What is a Survey?

A survey is a structured method of collecting information from a sample of people by presenting them with the same questions in the same order and format, so that responses can be counted, compared across respondents and groups, and, when the sample allows, generalized to a population. The word covers the whole design (who is asked, how they're chosen, how the questions are built, how the data is analyzed); the questionnaire is the instrument inside it. Surveys are the core tool of quantitative research and they span a range: a two-question in-product prompt, a fifteen-minute concept test, a national tracking study. What unites them is the trade they make: breadth and comparability in exchange for depth and the ability to follow up.

What Surveys Are Good For

Measuring how many. The share of users who do, want, know, or feel something: prevalence, which small qualitative samples cannot estimate.

Comparing groups and tracking change. Segments against each other; this quarter against last, with a fixed instrument and comparable samples.

Prioritizing at scale. Which of many needs, features, or messages matter most across the audience, through MaxDiff, importance ratings, and conjoint.

Collecting attitudes and self-report cheaply. Satisfaction, intent, awareness, and perceived usability from hundreds of people in a day.

Validating qualitative findings. A problem found in five interviews, sized across five hundred respondents.

What Surveys Can't Do

They can't explain: a survey knows that 40% are dissatisfied and not why, unless an open question catches some of it. They can't observe: self-report of behavior diverges from behavior, and only watching or usage data closes the gap. They can't follow up: the question that should have been asked next wasn't. They can't ask about what people haven't imagined, which rules out discovery. And they inherit every bias in this glossary: sampling, non-response, response, and the instrument's own leading. Mixed designs cover the gaps: a survey for the how many, recorded answers for the why, a task for the actual behavior, which is the reason modern platforms (Ballpark among them) treat surveys as one block in a study rather than the study.

The Decisions That Decide Whether the Numbers Mean Anything

1. Who is the population, and how is the sample drawn?
Define the audience, choose probability or screened non-probability sampling knowingly, and scope the claims to the method. Sample size governs precision (margin of error); selection method governs bias, and no size fixes bias.

2. What exactly is being measured?
Constructs defined before questions are written, with validated instruments for anything tracked, the validity work up front.

3. How are the questions built?
Neutral wording, one idea per question, balanced labeled scales, behavior before opinion, no leading binaries: the questionnaire-design craft.

4. How long is it?
As short as the decision allows; every question past the essential costs completion and attention (fatigue), and front-loading the critical items protects them from abandonment.

5. Was it piloted?
A pilot with a handful of real respondents catches the misread question and the broken logic before the full sample hits them.

6. How is the data cleaned and analyzed?
Pre-set exclusion rules, a fixed reporting convention, uncertainty reported with every estimate, and subgroup analysis planned rather than mined.

Survey Types, Briefly

Cross-sectional (one point in time) versus longitudinal and tracking (repeated waves, fixed instrument). Relationship versus transactional (NPS about the whole relationship; CSAT and CES about a moment). In-product intercepts (short, contextual, high volume) versus emailed or panel-recruited studies (longer, screened, better sampled). And embedded survey blocks inside mixed studies, where a few questions sit beside tasks and recorded answers and borrow their context.

Specialized survey formats have their own entries: the intercept survey that catches visitors mid-experience, word association for unprompted perceptions, and gamification for the engagement techniques that help and the ones that distort.

In Short

A survey asks a sample the same questions the same way, to count, compare, prioritize, and track. It measures how many and not why, self-report and not behavior, the imagined and not the undiscovered. Its numbers mean something only if the sample was chosen knowingly, the constructs defined, the questions built neutrally, the length disciplined, the pilot run, and the analysis pre-planned. Done that way it is the fastest route from a question to a number; done casually it is the fastest route to a confident wrong one.