Sampling methods and survey design help students understand how data is collected before any statistics are calculated. This cheat sheet explains how to choose samples fairly, write better survey questions, and recognize sources of bias. It is useful because poor sampling can make even accurate calculations misleading.
Students in statistics need these tools to judge whether conclusions from data are trustworthy.
The core ideas include identifying the population, choosing a sample, and using probability-based methods when possible. Important sampling methods include simple random sampling, stratified sampling, cluster sampling, and systematic sampling. Survey design focuses on avoiding biased wording, undercoverage, nonresponse, and voluntary response bias.
Useful formulas include response rate, sampling fraction, and approximate margin of error for proportions.
Key Facts
- In a simple random sample of size from a population of size , every possible group of individuals has the same chance of being selected.
- The sampling fraction is , where is the sample size and is the population size.
- In stratified random sampling, split the population into similar groups called strata, then take a random sample from each stratum.
- In cluster sampling, split the population into mixed groups called clusters, randomly choose some clusters, and survey everyone or many people inside those clusters.
- In systematic sampling, choose a random starting point and then select every th person, where .
- The response rate is .
- For a sample proportion , an approximate margin of error is for a rough confidence estimate.
- Larger random samples usually reduce sampling variability because the standard error for a proportion is .
Vocabulary
- Population
- The entire group of individuals or items that a study wants to learn about.
- Sample
- A smaller group selected from the population to provide data for a study.
- Simple Random Sample
- A sample chosen so that every possible group of size has an equal chance of being selected.
- Stratum
- A subgroup of the population whose members share an important characteristic, such as grade level or age group.
- Bias
- A systematic problem in data collection that makes results consistently favor some outcomes over others.
- Margin of Error
- An estimate of how far a sample statistic, such as , may be from the true population value.
Common Mistakes to Avoid
- Confusing random sampling with convenience sampling is wrong because choosing people who are easy to reach does not give every member of the population a fair chance.
- Using a large biased sample is wrong because increasing does not fix undercoverage, leading questions, or voluntary response bias.
- Treating a sample statistic as the exact population value is wrong because values such as vary from sample to sample.
- Forgetting to define the population is wrong because the sample can only support conclusions about the group it was chosen to represent.
- Using systematic sampling without checking for patterns is wrong because selecting every th person can be biased if the list has a repeating order.
Practice Questions
- 1 A school has students and wants a sample of students. What is the sampling fraction ?
- 2 A survey contacts adults, and respond. Find the response rate using .
- 3 A population has people, and a researcher wants a systematic sample of people. Estimate the interval .
- 4 A website poll asks visitors whether homework should be optional. Explain why this survey may suffer from voluntary response bias and what population it may fail to represent.
Understanding Sampling Methods & Survey Design
A good sample is meant to act like a small version of the whole population. That goal is harder than it sounds. The people on a school email list may differ from students who never check school email.
Students absent on survey day may have different experiences from those present. A random method protects against hidden preferences by the researcher, but it cannot fix a list that leaves out part of the population. Before sampling, make a clear sampling frame.
This is the actual list or source from which names will be chosen. Compare that frame with the population you want to describe.
Different methods solve different practical problems. Stratified sampling is useful when important groups could be missed or appear in very small numbers. A school survey about course choices might sample students from each grade.
This gives every grade a planned place in the data. Cluster sampling can save time when people are spread across a wide area. A researcher might randomly choose several classrooms, then survey the students in those rooms.
It is efficient, but students in one classroom may be more alike than students chosen across the whole school. That similarity can make the results less precise than a simple random sample of the same size. Systematic sampling is easy to run from an ordered list, but the order matters.
A pattern in the list can create bias. For example, selecting every tenth customer can fail if every tenth record belongs to a particular type of customer.
Sampling error is the natural difference between a sample result and the true population value. It happens even when the method is fair. A margin of error describes the likely size of this random uncertainty for a proportion.
It becomes smaller as the sample size grows, though doubling the sample size does not cut the margin of error in half. It takes about four times as many responses to reduce it by half. A margin of error does not measure bias.
If a survey misses people, receives very few replies, or uses leading wording, a large sample can still give a confidently wrong result. Students should separate random error from systematic error whenever they judge a claim.
Survey questions need careful testing before the main survey begins. Each question should ask one clear thing. A question about whether school lunches are healthy and affordable combines two separate ideas, so the answers are hard to interpret.
Response choices should cover realistic answers without pushing people toward one choice. The order of questions can matter because an earlier question may affect later answers. Sensitive topics need privacy, since people may change answers when they fear being identified.
A short pilot survey with a few people can reveal confusing wording, missing choices, or instructions that do not work. When reporting results, state who was sampled, how people were selected, how many responded, and any limits on the conclusion.