Sampling and bias are central to understanding how psychologists study behavior and mental processes. This cheat sheet helps students identify who is being studied, how participants are selected, and whether results can fairly apply to a larger group. It is especially useful for evaluating experiments, surveys, case studies, and correlational research.
Strong sampling methods make research conclusions more trustworthy.
The core idea is that a sample should represent the population researchers want to understand. Random sampling gives every member of a population an equal chance of selection, while biased sampling can overrepresent or underrepresent certain groups. Bias can also appear through wording, researcher expectations, participant behavior, or missing responses.
To judge a study, students should ask whether the sample is representative, whether the method reduces bias, and whether the findings can be generalized.
Key Facts
- A population is the entire group a researcher wants to draw conclusions about.
- A sample is the smaller group of participants actually studied in a research project.
- Random sampling means every member of the population has an equal chance of being selected.
- A representative sample closely matches the population on important characteristics such as age, gender, culture, or experience.
- Sampling bias occurs when some members of the population are more likely to be included than others, making results less accurate.
- Generalizability is strongest when the sample is large, diverse, and representative of the target population.
- Response bias occurs when participants answer in a way that does not reflect their true thoughts, feelings, or behaviors.
- A larger sample can reduce random error, but it cannot fix a biased sampling method.
Vocabulary
- Population
- The full group of people or cases a researcher wants to understand or make claims about.
- Sample
- The subset of people or cases selected from a population to participate in a study.
- Random Sampling
- A sampling method in which every member of the population has an equal chance of being chosen.
- Representative Sample
- A sample that reflects the key characteristics of the population being studied.
- Sampling Bias
- A systematic problem in participant selection that makes the sample different from the population in an important way.
- Generalizability
- The extent to which research findings can be applied to people or situations beyond the study sample.
Common Mistakes to Avoid
- Confusing a sample with a population is wrong because the sample is only the group studied, while the population is the larger group researchers want to understand.
- Assuming a large sample is always representative is wrong because a big sample can still be biased if participants come from only one narrow group.
- Treating convenience sampling as random sampling is wrong because choosing whoever is easiest to reach does not give everyone an equal chance of selection.
- Ignoring nonresponse bias is wrong because people who choose not to answer may differ in important ways from those who participate.
- Generalizing results too broadly is wrong because findings from one age group, culture, school, or setting may not apply to all people.
Practice Questions
- 1 A psychologist wants to study stress in all high school seniors in a city but surveys 80 seniors from one private school. Identify the population and the sample.
- 2 A researcher randomly selects 200 names from a list of 2,000 eligible students. What percent of the population is included in the sample?
- 3 A survey about sleep habits is posted only in an online gaming forum, and 500 people respond. Name one likely sampling bias and explain how it could affect the results.
- 4 Why might a smaller randomly selected sample produce more trustworthy conclusions than a larger convenience sample?
Understanding Sampling and Bias in Research Reference
Sampling problems often begin before anyone is invited to take part. Researchers must define the group they mean with enough precision. A study of stress in teenagers may mean students aged thirteen to eighteen, but it might accidentally reach only pupils attending one high-performing school.
The results may describe that school well while saying little about teenagers who work after school, are absent often, live in rural areas, or have limited internet access. A clearly defined target group helps researchers choose a suitable recruitment method and prevents broad claims from narrow evidence.
Different sampling methods create different risks. Convenience sampling uses people who are easy to reach, such as university students, clinic visitors, or followers of a social media account. It is quick and cheap, yet those volunteers may share features that matter to the result.
Volunteer samples can contain people who are especially interested in the topic or who have strong views. In a survey about sleep, people with serious sleep difficulties may be more motivated to respond. Stratified sampling can reduce this problem.
Researchers divide the target group into relevant categories, then select participants from each category in proportions that reflect the group being studied. This is useful when age, location, income, or cultural background could affect the outcome.
Random selection does not guarantee a perfect sample every time. Chance can still produce a group with an unusual number of people from one background, especially when the group is small. Researchers therefore report sample size and participant details so readers can judge the evidence.
They may compare their sample with census data or school records to spot major gaps. A large survey of only one online gaming community can be less useful than a smaller, carefully selected survey across several communities. Size reduces the effect of random fluctuations, but it does not remove a systematic gap caused by who was invited or who chose to reply.
Students should separate sampling issues from other weaknesses in a study. A biased sample mainly limits how far a finding can be applied beyond the people studied. It does not automatically prove that the measured pattern is false within that group.
For example, an experiment with adults from one city may still show a reliable effect in those participants, provided its procedures were sound. However, researchers should not claim the effect applies equally to children, older adults, or people in different cultures without further evidence.
Pay attention to recruitment details, exclusion rules, dropout rates, and missing responses. These details reveal whose experiences were counted, whose were left out, and how cautious the conclusion should be.