Experimental Design and Causal Inference Primer Cheat Sheet
A printable reference covering randomization, bias, treatment effects, confounding, blocking, power, and causal diagrams for college.
Related Tools
Related Labs
Related Worksheets
Related Infographics
Experimental design and causal inference help students understand when data can support a cause and effect claim. This cheat sheet covers randomized experiments, observational studies, treatment effects, confounding, blocking, and basic causal diagrams. Students need these tools to separate association from causation and to judge whether a study design answers the question being asked. The goal is to connect statistical comparisons with the assumptions that make causal conclusions valid. The most important ideas are potential outcomes, random assignment, control groups, and adjustment for confounders. A treatment effect is often written as a difference in outcomes, such as , even though only one potential outcome is observed for each unit. Randomization makes treatment assignment independent of potential outcomes, written . In observational studies, causal claims require careful assumptions, such as no unmeasured confounding and proper adjustment for variables that affect both treatment and outcome.
Key Facts
- The individual causal effect is , but only one of or is observed for each unit.
- The average treatment effect is , which summarizes the mean causal effect in a target population.
- In a randomized experiment, treatment assignment satisfies , so treated and control groups are comparable in expectation.
- A simple difference in means estimator is , where is the treated mean and is the control mean.
- Confounding occurs when a variable affects both treatment and outcome , creating a backdoor path such as .
- Blocking or stratification improves precision by comparing treatment groups within levels of an important variable, then combining stratum estimates.
- A standard error for a difference in independent means is .
- A common approximate confidence interval for a treatment effect is , where depends on the confidence level.
Vocabulary
- Random assignment
- A design method where units are assigned to treatment conditions by chance so that groups are comparable before treatment.
- Potential outcome
- The outcome a unit would have under a specific treatment condition, such as under treatment or under control.
- Average treatment effect
- The expected difference between potential outcomes in a population, written .
- Confounder
- A variable that influences both the treatment and the outcome, which can make an association look causal when it is not.
- Blocking
- A design strategy that groups similar units before random assignment to reduce variation and improve precision.
- Causal diagram
- A graph using arrows to represent assumed causal relationships among variables.
Common Mistakes to Avoid
- Treating correlation as causation is wrong because an association between and may be explained by a confounder rather than a causal effect.
- Adjusting for a collider is wrong because conditioning on a variable caused by both and can create a false association between them.
- Ignoring random assignment failures is wrong because noncompliance, attrition, or missing data can break the comparability that randomization was meant to create.
- Comparing raw group means in an observational study is wrong when treatment groups differ on variables that also affect the outcome.
- Using a tiny sample without considering power is wrong because a study may have a large and fail to detect meaningful effects.
Practice Questions
- 1 In an experiment, the treated group has , , and the control group has , . Compute .
- 2 Given , , , and , compute .
- 3 A blocked experiment has stratum effects and with stratum weights and . Compute .
- 4 A study finds that students who attend extra tutoring have higher test scores, but tutoring was voluntary. Explain why this evidence alone may not justify the causal claim that tutoring caused higher scores.