Degrees of freedom tell you how many independent pieces of information are still free to vary after you use the data to satisfy a constraint. They matter because many statistical distributions change shape depending on this number. In practice, degrees of freedom help choose the correct t, chi-square, or F distribution for a hypothesis test or confidence interval.
A simple way to remember the idea is: data points minus restrictions equals remaining freedom.
A constraint is often created when a parameter is estimated from the same data, such as using the sample mean to estimate the population mean. If a sample has n values and its mean is fixed, only n - 1 values can vary freely because the last value must make the total come out correctly. This is why the sample variance uses n - 1 in the denominator instead of n.
As degrees of freedom increase, t and chi-square distributions become less spread out in predictable ways and often move closer to familiar limiting shapes.
Key Facts
- Degrees of freedom = number of independent values that can vary after constraints are applied.
- For one sample mean, df = n - 1.
- Sample variance uses s^2 = Σ(x_i - x̄)^2 / (n - 1).
- For a one-sample t test, t = (x̄ - μ0) / (s / √n) with df = n - 1.
- For a chi-square goodness-of-fit test, df = number of categories - 1 - number of estimated parameters.
- For a two-sample independent t test with equal variances, df = n1 + n2 - 2.
Vocabulary
- Degrees of freedom
- The number of independent pieces of information that remain after accounting for constraints or estimated parameters.
- Constraint
- A condition that limits how data values can vary, such as requiring all deviations from the mean to add to zero.
- Sample variance
- A measure of spread in a sample that averages squared deviations from the sample mean using n - 1 degrees of freedom.
- t distribution
- A probability distribution used when estimating a mean with an unknown population standard deviation, especially for small samples.
- Chi-square distribution
- A right-skewed distribution used for tests involving counts, variances, and sums of squared standardized quantities.
Common Mistakes to Avoid
- Using n instead of n - 1 for a one-sample t test. This is wrong because estimating the sample mean uses one degree of freedom.
- Forgetting to subtract estimated parameters in a chi-square goodness-of-fit test. This is wrong because each fitted parameter adds a constraint to the expected counts.
- Treating degrees of freedom as the same as sample size. This is wrong because degrees of freedom depend on both sample size and the number of constraints.
- Using the wrong numerator and denominator degrees of freedom in an F test. This is wrong because the F distribution is identified by two separate degrees of freedom values tied to two variance estimates.
Practice Questions
- 1 A sample has n = 12 observations. What are the degrees of freedom for estimating the sample variance and for a one-sample t test?
- 2 A chi-square goodness-of-fit test has 6 categories, and 1 parameter is estimated from the data. What are the degrees of freedom?
- 3 Explain why, if five data values have a fixed mean of 10, only four of the values can be chosen freely.