The F-distribution is a probability distribution used when comparing variability, especially when studying ratios of sample variances. It is always nonnegative, so its curve starts at F = 0 and stretches to the right. The shape is right-skewed, with a long tail that depends on two degrees of freedom.
It matters because many statistical tests ask whether observed variation is larger than expected by chance.
Key Facts
- F = s1^2 / s2^2 when comparing two sample variances.
- In ANOVA, F = variation between groups / variation within groups.
- F >= 0 because variances cannot be negative.
- The F-distribution has two parameters: df1 for the numerator and df2 for the denominator.
- Large F values fall in the right tail and can provide evidence against the null hypothesis.
- For ANOVA, df1 = k - 1 and df2 = N - k, where k is the number of groups and N is the total sample size.
Vocabulary
- F-distribution
- A right-skewed probability distribution used to model ratios of independent variance estimates.
- Degrees of freedom
- The number of independent pieces of information used to estimate a quantity.
- Numerator degrees of freedom
- The degrees of freedom associated with the variance estimate in the top of an F ratio.
- Denominator degrees of freedom
- The degrees of freedom associated with the variance estimate in the bottom of an F ratio.
- ANOVA
- A statistical method that compares group means by analyzing variation between groups and within groups.
Common Mistakes to Avoid
- Treating the F-distribution as symmetric is wrong because it is right-skewed and only defined for F values at or above 0.
- Swapping df1 and df2 is wrong because the numerator and denominator degrees of freedom affect the shape and critical values differently.
- Using F to compare means directly is wrong because the F statistic compares ratios of variation, such as between-group variation to within-group variation.
- Thinking a large F value always proves a real effect is wrong because it only gives evidence relative to a significance level and assumptions such as independence and similar variances.
Practice Questions
- 1 Two independent sample variances are s1^2 = 18 and s2^2 = 6. Compute the F statistic using F = s1^2 / s2^2.
- 2 An ANOVA has k = 4 groups and N = 28 total observations. Find df1 and df2 for the F statistic.
- 3 In an ANOVA, explain why a much larger between-group variation than within-group variation leads to a large F value and what that suggests about the group means.