The hypothesis testing framework
vs , sig level , test statistic, decision, contextual conclusion.
Five-step recipe.
- Hypotheses. is the equality / status quo; is what we are testing FOR.
- Distribution under . Identify the test statistic and its distribution.
- Compute either:
- p-value: probability of an outcome at least as extreme as observed, under .
- Critical region: set of test statistic values that lead to rejecting at level .
- Decision. Reject if p-value (equivalently, test stat in critical region).
- Conclusion IN CONTEXT. Translate back to the scenario.
Worked outline. 'A coin is flipped times and gets heads. Is the coin biased?'
- vs (two-tail).
- Under , .
- p-value for a symmetric distribution.
- Compare to .
- 'At the level, [is / is not] sufficient evidence that the coin is biased.'
Symmetry vs framework. The five-step framework is universal; only the distribution changes between binomial, Poisson, and normal tests.
- Hypotheses ( equality, inequality).
- Distribution under .
- p-value OR critical region.
- Decision.
- Contextual conclusion.