Goal: make decisions about the value of a parameter.
We have confidence intervals, but we might also want to ask questions like
- Do cans of soda actually contain 12 oz?
- Is Medicine A better than Medicine B?
Goal: make decisions about the value of a parameter.
We have confidence intervals, but we might also want to ask questions like
A hypothesis is a statement that something is true.
A hypothesis test involves two (competing) hypotheses:
A hypothesis test helps us decide whether the null hypothesis should be rejected in favor of the alternative.
Cans of soda are labeled with “12 FL OZ”. Is this accurate?
The default, or uninteresting, assumption is that cans of soda contain 12 oz.
We can write these hypotheses in words or in statistical notation.
The null specifies a single value of \(\mu\)
We call \(\mu_0\) the null value. When we run a hypothesis test, \(\mu_0\) will be replaced by some number.
The alternative specifies a range of possible values for \(\mu\):
In the US court system, jurors are told to assume the defendant is “innocent until proven guilty”.
Innocence is the default assumption, so
The burden of proof lies on the alternative hypothesis.
Notice the careful language in the logic of hypothesis testing: we either reject, or fail to reject, the null hypothesis.
We never “accept” a null hypothesis.
\(H_0\) is | |||
---|---|---|---|
True | False | ||
Decision | Do not reject \(H_0\) | Correct decision | Type II Error |
Reject \(H_0\) | Type I Error | Correct decision |
In our jury trial,
A Type I error is concluding guilt when the defendant is innocent.
A Type II error is failing to convict when the person is guilty.
\(P(\)Type I Error\()=\alpha\), the significance level.
\(P(\)Type II Error\()=\beta\).
We would like both \(\alpha\) and \(\beta\) to be small but,
In practice, we set \(\alpha\) (as we did in confidence intervals).
We can improve \(\beta\) by increasing sample size.
Consider two possible criminal charges:
Since these are moral questions, I will let you consider the consequences of each type of error.
However, keep in mind that we do make scientific decisions that have lasting impacts on people’s lives.
When we write these types of conclusions, we will write them in the context of the problem.