7.4.1 - Hypothesis Testing

7.4.1 - Hypothesis Testing

Five Step Hypothesis Testing Procedure

In the remaining lessons, we will use the following five step hypothesis testing procedure. This is slightly different from the five step procedure that we used when conducting randomization tests. 

  1. Check assumptions and write hypotheses. The assumptions will vary depending on the test. In this lesson we'll be confirming that the sampling distribution is approximately normal by visually examining the sampling distribution. In later lessons you'll learn more objective assumptions. The null and alternative hypotheses will always be written in terms of population parameters; the null hypothesis will always contain the equality (i.e., \(=\)).
  2. Calculate the test statistic. Here, we'll be using the formula below for the general form of the test statistic.
  3. Determine the p-value. The p-value is the area under the standard normal distribution that is more extreme than the test statistic in the direction of the alternative hypothesis.
  4. Make a decision. If \(p \leq \alpha\) reject the null hypothesis. If \(p>\alpha\) fail to reject the null hypothesis.
  5. State a "real world" conclusion. Based on your decision in step 4, write a conclusion in terms of the original research question.

General Form of a Test Statistic

When using a standard normal distribution (i.e., z distribution), the test statistic is the standardized value that is the boundary of the p-value. Recall the formula for a z score: \(z=\frac{x-\overline x}{s}\). The formula for a test statistic will be similar. When conducting a hypothesis test the sampling distribution will be centered on the null parameter and the standard deviation is known as the standard error.

General Form of a Test Statistic
\(test\;statistic=\dfrac{sample\;statistic-null\;parameter}{standard\;error}\)

This formula puts our observed sample statistic on a standard scale (e.g., z distribution). A z score tells us where a score lies on a normal distribution in standard deviation units. The test statistic tells us where our sample statistic falls on the sampling distribution in standard error units.


7.4.1.1 - Video Example: Mean Body Temperature

7.4.1.1 - Video Example: Mean Body Temperature

Research question: Is the mean body temperature in the population different from 98.6° Fahrenheit?


Video Walkthrough

7.4.1.2 - Video Example: Correlation Between Printer Price and PPM

7.4.1.2 - Video Example: Correlation Between Printer Price and PPM

Research question: Is there a positive correlation in the population between the price of an ink jet printer and how many pages per minute (ppm) it prints?


Video Walkthrough

7.4.1.3 - Example: Proportion NFL Coin Toss Wins

7.4.1.3 - Example: Proportion NFL Coin Toss Wins

Research question: Is the proportion of NFL overtime coin tosses that are won different from 0.50?


StatKey was used to construct a randomization distribution:

Screenshot of StatKey randomization distribution

 

Step 1: Check assumptions and write hypotheses

From the given StatKey output, the sampling distribution is approximately normal.

\(H_0\colon p=0.50\)

\(H_a\colon p \ne 0.50\)

Step 2: Calculate the test statistic

\(test\;statistic=\dfrac{sample\;statistic-null\;parameter}{standard\;error}\)

The sample statistic is the proportion in the original sample, 0.561. The null parameter is 0.50. And, the standard error is 0.024.

\(test\;statistic=\dfrac{0.561-0.50}{0.024}=\dfrac{0.061}{0.024}=2.542\)

Step 3: Determine the p value

The p value will be the area on the z distribution that is more extreme than the test statistic of 2.542, in the direction of the alternative hypothesis. This is a two-tailed test:

Minitab Express output of a z distribution, the area more extreme than z= 2.542 is highlighted

The p value is the area in the left and right tails combined: \(p=0.0055110+0.0055110=0.011022\)

Step 4: Make a decision

The p value (0.011022) is less than the standard 0.05 alpha level, therefore we reject the null hypothesis.

Step 5: State a "real world" conclusion

There is evidence that the proportion of all NFL overtime coin tosses that are won is different from 0.50

 


7.4.1.4 - Example: Proportion of Students Female

7.4.1.4 - Example: Proportion of Students Female

Research question: Are more than 50% of all World Campus STAT 200 students female?

Data were collected from a representative sample of 501 World Campus STAT 200 students. In that sample, 284 students were female and 217 were male. 


StatKey was used to construct a sampling distribution using randomization methods:

Randomization Dotplot of Proportion; Null hypothesis p=0.5

Because this sampling distribution is approximately normal, we can find the p value by computing a standardized test statistic and using the z distribution.

Step 1: Check assumptions and write hypotheses

The assumption here is that the sampling distribution is approximately normal. From the given StatKey output, the sampling distribution is approximately normal. 

\(H_0\colon p=0.50\)
\(H_a\colon p>0.50\)

2. Calculate the test statistic

\(test\;statistic=\dfrac{sample\;statistic-hypothesized\;parameter}{standard\;error}\)

The sample statistic is \(\widehat p = 284/501 = 0.567\).

The hypothesized parameter is the value from the hypotheses: \(p_0=0.50\).

The standard error on the randomization distribution above is 0.022.

\(test\;statistic=\dfrac{0.567-0.50}{0.022}=3.045\)

3. Determine the p value

We can find the p value by constructing a standard normal distribution and finding the area under the curve that is more extreme than our observed test statistic of 3.045, in the direction of the alternative hypothesis. In other words, \(P(z>3.045)\):

Distribution Plot - Normal, Mean=0, StDev=1

Our p value is 0.0011634

4. Make a decision

Our p value is less than or equal to the standard 0.05 alpha level, therefore we reject the null hypothesis.

5. State a "real world" conclusion

There is evidence that the proportion of all World Campus STAT 200 students who are female is greater than 0.50.


7.4.1.5 - Example: Mean Quiz Score

7.4.1.5 - Example: Mean Quiz Score

Research question: Is the mean quiz score different from 14 in the population?


StatKey was used to construct a randomization distribution:

Randomization distribution constructed in StatKey

Step 1: Check assumptions and write hypotheses

From the given StatKey output, the sampling distribution is approximately normal.

\(H_0\colon \mu = 14\)

\(H_a\colon \mu \ne 14\)

Step 2: Calculate the test statistic

\(test\;statistic=\dfrac{sample\;statistic-null\;parameter}{standard\;error}\)

The sample statistic is the mean in the original sample, 13.746 points. The null parameter is 14 points. And, the standard error, 0.142, can be found on the StatKey output.

\(test\;statistic=\dfrac{13.746-14}{0.142}=\dfrac{-0.254}{0.142}=-1.789\)

Step 3: Determine the p value

The p value will be the area on the z distribution that is more extreme than the test statistic of -1.789, in the direction of the alternative hypothesis:

Minitab Express output showing the area more extreme than z = -1.789

This was a two-tailed test. The p value is the area in the left and right tails combined: \(p=0.0368074+0.0368074=0.0736148\)

Step 4: Make a decision

The p value (0.0736148) is greater than the standard 0.05 alpha level, therefore we fail to reject the null hypothesis.

Step 5: State a "real world" conclusion

There is not evidence that the mean quiz score in the population is different from 14 points. 


7.4.1.6 - Example: Difference in Mean Commute Times

7.4.1.6 - Example: Difference in Mean Commute Times

Research question: Do the mean commute times in Atlanta and St. Louis differ in the population? 


StatKey was used to construct a randomization distribution:

Screenshot of the randomization distribution constructed in StatKey

Step 1: Check assumptions and write hypotheses

 From the given StatKey output, the sampling distribution is approximately normal.

\(H_0: \mu_1-\mu_2=0\)

\(H_a: \mu_1 - \mu_2 \ne 0\)

Step 2: Compute the test statistic

\(test\;statistic=\dfrac{sample\;statistic - null \; parameter}{standard \;error}\)

The observed sample statistic is \(\overline x _1 - \overline x _2 = 7.14\). The null parameter is 0. And, the standard error, from the StatKey output, is 1.136.

\(test\;statistic=\dfrac{7.14-0}{1.136}=6.285\)

Step 3: Determine the p value

The p value will be the area on the z distribution that is more extreme than the test statistic of 6.285, in the direction of the alternative hypothesis:

Minitab Express output: Normal distribution showing the area more extreme than 6.285

This was a two-tailed test. The area in the two tailed combined is 0.000000. Theoretically, the p value cannot be 0 because there is always some chance that a Type I error was committed. This p value would be written as p < 0.001.

Step 4: Make a decision

The p value is smaller than the standard 0.05 alpha level, therefore we reject the null hypothesis. 

Step 5: State a "real world" conclusion

There is evidence that the mean commute times in Atlanta and St. Louis are different in the population. 


Legend
[1]Link
Has Tooltip/Popover
 Toggleable Visibility