Interpreting hypothesis test results

Introduction to Statistics

George Boorman

Curriculum Manager, DataCamp

Life expectancy in Chicago vs. Bangkok

  • Null hypothesis:

    • There is no difference in life expectancy between Chicago residents and Bangkok residents
  • Alternative hypothesis:

    • Chicago residents have a longer life expectancy than Bangkok residents

Chicago chicago_skyline_at_night.jpg

Bangkok bangkok_skyline_at_dusk.jpg

Introduction to Statistics

Sampling distribution

sampling_histogram_of_life_expectancy_in_Chicago_and_Bangkok.png

Introduction to Statistics

Different samples

second_sample_histogram_of_life_expectancy_in_Chicago_and_Bangkok.png

Introduction to Statistics

Sampling distribution of mean life expectancy

sampling_distribution_of_mean_life_expectancy_per_city_following_two_bell_curve_shapes.png

Introduction to Statistics

p-value

  • $p$
    • Probability of achieving this result, assuming the null hypothesis is true

chicacgo_sample_means_distribution_annotated_with_p_value_for_mean_of_eighty_two.png

Introduction to Statistics

p-value

bangkok_and_chicago_sample_mean_distributions_with_p_value_annotated_as_the_overlap_between_the_two.png

Introduction to Statistics

Significance level ($\alpha$)

  • To reduce the risk of drawing a false conclusion:

    • Set a probability threshold for rejecting the null hypothesis
  • Known as $\alpha$ or significance level

  • Decided before data collection to minimize bias:

    • Otherwise they could choose a different $\alpha$ to serve their interests
  • A typical threshold is 0.05

    • 5% chance of wrongly concluding that Chicago residents live longer than Bangkok residents
  • If $p\leq\alpha$, reject the null hypothesis

  • These results are said to be statistically significant

Introduction to Statistics

Type I/II error

falsely_reject_the_null_hypothesis.png

Introduction to Statistics

Type I/II error

falsely_accept_the_null_hypothesis.png

Introduction to Statistics

Type I/II error

correctly_accept_the_null_hypothesis.png

Introduction to Statistics

Type I/II error

correctly_reject_the_null_hypothesis.png

Introduction to Statistics

Drawing a conclusion

sampling_distribution_of_mean_life_expectancy_per_city_following_two_bell_curve_shapes_with_overlap_annotated.png

Introduction to Statistics

Let's practice!

Introduction to Statistics

Preparing Video For Download...