# Single sample hypothesis testing, II /02/2004

Save this PDF as:

Size: px
Start display at page:

## Transcription

1 Single sample hypothesis testing, II /02/2004

2 Outline Very brief review One-tailed vs. two-tailed tests Small sample testing Significance & multiple tests II: Data snooping What do our results mean? Decision theory and power

3 Brief review Null and alternative hypothesis Null: only chance effects Alternative: systematic + chance effects Assume the null is true Given this assumption, how likely is it that we d see values at least as extreme as the ones we got? If it s highly unlikely, reject the null hypothesis, and say the results are statistically significant. The results are due to a combination of chance and a systematic effect.

4 Key Concepts H 0 and H a are contradictory (mutually exclusive) Support for H a can only be obtained indirectly -- by rejecting H 0 Rationale: We can never prove anything true, but we can prove something false We know the value of the parameter given H 0 but not given H a

5 Why bother with H a at all? The alternative hypothesis describes the condition that is contrary to the null hypothesis, and this can be directional or non-directional Directional: The effect only occurs in a specific direction -- increases or decreases Non-directional: The effect may be greater or less than a population parameter

6 Outline Very brief review One-tailed vs. two-tailed tests Small sample testing Significance & multiple tests II: Data snooping What do our results mean? Decision theory and power

7 A Tale of Two Tails Directional hypotheses are called one-tailed We are only interested in deviations at one tail of the distribution Non-directional hypotheses are called twotailed We are interested in any significant deviations from H 0

8 The p-value for a test of H : µ = µ against: o o H a : µ> µ o is prob z H a : µ< µ o is prob z H a : µ µ o is prob z Figure by MIT OCW.

9 How do you decide to use a one- or two-tailed approach? A one-tailed approach is more liberal -- it is more likely to declare a result significant. t crit = %, one-tailed t crit = %, two-tailed There s no one right answer as to which test to use. People will debate this point. z obt p 2p

10 One Tail or Two? The moderate approach: If there s a strong, prior, theoretical expectation that the effect will be in a particular direction (A>B), then you may use a one-tailed approach. Otherwise, use a two-tailed test. Because only an A>B result is interesting, concentrate your attention on whether there is evidence for a difference in that direction. E.G. does this new educational reform improve students test scores? Does this drug reduce depression?

11 Examples of the moderate approach Is the age of this class different than the average age at MIT? Do you pay less for an education at a state university than you do at an Ivy League college? Is this class more boring than the norm for an MIT class?

12 Age Distribution Age Probability Density

13 Cost of an Ivy Education Cost Probability Density

14 Number of Doodles Doodles Probability Density

15 One tail or two? The moderately conservative approach: The problem with the moderate approach is that you probably would actually find it interesting if the result went the other way, in many cases. If the new educational reform leads to worse test scores, we d want to know! If the new drug actually increases symptoms of depression, we d want to know!

16 One tail or two? The moderately conservative approach: Only use a one-tailed test if you not only have a strong hypothesis about the directionality of the results (A>B) but if it could also be argued that a result in the wrong tail (A<B) is meaningless, and might as well be due to chance. Put another way, only use a one-tailed test if you would not have been tempted, if the result went the wrong way, to switch to a two-tailed test (or switch the direction of your one-tailed test). It s tough to meet this criterion.

17 The moderately conservative approach: a possible example It s known how well students typically do on a intro statistics class. You test a new self-paced study guide, in addition to the instruction the students usually get, and have reason to believe this will improve how well they do in class. You might well consider any evidence that the students do worse as simply due to chance. After all, the students are getting the exact same instruction as they usually do the study guide is extra. The moderately conservative approach would allow a onetailed test in this case.

18 One tail or two: The conservative approach Always use two-tailed tests. More on one- vs. two-tailed tests later in the lecture.

19 Outline Very brief review One-tailed vs. two-tailed tests Small sample testing Significance & multiple tests II: Data snooping What do our results mean? Decision theory and power

20 Significance testing for small samples z-test is for known standard error, or large sample size (N>30) As you might imagine, for small sample sizes, we can again use the t-distribution instead, resulting in a t-test.

21 Example t-test A researcher needs to calibrate a spectrophotometer used to measure carbon monoxide (CO) concentration in the air. This is done by measuring the CO concentration in a special manufactured gas sample ( span gas ), known to have a precisely controlled concentration of 70 ppm. If the machine reads close to 70 ppm, it s ready for use. If not, it needs to be adjusted.

22 Spectrophotometer calibration One day the technician makes five readings on the span gas: 78, 83, 68, 72, 88. Can these readings have occurred by chance, if the machine is set properly, or do they show bias, i.e. that the machine needs to be adjusted? H 0 : µ = 70 ppm H a : µ 70 ppm

23 Calculate the test statistic As before (with the z-test) we calculate the test statistic, t obt = (observed expected)/se Under H 0, expected = µ = 70 ppm Observed = m = 77.8 ppm We don t know the SE of the mean, given H 0, but we can estimate it by SD/sqrt(N). But for this small sample size (N=5), we then need to use a t-test instead of a z-test. SD 8.07 ppm Note this is the SD estimate where we divide by N-1, not N

24 Calculate the test statistic m = 77.8 ppm, SE = 8.07/sqrt(5) 3.61ppm t obt = ( )/

25 Find the p-value t obt = 2.2, d.f. = 4 From the table in the back of your book, it looks like we re dealing with the 5% column. Degrees of freedom 10% 5% 1%

26 Find the p-value However, this 5% is the area under one tail of the t-distribution. Recall the alternative hypothesis: H a : µ 70 ppm We are interested in whether the spectrophotometer is off in either direction from 70 ppm. This means we should be doing a 2-tailed t-test. Note your book does a 1-tailed test, which doesn t really match H a. p = 2(0.05) = 0.10 This isn t much evidence against the null hypothesis, so we might decide not to calibrate.

27 Report the results The spectrophotometer readings (M=77.8, SD=8.07) were not significantly different from those expected from a calibrated machine (t(4)=2.2, p=0.10, two-tailed).

28 Outline Very brief review One-tailed vs. two-tailed tests Small sample testing Significance & multiple tests II: Data snooping What do our results mean? Decision theory and power

29 Significance and multiple tests (from the last lecture) Point of testing is to distinguish between real differences and chance variation. Does statistical significance mean that the result cannot be explained by chance variation? No. Once in a while, an event that is unlikely to occur due to chance can actually occur. We talked about this with confidence intervals roughly 1 in 20 times, the true mean fell outside of the 95% confidence interval.

30 Significance and multiple tests Put another way, a researcher who runs 100 tests can expect to get 5 results which are statistically significant (p<0.05), and one which is highly significant (p<0.01), even if the null hypothesis is correct in every case. You cannot tell, for sure, whether a difference is real or just coincidence. This is why science requires replicable results. If n independent tests all show a statistically significant result, the probability of this happening due to chance is very small.

31 A special case of multiple tests: data snooping Data snooping = deciding which tests to do once you ve seen the data. Examples: Disease clusters One-tailed vs. two-tailed tests

32 Data snooping: Disease clusters Liver cancer is rare. The chance of having 2 or more cases in a given town in a year (a cluster ) with 10,000 inhabitants is about 0.5% A cluster of liver cancer cases causes a researcher to search for causes, like water contamination. But, with a bunch of small towns of this size, looked at over a 10-year time period, it s likely you ll see a few clusters like this. 100 towns x 10 years = 1000 cases *1000 = 5.

33 Data snooping: One-tailed vs. twotailed significance testing This is where you look at your data to see whether your sample average is bigger or smaller than expected, before you choose your statistical test. H 0 : µ=50 m = 65, so, uh, H a : µ > 50. So, I ll do a one-tailed t-test looking at the upper tail This is not allowed, and many statisticians recommend always using two-tailed tests, to guard against this temptation.

34 Consequences of data snooping: 1-tailed vs. 2-tailed tests Suppose H 0 : µ = 20. You set α=0.05 as your criterion, and initially plan a 1-tailed test (H a : µ > 20). Running the experiment, you find that m=15. Oops, you switch to a 2-tailed test to see if this is significant. What is p?

35 Data snooping & the switch to a 2- tailed test Reject the null hypothesis if z obt falls in the 5% region of the upper tail (1-tailed test) Or, switching to a 2-tailed test with α=0.05, if it falls in the 2.5% region of the lower tail. Thus, if z obt passes the test, you should report p<0.075, not p<0.05. Probably the researcher incorrectly reports p<0.05. This is like a one-and-a-half tailed test.

36 Switching to a 2-tailed test

37 Data snooping and the switch to a 1- tailed test Similiarly, you might start off assuming you ll do a 2- tailed test, with α= % in each of the two tails But when you get the data, z obt isn t big enough to fall in the 2.5% region of the upper tail, but is big enough to fall in the 5% region of the upper tail. You decide to switch to a 1-tailed test. Again, this amounts to a one-and-a-half tailed test. Reject the null hypothesis if z obt falls in the 2.5% region of the lower tail (2-tailed test), Or, switching to a 1-tailed test, if z obt falls in the 5% region of the upper tail.

38 Correcting for one- vs. two-tailed tests If you think a researcher has run the wrong kind of test, it s easy to recalculate the p- value yourself. p(one-tailed) = ½ p(two-tailed) 1.5 p(one-tailed) = p(1.5-tailed) Etc.

39 A special case of multiple tests: data snooping If you re going to use your data to pick your statistical test, you should really test your conclusions on an independent set of data. Then it s like you used pilot data (or other previous experiments) to form your hypothesis, and tested the hypothesis independently on other data. This is allowed.

40 Outline Very brief review One-tailed vs. two-tailed tests Small sample testing Significance & multiple tests II: Data snooping What do our results mean? Decision theory and power

41 What do our results mean? Significance Importance Size of the effect Does the difference prove the point?

42 Was the result significant? There is no true sharp dividing line between probable and improbable results. There s little difference between p=0.051 and p=0.049, except that some journals will not publish results at p=0.051, and some readers will accept results at p=0.049 but not at p=0.051.

43 Was the result important? Significant does not mean you care about it. Some of what important means has to do with what you re studying.

44 Importance and what you are studying Suppose you give children a vocabulary test consisting of 40 words that the child must define. 2 points are given for a correct answer, 1 point for a partially correct answer. City kids, ages 6-9, are known to average 26 points on this test. Study 2500 rural kids, ages 6-9. Rural kids get an average of 25 points. This difference from the expected 26 points is highly significant. We would probably really do a two-sample test here, not a onesample test. But we don t cover that until next week

45 Importance and what you are studying But is the result important? The z-test only tells us that this one point difference is unlikely to have occurred by chance. Suppose you studied the entire population, and found this difference between rural and big city kids. What would this difference mean? A one-point difference in average scores only amounts to partial credit on one word out of a test of 40 words. If anything, the investigators have provided evidence that there is almost no difference between rural and big city kids on this test.

46 Was the result important? The p-value of a test depends upon the sample size. z obt = (observed expected)/se (same idea with t obt ) SE has a sqrt(n) in the denominator as N increases, SE decreases, and z obt (t obt ) increases. As N increases, the same difference between observed & expected becomes more significant. An important result can be non-significant just because you didn t take a big enough sample. A very small, unimportant result can be significant just because the sample size is so big.

47 Picking N As with confidence intervals, we can estimate what sample size we should use, for a given anticipated effect size. For the vocabulary test example, suppose an effect is only important if the rural kids scores are at least 10 points different from the city kids score of 26. How many rural kids should we give the vocabulary test to, if we want to be able to detect a significant difference of this size, with α=0.01?

48 Picking N For α=0.01, z crit = 2.58 z obt = (observed expected)/se SE = SD/sqrt(N) Need to approximate SD, either from previous data, or just by taking a guess. Here, we guess SD = 10 z obt = 10/(10/sqrt(N)) = sqrt(n) A difference of 10 will be highly significant if sqrt(n) > 2.58, which implies we need a sample size of at least , i.e. N 7. Note in the example, N=2500!

49 Does the difference prove the point the study was designed to test? No, a test of significance does not check the design of the study. (There are tons of things that could go wrong, here.) Is it a simple random sample, or is there some bias? Did our poll call only phone numbers in the phonebook? Could the result be due to something other than the intended systematic effect? Did drug study subjects figure out whether they had been given the true drug vs. placebo? Is the null hypothesis appropriate? Does it assume that the stimulus levels are randomly selected, when actually they follow a pattern the subject might notice?

50 Outline Very brief review One-tailed vs. two-tailed tests Small sample testing Significance & multiple tests II: Data snooping What do our results mean? Decision theory and power

51 Decisions, Decisions... Hypothesis testing is an example of the application of decision theory We want to use the evidence from our sample to decide between two hypotheses This involves a trade-off between different types of errors

52 Decision theory and tradeoffs between types of errors Think of a household smoke detector. Sometimes it goes off and there s no fire (you burn some toast, or take a shower). A false alarm. A Type I error. Easy to avoid this type of error: take out the batteries! However, this increases the chances of a Type II error: there s a fire, but no alarm.

53 Decision theory and tradeoffs between types of errors Similarly, one could reduce the chances of a Type II error by making the alarm hypersensitive to smoke. Then the alarm will by highly likely to go off in a fire. But you ll increase your chances of a false alarm = Type I error. (The alarm is more likely to go off because someone sneezed.) There is typically a tradeoff of this sort between Type I and Type II errors.

54 A table No fire Fire No alarm No error Type II Alarm Type I No error

55 A table Truth about the population H o true (No fire) H a true (Fire) Decision based on sample Accept H o (No alarm) Reject H o (Alarm) No error (correct null response) Type I (false alarm) Type II (miss) No error (hit)

56 More on the tradeoff between Type I and Type II errors Consider the null hypothesis, H 0 : µ=µ 0 Sampling distribution of the mean, m, given true mean µ o. µ ο

57 More on the tradeoff between Type I and Type II errors And the alternative: Sampling distribution of the mean, m, if there is a real, systematic effect. µ ο µ a Here s the mean if there s a systematic effect. Often we don t know this.

58 More on the tradeoff between Type I and Type II errors We set a criterion for deciding an effect is significant, e.g. α=0.05, one-tailed. µ ο µ a criterion α=0.05

59 More on the tradeoff between Type I and Type II errors Note that α is the probability of saying there s a systematic effect, when the results are actually just due to chance. A Type I error. µ ο µ a criterion α=0.05

60 More on the tradeoff between Type I and Type II errors Whereas β is the probability of saying the results are due to chance, when actually there s a systematic effect as shown. A Type II error. β µ ο µ a criterion α

61 More on the tradeoff between Type I and Type II errors Another relevant quantity: 1-β. This is the probability of correctly rejecting the null hypothesis (a hit). β µ ο µ a criterion 1 β

62 Moving the criterion around changes the % of false alarms (α) and hits (1-β) A natural tradeoff between Type I and Type II errors. Hits = 97.5% False Alarms = 84% Hits = 84% False Alarms = 50% Hits = 50% False Alarms = 16% Figure by MIT OCW. This is one reason we test x 14 instead of x=14 (binomial distribution). The latter reduces false alarms, but increases the number of misses.

63 Type I and Type II errors Hypothesis testing as usually done is minimizing α, the probability of a Type I error (false alarm). This is, in part, because we don t know enough to maximize 1-β (hits). However, 1-β is an important quantity. It s known as the power of a test.

64 Statistical power The probability that a significance test at fixed level α will reject the null hypothesis when the alternative hypothesis is true. In other words, power describes the ability of a statistical test to show that an effect exists (i.e. that H o is false) when there really is an effect (i.e. when H a is true). A test with weak power might not be able to reject H o even when H a is true.

65 An example Can a 6-month exercise program increase the mineral content of young women s bones? A change of 1% or more would be considered important. What is the power of this test to detect a change of 1% if it exists, given that we study a sample of 25 subjects? Again, you d probably really run this as a twosample test

66 How to figure out the power of a significance test (p. 471) Ho: µ=0% (i.e. the exercise program has no effect on bone mineral content) Ha: µ>0% (i.e. the exercise program has a beneficial effect on bone mineral content). Set α to 5% Guess the standard deviation is σ=2%

67 First, find the criterion for rejecting the null hypothesis with α=0.05 H o : µ=0%; say n=25 and σ=2% H a : µ>0% The z-test will reject H o at the α =.05 level when: z=(m-µ o )/(σ/sqrt(n)) = (m-0)/(2/5) So m 1.645(2/5) m 0.658% is our criterion for deciding to reject the null.

68 Step 2 Now we want to calculate the probability that H o will be rejected when µ has, say, the value 1%. We want to know the area under the normal curve from the criterion (m=0.658) to + What is z for m=0.658?

69 Step 2 Assuming σ for the alternative is the same as for the null, µ a =1 z crit = ( )/(2/sqrt(25) = Pr(z -.855) =.80 So, the power of this test is 80%. This test will reject the null hypothesis 80% of the time, if the true value of the parameter µ = 1%

70 Fail to reject H 0 Reject H 0 Distribution of x when µ=0 α = Increase Fail to reject H 0 Reject H 0 Distribution of x when µ=1 Power = Increase Figure by MIT OCW.

71 How to increase power Increase α Make the smoke alarm more sensitive. Get more false alarms, but more power to detect a true fire. Increase n. Increase the difference between the µ in H a and the in µ o in H o. Decrease σ.

### Two-sample hypothesis testing, I 9.07 3/09/2004

Two-sample hypothesis testing, I 9.07 3/09/2004 But first, from last time More on the tradeoff between Type I and Type II errors The null and the alternative: Sampling distribution of the mean, m, given

### Chapter 7 Part 2. Hypothesis testing Power

Chapter 7 Part 2 Hypothesis testing Power November 6, 2008 All of the normal curves in this handout are sampling distributions Goal: To understand the process of hypothesis testing and the relationship

### AMS 5 HYPOTHESIS TESTING

AMS 5 HYPOTHESIS TESTING Hypothesis Testing Was it due to chance, or something else? Decide between two hypotheses that are mutually exclusive on the basis of evidence from observations. Test of Significance

### Introduction to Hypothesis Testing. Hypothesis Testing. Step 1: State the Hypotheses

Introduction to Hypothesis Testing 1 Hypothesis Testing A hypothesis test is a statistical procedure that uses sample data to evaluate a hypothesis about a population Hypothesis is stated in terms of the

### HYPOTHESIS TESTING AND TYPE I AND TYPE II ERROR

HYPOTHESIS TESTING AND TYPE I AND TYPE II ERROR Hypothesis is a conjecture (an inferring) about one or more population parameters. Null Hypothesis (H 0 ) is a statement of no difference or no relationship

### Hypothesis Testing or How to Decide to Decide Edpsy 580

Hypothesis Testing or How to Decide to Decide Edpsy 580 Carolyn J. Anderson Department of Educational Psychology University of Illinois at Urbana-Champaign Hypothesis Testing or How to Decide to Decide

### Two-sample hypothesis testing, II 9.07 3/16/2004

Two-sample hypothesis testing, II 9.07 3/16/004 Small sample tests for the difference between two independent means For two-sample tests of the difference in mean, things get a little confusing, here,

### IQ of deaf children example: Are the deaf children lower in IQ? Or are they average? If µ100 and σ 2 225, is the 88.07 from the sample of N59 deaf chi

PSY 511: Advanced Statistics for Psychological and Behavioral Research 1 All inferential statistics have the following in common: Use of some descriptive statistic Use of probability Potential for estimation

### Testing: is my coin fair?

Testing: is my coin fair? Formally: we want to make some inference about P(head) Try it: toss coin several times (say 7 times) Assume that it is fair ( P(head)= ), and see if this assumption is compatible

### Hypothesis Testing. Reminder of Inferential Statistics. Hypothesis Testing: Introduction

Hypothesis Testing PSY 360 Introduction to Statistics for the Behavioral Sciences Reminder of Inferential Statistics All inferential statistics have the following in common: Use of some descriptive statistic

### Module 5 Hypotheses Tests: Comparing Two Groups

Module 5 Hypotheses Tests: Comparing Two Groups Objective: In medical research, we often compare the outcomes between two groups of patients, namely exposed and unexposed groups. At the completion of this

### I. Basics of Hypothesis Testing

Introduction to Hypothesis Testing This deals with an issue highly similar to what we did in the previous chapter. In that chapter we used sample information to make inferences about the range of possibilities

### Hypothesis testing S2

Basic medical statistics for clinical and experimental research Hypothesis testing S2 Katarzyna Jóźwiak k.jozwiak@nki.nl 2nd November 2015 1/43 Introduction Point estimation: use a sample statistic to

### Introduction to Hypothesis Testing OPRE 6301

Introduction to Hypothesis Testing OPRE 6301 Motivation... The purpose of hypothesis testing is to determine whether there is enough statistical evidence in favor of a certain belief, or hypothesis, about

### Hypothesis Testing 1

Hypothesis Testing 1 Statistical procedures for addressing research questions involves formulating a concise statement of the hypothesis to be tested. The hypothesis to be tested is referred to as the

### Correlational Research

Correlational Research Chapter Fifteen Correlational Research Chapter Fifteen Bring folder of readings The Nature of Correlational Research Correlational Research is also known as Associational Research.

### The Basics of a Hypothesis Test

Overview The Basics of a Test Dr Tom Ilvento Department of Food and Resource Economics Alternative way to make inferences from a sample to the Population is via a Test A hypothesis test is based upon A

### Chapter 8. Hypothesis Testing

Chapter 8 Hypothesis Testing Hypothesis In statistics, a hypothesis is a claim or statement about a property of a population. A hypothesis test (or test of significance) is a standard procedure for testing

### Sampling and Hypothesis Testing

Population and sample Sampling and Hypothesis Testing Allin Cottrell Population : an entire set of objects or units of observation of one sort or another. Sample : subset of a population. Parameter versus

### Chapter 8 Hypothesis Testing Chapter 8 Hypothesis Testing 8-1 Overview 8-2 Basics of Hypothesis Testing

Chapter 8 Hypothesis Testing 1 Chapter 8 Hypothesis Testing 8-1 Overview 8-2 Basics of Hypothesis Testing 8-3 Testing a Claim About a Proportion 8-5 Testing a Claim About a Mean: s Not Known 8-6 Testing

### MATH 10: Elementary Statistics and Probability Chapter 9: Hypothesis Testing with One Sample

MATH 10: Elementary Statistics and Probability Chapter 9: Hypothesis Testing with One Sample Tony Pourmohamad Department of Mathematics De Anza College Spring 2015 Objectives By the end of this set of

### Null and Alternative Hypotheses. Lecture # 3. Steps in Conducting a Hypothesis Test (Cont d) Steps in Conducting a Hypothesis Test

Lecture # 3 Significance Testing Is there a significant difference between a measured and a standard amount (that can not be accounted for by random error alone)? aka Hypothesis testing- H 0 (null hypothesis)

### statistics Chi-square tests and nonparametric Summary sheet from last time: Hypothesis testing Summary sheet from last time: Confidence intervals

Summary sheet from last time: Confidence intervals Confidence intervals take on the usual form: parameter = statistic ± t crit SE(statistic) parameter SE a s e sqrt(1/n + m x 2 /ss xx ) b s e /sqrt(ss

### Hypothesis Testing - II

-3σ -2σ +σ +2σ +3σ Hypothesis Testing - II Lecture 9 0909.400.01 / 0909.400.02 Dr. P. s Clinic Consultant Module in Probability & Statistics in Engineering Today in P&S -3σ -2σ +σ +2σ +3σ Review: Hypothesis

### Chapter 6: t test for dependent samples

Chapter 6: t test for dependent samples ****This chapter corresponds to chapter 11 of your book ( t(ea) for Two (Again) ). What it is: The t test for dependent samples is used to determine whether the

### Two-sample inference: Continuous data

Two-sample inference: Continuous data Patrick Breheny April 5 Patrick Breheny STA 580: Biostatistics I 1/32 Introduction Our next two lectures will deal with two-sample inference for continuous data As

### CHAPTER 11 SECTION 2: INTRODUCTION TO HYPOTHESIS TESTING

CHAPTER 11 SECTION 2: INTRODUCTION TO HYPOTHESIS TESTING MULTIPLE CHOICE 56. In testing the hypotheses H 0 : µ = 50 vs. H 1 : µ 50, the following information is known: n = 64, = 53.5, and σ = 10. The standardized

### Introduction to. Hypothesis Testing CHAPTER LEARNING OBJECTIVES. 1 Identify the four steps of hypothesis testing.

Introduction to Hypothesis Testing CHAPTER 8 LEARNING OBJECTIVES After reading this chapter, you should be able to: 1 Identify the four steps of hypothesis testing. 2 Define null hypothesis, alternative

### t Tests in Excel The Excel Statistical Master By Mark Harmon Copyright 2011 Mark Harmon

t-tests in Excel By Mark Harmon Copyright 2011 Mark Harmon No part of this publication may be reproduced or distributed without the express permission of the author. mark@excelmasterseries.com www.excelmasterseries.com

### Hypothesis Testing Summary

Hypothesis Testing Summary Hypothesis testing begins with the drawing of a sample and calculating its characteristics (aka, statistics ). A statistical test (a specific form of a hypothesis test) is an

### Chapter 9, Part A Hypothesis Tests. Learning objectives

Chapter 9, Part A Hypothesis Tests Slide 1 Learning objectives 1. Understand how to develop Null and Alternative Hypotheses 2. Understand Type I and Type II Errors 3. Able to do hypothesis test about population

### Chapter 8 Introduction to Hypothesis Testing

Chapter 8 Student Lecture Notes 8-1 Chapter 8 Introduction to Hypothesis Testing Fall 26 Fundamentals of Business Statistics 1 Chapter Goals After completing this chapter, you should be able to: Formulate

### Chapter 21. More About Tests and Intervals. Copyright 2012, 2008, 2005 Pearson Education, Inc.

Chapter 21 More About Tests and Intervals Copyright 2012, 2008, 2005 Pearson Education, Inc. Zero In on the Null Null hypotheses have special requirements. To perform a hypothesis test, the null must be

### Null Hypothesis H 0. The null hypothesis (denoted by H 0

Hypothesis test In statistics, a hypothesis is a claim or statement about a property of a population. A hypothesis test (or test of significance) is a standard procedure for testing a claim about a property

### Homework 6 Solutions

Math 17, Section 2 Spring 2011 Assignment Chapter 20: 12, 14, 20, 24, 34 Chapter 21: 2, 8, 14, 16, 18 Chapter 20 20.12] Got Milk? The student made a number of mistakes here: Homework 6 Solutions 1. Null

### Experimental Design. Power and Sample Size Determination. Proportions. Proportions. Confidence Interval for p. The Binomial Test

Experimental Design Power and Sample Size Determination Bret Hanlon and Bret Larget Department of Statistics University of Wisconsin Madison November 3 8, 2011 To this point in the semester, we have largely

### Confidence intervals, t tests, P values

Confidence intervals, t tests, P values Joe Felsenstein Department of Genome Sciences and Department of Biology Confidence intervals, t tests, P values p.1/31 Normality Everybody believes in the normal

### COMP6053 lecture: Hypothesis testing, t-tests, p-values, type-i and type-ii errors.

COMP6053 lecture: Hypothesis testing, t-tests, p-values, type-i and type-ii errors jn2@ecs.soton.ac.uk The t-test This lecture introduces the t-test -- our first real statistical test -- and the related

### Paired vs. 2 sample comparisons. Comparing means. Paired comparisons allow us to account for a lot of extraneous variation.

Comparing means! Tests with one categorical and one numerical variable Paired vs. sample comparisons! Goal: to compare the mean of a numerical variable for different groups. Paired comparisons allow us

### HYPOTHESIS TESTING: POWER OF THE TEST

HYPOTHESIS TESTING: POWER OF THE TEST The first 6 steps of the 9-step test of hypothesis are called "the test". These steps are not dependent on the observed data values. When planning a research project,

### Homework #3 is due Friday by 5pm. Homework #4 will be posted to the class website later this week. It will be due Friday, March 7 th, at 5pm.

Homework #3 is due Friday by 5pm. Homework #4 will be posted to the class website later this week. It will be due Friday, March 7 th, at 5pm. Political Science 15 Lecture 12: Hypothesis Testing Sampling

### HypoTesting. Name: Class: Date: Multiple Choice Identify the choice that best completes the statement or answers the question.

Name: Class: Date: HypoTesting Multiple Choice Identify the choice that best completes the statement or answers the question. 1. A Type II error is committed if we make: a. a correct decision when the

About Hypothesis Testing TABLE OF CONTENTS About Hypothesis Testing... 1 What is a HYPOTHESIS TEST?... 1 Hypothesis Testing... 1 Hypothesis Testing... 1 Steps in Hypothesis Testing... 2 Steps in Hypothesis

### General Procedure for Hypothesis Test. Five types of statistical analysis. 1. Formulate H 1 and H 0. General Procedure for Hypothesis Test

Five types of statistical analysis General Procedure for Hypothesis Test Descriptive Inferential Differences Associative Predictive What are the characteristics of the respondents? What are the characteristics

### Introduction to Hypothesis Testing. Point estimation and confidence intervals are useful statistical inference procedures.

Introduction to Hypothesis Testing Point estimation and confidence intervals are useful statistical inference procedures. Another type of inference is used frequently used concerns tests of hypotheses.

### HYPOTHESIS TESTING (ONE SAMPLE) - CHAPTER 7 1. used confidence intervals to answer questions such as...

HYPOTHESIS TESTING (ONE SAMPLE) - CHAPTER 7 1 PREVIOUSLY used confidence intervals to answer questions such as... You know that 0.25% of women have red/green color blindness. You conduct a study of men

### Section 7.1. Introduction to Hypothesis Testing. Schrodinger s cat quantum mechanics thought experiment (1935)

Section 7.1 Introduction to Hypothesis Testing Schrodinger s cat quantum mechanics thought experiment (1935) Statistical Hypotheses A statistical hypothesis is a claim about a population. Null hypothesis

### 9.1 Basic Principles of Hypothesis Testing

9. Basic Principles of Hypothesis Testing Basic Idea Through an Example: On the very first day of class I gave the example of tossing a coin times, and what you might conclude about the fairness of the

### THE FIRST SET OF EXAMPLES USE SUMMARY DATA... EXAMPLE 7.2, PAGE 227 DESCRIBES A PROBLEM AND A HYPOTHESIS TEST IS PERFORMED IN EXAMPLE 7.

THERE ARE TWO WAYS TO DO HYPOTHESIS TESTING WITH STATCRUNCH: WITH SUMMARY DATA (AS IN EXAMPLE 7.17, PAGE 236, IN ROSNER); WITH THE ORIGINAL DATA (AS IN EXAMPLE 8.5, PAGE 301 IN ROSNER THAT USES DATA FROM

### Comparing Two Groups. Standard Error of ȳ 1 ȳ 2. Setting. Two Independent Samples

Comparing Two Groups Chapter 7 describes two ways to compare two populations on the basis of independent samples: a confidence interval for the difference in population means and a hypothesis test. The

### Statistical Inference and t-tests

1 Statistical Inference and t-tests Objectives Evaluate the difference between a sample mean and a target value using a one-sample t-test. Evaluate the difference between a sample mean and a target value

### Module 7: Hypothesis Testing I Statistics (OA3102)

Module 7: Hypothesis Testing I Statistics (OA3102) Professor Ron Fricker Naval Postgraduate School Monterey, California Reading assignment: WM&S chapter 10.1-10.5 Revision: 2-12 1 Goals for this Module

### 1 Confidence intervals

Math 143 Inference for Means 1 Statistical inference is inferring information about the distribution of a population from information about a sample. We re generally talking about one of two things: 1.

### Water Quality Problem. Hypothesis Testing of Means. Water Quality Example. Water Quality Example. Water quality example. Water Quality Example

Water Quality Problem Hypothesis Testing of Means Dr. Tom Ilvento FREC 408 Suppose I am concerned about the quality of drinking water for people who use wells in a particular geographic area I will test

### Example Hypotheses. Chapter 8-2: Basics of Hypothesis Testing. A newspaper headline makes the claim: Most workers get their jobs through networking

Chapter 8-2: Basics of Hypothesis Testing Two main activities in statistical inference are using sample data to: 1. estimate a population parameter forming confidence intervals 2. test a hypothesis or

### MONT 107N Understanding Randomness Solutions For Final Examination May 11, 2010

MONT 07N Understanding Randomness Solutions For Final Examination May, 00 Short Answer (a) (0) How are the EV and SE for the sum of n draws with replacement from a box computed? Solution: The EV is n times

### T-test in SPSS Hypothesis tests of proportions Confidence Intervals (End of chapter 6 material)

T-test in SPSS Hypothesis tests of proportions Confidence Intervals (End of chapter 6 material) Definition of p-value: The probability of getting evidence as strong as you did assuming that the null hypothesis

### Section 12.2, Lesson 3. What Can Go Wrong in Hypothesis Testing: The Two Types of Errors and Their Probabilities

Today: Section 2.2, Lesson 3: What can go wrong with hypothesis testing Section 2.4: Hypothesis tests for difference in two proportions ANNOUNCEMENTS: No discussion today. Check your grades on eee and

### Lecture 18: Two-Sample Hypothesis Test of Means

Statistics 18 sample_t_test.pdf Michael Hallstone, Ph.D. hallston@hawaii.edu Lecture 18: Two-Sample Hypothesis Test of Means Some Common Sense Assumptions for Two Sample Hypothesis Tests 1. The test variable

### Lesson 1: Comparison of Population Means Part c: Comparison of Two- Means

Lesson : Comparison of Population Means Part c: Comparison of Two- Means Welcome to lesson c. This third lesson of lesson will discuss hypothesis testing for two independent means. Steps in Hypothesis

### research/scientific includes the following: statistical hypotheses: you have a null and alternative you accept one and reject the other

1 Hypothesis Testing Richard S. Balkin, Ph.D., LPC-S, NCC 2 Overview When we have questions about the effect of a treatment or intervention or wish to compare groups, we use hypothesis testing Parametric

### Chapter 8 Hypothesis Testing

Chapter 8 Hypothesis Testing Chapter problem: Does the MicroSort method of gender selection increase the likelihood that a baby will be girl? MicroSort: a gender-selection method developed by Genetics

### TRANSCRIPT: In this lecture, we will talk about both theoretical and applied concepts related to hypothesis testing.

This is Dr. Chumney. The focus of this lecture is hypothesis testing both what it is, how hypothesis tests are used, and how to conduct hypothesis tests. 1 In this lecture, we will talk about both theoretical

### Section 13, Part 1 ANOVA. Analysis Of Variance

Section 13, Part 1 ANOVA Analysis Of Variance Course Overview So far in this course we ve covered: Descriptive statistics Summary statistics Tables and Graphs Probability Probability Rules Probability

### Psychology 60 Fall 2013 Practice Exam Actual Exam: Next Monday. Good luck!

Psychology 60 Fall 2013 Practice Exam Actual Exam: Next Monday. Good luck! Name: 1. The basic idea behind hypothesis testing: A. is important only if you want to compare two populations. B. depends on

### Chapter 8: Hypothesis Testing of a Single Population Parameter

Chapter 8: Hypothesis Testing of a Single Population Parameter THE LANGUAGE OF STATISTICAL DECISION MAKING DEFINITIONS: The population is the entire group of objects or individuals under study, about which

### Elements of Hypothesis Testing (Summary from lecture notes)

Statistics-20090 MINITAB - Lab 1 Large Sample Tests of Hypothesis About a Population Mean We use hypothesis tests to make an inference about some population parameter of interest, for example the mean

### Sociology 6Z03 Topic 15: Statistical Inference for Means

Sociology 6Z03 Topic 15: Statistical Inference for Means John Fox McMaster University Fall 2016 John Fox (McMaster University) Soc 6Z03: Statistical Inference for Means Fall 2016 1 / 41 Outline: Statistical

### Statistiek I. t-tests. John Nerbonne. CLCG, Rijksuniversiteit Groningen. John Nerbonne 1/35

Statistiek I t-tests John Nerbonne CLCG, Rijksuniversiteit Groningen http://wwwletrugnl/nerbonne/teach/statistiek-i/ John Nerbonne 1/35 t-tests To test an average or pair of averages when σ is known, we

### HYPOTHESIS TESTING (ONE SAMPLE) - CHAPTER 7 1. used confidence intervals to answer questions such as...

HYPOTHESIS TESTING (ONE SAMPLE) - CHAPTER 7 1 PREVIOUSLY used confidence intervals to answer questions such as... You know that 0.25% of women have red/green color blindness. You conduct a study of men

### 8-2 Basics of Hypothesis Testing. Definitions. Rare Event Rule for Inferential Statistics. Null Hypothesis

8-2 Basics of Hypothesis Testing Definitions This section presents individual components of a hypothesis test. We should know and understand the following: How to identify the null hypothesis and alternative

### 11. Logic of Hypothesis Testing

11. Logic of Hypothesis Testing A. Introduction B. Significance Testing C. Type I and Type II Errors D. One- and Two-Tailed Tests E. Interpreting Significant Results F. Interpreting Non-Significant Results

### One-Sample t-test. Example 1: Mortgage Process Time. Problem. Data set. Data collection. Tools

One-Sample t-test Example 1: Mortgage Process Time Problem A faster loan processing time produces higher productivity and greater customer satisfaction. A financial services institution wants to establish

### Hypothesis Testing hypothesis testing approach formulation of the test statistic

Hypothesis Testing For the next few lectures, we re going to look at various test statistics that are formulated to allow us to test hypotheses in a variety of contexts: In all cases, the hypothesis testing

### 15.0 More Hypothesis Testing

15.0 More Hypothesis Testing 1 Answer Questions Type I and Type II Error Power Calculation Bayesian Hypothesis Testing 15.1 Type I and Type II Error In the philosophy of hypothesis testing, the null hypothesis

### Hypothesis Testing --- One Mean

Hypothesis Testing --- One Mean A hypothesis is simply a statement that something is true. Typically, there are two hypotheses in a hypothesis test: the null, and the alternative. Null Hypothesis The hypothesis

### Chapter 7 Notes - Inference for Single Samples. You know already for a large sample, you can invoke the CLT so:

Chapter 7 Notes - Inference for Single Samples You know already for a large sample, you can invoke the CLT so: X N(µ, ). Also for a large sample, you can replace an unknown σ by s. You know how to do a

### Introduction to Hypothesis Testing

I. Terms, Concepts. Introduction to Hypothesis Testing A. In general, we do not know the true value of population parameters - they must be estimated. However, we do have hypotheses about what the true

### LAB 4 INSTRUCTIONS CONFIDENCE INTERVALS AND HYPOTHESIS TESTING

LAB 4 INSTRUCTIONS CONFIDENCE INTERVALS AND HYPOTHESIS TESTING In this lab you will explore the concept of a confidence interval and hypothesis testing through a simulation problem in engineering setting.

### HYPOTHESIS TESTING WITH SPSS:

HYPOTHESIS TESTING WITH SPSS: A NON-STATISTICIAN S GUIDE & TUTORIAL by Dr. Jim Mirabella SPSS 14.0 screenshots reprinted with permission from SPSS Inc. Published June 2006 Copyright Dr. Jim Mirabella CHAPTER

### AP Statistics 2002 Scoring Guidelines

AP Statistics 2002 Scoring Guidelines The materials included in these files are intended for use by AP teachers for course and exam preparation in the classroom; permission for any other use must be sought

### Multiple random variables

Multiple random variables Multiple random variables We essentially always consider multiple random variables at once. The key concepts: Joint, conditional and marginal distributions, and independence of

### Hypothesis testing: Examples. AMS7, Spring 2012

Hypothesis testing: Examples AMS7, Spring 2012 Example 1: Testing a Claim about a Proportion Sect. 7.3, # 2: Survey of Drinking: In a Gallup survey, 1087 randomly selected adults were asked whether they

### Chapter Five: Paired Samples Methods 1/38

Chapter Five: Paired Samples Methods 1/38 5.1 Introduction 2/38 Introduction Paired data arise with some frequency in a variety of research contexts. Patients might have a particular type of laser surgery

### Introduction. Hypothesis Testing. Hypothesis Testing. Significance Testing

Introduction Hypothesis Testing Mark Lunt Arthritis Research UK Centre for Ecellence in Epidemiology University of Manchester 13/10/2015 We saw last week that we can never know the population parameters

### 12 Hypothesis Testing

CHAPTER 12 Hypothesis Testing Chapter Outline 12.1 HYPOTHESIS TESTING 12.2 CRITICAL VALUES 12.3 ONE-SAMPLE T TEST 247 12.1. Hypothesis Testing www.ck12.org 12.1 Hypothesis Testing Learning Objectives Develop

### Hypothesis Testing. Concept of Hypothesis Testing

Quantitative Methods 2013 Hypothesis Testing with One Sample 1 Concept of Hypothesis Testing Testing Hypotheses is another way to deal with the problem of making a statement about an unknown population

### Sample Size and Power in Clinical Trials

Sample Size and Power in Clinical Trials Version 1.0 May 011 1. Power of a Test. Factors affecting Power 3. Required Sample Size RELATED ISSUES 1. Effect Size. Test Statistics 3. Variation 4. Significance

### 9-3.4 Likelihood ratio test. Neyman-Pearson lemma

9-3.4 Likelihood ratio test Neyman-Pearson lemma 9-1 Hypothesis Testing 9-1.1 Statistical Hypotheses Statistical hypothesis testing and confidence interval estimation of parameters are the fundamental

### Outline. Correlation & Regression, III. Review. Relationship between r and regression

Outline Correlation & Regression, III 9.07 4/6/004 Relationship between correlation and regression, along with notes on the correlation coefficient Effect size, and the meaning of r Other kinds of correlation

### Hypothesis testing. Hypothesis testing asks how unusual it is to get data that differ from the null hypothesis.

Hypothesis testing Hypothesis testing asks how unusual it is to get data that differ from the null hypothesis. If the data would be quite unlikely under H 0, we reject H 0. So we need to know how good

### The Philosophy of Hypothesis Testing, Questions and Answers 2006 Samuel L. Baker

HYPOTHESIS TESTING PHILOSOPHY 1 The Philosophy of Hypothesis Testing, Questions and Answers 2006 Samuel L. Baker Question: So I'm hypothesis testing. What's the hypothesis I'm testing? Answer: When you're

### THE LOGIC OF HYPOTHESIS TESTING. The general process of hypothesis testing remains constant from one situation to another.

THE LOGIC OF HYPOTHESIS TESTING Hypothesis testing is a statistical procedure that allows researchers to use sample to draw inferences about the population of interest. It is the most commonly used inferential

### Chapter Five. Hypothesis Testing: Concepts

Chapter Five The Purpose of Hypothesis Testing... 110 An Initial Look at Hypothesis Testing... 112 Formal Hypothesis Testing... 114 Introduction... 114 Null and Alternate Hypotheses... 114 Procedure for

### Inferential Statistics

Inferential Statistics Sampling and the normal distribution Z-scores Confidence levels and intervals Hypothesis testing Commonly used statistical methods Inferential Statistics Descriptive statistics are

### Develop hypothesis and then research to find out if it is true. Derived from theory or primary question/research questions

Chapter 12 Hypothesis Testing Learning Objectives Examine the process of hypothesis testing Evaluate research and null hypothesis Determine one- or two-tailed tests Understand obtained values, significance,

### Sample Size Determination

Sample Size Determination Population A: 10,000 Population B: 5,000 Sample 10% Sample 15% Sample size 1000 Sample size 750 The process of obtaining information from a subset (sample) of a larger group (population)