# CONTENTS OF DAY 2. II. Why Random Sampling is Important 9 A myth, an urban legend, and the real reason NOTES FOR SUMMER STATISTICS INSTITUTE COURSE

Size: px
Start display at page:

Download "CONTENTS OF DAY 2. II. Why Random Sampling is Important 9 A myth, an urban legend, and the real reason NOTES FOR SUMMER STATISTICS INSTITUTE COURSE" Transcription

1 1 2 CONTENTS OF DAY 2 I. More Precise Definition of Simple Random Sample 3 Connection with independent random variables 3 Problems with small populations 8 II. Why Random Sampling is Important 9 A myth, an urban legend, and the real reason NOTES FOR SUMMER STATISTICS INSTITUTE COURSE COMMON MISTAKES IN STATISTICS SPOTTING THEM AND AVOIDING THEM Day 2: Important Details about Statistical Inference MAY Instructor: Martha K. Smith III. Overview of Frequentist Hypothesis Testing 10 Basic elements of most frequentist hypothesis tests 10 Illustration: Large sample z-test 11 Common confusions in terminology and concepts 12 Sampling distribution 13 Role of model assumptions 17 Importance of model assumptions in general 20 Robustness 20 IV. Frequentist Confidence Intervals 21 Illustration: Large sample z-procedure 22 Common confusions 27, 28, 30 Importance of model assumptions 22, 24, 26, 29, 31 Robustness 31 Variations and trade-offs V. More on Frequentist Hypothesis Tests 34 Illustration: One-sided t-test for a sample mean 35 p-values 38 VI. Misinterpretations and Misuses of p-values 42 VII. Type I error and significance levels 46 VIII. Pros and cons of setting a significance level 49

2 I. MORE PRECISE DEFINITION OF SIMPLE RANDOM SAMPLE In practice in applying statistical techniques, we are interested in random variables defined on the population under study. To illustrate, recall the examples mentioned yesterday: 1. In a medical study, the population might be all adults over age 50 who have high blood pressure. 2. In another study, the population might be all hospitals in the U.S. that perform heart bypass surgery. 3. If we re studying whether a certain die is fair or weighted, the population is all possible tosses of the die. In these examples, we might be interested in the following random variables: Example 1: The difference in blood pressure with and without taking a certain drug. Example 2: The number of heart bypass surgeries performed in a particular year, or the number of such surgeries that are successful, or the number in which the patient has complications of surgery, etc. Example 3: The number that comes up on the die. Connection with Independent Random Variables: If we take a sample of units from the population, we have a corresponding sample of values of the random variable. 3 For example, if the random variable (let's call it Y) is difference in blood pressure with and without taking the drug, then the sample will consist of values we can call y 1, y 2,..., y n, where n = number of people in the sample from the population of patients The people in the sample are listed as person 1, person 2, etc. y 1 = the difference in blood pressures (that is, the value of Y) for the first person in the sample, y 2 = the difference in blood pressures (that is, the value of Y) for the second person in the sample etc. We can look at this another way, in terms of n random variables Y 1, Y 2,..., Y n, described as follows: The random process for Y 1 is pick the first person in the sample ; the value of Y 1 is the value of Y for that person i.e., y 1. The random process for Y 2 is pick the second person in the sample ; the value of Y 2 is the value of Y for that person i.e., y 2. etc. The difference between using the small y's and the large Y's is that when we use the small y's we are thinking of a fixed sample of size n from the population, but when we use the large Y's, we are thinking of letting the sample vary (but always with size n). Note: The Y i s are sometimes called identically distributed, because they have the same probability distribution. 4

3 5 6 Precise definition of simple random sample of a random variable: "The sample y 1, y 2,..., y n is a simple random sample" means that the associated random variables Y 1, Y 2,..., Y n are independent. Intuitively speaking, "independent" means that the values of any subset of the random variables Y 1, Y 2,..., Y n do not influence the values of the other random variables in the list. Recall: We defined a random sample as one that is chosen by a random process. Where is the random process in the precise definition? Note: To emphasize that the Y i s all have the same distribution, the precise definition is sometimes stated as, Y 1, Y 2,..., Y n are independent, identically distributed, sometimes abbreviated as iid. Connection with the initial definition of simple random sample Recall the preliminary definition (from Moore and McCabe, Introduction to the Practice of Statistics) given in Simple Random Samples, Part 1: "A simple random sample (SRS) of size n consists of n individuals from the population chosen in such a way that every set of n individuals has an equal chance to be the sample actually selected." Recall Example 3 above: We are tossing a die; the number that comes up on the die is our random variable Y. In terms of the preliminary definition, the population is all possible tosses of the die, and a simple random sample is n different tosses. The different tosses of the die are independent events (i.e., what happens in some tosses has no influence on the other tosses), which means that in the precise definition above, the random variables Y 1, Y 2,..., Y n are indeed independent: The numbers that come up in some tosses in no way influence the numbers that come up in other tosses.

4 Compare this with example 2: The population is all hospitals in the U.S. that perform heart bypass surgery. Using the preliminary definition of simple random sample of size n, we end up with n distinct hospitals. This means that when we have chosen the first hospital in our simple random sample, we cannot choose it again to be in our simple random sample. Thus the events "Choose the first hospital in the sample; choose the second hospital in the sample;...," are not independent events: The choice of first hospital restricts the choice of the second and subsequent hospitals in the sample. If we now consider the random variable Y = the number of heart bypass surgeries performed in 2008, then it follows that the random variables Y 1, Y 2,..., Y n are not independent. The Bottom Line: In many cases, the preliminary definition does not coincide with the more precise definition. More specifically, the preliminary definition allows sampling without replacement, whereas the more precise definition requires sampling with replacement. 7 The Bad News: The precise definition is the one that is used in the mathematical theorems that justify many of the procedures of statistical inference. (More detail later.) The Good News: If the population is large enough, the preliminary definition is close enough for all practical purposes. In many cases where the population is not large enough, there are alternate theorems giving rise to alternate procedures using a finite population correction factor that will work (Unfortunately, the question, "How large is large enough?" does not have a simple answer.) In many cases, even if the population is not large enough, there are alternate procedures (known as permutation or randomization or resampling tests) that are applicable Problems with Small Populations: The upshot: 1) Using a large population procedure with a small population is a common mistake. 2) One more difficulty in selecting an appropriate sample, which leads to one more source of uncertainty. 8

5 II. WHY RANDOM SAMPLING IS IMPORTANT Recall the Myth: "A random sample will be representative of the population". A slightly better explanation that is partly true but partly Urban Legend: "Random sampling prevents bias by giving all individuals an equal chance to be chosen." The element of truth: Random sampling will eliminate systematic bias. A practical rationale: This statement is often the best plausible explanation that is acceptable to someone with little mathematical background. However, this statement could easily be misinterpreted as the myth above. An additional, very important, reason why random sampling is important, at least in frequentist statistical procedures, which are those most often taught (especially in introductory classes) and used: The Real Reason: The mathematical theorems that justify most parametric frequentist statistical procedures apply only to truly random samples. The next section elaborates. 9 III. OVERVIEW OF FREQUENTIST HYPOTHESIS TESTING Basic Elements of Most Frequentist Hypothesis Tests: Most commonly-used ( parametric ), frequentist hypothesis tests involve the following elements: 1. Model assumptions 2. Null and alternative hypotheses 3. A test statistic. Note: A test statistic is something calculated by a rule from a sample. It needs to have the property that extreme values of the test statistic are rare, and hence cast doubt on the null hypothesis. 4. A mathematical theorem saying, "If the model assumptions and the null hypothesis are both true, then the sampling distribution of the test statistic has this particular form." The sampling distribution is the probability distribution of the test statistic, when considering all possible suitably random samples of the same size. (More later.) The exact details of these four elements will depend on the particular hypothesis test. 10

6 Illustration: Large Sample z-test In the case of the large sample z-test for the mean, with twosided alternative, the elements are: 1. Model assumptions: We are working with simple random samples of a random variable Y that has a normal distribution. 2. Null hypothesis: The mean of the random variable Y is a certain value 0. Alternative hypothesis: "The mean of the random variable Y is not 0." (This is called the two-sided alternative.) 3. Test statistic: y (the sample mean of a simple random sample of size n from the random variable Y). Before discussing item 4 (the mathematical theorem), we first need to do two things: Common confusions in terminology and concepts: The mean of the random variable Y is also called the expected value or the expectation of Y. o It s denoted E(Y). o It s also called the population mean, often denoted as µ. o It is what we do not know in this example. A sample mean is typically denoted y (read "y-bar"). o It is calculated from a sample y 1, y 2,..., y n of values of Y by the familiar formula y = (y 1 + y y n )/n. The sample mean y is an estimate of the population mean µ, but they are usually not the same. o Confusing them is a common mistake. Note that I have written, "the population mean" but "a sample mean". o A sample mean depends on the sample chosen. o Since there are many possible samples, there are many possible sample means. o However, there is only one population mean associated with the random variable Y. 12

7 Sampling Distribution: Even though we apply a hypothesis test to a single sample, to understand the test, we need to step back and consider all possible simple random samples of Y of size n. For each simple random sample of Y of size n, we get a value of y. We thus have a new random variable Y n : o The associated random process is pick a simple random sample of size n o The value of Y n is the sample mean y for this sample Note that o Y n stands for the new random variable o y stands for the value of Y n, for a particular sample of size n. o y (the value of Y n ) depends on the sample, and typically varies from sample to sample. The distribution of the new random variable Y n is called the sampling distribution of Y n (or the sampling distribution of the mean). Simulation of sampling distribution: Now we can state the theorem: 4. The theorem states: If the model assumptions are all true (i.e., if Y is normal and all samples considered are simple random samples), and if in addition the mean of Y is indeed 0 (i.e., if the null hypothesis is true), then The sampling distribution of Y n is normal The sampling distribution of Y n has mean 0 The sampling distribution of Y n has standard deviation ", where " is the n standard deviation of the original random variable Y. Check that this is consistent with what the simulation shows. Also note: " is smaller than " (if n is larger than 1) n The larger n is, the smaller Why is this nice? " n is. More Terminology: " is called the population standard deviation of Y; it is not the same as the sample standard deviation s, although s is an estimate of ". The following chart and picture summarize the conclusion of the theorem and related information:

8 15 16 Mean Standard deviation Random variable Y (population distribution) Population mean ( = 0 if null hypothesis true) Population standard deviation Related quantity calculated from a sample y 1, y 2,, y n Sample mean y = (y 1 + y 2 + y n )/n y is an estimate of the population mean Sample standard deviation s = 1 n "1 n # i=1 (y " y i ) 2 s is an estimate of the population standard deviation Random variable Y n (sampling distribution) Sampling distribution mean ( = 0 if null hypothesis true) Sampling distribution standard deviation " n

9 17 18 The roles of the model assumptions for this hypothesis test: Recall: The theorem has three assumptions: Assumption 1: Y has a normal distribution (a model assumption). Assumption 2: All samples considered are simple random samples (also a model assumption). Assumption 3: The null hypothesis is true (assumption for the theorem, but not a model assumption). The theorem also has three conclusions: Conclusion 1: The sampling distribution of Y n is normal Conclusion 2: The sampling distribution of Y n has mean 0 Conclusion 3: The sampling distribution of Y n has standard deviation ", where " is the standard n deviation of the original random variable Y. The following chart shows which conclusion depends on which assumption(s): Assumption 1: Y normal (model assumption) Assumption 2: simple random samples (model assumption) Assumption 3: null hypothesis true (not a model assumption) Conclusions about Sampling Distribution (Distribution of Y n ) 1: Normal 2: Mean 0 3: Standard deviation " n Note that the model assumption that the sample is a simple random sample (in particular, that the Y i s as defined earlier are independent) is used to prove 1. that the sampling distribution is normal and 2. (even more importantly) that the standard deviation of the sampling distribution is ". n

10 19 20 Consequences (More detail later): 1. If the conclusion of the theorem is true, the sampling distribution of Y n is narrower than the original distribution of Y In fact, conclusion 3 of the theorem gives us an idea of just how narrow it is, depending on n. This will allow us to construct a useful hypothesis test. 2. The only way we know the conclusion is true is if we know the hypotheses of the theorem (the model assumptions and the null hypothesis) are true. 3. Thus: If the model assumptions are not true, then we do not know that the theorem is true, so we do not know that the hypothesis test is valid. In the example (large sample z-test for a mean), this translates to: If the sample is not a simple random sample, or if the random variable is not normal, then the reasoning establishing the validity of the test breaks down. Importance of Model Assumptions in General: Different hypothesis tests have different model assumptions. Some tests apply to random samples that are not simple. For many tests, the model assumptions consist of several assumptions. If any one of these model assumptions is not true, we do not know that the test is valid. Robustness: Many techniques are robust to some departures from at least some model assumptions. This means that if the particular assumption is not too far from true, then the technique is still approximately valid. For example, the large sample z-test for the mean is somewhat robust to departures from normality. In particular, for large enough sample sizes, the test is very close to accurate. o Unfortunately, how large is large enough depends on the distribution of the random variable Y. See the sampling distribution simulation for an illustration. o Try a distribution with a full height spike at the left, a half height spike at the right, and nothing in between, with n= 25; or three equally spaced spikes, descending in height, with nothing in between. Using a hypothesis test without paying attention to whether or not the model assumptions are true and whether or not the technique is robust to possible departures from model assumptions is a very common mistake in using statistics. (More later.)

11 IV: FREQUENTIST CONFIDENCE INTERVALS Before continuing the discussion of hypothesis tests, it will be helpful to first discuss the related concept of confidence intervals. The General Situation: We are considering a random variable Y. We are interested in a certain parameter (e.g., a proportion, or mean, or regression coefficient, or variance) associated with the random variable Y (i.e., associated with the population) We do not know the value of the parameter. Goal 1: We would like to estimate the unknown parameter, using data from a sample. Goal 2: We would also like to get some sense of how good our estimate is. The first goal is usually easier than the second. Example: If the parameter we are interested in estimating is the mean of the random variable (i.e., the population mean), we can estimate it using a sample mean. 21 The idea for the second goal (getting some sense of how good our estimate is), like hypothesis testing, involves the sampling distribution and depends on model assumptions: Although we typically have just one sample at hand when we do statistics, the reasoning used in classical frequentist inference depends on thinking about all possible suitable samples of the same size n. Which samples are considered "suitable" will depend on the particular statistical procedure to be used. Each statistical procedure has model assumptions that are needed to ensure that the reasoning behind the procedure is sound. The model assumptions determine which samples are "suitable." Illustration: Large Sample z-procedure for a Confidence Interval for a Mean The parameter we are interested in estimating is the population mean µ = E(Y) of the random variable Y. The model assumptions for this procedure are: The random variable is normal, and samples are simple random samples. o o Thus in this case, "suitable sample" means simple random sample. We will also assume Y is normal, so that both model assumptions are satisfied. 22

12 23 24 We ll use " to denote the (population) standard deviation of Y. We have a simple random sample, say of size n, consisting of observations y 1, y 2,..., y n. o For example, if Y is "height of an adult American male", we take a sample random sample of n adult American males; y 1, y 2,..., y n are their heights. We use the sample mean y = (y 1 + y y n )/n as our estimate of the population mean µ. o This is an example of a point estimate -- a numerical estimate with no indication of how good the estimate is. To get an idea of how good our estimate is, we consider all possible simple random samples of size n from Y. o In the specific example, we consider all possible simple random samples of adult American males, and for each sample of men, the list of their heights. We consider the sample means y for all possible simple random samples of size n from Y. o This amounts to defining a new random variable, which we will call Y n (read Y-bar sub n). o We can describe the random variable Y n briefly as "sample mean of a simple random sample of size n from Y", or more explicitly as: "pick a simple random sample of size n from Y and calculate its sample mean". o Note that each value of Y n is an estimate of the population mean µ. This new random variable Y n has a distribution, called a sampling distribution since it arises from considering varying samples. o The values of Y n are all the possible values of sample means y of simple random samples of Y i.e, the values of our estimates of µ. o The distribution of Y n gives us information about the variability (as samples vary) of our estimates of the population mean µ. o There is a mathematical theorem that tells us that if the model assumptions are true, then: The sampling distribution is normal The mean of the sampling distribution is also µ. The sampling distribution has standard deviation " n o The chart (best read one column at a time) and picture below summarize some of this information.

### Name: Date: Use the following to answer questions 3-4: Name: Date: 1. Determine whether each of the following statements is true or false. A) The margin of error for a 95% confidence interval for the mean increases as the sample size increases. B) The margin

### Two-sample hypothesis testing, II 9.07 3/16/2004 Two-sample hypothesis testing, II 9.07 3/16/004 Small sample tests for the difference between two independent means For two-sample tests of the difference in mean, things get a little confusing, here,

### The Variability of P-Values. Summary The Variability of P-Values Dennis D. Boos Department of Statistics North Carolina State University Raleigh, NC 27695-8203 boos@stat.ncsu.edu August 15, 2009 NC State Statistics Departement Tech Report Chapter 11 Testing Hypotheses About Proportions Hypothesis testing method: uses data from a sample to judge whether or not a statement about a population may be true. Steps in Any Hypothesis Test 1. Determine

### Understanding Confidence Intervals and Hypothesis Testing Using Excel Data Table Simulation Understanding Confidence Intervals and Hypothesis Testing Using Excel Data Table Simulation Leslie Chandrakantha lchandra@jjay.cuny.edu Department of Mathematics & Computer Science John Jay College of

### Recall this chart that showed how most of our course would be organized: Chapter 4 One-Way ANOVA Recall this chart that showed how most of our course would be organized: Explanatory Variable(s) Response Variable Methods Categorical Categorical Contingency Tables Categorical

### Data Mining Techniques Chapter 5: The Lure of Statistics: Data Mining Using Familiar Tools Data Mining Techniques Chapter 5: The Lure of Statistics: Data Mining Using Familiar Tools Occam s razor.......................................................... 2 A look at data I.........................................................

### Introduction to Hypothesis Testing OPRE 6301 Introduction to Hypothesis Testing OPRE 6301 Motivation... The purpose of hypothesis testing is to determine whether there is enough statistical evidence in favor of a certain belief, or hypothesis, about

### 3.4 Statistical inference for 2 populations based on two samples 3.4 Statistical inference for 2 populations based on two samples Tests for a difference between two population means The first sample will be denoted as X 1, X 2,..., X m. The second sample will be denoted

### Simple Regression Theory II 2010 Samuel L. Baker SIMPLE REGRESSION THEORY II 1 Simple Regression Theory II 2010 Samuel L. Baker Assessing how good the regression equation is likely to be Assignment 1A gets into drawing inferences about how close the

### Introduction. Hypothesis Testing. Hypothesis Testing. Significance Testing Introduction Hypothesis Testing Mark Lunt Arthritis Research UK Centre for Ecellence in Epidemiology University of Manchester 13/10/2015 We saw last week that we can never know the population parameters

### Comparison of frequentist and Bayesian inference. Class 20, 18.05, Spring 2014 Jeremy Orloff and Jonathan Bloom Comparison of frequentist and Bayesian inference. Class 20, 18.05, Spring 2014 Jeremy Orloff and Jonathan Bloom 1 Learning Goals 1. Be able to explain the difference between the p-value and a posterior

### Econometrics and Data Analysis I Econometrics and Data Analysis I Yale University ECON S131 (ONLINE) Summer Session A, 2014 June 2 July 4 Instructor: Doug McKee (douglas.mckee@yale.edu) Teaching Fellow: Yu Liu (dav.yu.liu@yale.edu) Classroom:

### Parametric and Nonparametric: Demystifying the Terms Parametric and Nonparametric: Demystifying the Terms By Tanya Hoskin, a statistician in the Mayo Clinic Department of Health Sciences Research who provides consultations through the Mayo Clinic CTSA BERD

### Fairfield Public Schools Mathematics Fairfield Public Schools AP Statistics AP Statistics BOE Approved 04/08/2014 1 AP STATISTICS Critical Areas of Focus AP Statistics is a rigorous course that offers advanced students an opportunity

### MONT 107N Understanding Randomness Solutions For Final Examination May 11, 2010 MONT 07N Understanding Randomness Solutions For Final Examination May, 00 Short Answer (a) (0) How are the EV and SE for the sum of n draws with replacement from a box computed? Solution: The EV is n times

### Tutorial 5: Hypothesis Testing Tutorial 5: Hypothesis Testing Rob Nicholls nicholls@mrc-lmb.cam.ac.uk MRC LMB Statistics Course 2014 Contents 1 Introduction................................ 1 2 Testing distributional assumptions....................

### Math 58. Rumbos Fall 2008 1. Solutions to Review Problems for Exam 2 Math 58. Rumbos Fall 2008 1 Solutions to Review Problems for Exam 2 1. For each of the following scenarios, determine whether the binomial distribution is the appropriate distribution for the random variable

### Introduction to. Hypothesis Testing CHAPTER LEARNING OBJECTIVES. 1 Identify the four steps of hypothesis testing. Introduction to Hypothesis Testing CHAPTER 8 LEARNING OBJECTIVES After reading this chapter, you should be able to: 1 Identify the four steps of hypothesis testing. 2 Define null hypothesis, alternative

### MATH 140 HYBRID INTRODUCTORY STATISTICS COURSE SYLLABUS MATH 140 HYBRID INTRODUCTORY STATISTICS COURSE SYLLABUS Instructor: Mark Schilling Email: mark.schilling@csun.edu (Note: If your CSUN email address is not one you use regularly, be sure to set up automatic

### SIMULATION STUDIES IN STATISTICS WHAT IS A SIMULATION STUDY, AND WHY DO ONE? What is a (Monte Carlo) simulation study, and why do one? SIMULATION STUDIES IN STATISTICS WHAT IS A SIMULATION STUDY, AND WHY DO ONE? What is a (Monte Carlo) simulation study, and why do one? Simulations for properties of estimators Simulations for properties

### Class 19: Two Way Tables, Conditional Distributions, Chi-Square (Text: Sections 2.5; 9.1) Spring 204 Class 9: Two Way Tables, Conditional Distributions, Chi-Square (Text: Sections 2.5; 9.) Big Picture: More than Two Samples In Chapter 7: We looked at quantitative variables and compared the

### Unit 31 A Hypothesis Test about Correlation and Slope in a Simple Linear Regression Unit 31 A Hypothesis Test about Correlation and Slope in a Simple Linear Regression Objectives: To perform a hypothesis test concerning the slope of a least squares line To recognize that testing for a

### 17. SIMPLE LINEAR REGRESSION II 17. SIMPLE LINEAR REGRESSION II The Model In linear regression analysis, we assume that the relationship between X and Y is linear. This does not mean, however, that Y can be perfectly predicted from X.

### From the help desk: Bootstrapped standard errors The Stata Journal (2003) 3, Number 1, pp. 71 80 From the help desk: Bootstrapped standard errors Weihua Guan Stata Corporation Abstract. Bootstrapping is a nonparametric approach for evaluating the distribution

### HYPOTHESIS TESTING (ONE SAMPLE) - CHAPTER 7 1. used confidence intervals to answer questions such as... HYPOTHESIS TESTING (ONE SAMPLE) - CHAPTER 7 1 PREVIOUSLY used confidence intervals to answer questions such as... You know that 0.25% of women have red/green color blindness. You conduct a study of men

### General Method: Difference of Means. 3. Calculate df: either Welch-Satterthwaite formula or simpler df = min(n 1, n 2 ) 1. General Method: Difference of Means 1. Calculate x 1, x 2, SE 1, SE 2. 2. Combined SE = SE1 2 + SE2 2. ASSUMES INDEPENDENT SAMPLES. 3. Calculate df: either Welch-Satterthwaite formula or simpler df = min(n

### Basic Concepts in Research and Data Analysis Basic Concepts in Research and Data Analysis Introduction: A Common Language for Researchers...2 Steps to Follow When Conducting Research...3 The Research Question... 3 The Hypothesis... 4 Defining the

### Statistics 3202 Introduction to Statistical Inference for Data Analytics 4-semester-hour course Statistics 3202 Introduction to Statistical Inference for Data Analytics 4-semester-hour course Prerequisite: Stat 3201 (Introduction to Probability for Data Analytics) Exclusions: Class distribution:

### Multivariate Normal Distribution Multivariate Normal Distribution Lecture 4 July 21, 2011 Advanced Multivariate Statistical Methods ICPSR Summer Session #2 Lecture #4-7/21/2011 Slide 1 of 41 Last Time Matrices and vectors Eigenvalues

### A POPULATION MEAN, CONFIDENCE INTERVALS AND HYPOTHESIS TESTING CHAPTER 5. A POPULATION MEAN, CONFIDENCE INTERVALS AND HYPOTHESIS TESTING 5.1 Concepts When a number of animals or plots are exposed to a certain treatment, we usually estimate the effect of the treatment

### How To Check For Differences In The One Way Anova MINITAB ASSISTANT WHITE PAPER This paper explains the research conducted by Minitab statisticians to develop the methods and data checks used in the Assistant in Minitab 17 Statistical Software. One-Way

### Curriculum Map Statistics and Probability Honors (348) Saugus High School Saugus Public Schools 2009-2010 Curriculum Map Statistics and Probability Honors (348) Saugus High School Saugus Public Schools 2009-2010 Week 1 Week 2 14.0 Students organize and describe distributions of data by using a number of different

### Institute of Actuaries of India Subject CT3 Probability and Mathematical Statistics Institute of Actuaries of India Subject CT3 Probability and Mathematical Statistics For 2015 Examinations Aim The aim of the Probability and Mathematical Statistics subject is to provide a grounding in EC151.02 Statistics for Business and Economics (MWF 8:00-8:50) Instructor: Chiu Yu Ko Office: 462D, 21 Campenalla Way Phone: 2-6093 Email: kocb@bc.edu Office Hours: by appointment Description This course

### Fixed-Effect Versus Random-Effects Models CHAPTER 13 Fixed-Effect Versus Random-Effects Models Introduction Definition of a summary effect Estimating the summary effect Extreme effect size in a large study or a small study Confidence interval

### Biostatistics: Types of Data Analysis Biostatistics: Types of Data Analysis Theresa A Scott, MS Vanderbilt University Department of Biostatistics theresa.scott@vanderbilt.edu http://biostat.mc.vanderbilt.edu/theresascott Theresa A Scott, MS

### Chapter 7 Notes - Inference for Single Samples. You know already for a large sample, you can invoke the CLT so: Chapter 7 Notes - Inference for Single Samples You know already for a large sample, you can invoke the CLT so: X N(µ, ). Also for a large sample, you can replace an unknown σ by s. You know how to do a

### LAB 4 INSTRUCTIONS CONFIDENCE INTERVALS AND HYPOTHESIS TESTING LAB 4 INSTRUCTIONS CONFIDENCE INTERVALS AND HYPOTHESIS TESTING In this lab you will explore the concept of a confidence interval and hypothesis testing through a simulation problem in engineering setting.

### Testing Group Differences using T-tests, ANOVA, and Nonparametric Measures Testing Group Differences using T-tests, ANOVA, and Nonparametric Measures Jamie DeCoster Department of Psychology University of Alabama 348 Gordon Palmer Hall Box 870348 Tuscaloosa, AL 35487-0348 Phone:

### 1. How different is the t distribution from the normal? Statistics 101 106 Lecture 7 (20 October 98) c David Pollard Page 1 Read M&M 7.1 and 7.2, ignoring starred parts. Reread M&M 3.2. The effects of estimated variances on normal approximations. t-distributions.

### INTRODUCTORY STATISTICS INTRODUCTORY STATISTICS FIFTH EDITION Thomas H. Wonnacott University of Western Ontario Ronald J. Wonnacott University of Western Ontario WILEY JOHN WILEY & SONS New York Chichester Brisbane Toronto Singapore

### 200627 - AC - Clinical Trials Coordinating unit: Teaching unit: Academic year: Degree: ECTS credits: 2014 200 - FME - School of Mathematics and Statistics 715 - EIO - Department of Statistics and Operations Research MASTER'S DEGREE

### WISE Power Tutorial All Exercises ame Date Class WISE Power Tutorial All Exercises Power: The B.E.A.. Mnemonic Four interrelated features of power can be summarized using BEA B Beta Error (Power = 1 Beta Error): Beta error (or Type II

### C. The null hypothesis is not rejected when the alternative hypothesis is true. A. population parameters. Sample Multiple Choice Questions for the material since Midterm 2. Sample questions from Midterms and 2 are also representative of questions that may appear on the final exam.. A randomly selected sample

### Hypothesis Test for Mean Using Given Data (Standard Deviation Known-z-test) Hypothesis Test for Mean Using Given Data (Standard Deviation Known-z-test) A hypothesis test is conducted when trying to find out if a claim is true or not. And if the claim is true, is it significant.

### Statistical Rules of Thumb Statistical Rules of Thumb Second Edition Gerald van Belle University of Washington Department of Biostatistics and Department of Environmental and Occupational Health Sciences Seattle, WA WILEY AJOHN

### Sample Size and Power in Clinical Trials Sample Size and Power in Clinical Trials Version 1.0 May 011 1. Power of a Test. Factors affecting Power 3. Required Sample Size RELATED ISSUES 1. Effect Size. Test Statistics 3. Variation 4. Significance

### NCSS Statistical Software Chapter 06 Introduction This procedure provides several reports for the comparison of two distributions, including confidence intervals for the difference in means, two-sample t-tests, the z-test, the

### Introduction to Regression and Data Analysis Statlab Workshop Introduction to Regression and Data Analysis with Dan Campbell and Sherlock Campbell October 28, 2008 I. The basics A. Types of variables Your variables may take several forms, and it

### Introduction to Hypothesis Testing I. Terms, Concepts. Introduction to Hypothesis Testing A. In general, we do not know the true value of population parameters - they must be estimated. However, we do have hypotheses about what the true

### Standard Deviation Estimator CSS.com Chapter 905 Standard Deviation Estimator Introduction Even though it is not of primary interest, an estimate of the standard deviation (SD) is needed when calculating the power or sample size of

### LAB : THE CHI-SQUARE TEST. Probability, Random Chance, and Genetics Period Date LAB : THE CHI-SQUARE TEST Probability, Random Chance, and Genetics Why do we study random chance and probability at the beginning of a unit on genetics? Genetics is the study of inheritance,

### Two-sample inference: Continuous data Two-sample inference: Continuous data Patrick Breheny April 5 Patrick Breheny STA 580: Biostatistics I 1/32 Introduction Our next two lectures will deal with two-sample inference for continuous data As

### Hypothesis Testing. Steps for a hypothesis test: Hypothesis Testing Steps for a hypothesis test: 1. State the claim H 0 and the alternative, H a 2. Choose a significance level or use the given one. 3. Draw the sampling distribution based on the assumption

### NCC5010: Data Analytics and Modeling Spring 2015 Practice Exemption Exam NCC5010: Data Analytics and Modeling Spring 2015 Practice Exemption Exam Do not look at other pages until instructed to do so. The time limit is two hours. This exam consists of 6 problems. Do all of your

### Good luck! BUSINESS STATISTICS FINAL EXAM INSTRUCTIONS. Name: Glo bal Leadership M BA BUSINESS STATISTICS FINAL EXAM Name: INSTRUCTIONS 1. Do not open this exam until instructed to do so. 2. Be sure to fill in your name before starting the exam. 3. You have two hours

### One-Way Analysis of Variance (ANOVA) Example Problem One-Way Analysis of Variance (ANOVA) Example Problem Introduction Analysis of Variance (ANOVA) is a hypothesis-testing technique used to test the equality of two or more population (or treatment) means

### Teaching Business Statistics through Problem Solving Teaching Business Statistics through Problem Solving David M. Levine, Baruch College, CUNY with David F. Stephan, Two Bridges Instructional Technology CONTACT: davidlevine@davidlevinestatistics.com Typical

### Example G Cost of construction of nuclear power plants 1 Example G Cost of construction of nuclear power plants Description of data Table G.1 gives data, reproduced by permission of the Rand Corporation, from a report (Mooz, 1978) on 32 light water reactor

### AMS 5 Statistics. Instructor: Bruno Mendes mendes@ams.ucsc.edu, Office 141 Baskin Engineering. July 11, 2008 AMS 5 Statistics Instructor: Bruno Mendes mendes@ams.ucsc.edu, Office 141 Baskin Engineering July 11, 2008 Course contents and objectives Our main goal is to help a student develop a feeling for experimental

### Comparing Two Groups. Standard Error of ȳ 1 ȳ 2. Setting. Two Independent Samples Comparing Two Groups Chapter 7 describes two ways to compare two populations on the basis of independent samples: a confidence interval for the difference in population means and a hypothesis test. The

### Online 12 - Sections 9.1 and 9.2-Doug Ensley Student: Date: Instructor: Doug Ensley Course: MAT117 01 Applied Statistics - Ensley Assignment: Online 12 - Sections 9.1 and 9.2 1. Does a P-value of 0.001 give strong evidence or not especially strong Name: University of Chicago Graduate School of Business Business 41000: Business Statistics Special Notes: 1. This is a closed-book exam. You may use an 8 11 piece of paper for the formulas. 2. Throughout

### What Is Probability? 1 What Is Probability? The idea: Uncertainty can often be "quantified" i.e., we can talk about degrees of certainty or uncertainty. This is the idea of probability: a higher probability expresses a higher

### Practice problems for Homework 12 - confidence intervals and hypothesis testing. Open the Homework Assignment 12 and solve the problems. Practice problems for Homework 1 - confidence intervals and hypothesis testing. Read sections 10..3 and 10.3 of the text. Solve the practice problems below. Open the Homework Assignment 1 and solve the

### Section 13, Part 1 ANOVA. Analysis Of Variance Section 13, Part 1 ANOVA Analysis Of Variance Course Overview So far in this course we ve covered: Descriptive statistics Summary statistics Tables and Graphs Probability Probability Rules Probability

### Simple Random Sampling Source: Frerichs, R.R. Rapid Surveys (unpublished), 2008. NOT FOR COMMERCIAL DISTRIBUTION 3 Simple Random Sampling 3.1 INTRODUCTION Everyone mentions simple random sampling, but few use this method for

### CHANCE ENCOUNTERS. Making Sense of Hypothesis Tests. Howard Fincher. Learning Development Tutor. Upgrade Study Advice Service CHANCE ENCOUNTERS Making Sense of Hypothesis Tests Howard Fincher Learning Development Tutor Upgrade Study Advice Service Oxford Brookes University Howard Fincher 2008 PREFACE This guide has a restricted

### Statistics 104: Section 6! Page 1 Statistics 104: Section 6! TF: Deirdre (say: Dear-dra) Bloome Email: dbloome@fas.harvard.edu Section Times Thursday 2pm-3pm in SC 109, Thursday 5pm-6pm in SC 705 Office Hours: Thursday 6pm-7pm SC

### " Y. Notation and Equations for Regression Lecture 11/4. Notation: Notation: Notation and Equations for Regression Lecture 11/4 m: The number of predictor variables in a regression Xi: One of multiple predictor variables. The subscript i represents any number from 1 through

### Chapter Four. Data Analyses and Presentation of the Findings Chapter Four Data Analyses and Presentation of the Findings The fourth chapter represents the focal point of the research report. Previous chapters of the report have laid the groundwork for the project.

### The Math. P (x) = 5! = 1 2 3 4 5 = 120. The Math Suppose there are n experiments, and the probability that someone gets the right answer on any given experiment is p. So in the first example above, n = 5 and p = 0.2. Let X be the number of correct

### Chi Square Tests. Chapter 10. 10.1 Introduction Contents 10 Chi Square Tests 703 10.1 Introduction............................ 703 10.2 The Chi Square Distribution.................. 704 10.3 Goodness of Fit Test....................... 709 10.4 Chi Square

### Section 14 Simple Linear Regression: Introduction to Least Squares Regression Slide 1 Section 14 Simple Linear Regression: Introduction to Least Squares Regression There are several different measures of statistical association used for understanding the quantitative relationship

### t Tests in Excel The Excel Statistical Master By Mark Harmon Copyright 2011 Mark Harmon t-tests in Excel By Mark Harmon Copyright 2011 Mark Harmon No part of this publication may be reproduced or distributed without the express permission of the author. mark@excelmasterseries.com www.excelmasterseries.com

### Chicago Booth BUSINESS STATISTICS 41000 Final Exam Fall 2011 Chicago Booth BUSINESS STATISTICS 41000 Final Exam Fall 2011 Name: Section: I pledge my honor that I have not violated the Honor Code Signature: This exam has 34 pages. You have 3 hours to complete this

### One-Way Analysis of Variance One-Way Analysis of Variance Note: Much of the math here is tedious but straightforward. We ll skim over it in class but you should be sure to ask questions if you don t understand it. I. Overview A. We

### Characteristics of Binomial Distributions Lesson2 Characteristics of Binomial Distributions In the last lesson, you constructed several binomial distributions, observed their shapes, and estimated their means and standard deviations. In Investigation

### Why Taking This Course? Course Introduction, Descriptive Statistics and Data Visualization. Learning Goals. GENOME 560, Spring 2012 Why Taking This Course? Course Introduction, Descriptive Statistics and Data Visualization GENOME 560, Spring 2012 Data are interesting because they help us understand the world Genomics: Massive Amounts

### Penalized regression: Introduction Penalized regression: Introduction Patrick Breheny August 30 Patrick Breheny BST 764: Applied Statistical Modeling 1/19 Maximum likelihood Much of 20th-century statistics dealt with maximum likelihood

### Simulation Exercises to Reinforce the Foundations of Statistical Thinking in Online Classes Simulation Exercises to Reinforce the Foundations of Statistical Thinking in Online Classes Simcha Pollack, Ph.D. St. John s University Tobin College of Business Queens, NY, 11439 pollacks@stjohns.edu

### BA 275 Review Problems - Week 6 (10/30/06-11/3/06) CD Lessons: 53, 54, 55, 56 Textbook: pp. 394-398, 404-408, 410-420 BA 275 Review Problems - Week 6 (10/30/06-11/3/06) CD Lessons: 53, 54, 55, 56 Textbook: pp. 394-398, 404-408, 410-420 1. Which of the following will increase the value of the power in a statistical test

### Population Mean (Known Variance) Confidence Intervals Solutions STAT-UB.0103 Statistics for Business Control and Regression Models Population Mean (Known Variance) 1. A random sample of n measurements was selected from a population with

### Service courses for graduate students in degree programs other than the MS or PhD programs in Biostatistics. Course Catalog In order to be assured that all prerequisites are met, students must acquire a permission number from the education coordinator prior to enrolling in any Biostatistics course. Courses are

### Measurement in ediscovery Measurement in ediscovery A Technical White Paper Herbert Roitblat, Ph.D. CTO, Chief Scientist Measurement in ediscovery From an information-science perspective, ediscovery is about separating the responsive

### Discrete Mathematics and Probability Theory Fall 2009 Satish Rao, David Tse Note 13. Random Variables: Distribution and Expectation CS 70 Discrete Mathematics and Probability Theory Fall 2009 Satish Rao, David Tse Note 3 Random Variables: Distribution and Expectation Random Variables Question: The homeworks of 20 students are collected

### Introduction to time series analysis Introduction to time series analysis Margherita Gerolimetto November 3, 2010 1 What is a time series? A time series is a collection of observations ordered following a parameter that for us is time. Examples

### Cell Phone Impairment? Cell Phone Impairment? Overview of Lesson This lesson is based upon data collected by researchers at the University of Utah (Strayer and Johnston, 2001). The researchers asked student volunteers (subjects)

### Elements of statistics (MATH0487-1) Elements of statistics (MATH0487-1) Prof. Dr. Dr. K. Van Steen University of Liège, Belgium December 10, 2012 Introduction to Statistics Basic Probability Revisited Sampling Exploratory Data Analysis -

### Simulating Chi-Square Test Using Excel Simulating Chi-Square Test Using Excel Leslie Chandrakantha John Jay College of Criminal Justice of CUNY Mathematics and Computer Science Department 524 West 59 th Street, New York, NY 10019 lchandra@jjay.cuny.edu

### Math 58. Rumbos Fall 2008 1. Solutions to Assignment #3 Math 58. Rumbos Fall 2008 1 Solutions to Assignment #3 1. Use randomization to test the null hypothesis that there is no difference between calcium supplementation and a placebo for the experimental data

### LOGNORMAL MODEL FOR STOCK PRICES LOGNORMAL MODEL FOR STOCK PRICES MICHAEL J. SHARPE MATHEMATICS DEPARTMENT, UCSD 1. INTRODUCTION What follows is a simple but important model that will be the basis for a later study of stock prices as

### Multiple Linear Regression in Data Mining Multiple Linear Regression in Data Mining Contents 2.1. A Review of Multiple Linear Regression 2.2. Illustration of the Regression Process 2.3. Subset Selection in Linear Regression 1 2 Chap. 2 Multiple

### Hypothesis Testing for Beginners Hypothesis Testing for Beginners Michele Piffer LSE August, 2011 Michele Piffer (LSE) Hypothesis Testing for Beginners August, 2011 1 / 53 One year ago a friend asked me to put down some easy-to-read notes

### The correlation coefficient The correlation coefficient Clinical Biostatistics The correlation coefficient Martin Bland Correlation coefficients are used to measure the of the relationship or association between two quantitative Two-sample t-tests. - Independent samples - Pooled standard devation - The equal variance assumption Last time, we used the mean of one sample to test against the hypothesis that the true mean was a particular 2013 MBA Jump Start Program Module 1: Statistics Thomas Gilbert Part 3 Statistics Module Part 3 Hypothesis Testing (Inference) Regressions 2 1 Making an Investment Decision A researcher in your firm just