# Statistiek II. John Nerbonne. October 1, Dept of Information Science

Size: px
Start display at page:

Download "Statistiek II. John Nerbonne. October 1, 2010. Dept of Information Science j.nerbonne@rug.nl"

Transcription

1 Dept of Information Science October 1, 2010

2 Course outline 1 One-way ANOVA. 2 Factorial ANOVA. 3 Repeated measures ANOVA. 4 Correlation and regression. 5 Multiple regression. 6 Logistic regression.

3 Lecture outline Today: One-way ANOVA 1 General motivation 2 F -test and F -distribution 3 ANOVA example 4 The logic of ANOVA Short break 5 ANOVA calculations 6 Post-hoc tests

4 What s ANalysis Of VAriance (ANOVA)? Most popular statistical test for numerical data Generalized t-test Compares means of more than two groups Fairly robust Based on F -distribution compares variances (between groups and within groups) Two basic versions: a One-way (or single) ANOVA: compare groups along one dimension, e.g., grade point average by school class b N-way (or factorial) ANOVA: compare groups along 2 dimensions, e.g., grade point average by school class and gender

5 Typical applications One-way ANOVA: Compare time needed for lexical recognition in 1. healthy adults 2. patients with Wernicke s aphasia 3. patients with Broca s aphasia Factorial ANOVA: Compare lexical recognition time in male and female in the same three groups

6 Comparing multiple means For two groups: use t-test Note: testing for p-value of 0.05 shows significance 1 time in 20 if there is no difference in population mean (effect of chance) But suppose there are 7 groups, i.e., we test ( 7 2) = 21 pairs of groups Caution: several tests (on the same data) run the risk of finding significance through sheer chance

7 Multiple comparison problem Example: Suppose you run k = 3 tests, always seeking a result significant at α = 0.05 probability of getting at least one false positive is given by: α FW = 1 P(zero false positive results) = 1 (1 α) k = 1 (1 0.05) 3 = 1 (0.95) 3 = Hence, with only 3 pairwise tests, the chance of committing type I error almost 15% (and 66% for 21 tests!) α FW called Bonferroni family-wise α-level

8 Bonferroni correction for multiple comparisons To guarantee a family-wise α-level of 0.05, divide α by number of tests. Example: 0.05/3 (= α/# tests) = (note: ) set α = (= Bonferroni-corrected α-level) If p-value is less than the Bonferroni-corrected target α: reject the null hypothesis. If p-value greater than the Bonferroni-corrected target α: do not reject the null hypothesis.

9 Analysis of variance ANOVA automatically corrects for looking at several relationships (like Bonferroni correction) Based on F -distribution: Moore & McCabe, 7.3, pp Measures the difference between two variances (variance σ 2 ) F = s2 1 s 2 2 always positive since variances are positive two degrees of freedom interesting, one for s 1, one for s 2

10 F -test vs. F -distribution F -value: F = s2 1 s 2 2 F -values used in F -test (Fisher s test) H 0 : samples are from same distribution (s 1 = s 2 ) H a : samples are from different distributions (s 1 s 2 ) - value near 1 indicates same variance - value near 0 or + indicates difference in variance F -test very sensitive to deviations from normal ANOVA uses F -distribution, but is different: ANOVA F -test!

11 F -distribution Critical area for F -distribution at p = 0.05 (df: 12,10) Probability density rejection region acceptance region rejection region Note the symmetry: P( s2 1 s 2 2 F value < x) = P( s2 2 s 2 1 (because y < x 1 y > 1 x for x, y R + ) > 1 x )

12 F -test Example: height group sample mean standard size deviation boys cm 6cm girls 9 168cm 4cm Is the difference in standard deviation significant? Examine F = s2 boys s 2 girls Degrees of freedom: df boys = 16 1 df girls = 9 1

13 F -test critical area (for two-tailed test with α = 0.05) P(F (15, 8) > x) = α 2 = P(F (15, 8) < x) = P(F (15, 8) < 4.1) = Moore & McCabe, Table E, p. 706 P(F (15, 8) < x) = P(F (8, 15) > x ) = where x = 1 x P(F (8, 15) > 3.2) = (tables) P(F (15, 8) < ) = P(F (15, 8) < 0.31) = (no values directly for P(F (df 1, df 2 ) > x)) Reject H 0 if F < 0.31 or F > 4.1 Here, F = = 2.25 (hence no evidence of difference in distributions)

14 ANOVA Analysis of Variance (ANOVA) most popular statistical test for numerical data several types - single, one-way - factorial, two-, three-,..., n-way - single/factorial repeated measures examines variation - between-groups gender, age, etc. - within-groups overall automatically corrects for looking at several relationships (like Bonferroni correction) uses F -distribution, where F (n, m) fixes n typically at the number of groups (minus 1), m at the number of subjects, i.e., data points (minus number of groups)

15 Detailed example: one-way ANOVA Question: Are exam grades of four groups of foreign students Nederlands voor anderstaligen the same? More exactly, are the four averages the same? H 0 : µ 1 = µ 2 = µ 3 = µ 4 H a : µ 1 µ 2 or µ 1 µ 3... or µ 3 µ 4 Alternative hypothesis: at least one group has a different mean For the question of whether any particular pair is different, the t-test is appropriate. For testing whether all language groups are the same, pairwise t-tests exaggerate differences (increase the chance of type I error) We therefore want to apply one-way ANOVA

16 Data: Dutch proficiency of foreigners Four groups of ten students each: Group Europe America Africa Asia Mean Samp. SD Samp. Variance

17 ANOVA conditions ANOVA assumptions: Normal distribution per subgroup Same variance in subgroups: least SD > one-half of largest SD independent observations: watch out for test-retest situations! Check differences in SD s! (some SPSS computing)

18 ANOVA conditions Assumption: normal distribution per group, check with normal quantile plot, e.g., for Europeans below (repeat for every group) Normal Q-Q plot of toets.nl voor anderstalige

19 Visualizing ANOVA data Is there a significant difference in the means (of the groups being contrasted)? Take care that boxplots sketch medians not means.

20 Sketch of ANOVA Group Eur. Amer. Africa Asia x 1j x 2j x 3j x 4j x 1 x 2 x 3 x 4 Notation: Group index: i {1, 2, 3, 4} Sample index: j N i = size of group i Data point x ij : ith group, jth observation Number of groups: I = 4 Total mean: x Group mean: x i For any data point x ij : (x ij x) = (x i x) + (x ij x i ) total residue = group diff. + error ANOVA question: does group membership influence the response variable?

21 Two variances Reminder of high school algebra: (a + b) 2 = a 2 + b 2 + 2ab ab a 2 a b 2 ab b

22 Two variances Data point x ij : (x ij x) = (x i x) + (x ij x i ) Want sum of squared deviates for each group: (x ij x) 2 = (x i x) 2 + (x ij x i ) 2 + 2(x i x)(x ij x i ) Sum over elements in ith group: N i (x ij x) 2 = j=1 N i N i (x i x) 2 + (x ij x i ) 2 + 2(x i x)(x ij x i ) j=1 j=1 j=1 N i

23 Two variances Note that this term must be zero: Because: N i 2(x i x)(x ij x i ) j=1 (a) (b) N i 2(x i x)(x ij x i ) = 2(x i x) (x ij x i ) j=1 N i (x ij x i ) = 0 x i = j=1 N i j=1 } {{ } Ni j=1 x ij 0 N i

24 Two variances So we have: N i j=1 (x ij x) 2 = N i N i (x i x) 2 + (x ij x i ) 2 j=1 j=1 N i (+ 2(x i x)(x ij x i ) = 0) j=1 Therefore: N i j=1 (x ij x) 2 = N i N i (x i x) 2 + (x ij x i ) 2 j=1 j=1 And finally we can sum over all groups: I N i I N i I N i (x ij x) 2 = (x i x) 2 + (x ij x i ) 2 i=1 j=1 i=1 j=1 i=1 j=1

25 ANOVA terminology (x ij x) = (x i x) + (x ij x i ) total residue = group diff. + error I N i I I N i (x ij x) 2 = N i (x i x) 2 + (x ij x i ) 2 i=1 j=1 i=1 i=1 j=1 SST SSG SSE Total Sum of Squares = Group Sum of Squares + Error Sum of Squares (n 1) = (I 1) + (n I ) DFT DFG DFE Total Degrees of Freedom = Group Degrees of Freedom + Error Degrees of Freedom

26 Variances are mean squared differences to the mean Note that SST/DFT: P I P Ni i=1 j=1 (x ij x) 2 n 1 is a variance, and likewise SSG/DFG: labelled MSG ( Mean square between groups ), and SSE/DFE: labelled MSE ( Mean square error or sometimes Mean square within groups ) In ANOVA, we compare MSG (variance between groups) and MSE (variance within groups), i.e. we measure F = MSG MSE If this F -value is large, differences between groups overshadow differences within groups.

27 Two variances 1) Estimate the pooled variance of the population (MSE): MSE = DFE SSE PI P Ni = i=1 j=1 (x ij x i ) 2 n I equiv = P I i=1 DF i s 2 i P I i=1 DF i In our example (Nederlands for anderstaligen): P I i=1 DF i s 2 i P I i=1 DF i = (N1 1)s2 1 + (N 3 1)s (N 3 1)s (N 4 1)s 2 4 (N 1 1) + (N 3 1) + (N 3 1) + (N 4 1) = = = Estimates the variance in groups (using DF), aka within-groups estimate of variance

28 Two variances 2) Estimate the between-groups variance of the population (MSG): MSG = DFG SSG P = I i=1 N i (x i x) 2 I 1 In our example (Nederlands for anderstaligen): We had 4 group means: 25.0, 21.9, 23.1, 21.3, grand mean: 22.8 MSG = 10 (( )2 +( ) 2 +( ) 2 +( ) 2 ) 4 1 = 26.6 The between-groups variance (MSG) is an aggregate estimate of the degree to which the four sample means differ from one another

29 Interpreting estimates with F -scores If H 0 is true, then we have two variances: Between-groups estimate: s 2 bg = Within-groups estimate: s 2 wg = and and their ratio s 2 bg s 2 wg follows an F -distribution with: (# groups 1) = 3 degrees of freedom for s bg 2 and (# observations # groups) = 36 degrees of freedom for swg 2 In our example: F (3, 36) = = 0.55 P(F (3, 40) > 2.84) = 0.05 (see tables), so there is no evidence of non-uniform behavior

30 SPSS summary No evidence of non-uniform behavior

31 Other questions ANOVA H 0 : µ 1 = µ 2 =... = µ n But sometimes particular contrasts are important e.g., are Europeans better (in learning Dutch)? Distinguish (in reporting results): prior contrasts questions asked before data is collected and analyzed post hoc (posterior) questions questions asked after data collection and analysis data-snooping is exploratory, cannot contribute to hypothesis testing

32 Prior contrasts Questions asked before data collection and analysis e.g., are Europeans better (in learning Dutch)? Another way of putting this: H 0 : µ Eur = 1 3 (µ Am + µ Afr + µ Asia ) H a : µ Eur 1 3 (µ Am + µ Afr + µ Asia ) Reformulation (SPSS requires this): H 0 : 0 = µ Eur µ Am µ Afr µ Asia

33 Prior contrasts in SPSS Mean of every group gets a coefficient Sum of coefficients is 0 A t-test is carried out and two-tailed p-value is reported (as usual): No significant difference here (of course) Note: prior contrasts are legitimate as hypothesis tests as long as they are formulated before data collection and analysis

34 Post-hoc questions Assume H 0 is rejected: which means are distinct? Data-snooping problem: in a large set, some distinctions are likely to be statistically significant But we can still look (we just cannot claim to have tested the hypothesis) We are asking whether m i m j is significantly larger, we apply a variant of the t-test The relevant sd is MSE n (differences among scores), but there is a correction since we re looking at a proportion of the scores in any one comparison

35 SD in post-hoc ANOVA questions Standard deviation (among differences in groups i and j): sd = t = MSE N i +N j N = = 4.9 x i x j sd q 1 N i + 1 N j The critical t-value is calculated as p c where p is the desired significance level and c is the number of comparisons. For pairwise comparisons: c = ( ) I 2

36 Post-hoc questions in SPSS SPSS post-hoc Bonferroni -searches among all groupings for statistically significant ones But in this case there are none (of course)

37 How to win at ANOVA Note the ways in which the F -ratio increases (i.e., becomes more significant): F = MSG MSE 1. MSG increases: differences in means between groups grow larger 2. MSE decreases: overall variation within groups grows smaller

38 Two models for grouped data x ij = µ + ɛ ij x ij = µ + α i + ɛ ij First model: no group effect each data point represents error (ɛ) around a mean (µ) Second model: real group effect each data point represents error (ɛ) around an overall mean (µ), combined with a group adjustment (α i ) ANOVA asks: is there sufficient evidence for α i?

39 Next week Next week: factorial ANOVA

### Section 13, Part 1 ANOVA. Analysis Of Variance

Section 13, Part 1 ANOVA Analysis Of Variance Course Overview So far in this course we ve covered: Descriptive statistics Summary statistics Tables and Graphs Probability Probability Rules Probability

### 1.5 Oneway Analysis of Variance

Statistics: Rosie Cornish. 200. 1.5 Oneway Analysis of Variance 1 Introduction Oneway analysis of variance (ANOVA) is used to compare several means. This method is often used in scientific or medical experiments

### 1 Basic ANOVA concepts

Math 143 ANOVA 1 Analysis of Variance (ANOVA) Recall, when we wanted to compare two population means, we used the 2-sample t procedures. Now let s expand this to compare k 3 population means. As with the

### THE KRUSKAL WALLLIS TEST

THE KRUSKAL WALLLIS TEST TEODORA H. MEHOTCHEVA Wednesday, 23 rd April 08 THE KRUSKAL-WALLIS TEST: The non-parametric alternative to ANOVA: testing for difference between several independent groups 2 NON

### Chapter 5 Analysis of variance SPSS Analysis of variance

Chapter 5 Analysis of variance SPSS Analysis of variance Data file used: gss.sav How to get there: Analyze Compare Means One-way ANOVA To test the null hypothesis that several population means are equal,

### INTERPRETING THE ONE-WAY ANALYSIS OF VARIANCE (ANOVA)

INTERPRETING THE ONE-WAY ANALYSIS OF VARIANCE (ANOVA) As with other parametric statistics, we begin the one-way ANOVA with a test of the underlying assumptions. Our first assumption is the assumption of

### UNDERSTANDING THE TWO-WAY ANOVA

UNDERSTANDING THE e have seen how the one-way ANOVA can be used to compare two or more sample means in studies involving a single independent variable. This can be extended to two independent variables

### 3.4 Statistical inference for 2 populations based on two samples

3.4 Statistical inference for 2 populations based on two samples Tests for a difference between two population means The first sample will be denoted as X 1, X 2,..., X m. The second sample will be denoted

### Analysis of Data. Organizing Data Files in SPSS. Descriptive Statistics

Analysis of Data Claudia J. Stanny PSY 67 Research Design Organizing Data Files in SPSS All data for one subject entered on the same line Identification data Between-subjects manipulations: variable to

### ANOVA ANOVA. Two-Way ANOVA. One-Way ANOVA. When to use ANOVA ANOVA. Analysis of Variance. Chapter 16. A procedure for comparing more than two groups

ANOVA ANOVA Analysis of Variance Chapter 6 A procedure for comparing more than two groups independent variable: smoking status non-smoking one pack a day > two packs a day dependent variable: number of

### HYPOTHESIS TESTING: CONFIDENCE INTERVALS, T-TESTS, ANOVAS, AND REGRESSION

HYPOTHESIS TESTING: CONFIDENCE INTERVALS, T-TESTS, ANOVAS, AND REGRESSION HOD 2990 10 November 2010 Lecture Background This is a lightning speed summary of introductory statistical methods for senior undergraduate

### Independent t- Test (Comparing Two Means)

Independent t- Test (Comparing Two Means) The objectives of this lesson are to learn: the definition/purpose of independent t-test when to use the independent t-test the use of SPSS to complete an independent

### An Introduction to Statistics Course (ECOE 1302) Spring Semester 2011 Chapter 10- TWO-SAMPLE TESTS

The Islamic University of Gaza Faculty of Commerce Department of Economics and Political Sciences An Introduction to Statistics Course (ECOE 130) Spring Semester 011 Chapter 10- TWO-SAMPLE TESTS Practice

### One-Way Analysis of Variance: A Guide to Testing Differences Between Multiple Groups

One-Way Analysis of Variance: A Guide to Testing Differences Between Multiple Groups In analysis of variance, the main research question is whether the sample means are from different populations. The

### Linear Models in STATA and ANOVA

Session 4 Linear Models in STATA and ANOVA Page Strengths of Linear Relationships 4-2 A Note on Non-Linear Relationships 4-4 Multiple Linear Regression 4-5 Removal of Variables 4-8 Independent Samples

### Introduction. Hypothesis Testing. Hypothesis Testing. Significance Testing

Introduction Hypothesis Testing Mark Lunt Arthritis Research UK Centre for Ecellence in Epidemiology University of Manchester 13/10/2015 We saw last week that we can never know the population parameters

### Introduction to Analysis of Variance (ANOVA) Limitations of the t-test

Introduction to Analysis of Variance (ANOVA) The Structural Model, The Summary Table, and the One- Way ANOVA Limitations of the t-test Although the t-test is commonly used, it has limitations Can only

### Outline. Topic 4 - Analysis of Variance Approach to Regression. Partitioning Sums of Squares. Total Sum of Squares. Partitioning sums of squares

Topic 4 - Analysis of Variance Approach to Regression Outline Partitioning sums of squares Degrees of freedom Expected mean squares General linear test - Fall 2013 R 2 and the coefficient of correlation

### Analysis of Variance ANOVA

Analysis of Variance ANOVA Overview We ve used the t -test to compare the means from two independent groups. Now we ve come to the final topic of the course: how to compare means from more than two populations.

### Chapter 8 Hypothesis Testing Chapter 8 Hypothesis Testing 8-1 Overview 8-2 Basics of Hypothesis Testing

Chapter 8 Hypothesis Testing 1 Chapter 8 Hypothesis Testing 8-1 Overview 8-2 Basics of Hypothesis Testing 8-3 Testing a Claim About a Proportion 8-5 Testing a Claim About a Mean: s Not Known 8-6 Testing

### Examining Differences (Comparing Groups) using SPSS Inferential statistics (Part I) Dwayne Devonish

Examining Differences (Comparing Groups) using SPSS Inferential statistics (Part I) Dwayne Devonish Statistics Statistics are quantitative methods of describing, analysing, and drawing inferences (conclusions)

### One-Way Analysis of Variance (ANOVA) Example Problem

One-Way Analysis of Variance (ANOVA) Example Problem Introduction Analysis of Variance (ANOVA) is a hypothesis-testing technique used to test the equality of two or more population (or treatment) means

### Difference of Means and ANOVA Problems

Difference of Means and Problems Dr. Tom Ilvento FREC 408 Accounting Firm Study An accounting firm specializes in auditing the financial records of large firm It is interested in evaluating its fee structure,particularly

### CHAPTER 13. Experimental Design and Analysis of Variance

CHAPTER 13 Experimental Design and Analysis of Variance CONTENTS STATISTICS IN PRACTICE: BURKE MARKETING SERVICES, INC. 13.1 AN INTRODUCTION TO EXPERIMENTAL DESIGN AND ANALYSIS OF VARIANCE Data Collection

### 1. What is the critical value for this 95% confidence interval? CV = z.025 = invnorm(0.025) = 1.96

1 Final Review 2 Review 2.1 CI 1-propZint Scenario 1 A TV manufacturer claims in its warranty brochure that in the past not more than 10 percent of its TV sets needed any repair during the first two years

### Psychology 60 Fall 2013 Practice Exam Actual Exam: Next Monday. Good luck!

Psychology 60 Fall 2013 Practice Exam Actual Exam: Next Monday. Good luck! Name: 1. The basic idea behind hypothesis testing: A. is important only if you want to compare two populations. B. depends on

### HYPOTHESIS TESTING: POWER OF THE TEST

HYPOTHESIS TESTING: POWER OF THE TEST The first 6 steps of the 9-step test of hypothesis are called "the test". These steps are not dependent on the observed data values. When planning a research project,

### Testing Group Differences using T-tests, ANOVA, and Nonparametric Measures

Testing Group Differences using T-tests, ANOVA, and Nonparametric Measures Jamie DeCoster Department of Psychology University of Alabama 348 Gordon Palmer Hall Box 870348 Tuscaloosa, AL 35487-0348 Phone:

### SCHOOL OF HEALTH AND HUMAN SCIENCES DON T FORGET TO RECODE YOUR MISSING VALUES

SCHOOL OF HEALTH AND HUMAN SCIENCES Using SPSS Topics addressed today: 1. Differences between groups 2. Graphing Use the s4data.sav file for the first part of this session. DON T FORGET TO RECODE YOUR

### Comparing Means in Two Populations

Comparing Means in Two Populations Overview The previous section discussed hypothesis testing when sampling from a single population (either a single mean or two means from the same population). Now we

### Statistics Review PSY379

Statistics Review PSY379 Basic concepts Measurement scales Populations vs. samples Continuous vs. discrete variable Independent vs. dependent variable Descriptive vs. inferential stats Common analyses

### research/scientific includes the following: statistical hypotheses: you have a null and alternative you accept one and reject the other

1 Hypothesis Testing Richard S. Balkin, Ph.D., LPC-S, NCC 2 Overview When we have questions about the effect of a treatment or intervention or wish to compare groups, we use hypothesis testing Parametric

### Two-sample hypothesis testing, II 9.07 3/16/2004

Two-sample hypothesis testing, II 9.07 3/16/004 Small sample tests for the difference between two independent means For two-sample tests of the difference in mean, things get a little confusing, here,

### Study Guide for the Final Exam

Study Guide for the Final Exam When studying, remember that the computational portion of the exam will only involve new material (covered after the second midterm), that material from Exam 1 will make

### UNDERSTANDING ANALYSIS OF COVARIANCE (ANCOVA)

UNDERSTANDING ANALYSIS OF COVARIANCE () In general, research is conducted for the purpose of explaining the effects of the independent variable on the dependent variable, and the purpose of research design

### The Dummy s Guide to Data Analysis Using SPSS

The Dummy s Guide to Data Analysis Using SPSS Mathematics 57 Scripps College Amy Gamble April, 2001 Amy Gamble 4/30/01 All Rights Rerserved TABLE OF CONTENTS PAGE Helpful Hints for All Tests...1 Tests

### Two-Sample T-Tests Assuming Equal Variance (Enter Means)

Chapter 4 Two-Sample T-Tests Assuming Equal Variance (Enter Means) Introduction This procedure provides sample size and power calculations for one- or two-sided two-sample t-tests when the variances of

### Analysing Questionnaires using Minitab (for SPSS queries contact -) Graham.Currell@uwe.ac.uk

Analysing Questionnaires using Minitab (for SPSS queries contact -) Graham.Currell@uwe.ac.uk Structure As a starting point it is useful to consider a basic questionnaire as containing three main sections:

### Descriptive Statistics

Descriptive Statistics Primer Descriptive statistics Central tendency Variation Relative position Relationships Calculating descriptive statistics Descriptive Statistics Purpose to describe or summarize

### Final Exam Practice Problem Answers

Final Exam Practice Problem Answers The following data set consists of data gathered from 77 popular breakfast cereals. The variables in the data set are as follows: Brand: The brand name of the cereal

### Simple Linear Regression Inference

Simple Linear Regression Inference 1 Inference requirements The Normality assumption of the stochastic term e is needed for inference even if it is not a OLS requirement. Therefore we have: Interpretation

### Non-Parametric Tests (I)

Lecture 5: Non-Parametric Tests (I) KimHuat LIM lim@stats.ox.ac.uk http://www.stats.ox.ac.uk/~lim/teaching.html Slide 1 5.1 Outline (i) Overview of Distribution-Free Tests (ii) Median Test for Two Independent

### STA-201-TE. 5. Measures of relationship: correlation (5%) Correlation coefficient; Pearson r; correlation and causation; proportion of common variance

Principles of Statistics STA-201-TE This TECEP is an introduction to descriptive and inferential statistics. Topics include: measures of central tendency, variability, correlation, regression, hypothesis

### Lesson 1: Comparison of Population Means Part c: Comparison of Two- Means

Lesson : Comparison of Population Means Part c: Comparison of Two- Means Welcome to lesson c. This third lesson of lesson will discuss hypothesis testing for two independent means. Steps in Hypothesis

### 12: Analysis of Variance. Introduction

1: Analysis of Variance Introduction EDA Hypothesis Test Introduction In Chapter 8 and again in Chapter 11 we compared means from two independent groups. In this chapter we extend the procedure to consider

### BA 275 Review Problems - Week 5 (10/23/06-10/27/06) CD Lessons: 48, 49, 50, 51, 52 Textbook: pp. 380-394

BA 275 Review Problems - Week 5 (10/23/06-10/27/06) CD Lessons: 48, 49, 50, 51, 52 Textbook: pp. 380-394 1. Does vigorous exercise affect concentration? In general, the time needed for people to complete

### UNDERSTANDING THE INDEPENDENT-SAMPLES t TEST

UNDERSTANDING The independent-samples t test evaluates the difference between the means of two independent or unrelated groups. That is, we evaluate whether the means for two independent groups are significantly

### Chapter 7. One-way ANOVA

Chapter 7 One-way ANOVA One-way ANOVA examines equality of population means for a quantitative outcome and a single categorical explanatory variable with any number of levels. The t-test of Chapter 6 looks

### Statistical Models in R

Statistical Models in R Some Examples Steven Buechler Department of Mathematics 276B Hurley Hall; 1-6233 Fall, 2007 Outline Statistical Models Structure of models in R Model Assessment (Part IA) Anova

### individualdifferences

1 Simple ANalysis Of Variance (ANOVA) Oftentimes we have more than two groups that we want to compare. The purpose of ANOVA is to allow us to compare group means from several independent samples. In general,

### COMPARISONS OF CUSTOMER LOYALTY: PUBLIC & PRIVATE INSURANCE COMPANIES.

277 CHAPTER VI COMPARISONS OF CUSTOMER LOYALTY: PUBLIC & PRIVATE INSURANCE COMPANIES. This chapter contains a full discussion of customer loyalty comparisons between private and public insurance companies

### A Primer on Mathematical Statistics and Univariate Distributions; The Normal Distribution; The GLM with the Normal Distribution

A Primer on Mathematical Statistics and Univariate Distributions; The Normal Distribution; The GLM with the Normal Distribution PSYC 943 (930): Fundamentals of Multivariate Modeling Lecture 4: September

### DDBA 8438: The t Test for Independent Samples Video Podcast Transcript

DDBA 8438: The t Test for Independent Samples Video Podcast Transcript JENNIFER ANN MORROW: Welcome to The t Test for Independent Samples. My name is Dr. Jennifer Ann Morrow. In today's demonstration,

### Multiple Linear Regression

Multiple Linear Regression A regression with two or more explanatory variables is called a multiple regression. Rather than modeling the mean response as a straight line, as in simple regression, it is

### Reporting Statistics in Psychology

This document contains general guidelines for the reporting of statistics in psychology research. The details of statistical reporting vary slightly among different areas of science and also among different

### Chapter Seven. Multiple regression An introduction to multiple regression Performing a multiple regression on SPSS

Chapter Seven Multiple regression An introduction to multiple regression Performing a multiple regression on SPSS Section : An introduction to multiple regression WHAT IS MULTIPLE REGRESSION? Multiple

### Premaster Statistics Tutorial 4 Full solutions

Premaster Statistics Tutorial 4 Full solutions Regression analysis Q1 (based on Doane & Seward, 4/E, 12.7) a. Interpret the slope of the fitted regression = 125,000 + 150. b. What is the prediction for

### CS 147: Computer Systems Performance Analysis

CS 147: Computer Systems Performance Analysis One-Factor Experiments CS 147: Computer Systems Performance Analysis One-Factor Experiments 1 / 42 Overview Introduction Overview Overview Introduction Finding

### MULTIPLE REGRESSION AND ISSUES IN REGRESSION ANALYSIS

MULTIPLE REGRESSION AND ISSUES IN REGRESSION ANALYSIS MSR = Mean Regression Sum of Squares MSE = Mean Squared Error RSS = Regression Sum of Squares SSE = Sum of Squared Errors/Residuals α = Level of Significance

### UNDERSTANDING THE DEPENDENT-SAMPLES t TEST

UNDERSTANDING THE DEPENDENT-SAMPLES t TEST A dependent-samples t test (a.k.a. matched or paired-samples, matched-pairs, samples, or subjects, simple repeated-measures or within-groups, or correlated groups)

### Outline. Definitions Descriptive vs. Inferential Statistics The t-test - One-sample t-test

The t-test Outline Definitions Descriptive vs. Inferential Statistics The t-test - One-sample t-test - Dependent (related) groups t-test - Independent (unrelated) groups t-test Comparing means Correlation

### Good luck! BUSINESS STATISTICS FINAL EXAM INSTRUCTIONS. Name:

Glo bal Leadership M BA BUSINESS STATISTICS FINAL EXAM Name: INSTRUCTIONS 1. Do not open this exam until instructed to do so. 2. Be sure to fill in your name before starting the exam. 3. You have two hours

### NCSS Statistical Software

Chapter 06 Introduction This procedure provides several reports for the comparison of two distributions, including confidence intervals for the difference in means, two-sample t-tests, the z-test, the

### THE FIRST SET OF EXAMPLES USE SUMMARY DATA... EXAMPLE 7.2, PAGE 227 DESCRIBES A PROBLEM AND A HYPOTHESIS TEST IS PERFORMED IN EXAMPLE 7.

THERE ARE TWO WAYS TO DO HYPOTHESIS TESTING WITH STATCRUNCH: WITH SUMMARY DATA (AS IN EXAMPLE 7.17, PAGE 236, IN ROSNER); WITH THE ORIGINAL DATA (AS IN EXAMPLE 8.5, PAGE 301 IN ROSNER THAT USES DATA FROM

### Introduction to Quantitative Methods

Introduction to Quantitative Methods October 15, 2009 Contents 1 Definition of Key Terms 2 2 Descriptive Statistics 3 2.1 Frequency Tables......................... 4 2.2 Measures of Central Tendencies.................

### CHAPTER 14 NONPARAMETRIC TESTS

CHAPTER 14 NONPARAMETRIC TESTS Everything that we have done up until now in statistics has relied heavily on one major fact: that our data is normally distributed. We have been able to make inferences

### Unit 31: One-Way ANOVA

Unit 31: One-Way ANOVA Summary of Video A vase filled with coins takes center stage as the video begins. Students will be taking part in an experiment organized by psychology professor John Kelly in which

### Parametric and non-parametric statistical methods for the life sciences - Session I

Why nonparametric methods What test to use? Rank Tests Parametric and non-parametric statistical methods for the life sciences - Session I Liesbeth Bruckers Geert Molenberghs Interuniversity Institute

### Research Methods & Experimental Design

Research Methods & Experimental Design 16.422 Human Supervisory Control April 2004 Research Methods Qualitative vs. quantitative Understanding the relationship between objectives (research question) and

### Two-Sample T-Tests Allowing Unequal Variance (Enter Difference)

Chapter 45 Two-Sample T-Tests Allowing Unequal Variance (Enter Difference) Introduction This procedure provides sample size and power calculations for one- or two-sided two-sample t-tests when no assumption

### One-Way ANOVA using SPSS 11.0. SPSS ANOVA procedures found in the Compare Means analyses. Specifically, we demonstrate

1 One-Way ANOVA using SPSS 11.0 This section covers steps for testing the difference between three or more group means using the SPSS ANOVA procedures found in the Compare Means analyses. Specifically,

### Part 3. Comparing Groups. Chapter 7 Comparing Paired Groups 189. Chapter 8 Comparing Two Independent Groups 217

Part 3 Comparing Groups Chapter 7 Comparing Paired Groups 189 Chapter 8 Comparing Two Independent Groups 217 Chapter 9 Comparing More Than Two Groups 257 188 Elementary Statistics Using SAS Chapter 7 Comparing

### 1 Nonparametric Statistics

1 Nonparametric Statistics When finding confidence intervals or conducting tests so far, we always described the population with a model, which includes a set of parameters. Then we could make decisions

### 5. Linear Regression

5. Linear Regression Outline.................................................................... 2 Simple linear regression 3 Linear model............................................................. 4

### Two Related Samples t Test

Two Related Samples t Test In this example 1 students saw five pictures of attractive people and five pictures of unattractive people. For each picture, the students rated the friendliness of the person

### Unit 31 A Hypothesis Test about Correlation and Slope in a Simple Linear Regression

Unit 31 A Hypothesis Test about Correlation and Slope in a Simple Linear Regression Objectives: To perform a hypothesis test concerning the slope of a least squares line To recognize that testing for a

### Association Between Variables

Contents 11 Association Between Variables 767 11.1 Introduction............................ 767 11.1.1 Measure of Association................. 768 11.1.2 Chapter Summary.................... 769 11.2 Chi

### General Method: Difference of Means. 3. Calculate df: either Welch-Satterthwaite formula or simpler df = min(n 1, n 2 ) 1.

General Method: Difference of Means 1. Calculate x 1, x 2, SE 1, SE 2. 2. Combined SE = SE1 2 + SE2 2. ASSUMES INDEPENDENT SAMPLES. 3. Calculate df: either Welch-Satterthwaite formula or simpler df = min(n

### An analysis method for a quantitative outcome and two categorical explanatory variables.

Chapter 11 Two-Way ANOVA An analysis method for a quantitative outcome and two categorical explanatory variables. If an experiment has a quantitative outcome and two categorical explanatory variables that

### This chapter discusses some of the basic concepts in inferential statistics.

Research Skills for Psychology Majors: Everything You Need to Know to Get Started Inferential Statistics: Basic Concepts This chapter discusses some of the basic concepts in inferential statistics. Details

### 1. The parameters to be estimated in the simple linear regression model Y=α+βx+ε ε~n(0,σ) are: a) α, β, σ b) α, β, ε c) a, b, s d) ε, 0, σ

STA 3024 Practice Problems Exam 2 NOTE: These are just Practice Problems. This is NOT meant to look just like the test, and it is NOT the only thing that you should study. Make sure you know all the material

### Introduction to Statistics with GraphPad Prism (5.01) Version 1.1

Babraham Bioinformatics Introduction to Statistics with GraphPad Prism (5.01) Version 1.1 Introduction to Statistics with GraphPad Prism 2 Licence This manual is 2010-11, Anne Segonds-Pichon. This manual

### 1 Simple Linear Regression I Least Squares Estimation

Simple Linear Regression I Least Squares Estimation Textbook Sections: 8. 8.3 Previously, we have worked with a random variable x that comes from a population that is normally distributed with mean µ and

### " Y. Notation and Equations for Regression Lecture 11/4. Notation:

Notation: Notation and Equations for Regression Lecture 11/4 m: The number of predictor variables in a regression Xi: One of multiple predictor variables. The subscript i represents any number from 1 through

### Non-Inferiority Tests for Two Means using Differences

Chapter 450 on-inferiority Tests for Two Means using Differences Introduction This procedure computes power and sample size for non-inferiority tests in two-sample designs in which the outcome is a continuous

### Randomized Block Analysis of Variance

Chapter 565 Randomized Block Analysis of Variance Introduction This module analyzes a randomized block analysis of variance with up to two treatment factors and their interaction. It provides tables of

### The Analysis of Variance ANOVA

-3σ -σ -σ +σ +σ +3σ The Analysis of Variance ANOVA Lecture 0909.400.0 / 0909.400.0 Dr. P. s Clinic Consultant Module in Probability & Statistics in Engineering Today in P&S -3σ -σ -σ +σ +σ +3σ Analysis

### Two-sample t-tests. - Independent samples - Pooled standard devation - The equal variance assumption

Two-sample t-tests. - Independent samples - Pooled standard devation - The equal variance assumption Last time, we used the mean of one sample to test against the hypothesis that the true mean was a particular

### II. DISTRIBUTIONS distribution normal distribution. standard scores

Appendix D Basic Measurement And Statistics The following information was developed by Steven Rothke, PhD, Department of Psychology, Rehabilitation Institute of Chicago (RIC) and expanded by Mary F. Schmidt,

### DEPARTMENT OF PSYCHOLOGY UNIVERSITY OF LANCASTER MSC IN PSYCHOLOGICAL RESEARCH METHODS ANALYSING AND INTERPRETING DATA 2 PART 1 WEEK 9

DEPARTMENT OF PSYCHOLOGY UNIVERSITY OF LANCASTER MSC IN PSYCHOLOGICAL RESEARCH METHODS ANALYSING AND INTERPRETING DATA 2 PART 1 WEEK 9 Analysis of covariance and multiple regression So far in this course,

### LAB 4 INSTRUCTIONS CONFIDENCE INTERVALS AND HYPOTHESIS TESTING

LAB 4 INSTRUCTIONS CONFIDENCE INTERVALS AND HYPOTHESIS TESTING In this lab you will explore the concept of a confidence interval and hypothesis testing through a simulation problem in engineering setting.

### DATA INTERPRETATION AND STATISTICS

PholC60 September 001 DATA INTERPRETATION AND STATISTICS Books A easy and systematic introductory text is Essentials of Medical Statistics by Betty Kirkwood, published by Blackwell at about 14. DESCRIPTIVE

### Part 2: Analysis of Relationship Between Two Variables

Part 2: Analysis of Relationship Between Two Variables Linear Regression Linear correlation Significance Tests Multiple regression Linear Regression Y = a X + b Dependent Variable Independent Variable

### Hypothesis Testing: Two Means, Paired Data, Two Proportions

Chapter 10 Hypothesis Testing: Two Means, Paired Data, Two Proportions 10.1 Hypothesis Testing: Two Population Means and Two Population Proportions 1 10.1.1 Student Learning Objectives By the end of this

### Chapter 13 Introduction to Linear Regression and Correlation Analysis

Chapter 3 Student Lecture Notes 3- Chapter 3 Introduction to Linear Regression and Correlation Analsis Fall 2006 Fundamentals of Business Statistics Chapter Goals To understand the methods for displaing

### Pearson's Correlation Tests

Chapter 800 Pearson's Correlation Tests Introduction The correlation coefficient, ρ (rho), is a popular statistic for describing the strength of the relationship between two variables. The correlation

### BA 275 Review Problems - Week 6 (10/30/06-11/3/06) CD Lessons: 53, 54, 55, 56 Textbook: pp. 394-398, 404-408, 410-420

BA 275 Review Problems - Week 6 (10/30/06-11/3/06) CD Lessons: 53, 54, 55, 56 Textbook: pp. 394-398, 404-408, 410-420 1. Which of the following will increase the value of the power in a statistical test