EPS 625 ANALYSIS OF COVARIANCE (ANCOVA) EXAMPLE USING THE GENERAL LINEAR MODEL PROGRAM

Size: px
Start display at page:

Download "EPS 625 ANALYSIS OF COVARIANCE (ANCOVA) EXAMPLE USING THE GENERAL LINEAR MODEL PROGRAM"

Transcription

1 EPS 6 ANALYSIS OF COVARIANCE (ANCOVA) EXAMPLE USING THE GENERAL LINEAR MODEL PROGRAM ANCOVA One Continuous Dependent Variable (DVD Rating) Interest Rating in DVD One Categorical/Discrete Independent Variable () with four levels ( Group,,, and ) One Continuous Covariate (Age) Actual Age of Consumer Research Question: Is there a difference in interest ratings of a DVD depending on which type of promotion is provided controlling for differences in the actual age of the consumer? ANCOVA Syntax to test the Assumption of Regression (Slopes) UNIANOVA DVDRating BY WITH Age /METHOD = SSTYPE() /INTERCEPT = INCLUDE /CRITERIA = ALPHA(.05) /DESIGN = Age Age*. Univariate Analysis of Variance This first table identifies the four levels of the between-subjects factors used in the ANCOVA. Between-Subjects Factors Group N This analysis is done to check the assumption of homogeneity of regression slopes, not to test the main hypothesis. The factor ( Group) and covariate (Actual Age) do not interact [p (.969) > (.05)], so the assumption of homogeneity of regression slopes has been met. Corrected Model Intercept Age * Age Total Corrected Total Tests of Between-Subjects Effects Type III Sum of Squares df Mean Square F Sig a a. R Squared =.8 (Adjusted R Squared =.0)

2 ANCOVA Syntax to test the Assumption of Homogeneity of Variance, Linear Relationship between the Covariate and the Dependent Variable, and the Main Hypothesis UNIANOVA DVDRating BY WITH Age /METHOD = SSTYPE() /INTERCEPT = INCLUDE /PLOT = PROFILE( ) /EMMEANS = TABLES() WITH(Age=MEAN) /PRINT = DESCRIPTIVE HOMOGENEITY /CRITERIA = ALPHA(.05) /DESIGN = Age. Syntax for ANCOVA to test the main hypothesis Univariate Analysis of Variance This first table identifies the four levels of the between-subjects factors used in the ANCOVA. Between-Subjects Factors Group N The following table provides the UNADJUSTED group means and standard deviations. Descriptive Statistics Group Total Mean Std. Deviation N The following table is the Levene s Test of Homogeneity of Variance. As we can see this assumption is met since p (.995) > (.05). Levene's Test of Equality of Variances a F df df Sig Tests the null hypothesis that the error variance of the dependent variable is equal across groups. a. Design: Intercept+Age+ PAGE

3 If the Assumption of Homogeneity of Variance had not be met (found significant) this is not a major problem if the cell sizes are equal (i.e., the largest group size is not more than ½ times greater than the smallest group size). This is the case for two reasons, first, the ANCOVA statistic is a robust statistic and second, because of the way SPSS calculates the ANCOVA (Leech, Barrett, & Morgan, 005). The following table actually serves two purposes First, we use it to test if there is a linear relationship between the covariate and the dependent variable. As we can see there is a (significant) linear relationship between the covariate (Age) and the dependent variable (DVD Rating) since p (.00) < α (.05). Corrected Model Intercept Age Total Corrected Total Tests of Between-Subjects Effects Type III Sum of Squares df Mean Square F Sig a a. R Squared =.8 (Adjusted R Squared =.) The following table is the test of the main hypothesis Here we see that the Group Main Effect is significant [p (.000) < (.05)] controlling for the effect of age. Because we found a significant main effect and there are more than two levels for the independent variable we will need to conduct follow-up procedures (i.e., post hoc procedures or multiple comparisons tests) to determine significant pairwise differences. Corrected Model Intercept Age Total Corrected Total Tests of Between-Subjects Effects Type III Sum of Squares df Mean Square F Sig a a. R Squared =.8 (Adjusted R Squared =.) The covariate is included in the analysis to control for differences on this variable and is not the focus of the main analysis (it is used to test the linear relationship between the covariate and the dependent variable as noted above). Consequently, the results of the covariate are frequently not reported in a Results section. PAGE

4 Since we found a significant between-subjects main effect, we will want to calculate the measure of association, omega squared (ω ). Calculating the measure of association (omega squared) for the ANCOVA is very similar to that for the One-Way ANOVA. We only need to make a few minor adjustments to the formula to account for the adjusted values of interest ω ' SS B ( K ) = ' ' SST + MSW For our example we substitute into the formula and get:.06 ( ).6.0 () ω = = = = MS ' W =.06 ω =.0, which means that the four levels of promotion group (the independent variable) account for approximately 0% of the total variance in the individual s interest rating of the DVD (the dependent variable) controlling for the effect of the actual age of the individuals (the covariate). Estimated Marginal Means The following table shows the adjusted group means These means are adjusted for the covariate. Group Group Mean Std. Lower Bound Upper Bound 0.88 a a a a a. Covariates appearing in the model are evaluated at the following values: Actual Age = 6.8. Note the difference between the unadjusted and the adjusted means For this example they are relatively the same however, depending on the effect (influence) of the covariate these means can be notably different. PAGE

5 Profile Plots Estimated Marginal Means of Interest Rating in DVD 0 Estimated Marginal Means Group The Profile Plot will give us a visual picture of what is going on with our study. As we can see the line represents the estimated marginal means for the interest rating in DVD at each of the levels of promotion. These values correspond to those found in the estimated marginal means table. Post hoc Analyses Because we found a significant between-subjects main effect and there are four levels to our independent variable we will need to conduct a follow-up test to determine where any significant pairwise differences are. One option is to use the lmatrix syntax command which uses the appropriate error term to make pairwise comparisons. We will still need to control for Type I error. While there are several methods from which to choose we will use the Bonferroni adjustment (alpha divided by the number of comparisons). PAGE 5

6 Syntax for the lmatrix command UNIANOVA DVDRating BY WITH Age /METHOD = SSTYPE() /lmatrix ' Group vs Group ' promotion /lmatrix ' Group vs Group ' promotion 0-0 /lmatrix ' Group vs Group ' promotion /lmatrix ' Group vs Group ' promotion 0-0 /lmatrix ' Group vs Group ' promotion /lmatrix ' Group vs Group ' promotion Because we use the top three lines of the ANCOVA syntax we will get a few redundant tables i.e., the Between-Subjects Factors and the Tests of Between-Subjects Effects. These can be ignored here. Univariate Analysis of Variance Between-Subjects Factors Group N Corrected Model Intercept Age Total Corrected Total Tests of Between-Subjects Effects Type III Sum of Squares df Mean Square F Sig a a. R Squared =.8 (Adjusted R Squared =.) PAGE 6

7 The following table provides a summary of the lmatrix syntax that we just requested. For this analysis there is no pertinent information contained in this table as such, it too can be ignored. Custom Hypothesis Tests Index 5 6 Coefficients (L' Matrix) Transformation Coefficients (M Matrix) Results (K Matrix) Coefficients (L' Matrix) Transformation Coefficients (M Matrix) Results (K Matrix) Coefficients (L' Matrix) Transformation Coefficients (M Matrix) Results (K Matrix) Coefficients (L' Matrix) Transformation Coefficients (M Matrix) Results (K Matrix) Coefficients (L' Matrix) Transformation Coefficients (M Matrix) Results (K Matrix) Coefficients (L' Matrix) Transformation Coefficients (M Matrix) Results (K Matrix) LMATRIX Subcommand : Group vs Group Identity Matrix Zero Matrix LMATRIX Subcommand : Group vs Group Identity Matrix Zero Matrix LMATRIX Subcommand : Group vs Group Identity Matrix Zero Matrix LMATRIX Subcommand : Group vs Group Identity Matrix Zero Matrix LMATRIX Subcommand 5: Group vs Group Identity Matrix Zero Matrix LMATRIX Subcommand 6: Group vs Group Identity Matrix Zero Matrix PAGE 7

8 This first set of information provides the pairwise comparison of Group vs. Group. Custom Hypothesis Tests # Note the this is the adjusted mean difference of Group (M = 0.88) and Group (M = 9.88). The negative value is simply because of the order (low high = negative). Typically, we would report the absolute value (i.e., 9.00). L Estimate Hypothesized Value Results (K Matrix) a Difference (Estimate - Hypothesized) Std. Sig. for Difference Lower Bound Upper Bound Dependent Variable Interest Rating in DVD a. Based on the user-specified contrast coefficients (L') matrix: Group vs Group Note the footnote (a) provides a reminder of which groups are being compared that is, provided we indicated that in the lmatrix syntax. While the above table also indicates significance it does not provide us with the F values needed to put into a report. The following table provides the necessary information to determine if the group difference is significant. In this case we see F(, 95) =.8, p <.00 indicating that Group is significantly different from Group. This is compared to our adjusted alpha level (Bonferroni adjustment) of.008 (/ =.05/6 =.008). A review of the group means shows that Group (M = 0.88) is significantly lower than Group (M = 9.88) on their DVD interest levels controlling for age. Test Results Sum of Squares df Mean Square F Sig Because we found a significant difference we will need to follow this up with the calculation of an Effect Size. Don t forget to use the appropriate error term (MS W =.6) which we get from the above table. To calculate the effect size (adjusted Cohen s d), we use the following formula: PAGE 8

9 ' ' ˆ X i X k ' d = where MS error =.6 = MS ' error d ˆ = =.568 = This next set of information provides the pairwise comparison of Group vs. Group. Custom Hypothesis Tests # Note the -.8 this is the adjusted mean difference of Group (M = 0.88) and Group (M =.695). The negative is simply because of the order (low high = negative). Typically, we would report the absolute value (i.e.,.8). L Estimate Hypothesized Value Results (K Matrix) a Difference (Estimate - Hypothesized) Std. Sig. for Difference Lower Bound Upper Bound Dependent Variable Interest Rating in DVD a. Based on the user-specified contrast coefficients (L') matrix: Group vs Group.97 The following table provides the necessary information to determine if the group difference is significant. In this case we see F(, 95) =.86, p =.667 indicating that Group is not significantly different from Group. This is compared to our adjusted alpha level (Bonferroni adjustment) of.008 (/ =.05/6 =.008). A review of the group means shows that while Group (M = 0.88) is lower than Group (M =.695) on their DVD interest levels controlling for age, it is not significantly different. Test Results Sum of Squares df Mean Square F Sig Because no significant difference was found for these two groups no Effect Size needs to be calculated. PAGE 9

10 This next set of information provides the pairwise comparison of Group vs. Group. Custom Hypothesis Tests # Note the this is the adjusted mean difference of Group (M = 0.88) and Group (M = 6.9). The negative is simply because of the order (low high = negative). Typically, we would report the absolute value (i.e., 5.6). L Estimate Hypothesized Value Results (K Matrix) a Difference (Estimate - Hypothesized) Std. Sig. for Difference Lower Bound Upper Bound Dependent Variable Interest Rating in DVD a. Based on the user-specified contrast coefficients (L') matrix: Group vs Group The following table provides the necessary information to determine if the group difference is significant. In this case we see F(, 95) = 8., p =.005 indicating that Group is significantly different from Group. This is compared to our adjusted alpha level (Bonferroni adjustment) of.008 (/ =.05/6 =.008). A review of the group means shows that Group (M = 0.88) is significantly lower than Group (M = 6.9) on their DVD interest levels controlling for age. Test Results Sum of Squares df Mean Square F Sig Because we found a significant difference we will need to follow this up with the calculation of an Effect Size. Don t forget to use the appropriate error term (MS W =.6) which we get from the above table. ' ' ˆ X i X k 5.56 d = d ˆ = = =.8 MS ' error PAGE 0

11 This next set of information provides the pairwise comparison of Group vs. Group. Custom Hypothesis Tests # Note the 8.87 this is the adjusted mean difference of Group (M = 9.88) and Group (M =.695). L Estimate Hypothesized Value Results (K Matrix) a Difference (Estimate - Hypothesized) Std. Sig. for Difference Lower Bound Upper Bound Dependent Variable Interest Rating in DVD a. Based on the user-specified contrast coefficients (L') matrix: Group vs Group The following table provides the necessary information to determine if the group difference is significant. In this case we see F(, 95) = 8.898, p <.00 indicating that Group is significantly different from Group. This is compared to our adjusted alpha level (Bonferroni adjustment) of.008 (/ =.05/6 =.008). A review of the group means shows that Group (M = 9.88) is significantly higher than Group (M =.695) on their DVD interest levels controlling for age. Test Results Sum of Squares df Mean Square F Sig Because we found a significant difference we will need to follow this up with the calculation of an Effect Size. Don t forget to use the appropriate error term (MS W =.6) which we get from the above table. ' ' ˆ X i X k 8.87 d = d ˆ = = =. MS ' error PAGE

12 This next set of information provides the pairwise comparison of Group vs. Group. Custom Hypothesis Tests #5 Note the.5 this is the adjusted mean difference of Group (M = 9.88) and Group (M = 6.9). L Estimate Hypothesized Value Results (K Matrix) a Difference (Estimate - Hypothesized) Std. Sig. for Difference Lower Bound Upper Bound Dependent Variable Interest Rating in DVD a. Based on the user-specified contrast coefficients (L') matrix: Group vs Group The following table provides the necessary information to determine if the group difference is significant. In this case we see F(, 95) =.96, p =.065 indicating that Group is not significantly different from Group. This is compared to our adjusted alpha level (Bonferroni adjustment) of.008 (/ =.05/6 =.008). A review of the group means shows that while Group (M = 9.88) is higher than Group (M = 6.9) on their DVD interest levels controlling for age, it is not significantly different. Test Results Sum of Squares df Mean Square F Sig Because no significant difference was found for these two groups no Effect Size needs to be calculated. PAGE

13 This next set of information provides the pairwise comparison of Group vs. Group. Custom Hypothesis Tests #6 Note the -.6 this is the adjusted mean difference of Group (M =.695) and Group (M = 6.9). The negative is simply because of the order (low high = negative). Typically, we would report the absolute value (i.e.,.6). L Estimate Hypothesized Value Results (K Matrix) a Difference (Estimate - Hypothesized) Std. Sig. for Difference Lower Bound Upper Bound Dependent Variable Interest Rating in DVD a. Based on the user-specified contrast coefficients (L') matrix: Group vs Group The following table provides the necessary information to determine if the group difference is significant. In this case we see F(, 95) = 5.988, p =.06 indicating that Group is not significantly different from Group. This is compared to our adjusted alpha level (Bonferroni adjustment) of.008 (/ =.05/6 =.008). A review of the group means shows that while Group (M =.695) is lower than Group (M = 6.9) on their DVD interest levels controlling for age, it is not significantly different. Test Results Sum of Squares df Mean Square F Sig Because no significant difference was found for these two groups no Effect Size needs to be calculated. PAGE

INTERPRETING THE ONE-WAY ANALYSIS OF VARIANCE (ANOVA)

INTERPRETING THE ONE-WAY ANALYSIS OF VARIANCE (ANOVA) INTERPRETING THE ONE-WAY ANALYSIS OF VARIANCE (ANOVA) As with other parametric statistics, we begin the one-way ANOVA with a test of the underlying assumptions. Our first assumption is the assumption of

More information

INTERPRETING THE REPEATED-MEASURES ANOVA

INTERPRETING THE REPEATED-MEASURES ANOVA INTERPRETING THE REPEATED-MEASURES ANOVA USING THE SPSS GENERAL LINEAR MODEL PROGRAM RM ANOVA In this scenario (based on a RM ANOVA example from Leech, Barrett, and Morgan, 2005) each of 12 participants

More information

Chapter 5 Analysis of variance SPSS Analysis of variance

Chapter 5 Analysis of variance SPSS Analysis of variance Chapter 5 Analysis of variance SPSS Analysis of variance Data file used: gss.sav How to get there: Analyze Compare Means One-way ANOVA To test the null hypothesis that several population means are equal,

More information

Simple Tricks for Using SPSS for Windows

Simple Tricks for Using SPSS for Windows Simple Tricks for Using SPSS for Windows Chapter 14. Follow-up Tests for the Two-Way Factorial ANOVA The Interaction is Not Significant If you have performed a two-way ANOVA using the General Linear Model,

More information

Factor B: Curriculum New Math Control Curriculum (B (B 1 ) Overall Mean (marginal) Females (A 1 ) Factor A: Gender Males (A 2) X 21

Factor B: Curriculum New Math Control Curriculum (B (B 1 ) Overall Mean (marginal) Females (A 1 ) Factor A: Gender Males (A 2) X 21 1 Factorial ANOVA The ANOVA designs we have dealt with up to this point, known as simple ANOVA or oneway ANOVA, had only one independent grouping variable or factor. However, oftentimes a researcher has

More information

THE KRUSKAL WALLLIS TEST

THE KRUSKAL WALLLIS TEST THE KRUSKAL WALLLIS TEST TEODORA H. MEHOTCHEVA Wednesday, 23 rd April 08 THE KRUSKAL-WALLIS TEST: The non-parametric alternative to ANOVA: testing for difference between several independent groups 2 NON

More information

ANSWERS TO EXERCISES AND REVIEW QUESTIONS

ANSWERS TO EXERCISES AND REVIEW QUESTIONS ANSWERS TO EXERCISES AND REVIEW QUESTIONS PART FIVE: STATISTICAL TECHNIQUES TO COMPARE GROUPS Before attempting these questions read through the introduction to Part Five and Chapters 16-21 of the SPSS

More information

Main Effects and Interactions

Main Effects and Interactions Main Effects & Interactions page 1 Main Effects and Interactions So far, we ve talked about studies in which there is just one independent variable, such as violence of television program. You might randomly

More information

Contrasts ask specific questions as opposed to the general ANOVA null vs. alternative

Contrasts ask specific questions as opposed to the general ANOVA null vs. alternative Chapter 13 Contrasts and Custom Hypotheses Contrasts ask specific questions as opposed to the general ANOVA null vs. alternative hypotheses. In a one-way ANOVA with a k level factor, the null hypothesis

More information

UNDERSTANDING THE INDEPENDENT-SAMPLES t TEST

UNDERSTANDING THE INDEPENDENT-SAMPLES t TEST UNDERSTANDING The independent-samples t test evaluates the difference between the means of two independent or unrelated groups. That is, we evaluate whether the means for two independent groups are significantly

More information

UNDERSTANDING THE TWO-WAY ANOVA

UNDERSTANDING THE TWO-WAY ANOVA UNDERSTANDING THE e have seen how the one-way ANOVA can be used to compare two or more sample means in studies involving a single independent variable. This can be extended to two independent variables

More information

UNDERSTANDING ANALYSIS OF COVARIANCE (ANCOVA)

UNDERSTANDING ANALYSIS OF COVARIANCE (ANCOVA) UNDERSTANDING ANALYSIS OF COVARIANCE () In general, research is conducted for the purpose of explaining the effects of the independent variable on the dependent variable, and the purpose of research design

More information

c. The factor is the type of TV program that was watched. The treatment is the embedded commercials in the TV programs.

c. The factor is the type of TV program that was watched. The treatment is the embedded commercials in the TV programs. STAT E-150 - Statistical Methods Assignment 9 Solutions Exercises 12.8, 12.13, 12.75 For each test: Include appropriate graphs to see that the conditions are met. Use Tukey's Honestly Significant Difference

More information

Unit 31 A Hypothesis Test about Correlation and Slope in a Simple Linear Regression

Unit 31 A Hypothesis Test about Correlation and Slope in a Simple Linear Regression Unit 31 A Hypothesis Test about Correlation and Slope in a Simple Linear Regression Objectives: To perform a hypothesis test concerning the slope of a least squares line To recognize that testing for a

More information

Independent t- Test (Comparing Two Means)

Independent t- Test (Comparing Two Means) Independent t- Test (Comparing Two Means) The objectives of this lesson are to learn: the definition/purpose of independent t-test when to use the independent t-test the use of SPSS to complete an independent

More information

ANOVA - Analysis of Variance

ANOVA - Analysis of Variance ANOVA - Analysis of Variance ANOVA - Analysis of Variance Extends independent-samples t test Compares the means of groups of independent observations Don t be fooled by the name. ANOVA does not compare

More information

EPS 625 INTERMEDIATE STATISTICS FRIEDMAN TEST

EPS 625 INTERMEDIATE STATISTICS FRIEDMAN TEST EPS 625 INTERMEDIATE STATISTICS The Friedman test is an extension of the Wilcoxon test. The Wilcoxon test can be applied to repeated-measures data if participants are assessed on two occasions or conditions

More information

1. What is the critical value for this 95% confidence interval? CV = z.025 = invnorm(0.025) = 1.96

1. What is the critical value for this 95% confidence interval? CV = z.025 = invnorm(0.025) = 1.96 1 Final Review 2 Review 2.1 CI 1-propZint Scenario 1 A TV manufacturer claims in its warranty brochure that in the past not more than 10 percent of its TV sets needed any repair during the first two years

More information

ANOVA ANOVA. Two-Way ANOVA. One-Way ANOVA. When to use ANOVA ANOVA. Analysis of Variance. Chapter 16. A procedure for comparing more than two groups

ANOVA ANOVA. Two-Way ANOVA. One-Way ANOVA. When to use ANOVA ANOVA. Analysis of Variance. Chapter 16. A procedure for comparing more than two groups ANOVA ANOVA Analysis of Variance Chapter 6 A procedure for comparing more than two groups independent variable: smoking status non-smoking one pack a day > two packs a day dependent variable: number of

More information

Profile analysis is the multivariate equivalent of repeated measures or mixed ANOVA. Profile analysis is most commonly used in two cases:

Profile analysis is the multivariate equivalent of repeated measures or mixed ANOVA. Profile analysis is most commonly used in two cases: Profile Analysis Introduction Profile analysis is the multivariate equivalent of repeated measures or mixed ANOVA. Profile analysis is most commonly used in two cases: ) Comparing the same dependent variables

More information

SPSS Guide: Regression Analysis

SPSS Guide: Regression Analysis SPSS Guide: Regression Analysis I put this together to give you a step-by-step guide for replicating what we did in the computer lab. It should help you run the tests we covered. The best way to get familiar

More information

UNDERSTANDING THE DEPENDENT-SAMPLES t TEST

UNDERSTANDING THE DEPENDENT-SAMPLES t TEST UNDERSTANDING THE DEPENDENT-SAMPLES t TEST A dependent-samples t test (a.k.a. matched or paired-samples, matched-pairs, samples, or subjects, simple repeated-measures or within-groups, or correlated groups)

More information

Multiple Regression in SPSS This example shows you how to perform multiple regression. The basic command is regression : linear.

Multiple Regression in SPSS This example shows you how to perform multiple regression. The basic command is regression : linear. Multiple Regression in SPSS This example shows you how to perform multiple regression. The basic command is regression : linear. In the main dialog box, input the dependent variable and several predictors.

More information

SPSS Tests for Versions 9 to 13

SPSS Tests for Versions 9 to 13 SPSS Tests for Versions 9 to 13 Chapter 2 Descriptive Statistic (including median) Choose Analyze Descriptive statistics Frequencies... Click on variable(s) then press to move to into Variable(s): list

More information

0.1 Multiple Regression Models

0.1 Multiple Regression Models 0.1 Multiple Regression Models We will introduce the multiple Regression model as a mean of relating one numerical response variable y to two or more independent (or predictor variables. We will see different

More information

Section 13, Part 1 ANOVA. Analysis Of Variance

Section 13, Part 1 ANOVA. Analysis Of Variance Section 13, Part 1 ANOVA Analysis Of Variance Course Overview So far in this course we ve covered: Descriptive statistics Summary statistics Tables and Graphs Probability Probability Rules Probability

More information

Introduction to Analysis of Variance (ANOVA) Limitations of the t-test

Introduction to Analysis of Variance (ANOVA) Limitations of the t-test Introduction to Analysis of Variance (ANOVA) The Structural Model, The Summary Table, and the One- Way ANOVA Limitations of the t-test Although the t-test is commonly used, it has limitations Can only

More information

The scatterplot indicates a positive linear relationship between waist size and body fat percentage:

The scatterplot indicates a positive linear relationship between waist size and body fat percentage: STAT E-150 Statistical Methods Multiple Regression Three percent of a man's body is essential fat, which is necessary for a healthy body. However, too much body fat can be dangerous. For men between the

More information

Regression III: Dummy Variable Regression

Regression III: Dummy Variable Regression Regression III: Dummy Variable Regression Tom Ilvento FREC 408 Linear Regression Assumptions about the error term Mean of Probability Distribution of the Error term is zero Probability Distribution of

More information

13: Additional ANOVA Topics. Post hoc Comparisons

13: Additional ANOVA Topics. Post hoc Comparisons 13: Additional ANOVA Topics Post hoc Comparisons ANOVA Assumptions Assessing Group Variances When Distributional Assumptions are Severely Violated Kruskal-Wallis Test Post hoc Comparisons In the prior

More information

SPSS Advanced Statistics 17.0

SPSS Advanced Statistics 17.0 i SPSS Advanced Statistics 17.0 For more information about SPSS Inc. software products, please visit our Web site at http://www.spss.com or contact SPSS Inc. 233 South Wacker Drive, 11th Floor Chicago,

More information

Multiple Linear Regression

Multiple Linear Regression Multiple Linear Regression A regression with two or more explanatory variables is called a multiple regression. Rather than modeling the mean response as a straight line, as in simple regression, it is

More information

1.5 Oneway Analysis of Variance

1.5 Oneway Analysis of Variance Statistics: Rosie Cornish. 200. 1.5 Oneway Analysis of Variance 1 Introduction Oneway analysis of variance (ANOVA) is used to compare several means. This method is often used in scientific or medical experiments

More information

One-Way Analysis of Variance

One-Way Analysis of Variance One-Way Analysis of Variance Note: Much of the math here is tedious but straightforward. We ll skim over it in class but you should be sure to ask questions if you don t understand it. I. Overview A. We

More information

SIMPLE LINEAR CORRELATION. r can range from -1 to 1, and is independent of units of measurement. Correlation can be done on two dependent variables.

SIMPLE LINEAR CORRELATION. r can range from -1 to 1, and is independent of units of measurement. Correlation can be done on two dependent variables. SIMPLE LINEAR CORRELATION Simple linear correlation is a measure of the degree to which two variables vary together, or a measure of the intensity of the association between two variables. Correlation

More information

For example, enter the following data in three COLUMNS in a new View window.

For example, enter the following data in three COLUMNS in a new View window. Statistics with Statview - 18 Paired t-test A paired t-test compares two groups of measurements when the data in the two groups are in some way paired between the groups (e.g., before and after on the

More information

1. Complete the sentence with the correct word or phrase. 2. Fill in blanks in a source table with the correct formuli for df, MS, and F.

1. Complete the sentence with the correct word or phrase. 2. Fill in blanks in a source table with the correct formuli for df, MS, and F. Final Exam 1. Complete the sentence with the correct word or phrase. 2. Fill in blanks in a source table with the correct formuli for df, MS, and F. 3. Identify the graphic form and nature of the source

More information

Two Related Samples t Test

Two Related Samples t Test Two Related Samples t Test In this example 1 students saw five pictures of attractive people and five pictures of unattractive people. For each picture, the students rated the friendliness of the person

More information

" Y. Notation and Equations for Regression Lecture 11/4. Notation:

 Y. Notation and Equations for Regression Lecture 11/4. Notation: Notation: Notation and Equations for Regression Lecture 11/4 m: The number of predictor variables in a regression Xi: One of multiple predictor variables. The subscript i represents any number from 1 through

More information

Simple Linear Regression Chapter 11

Simple Linear Regression Chapter 11 Simple Linear Regression Chapter 11 Rationale Frequently decision-making situations require modeling of relationships among business variables. For instance, the amount of sale of a product may be related

More information

SPSS Guide: Tests of Differences

SPSS Guide: Tests of Differences SPSS Guide: Tests of Differences I put this together to give you a step-by-step guide for replicating what we did in the computer lab. It should help you run the tests we covered. The best way to get familiar

More information

psyc3010 lecture 8 standard and hierarchical multiple regression last week: correlation and regression Next week: moderated regression

psyc3010 lecture 8 standard and hierarchical multiple regression last week: correlation and regression Next week: moderated regression psyc3010 lecture 8 standard and hierarchical multiple regression last week: correlation and regression Next week: moderated regression 1 last week this week last week we revised correlation & regression

More information

IBM SPSS Advanced Statistics 20

IBM SPSS Advanced Statistics 20 IBM SPSS Advanced Statistics 20 Note: Before using this information and the product it supports, read the general information under Notices on p. 166. This edition applies to IBM SPSS Statistics 20 and

More information

SPSS: Descriptive and Inferential Statistics. For Windows

SPSS: Descriptive and Inferential Statistics. For Windows For Windows August 2012 Table of Contents Section 1: Summarizing Data...3 1.1 Descriptive Statistics...3 Section 2: Inferential Statistics... 10 2.1 Chi-Square Test... 10 2.2 T tests... 11 2.3 Correlation...

More information

Chapter 2 Probability Topics SPSS T tests

Chapter 2 Probability Topics SPSS T tests Chapter 2 Probability Topics SPSS T tests Data file used: gss.sav In the lecture about chapter 2, only the One-Sample T test has been explained. In this handout, we also give the SPSS methods to perform

More information

Univariate Regression

Univariate Regression Univariate Regression Correlation and Regression The regression line summarizes the linear relationship between 2 variables Correlation coefficient, r, measures strength of relationship: the closer r is

More information

12-1 Multiple Linear Regression Models

12-1 Multiple Linear Regression Models 12-1.1 Introduction Many applications of regression analysis involve situations in which there are more than one regressor variable. A regression model that contains more than one regressor variable is

More information

Analysis of Data. Organizing Data Files in SPSS. Descriptive Statistics

Analysis of Data. Organizing Data Files in SPSS. Descriptive Statistics Analysis of Data Claudia J. Stanny PSY 67 Research Design Organizing Data Files in SPSS All data for one subject entered on the same line Identification data Between-subjects manipulations: variable to

More information

COMPARISONS OF CUSTOMER LOYALTY: PUBLIC & PRIVATE INSURANCE COMPANIES.

COMPARISONS OF CUSTOMER LOYALTY: PUBLIC & PRIVATE INSURANCE COMPANIES. 277 CHAPTER VI COMPARISONS OF CUSTOMER LOYALTY: PUBLIC & PRIVATE INSURANCE COMPANIES. This chapter contains a full discussion of customer loyalty comparisons between private and public insurance companies

More information

Basic Statistcs Formula Sheet

Basic Statistcs Formula Sheet Basic Statistcs Formula Sheet Steven W. ydick May 5, 0 This document is only intended to review basic concepts/formulas from an introduction to statistics course. Only mean-based procedures are reviewed,

More information

UNDERSTANDING THE ONE-WAY ANOVA

UNDERSTANDING THE ONE-WAY ANOVA UNDERSTANDING The One-way Analysis of Variance (ANOVA) is a procedure for testing the hypothesis that K population means are equal, where K >. The One-way ANOVA compares the means of the samples or groups

More information

Chapter 15. Mixed Models. 15.1 Overview. A flexible approach to correlated data.

Chapter 15. Mixed Models. 15.1 Overview. A flexible approach to correlated data. Chapter 15 Mixed Models A flexible approach to correlated data. 15.1 Overview Correlated data arise frequently in statistical analyses. This may be due to grouping of subjects, e.g., students within classrooms,

More information

Linear Mixed-Effects Modeling in SPSS: An Introduction to the MIXED Procedure

Linear Mixed-Effects Modeling in SPSS: An Introduction to the MIXED Procedure Technical report Linear Mixed-Effects Modeling in SPSS: An Introduction to the MIXED Procedure Table of contents Introduction................................................................ 1 Data preparation

More information

Final Exam Practice Problem Answers

Final Exam Practice Problem Answers Final Exam Practice Problem Answers The following data set consists of data gathered from 77 popular breakfast cereals. The variables in the data set are as follows: Brand: The brand name of the cereal

More information

Part 2: Analysis of Relationship Between Two Variables

Part 2: Analysis of Relationship Between Two Variables Part 2: Analysis of Relationship Between Two Variables Linear Regression Linear correlation Significance Tests Multiple regression Linear Regression Y = a X + b Dependent Variable Independent Variable

More information

An analysis method for a quantitative outcome and two categorical explanatory variables.

An analysis method for a quantitative outcome and two categorical explanatory variables. Chapter 11 Two-Way ANOVA An analysis method for a quantitative outcome and two categorical explanatory variables. If an experiment has a quantitative outcome and two categorical explanatory variables that

More information

DEPARTMENT OF PSYCHOLOGY UNIVERSITY OF LANCASTER MSC IN PSYCHOLOGICAL RESEARCH METHODS ANALYSING AND INTERPRETING DATA 2 PART 1 WEEK 9

DEPARTMENT OF PSYCHOLOGY UNIVERSITY OF LANCASTER MSC IN PSYCHOLOGICAL RESEARCH METHODS ANALYSING AND INTERPRETING DATA 2 PART 1 WEEK 9 DEPARTMENT OF PSYCHOLOGY UNIVERSITY OF LANCASTER MSC IN PSYCHOLOGICAL RESEARCH METHODS ANALYSING AND INTERPRETING DATA 2 PART 1 WEEK 9 Analysis of covariance and multiple regression So far in this course,

More information

Using SPSS version 14 Joel Elliott, Jennifer Burnaford, Stacey Weiss

Using SPSS version 14 Joel Elliott, Jennifer Burnaford, Stacey Weiss Using SPSS version 14 Joel Elliott, Jennifer Burnaford, Stacey Weiss SPSS is a program that is very easy to learn and is also very powerful. This manual is designed to introduce you to the program however,

More information

Perform hypothesis testing

Perform hypothesis testing Multivariate hypothesis tests for fixed effects Testing homogeneity of level-1 variances In the following sections, we use the model displayed in the figure below to illustrate the hypothesis tests. Partial

More information

Statistiek II. John Nerbonne. October 1, 2010. Dept of Information Science j.nerbonne@rug.nl

Statistiek II. John Nerbonne. October 1, 2010. Dept of Information Science j.nerbonne@rug.nl Dept of Information Science j.nerbonne@rug.nl October 1, 2010 Course outline 1 One-way ANOVA. 2 Factorial ANOVA. 3 Repeated measures ANOVA. 4 Correlation and regression. 5 Multiple regression. 6 Logistic

More information

Aus: Statnotes: Topics in Multivariate Analysis, by G. David Garson (Zugriff am

Aus: Statnotes: Topics in Multivariate Analysis, by G. David Garson  (Zugriff am Aus: Statnotes: Topics in Multivariate Analysis, by G. David Garson http://faculty.chass.ncsu.edu/garson/pa765/anova.htm (Zugriff am 20.10.2010) Planned multiple comparison t-tests, also just called "multiple

More information

PSYCHOLOGY 320L Problem Set #3: One-Way ANOVA and Analytical Comparisons

PSYCHOLOGY 320L Problem Set #3: One-Way ANOVA and Analytical Comparisons PSYCHOLOGY 30L Problem Set #3: One-Way ANOVA and Analytical Comparisons Name: Score:. You and Dr. Exercise have decided to conduct a study on exercise and its effects on mood ratings. Many studies (Babyak

More information

Regression in ANOVA. James H. Steiger. Department of Psychology and Human Development Vanderbilt University

Regression in ANOVA. James H. Steiger. Department of Psychology and Human Development Vanderbilt University Regression in ANOVA James H. Steiger Department of Psychology and Human Development Vanderbilt University James H. Steiger (Vanderbilt University) 1 / 30 Regression in ANOVA 1 Introduction 2 Basic Linear

More information

Pearson s Correlation

Pearson s Correlation Pearson s Correlation Correlation the degree to which two variables are associated (co-vary). Covariance may be either positive or negative. Its magnitude depends on the units of measurement. Assumes the

More information

Regression in SPSS. Workshop offered by the Mississippi Center for Supercomputing Research and the UM Office of Information Technology

Regression in SPSS. Workshop offered by the Mississippi Center for Supercomputing Research and the UM Office of Information Technology Regression in SPSS Workshop offered by the Mississippi Center for Supercomputing Research and the UM Office of Information Technology John P. Bentley Department of Pharmacy Administration University of

More information

Testing Hypotheses using SPSS

Testing Hypotheses using SPSS Is the mean hourly rate of male workers $2.00? T-Test One-Sample Statistics Std. Error N Mean Std. Deviation Mean 2997 2.0522 6.6282.2 One-Sample Test Test Value = 2 95% Confidence Interval Mean of the

More information

One-Way ANOVA using SPSS 11.0. SPSS ANOVA procedures found in the Compare Means analyses. Specifically, we demonstrate

One-Way ANOVA using SPSS 11.0. SPSS ANOVA procedures found in the Compare Means analyses. Specifically, we demonstrate 1 One-Way ANOVA using SPSS 11.0 This section covers steps for testing the difference between three or more group means using the SPSS ANOVA procedures found in the Compare Means analyses. Specifically,

More information

e = random error, assumed to be normally distributed with mean 0 and standard deviation σ

e = random error, assumed to be normally distributed with mean 0 and standard deviation σ 1 Linear Regression 1.1 Simple Linear Regression Model The linear regression model is applied if we want to model a numeric response variable and its dependency on at least one numeric factor variable.

More information

Mixed 2 x 3 ANOVA. Notes

Mixed 2 x 3 ANOVA. Notes Mixed 2 x 3 ANOVA This section explains how to perform an ANOVA when one of the variables takes the form of repeated measures and the other variable is between-subjects that is, independent groups of participants

More information

An Intermediate Course in SPSS. Mr. Liberato Camilleri

An Intermediate Course in SPSS. Mr. Liberato Camilleri An Intermediate Course in SPSS by Mr. Liberato Camilleri 3. Simple linear regression 3. Regression Analysis The model that is applicable in the simplest regression structure is the simple linear regression

More information

Analysis of numerical data S4

Analysis of numerical data S4 Basic medical statistics for clinical and experimental research Analysis of numerical data S4 Katarzyna Jóźwiak k.jozwiak@nki.nl 3rd November 2015 1/42 Hypothesis tests: numerical and ordinal data 1 group:

More information

17. SIMPLE LINEAR REGRESSION II

17. SIMPLE LINEAR REGRESSION II 17. SIMPLE LINEAR REGRESSION II The Model In linear regression analysis, we assume that the relationship between X and Y is linear. This does not mean, however, that Y can be perfectly predicted from X.

More information

Null Hypothesis H 0. The null hypothesis (denoted by H 0

Null Hypothesis H 0. The null hypothesis (denoted by H 0 Hypothesis test In statistics, a hypothesis is a claim or statement about a property of a population. A hypothesis test (or test of significance) is a standard procedure for testing a claim about a property

More information

Study Guide for the Final Exam

Study Guide for the Final Exam Study Guide for the Final Exam When studying, remember that the computational portion of the exam will only involve new material (covered after the second midterm), that material from Exam 1 will make

More information

Elementary Statistics Sample Exam #3

Elementary Statistics Sample Exam #3 Elementary Statistics Sample Exam #3 Instructions. No books or telephones. Only the supplied calculators are allowed. The exam is worth 100 points. 1. A chi square goodness of fit test is considered to

More information

Chapter 11: Two Variable Regression Analysis

Chapter 11: Two Variable Regression Analysis Department of Mathematics Izmir University of Economics Week 14-15 2014-2015 In this chapter, we will focus on linear models and extend our analysis to relationships between variables, the definitions

More information

Statistics II Final Exam - January Use the University stationery to give your answers to the following questions.

Statistics II Final Exam - January Use the University stationery to give your answers to the following questions. Statistics II Final Exam - January 2012 Use the University stationery to give your answers to the following questions. Do not forget to write down your name and class group in each page. Indicate clearly

More information

ABSORBENCY OF PAPER TOWELS

ABSORBENCY OF PAPER TOWELS ABSORBENCY OF PAPER TOWELS 15. Brief Version of the Case Study 15.1 Problem Formulation 15.2 Selection of Factors 15.3 Obtaining Random Samples of Paper Towels 15.4 How will the Absorbency be measured?

More information

Technology Step-by-Step Using StatCrunch

Technology Step-by-Step Using StatCrunch Technology Step-by-Step Using StatCrunch Section 1.3 Simple Random Sampling 1. Select Data, highlight Simulate Data, then highlight Discrete Uniform. 2. Fill in the following window with the appropriate

More information

January 26, 2009 The Faculty Center for Teaching and Learning

January 26, 2009 The Faculty Center for Teaching and Learning THE BASICS OF DATA MANAGEMENT AND ANALYSIS A USER GUIDE January 26, 2009 The Faculty Center for Teaching and Learning THE BASICS OF DATA MANAGEMENT AND ANALYSIS Table of Contents Table of Contents... i

More information

INCOME AND HAPPINESS 1. Income and Happiness

INCOME AND HAPPINESS 1. Income and Happiness INCOME AND HAPPINESS 1 Income and Happiness Abstract Are wealthier people happier? The research study employed simple linear regression analysis to confirm the positive relationship between income and

More information

Variance of OLS Estimators and Hypothesis Testing. Randomness in the model. GM assumptions. Notes. Notes. Notes. Charlie Gibbons ARE 212.

Variance of OLS Estimators and Hypothesis Testing. Randomness in the model. GM assumptions. Notes. Notes. Notes. Charlie Gibbons ARE 212. Variance of OLS Estimators and Hypothesis Testing Charlie Gibbons ARE 212 Spring 2011 Randomness in the model Considering the model what is random? Y = X β + ɛ, β is a parameter and not random, X may be

More information

This can dilute the significance of a departure from the null hypothesis. We can focus the test on departures of a particular form.

This can dilute the significance of a departure from the null hypothesis. We can focus the test on departures of a particular form. One-Degree-of-Freedom Tests Test for group occasion interactions has (number of groups 1) number of occasions 1) degrees of freedom. This can dilute the significance of a departure from the null hypothesis.

More information

Math 62 Statistics Sample Exam Questions

Math 62 Statistics Sample Exam Questions Math 62 Statistics Sample Exam Questions 1. (10) Explain the difference between the distribution of a population and the sampling distribution of a statistic, such as the mean, of a sample randomly selected

More information

4.4. Further Analysis within ANOVA

4.4. Further Analysis within ANOVA 4.4. Further Analysis within ANOVA 1) Estimation of the effects Fixed effects model: α i = µ i µ is estimated by a i = ( x i x) if H 0 : µ 1 = µ 2 = = µ k is rejected. Random effects model: If H 0 : σa

More information

Hypothesis Testing. Chapter 7

Hypothesis Testing. Chapter 7 Hypothesis Testing Chapter 7 Hypothesis Testing Time to make the educated guess after answering: What the population is, how to extract the sample, what characteristics to measure in the sample, After

More information

Multivariate Analysis of Variance. The general purpose of multivariate analysis of variance (MANOVA) is to determine

Multivariate Analysis of Variance. The general purpose of multivariate analysis of variance (MANOVA) is to determine 2 - Manova 4.3.05 25 Multivariate Analysis of Variance What Multivariate Analysis of Variance is The general purpose of multivariate analysis of variance (MANOVA) is to determine whether multiple levels

More information

Regression Analysis Prof. Soumen Maity Department of Mathematics Indian Institute of Technology, Kharagpur

Regression Analysis Prof. Soumen Maity Department of Mathematics Indian Institute of Technology, Kharagpur Regression Analysis Prof. Soumen Maity Department of Mathematics Indian Institute of Technology, Kharagpur Lecture - 7 Multiple Linear Regression (Contd.) This is my second lecture on Multiple Linear Regression

More information

DDBA 8438: The t Test for Independent Samples Video Podcast Transcript

DDBA 8438: The t Test for Independent Samples Video Podcast Transcript DDBA 8438: The t Test for Independent Samples Video Podcast Transcript JENNIFER ANN MORROW: Welcome to The t Test for Independent Samples. My name is Dr. Jennifer Ann Morrow. In today's demonstration,

More information

A. Karpinski

A. Karpinski Chapter 3 Multiple Linear Regression Page 1. Overview of multiple regression 3-2 2. Considering relationships among variables 3-3 3. Extending the simple regression model to multiple predictors 3-4 4.

More information

Additional sources Compilation of sources: http://lrs.ed.uiuc.edu/tseportal/datacollectionmethodologies/jin-tselink/tselink.htm

Additional sources Compilation of sources: http://lrs.ed.uiuc.edu/tseportal/datacollectionmethodologies/jin-tselink/tselink.htm Mgt 540 Research Methods Data Analysis 1 Additional sources Compilation of sources: http://lrs.ed.uiuc.edu/tseportal/datacollectionmethodologies/jin-tselink/tselink.htm http://web.utk.edu/~dap/random/order/start.htm

More information

12/31/2016. PSY 512: Advanced Statistics for Psychological and Behavioral Research 2

12/31/2016. PSY 512: Advanced Statistics for Psychological and Behavioral Research 2 PSY 512: Advanced Statistics for Psychological and Behavioral Research 2 Understand linear regression with a single predictor Understand how we assess the fit of a regression model Total Sum of Squares

More information

5. Linear Regression

5. Linear Regression 5. Linear Regression Outline.................................................................... 2 Simple linear regression 3 Linear model............................................................. 4

More information

Using Minitab for Regression Analysis: An extended example

Using Minitab for Regression Analysis: An extended example Using Minitab for Regression Analysis: An extended example The following example uses data from another text on fertilizer application and crop yield, and is intended to show how Minitab can be used to

More information

Using SPSS for Multiple Regression. UDP 520 Lab 7 Lin Lin December 4 th, 2007

Using SPSS for Multiple Regression. UDP 520 Lab 7 Lin Lin December 4 th, 2007 Using SPSS for Multiple Regression UDP 520 Lab 7 Lin Lin December 4 th, 2007 Step 1 Define Research Question What factors are associated with BMI? Predict BMI. Step 2 Conceptualizing Problem (Theory) Individual

More information

AP Statistics 2002 Scoring Guidelines

AP Statistics 2002 Scoring Guidelines AP Statistics 2002 Scoring Guidelines The materials included in these files are intended for use by AP teachers for course and exam preparation in the classroom; permission for any other use must be sought

More information

SPSS BASICS. (Data used in this tutorial: General Social Survey 2000 and 2002) Ex: Mother s Education to eliminate responses 97,98, 99;

SPSS BASICS. (Data used in this tutorial: General Social Survey 2000 and 2002) Ex: Mother s Education to eliminate responses 97,98, 99; SPSS BASICS (Data used in this tutorial: General Social Survey 2000 and 2002) How to do Recoding Eliminating Response Categories Ex: Mother s Education to eliminate responses 97,98, 99; When we run a frequency

More information

Latin Square Design Analysis

Latin Square Design Analysis SPSS NOV for Latin Square esign Latin Square esign nalysis Goal: omparing the performance of four different brands of tires (,,, and ). ackground: There are four cars available for this comparative study

More information

ANOVA must be modified to take correlated errors into account when multiple measurements are made for each subject.

ANOVA must be modified to take correlated errors into account when multiple measurements are made for each subject. Chapter 14 Within-Subjects Designs ANOVA must be modified to take correlated errors into account when multiple measurements are made for each subject. 14.1 Overview of within-subjects designs Any categorical

More information

Principles of Hypothesis Testing for Public Health

Principles of Hypothesis Testing for Public Health Principles of Hypothesis Testing for Public Health Laura Lee Johnson, Ph.D. Statistician National Center for Complementary and Alternative Medicine johnslau@mail.nih.gov Fall 2011 Answers to Questions

More information