Moderator and Mediator Analysis


 Jared Woods
 2 years ago
 Views:
Transcription
1 Moderator and Mediator Analysis Seminar General Statistics Marijtje van Duijn October 8, Overview What is moderation and mediation? What is their relation to statistical concepts? Example(s) October 8, Moderator and mediator analysis
2 Mediation and Moderation X Y X October 8, Moderator and mediator analysis 3 Examples Y : test score X : sex, SES, etc. X : ability (IQ score) Y : test score X : brain volume, SES parents X : ability More? October 8, Moderator and mediator analysis 4
3 i Multiple regression Y + = β + βx i + βx i Goal: to explain variation in Y using Xs Assumptions Independent observations Normality (of residuals) and constant variance Linearity (of relationship Y and Xs) E i October 8, Moderator and mediator analysis 5 Regression X β Y E X β October 8, Moderator and mediator analysis 6 3
4 Explained variance in regression Y X X Circles represent variances X and X explain different parts of Y and are independent October 8, Moderator and mediator analysis 7 Multicollinearity competition between variables for explaining Y Y X X Degree depends on correlation between X s Variance inflation factor (VIF): worse (= less precise) parameter estimation October 8, Moderator and mediator analysis 8 4
5 Association between all (3) variables Several correlations to describe association Partial correlation: correlation between two variables with the third variable fixed (i.e. corrected for the third variable) (partial in SPSS) unique portion of variance Semipartial correlation: correlation between two variables with one variable s association corrected for the third variable (part in SPSS output) extra variance explained Important in regression when variables are entered in a certain order Usually the partial correlation is smaller than the uncorrected ( zeroorder ) correlation, and larger than the semipartial correlation October 8, Moderator and mediator analysis 9 Multicollinearity/Mediation X Y X October 8, Moderator and mediator analysis 5
6 Mediation as a special case of multicollinearity and/or model selection Causal model defines direction of arrows X is the mediator (M) Also: intervening or process variable Or: indirect causal relationship Relations between all variables are assumed to be positive Question is whether direct effect between X and Y disappears when M is added to the regression equation October 8, Moderator and mediator analysis Mediation (Baron & Kenny, 986), X c c Y a M b October 8, Moderator and mediator analysis 6
7 Mediation as prescribed by Baron and Kenny (986) Estimate regression of Y on only X Estimated parameter c Estimate regression of M on X Estimated parameter a Estimate effect of M on Y, together with X Estimated parameters b and c Complete mediation: c = Partial mediation: c < c (can be tested) October 8, Moderator and mediator analysis 3 Testing of change in c Amount of mediation cc Theoretically equal to ab (indirect path) Standard error of ab is approximately square root of b s a + a s b (Sobel test) see (do) Note: neither c nor c are needed! Some eyeballing also possible Or: nonparametric tests (based on bootstrapping) October 8, Moderator and mediator analysis 4 7
8 Example (Miles and Shevlin) Y: read, a measure of the number of books that people have read. X: enjoy, scale score to measure how much people enjoy reading books M: buy, a measure of how many books people have bought in the previous months Idea: how much people enjoy reading books > the number of books bought > the number of books read But: is the number of books a complete mediator.? (People could go to the library or borrow books from friends.) October 8, Moderator and mediator analysis 5 Descriptive Statistics Std. Mean Deviation N read 8,85 3,563 4 buy 5,73 8,65 4 enjoy 9,8 5,354 4 Pearson Correlation Correlations read buy enjoy read,,747,73 buy,747,,644 enjoy,73,644, Step a Unstandardized Standardized B Std. Error Beta t Sig. (Constant) 4,33,785 5,57, enjoy,487,74,73 6,65, a. Dependent Variable: read October 8, Moderator and mediator analysis 6 8
9 Step a Unstandardized Standardiz ed B Std. Error Beta t Sig. (Constant) 6,66, 3,74, enjoy,98,89,644 5,9, a. Dependent Variable: buy Step 3 Unstandardized a Standardized B Std. Error Beta t Sig. (Constant),973,765 3,887, Correlations Zeroorder Partial Part buy,5,54,47 3,786,,747,58,36 enjoy,86,83,49 3,45,,73,494,38 a. Dependent Variable: read October 8, Moderator and mediator analysis 7 Examples Baron/Kenny + Sobel a=.98 s a =.89 b=.487 s b =.74 ab=.478, s ab = (.487 * *.74 )=. ztest 4.8; p<. Eyeballing c=.487 (.74), then roughly.34 < c <.64 c =.86 (.83): partial mediation (because. < c <.45) October 8, Moderator and mediator analysis 8 9
10 choice is important Many other patterns of association are possible Arrows between X and X may be reversed not always clear which variable mediates No causal relation, just association Explicit assumption of positive associations and ordering of (semi) partial correlations. Not guaranteed October 8, Moderator and mediator analysis 9 Moderation X Y X October 8, Moderator and mediator analysis
11 Moderation is interaction The effect of X depends on the value of X (or vice versa) different slopes for different folks can be a way to tackle nonlinearity in regression Interpretation depends on type of variable Interaction usually (but not necessarily) product of X and X X and X may be correlated Importance of model formulation October 8, Moderator and mediator analysis Regression model i = β + βx i + βx i + β3x i X i Y + E Centering is (usually) advised Facilitates interpretation Reduces the inevitable multicollinearity incurred with interaction terms c c c c i = β + βx i + βx i + β3x i X i Y + E i i October 8, Moderator and mediator analysis
12 X dichotomous and X continuous X = or X = (e.g. man/woman; control/experimental group) Y = β + β X + β X + β 3 X X X = : Y = β + β X X = : Y = (β + β ) + (β + β 3 )X so: intercept and regressioneffect of X change interaction effect represents the change in effect of X or, the difference in the effect of X between the two groups interpretation of β General formula: Y = (β + β X ) + (β + β 3 X )X October 8, Moderator and mediator analysis 3 X and X dichotomous X = or X = (e.g. man/woman) X = or X = (e.g. control/experimental grp) Y = β + β X + β X + β 3 X X X =, X = : Y = β X =, X = : Y = β + β X =, X = : Y = β + β X =, X = : Y = β + β + β + β 3 so: defines four groups with their own mean Interaction defines extra effect of X = and X = October 8, Moderator and mediator analysis 4
13 X nominal and X continuous X takes on more than (c) values (e.g. age groups, control/exp/exp) Make dummies, for each contrast, wrt reference group (e.g. controls) Leads to c dichotomous variables And also c interaction terms Also possible: dummies (indicators) for each group leaving out the intercept October 8, Moderator and mediator analysis 5 c=3; group reference group group D D 3 Y = β + β d D + β d D + β X +β 3 D X +β 4 D X group: Y = β + β X group: Y = (β + β d ) + (β + β 3 )X group3: Y = (β + β d ) + (β + β 4 )X October 8, Moderator and mediator analysis 6 3
14 X and X continuous Y = β + β X +β X +β 3 X X Y = (β + β X ) + (β +β 3 X )X Y = (β +β X ) + (β +β 3 X )X X X c c = X X = X c c * β = β β X β X + β 3 X X * β = β β 3 X * β = β β 3 X X * * Y = β + β X * + β X + β X 3 c X c X X = X = X : Y : Y = β * = β * + β * + β * X X c c October 8, Moderator and mediator analysis 7 Example (Miles and Shevlin) Y: grade in statistics course X: number of books read (4) X: number of classes attended () Descriptive Statistics Mean Std. Deviation N grade 63,55 6,755 4 books,,43 4 attend 4, 4,78 4 October 8, Moderator and mediator analysis 8 4
15 October 8, Moderator and mediator analysis 9 Unstandardized Standardiz ed Coefficient s a B Std. Error Beta t Sig. (Constant) 63,4,3 8,534, Correlations Zeroorder Partial Part Collinearity Statistics Toleran ce VIF booksc 4,37,753,346,33,7,49,354,3,83,45 attendc,83,587,39,87,35,48,338,95,83,45 (Constant) 6,469,3 6,494, booksc 4,8,677,35,433,,49,376,34,83,45 attendc,333,56,34,37,3,48,368,36,8,47 bookscxatte ndc a. Dependent Variable: grade,735,349,7,4,4,4,33,7,997,3 October 8, Moderator and mediator analysis 3 5
16 Other example (missed) interaction: nonlinearity? 3 groups with each a distinct linear relation October 8, Moderator and mediator analysis 3 October 8, Moderator and mediator analysis 3 6
17 October 8, Moderator and mediator analysis 33 Summary b Adjusted Std. Error of R R Square R Square the Estimate.45 a a. Predictors: (Constant), x b. Dependent Variable: y Predicted Value Residual Std. Predicted Value Std. Residual a. Dependent Variable: y Residuals Statistics a Minimum Maximum Mean Std. Deviation N (Constant) x a. Dependent Variable: y Unstandardized Standardized a Correlations t Sig. Zeroorder Partial Part Collinearity Statistics VIF B Std. Error Beta Tolerance Histogram Normal PP Plot of Regression Standardized Residual Dependent Variable: y Dependent Variable: y, 6 Frequency 4 Expected Cum Prob,8,6,4,  Regression Standardized Residual Mean =,78E7 Std. Dev. =,983 N =3,,,,4,6,8 Observed Cum Prob, October 8, Moderator and mediator analysis 34 7
18 y Summary b Adjusted Std. Error of R R Square R Square the Estimate.98 a a. Predictors: (Constant), xkwadraat, x b. Dependent Variable: y Predicted Value Residual Std. Predicted Value Std. Residual a. Dependent Variable: y Residuals Statistics a Minimum Maximum Mean Std. Deviation N (Constant) x xkwadraat a. Dependent Variable: y Unstandardized Standardized a Correlations t Sig. Zeroorder Partial Part Collinearity Statistics VIF B Std. Error Beta Tolerance Histogram Partial Regression Plot Dependent Variable: y Dependent Variable: y 6, Frequency 4,  Regression Standardized Residual Mean =3,6E6 Std. Dev. =,965 N =3 , 5, , 5,, x 5,, 5, October 8, Moderator and mediator analysis 35 Summary b Adjusted Std. Error of R R Square R Square the Estimate.4 a a. Predictors: (Constant), groep, x b. Dependent Variable: y Predicted Value Residual Std. Predicted Value Std. Residual a. Dependent Variable: y Residuals Statistics a Minimum Maximum Mean Std. Deviation N (Constant) x groep a. Dependent Variable: y Unstandardized Standardized a Correlations t Sig. Zeroorder Partial Part Collinearity Statistics VIF B Std. Error Beta Tolerance Partial Regression Plot Histogram Dependent Variable: y Dependent Variable: y 6,5 Frequency 4 y, ,5  Mean =5,69E6 Std. Dev. =,965 N =35, Regression Standardized Residual 4, ,, x, 4, October 8, Moderator and mediator analysis 36 8
19 y y Summary b Adjusted Std. Error of R R Square R Square the Estimate.75 a a. Predictors: (Constant), groep3, groep, x b. Dependent Variable: y Predicted Value Residual Std. Predicted Value Std. Residual a. Dependent Variable: y Residuals Statistics a Minimum Maximum Mean Std. Deviation N (Constant) x groep groep3 a. Dependent Variable: y Unstandardized Standardized a Correlations t Sig. Zeroorder Partial Part Collinearity Statistics VIF B Std. Error Beta Tolerance Partial Regression Plot Histogram Dependent Variable: y Dependent Variable: y 4, 8, Frequency 6 4, , 4,  Regression Standardized Residual Mean =3,47E6 Std. Dev. =,947 N =34, ,, x, 4, October 8, Moderator and mediator analysis 37 Summary b Adjusted Std. Error of R R Square R Square the Estimate.997 a a. Predictors: (Constant), intxgr3, intxgr, x, groep, groep3 b. Dependent Variable: y Predicted Value Residual Std. Predicted Value Std. Residual a. Dependent Variable: y Residuals Statistics a Minimum Maximum Mean Std. Deviation N (Constant) x groep groep3 intxgr intxgr3 a. Dependent Variable: y Unstandardized Standardized a Correlations t Sig. Zeroorder Partial Part Collinearity Statistics VIF B Std. Error Beta Tolerance 4.97E Histogram Partial Regression Plot Dependent Variable: y Dependent Variable: y 4,, Frequency 8 6 4, ,  Mean =,8E5 Std. Dev. =,9 N =34, Regression Standardized Residual 4, ,,, 4, x October 8, Moderator and mediator analysis 38 9
20 choice important Missing interaction may result in Violations of linearity assumption nonconstant variance (heterogeneity) Incorrect model choice and interpretation October 8, Moderator and mediator analysis 39 Conclusion choice and selection crucial in detecting mediation and moderation Substantive / theoretical considerations should guide the model selection process! October 8, Moderator and mediator analysis 4
21 Other methods/models Mediation sometimes too simple More refined path analysis Regression analysis sometimes too simple More elaborate models for causal modeling Structural Equation s October 8, Moderator and mediator analysis 4
Multiple Linear Regression
Multiple Linear Regression Simple Linear Regression Regression equation for a line (population): y = β 0 + β 1 x + β 0 : point where the line intercepts yaxis β 1 : slope of the line : error in estimating
More informationIntroduction Types of mediation Causal steps approach SPSS example Miscellaneous topics Proportion mediated Sobel test. Mediation analysis
Mediation analysis Seminar General Statistics Matthijs J Warrens GION Multiple regression analysis 1 dependent variable (INT) Several independent variables 1, 2, 3 (INT) (predictors) 1 2 3 Research question
More informationSimple linear regression
Simple linear regression Introduction Simple linear regression is a statistical method for obtaining a formula to predict values of one variable from another where there is a causal relationship between
More informationBy Hui Bian Office for Faculty Excellence
By Hui Bian Office for Faculty Excellence 1 Email: bianh@ecu.edu Phone: 3285428 Location: 2307 Old Cafeteria Complex 2 When want to predict one variable from a combination of several variables. When want
More informationCRJ Doctoral Comprehensive Exam Statistics Friday August 23, :00pm 5:30pm
CRJ Doctoral Comprehensive Exam Statistics Friday August 23, 23 2:pm 5:3pm Instructions: (Answer all questions below) Question I: Data Collection and Bivariate Hypothesis Testing. Answer the following
More informationMultiple Regression in SPSS This example shows you how to perform multiple regression. The basic command is regression : linear.
Multiple Regression in SPSS This example shows you how to perform multiple regression. The basic command is regression : linear. In the main dialog box, input the dependent variable and several predictors.
More informationChapter Seven. Multiple regression An introduction to multiple regression Performing a multiple regression on SPSS
Chapter Seven Multiple regression An introduction to multiple regression Performing a multiple regression on SPSS Section : An introduction to multiple regression WHAT IS MULTIPLE REGRESSION? Multiple
More informationUsing SPSS for Multiple Regression. UDP 520 Lab 7 Lin Lin December 4 th, 2007
Using SPSS for Multiple Regression UDP 520 Lab 7 Lin Lin December 4 th, 2007 Step 1 Define Research Question What factors are associated with BMI? Predict BMI. Step 2 Conceptualizing Problem (Theory) Individual
More information12/31/2016. PSY 512: Advanced Statistics for Psychological and Behavioral Research 2
PSY 512: Advanced Statistics for Psychological and Behavioral Research 2 Understand when to use multiple Understand the multiple equation and what the coefficients represent Understand different methods
More informationSPSS Guide: Regression Analysis
SPSS Guide: Regression Analysis I put this together to give you a stepbystep guide for replicating what we did in the computer lab. It should help you run the tests we covered. The best way to get familiar
More informationChapter 13 Introduction to Linear Regression and Correlation Analysis
Chapter 3 Student Lecture Notes 3 Chapter 3 Introduction to Linear Regression and Correlation Analsis Fall 2006 Fundamentals of Business Statistics Chapter Goals To understand the methods for displaing
More informationChapter 14: Analyzing Relationships Between Variables
Chapter Outlines for: Frey, L., Botan, C., & Kreps, G. (1999). Investigating communication: An introduction to research methods. (2nd ed.) Boston: Allyn & Bacon. Chapter 14: Analyzing Relationships Between
More informationA. Karpinski
Chapter 3 Multiple Linear Regression Page 1. Overview of multiple regression 32 2. Considering relationships among variables 33 3. Extending the simple regression model to multiple predictors 34 4.
More information11/20/2014. Correlational research is used to describe the relationship between two or more naturally occurring variables.
Correlational research is used to describe the relationship between two or more naturally occurring variables. Is age related to political conservativism? Are highly extraverted people less afraid of rejection
More informationLEARNING OBJECTIVES SCALES OF MEASUREMENT: A REVIEW SCALES OF MEASUREMENT: A REVIEW DESCRIBING RESULTS DESCRIBING RESULTS 8/14/2016
UNDERSTANDING RESEARCH RESULTS: DESCRIPTION AND CORRELATION LEARNING OBJECTIVES Contrast three ways of describing results: Comparing group percentages Correlating scores Comparing group means Describe
More informationDoing Multiple Regression with SPSS. In this case, we are interested in the Analyze options so we choose that menu. If gives us a number of choices:
Doing Multiple Regression with SPSS Multiple Regression for Data Already in Data Editor Next we want to specify a multiple regression analysis for these data. The menu bar for SPSS offers several options:
More informationpsyc3010 lecture 8 standard and hierarchical multiple regression last week: correlation and regression Next week: moderated regression
psyc3010 lecture 8 standard and hierarchical multiple regression last week: correlation and regression Next week: moderated regression 1 last week this week last week we revised correlation & regression
More informationUNDERSTANDING MULTIPLE REGRESSION
UNDERSTANDING Multiple regression analysis (MRA) is any of several related statistical methods for evaluating the effects of more than one independent (or predictor) variable on a dependent (or outcome)
More informationMultiple Regression. Page 24
Multiple Regression Multiple regression is an extension of simple (bivariate) regression. The goal of multiple regression is to enable a researcher to assess the relationship between a dependent (predicted)
More informationModeration. Moderation
Stats  Moderation Moderation A moderator is a variable that specifies conditions under which a given predictor is related to an outcome. The moderator explains when a DV and IV are related. Moderation
More informationChapter 6 Partial Correlation
Chapter 6 Partial Correlation Chapter Overview Partial correlation is a statistical technique for computing the Pearson correlation between a predictor and a criterion variable while controlling for (removing)
More information, then the form of the model is given by: which comprises a deterministic component involving the three regression coefficients (
Multiple regression Introduction Multiple regression is a logical extension of the principles of simple linear regression to situations in which there are several predictor variables. For instance if we
More informationNCSS Statistical Software Principal Components Regression. In ordinary least squares, the regression coefficients are estimated using the formula ( )
Chapter 340 Principal Components Regression Introduction is a technique for analyzing multiple regression data that suffer from multicollinearity. When multicollinearity occurs, least squares estimates
More information6: Regression and Multiple Regression
6: Regression and Multiple Regression Objectives Calculate regressions with one independent variable Calculate regressions with multiple independent variables Scatterplot of predicted and actual values
More informationANNOTATED OUTPUTSPSS Simple Linear (OLS) Regression
Simple Linear (OLS) Regression Regression is a method for studying the relationship of a dependent variable and one or more independent variables. Simple Linear Regression tells you the amount of variance
More informationDirections for using SPSS
Directions for using SPSS Table of Contents Connecting and Working with Files 1. Accessing SPSS... 2 2. Transferring Files to N:\drive or your computer... 3 3. Importing Data from Another File Format...
More informationRegressionBased Tests for Moderation
RegressionBased Tests for Moderation Brian K. Miller, Ph.D. 1 Presentation Objectives 1. Differentiate between mediation & moderation 2. Differentiate between hierarchical and stepwise regression 3. Run
More informationMulticollinearity Richard Williams, University of Notre Dame, http://www3.nd.edu/~rwilliam/ Last revised January 13, 2015
Multicollinearity Richard Williams, University of Notre Dame, http://www3.nd.edu/~rwilliam/ Last revised January 13, 2015 Stata Example (See appendices for full example).. use http://www.nd.edu/~rwilliam/stats2/statafiles/multicoll.dta,
More informationCorrelation and Regression
Dublin Institute of Technology ARROW@DIT Books/Book Chapters School of Management 201210 Correlation and Regression Donal O'Brien Dublin Institute of Technology, donal.obrien@dit.ie Pamela Sharkey Scott
More informationAdditional sources Compilation of sources: http://lrs.ed.uiuc.edu/tseportal/datacollectionmethodologies/jintselink/tselink.htm
Mgt 540 Research Methods Data Analysis 1 Additional sources Compilation of sources: http://lrs.ed.uiuc.edu/tseportal/datacollectionmethodologies/jintselink/tselink.htm http://web.utk.edu/~dap/random/order/start.htm
More informationRunning head: ASSUMPTIONS IN MULTIPLE REGRESSION 1. Assumptions in Multiple Regression: A Tutorial. Dianne L. Ballance ID#
Running head: ASSUMPTIONS IN MULTIPLE REGRESSION 1 Assumptions in Multiple Regression: A Tutorial Dianne L. Ballance ID#00939966 University of Calgary APSY 607 ASSUMPTIONS IN MULTIPLE REGRESSION 2 Assumptions
More informationModule 3  Multiple Linear Regressions
Module 3  Multiple Linear Regressions Objectives Understand the strength of Multiple linear regression (MLR) in untangling cause and effect relationships Understand how MLR can answer substantive questions
More informationThe scatterplot indicates a positive linear relationship between waist size and body fat percentage:
STAT E150 Statistical Methods Multiple Regression Three percent of a man's body is essential fat, which is necessary for a healthy body. However, too much body fat can be dangerous. For men between the
More informationCorrelation and Regression Analysis: SPSS
Correlation and Regression Analysis: SPSS Bivariate Analysis: Cyberloafing Predicted from Personality and Age These days many employees, during work hours, spend time on the Internet doing personal things,
More informationStepwise Regression. Chapter 311. Introduction. Variable Selection Procedures. Forward (StepUp) Selection
Chapter 311 Introduction Often, theory and experience give only general direction as to which of a pool of candidate variables (including transformed variables) should be included in the regression model.
More informationCollinearity of independent variables. Collinearity is a condition in which some of the independent variables are highly correlated.
Collinearity of independent variables Collinearity is a condition in which some of the independent variables are highly correlated. Why is this a problem? Collinearity tends to inflate the variance of
More information5. Linear Regression
5. Linear Regression Outline.................................................................... 2 Simple linear regression 3 Linear model............................................................. 4
More informationMultiple Regression and Mediation Analyses Using SPSS
Psychology 305 p. 1 Multiple Regression and Mediation Analyses Using SPSS Overview For this computer assignment, you will conduct a series of multiple regression analyses to examine your proposed theoretical
More informationUsing Correlation and Regression: Mediation, Moderation, and More
Using Correlation and Regression: Mediation, Moderation, and More Part 2: Mediation analysis with regression Claremont Graduate University Professional Development Workshop August 22, 2015 Dale Berger,
More informationClass 6: Chapter 12. Key Ideas. Explanatory Design. Correlational Designs
Class 6: Chapter 12 Correlational Designs l 1 Key Ideas Explanatory and predictor designs Characteristics of correlational research Scatterplots and calculating associations Steps in conducting a correlational
More informationPremaster Statistics Tutorial 4 Full solutions
Premaster Statistics Tutorial 4 Full solutions Regression analysis Q1 (based on Doane & Seward, 4/E, 12.7) a. Interpret the slope of the fitted regression = 125,000 + 150. b. What is the prediction for
More informationChapter 7: Simple linear regression Learning Objectives
Chapter 7: Simple linear regression Learning Objectives Reading: Section 7.1 of OpenIntro Statistics Video: Correlation vs. causation, YouTube (2:19) Video: Intro to Linear Regression, YouTube (5:18) 
More informationIAPRI Quantitative Analysis Capacity Building Series. Multiple regression analysis & interpreting results
IAPRI Quantitative Analysis Capacity Building Series Multiple regression analysis & interpreting results How important is Rsquared? Rsquared Published in Agricultural Economics 0.45 Best article of the
More informationCan Mediation be Tested with Crosssectional Studies?
Can Mediation be Tested with Crosssectional Studies? Mediation Mediation occurs when a variable (IV) affects another variable (DV) wholly or partly via its effect on another variable (MV) 1 Mediation
More informationBivariate Analysis. Correlation. Correlation. Pearson's Correlation Coefficient. Variable 1. Variable 2
Bivariate Analysis Variable 2 LEVELS >2 LEVELS COTIUOUS Correlation Used when you measure two continuous variables. Variable 2 2 LEVELS X 2 >2 LEVELS X 2 COTIUOUS ttest X 2 X 2 AOVA (Ftest) ttest AOVA
More informationMultiple Regression. Motivations. Multiple Regression
Motivations Multiple Regression to make the predictions of the model more precise by adding other factors believed to affect the dependent variable to reduce the proportion of error variance associated
More informationBivariate Regression Analysis. The beginning of many types of regression
Bivariate Regression Analysis The beginning of many types of regression TOPICS Beyond Correlation Forecasting Two points to estimate the slope Meeting the BLUE criterion The OLS method Purpose of Regression
More information1. The parameters to be estimated in the simple linear regression model Y=α+βx+ε ε~n(0,σ) are: a) α, β, σ b) α, β, ε c) a, b, s d) ε, 0, σ
STA 3024 Practice Problems Exam 2 NOTE: These are just Practice Problems. This is NOT meant to look just like the test, and it is NOT the only thing that you should study. Make sure you know all the material
More informationYiming Peng, Department of Statistics. February 12, 2013
Regression Analysis Using JMP Yiming Peng, Department of Statistics February 12, 2013 2 Presentation and Data http://www.lisa.stat.vt.edu Short Courses Regression Analysis Using JMP Download Data to Desktop
More informationSEX DISCRIMINATION PROBLEM
SEX DISCRIMINATION PROBLEM 12. Multiple Linear Regression in SPSS In this section we will demonstrate how to apply the multiple linear regression procedure in SPSS to the sex discrimination data. The numerical
More informationHYPOTHESIS TESTING: CONFIDENCE INTERVALS, TTESTS, ANOVAS, AND REGRESSION
HYPOTHESIS TESTING: CONFIDENCE INTERVALS, TTESTS, ANOVAS, AND REGRESSION HOD 2990 10 November 2010 Lecture Background This is a lightning speed summary of introductory statistical methods for senior undergraduate
More informationMediation with Dichotomous Outcomes
April 19, 2013 This is a draft document to assist researchers. Please do not cite or quote without the author s permission. I thank both Nathaniel R. Herr and Craig Nathanson who suggested corrections
More information1.1. Simple Regression in Excel (Excel 2010).
.. Simple Regression in Excel (Excel 200). To get the Data Analysis tool, first click on File > Options > AddIns > Go > Select Data Analysis Toolpack & Toolpack VBA. Data Analysis is now available under
More informationChapter 23. Inferences for Regression
Chapter 23. Inferences for Regression Topics covered in this chapter: Simple Linear Regression Simple Linear Regression Example 23.1: Crying and IQ The Problem: Infants who cry easily may be more easily
More informationSupplementary PROCESS Documentation
Supplementary PROCESS Documentation This document is an addendum to Appendix A of Introduction to Mediation, Moderation, and Conditional Process Analysis that describes options and output added to PROCESS
More informationFalse. Model 2 is not a special case of Model 1, because Model 2 includes X5, which is not part of Model 1. What she ought to do is estimate
Sociology 59  Research Statistics I Final Exam Answer Key December 6, 00 Where appropriate, show your work  partial credit may be given. (On the other hand, don't waste a lot of time on excess verbiage.)
More informationCorrelation. What Is Correlation? Perfect Correlation. Perfect Correlation. Greg C Elvers
Correlation Greg C Elvers What Is Correlation? Correlation is a descriptive statistic that tells you if two variables are related to each other E.g. Is your related to how much you study? When two variables
More information12/31/2016. PSY 512: Advanced Statistics for Psychological and Behavioral Research 2
PSY 512: Advanced Statistics for Psychological and Behavioral Research 2 Understand linear regression with a single predictor Understand how we assess the fit of a regression model Total Sum of Squares
More informationDEPARTMENT OF PSYCHOLOGY UNIVERSITY OF LANCASTER MSC IN PSYCHOLOGICAL RESEARCH METHODS ANALYSING AND INTERPRETING DATA 2 PART 1 WEEK 9
DEPARTMENT OF PSYCHOLOGY UNIVERSITY OF LANCASTER MSC IN PSYCHOLOGICAL RESEARCH METHODS ANALYSING AND INTERPRETING DATA 2 PART 1 WEEK 9 Analysis of covariance and multiple regression So far in this course,
More informationID X Y
Dale Berger SPSS StepbyStep Regression Introduction: MRC01 This stepbystep example shows how to enter data into SPSS and conduct a simple regression analysis to develop an equation to predict from.
More information1/27/2013. PSY 512: Advanced Statistics for Psychological and Behavioral Research 2
PSY 512: Advanced Statistics for Psychological and Behavioral Research 2 Introduce moderated multiple regression Continuous predictor continuous predictor Continuous predictor categorical predictor Understand
More informationLecture 5: Correlation and Linear Regression
Lecture 5: Correlation and Linear Regression 3.5. (Pearson) correlation coefficient The correlation coefficient measures the strength of the linear relationship between two variables. The correlation is
More informationProjects Involving Statistics (& SPSS)
Projects Involving Statistics (& SPSS) Academic Skills Advice Starting a project which involves using statistics can feel confusing as there seems to be many different things you can do (charts, graphs,
More informationMultiple Regression in SPSS STAT 314
Multiple Regression in SPSS STAT 314 I. The accompanying data is on y = profit margin of savings and loan companies in a given year, x 1 = net revenues in that year, and x 2 = number of savings and loan
More informationEDUCATION AND VOCABULARY MULTIPLE REGRESSION IN ACTION
EDUCATION AND VOCABULARY MULTIPLE REGRESSION IN ACTION EDUCATION AND VOCABULARY 510 hours of input weekly is enough to pick up a new language (Schiff & Myers, 1988). Dutch children spend 5.5 hours/day
More informationSimple Linear Regression One Binary Categorical Independent Variable
Simple Linear Regression Does sex influence mean GCSE score? In order to answer the question posed above, we want to run a linear regression of sgcseptsnew against sgender, which is a binary categorical
More informationUsing Excel for Statistical Analysis
Using Excel for Statistical Analysis You don t have to have a fancy pants statistics package to do many statistical functions. Excel can perform several statistical tests and analyses. First, make sure
More informationRegression Analysis (Spring, 2000)
Regression Analysis (Spring, 2000) By Wonjae Purposes: a. Explaining the relationship between Y and X variables with a model (Explain a variable Y in terms of Xs) b. Estimating and testing the intensity
More informationINTRODUCTION TO MULTIPLE CORRELATION
CHAPTER 13 INTRODUCTION TO MULTIPLE CORRELATION Chapter 12 introduced you to the concept of partialling and how partialling could assist you in better interpreting the relationship between two primary
More informationIntroduction. Research Problem. Larojan Chandrasegaran (1), Janaki Samuel Thevaruban (2)
Larojan Chandrasegaran (1), Janaki Samuel Thevaruban (2) Determining Factors on Applicability of the Computerized Accounting System in Financial Institutions in Sri Lanka (1) Department of Finance and
More informationMultiple Regression Using SPSS
Multiple Regression Using SPSS The following sections have been adapted from Field (2009) Chapter 7. These sections have been edited down considerably and I suggest (especially if you re confused) that
More informationMultiple Regression Using SPSS
Multiple Regression Using SPSS The following sections have been adapted from Field (2005) Chapter 5. These sections have been edited down considerably and I suggest (especially if you re confused) that
More informationSPSS BASICS. (Data used in this tutorial: General Social Survey 2000 and 2002) Ex: Mother s Education to eliminate responses 97,98, 99;
SPSS BASICS (Data used in this tutorial: General Social Survey 2000 and 2002) How to do Recoding Eliminating Response Categories Ex: Mother s Education to eliminate responses 97,98, 99; When we run a frequency
More informationUsing Minitab for Regression Analysis: An extended example
Using Minitab for Regression Analysis: An extended example The following example uses data from another text on fertilizer application and crop yield, and is intended to show how Minitab can be used to
More informationThis chapter will demonstrate how to perform multiple linear regression with IBM SPSS
CHAPTER 7B Multiple Regression: Statistical Methods Using IBM SPSS This chapter will demonstrate how to perform multiple linear regression with IBM SPSS first using the standard method and then using the
More informationCorrelation key concepts:
CORRELATION Correlation key concepts: Types of correlation Methods of studying correlation a) Scatter diagram b) Karl pearson s coefficient of correlation c) Spearman s Rank correlation coefficient d)
More informationWhat is correlational research?
Key Ideas Purpose and use of correlational designs How correlational research developed Types of correlational designs Key characteristics of correlational designs Procedures used in correlational studies
More informationSELFTEST: SIMPLE REGRESSION
ECO 22000 McRAE SELFTEST: SIMPLE REGRESSION Note: Those questions indicated with an (N) are unlikely to appear in this form on an inclass examination, but you should be able to describe the procedures
More informationInternational Journal of Computer Trends and Technology (IJCTT) volume 4 Issue 8 August 2013
A ShortTerm Traffic Prediction On A Distributed Network Using Multiple Regression Equation Ms.Sharmi.S 1 Research Scholar, MS University,Thirunelvelli Dr.M.Punithavalli Director, SREC,Coimbatore. Abstract:
More informationChapter 4 and 5 solutions
Chapter 4 and 5 solutions 4.4. Three different washing solutions are being compared to study their effectiveness in retarding bacteria growth in five gallon milk containers. The analysis is done in a laboratory,
More informationOverview Classes. 123 Logistic regression (5) 193 Building and applying logistic regression (6) 263 Generalizations of logistic regression (7)
Overview Classes 123 Logistic regression (5) 193 Building and applying logistic regression (6) 263 Generalizations of logistic regression (7) 24 Loglinear models (8) 54 1517 hrs; 5B02 Building and
More informationMultiple Regression Exercises
Multiple Regression Exercises 1. In a study to predict the sale price of a residential property (dollars), data is taken on 20 randomly selected properties. The potential predictors in the study are appraised
More informationMultiple Linear Regression
Multiple Linear Regression by Lin Naing @ Mohd. Ayub Sadiq School of Dental Sciences Universiti Sains Malaysia 1 Contents Simple Linear Regression (Revision) Basic Theory of Multiple Linear Regression
More informationSPSS: Descriptive and Inferential Statistics. For Windows
For Windows August 2012 Table of Contents Section 1: Summarizing Data...3 1.1 Descriptive Statistics...3 Section 2: Inferential Statistics... 10 2.1 ChiSquare Test... 10 2.2 T tests... 11 2.3 Correlation...
More informationSimple Linear Regression Chapter 11
Simple Linear Regression Chapter 11 Rationale Frequently decisionmaking situations require modeling of relationships among business variables. For instance, the amount of sale of a product may be related
More informationPASS Sample Size Software. Linear Regression
Chapter 855 Introduction Linear regression is a commonly used procedure in statistical analysis. One of the main objectives in linear regression analysis is to test hypotheses about the slope (sometimes
More informationMultiple Regression: What Is It?
Multiple Regression Multiple Regression: What Is It? Multiple regression is a collection of techniques in which there are multiple predictors of varying kinds and a single outcome We are interested in
More information0.1 Multiple Regression Models
0.1 Multiple Regression Models We will introduce the multiple Regression model as a mean of relating one numerical response variable y to two or more independent (or predictor variables. We will see different
More information3:3 LEC  NONLINEAR REGRESSION
3:3 LEC  NONLINEAR REGRESSION Not all relationships between predictor and criterion variables are strictly linear. For a linear relationship, a unit change on X produces exactly the same amount of change
More informationOutline. Topic 4  Analysis of Variance Approach to Regression. Partitioning Sums of Squares. Total Sum of Squares. Partitioning sums of squares
Topic 4  Analysis of Variance Approach to Regression Outline Partitioning sums of squares Degrees of freedom Expected mean squares General linear test  Fall 2013 R 2 and the coefficient of correlation
More informationExploring Relationships using SPSS inferential statistics (Part II) Dwayne Devonish
Exploring Relationships using SPSS inferential statistics (Part II) Dwayne Devonish Reminder: Types of Variables Categorical Variables Based on qualitative type variables. Gender, Ethnicity, religious
More informationSPSS and SAS Programming for the Testing of Mediation Models
SPSS and SAS Programming for the Testing of Mediation Models By: William N. Dudley, Jose G. Benuzillo, and Mineh A. S. Carrico Dudley WN, Benuzillo JG, Carrico MS. (2004). SPSS and SAS programming for
More informationIntroduction to Regression and Data Analysis
Statlab Workshop Introduction to Regression and Data Analysis with Dan Campbell and Sherlock Campbell October 28, 2008 I. The basics A. Types of variables Your variables may take several forms, and it
More informationCategorical Variables in Regression: Implementation and Interpretation By Dr. Jon Starkweather, Research and Statistical Support consultant
Interpretation and Implementation 1 Categorical Variables in Regression: Implementation and Interpretation By Dr. Jon Starkweather, Research and Statistical Support consultant Use of categorical variables
More informationX2: Mediator. Variable
1 Neuendorf Mediating vs. Moderating s The classic reference on this topic may be found on the COM 631 web site: Baron, R. M., & Kenny, D. A. (1986). The moderatormediator variable distinction in social
More informationSection 14 Simple Linear Regression: Introduction to Least Squares Regression
Slide 1 Section 14 Simple Linear Regression: Introduction to Least Squares Regression There are several different measures of statistical association used for understanding the quantitative relationship
More informationExample: Boats and Manatees
Figure 96 Example: Boats and Manatees Slide 1 Given the sample data in Table 91, find the value of the linear correlation coefficient r, then refer to Table A6 to determine whether there is a significant
More informationMultiple Regression in SPSS
Multiple Regression in SPSS Example: An automotive industry group keeps track of the sales for a variety of personal motor vehicles. In an effort to be able to identify over and underperforming models,
More informationSimple Linear Regression in SPSS STAT 314
Simple Linear Regression in SPSS STAT 314 1. Ten Corvettes between 1 and 6 years old were randomly selected from last year s sales records in Virginia Beach, Virginia. The following data were obtained,
More informationElements of statistics (MATH04871)
Elements of statistics (MATH04871) Prof. Dr. Dr. K. Van Steen University of Liège, Belgium December 10, 2012 Introduction to Statistics Basic Probability Revisited Sampling Exploratory Data Analysis 
More information