1 Lesson 4 Part 1 Relationships between two numerical variables 1
2 Correlation Coefficient The correlation coefficient is a summary statistic that describes the linear relationship between two numerical variables 2
3 Relationship between two variables The summary statistics covered in the previous lessons are appropriate for describing a single variable. In many investigations, there is interest in evaluating the relationship between two variables. Depending on the type of data, different statistics are used to measure the relationship between two variables. 3
4 Measuring relationship between two variables Nominal binary data Odds Ratio or Risk Ratio (covered in Lesson 4 part 2) Numerical data Pearson Correlation Coefficient Ordinal data or Skewed Numerical data Spearman Rank Correlation Coefficient 4
5 Correlation Coefficients Correlation coefficients measure the linear relationship between two numerical variables. Most often the Pearson Correlation Coefficient is used to describe the linear relationship Note if just the term correlation coefficient is used, it is referring to the Pearson Correlation Coefficient If one variable is numerical and the other variable is ordinal or if both variables are ordinal, use the Spearman rank correlation coefficient instead. 5
6 Correlation Analysis Examples For correlation analysis, you have pairs of values. The goal is to measure the linear relationship between these values. For example, what is the linear relationship between: Weight and height Blood pressure and age Daily fat intake and cholesterol Weight and cholesterol Age and bone density The pairs of values are labeled (x,y) and can be plotted on a scatter plot 6
7 Types of Relationships between 2 variables There are 2 types of relationships between numerical variables Deterministic relationship the values of the 2 variables are related through an exact mathematical formula. Statistical relationship this is not a perfectly linear relationship. This is what we will explore through correlation analysis. 7
8 Example of Deterministic Linear relationship Weight in kg Deterministic linear relationship Weight in pounds The relationship between weight measured in lbs. And weight measured in kg. is deterministic because it can be described with a Mathematical formula: 1 pound = *kg All the points in the plot fall on a straight line in a deterministic relationship 8
9 Statistical Linear relationship In a statistical linear relationship the plotted (x,y) values do not fall exactly on a straight line. Var Y Var X You can see, however, that there is a general linear trend in the plot of the (x,y) values. The correlation coefficient provides information about the direction and strength of the linear relationship between two numerical values. 9
10 Nonlinear Relationship V a r. Y Nonlinear relationship Var. X A nonlinear relationship between two variables results in a scatter plot of the (x,y) values that do not follow a straight line pattern. The relationship between these two variables is a curvilinear relationship. The correlation coefficient does not provide a description of the strength and direction of nonlinear relationships. 10
11 Random scatter: no pattern IQ Height This scatter plot of IQ and height for 18 individuals illustrates the situation where there is no relationship between the two variables. The (x,y) values do not have either a linear or curvilinear pattern. These points have a random scatter, indicating no relationship. 11
12 Correlation Analysis Procedure 1. Plot the data using a scatter plot to get a visual idea of the relationship 1. If there is a linear pattern, continue 2. If the pattern is curved, stop Calculate the correlation coefficient 3. Interpret the correlation coefficient 12
13 Scatter Plots Plot the 2 variables in a scatter plot (one of the types of charts in EXCEL). The pattern of the dots in the plot indicates the direction of the statistical relationship between the variables Positive correlation pattern goes from lower left to upper right Increase in X is associated with increase in Y Negative correlation pattern goes from upper left to lower right Increase in X is associated with decrease in Y 13
14 Height and weight: a positive linear relationship Ht (in) Wt (lbs) Weight (lbs) Height (In) 14
15 Age and Bone Density (mg/cm 2 ): a negative linear relationship Age Bone Density Bone density Bone Density and Age for Women Age 15
16 Strength of the Association The correlation coefficient provides a measure of the strength and direction of the linear relationship. The sign of the correlation coefficient indicates the direction Positive coefficient = positive direction Negative coefficient = negative direction Strength of association Correlation coefficients closer to 1 or -1 indicates a stronger relationship Correlation coefficients = 0 (or close to 0) indicate a non-existent or very weak linear relationship 16
17 Correlation Coefficient r = [ ( x ( x x) 2 x)( y ][ y) ( y y) 2 ] The statistic r is called the Correlation Coefficient r is always between 1 and 1 The closer r is to 1 or -1, the stronger the linear relationship 17
18 Strong positive relationship R = 0.85 Weight (lbs) Height (In) The correlation coefficient for the (height, weight) data = 0.85 indicating a strong (close to 1.0), positive linear relationship between height and weight. 18
19 Strong negative relationship 1100 Bone Density and Age for Women Bome density R = Age The correlation coefficient for the (age, bone density) data = indicating a strong (close to -1.0), negative linear relationship between age and bone density for women. 19
20 Correlation Coefficient Interpretation Guidelines* These guidelines can be used to interpret the correlation coefficient 0 to 0.25 ( or 0 to 0.25) weak or no linear relationship 0.25 to 0.5 (or 0.25 to 0.5) fair degree of linear relationship 0.50 to 0.75 (or 0.5 to 0.75) moderately strong linear relationship > 0.75 ( or -0.75) very strong linear relationship 1 or 1 perfect linear relationship deterministic relationship * Colton (1974) 20
21 Calculating Correlation Coefficient in Excel If the original data are in B2:B11 and C2:C11 Use the CORREL function and the data ranges =CORREL(B2:B11,C2:C11) to find the correlation coefficient : Use the CORREL function for assignments and exams. 21
22 Interpretation of Correlation Coefficient = 0 A correlation coefficient = 0 does not necessarily mean there is NO relationship between the variables. If r = 0 this means there is no linear relationship There may be a strong nonlinear relationship but r will not identify this. Plot the data first to determine if there is a nonlinear relationship 22
23 Nonlinear Relationship r = 0 Nonlinear relationship V a r. Y Var. X This plot illustrates that the correlation coefficient only measures the strength of linear relationships. Here there is a nonlinear (curvilinear) relationship between X and Y but the correlation coefficient = 0. 23
24 Random scatter: no pattern r = IQ Height When there is a random scatter of points, the correlation coefficient will be near 0 indicating no linear relationship between the variables 24
25 Notes about Correlation Coefficient The correlation coefficient is independent of the units used in measuring the variables The correlation coefficient is independent of which variable is designated the X variable and which is designated the Y variable 25
26 Correlation vs. Causation Strong correlation does not imply causation (i.e. that changes in one variable cause changes in the other variable). Example*: There is a strong positive correlation between the number of television sets /person and the average life expectancy for the world s nations. Does having more TV sets cause longer life expectancy? *Moore & McCabe 26
27 Coefficient of Determination The coefficient of Determination is the correlation coefficient squared (R 2 ) R 2 = the percent of variation in the Y variable that is explained by the linear association between the two variables From example of age / bone density: Correlation coefficient for age and bone density = Coefficient of determination = (-0.96) 2 = % of the variation in bone density is explained by the linear association between age and bone density 27
28 Effect of outlier on r One outlier has been added to the random pattern plot of height and IQ: a 74 inch tall person with IQ of 165 Addition of this one point results in r changing from to 0.44 Random Pattern with outlier IQ r = Height 28
29 Correlation Coefficient and Outliers The Pearson s correlation coefficient can be influenced by extreme values (outliers). Outliers are most easily identified from a scatter plot. If an outlier is suspected, calculate r with and without the outlier. If the results are very different, consider calculating the Spearman rank correlation coefficient instead. 29
30 Correlation measures the strength of any relationship between two continuous variables? 1. True 2. False
31 What is the direction of the association pictured in the scatter-plot below? 1. Positive 2. Negative 3. Cannot be determined. 3.
32 Which of the choices best describes the strength of the linear relationship pictured in the scatter-plot below? 1. Weak 2. Moderate 3. Strong 3.
33 Suppose more data is added to the original plot, what happens to the strength of the linear relationship? 1. Weaker 2. Stronger 3. Cannot be determined. 3.
34 Which of the choices best describes the strength of the linear relationship pictured in the scatter-plot below? 1. Weak 2. Moderate 3. Strong 3.
35 Suppose another piece data is added to the original plot, what happens to the strength of the linear relationship? 1. Weaker 2. Stronger 3. Cannot be determined 3.
36 Scatter-plot girls education vs. fertility rate. Source: Population Reference Bureau website: What is the general trend in this relationship?
37 What is the general trend in this relationship?? 1. Positive 2. Negative
38 Scatter-plot girls education vs. fertility rate. Source: Population Reference Bureau website: How strong is this linear relationship?
39 1. Weak How strong is this linear 2. Moderate relationship? 3. Moderately Strong 4. Extremely Strong
40 Scatter-plot girls education vs. fertility rate. Source: Population Reference Bureau website: Which location appears to not follow the linear relationship?
41 Which location appears to not follow the linear relationship? 1. Palestinian Territory 2. Czech Republic 3. Burkina Faso 4. Laos
42 Scatter-plot girls education vs. fertility rate. Source: Population Reference Bureau website: With what type of data can you create a scatter-plot?
43 With what type of data can you create a scatter-plot? 1. Two binary variables for each unit. 2. A continuous x and y for each unit. 3. An ordinal and a nominal variable for each unit. 4. Univariate Data
44 Spearman Rank Correlation (Spearman s Rho) Non-parametric: analysis methods that make no assumptions about the data distribution Spearman rank correlation is the appropriate correlation analysis to use when Both variables are ordinal data One variable is continuous and one is ordinal Continuous data is skewed due to outlier(s) 44
45 Spearman rank correlation Procedure Order the data values for each variable from lowest to highest Assign ranks for each variable (1 up to n) Use the ranks instead of the original data values in the formula for the correlation coefficient 45
46 Skewed Data due to outlier Pearson Correlation = With the outlier point (17,9) r = Without the outlier, r =
47 Original values and Rank values X Y X-rank Y-rank The smallest X value is given rank 1, the largest is given rank 7 Similarly, the smallest Y value is given rank 1, the largest is given rank 7 Other values are ranked according to their order. 47
48 Spearman s Rho: the Spearman rank correlation coefficient Ranked values of Y Spearman s Rho = Ranked values of X Ranking the values of X and Y removes the influence of the outlier Spearman s Rho is not as large as the Pearson s correlation coefficient for the original data (r = 0.44) and the outlier is not excluded from analysis. 48
49 Spearman rank correlation in Excel Excel does not have a function for Spearman rank correlation Use the RANK function to find the ordered rank for each value (separately for each variable) Use the CORREL function on the ranks. This will return the Spearman rank correlation coefficient (Spearman s Rho) 49
50 Reading and Assignments Reading: Chapter 3 pgs Lesson 4 Part 1 Practice Exercises Lesson 4 Excel Module Begin Homework 2: Problems 1 and 2 50
Lesson Part Relationships between two numerical variables Correlation Coefficient The correlation coefficient is a summary statistic that describes the linear between two numerical variables Relationship
Section 3 Part 1 Relationships between two numerical variables 1 Relationship between two variables The summary statistics covered in the previous lessons are appropriate for describing a single variable.
Spearman s correlation Introduction Before learning about Spearman s correllation it is important to understand Pearson s correlation which is a statistical measure of the strength of a linear relationship
Lesson 15 Linear Regression Lesson 15 Outline Review correlation analysis Dependent and Independent variables Least Squares Regression line Calculating l the slope Calculating the Intercept Residuals and
DESCRIPTIVE STATISTICS The purpose of statistics is to condense raw data to make it easier to answer specific questions; test hypotheses. DESCRIPTIVE VS. INFERENTIAL STATISTICS Descriptive To organize,
Pearson s correlation Introduction Often several quantitative variables are measured on each member of a sample. If we consider a pair of such variables, it is frequently of interest to establish if there
THE CORRELATION COEFFICIENT 1 More Statistical Notation Correlational analysis requires scores from two variables. X stands for the scores on one variable and Y stands for the scores on the other variable.
Unit 12: Correlation Summary of Video How much are identical twins alike and are these similarities due to genetics or to the environment in which the twins were raised? The Minnesota Twin Study, a classic
Slide 1 Section 14 Simple Linear Regression: Introduction to Least Squares Regression There are several different measures of statistical association used for understanding the quantitative relationship
CORRELATION AND REGRESSION / 47 CHAPTER EIGHT CORRELATION AND REGRESSION Correlation and regression are statistical methods that are commonly used in the medical literature to compare two or more variables.
5 Week Modular Course in Statistics & Probability Strand 1 Module 2 Analysing Data Numerically Measures of Central Tendency Mean Median Mode Measures of Spread Range Standard Deviation Inter-Quartile Range
Name: Score: / Homework 11 Part 1 null 1 For which of the following correlations would the data points be clustered most closely around a straight line? A. r = 0.50 B. r = -0.80 C. r = 0.10 D. There is
AMS7: WEEK 8. CLASS 1 Correlation Monday May 18th, 2015 Type of Data and objectives of the analysis Paired sample data (Bivariate data) Determine whether there is an association between two variables This
5 Week Modular Course in Statistics & Probability Strand 1 Module 2 Analysing Data Numerically Measures of Central Tendency Mean Median Mode Measures of Spread Range Standard Deviation Inter-Quartile Range
Using Statistical Data to Make Decisions Module 3: Correlation and Covariance Tom Ilvento Dr. Mugdim Pašiƒ University of Delaware Sarajevo Graduate School of Business O ften our interest in data analysis
Inferential Statistics Sampling and the normal distribution Z-scores Confidence levels and intervals Hypothesis testing Commonly used statistical methods Inferential Statistics Descriptive statistics are
Correlational Research Stephen E. Brock, Ph.D., NCSP California State University, Sacramento 1 Correlational Research A quantitative methodology used to determine whether, and to what degree, a relationship
Study Resources For Algebra I Unit 1C Analyzing Data Sets for Two Quantitative Variables This unit explores linear functions as they apply to data analysis of scatter plots. Information compiled and written
Correlation Greg C Elvers What Is Correlation? Correlation is a descriptive statistic that tells you if two variables are related to each other E.g. Is your related to how much you study? When two variables
9.2 Analyzing Scatter Plots Now that we know how to draw scatter plots, we need to know how to interpret them. A scatter plot graph can give us lots of important information about how data sets are related
7. Tests of association and Linear Regression In this chapter we consider 1. Tests of Association for 2 qualitative variables. 2. Measures of the strength of linear association between 2 quantitative variables.
Lecture 11: Chapter 5, Section 3 Relationships between Two Quantitative Variables; Correlation Display and Summarize Correlation for Direction and Strength Properties of Correlation Regression Line Cengage
Scatter Plot, Regression Line, Linear Correlation Coefficient, and Coefficient of Determination What is a Scatter Plot? A Scatter Plot is a plot of ordered pairs (x, y) where the horizontal axis is used
PS 511: Advanced Statistics for Psychological and Behavioral Research 1 Both examine linear (straight line) relationships Correlation works with a pair of scores One score on each of two variables ( and
Unit 9 Describing Relationships in Scatter Plots and Line Graphs Objectives: To construct and interpret a scatter plot or line graph for two quantitative variables To recognize linear relationships, non-linear
Two-Variable Quantitative Data: Lesson Summary with Examples Bivariate data involves two quantitative variables and deals with relationships between those variables. By plotting bivariate data as ordered
Statistics: Correlation Richard Buxton. 2008. 1 Introduction We are often interested in the relationship between two variables. Do people with more years of full-time education earn higher salaries? Do
Numerical Summarization of Data OPRE 6301 Motivation... In the previous session, we used graphical techniques to describe data. For example: While this histogram provides useful insight, other interesting
Correlational research is used to describe the relationship between two or more naturally occurring variables. Is age related to political conservativism? Are highly extraverted people less afraid of rejection
Using SAS to Analyze Data Nadia Akseer MSc. Candidate Brock University Agenda a. Examine Individual Variable Distributions i. Continuous data: ii. Proc Univariate distributions, tests for normality, plots
Chapter 3 Student Lecture Notes 3- Chapter 3 Introduction to Linear Regression and Correlation Analsis Fall 2006 Fundamentals of Business Statistics Chapter Goals To understand the methods for displaing
1 Linear Regression 1.1 Simple Linear Regression Model The linear regression model is applied if we want to model a numeric response variable and its dependency on at least one numeric factor variable.
Individuals: The objects that are described by a set of data. They may be people, animals, things, etc. (Also referred to as Cases or Records) Variables: The characteristics recorded about each individual.
Using Excel to Solve Business Problems: Simple Predictive Analytics Curtis Seare Copyright: Vault Analytics July 2010 Contents Section I: Background Information Why use Predictive Analytics? How to use
Multiple regression Introduction Multiple regression is a logical extension of the principles of simple linear regression to situations in which there are several predictor variables. For instance if we
CALCULATIONS & STATISTICS CALCULATION OF SCORES Conversion of 1-5 scale to 0-100 scores When you look at your report, you will notice that the scores are reported on a 0-100 scale, even though respondents
Correlations MSc Module 6: Introduction to Quantitative Research Methods Kenneth Benoit March 18, 2010 Relationships between variables In previous weeks, we have been concerned with describing variables
Chapter 2: Looking at Data Relationships (Part 1) Dr. Nahid Sultana Chapter 2: Looking at Data Relationships 2.1: Scatterplots 2.2: Correlation 2.3: Least-Squares Regression 2.5: Data Analysis for Two-Way
Introduction to Quantitative Methods October 15, 2009 Contents 1 Definition of Key Terms 2 2 Descriptive Statistics 3 2.1 Frequency Tables......................... 4 2.2 Measures of Central Tendencies.................
Describing Relationships between Two Variables Up until now, we have dealt, for the most part, with just one variable at a time. This variable, when measured on many different subjects or objects, took
Chapter 3 Descriptive Statistics: Numerical Measures Slide 1 Learning objectives 1. Single variable Part I (Basic) 1.1. How to calculate and use the measures of location 1.. How to calculate and use the
AP * Statistics Review Linear Regression Teacher Packet Advanced Placement and AP are registered trademark of the College Entrance Examination Board. The College Board was not involved in the production
Appendix D Basic Measurement And Statistics The following information was developed by Steven Rothke, PhD, Department of Psychology, Rehabilitation Institute of Chicago (RIC) and expanded by Mary F. Schmidt,
Descriptive Statistics Primer Descriptive statistics Central tendency Variation Relative position Relationships Calculating descriptive statistics Descriptive Statistics Purpose to describe or summarize
You have learnt in previous chapter that organising and presenting data makes them comprehensible. It facilitates data processing. A number of statistical techniques are used to analyse the data. In this
4. Describing Bivariate Data A. Introduction to Bivariate Data B. Values of the Pearson Correlation C. Properties of Pearson's r D. Computing Pearson's r E. Variance Sum Law II F. Exercises A dataset with
PholC60 September 001 DATA INTERPRETATION AND STATISTICS Books A easy and systematic introductory text is Essentials of Medical Statistics by Betty Kirkwood, published by Blackwell at about 14. DESCRIPTIVE
Statistics for Sports Medicine Suzanne Hecht, MD University of Minnesota (email@example.com) Fellow s Research Conference July 2012: Philadelphia GOALS Try not to bore you to death!! Try to teach
Readings: Ha and Ha Textbook - Chapters 1 8 Appendix D & E (online) Plous - Chapters 10, 11, 12 and 14 Chapter 10: The Representativeness Heuristic Chapter 11: The Availability Heuristic Chapter 12: Probability
Regression Analysis Using JMP Yiming Peng, Department of Statistics February 12, 2013 2 Presentation and Data http://www.lisa.stat.vt.edu Short Courses Regression Analysis Using JMP Download Data to Desktop
Simple linear regression Introduction Simple linear regression is a statistical method for obtaining a formula to predict values of one variable from another where there is a causal relationship between
Statistics Quiz Correlation and Regression -- ANSWERS 1. Temperature and air pollution are known to be correlated. We collect data from two laboratories, in Boston and Montreal. Boston makes their measurements
How to choose a statistical test Francisco J. Candido dos Reis DGO-FMRP University of São Paulo Choosing the right test One of the most common queries in stats support is Which analysis should I use There
Statistics Measurement Measurement is defined as a set of rules for assigning numbers to represent objects, traits, attributes, or behaviors A variableis something that varies (eye color), a constant does
The Correlation Coefficient Lelys Bravo de Guenni April 22nd, 2015 Outline The Correlation coefficient Positive Correlation Negative Correlation Properties of the Correlation Coefficient Non-linear association
Figure 9-6 Example: Boats and Manatees Slide 1 Given the sample data in Table 9-1, find the value of the linear correlation coefficient r, then refer to Table A-6 to determine whether there is a significant
Session 7 Bivariate Data and Analysis Key Terms for This Session Previously Introduced mean standard deviation New in This Session association bivariate analysis contingency table co-variation least squares
A continuation of regression analysis Lesson Objectives Continue to build on regression analysis. Learn how residual plots help identify problems with the analysis. M23-1 M23-2 Example 1: continued Case
GCSE Statistics Revision notes Collecting data Sample This is when data is collected from part of the population. There are different methods for sampling Random sampling, Stratified sampling, Systematic
KY San Jose State University Engineering 10 1 Select Insert from the main menu Plotting in Excel Select All Chart Types San Jose State University Engineering 10 2 Definition: A chart that consists of multiple
Review MULTIPLE CHOICE. Choose the one alternative that best completes the statement or answers the question. 1) All but one of these statements contain a mistake. Which could be true? A) There is a correlation
Linear Regression Chapter 5 Regression Objective: To quantify the linear relationship between an explanatory variable (x) and response variable (y). We can then predict the average response for all subjects
1. p. 175, Question 32 (Modules 10.1-10.4) [Learning Objectives J1, J3, J9, J11-14, J17] Since 1980, average mortgage rates have fluctuated from a low of under 6% to a high of over 14%. Is there a relationship
1 SPSS Multivariable Linear Models and Logistic Regression Multivariable Models Single continuous outcome (dependent variable), one main exposure (independent) variable, and one or more potential confounders
GCSE HIGHER Statistics Key Facts Collecting Data When writing questions for questionnaires, always ensure that: 1. the question is worded so that it will allow the recipient to give you the information
Univariate Regression Correlation and Regression The regression line summarizes the linear relationship between 2 variables Correlation coefficient, r, measures strength of relationship: the closer r is
AP Statistics Semester Exam Review Chapters 1-3 1. Here are the IQ test scores of 10 randomly chosen fifth-grade students: 145 139 126 122 125 130 96 110 118 118 To make a stemplot of these scores, you
Class 6: Chapter 12 Correlational Designs l 1 Key Ideas Explanatory and predictor designs Characteristics of correlational research Scatterplots and calculating associations Steps in conducting a correlational
STATS8: Introduction to Biostatistics Data Exploration Babak Shahbaba Department of Statistics, UCI Introduction After clearly defining the scientific problem, selecting a set of representative members
Dale Berger SPSS Step-by-Step Regression Introduction: MRC01 This step-by-step example shows how to enter data into SPSS and conduct a simple regression analysis to develop an equation to predict from.
Mind on Statistics Chapter 3 Section 3.1 1. Which one of the following is not appropriate for studying the relationship between two quantitative variables? A. Scatterplot B. Bar chart C. Correlation D.
Chapter 807 Point Biserial Correlation Tests Introduction The point biserial correlation coefficient (ρ in this chapter) is the product-moment correlation calculated between a continuous random variable
FACT SHEET Using Excel for inferential statistics Introduction When you collect data, you expect a certain amount of variation, just caused by chance. A wide variety of statistical tests can be applied
Mgt 540 Research Methods Data Analysis 1 Additional sources Compilation of sources: http://lrs.ed.uiuc.edu/tseportal/datacollectionmethodologies/jin-tselink/tselink.htm http://web.utk.edu/~dap/random/order/start.htm
Statistical Significance and Bivariate Tests BUS 735: Business Decision Making and Research 1 1.1 Goals Goals Specific goals: Re-familiarize ourselves with basic statistics ideas: sampling distributions,
Module 9: Nonparametric Tests The Applied Research Center Module 9 Overview } Nonparametric Tests } Parametric vs. Nonparametric Tests } Restrictions of Nonparametric Tests } One-Sample Chi-Square Test
Chapter 9 Section 9.1 - Correlation Objectives: Introduce linear correlation, independent and dependent variables, and the types of correlation Find a correlation coefficient Test a population correlation
24 Chapter 2. Describing, Exploring, and Comparing Data Chapter 2. Describing, Exploring, and Comparing Data There are many tools used in Statistics to visualize, summarize, and describe data. This chapter
Unit 21 Student s t Distribution in Hypotheses Testing Objectives: To understand the difference between the standard normal distribution and the Student's t distributions To understand the difference between
Research Skills One, Correlation interpretation, Graham Hole v.1.0. Page 1 Eight things you need to know about interpreting correlations: A correlation coefficient is a single number that represents the
Content DESCRIPTIVE STATISTICS Dr Najib Majdi bin Yaacob MD, MPH, DrPH (Epidemiology) USM Unit of Biostatistics & Research Methodology School of Medical Sciences Universiti Sains Malaysia. Introduction