CHAPTER 13 SIMPLE LINEAR REGRESSION. Opening Example. Simple Regression. Linear Regression


 Tiffany York
 3 years ago
 Views:
Transcription
1 Opening Example CHAPTER 13 SIMPLE LINEAR REGREION SIMPLE LINEAR REGREION! Simple Regression! Linear Regression Simple Regression Definition A regression model is a mathematical equation that descries the relationship etween two or more variales. A simple regression model includes only two variales: one independent and one dependent. The dependent variale is the one eing explained, and the independent variale is the one used to explain the variation in the dependent variale. Linear Regression Definition A (simple) regression model that gives a straightline relationship etween two variales is called a linear regression model. Figure 13.1 Relationship etween food expenditure and income. (a) Linear relationship. () Nonlinear relationship.
2 Figure 13. Plotting a linear equation. Figure 13.3 yintercept and slope of a line. SIMPLE LINEAR REGREION ANALYSIS SIMPLE LINEAR REGREION ANALYSIS Definition In the regression model y = A + Bx + ε, A is called the y intercept or constant term, B is the slope, and ε is the random error term. The dependent and independent variales are y and x, respectively. SIMPLE LINEAR REGREION ANALYSIS Definition In the model ŷ = a + x, a and, which are calculated using sample data, are called the estimates of A and B, respectively. Tale 13.1 Incomes (in hundreds of dollars) and Food Expenditures of Seven Households
3 Scatter Diagram Definition A plot of paired oservations is called a scatter diagram. Figure 13.4 Scatter diagram. Figure 13.5 Scatter diagram and straight lines. Figure 13.6 Regression Line and random errors. Error Sum of Squares (E) The error sum of squares, denoted E, is E = e = ( y yˆ ) The values of a and that give the minimum E are called the least square estimates of A and B, and the regression line otained with these estimates is called the least squares line. The Least Squares Line For the least squares regression line ŷ = a + x, where xy = and a = y x ( x)( y) ( x) x xy = xy and = n and stands for sum of squares. The least squares regression line ŷ = a + x is also called the regression of y on x. n
4 Example 131 Find the least squares regression line for the data on incomes and food expenditure on the seven households given in the Tale Use income as an independent variale and food expenditure as a dependent variale. Tale 13. Example 131: Solution x = 386 y = 108 x = x/ n = 386 / 7 = y = y / n = 108 / 7 = Example 131: Solution ( x)( y) (386)(108) xy = xy = 6403 = n 7 ( ) x (386) = x = 3,058 = n 7 Example 131: Solution Figure 13.7 Error of prediction. xy = = = a = y x = (.55)(55.149) = Thus, our estimated regression model is ŷ = x
5 Interpretation of a and Interpretation of a! Consider a household with zero income. Using the estimated regression line otained in Example 131, " ŷ = (0) = $ hundred.! Thus, we can state that a household with no income is expected to spend $ per month on food.! The regression line is valid only for the values of x etween 33 and 83. Interpretation of a and Interpretation of! The value of in the regression model gives the change in y (dependent variale) due to a change of one unit in x (independent variale).! We can state that, on average, a $100 (or $1) increase in income of a household will increase the food expenditure y $5.5 (or $.55). Figure 13.8 Positive and negative linear relationships etween x and y. Case Study 131 Regression of Weights on Heights for NFL Players Case Study 131 Regression of Weights on Heights for NFL Players Assumptions of the Regression Model Assumption 1: The random error term Є has a mean equal to zero for each x Assumption : The errors associated with different oservations are independent Assumption 3: For any given x, the distriution of errors is normal Assumption 4: The distriution of population errors for each x has the same (constant) standard deviation, which is denoted σ Є
6 Figure (a) Errors for households with an income of $4000 per month. Figure () Errors for households with an income of $ 7500 per month. Figure 13.1 Distriution of errors around the population regression line. Figure Nonlinear relations etween x and y. STANDARD DEVIATION OF ERRORS AND COEFFICIENT OF DETERMINATION Degrees of Freedom for a Simple Linear Regression Model The degrees of freedom for a simple linear regression model are df = n Figure Spread of errors for x = 40 and x = 75.
7 STANDARD DEVIATION OF ERRORS AND COEFFICIENT OF DETERMINATION The standard deviation of errors is calculated as where s e = n xy Example 13 Compute the standard deviation of errors s e for the data on monthly incomes and food expenditures of the seven households given in Tale ( y ) = y n Tale 13.3 Example 13: Solution ( y ) (108) = y = 179 = n 7 xy ( ) se = = n 7 COEFFICIENT OF DETERMINATION Total Sum of Squares (T) The total sum of squares, denoted y T, is calculated as ( ) T = y n y Figure Total errors. Note that this is the same formula that we used to calculate.
8 Tale 13.4 Figure Errors of prediction when regression model is used. COEFFICIENT OF DETERMINATION Regression Sum of Squares (R) The regression sum of squares, denoted y R, is R = T E COEFFICIENT OF DETERMINATION Coefficient of Determination The coefficient of determination, denoted y r, represents the proportion of T that is explained y the use of the regression model. The computational formula for r is r = xy and 0 r 1 Example 133 For the data of Tale 13.1 on monthly incomes and food expenditures of seven households, calculate the coefficient of determination. Example 133: Solution! From earlier calculations made in Examples 131 and 13,! =.55, = , = xy (.55)( ) r = = =
9 INFERENCES ABOUT B! Sampling Distriution of! Estimation of B! Hypothesis Testing Aout B Sampling Distriution of Mean, Standard Deviation, and Sampling Distriution of Because of the assumption of normally distriuted random errors, the sampling distriution of is normal. The mean and standard deviation of, denoted y µ and, respectively, σ are σ µ = B and σ = Estimation of B Confidence Interval for B The (1 α)100% confidence interval for B is given y ± ts Example 134 Construct a 95% confidence interval for B for the data on incomes and food expenditures of seven households given in Tale where s = s e and the value of t is otained from the t distriution tale for α α / area in the right tail of the t distriution and n degrees of freedom. Example 134: Solution s se = = = df = n = 7 = 5 α / = (1.95) / =.05 t =.571 ± ts =.55 ±.571(.0379) =.55 ±.0974 =.155 to.350 Hypothesis Testing Aout B Test Statistic for The value of the test statistic t for is calculated as B t = s The value of B is sustituted from the null hypothesis.
10 Example 135 Test at the 1% significance level whether the slope of the regression line for the example on incomes and food expenditures of seven households is positive. Example 135: Solution! Step 1: H 0 : B = 0 (The slope is zero) H 1 : B > 0 (The slope is positive)! Step : σ is not known Hence, we will use the t distriution to make the test aout B. Example 135: Solution! Step 3: α =.01 Area in the right tail = α =.01 df = n = 7 = 5 The critical value of t is Figure Example 135: Solution # Step 4: From H 0 B.55 0 t = = = 6.66 s.0379 Example 135: Solution! Step 5: The value of the test statistic t = 6.66 " It is greater than the critical value of t = " It falls in the rejection region Hence, we reject the null hypothesis We conclude that x (income) determines y (food expenditure) positively.
11 LINEAR CORRELATION! Linear Correlation Coefficient! Hypothesis Testing Aout the Linear Correlation Coefficient Linear Correlation Coefficient Value of the Correlation Coefficient The value of the correlation coefficient always lies in the range of 1 to 1; that is, 1 ρ 1 and 1 r 1 Figure Linear correlation etween two variales. (a) Perfect positive linear correlation, r = 1 Figure Linear correlation etween two variales. () Perfect negative linear correlation, r = 1 Copyright 013 John Wiley x & Sons. All rights reserved. Copyright 013 John Wiley x & Sons. All rights reserved. Figure Linear correlation etween two variales. Figure Linear correlation etween variales. (c) No linear correlation,, r 0 Copyright 013 John Wiley x & Sons. All rights reserved.
12 Figure Linear correlation etween variales. Figure Linear correlation etween variales. Figure Linear correlation etween variales. Linear Correlation Coefficient Linear Correlation Coefficient The simple linear correlation coefficient, denoted y r, measures the strength of the linear relationship etween two variales for a sample and is calculated as r = xy Example 136 Calculate the correlation coefficient for the example on incomes and food expenditures of seven households. Example 136: Solution r = xy = =.95 ( )( )
13 Hypothesis Testing Aout the Linear Correlation Coefficient Test Statistic for r If oth variales are normally distriuted and the null hypothesis is H 0 : ρ = 0, then the value of the test statistic t is calculated as t = r n 1 r Example 137 Using the 1% level of significance and the data from Example 131, test whether the linear correlation coefficient etween incomes and food expenditures is positive. Assume that the populations of oth variales are normally distriuted. Here n are the degrees of freedom. Example 137: Solution! Step 1: H 0 : ρ = 0 (The linear correlation coefficient is zero) H 1 : ρ > 0 (The linear correlation coefficient is positive)! Step : The population distriutions for oth variales are normally distriuted. Hence, we can use the t distriution to perform this test aout the linear correlation coefficient. Example 137: Solution! Step 3: Area in the right tail =.01 df = n = 7 = 5 The critical value of t = Figure 13.0 Example 137: Solution # Step 4:!=" % #/$ " # =.&'($ ) #/$ (.&'($ ) # =6.667
14 Example 137: Solution! Step 5: The value of the test statistic t = " It is greater than the critical value of t=3.365 " It falls in the rejection region Hence, we reject the null hypothesis. REGREION ANALYSIS: A COMPLETE Example 138 A random sample of eight drivers selected from a small city insured with a company and having similar minimum required auto insurance policies was selected. The following tale lists their driving experiences (in years) and monthly auto insurance premiums (in dollars). We conclude that there is a positive relationship etween incomes and food expenditures. Example 138 Example 138 (a) Does the insurance premium depend on the driving experience or does the driving experience depend on the insurance premium? Do you expect a positive or a negative relationship etween these two variales? () Compute,, and xy. (c) Find the least squares regression line y choosing appropriate dependent and independent variales ased on your answer in part a. (d) Interpret the meaning of the values of a and calculated in part c. Example 138 (e) Plot the scatter diagram and the regression line. (f) Calculate r and r and explain what they mean. (g) Predict the monthly auto insurance for a driver with 10 years of driving experience. (h) Compute the standard deviation of errors. (i) Construct a 90% confidence interval for B. (j) Test at the 5% significance level whether B is negative. (k) Using α =.05, test whether ρ is different from zero. (a) Based on theory and intuition, we expect the insurance premium to depend on driving experience. " The insurance premium is a dependent variale " The driving experience is an independent variale
15 Tale 13.5 () x = x/ n = 90/8= 11.5 y = y/ n = 474/8= 59.5 xy ( x)( y) (90)(474) = xy = 4739 = n 8 ( x) (90) 1396 n ( y ) (474) 9,64 n = x = = = y = = (c) xy = = = a = y x = 59.5 ( )(11.5) = (d) The value of a = gives the value of ŷ for x = 0; that is, it gives the monthly auto insurance premium for a driver with no driving experience. The value of = indicates that, on average, for every extra year of driving experience, the monthly auto insurance premium decreases y $1.55. ŷ=)../ $./')) Figure 13.1 Scatter diagram and the regression line. (e) The regression line slopes downward from left to right. (f) xy r = = =.77 ( )( ) r xy ( )( ) = = =
16 (f) The value of r = indicates that the driving experience and the monthly auto insurance premium are negatively related. The (linear) relationship is strong ut not very strong. The value of r² = 0.59 states that 59% of the total variation in insurance premiums is explained y years of driving experience and 41% is not. (g) Using the estimated regression line, we find the predicted value of y for x = 10 is ŷ = (10) = $61.18 Thus, we expect the monthly auto insurance premium of a driver with 10 years of driving experience to e $ (h) s e = n xy ( )( ) = 8 = (i) se s = = = α / =.5 (.90/) =.05 df = n = 8 = 6 t = ± ts = ± 1.943(.570) = ± =.57 to.5 (j)! Step 1: H 0 : B = 0 (B is not negative) H 1 : B < 0 (B is negative)! Step 3: Area in the left tail = α =.05 df = n = 8 = 6 The critical value of t is ! Step : Because the standard deviation of the error is not known, we use the t distriution to make the hypothesis test
17 Figure 13. # Step 4: From H 0 B t = = =.937 s.570! Step 5: The value of the test statistic t = " It falls in the rejection region Hence, we reject the null hypothesis and conclude that B is negative. (k)! Step 1: H 0 : ρ = 0 (The linear correlation coefficient is zero) H 1 : ρ 0 (The linear correlation coefficient is different from zero) The monthly auto insurance premium decreases with an increase in years of driving experience.! Step : Assuming that variales x and y are normally distriuted, we will use the t distriution to perform this test aout the linear correlation coefficient. Figure 13.3! Step 3: Area in each tail =.05/ =.05 df = n = 8 = 6 The critical values of t are and.447
18 # Step 4: *=" % #/$ " # =.))& ( #/$ (.))) # = .936! Step 5: The value of the test statistic t = " It falls in the rejection region Hence, we reject the null hypothesis We conclude that the linear correlation coefficient etween driving experience and auto insurance premium is different from zero. USING THE REGREION MODEL! Using the Regression Model for Estimating the Mean Value of y! Using the Regression Model for Predicting a Particular Value of y Figure 13.4 Population and sample regression lines. Using the Regression Model for Estimating the Mean Value of y Confidence Interval for µ y x The (1 α)100% confidence interval for µ y x for x = x 0 is ˆ y ± t s ym ˆ where the value of t is otained from the t distriution tale for α/ area in the right tail of the t distriution curve and df = n. Using the Regression Model for Estimating the Mean Value of y Confidence Interval for µ y x The value of s y is calculated as follows: s ˆm 1 ( x0 x) = s + n yˆ m e
19 Example 139 Refer to Example 131 on incomes and food expenditures. Find a 99% confidence interval for the mean food expenditure for all households with a monthly income of $5500. Example 139: Solution! Using the regression line estimated in Example 131, we find the point estimate of the mean food expenditure for x = 55 " ŷ = (55) = $ hundred! Area in each tail = α/ = (1.99)/ =.005! df = n = 7 = 5! t = 4.03 Example 139: Solution s = , x = , and = S e yˆ m 1 ( x0 x) = se + n 1 ( ) = (1.5939) + = Example 139: Solution Hence, the 99% confidence interval for µ yˆ ± ts = ± 4.03(.605) yˆ m y 55 = ±.493 = to is Using the Regression Model for Predicting a Particular Value of y Prediction Interval for y p The (1 α)100% prediction interval for the predicted value of y, denoted y y p, for x = x 0 is ˆ y ± t s y ˆ p Using the Regression Model for Predicting a Particular Value of y Prediction Interval for y p where the value of t is otained from the t distriution tale for α/ area in the right tail of the t distriution curve and df = n. The value of s s y ˆ p yˆ p e is calculated as follows: 1 ( x0 x) = s 1+ + n
20 Example Refer to Example 131 on incomes and food expenditures. Find a 99% prediction interval for the predicted food expenditure for a randomly selected household with a monthly income of $5500. Example 1310: Solution! Using the regression line estimated in Example 131, we find the point estimate of the predicted food expenditure for x = 55 " ŷ = (55) = $ hundred! Area in each tail = α/ = (1.99)/ =.005! df = n = 7 = 5! t = 4.03 Example 1310: Solution Example 1310: Solution s = , x = , and = S e yˆ p 1 ( x0 x) = se 1+ + n 1 ( ) = (1.5939) 1+ + = Hence, the 99% prediction interval for y for x = 55 is yˆ ± t s = ± 4.03(1.7040) ŷ p = ± = 8.50 to.630 p TI84 TI84
21 Minita Excel Excel Excel Excel
Regression Analysis: A Complete Example
Regression Analysis: A Complete Example This section works out an example that includes all the topics we have discussed so far in this chapter. A complete example of regression analysis. PhotoDisc, Inc./Getty
More informationAMS7: WEEK 8. CLASS 1. Correlation Monday May 18th, 2015
AMS7: WEEK 8. CLASS 1 Correlation Monday May 18th, 2015 Type of Data and objectives of the analysis Paired sample data (Bivariate data) Determine whether there is an association between two variables This
More informationSimple Linear Regression Chapter 11
Simple Linear Regression Chapter 11 Rationale Frequently decisionmaking situations require modeling of relationships among business variables. For instance, the amount of sale of a product may be related
More informatione = random error, assumed to be normally distributed with mean 0 and standard deviation σ
1 Linear Regression 1.1 Simple Linear Regression Model The linear regression model is applied if we want to model a numeric response variable and its dependency on at least one numeric factor variable.
More informationA correlation exists between two variables when one of them is related to the other in some way.
Lecture #10 Chapter 10 Correlation and Regression The main focus of this chapter is to form inferences based on sample data that come in pairs. Given such paired sample data, we want to determine whether
More informationChapter 9. Section Correlation
Chapter 9 Section 9.1  Correlation Objectives: Introduce linear correlation, independent and dependent variables, and the types of correlation Find a correlation coefficient Test a population correlation
More informationChapter 11: Two Variable Regression Analysis
Department of Mathematics Izmir University of Economics Week 1415 20142015 In this chapter, we will focus on linear models and extend our analysis to relationships between variables, the definitions
More informationFactors affecting online sales
Factors affecting online sales Table of contents Summary... 1 Research questions... 1 The dataset... 2 Descriptive statistics: The exploratory stage... 3 Confidence intervals... 4 Hypothesis tests... 4
More informationElementary Statistics. Scatter Plot, Regression Line, Linear Correlation Coefficient, and Coefficient of Determination
Scatter Plot, Regression Line, Linear Correlation Coefficient, and Coefficient of Determination What is a Scatter Plot? A Scatter Plot is a plot of ordered pairs (x, y) where the horizontal axis is used
More informationwhere b is the slope of the line and a is the intercept i.e. where the line cuts the y axis.
Least Squares Introduction We have mentioned that one should not always conclude that because two variables are correlated that one variable is causing the other to behave a certain way. However, sometimes
More informationChapter 7: Simple linear regression Learning Objectives
Chapter 7: Simple linear regression Learning Objectives Reading: Section 7.1 of OpenIntro Statistics Video: Correlation vs. causation, YouTube (2:19) Video: Intro to Linear Regression, YouTube (5:18) 
More informationChapter 13 Introduction to Linear Regression and Correlation Analysis
Chapter 3 Student Lecture Notes 3 Chapter 3 Introduction to Linear Regression and Correlation Analsis Fall 2006 Fundamentals of Business Statistics Chapter Goals To understand the methods for displaing
More informationRegression. Name: Class: Date: Multiple Choice Identify the choice that best completes the statement or answers the question.
Class: Date: Regression Multiple Choice Identify the choice that best completes the statement or answers the question. 1. Given the least squares regression line y8 = 5 2x: a. the relationship between
More informationSimple Linear Regression
Inference for Regression Simple Linear Regression IPS Chapter 10.1 2009 W.H. Freeman and Company Objectives (IPS Chapter 10.1) Simple linear regression Statistical model for linear regression Estimating
More information2. Simple Linear Regression
Research methods  II 3 2. Simple Linear Regression Simple linear regression is a technique in parametric statistics that is commonly used for analyzing mean response of a variable Y which changes according
More informationUnit 31 A Hypothesis Test about Correlation and Slope in a Simple Linear Regression
Unit 31 A Hypothesis Test about Correlation and Slope in a Simple Linear Regression Objectives: To perform a hypothesis test concerning the slope of a least squares line To recognize that testing for a
More informationNonLinear Regression 20062008 Samuel L. Baker
NONLINEAR REGRESSION 1 NonLinear Regression 20062008 Samuel L. Baker The linear least squares method that you have een using fits a straight line or a flat plane to a unch of data points. Sometimes
More informationMultiple Regression in SPSS STAT 314
Multiple Regression in SPSS STAT 314 I. The accompanying data is on y = profit margin of savings and loan companies in a given year, x 1 = net revenues in that year, and x 2 = number of savings and loan
More informationInferential Statistics
Inferential Statistics Sampling and the normal distribution Zscores Confidence levels and intervals Hypothesis testing Commonly used statistical methods Inferential Statistics Descriptive statistics are
More information2013 MBA Jump Start Program. Statistics Module Part 3
2013 MBA Jump Start Program Module 1: Statistics Thomas Gilbert Part 3 Statistics Module Part 3 Hypothesis Testing (Inference) Regressions 2 1 Making an Investment Decision A researcher in your firm just
More information17. SIMPLE LINEAR REGRESSION II
17. SIMPLE LINEAR REGRESSION II The Model In linear regression analysis, we assume that the relationship between X and Y is linear. This does not mean, however, that Y can be perfectly predicted from X.
More informationSELFTEST: SIMPLE REGRESSION
ECO 22000 McRAE SELFTEST: SIMPLE REGRESSION Note: Those questions indicated with an (N) are unlikely to appear in this form on an inclass examination, but you should be able to describe the procedures
More informationRegression and Correlation
Regression and Correlation Topics Covered: Dependent and independent variables. Scatter diagram. Correlation coefficient. Linear Regression line. by Dr.I.Namestnikova 1 Introduction Regression analysis
More informationExample: Boats and Manatees
Figure 96 Example: Boats and Manatees Slide 1 Given the sample data in Table 91, find the value of the linear correlation coefficient r, then refer to Table A6 to determine whether there is a significant
More information1. What is the critical value for this 95% confidence interval? CV = z.025 = invnorm(0.025) = 1.96
1 Final Review 2 Review 2.1 CI 1propZint Scenario 1 A TV manufacturer claims in its warranty brochure that in the past not more than 10 percent of its TV sets needed any repair during the first two years
More informationStatistics for Management IISTAT 362Final Review
Statistics for Management IISTAT 362Final Review Multiple Choice Identify the letter of the choice that best completes the statement or answers the question. 1. The ability of an interval estimate to
More informationSimple Linear Regression in SPSS STAT 314
Simple Linear Regression in SPSS STAT 314 1. Ten Corvettes between 1 and 6 years old were randomly selected from last year s sales records in Virginia Beach, Virginia. The following data were obtained,
More informationThe correlation coefficient
The correlation coefficient Clinical Biostatistics The correlation coefficient Martin Bland Correlation coefficients are used to measure the of the relationship or association between two quantitative
More informationCorrelation key concepts:
CORRELATION Correlation key concepts: Types of correlation Methods of studying correlation a) Scatter diagram b) Karl pearson s coefficient of correlation c) Spearman s Rank correlation coefficient d)
More informationE205 Final: Version B
Name: Class: Date: E205 Final: Version B Multiple Choice Identify the choice that best completes the statement or answers the question. 1. The owner of a local nightclub has recently surveyed a random
More informationLesson Lesson Outline Outline
Lesson 15 Linear Regression Lesson 15 Outline Review correlation analysis Dependent and Independent variables Least Squares Regression line Calculating l the slope Calculating the Intercept Residuals and
More informationChapter 11: Linear Regression  Inference in Regression Analysis  Part 2
Chapter 11: Linear Regression  Inference in Regression Analysis  Part 2 Note: Whether we calculate confidence intervals or perform hypothesis tests we need the distribution of the statistic we will use.
More information" Y. Notation and Equations for Regression Lecture 11/4. Notation:
Notation: Notation and Equations for Regression Lecture 11/4 m: The number of predictor variables in a regression Xi: One of multiple predictor variables. The subscript i represents any number from 1 through
More informationX X X a) perfect linear correlation b) no correlation c) positive correlation (r = 1) (r = 0) (0 < r < 1)
CORRELATION AND REGRESSION / 47 CHAPTER EIGHT CORRELATION AND REGRESSION Correlation and regression are statistical methods that are commonly used in the medical literature to compare two or more variables.
More informationSimple Linear Regression Inference
Simple Linear Regression Inference 1 Inference requirements The Normality assumption of the stochastic term e is needed for inference even if it is not a OLS requirement. Therefore we have: Interpretation
More informationA Primer on Forecasting Business Performance
A Primer on Forecasting Business Performance There are two common approaches to forecasting: qualitative and quantitative. Qualitative forecasting methods are important when historical data is not available.
More informationDATA INTERPRETATION AND STATISTICS
PholC60 September 001 DATA INTERPRETATION AND STATISTICS Books A easy and systematic introductory text is Essentials of Medical Statistics by Betty Kirkwood, published by Blackwell at about 14. DESCRIPTIVE
More informationUsing R for Linear Regression
Using R for Linear Regression In the following handout words and symbols in bold are R functions and words and symbols in italics are entries supplied by the user; underlined words and symbols are optional
More informationBIOSTATISTICS QUIZ ANSWERS
BIOSTATISTICS QUIZ ANSWERS 1. When you read scientific literature, do you know whether the statistical tests that were used were appropriate and why they were used? a. Always b. Mostly c. Rarely d. Never
More information0.1 Multiple Regression Models
0.1 Multiple Regression Models We will introduce the multiple Regression model as a mean of relating one numerical response variable y to two or more independent (or predictor variables. We will see different
More informationStatistics II Final Exam  January Use the University stationery to give your answers to the following questions.
Statistics II Final Exam  January 2012 Use the University stationery to give your answers to the following questions. Do not forget to write down your name and class group in each page. Indicate clearly
More informationSimple linear regression
Simple linear regression Introduction Simple linear regression is a statistical method for obtaining a formula to predict values of one variable from another where there is a causal relationship between
More informationNCSS Statistical Software Principal Components Regression. In ordinary least squares, the regression coefficients are estimated using the formula ( )
Chapter 340 Principal Components Regression Introduction is a technique for analyzing multiple regression data that suffer from multicollinearity. When multicollinearity occurs, least squares estimates
More informationSimple Regression Theory II 2010 Samuel L. Baker
SIMPLE REGRESSION THEORY II 1 Simple Regression Theory II 2010 Samuel L. Baker Assessing how good the regression equation is likely to be Assignment 1A gets into drawing inferences about how close the
More information12/31/2016. PSY 512: Advanced Statistics for Psychological and Behavioral Research 2
PSY 512: Advanced Statistics for Psychological and Behavioral Research 2 Understand linear regression with a single predictor Understand how we assess the fit of a regression model Total Sum of Squares
More information1) Write the following as an algebraic expression using x as the variable: Triple a number subtracted from the number
1) Write the following as an algebraic expression using x as the variable: Triple a number subtracted from the number A. 3(x  x) B. x 3 x C. 3x  x D. x  3x 2) Write the following as an algebraic expression
More informationChapter 12 : Linear Correlation and Linear Regression
Number of Faculty Chapter 12 : Linear Correlation and Linear Regression Determining whether a linear relationship exists between two quantitative variables, and modeling the relationship with a line, if
More informationLecture 5: Correlation and Linear Regression
Lecture 5: Correlation and Linear Regression 3.5. (Pearson) correlation coefficient The correlation coefficient measures the strength of the linear relationship between two variables. The correlation is
More informationThe Big Picture. Correlation. Scatter Plots. Data
The Big Picture Correlation Bret Hanlon and Bret Larget Department of Statistics Universit of Wisconsin Madison December 6, We have just completed a length series of lectures on ANOVA where we considered
More informationAugust 2012 EXAMINATIONS Solution Part I
August 01 EXAMINATIONS Solution Part I (1) In a random sample of 600 eligible voters, the probability that less than 38% will be in favour of this policy is closest to (B) () In a large random sample,
More information, then the form of the model is given by: which comprises a deterministic component involving the three regression coefficients (
Multiple regression Introduction Multiple regression is a logical extension of the principles of simple linear regression to situations in which there are several predictor variables. For instance if we
More informationMath 62 Statistics Sample Exam Questions
Math 62 Statistics Sample Exam Questions 1. (10) Explain the difference between the distribution of a population and the sampling distribution of a statistic, such as the mean, of a sample randomly selected
More information4. Simple regression. QBUS6840 Predictive Analytics. https://www.otexts.org/fpp/4
4. Simple regression QBUS6840 Predictive Analytics https://www.otexts.org/fpp/4 Outline The simple linear model Least squares estimation Forecasting with regression Nonlinear functional forms Regression
More informationIndiana State Core Curriculum Standards updated 2009 Algebra I
Indiana State Core Curriculum Standards updated 2009 Algebra I Strand Description Boardworks High School Algebra presentations Operations With Real Numbers Linear Equations and A1.1 Students simplify and
More informationRegression in SPSS. Workshop offered by the Mississippi Center for Supercomputing Research and the UM Office of Information Technology
Regression in SPSS Workshop offered by the Mississippi Center for Supercomputing Research and the UM Office of Information Technology John P. Bentley Department of Pharmacy Administration University of
More informationQUADRATIC EQUATIONS EXPECTED BACKGROUND KNOWLEDGE
MODULE  1 Quadratic Equations 6 QUADRATIC EQUATIONS In this lesson, you will study aout quadratic equations. You will learn to identify quadratic equations from a collection of given equations and write
More informationSimple Regression and Correlation
Simple Regression and Correlation Today, we are going to discuss a powerful statistical technique for examining whether or not two variables are related. Specifically, we are going to talk about the ideas
More informationRegression, least squares
Regression, least squares Joe Felsenstein Department of Genome Sciences and Department of Biology Regression, least squares p.1/24 Fitting a straight line X Two distinct cases: The X values are chosen
More informationLecture 18 Linear Regression
Lecture 18 Statistics Unit Andrew Nunekpeku / Charles Jackson Fall 2011 Outline 1 1 Situation  used to model quantitative dependent variable using linear function of quantitative predictor(s). Situation
More information12.1 Inference for Linear Regression
12.1 Inference for Linear Regression Least Squares Regression Line y = a + bx You might want to refresh your memory of LSR lines by reviewing Chapter 3! 1 Sample Distribution of b p740 Shape Center Spread
More informationCorrelation and Simple Linear Regression
Correlation and Simple Linear Regression We are often interested in studying the relationship among variables to determine whether they are associated with one another. When we think that changes in a
More informationSan Jose State University Engineering 10 1
KY San Jose State University Engineering 10 1 Select Insert from the main menu Plotting in Excel Select All Chart Types San Jose State University Engineering 10 2 Definition: A chart that consists of multiple
More informationProbability, Mean and Median
Proaility, Mean and Median In the last section, we considered (proaility) density functions. We went on to discuss their relationship with cumulative distriution functions. The goal of this section is
More informationExercise 1.12 (Pg. 2223)
Individuals: The objects that are described by a set of data. They may be people, animals, things, etc. (Also referred to as Cases or Records) Variables: The characteristics recorded about each individual.
More informationPreCalculus III Linear Functions and Quadratic Functions
Linear Functions.. 1 Finding Slope...1 Slope Intercept 1 Point Slope Form.1 Parallel Lines.. Line Parallel to a Given Line.. Perpendicular Lines. Line Perpendicular to a Given Line 3 Quadratic Equations.3
More informationThe scatterplot indicates a positive linear relationship between waist size and body fat percentage:
STAT E150 Statistical Methods Multiple Regression Three percent of a man's body is essential fat, which is necessary for a healthy body. However, too much body fat can be dangerous. For men between the
More informationPart 2: Analysis of Relationship Between Two Variables
Part 2: Analysis of Relationship Between Two Variables Linear Regression Linear correlation Significance Tests Multiple regression Linear Regression Y = a X + b Dependent Variable Independent Variable
More informationAP Physics 1 and 2 Lab Investigations
AP Physics 1 and 2 Lab Investigations Student Guide to Data Analysis New York, NY. College Board, Advanced Placement, Advanced Placement Program, AP, AP Central, and the acorn logo are registered trademarks
More informationSection A. Index. Section A. Planning, Budgeting and Forecasting Section A.2 Forecasting techniques... 1. Page 1 of 11. EduPristine CMA  Part I
Index Section A. Planning, Budgeting and Forecasting Section A.2 Forecasting techniques... 1 EduPristine CMA  Part I Page 1 of 11 Section A. Planning, Budgeting and Forecasting Section A.2 Forecasting
More informationMultiple Linear Regression
Multiple Linear Regression A regression with two or more explanatory variables is called a multiple regression. Rather than modeling the mean response as a straight line, as in simple regression, it is
More informationIntroduction to Regression and Data Analysis
Statlab Workshop Introduction to Regression and Data Analysis with Dan Campbell and Sherlock Campbell October 28, 2008 I. The basics A. Types of variables Your variables may take several forms, and it
More informationHow To Run Statistical Tests in Excel
How To Run Statistical Tests in Excel Microsoft Excel is your best tool for storing and manipulating data, calculating basic descriptive statistics such as means and standard deviations, and conducting
More informationSHORT ANSWER. Write the word or phrase that best completes each statement or answers the question.
Practice for Chapter 9 and 10 The acutal exam differs. SHORT ANSWER. Write the word or phrase that best completes each statement or answers the question. Find the number of successes x suggested by the
More informationSIMPLE REGRESSION ANALYSIS
SIMPLE REGRESSION ANALYSIS Introduction. Regression analysis is used when two or more variables are thought to be systematically connected by a linear relationship. In simple regression, we have only two
More informationCopyright 2007 by Laura Schultz. All rights reserved. Page 1 of 5
Using Your TI83/84 Calculator: Linear Correlation and Regression Elementary Statistics Dr. Laura Schultz This handout describes how to use your calculator for various linear correlation and regression
More informationSydney Roberts Predicting Age Group Swimmers 50 Freestyle Time 1. 1. Introduction p. 2. 2. Statistical Methods Used p. 5. 3. 10 and under Males p.
Sydney Roberts Predicting Age Group Swimmers 50 Freestyle Time 1 Table of Contents 1. Introduction p. 2 2. Statistical Methods Used p. 5 3. 10 and under Males p. 8 4. 11 and up Males p. 10 5. 10 and under
More information7. Tests of association and Linear Regression
7. Tests of association and Linear Regression In this chapter we consider 1. Tests of Association for 2 qualitative variables. 2. Measures of the strength of linear association between 2 quantitative variables.
More informationModule 5: Multiple Regression Analysis
Using Statistical Data Using to Make Statistical Decisions: Data Multiple to Make Regression Decisions Analysis Page 1 Module 5: Multiple Regression Analysis Tom Ilvento, University of Delaware, College
More informationChapter 10. Key Ideas Correlation, Correlation Coefficient (r),
Chapter 0 Key Ideas Correlation, Correlation Coefficient (r), Section 0: Overview We have already explored the basics of describing single variable data sets. However, when two quantitative variables
More informationInteraction between quantitative predictors
Interaction between quantitative predictors In a firstorder model like the ones we have discussed, the association between E(y) and a predictor x j does not depend on the value of the other predictors
More information2. What is the general linear model to be used to model linear trend? (Write out the model) = + + + or
Simple and Multiple Regression Analysis Example: Explore the relationships among Month, Adv.$ and Sales $: 1. Prepare a scatter plot of these data. The scatter plots for Adv.$ versus Sales, and Month versus
More informationttests and Ftests in regression
ttests and Ftests in regression Johan A. Elkink University College Dublin 5 April 2012 Johan A. Elkink (UCD) t and Ftests 5 April 2012 1 / 25 Outline 1 Simple linear regression Model Variance and R
More informationMULTIPLE CHOICE. Choose the one alternative that best completes the statement or answers the question.
Open book and note Calculator OK Multiple Choice 1 point each MULTIPLE CHOICE. Choose the one alternative that best completes the statement or answers the question. Find the mean for the given sample data.
More informationOutline. Correlation & Regression, III. Review. Relationship between r and regression
Outline Correlation & Regression, III 9.07 4/6/004 Relationship between correlation and regression, along with notes on the correlation coefficient Effect size, and the meaning of r Other kinds of correlation
More informationUsing Excel for inferential statistics
FACT SHEET Using Excel for inferential statistics Introduction When you collect data, you expect a certain amount of variation, just caused by chance. A wide variety of statistical tests can be applied
More informationLecture  32 Regression Modelling Using SPSS
Applied Multivariate Statistical Modelling Prof. J. Maiti Department of Industrial Engineering and Management Indian Institute of Technology, Kharagpur Lecture  32 Regression Modelling Using SPSS (Refer
More informationWEB APPENDIX. Calculating Beta Coefficients. b Beta Rise Run Y 7.1 1 8.92 X 10.0 0.0 16.0 10.0 1.6
WEB APPENDIX 8A Calculating Beta Coefficients The CAPM is an ex ante model, which means that all of the variables represent beforethefact, expected values. In particular, the beta coefficient used in
More informationRegression. In this class we will:
AMS 5 REGRESSION Regression The idea behind the calculation of the coefficient of correlation is that the scatter plot of the data corresponds to a cloud that follows a straight line. This idea can be
More informationInternational Statistical Institute, 56th Session, 2007: Phil Everson
Teaching Regression using American Football Scores Everson, Phil Swarthmore College Department of Mathematics and Statistics 5 College Avenue Swarthmore, PA198, USA Email: peverso1@swarthmore.edu 1. Introduction
More information5. Linear Regression
5. Linear Regression Outline.................................................................... 2 Simple linear regression 3 Linear model............................................................. 4
More informationHence, multiplying by 12, the 95% interval for the hourly rate is (965, 1435)
Confidence Intervals for Poisson data For an observation from a Poisson distribution, we have σ 2 = λ. If we observe r events, then our estimate ˆλ = r : N(λ, λ) If r is bigger than 20, we can use this
More information17.0 Linear Regression
17.0 Linear Regression 1 Answer Questions Lines Correlation Regression 17.1 Lines The algebraic equation for a line is Y = β 0 + β 1 X 2 The use of coordinate axes to show functional relationships was
More informationA. Karpinski
Chapter 3 Multiple Linear Regression Page 1. Overview of multiple regression 32 2. Considering relationships among variables 33 3. Extending the simple regression model to multiple predictors 34 4.
More informationPASS Sample Size Software. Linear Regression
Chapter 855 Introduction Linear regression is a commonly used procedure in statistical analysis. One of the main objectives in linear regression analysis is to test hypotheses about the slope (sometimes
More informationAP * Statistics Review. Linear Regression
AP * Statistics Review Linear Regression Teacher Packet Advanced Placement and AP are registered trademark of the College Entrance Examination Board. The College Board was not involved in the production
More informationStatistiek II. John Nerbonne. March 24, 2010. Information Science, Groningen Slides improved a lot by Harmut Fitz, Groningen!
Information Science, Groningen j.nerbonne@rug.nl Slides improved a lot by Harmut Fitz, Groningen! March 24, 2010 Correlation and regression We often wish to compare two different variables Examples: compare
More information1 Simple Linear Regression I Least Squares Estimation
Simple Linear Regression I Least Squares Estimation Textbook Sections: 8. 8.3 Previously, we have worked with a random variable x that comes from a population that is normally distributed with mean µ and
More informationCurriculum Map Statistics and Probability Honors (348) Saugus High School Saugus Public Schools 20092010
Curriculum Map Statistics and Probability Honors (348) Saugus High School Saugus Public Schools 20092010 Week 1 Week 2 14.0 Students organize and describe distributions of data by using a number of different
More informationQuestions and Answers on Hypothesis Testing and Confidence Intervals
Questions and Answers on Hypothesis Testing and Confidence Intervals L. Magee Fall, 2008 1. Using 25 observations and 5 regressors, including the constant term, a researcher estimates a linear regression
More informationRegression Analysis: Basic Concepts
The simple linear model Regression Analysis: Basic Concepts Allin Cottrell Represents the dependent variable, y i, as a linear function of one independent variable, x i, subject to a random disturbance
More information