# 1. The parameters to be estimated in the simple linear regression model Y=α+βx+ε ε~n(0,σ) are: a) α, β, σ b) α, β, ε c) a, b, s d) ε, 0, σ

Size: px
Start display at page:

Download "1. The parameters to be estimated in the simple linear regression model Y=α+βx+ε ε~n(0,σ) are: a) α, β, σ b) α, β, ε c) a, b, s d) ε, 0, σ"

Transcription

1 STA 3024 Practice Problems Exam 2 NOTE: These are just Practice Problems. This is NOT meant to look just like the test, and it is NOT the only thing that you should study. Make sure you know all the material from the notes, quizzes, suggested homework and the corresponding chapters in the book. 1. The parameters to be estimated in the simple linear regression model Y=α+βx+ε ε~n(0,σ) are: a) α, β, σ b) α, β, ε c) a, b, s d) ε, 0, σ 2. We can measure the proportion of the variation explained by the regression model by: a) r b) R 2 c) σ 2 d) F 3. The MSE is an estimator of: a) ε b) 0 c) σ 2 d) Y 4. In multiple regression with p predictor variables, when constructing a confidence interval for any β i, the degrees of freedom for the tabulated value of t should be: a) n-1 b) n-2 c) n- p-1 d) p-1 5. In a regression study, a 95% confidence interval for β 1 was given as: (-5.65, 2.61). What would a test for H 0 : β 1 =0 vs H a : β 1 0 conclude? a) reject the null hypothesis at α=0.05 and all smaller α b) fail to reject the null hypothesis at α=0.05 and all smaller α c) reject the null hypothesis at α=0.05 and all larger α d) fail to reject the null hypothesis at α=0.05 and all larger α 6. In simple linear regression, when β is not significantly different from zero we conclude that: a) X is a good predictor of Y b) there is no linear relationship between X and Y c) the relationship between X and Y is quadratic d) there is no relationship between X and Y 7. In a study of the relationship between X=mean daily temperature for the month and Y=monthly charges on electrical bill, the following data was gathered: X Which of the following seems the most likely model? Y a) Y= α +βx+ε β<0 b) Y= α +βx+ε β>0 c) Y= α +β 1 x+β 2 x 2 +ε β 2 <0 d) Y= α +β 1 x+β 2 x 2 +ε β 2 >0 8. If a predictor variable x is found to be highly significant we would conclude that: a) a change in y causes a change in x b) a change in x causes a change in y c) changes in x are not related to changes in y d) changes in x are associated to changes in y 9. At the same confidence level, a prediction interval for a new response is always; a) somewhat larger than the corresponding confidence interval for the mean response b) somewhat smaller than the corresponding confidence interval for the mean response c) one unit larger than the corresponding confidence interval for the mean response d) one unit smaller than the corresponding confidence interval for the mean response 10. Both the prediction interval for a new response and the confidence interval for the mean response are narrower when made for values of x that are: a) closer to the mean of the x s b) further from the mean of the x s c) closer to the mean of the y s d) further from the mean of the y s

2 11. In the regression model Y = α + βx + ε the change in Y for a one unit increase in x: a) will always be the same amount, α b) will always be the same amount, β c) will depend on the error term d) will depend on the level of x 12. In a regression model with a dummy variable without interaction there can be: a) more than one slope and more than one intercept b) more than one slope, but only one intercept c) only one slope, but more than one intercept d) only one slope and one intercept 13. In a multiple regression model, where the x's are predictors and y is the response, multicollinearity occurs when: a) the x's provide redundant information about y b) the x's provide complementary information about y c) the x's are used to construct multiple lines, all of which are good predictors of y d) the x's are used to construct multiple lines, all of which are bad predictors of y 14. Compute the simple linear regression equation if: mean stdev correlation x y Match the statements below with the corresponding terms from the list. a) multicollinearity b) extrapolation c) R 2 adjusted d) quadratic regression e) interaction f) residual plots g) fitted equation h) dummy variables i) cause and effect j) multiple regression model k) R 2 l) residual m) influential points n) outliers Used when a numerical predictor has a curvilinear relationship with the response. Worst kind of outlier, can totally reverse the direction of association between x and y. Used to check the assumptions of the regression model. Used when trying to decide between two models with different numbers of predictors. Used when the effect of a predictor on the response depends on other predictors. Proportion of the variability in y explained by the regression model. Is the observed value of y minus the predicted value of y for the observed x.. A point that lies far away from the rest. Can give bad predictions if the conditions do not hold outside the observed range of x's. Can be erroneously assumed in an observational study. y= α +β 1 x 1 +β 2 x β p x p +ε ε~n(0,σ 2 ) ŷ =a+b 1 x 1 +b 2 x b p x p Problem that can occur when the information provided by several predictors overlaps. Used in a regression model to represent categorical variables.

3 Questions Palm readers claim to be able to tell how long your life will be by looking at a specific line on your hand. The following is a plot of age of person at death (in years) vs length of life line on the right hand (in cm) for a sample of 28 (dead) people. age If we fit a simple linear regression model 90 - to these data, what would the value of r be? - a) close to b) close to 0 - c) close to d) it's impossible to tell length of line 17. Would you say: a) length of life line is a very good predictor of age of person at death b) length of life line is a poor predictor of age of person at death c) length of life line is a reasonably good predictor of age of person at death d) cannot determine how good a predictor length of life line is of age of person at death 18. The ANOVA p-value will be around a) 1.00 b) c) 0.05 d) A better way of modeling age of person at death using this data set would be to use: a) a nonparametric procedure c) a contingency table b) the average age at death d) quadratic regression 20. According to the null hypothesis of the ANOVA F test, which predictor variables are providing significant information about the response? a) most of them b) none of them c) all of them d) some of them 21. According to the alternative hypothesis of the ANOVA F test, which predictor variables are providing significant information about the response? a) most of them b) none of them c) all of them d) some of them 22. In general, the Least Squares Regression approach finds the equation: a) that includes the best set of predictor variables b) of the best fitting straight line through a set of points c) with the highest R 2, after comparing all possible models d) that has the smallest sum of squared errors 23. Studies have shown a high positive correlation between the number of firefighters dispatched to combat a fire and the financial damages resulting from it. A politician commented that the fire chief should stop sending so many firefighters since they are clearly destroying the place. This is an example of: a) extrapolation b) dummy variables c) misuse of causality d) multicollinearity 24. The following appeared in the magazine Financial Times, March 23, 1995: "When Elvis Presley died in 1977, there were 48 professional Elvis impersonators. Today there are an estimated If that growth is projected, by the year 2012 one person in four on the face of the globe will be an Elvis impersonator." This is an example of: a) extrapolation b) dummy variables c) misuse of causality d) multicollinearity

4 Questions Most supermarkets use scanners at the checkout counters. The data collected this way can be used to evaluate the effect of price and store's promotional activities on the sales of any product. The promotions at a store change weekly, and are mainly of two types: flyers distributed outside the store and through newspapers (which may or may not include that particular product), and in-store displays at the end of an aisle that call the customers' attention to the product. Weekly data was collected on a particular beverage brand, including sales (in number of units), price (in dollars), flyer (1 if product appeared that week, 0 if it didn't) and display (1 if a special display of the product was used that week, 0 if it wasn't). As a preliminary analysis, a simple linear regression model was done. The fitted regression equation was: sales = price. The ANOVA F test p-value was.000, and R 2 = 59.7%. 25. The response variable is: a) quantitative b) y c) sales d) all of the above 26. Which of the following is the best interpretation of the slope of the line? a) As the price increases by 1 dollar, sales will increase, on average, by 2259 units. b) As the price increases by 1 dollar, sales will decrease, on average, by 1418 units. c) As the sales increase by 1 unit, the price will increase, on average, by 2259 dollars. d) As the sales increase by 1 unit, the price will decrease, on average, by 1418 dollars. 27. Should the intercept of the line be interpreted in this case? a) Yes, as the average price when no units are sold. b) Yes, as the average sales when the price is zero dollars. c) No, since sales of zero units are probably out of the range observed. d) No, since a price of zero dollars is probably out of the range observed. 28. The proportion of the variability in sales accounted for by the price of the product is: a) 14.18% b) 22.59% c) 59.70% d) 100% 29. The coefficient of linear correlation, r, for this analysis is: a) 7.73 b) c).773 d) According to this model, how many units will be sold, on average, when the price of the beverage is \$1.10? a) b) c) d) Is price a good predictor of sales? a) Yes, the p-value is very small. b) Yes, the intercept is very large. c) No, R-square is not too good. d) No, the slope is negative. 32. Below is a sketch of the residual plot for this analysis. What can you conclude from it? a) All the assumptions seem to be satisfied. * * b) There seems to be an outlier in the data. * * c) Simple linear regression might not be the best model. * * d) The assumption of constant variance might be violated.

5 Next, a quadratic regression was fitted to the data. Parts of the computer output appear below. Predictor Coef Stdev t-ratio p Constant price price Analysis of Variance SOURCE DF SS MS F p Regression Error Total We can write the model fitted here as: a) Y= α +βx+ε b) Y= α +β 1 x 1 +β 2 x 2 +ε c) Y= α +β 1 x+β 2 x 2 +ε d) Y= α +β 1 x 1 +β 2 x 2 +β 3 x 1 x 2 +ε 34. What is R 2? a) 19.3% b) 80.7% c) 23.98% d) 76.06% 35. What is the test statistic to determine if the quadratic term significantly differs from zero? a) b) c) d) Based on the results of the two regression analyses presented here, which of the following sketches best describes the relationship between price of the item and sales? a) b) c) d) sales sales sales sales * * * * * * * * * * * * * * * * * * * price price price price 37. According to this model, how many units will be sold, on average, when the price of the beverage is \$1.10? a) b) c) d) Is the quadratic model preferable to the linear model in this case? a) No, we always prefer the simpler model. b) No, the p-value for the quadratic term is zero. c) Yes, the p-value for the quadratic term is zero. d) Yes, we had more data for the quadratic model.

7 Questions A scientific foundation wanted to evaluate the relation between y= salary of researcher (in thousands of dollars), x 1 = number of years of experience, x 2 = an index of publication quality, x 3 =sex (M=1, F=0) and x 4 = an index of success in obtaining grant support. A sample of 35 randomly selected researchers was used to fit the multiple regression model. Parts of the computer output appear below. Predictor Coef SE Coef T P Constant Years Papers Sex Grants s = R-sq = 92.3% adj R-sq = 91.4% 44. The least squares line fitted to the data is: a) salary = x x x x 4 + ε b) salary = x x x x 4 + ε c) salary = x x x x 4 d) salary = x x x x The p-value of the ANOVA F test will be: a) very large, since it's clear that all of the variables are good predictors of salary b) very small, since it's clear that all of the variables are good predictors of salary c) very large, since it's clear that none of the variables are good predictors of salary d) very small, since it's clear that none of the variables are good predictors of salary 46. The (one-sided) p-value for testing whether salary increases with years of experience is: a).0001 b).0032 c).0064 d) The variable that helps the most in predicting salary is: a) intercept b) years c) papers d) sex e) grants 48. Which of the following gives a 95% CI for β 1? a) ± t* (2.002) b) ± t* (8.915) c) ± t* (.3596) d) ± t* (3.068) 49. How many degrees of freedom does the t* value from the previous question have? a) 34 b) 33 c) 30 d) According to the assumptions, what has to have a Normal distribution and constant variance? a) the researchers b) the years c) the variables d) the salaries Questions In a study on teenage pregnancies, the researchers attempted to determine the relationship between y=weight of baby at birth (in pounds) and x=age of the mother. The data collected is plotted below. wt If we fit a simple linear regression model - to these data, the value of r will be closest to? - a) 0 b) -1 c) 1 d) To determine if age of mother is a significantly - good predictor of weight of baby we could: 5 - a) construct a confidence interval for the slope age of b) test whether the slope is zero or not mother c) use an ANOVA F test d) all of the above

8 53. The best fitting line through these points will probably have a slope that is: a) positive and significantly different from zero. b) positive but not significantly different from zero. c) negative and significantly different from zero. d) negative but not significantly different from zero. Questions The following is a plot of the same data, but using different symbols to represent mothers who received prenatal care (*) and those who didn't ( ). We fit the model: Y= α +β 1 x 1 +β 2 x 2 +β 3 x 1 x 2 +ε, where Y= wt x 1 =age x 2 = 0 for prenatal care, 1 if not wt 9 - * * * 54. The model we fit to these data is not: - * * * * a) Multiple Regression - * * * * b) Regression with Dummy Variables 7 - * * * c) Least Squares Regression - * * d) Quadratic Regression age of mother 55. The baseline group is: a) age b) weight c) prenatal care d) random Match each parameter with the interpretations at right: 56. β 3 a) change in intercept 57. β 2 b) intercept for baseline group 58. β 1 c) slope for baseline group 59. α d) change in slope e) slope for non-baseline group 60. For the model above, and based on the plot, which of the following statements is true? a) Age of mother does not seem to be a good predictor of weight of baby. b) Prenatal care will probably have a significant effect on weight of baby. c) There appears to be an interaction between prenatal care and age of mother. d) all the statements are false. 61. Which parameter would we test for to determine if the rate at which weight of baby increases with age of mother differs for mothers who receive prenatal care and those who don't? a) β 3 b) β 2 c) β 1 d) α The computer output reports following equation: wt= x x x 1 x 2. Use that equation to answer the next two questions: 62. To predict weight of babies born to teenagers who do not receive prenatal care we use the equation: a) wt= x 1 b) wt= x 1 c) wt= x 1 d) wt= x To predict weight of babies born to teenagers who receive prenatal care we use the equation: a) wt= x 1 b) wt= x 1 c) wt= x 1 d) wt= x 1

9 Questions Data for 51 U.S. states (50 states, plus the District of Columbia) was used to examine the relationship between violent crime rate (violent crimes per 100,000 persons per year) and the predictor variables of urbanization (percentage of the population living in urban areas) and poverty rate. A predictor variable indicating whether or not a state is classified as a Southern state (1 = Southern, 0 = not) was also included. Some Minitab output for the analysis of this data is shown below (with some information intentionally left blank). The regression equation is Crime = Urban +39.3Poverty South +12.1Urban*South -5.84Poverty*South Predictor Coef SE Coef T P Constant Urban Poverty South(S=1) Urban*South Poverty*South Analysis of Variance Source DF SS MS F P Regression Residual Error Total Which of the following represents the fitted relationship between crime, urbanization, and poverty for Southern states? a) Crime = Urban Poverty b) Crime = Urban Poverty c) Crime = Urban Poverty d) Crime = Urban Poverty e) Crime = Urban Poverty 65. Predict the violent crime rate for a Southern state with an urbanization of 55.4 and a poverty rate of a) b) c) d) e) Predict the violent crime rate for a non-southern state with an urbanization of 65.6 and a poverty rate of 8.0. a) b) c) d) e) Calculate the ANOVA F test statistic value. a) 2.34 b) 4.20 c) 4.58 d) e) When finding the p-value for the ANOVA F test, what degrees of freedom should be used? a) df = 5 b) df = 45 c) df = 50 d) df 1 = 5, df 2 = 45 e) df 1 = 5, df 2 = Based on the p-value for the ANOVA F test shown in the output, how many of the predictors are useful for predicting crime rate? a) none of them b) all of them c) exactly one of them d) at least one of them 70. Which of the following predictors should probably be removed from the model to improve it? a) Urban b) Poverty c) South d) Urban*South e) Poverty*South

10 Questions The National Math and Science Initiative (NMSI) has recently begun a controversial program in which high school students are paid cash incentives for passing an end-of-year standardized test. Suppose we conduct a similar study, in which end-of-year test scores (y) are measured on a scale of and the amount of the cash incentive offered to the student (x) is measured in dollars from \$0 to \$500. A scatterplot of the 96 observations in the sample and the regression line is shown below, along with some Minitab output (with some information intentionally left blank). The regression equation is Score = Cash Predictor Coef SE Coef T P Constant Cash Predicted Values for New Observations Cash Fit SE Fit 95% CI 95% PI 200 [A] [B] Cash Fit SE Fit 95% CI 95% PI 500 [C] [D] 71. The coefficient in the equation is a) the parameter. b) the parameter. c) our estimate of the parameter. d) our estimate of the parameter. 72. Which of the following is the best interpretation of the slope? a) For each additional dollar offered to students, their scores increase by points, on average. b) For each additional dollar offered to students, their scores increase by points, on average. c) For each additional dollars offered to students, their scores increase by one point, on average. d) For each additional dollars offered to students, their scores increase by one point, on average. 73. Which of the following is the best interpretation of the intercept? a) The predicted score of a student who is offered no cash is points. b) The predicted score of a student who is offered no cash is points. c) The amount of cash offered to a student who scores a zero is, on average, dollars. d) The amount of cash offered to a student who scores a zero is, on average, dollars. e) None of the above; it is not appropriate to interpret the intercept in this situation. 74. Calculate the predicted test score of a student who is offered a cash incentive of \$200. a) b) c) d) e) The p-value for the ANOVA test was , so there is evidence that scores on the test depend on the size of the cash incentive. a) not enough b) pretty strong c) very strong d) some e) no 76. Calculate the value of the t test statistic for testing whether score depends on cash incentive. a) b) 1.67 c) 2.79 d) 4.10 e) Which of the four intervals labeled as [A] [D] in the Minitab output would be the widest? a) [A] b) [B] c) [C] d) [D] e) All four would have the same width. 78. Which of the four intervals labeled as [A] [D] in the Minitab output would be the narrowest? a) [A] b) [B] c) [C] d) [D] e) All four would have the same width. 79. Which of the four intervals labeled as [A] [D] in the Minitab output would be the confidence interval for? a) [A] b) [B] c) [C] d) [D] e) None of these

11 Questions The economic structure of Major League Baseball allows some teams to make substantially more money than others, which in turn allows some teams to spend much more on player salaries. These teams might therefore be expected to have better players and win more games on the field as a result. Suppose that after collecting data on team payroll (in millions of dollars) and season win total for 2010, we find a regression equation of Wins = Payroll League where League is an indicator variable that equals 0 if the team plays in the National League or 1 if the team plays in the American League. 80. If Teams A and B both play in the same league, and Team A s payroll is \$1 million higher than Team B s, then we would expect Team A to win, on average, a) games more than Team B. b) games more than Team B. c) games more than Team B. d) games fewer than Team B. 81. If Teams A and B have the same payroll, but Team A plays in the National League while Team B plays in the American League, then we would expect Team A to win, on average, a) games more than Team B. b) games more than Team B. c) games more than Team B. d) games fewer than Team B. 82. Suppose we plotted the data and drew the regression lines for National League and American League teams. What would be the slope of the line for American League teams? a) b) c) d) e) Suppose we plotted the data and drew the regression lines for National League and American League teams. What would be the intercept of the line for American League teams? a) b) c) d) e) Calculate the predicted number of wins for a National League team with a payroll of \$98 million. a) b) c) d) e) One American League team in the data set had a payroll of \$108 million and won 88 games. Calculate the residual for this observation. a) 1.26 b) 5.28 c) 9.65 d) e) The t tests for which variable would have the same p-value as the ANOVA test? a) constant b) payroll c) league d) wins e) none of them 87. Common sense suggests that teams with a higher payroll should have a strong tendency to win more games, but that league affiliation should not matter. Then common sense suggests that the ANOVA F test for this data would probably have a) a small test statistic value and a small p-value. b) a small test statistic value and a large p-value. c) a large test statistic value and a small p-value. d) a large test statistic value and a large p-value. 88. Based on the common sense described in the previous question, in which of the following t tests would we probably reject the null hypothesis? a) the t test for Payroll b) the t test for League c) both t tests d) neither t test

12 Questions Ecologists have long known that there is a relationship between the amount of precipitation a location receives and the number of trees that grow in the area. Suppose that the yearly rainfall (x, measured in mm) and the amount of the ground covered by trees (y, measured on a scale from 0 to 100) are recorded for 49 geographic locations. In the sample data, x has a sample mean of and a sample standard deviation of 226.0, while y has a sample mean of 49.6 and a sample standard deviation of 7.1. The sample correlation between x and y is In a simple linear regression analysis of this data, when we write y x, which of the following do we assume? a) The x values are independent and normally distributed with mean 0 and constant variance. b) The x values are independent and normally distributed with variance 0 and constant mean. c) The errors are independent and normally distributed with mean 0 and constant variance. d) The errors are independent and normally distributed with variance 0 and constant mean. e) both a) and c) 90. Use the information provided to calculate the regression equation. a) TreeCover = Rainfall b) TreeCover = Rainfall c) TreeCover = Rainfall d) TreeCover = Rainfall e) TreeCover = Rainfall 91. Calculate the predicted amount of tree cover for an area that receives 1230 mm of rainfall per year. a) 50.6 b) 52.3 c) 55.9 d) 60.9 e) What percentage of the variability in tree cover is explained by rainfall? a) 2.1% b) 21.5% c) 24.7% d) 45.3% e) 67.3% 93. For this data set, find the degrees of freedom for regression. a) 1 b) 2 c) 47 d) 48 e) For this data set, find the degrees of freedom for error. a) 1 b) 2 c) 47 d) 48 e) In a regression t test for this data, which of the following statements is the alternative hypothesis (in words)? a) The population mean of tree cover is not zero. b) The population mean of tree cover is zero. c) Tree cover depends on rainfall. d) Tree cover does not depend on rainfall. e) The population means of tree cover and rainfall are not equal. 96. Suppose now that we record a 50th observation, include it in the data set, and recalculate the regression equation. Which of the following possibilities for the 50th observation would probably change the regression equation the most? a) x = 900, y = 45 b) x = 1200, y = 40 c) x = 1200, y = 60 d) x = 2400, y = 75 e) x = 2400, y = 25

13 ANSWERS 1. a 2. b 3. c 4. c 5. b 6. b 7. d (Plot the data) 8. d 9. a 10. a 11. b 12. c 13. a 14. y-hat = x 15. d m f c e k l n b I j g a h 16. b 17. b 18. a 19. b 20. b 21. d 22. d 23. c 24. a 25. d 26. b 27. d 28. c 29. d 30. b 31. a 32. c 33. c 34. b 35. d 36. d 37. a 38. c 39. a 40. d 41. a 42. c 43. b 44. d 45. b 46. d 47. c 48. c 49. c 50. d 51. a 52. d 53. b 54. d 55. c 56. d 57. a 58. c 59. b 60. b 61. a 62. a 63. b 64. d 65. a 66. a 67. d 68. d 69. d 70. e 71. d 72. a 73. b 74. b 75. d 76. b 77. d 78. a 79. e 80. a (Write down the two equations 81. c and plot them for 80 88) 82. d 83. e 84. e 85. b 86. e 87. c 88. a 89. c 90. a 91. a 92. d 93. a 94. c 95. c 96. e

### 17. SIMPLE LINEAR REGRESSION II

17. SIMPLE LINEAR REGRESSION II The Model In linear regression analysis, we assume that the relationship between X and Y is linear. This does not mean, however, that Y can be perfectly predicted from X.

### Regression Analysis: A Complete Example

Regression Analysis: A Complete Example This section works out an example that includes all the topics we have discussed so far in this chapter. A complete example of regression analysis. PhotoDisc, Inc./Getty

### 2. Simple Linear Regression

Research methods - II 3 2. Simple Linear Regression Simple linear regression is a technique in parametric statistics that is commonly used for analyzing mean response of a variable Y which changes according

### Chapter 7: Simple linear regression Learning Objectives

Chapter 7: Simple linear regression Learning Objectives Reading: Section 7.1 of OpenIntro Statistics Video: Correlation vs. causation, YouTube (2:19) Video: Intro to Linear Regression, YouTube (5:18) -

### 1. What is the critical value for this 95% confidence interval? CV = z.025 = invnorm(0.025) = 1.96

1 Final Review 2 Review 2.1 CI 1-propZint Scenario 1 A TV manufacturer claims in its warranty brochure that in the past not more than 10 percent of its TV sets needed any repair during the first two years

### " Y. Notation and Equations for Regression Lecture 11/4. Notation:

Notation: Notation and Equations for Regression Lecture 11/4 m: The number of predictor variables in a regression Xi: One of multiple predictor variables. The subscript i represents any number from 1 through

### Solution Let us regress percentage of games versus total payroll.

Assignment 3, MATH 2560, Due November 16th Question 1: all graphs and calculations have to be done using the computer The following table gives the 1999 payroll (rounded to the nearest million dolars)

### Elementary Statistics Sample Exam #3

Elementary Statistics Sample Exam #3 Instructions. No books or telephones. Only the supplied calculators are allowed. The exam is worth 100 points. 1. A chi square goodness of fit test is considered to

### Final Exam Practice Problem Answers

Final Exam Practice Problem Answers The following data set consists of data gathered from 77 popular breakfast cereals. The variables in the data set are as follows: Brand: The brand name of the cereal

### Outline. Topic 4 - Analysis of Variance Approach to Regression. Partitioning Sums of Squares. Total Sum of Squares. Partitioning sums of squares

Topic 4 - Analysis of Variance Approach to Regression Outline Partitioning sums of squares Degrees of freedom Expected mean squares General linear test - Fall 2013 R 2 and the coefficient of correlation

### Chicago Booth BUSINESS STATISTICS 41000 Final Exam Fall 2011

Chicago Booth BUSINESS STATISTICS 41000 Final Exam Fall 2011 Name: Section: I pledge my honor that I have not violated the Honor Code Signature: This exam has 34 pages. You have 3 hours to complete this

### Chapter 13 Introduction to Linear Regression and Correlation Analysis

Chapter 3 Student Lecture Notes 3- Chapter 3 Introduction to Linear Regression and Correlation Analsis Fall 2006 Fundamentals of Business Statistics Chapter Goals To understand the methods for displaing

### Premaster Statistics Tutorial 4 Full solutions

Premaster Statistics Tutorial 4 Full solutions Regression analysis Q1 (based on Doane & Seward, 4/E, 12.7) a. Interpret the slope of the fitted regression = 125,000 + 150. b. What is the prediction for

### August 2012 EXAMINATIONS Solution Part I

August 01 EXAMINATIONS Solution Part I (1) In a random sample of 600 eligible voters, the probability that less than 38% will be in favour of this policy is closest to (B) () In a large random sample,

### 1 Simple Linear Regression I Least Squares Estimation

Simple Linear Regression I Least Squares Estimation Textbook Sections: 8. 8.3 Previously, we have worked with a random variable x that comes from a population that is normally distributed with mean µ and

### Part 2: Analysis of Relationship Between Two Variables

Part 2: Analysis of Relationship Between Two Variables Linear Regression Linear correlation Significance Tests Multiple regression Linear Regression Y = a X + b Dependent Variable Independent Variable

### 2. What is the general linear model to be used to model linear trend? (Write out the model) = + + + or

Simple and Multiple Regression Analysis Example: Explore the relationships among Month, Adv.\$ and Sales \$: 1. Prepare a scatter plot of these data. The scatter plots for Adv.\$ versus Sales, and Month versus

### Unit 31 A Hypothesis Test about Correlation and Slope in a Simple Linear Regression

Unit 31 A Hypothesis Test about Correlation and Slope in a Simple Linear Regression Objectives: To perform a hypothesis test concerning the slope of a least squares line To recognize that testing for a

### Moderation. Moderation

Stats - Moderation Moderation A moderator is a variable that specifies conditions under which a given predictor is related to an outcome. The moderator explains when a DV and IV are related. Moderation

### Univariate Regression

Univariate Regression Correlation and Regression The regression line summarizes the linear relationship between 2 variables Correlation coefficient, r, measures strength of relationship: the closer r is

### Introduction to Regression and Data Analysis

Statlab Workshop Introduction to Regression and Data Analysis with Dan Campbell and Sherlock Campbell October 28, 2008 I. The basics A. Types of variables Your variables may take several forms, and it

### Section 14 Simple Linear Regression: Introduction to Least Squares Regression

Slide 1 Section 14 Simple Linear Regression: Introduction to Least Squares Regression There are several different measures of statistical association used for understanding the quantitative relationship

### Simple Linear Regression Inference

Simple Linear Regression Inference 1 Inference requirements The Normality assumption of the stochastic term e is needed for inference even if it is not a OLS requirement. Therefore we have: Interpretation

### International Statistical Institute, 56th Session, 2007: Phil Everson

Teaching Regression using American Football Scores Everson, Phil Swarthmore College Department of Mathematics and Statistics 5 College Avenue Swarthmore, PA198, USA E-mail: peverso1@swarthmore.edu 1. Introduction

### The importance of graphing the data: Anscombe s regression examples

The importance of graphing the data: Anscombe s regression examples Bruce Weaver Northern Health Research Conference Nipissing University, North Bay May 30-31, 2008 B. Weaver, NHRC 2008 1 The Objective

### DEPARTMENT OF PSYCHOLOGY UNIVERSITY OF LANCASTER MSC IN PSYCHOLOGICAL RESEARCH METHODS ANALYSING AND INTERPRETING DATA 2 PART 1 WEEK 9

DEPARTMENT OF PSYCHOLOGY UNIVERSITY OF LANCASTER MSC IN PSYCHOLOGICAL RESEARCH METHODS ANALYSING AND INTERPRETING DATA 2 PART 1 WEEK 9 Analysis of covariance and multiple regression So far in this course,

### NCSS Statistical Software Principal Components Regression. In ordinary least squares, the regression coefficients are estimated using the formula ( )

Chapter 340 Principal Components Regression Introduction is a technique for analyzing multiple regression data that suffer from multicollinearity. When multicollinearity occurs, least squares estimates

### MULTIPLE REGRESSION EXAMPLE

MULTIPLE REGRESSION EXAMPLE For a sample of n = 166 college students, the following variables were measured: Y = height X 1 = mother s height ( momheight ) X 2 = father s height ( dadheight ) X 3 = 1 if

### 5. Linear Regression

5. Linear Regression Outline.................................................................... 2 Simple linear regression 3 Linear model............................................................. 4

### IAPRI Quantitative Analysis Capacity Building Series. Multiple regression analysis & interpreting results

IAPRI Quantitative Analysis Capacity Building Series Multiple regression analysis & interpreting results How important is R-squared? R-squared Published in Agricultural Economics 0.45 Best article of the

### TRINITY COLLEGE. Faculty of Engineering, Mathematics and Science. School of Computer Science & Statistics

UNIVERSITY OF DUBLIN TRINITY COLLEGE Faculty of Engineering, Mathematics and Science School of Computer Science & Statistics BA (Mod) Enter Course Title Trinity Term 2013 Junior/Senior Sophister ST7002

### Week TSX Index 1 8480 2 8470 3 8475 4 8510 5 8500 6 8480

1) The S & P/TSX Composite Index is based on common stock prices of a group of Canadian stocks. The weekly close level of the TSX for 6 weeks are shown: Week TSX Index 1 8480 2 8470 3 8475 4 8510 5 8500

### Regression step-by-step using Microsoft Excel

Step 1: Regression step-by-step using Microsoft Excel Notes prepared by Pamela Peterson Drake, James Madison University Type the data into the spreadsheet The example used throughout this How to is a regression

### Homework 8 Solutions

Math 17, Section 2 Spring 2011 Homework 8 Solutions Assignment Chapter 7: 7.36, 7.40 Chapter 8: 8.14, 8.16, 8.28, 8.36 (a-d), 8.38, 8.62 Chapter 9: 9.4, 9.14 Chapter 7 7.36] a) A scatterplot is given below.

### Example: Boats and Manatees

Figure 9-6 Example: Boats and Manatees Slide 1 Given the sample data in Table 9-1, find the value of the linear correlation coefficient r, then refer to Table A-6 to determine whether there is a significant

### STAT 350 Practice Final Exam Solution (Spring 2015)

PART 1: Multiple Choice Questions: 1) A study was conducted to compare five different training programs for improving endurance. Forty subjects were randomly divided into five groups of eight subjects

### Chapter 4 and 5 solutions

Chapter 4 and 5 solutions 4.4. Three different washing solutions are being compared to study their effectiveness in retarding bacteria growth in five gallon milk containers. The analysis is done in a laboratory,

### Basic Statistics and Data Analysis for Health Researchers from Foreign Countries

Basic Statistics and Data Analysis for Health Researchers from Foreign Countries Volkert Siersma siersma@sund.ku.dk The Research Unit for General Practice in Copenhagen Dias 1 Content Quantifying association

### KSTAT MINI-MANUAL. Decision Sciences 434 Kellogg Graduate School of Management

KSTAT MINI-MANUAL Decision Sciences 434 Kellogg Graduate School of Management Kstat is a set of macros added to Excel and it will enable you to do the statistics required for this course very easily. To

### 11. Analysis of Case-control Studies Logistic Regression

Research methods II 113 11. Analysis of Case-control Studies Logistic Regression This chapter builds upon and further develops the concepts and strategies described in Ch.6 of Mother and Child Health:

### 5. Multiple regression

5. Multiple regression QBUS6840 Predictive Analytics https://www.otexts.org/fpp/5 QBUS6840 Predictive Analytics 5. Multiple regression 2/39 Outline Introduction to multiple linear regression Some useful

### HYPOTHESIS TESTING: CONFIDENCE INTERVALS, T-TESTS, ANOVAS, AND REGRESSION

HYPOTHESIS TESTING: CONFIDENCE INTERVALS, T-TESTS, ANOVAS, AND REGRESSION HOD 2990 10 November 2010 Lecture Background This is a lightning speed summary of introductory statistical methods for senior undergraduate

### Name: Date: Use the following to answer questions 3-4:

Name: Date: 1. Determine whether each of the following statements is true or false. A) The margin of error for a 95% confidence interval for the mean increases as the sample size increases. B) The margin

### Module 5: Multiple Regression Analysis

Using Statistical Data Using to Make Statistical Decisions: Data Multiple to Make Regression Decisions Analysis Page 1 Module 5: Multiple Regression Analysis Tom Ilvento, University of Delaware, College

### DATA INTERPRETATION AND STATISTICS

PholC60 September 001 DATA INTERPRETATION AND STATISTICS Books A easy and systematic introductory text is Essentials of Medical Statistics by Betty Kirkwood, published by Blackwell at about 14. DESCRIPTIVE

### Predictor Coef StDev T P Constant 970667056 616256122 1.58 0.154 X 0.00293 0.06163 0.05 0.963. S = 0.5597 R-Sq = 0.0% R-Sq(adj) = 0.

Statistical analysis using Microsoft Excel Microsoft Excel spreadsheets have become somewhat of a standard for data storage, at least for smaller data sets. This, along with the program often being packaged

### 4. Multiple Regression in Practice

30 Multiple Regression in Practice 4. Multiple Regression in Practice The preceding chapters have helped define the broad principles on which regression analysis is based. What features one should look

### Multiple Linear Regression

Multiple Linear Regression A regression with two or more explanatory variables is called a multiple regression. Rather than modeling the mean response as a straight line, as in simple regression, it is

### Estimation of σ 2, the variance of ɛ

Estimation of σ 2, the variance of ɛ The variance of the errors σ 2 indicates how much observations deviate from the fitted surface. If σ 2 is small, parameters β 0, β 1,..., β k will be reliably estimated

### Good luck! BUSINESS STATISTICS FINAL EXAM INSTRUCTIONS. Name:

Glo bal Leadership M BA BUSINESS STATISTICS FINAL EXAM Name: INSTRUCTIONS 1. Do not open this exam until instructed to do so. 2. Be sure to fill in your name before starting the exam. 3. You have two hours

### SPSS Guide: Regression Analysis

SPSS Guide: Regression Analysis I put this together to give you a step-by-step guide for replicating what we did in the computer lab. It should help you run the tests we covered. The best way to get familiar

### Simple Regression Theory II 2010 Samuel L. Baker

SIMPLE REGRESSION THEORY II 1 Simple Regression Theory II 2010 Samuel L. Baker Assessing how good the regression equation is likely to be Assignment 1A gets into drawing inferences about how close the

### Chapter 1: Exploring Data

Chapter 1: Exploring Data Chapter 1 Review 1. As part of survey of college students a researcher is interested in the variable class standing. She records a 1 if the student is a freshman, a 2 if the student

### Factors affecting online sales

Factors affecting online sales Table of contents Summary... 1 Research questions... 1 The dataset... 2 Descriptive statistics: The exploratory stage... 3 Confidence intervals... 4 Hypothesis tests... 4

### 2013 MBA Jump Start Program. Statistics Module Part 3

2013 MBA Jump Start Program Module 1: Statistics Thomas Gilbert Part 3 Statistics Module Part 3 Hypothesis Testing (Inference) Regressions 2 1 Making an Investment Decision A researcher in your firm just

### Getting Correct Results from PROC REG

Getting Correct Results from PROC REG Nathaniel Derby, Statis Pro Data Analytics, Seattle, WA ABSTRACT PROC REG, SAS s implementation of linear regression, is often used to fit a line without checking

### Week 5: Multiple Linear Regression

BUS41100 Applied Regression Analysis Week 5: Multiple Linear Regression Parameter estimation and inference, forecasting, diagnostics, dummy variables Robert B. Gramacy The University of Chicago Booth School

### STATISTICS 8, FINAL EXAM. Last six digits of Student ID#: Circle your Discussion Section: 1 2 3 4

STATISTICS 8, FINAL EXAM NAME: KEY Seat Number: Last six digits of Student ID#: Circle your Discussion Section: 1 2 3 4 Make sure you have 8 pages. You will be provided with a table as well, as a separate

### Section 1: Simple Linear Regression

Section 1: Simple Linear Regression Carlos M. Carvalho The University of Texas McCombs School of Business http://faculty.mccombs.utexas.edu/carlos.carvalho/teaching/ 1 Regression: General Introduction

### CHAPTER 13 SIMPLE LINEAR REGRESSION. Opening Example. Simple Regression. Linear Regression

Opening Example CHAPTER 13 SIMPLE LINEAR REGREION SIMPLE LINEAR REGREION! Simple Regression! Linear Regression Simple Regression Definition A regression model is a mathematical equation that descries the

### Analysis of Variance. MINITAB User s Guide 2 3-1

3 Analysis of Variance Analysis of Variance Overview, 3-2 One-Way Analysis of Variance, 3-5 Two-Way Analysis of Variance, 3-11 Analysis of Means, 3-13 Overview of Balanced ANOVA and GLM, 3-18 Balanced

### GLM I An Introduction to Generalized Linear Models

GLM I An Introduction to Generalized Linear Models CAS Ratemaking and Product Management Seminar March 2009 Presented by: Tanya D. Havlicek, Actuarial Assistant 0 ANTITRUST Notice The Casualty Actuarial

### Simple linear regression

Simple linear regression Introduction Simple linear regression is a statistical method for obtaining a formula to predict values of one variable from another where there is a causal relationship between

### Using R for Linear Regression

Using R for Linear Regression In the following handout words and symbols in bold are R functions and words and symbols in italics are entries supplied by the user; underlined words and symbols are optional

### A Primer on Forecasting Business Performance

A Primer on Forecasting Business Performance There are two common approaches to forecasting: qualitative and quantitative. Qualitative forecasting methods are important when historical data is not available.

### Elements of statistics (MATH0487-1)

Elements of statistics (MATH0487-1) Prof. Dr. Dr. K. Van Steen University of Liège, Belgium December 10, 2012 Introduction to Statistics Basic Probability Revisited Sampling Exploratory Data Analysis -

### Recall this chart that showed how most of our course would be organized:

Chapter 4 One-Way ANOVA Recall this chart that showed how most of our course would be organized: Explanatory Variable(s) Response Variable Methods Categorical Categorical Contingency Tables Categorical

### MULTIPLE CHOICE. Choose the one alternative that best completes the statement or answers the question.

Final Exam Review MULTIPLE CHOICE. Choose the one alternative that best completes the statement or answers the question. 1) A researcher for an airline interviews all of the passengers on five randomly

### Statistics 151 Practice Midterm 1 Mike Kowalski

Statistics 151 Practice Midterm 1 Mike Kowalski Statistics 151 Practice Midterm 1 Multiple Choice (50 minutes) Instructions: 1. This is a closed book exam. 2. You may use the STAT 151 formula sheets and

### Simple Methods and Procedures Used in Forecasting

Simple Methods and Procedures Used in Forecasting The project prepared by : Sven Gingelmaier Michael Richter Under direction of the Maria Jadamus-Hacura What Is Forecasting? Prediction of future events

### Chapter 23. Inferences for Regression

Chapter 23. Inferences for Regression Topics covered in this chapter: Simple Linear Regression Simple Linear Regression Example 23.1: Crying and IQ The Problem: Infants who cry easily may be more easily

### STT 200 LECTURE 1, SECTION 2,4 RECITATION 7 (10/16/2012)

STT 200 LECTURE 1, SECTION 2,4 RECITATION 7 (10/16/2012) TA: Zhen (Alan) Zhang zhangz19@stt.msu.edu Office hour: (C500 WH) 1:45 2:45PM Tuesday (office tel.: 432-3342) Help-room: (A102 WH) 11:20AM-12:30PM,

### c 2015, Jeffrey S. Simonoff 1

Modeling Lowe s sales Forecasting sales is obviously of crucial importance to businesses. Revenue streams are random, of course, but in some industries general economic factors would be expected to have

### X X X a) perfect linear correlation b) no correlation c) positive correlation (r = 1) (r = 0) (0 < r < 1)

CORRELATION AND REGRESSION / 47 CHAPTER EIGHT CORRELATION AND REGRESSION Correlation and regression are statistical methods that are commonly used in the medical literature to compare two or more variables.

### ch12 practice test SHORT ANSWER. Write the word or phrase that best completes each statement or answers the question.

ch12 practice test 1) The null hypothesis that x and y are is H0: = 0. 1) 2) When a two-sided significance test about a population slope has a P-value below 0.05, the 95% confidence interval for A) does

### CHAPTER 13. Experimental Design and Analysis of Variance

CHAPTER 13 Experimental Design and Analysis of Variance CONTENTS STATISTICS IN PRACTICE: BURKE MARKETING SERVICES, INC. 13.1 AN INTRODUCTION TO EXPERIMENTAL DESIGN AND ANALYSIS OF VARIANCE Data Collection

### An analysis appropriate for a quantitative outcome and a single quantitative explanatory. 9.1 The model behind linear regression

Chapter 9 Simple Linear Regression An analysis appropriate for a quantitative outcome and a single quantitative explanatory variable. 9.1 The model behind linear regression When we are examining the relationship

### Copyright 2010-2011 PEOPLECERT Int. Ltd and IASSC

PEOPLECERT - Personnel Certification Body 3 Korai st., 105 64 Athens, Greece, Tel.: +30 210 372 9100, Fax: +30 210 372 9101, e-mail: info@peoplecert.org, www.peoplecert.org Copyright 2010-2011 PEOPLECERT

### Linear Regression. Chapter 5. Prediction via Regression Line Number of new birds and Percent returning. Least Squares

Linear Regression Chapter 5 Regression Objective: To quantify the linear relationship between an explanatory variable (x) and response variable (y). We can then predict the average response for all subjects

### MULTIPLE REGRESSION AND ISSUES IN REGRESSION ANALYSIS

MULTIPLE REGRESSION AND ISSUES IN REGRESSION ANALYSIS MSR = Mean Regression Sum of Squares MSE = Mean Squared Error RSS = Regression Sum of Squares SSE = Sum of Squared Errors/Residuals α = Level of Significance

: Table of Contents... 1 Overview of Model... 1 Dispersion... 2 Parameterization... 3 Sigma-Restricted Model... 3 Overparameterized Model... 4 Reference Coding... 4 Model Summary (Summary Tab)... 5 Summary

### Analysing Questionnaires using Minitab (for SPSS queries contact -) Graham.Currell@uwe.ac.uk

Analysing Questionnaires using Minitab (for SPSS queries contact -) Graham.Currell@uwe.ac.uk Structure As a starting point it is useful to consider a basic questionnaire as containing three main sections:

### 10. Analysis of Longitudinal Studies Repeat-measures analysis

Research Methods II 99 10. Analysis of Longitudinal Studies Repeat-measures analysis This chapter builds on the concepts and methods described in Chapters 7 and 8 of Mother and Child Health: Research methods.

### Data Analysis Tools. Tools for Summarizing Data

Data Analysis Tools This section of the notes is meant to introduce you to many of the tools that are provided by Excel under the Tools/Data Analysis menu item. If your computer does not have that tool

### Data Mining and Data Warehousing. Henryk Maciejewski. Data Mining Predictive modelling: regression

Data Mining and Data Warehousing Henryk Maciejewski Data Mining Predictive modelling: regression Algorithms for Predictive Modelling Contents Regression Classification Auxiliary topics: Estimation of prediction

### 1.1. Simple Regression in Excel (Excel 2010).

.. Simple Regression in Excel (Excel 200). To get the Data Analysis tool, first click on File > Options > Add-Ins > Go > Select Data Analysis Toolpack & Toolpack VBA. Data Analysis is now available under

### Simple Predictive Analytics Curtis Seare

Using Excel to Solve Business Problems: Simple Predictive Analytics Curtis Seare Copyright: Vault Analytics July 2010 Contents Section I: Background Information Why use Predictive Analytics? How to use

### BA 275 Review Problems - Week 6 (10/30/06-11/3/06) CD Lessons: 53, 54, 55, 56 Textbook: pp. 394-398, 404-408, 410-420

BA 275 Review Problems - Week 6 (10/30/06-11/3/06) CD Lessons: 53, 54, 55, 56 Textbook: pp. 394-398, 404-408, 410-420 1. Which of the following will increase the value of the power in a statistical test

### UNIVERSITY OF TORONTO SCARBOROUGH Department of Computer and Mathematical Sciences Midterm Test March 2014

UNIVERSITY OF TORONTO SCARBOROUGH Department of Computer and Mathematical Sciences Midterm Test March 2014 STAB22H3 Statistics I Duration: 1 hour and 45 minutes Last Name: First Name: Student number: Aids

### A) 0.1554 B) 0.0557 C) 0.0750 D) 0.0777

Math 210 - Exam 4 - Sample Exam 1) What is the p-value for testing H1: µ < 90 if the test statistic is t=-1.592 and n=8? A) 0.1554 B) 0.0557 C) 0.0750 D) 0.0777 2) The owner of a football team claims that

### Teaching Business Statistics through Problem Solving

Teaching Business Statistics through Problem Solving David M. Levine, Baruch College, CUNY with David F. Stephan, Two Bridges Instructional Technology CONTACT: davidlevine@davidlevinestatistics.com Typical

### MULTIPLE LINEAR REGRESSION ANALYSIS USING MICROSOFT EXCEL. by Michael L. Orlov Chemistry Department, Oregon State University (1996)

MULTIPLE LINEAR REGRESSION ANALYSIS USING MICROSOFT EXCEL by Michael L. Orlov Chemistry Department, Oregon State University (1996) INTRODUCTION In modern science, regression analysis is a necessary part

### Homework 11. Part 1. Name: Score: / null

Name: Score: / Homework 11 Part 1 null 1 For which of the following correlations would the data points be clustered most closely around a straight line? A. r = 0.50 B. r = -0.80 C. r = 0.10 D. There is

### MGT 267 PROJECT. Forecasting the United States Retail Sales of the Pharmacies and Drug Stores. Done by: Shunwei Wang & Mohammad Zainal

MGT 267 PROJECT Forecasting the United States Retail Sales of the Pharmacies and Drug Stores Done by: Shunwei Wang & Mohammad Zainal Dec. 2002 The retail sale (Million) ABSTRACT The present study aims

### How To Check For Differences In The One Way Anova

MINITAB ASSISTANT WHITE PAPER This paper explains the research conducted by Minitab statisticians to develop the methods and data checks used in the Assistant in Minitab 17 Statistical Software. One-Way

### Testing for Lack of Fit

Chapter 6 Testing for Lack of Fit How can we tell if a model fits the data? If the model is correct then ˆσ 2 should be an unbiased estimate of σ 2. If we have a model which is not complex enough to fit