# Non-Linear Regression Samuel L. Baker

Save this PDF as:

Size: px
Start display at page:

## Transcription

1 NON-LINEAR REGRESSION 1 Non-Linear Regression Samuel L. Baker The linear least squares method that you have een using fits a straight line or a flat plane to a unch of data points. Sometimes the true relationship that you want to model is curved, rather than flat. For example, if something is growing exponentially, which means growing at a steady rate, the relationship etween X and Y is curve, like that shown to the right. To fit something like this, you need non-linear regression. Often, you can adapt linear least squares to do this. The method is to create new variales from your data. The new variales are nonlinear functions of the variales in your data. If you construct your new variales properly, the curved function of your original variales can e expressed as a linear function of your new variales. We will e discussing two popular non-linear equation forms that are amenale to this technique: Equation Interpretation Linear Form Y = Ae u Y = AX u Y is growing (or shrinking) at a constant relative rate of. The elasticity of Y with respect to X is a constant,. ln(y) = ln(a) + + ln(u) ln(y) = ln(a) + ln(x) + ln(u) Consider the first equation, Y = Ae u. This is an exponential growth equation. is the growth rate. u is a random error term. If you take the logarithm of oth sides of that equation, you get ln(y) = ln(a) + + ln(u). This equation has logarithms in it, ut they relate in a linear way. It is in the form y=a++error, except that y, a, and the error are logarithms. (A review of logarithms and e is coming up on the next page. Bear with me until then.) This means that if you create a new variale, the ase-e logarithm of Y, written as ln(y), you can use the regular least squares method to fit ln(y) = ln(a) + + ln(u). That is a way of fitting the curve Y = Ae to your data. (We will go over this again after the review of logarithms.) Similarly, consider the second equation, Y = AX u. This is a constant-elasticity equation (more on why I call it that later), typically used for demand curves. Take the logarithm of oth sides of that equation and you get ln(y) = ln(a) + ln(x) + ln(u). For this equation, if you create the variale ln(y) and also a variale for the ase-e logarithm of X, written

2 NON-LINEAR REGRESSION 2 as ln(x), you can use the regular least squares method to fit the curve Y = AX to your data. Before we go further into how to use these new equations, we had etter review logarithms and e. Logarithms defined: If a = c then = logac. = logac is read, is the log to the ase a of c. I rememer the logarithm definition y rememering that: The log of 1 is 0, regardless of the ase. Anything to the 0 power is 1. If I can rememer those two facts, then I can aritrarily pick 10 as my ase and write: 0 10 = 1 and log101 = 0. From that I get a = c and log c =, y sustituting a for 10, for 0, and c for 1. a You can't take the log of 0 or of a negative numer. The c in logac must e a positive numer. e ( ) is the ase of the natural logarithms (log e is written ln ). Natural logarithms are used for continuous growth rates. Something growing at a 100% annual rate, compounded continuously, will grow to e times its original size in one year. (The diagram on the preceding page shows a 100% growth rate.) r Something growing at an r annual rate, compounded continuously, will grow to e times its original size in one year. In Excel, the function =EXP(A1) raises e the power of whatever numer is in cell A1. =LN(A1) takes the natural log of whatever is in cell A1. e Some exponential algera rules a+ a e = ee a a e = (e ) ln(a) e = a ln(a) e = a 0 e = 1 Some corresponding logarithm algera rules ln( a ) = ln( a )+ln( ) ln( a ) = ln( a ) a ln( e ) = a ln( 1 ) = 0 Non-linear models that can e made linear using logarithms: Now we can get ack to the curved models introduced at the eginning of this section and give fuller explanations. Constant growth or decay equation Y = Ae Suppose you re modeling a process that you think has continuous growth at a constant growth rate. This is like the diagram on page 1. You want to estimate the growth rate from your data. u

3 NON-LINEAR REGRESSION 3 Y = Ae u is your equation. X is often a measure of time. X goes up y 1 for each second, hour, day, year, or whatever time unit you are using. Sometimes, X is a measure of dosage. A is the starting amount, the amount expected when X is 0. is the relative growth rate, with continuous compounding. u is the random error. Notice that we multiply y the error, rather than adding or sutracting the error as in standard linear regression. u has a mean of 1 and is always igger than 0. u is never 0 or negative. Use this equation if: The analogy with steady growth or decay makes sense. Y cannot e 0 or negative. X can e positive, 0, or negative. The interpretation of in Y = Ae u: is the parameter in which you are most interested, usually. Your estimate of is your estimate of the relative change in Y associated with a unit change in X. (X+1) + Mathematically, if X goes up y 1, Y is multiplied y e. That is ecause Ae equals Ae, which equals Ae e, which is Y is multiplied y e. That may not look like relative change, ut it is, if you are using continuous compounding. People who use these models usually make a simpler statement aout. They say that if X goes up y 1, Y goes up y 100 percent. They mean that if X goes up y 1, Y is multiplied y (1+). For example, if your estimate for is 0.02, then it is said that if X goes up y 1, Y goes up y 2%, ecause Y is multiplied y ( = 1.02.) The 1+ idea is fine so long as is near 0. For small values of, e is close to 1+. Multiplying y 1+ is close to the same as multiplying y e. For example, if is 0.05 and X increases y 1, Y is multiplied y.5 e, which is aout 1.051, so Y really increases y 5.1%. That is pretty close to 5%. Most things in the financial world and the pulic health world grow pretty slowly, so the 1+ or -percent idea is OK. The downloadale file aout time series has more details on this. How to make the growth/decay equation linear: To convert Y = Ae u to a linear equation, take the natural log of oth sides: ln(y) = ln(ae u) Apply the rules aove and you get: ln(y) = ln(a) + + ln(u) To implement this, create a new variale y = ln(y). (The Y in the original equation is ig Y. The new variale is little y. ) Also, define v as equaling ln(u) and a as equaling ln(a).

4 NON-LINEAR REGRESSION 4 Susitute y for ln(y), a for ln(a), and v for ln(u) in ln(y) = ln(a) + + ln(u) and you get: y = a + + v This is a linear equation! It may seem like cheating to turn a curve equation into a straight line equation this way, ut that is how it s done. Doing the analysis this way is not exactly the same as fitting a curve to points using least squares. This method this method minimizes the sum of the squares of ln(y) - (ln(a) + ), not the sum of the squares of Y - Ae. In our equation, the error term is something we multiply y rather than add. Our equation is Y=Ae u, rather than Y = Ae +u. We make our equation Y=Ae u, rather than Y = Ae +u, so that when we take the log of oth sides we get an error, which we call v, the logarithm of u in the original equation, that ehaves like errors are supposed to ehave for linear regression. For example, for linear regression we have to assume that the error s expected value is 0. To make this work, we assume that the expected value of u is 1. That makes the expected value of ln(u) equal zero, ecause ln(1) = 0. In Y=Ae u, u is never 0 or negative, ut v can take on positive or negative values, ecause if u is less than 1, v=ln(u) is less than 0. When you transform Y=Ae u to y = a + + v and do a least squares regression, here is how you interpret the coefficients: is your estimate of the growth rate. a is your estimate of ln(a). To get an estimate of A, calcualte e to the a-hat power. Getting a prediction for Y from your prediction for y After you calculate a prediction for little y, you have to convert it to ig Y. Your prediction for Y = e An example Your prediction for y. In Excel, use the =EXP() function. The first two columns are your data in a dose-response experiment. The third column is calculated from the second y taking the natural logarithm. Dose Bacteria LnBacteria

5 NON-LINEAR REGRESSION 5 Your regression results are: LnBacteria is the dependent variale, with a mean of Variale Coefficient Std Error T-statistic P-Value Intercept Dose You have found that each dose reduces the numer of acteria y aout 22%. Prediction, showing how it is calculated: Variale Coefficient * Your Value = Product Intercept Dose Total is the prediction: % conf. interval is to Your prediction for the numer of acteria if the dose is 16 is e = In Excel, calculate =EXP( ). The 90% confidence interval for that prediction is from e to e, which is aout 955 to 1488.

6 NON-LINEAR REGRESSION 6 Constant elasticity equation Y=AX u Another non-linear equation that is commonly used is the constant elasticity model. Applications include supply, demand, cost, and production functions. Y = AX u is your equation X is some continuous variale that s always igger than 0. A determines the scale. is the elasticity of Y with respect to X (more on elasticity elow). u, the error, has a mean of 1 and is always igger than 0. Use this equation if: Graph of Y=X 2 u u is log-normally distriuted with a mean of 1. X and Y are always positive. X and Y can not e 0 or negative. You suspect, or wish to test for, diminishing ( <1) or increasing ( >1) returns to scale If it is reasonale that the percentage change in Y caused y a 1% change in X is the same at any level of X (or any level of Z, if you are doing a multiple regression). That is why this is called a constant elasticity equation. A constant elasticity model can never give a negative prediction. If a negative prediction would make sense, you do not want this model. If a negative prediction would not make sense, this model may e what you want. The interpretation of, the elasticity: is the percentage change in Y that you get when X changes y 1%. Economists call the elasticity of Y with respect to X. If is positive, you see a pattern like in the diagram aove. If is negative in this equation, the pattern is like a hyperola. The points get closer and closer to the X axis as you go the right. The points get closer and closer to the Y axis and they get higher and higher as X goes to the left and gets near 0. If you do a multiple regression version of this, with the equation Y = c A X Z u, then is the percentage change in Y that you get when X changes y 1% and Z does not change. Economists say and c are elasticities of Y with respect to X and Z. -1 <1 example: Y = 5x u How to make this linear: If you take the log of oth sides of Y = A X u, you get:

7 NON-LINEAR REGRESSION 7 ln(y) = ln(a) + ln(x) + ln(u) To make this linear, create two new variales, y = ln(y) and x = ln(x). (If you have more than one X variale, take the logs of all of them.) Let a e ln(a) and v e ln(u), and our equation ecomes nice and linear: y = a + x + v As with the growth model, to use least squares, we must assume that v ehaves like errors are supposed to ehave for linear regression. One of those assumptions is that v s expected value is 0. That is why we assume that the mean of u is 1. That fits ecause ln(1) = 0. u is never 0 or negative, ut v can take on positive or negative values, ecause if u is less than 1, v=ln(u) is less than 0. The multiple regression version of the constant elasticity model works like this: c Y = A X Z u is the equation. Take the log of oth sides to get: ln(y) = ln(a) + ln(x) + c ln(z) + ln(u) which you estimate as y = a + x + c z + v where y = Ln(Y), a = ln(a), x = ln(x), etc. This equation lets you look for diminishing or increases returns to scale. If +c < 1, you have diminishing returns. Douling X and Z makes Y go up less than twofold. If +c >1, you have increasing returns. Douling X and Z makes Y more than doule. Sometimes a linear model shows heteroskedasticity -- apparently unequal variances of the errors -- that takes the form of the residuals fanning out or in as you look down the residual plot. This constant elasticity form can correct that. Getting a prediction for Y from your prediction for y As with the growth-decay model, when you calculate a prediction for y, you have to convert it to Y. You y do this y raising e to the y power, ecause Y = e. In Excel, use the =EXP() function. An example Here are some data: Price Visits LnPrice LnVisits

8 NON-LINEAR REGRESSION The first two columns are the actual data. The third and fourth columns are calculated as the natural logs of the first two columns approximately = LN(40), for example. LnVisits is the dependent variale, with a mean of Variale Coefficient Std Error T-statistic P-Value Intercept LnPrice The estimated coefficient of LnPrice says that when the price is 1% higher, there are 0.29% fewer visits. To predict visits if the price is \$25, first calculate =EXP(25). It is aout Use that in the prediction form. Prediction, showing how it is calculated: Variale Coefficient * Your Value = Product Intercept LnPrice Total is the prediction: % conf. interval is to The prediction for the logarithm of visits is The prediction for visits is =EXP( ), which is aout 353. The 90% confidence interval for that prediction is from =EXP( ) to =EXP( ), which is aout 295 to 423. Notice that 353 is not in the middle of this confidence interval.

10 NON-LINEAR REGRESSION 10 Use least squares, including the transformed variales in your data set. Your predictions, and at least some of your estimated coefficients, will have to e transformed to anti-logs to get ack to the parameters in the original non-linear equation. In oth of these equations, the predicted value of ln(y) must e transformed with the exp function to get a predicted value for Y.

### CHAPTER 13 SIMPLE LINEAR REGRESSION. Opening Example. Simple Regression. Linear Regression

Opening Example CHAPTER 13 SIMPLE LINEAR REGREION SIMPLE LINEAR REGREION! Simple Regression! Linear Regression Simple Regression Definition A regression model is a mathematical equation that descries the

### Handout for three day Learning Curve Workshop

Handout for three day Learning Curve Workshop Unit and Cumulative Average Formulations DAUMW (Credits to Professors Steve Malashevitz, Bo Williams, and prior faculty. Blame to Dr. Roland Kankey, roland.kankey@dau.mil)

### QUADRATIC EQUATIONS EXPECTED BACKGROUND KNOWLEDGE

MODULE - 1 Quadratic Equations 6 QUADRATIC EQUATIONS In this lesson, you will study aout quadratic equations. You will learn to identify quadratic equations from a collection of given equations and write

### 10.1 Systems of Linear Equations: Substitution and Elimination

726 CHAPTER 10 Systems of Equations and Inequalities 10.1 Systems of Linear Equations: Sustitution and Elimination PREPARING FOR THIS SECTION Before getting started, review the following: Linear Equations

### Simple Regression Theory I 2010 Samuel L. Baker

SIMPLE REGRESSION THEORY I 1 Simple Regression Theory I 2010 Samuel L. Baker Regression analysis lets you use data to explain and predict. A simple regression line drawn through data points In Assignment

### KSTAT MINI-MANUAL. Decision Sciences 434 Kellogg Graduate School of Management

KSTAT MINI-MANUAL Decision Sciences 434 Kellogg Graduate School of Management Kstat is a set of macros added to Excel and it will enable you to do the statistics required for this course very easily. To

### Number Who Chose This Maximum Amount

1 TASK 3.3.1: MAXIMIZING REVENUE AND PROFIT Solutions Your school is trying to oost interest in its athletic program. It has decided to sell a pass that will allow the holder to attend all athletic events

### Exponential equations will be written as, where a =. Example 1: Determine a formula for the exponential function whose graph is shown below.

.1 Eponential and Logistic Functions PreCalculus.1 EXPONENTIAL AND LOGISTIC FUNCTIONS 1. Recognize eponential growth and deca functions 2. Write an eponential function given the -intercept and another

### Simple Predictive Analytics Curtis Seare

Using Excel to Solve Business Problems: Simple Predictive Analytics Curtis Seare Copyright: Vault Analytics July 2010 Contents Section I: Background Information Why use Predictive Analytics? How to use

### Nominal and Real U.S. GDP 1960-2001

Problem Set #5-Key Sonoma State University Dr. Cuellar Economics 318- Managerial Economics Use the data set for gross domestic product (gdp.xls) to answer the following questions. (1) Show graphically

### Substitute 4 for x in the function, Simplify.

Page 1 of 19 Review of Eponential and Logarithmic Functions An eponential function is a function in the form of f ( ) = for a fied ase, where > 0 and 1. is called the ase of the eponential function. The

### Unit of Study Exponents

DRAFT Unit of Study Exponents Grade: 8 Topic: Exponent operations and rules Length of Unit: days Focus of Learning Common Core Standards: Work with Radicals and Integer Exponents 8.EE. Know and apply the

### Experiment #1, Analyze Data using Excel, Calculator and Graphs.

Physics 182 - Fall 2014 - Experiment #1 1 Experiment #1, Analyze Data using Excel, Calculator and Graphs. 1 Purpose (5 Points, Including Title. Points apply to your lab report.) Before we start measuring

### Quadratic Functions [Judy Ahrens, Pellissippi State Technical Community College]

Quadratic unctions [Judy Ahrens, Pellissippi State Technical Community College] A quadratic function may always e written in the form f(x)= ax + x + c, where a 0. The degree of the function is (the highest

### Probability, Mean and Median

Proaility, Mean and Median In the last section, we considered (proaility) density functions. We went on to discuss their relationship with cumulative distriution functions. The goal of this section is

### San Jose State University Engineering 10 1

KY San Jose State University Engineering 10 1 Select Insert from the main menu Plotting in Excel Select All Chart Types San Jose State University Engineering 10 2 Definition: A chart that consists of multiple

### Simple Regression Theory II 2010 Samuel L. Baker

SIMPLE REGRESSION THEORY II 1 Simple Regression Theory II 2010 Samuel L. Baker Assessing how good the regression equation is likely to be Assignment 1A gets into drawing inferences about how close the

### FRACTIONS: MULTIPLICATION 1

. Fractions: Fractions Multiplication FRACTIONS: MULTIPLICATION In this lesson students extend the concepts and procedures for multiplication of whole numers to fractions. They interpret multiplication

### ω h (t) = Ae t/τ. (3) + 1 = 0 τ =.

MASSACHUSETTS INSTITUTE OF TECHNOLOGY Department of Mechanical Engineering 2.004 Dynamics and Control II Fall 2007 Lecture 2 Solving the Equation of Motion Goals for today Modeling of the 2.004 La s rotational

### We are going to delve into some economics today. Specifically we are going to talk about production and returns to scale.

Firms and Production We are going to delve into some economics today. Secifically we are going to talk aout roduction and returns to scale. firm - an organization that converts inuts such as laor, materials,

### Forecast. Forecast is the linear function with estimated coefficients. Compute with predict command

Forecast Forecast is the linear function with estimated coefficients T T + h = b0 + b1timet + h Compute with predict command Compute residuals Forecast Intervals eˆ t = = y y t+ h t+ h yˆ b t+ h 0 b Time

### GRAPHING WITH LOGARITHMIC PAPER

Page 1 of 5 GRAPHING WITH LOGARITHMIC PAPER Department of Physics, University of Guelph Guelph, Ontario, Canada http://www.physics.uoguelph.ca Go to this site to print free graph paper (en francais aussi):

### Magnetometer Realignment: Theory and Implementation

Magnetometer Realignment: heory and Implementation William Premerlani, Octoer 16, 011 Prolem A magnetometer that is separately mounted from its IMU partner needs to e carefully aligned with the IMU in

### Module 5: Multiple Regression Analysis

Using Statistical Data Using to Make Statistical Decisions: Data Multiple to Make Regression Decisions Analysis Page 1 Module 5: Multiple Regression Analysis Tom Ilvento, University of Delaware, College

### WHAT IS A BETTER PREDICTOR OF ACADEMIC SUCCESS IN AN MBA PROGRAM: WORK EXPERIENCE OR THE GMAT?

WHAT IS A BETTER PREDICTOR OF ACADEMIC SUCCESS IN AN MBA PROGRAM: WORK EXPERIENCE OR THE GMAT? Michael H. Deis, School of Business, Clayton State University, Morrow, Georgia 3060, (678)466-4541, MichaelDeis@clayton.edu

### A Primer on Forecasting Business Performance

A Primer on Forecasting Business Performance There are two common approaches to forecasting: qualitative and quantitative. Qualitative forecasting methods are important when historical data is not available.

### Motor and Household Insurance: Pricing to Maximise Profit in a Competitive Market

Motor and Household Insurance: Pricing to Maximise Profit in a Competitive Market by Tom Wright, Partner, English Wright & Brockman 1. Introduction This paper describes one way in which statistical modelling

### Nonlinear Regression Functions. SW Ch 8 1/54/

Nonlinear Regression Functions SW Ch 8 1/54/ The TestScore STR relation looks linear (maybe) SW Ch 8 2/54/ But the TestScore Income relation looks nonlinear... SW Ch 8 3/54/ Nonlinear Regression General

### SAS Software to Fit the Generalized Linear Model

SAS Software to Fit the Generalized Linear Model Gordon Johnston, SAS Institute Inc., Cary, NC Abstract In recent years, the class of generalized linear models has gained popularity as a statistical modeling

### 4. Simple regression. QBUS6840 Predictive Analytics. https://www.otexts.org/fpp/4

4. Simple regression QBUS6840 Predictive Analytics https://www.otexts.org/fpp/4 Outline The simple linear model Least squares estimation Forecasting with regression Non-linear functional forms Regression

### Course 4 Examination Questions And Illustrative Solutions. November 2000

Course 4 Examination Questions And Illustrative Solutions Novemer 000 1. You fit an invertile first-order moving average model to a time series. The lag-one sample autocorrelation coefficient is 0.35.

### Section 0.3 Power and exponential functions

Section 0.3 Power and eponential functions (5/6/07) Overview: As we will see in later chapters, man mathematical models use power functions = n and eponential functions =. The definitions and asic properties

### MBA Jump Start Program

MBA Jump Start Program Module 2: Mathematics Thomas Gilbert Mathematics Module Online Appendix: Basic Mathematical Concepts 2 1 The Number Spectrum Generally we depict numbers increasing from left to right

### Penalized regression: Introduction

Penalized regression: Introduction Patrick Breheny August 30 Patrick Breheny BST 764: Applied Statistical Modeling 1/19 Maximum likelihood Much of 20th-century statistics dealt with maximum likelihood

### Semi-Log Model. Semi-Log Model

Semi-Log Model The slope coefficient measures the relative change in Y for a given absolute change in the value of the explanatory variable (t). Semi-Log Model Using calculus: ln Y b2 = t 1 Y = Y t Y =

### Straightening Data in a Scatterplot Selecting a Good Re-Expression Model

Straightening Data in a Scatterplot Selecting a Good Re-Expression What Is All This Stuff? Here s what is included: Page 3: Graphs of the three main patterns of data points that the student is likely to

### Tutorial on Using Excel Solver to Analyze Spin-Lattice Relaxation Time Data

Tutorial on Using Excel Solver to Analyze Spin-Lattice Relaxation Time Data In the measurement of the Spin-Lattice Relaxation time T 1, a 180 o pulse is followed after a delay time of t with a 90 o pulse,

### X X X a) perfect linear correlation b) no correlation c) positive correlation (r = 1) (r = 0) (0 < r < 1)

CORRELATION AND REGRESSION / 47 CHAPTER EIGHT CORRELATION AND REGRESSION Correlation and regression are statistical methods that are commonly used in the medical literature to compare two or more variables.

What Does Your Quadratic Look Like? EXAMPLES 1. An equation such as y = x 2 4x + 1 descries a type of function known as a quadratic function. Review with students that a function is a relation in which

### Linear Approximations ACADEMIC RESOURCE CENTER

Linear Approximations ACADEMIC RESOURCE CENTER Table of Contents Linear Function Linear Function or Not Real World Uses for Linear Equations Why Do We Use Linear Equations? Estimation with Linear Approximations

### Introduction to Regression and Data Analysis

Statlab Workshop Introduction to Regression and Data Analysis with Dan Campbell and Sherlock Campbell October 28, 2008 I. The basics A. Types of variables Your variables may take several forms, and it

### Appendix E: Graphing Data

You will often make scatter diagrams and line graphs to illustrate the data that you collect. Scatter diagrams are often used to show the relationship between two variables. For example, in an absorbance

### 1. What is the critical value for this 95% confidence interval? CV = z.025 = invnorm(0.025) = 1.96

1 Final Review 2 Review 2.1 CI 1-propZint Scenario 1 A TV manufacturer claims in its warranty brochure that in the past not more than 10 percent of its TV sets needed any repair during the first two years

### NCSS Statistical Software Principal Components Regression. In ordinary least squares, the regression coefficients are estimated using the formula ( )

Chapter 340 Principal Components Regression Introduction is a technique for analyzing multiple regression data that suffer from multicollinearity. When multicollinearity occurs, least squares estimates

### REGRESSION LINES IN STATA

REGRESSION LINES IN STATA THOMAS ELLIOTT 1. Introduction to Regression Regression analysis is about eploring linear relationships between a dependent variable and one or more independent variables. Regression

### ANALYSIS OF TREND CHAPTER 5

ANALYSIS OF TREND CHAPTER 5 ERSH 8310 Lecture 7 September 13, 2007 Today s Class Analysis of trends Using contrasts to do something a bit more practical. Linear trends. Quadratic trends. Trends in SPSS.

### Microeconomic Theory: Basic Math Concepts

Microeconomic Theory: Basic Math Concepts Matt Van Essen University of Alabama Van Essen (U of A) Basic Math Concepts 1 / 66 Basic Math Concepts In this lecture we will review some basic mathematical concepts

### 11. Analysis of Case-control Studies Logistic Regression

Research methods II 113 11. Analysis of Case-control Studies Logistic Regression This chapter builds upon and further develops the concepts and strategies described in Ch.6 of Mother and Child Health:

### Statistical Models in R

Statistical Models in R Some Examples Steven Buechler Department of Mathematics 276B Hurley Hall; 1-6233 Fall, 2007 Outline Statistical Models Linear Models in R Regression Regression analysis is the appropriate

### where G is the universal gravitational constant (approximately 6.67 10 11 Nm 2 /kg 2 ) and M is the sun s mass (approximately 2 10 24 kg).

Kepler s Third Law ID: 8515 By Michele Impedovo Time required 2 hours Activity Overview Johannes Kepler (1571-1630) is remembered for laying firm mathematical foundations for modern astronomy through his

### 1) Write the following as an algebraic expression using x as the variable: Triple a number subtracted from the number

1) Write the following as an algebraic expression using x as the variable: Triple a number subtracted from the number A. 3(x - x) B. x 3 x C. 3x - x D. x - 3x 2) Write the following as an algebraic expression

### " Y. Notation and Equations for Regression Lecture 11/4. Notation:

Notation: Notation and Equations for Regression Lecture 11/4 m: The number of predictor variables in a regression Xi: One of multiple predictor variables. The subscript i represents any number from 1 through

### Online Appendix: Bank Competition, Risk Taking and Their Consequences

Online Appendix: Bank Competition, Risk Taking and Their Consequences Xiaochen (Alan) Feng Princeton University - Not for Pulication- This version: Novemer 2014 (Link to the most updated version) OA1.

### Simple linear regression

Simple linear regression Introduction Simple linear regression is a statistical method for obtaining a formula to predict values of one variable from another where there is a causal relationship between

### Statistics courses often teach the two-sample t-test, linear regression, and analysis of variance

2 Making Connections: The Two-Sample t-test, Regression, and ANOVA In theory, there s no difference between theory and practice. In practice, there is. Yogi Berra 1 Statistics courses often teach the two-sample

### Elementary Statistics. Scatter Plot, Regression Line, Linear Correlation Coefficient, and Coefficient of Determination

Scatter Plot, Regression Line, Linear Correlation Coefficient, and Coefficient of Determination What is a Scatter Plot? A Scatter Plot is a plot of ordered pairs (x, y) where the horizontal axis is used

### Logs Transformation in a Regression Equation

Fall, 2001 1 Logs as the Predictor Logs Transformation in a Regression Equation The interpretation of the slope and intercept in a regression change when the predictor (X) is put on a log scale. In this

### Chapter 9: Univariate Time Series Analysis

Chapter 9: Univariate Time Series Analysis In the last chapter we discussed models with only lags of explanatory variables. These can be misleading if: 1. The dependent variable Y t depends on lags of

### AP Physics 1 and 2 Lab Investigations

AP Physics 1 and 2 Lab Investigations Student Guide to Data Analysis New York, NY. College Board, Advanced Placement, Advanced Placement Program, AP, AP Central, and the acorn logo are registered trademarks

### Review for Calculus Rational Functions, Logarithms & Exponentials

Definition and Domain of Rational Functions A rational function is defined as the quotient of two polynomial functions. F(x) = P(x) / Q(x) The domain of F is the set of all real numbers except those for

### LAGUARDIA COMMUNITY COLLEGE CITY UNIVERSITY OF NEW YORK DEPARTMENT OF MATHEMATICS, ENGINEERING, AND COMPUTER SCIENCE

LAGUARDIA COMMUNITY COLLEGE CITY UNIVERSITY OF NEW YORK DEPARTMENT OF MATHEMATICS, ENGINEERING, AND COMPUTER SCIENCE MAT 119 STATISTICS AND ELEMENTARY ALGEBRA 5 Lecture Hours, 2 Lab Hours, 3 Credits Pre-

### Univariate Regression

Univariate Regression Correlation and Regression The regression line summarizes the linear relationship between 2 variables Correlation coefficient, r, measures strength of relationship: the closer r is

: Table of Contents... 1 Overview of Model... 1 Dispersion... 2 Parameterization... 3 Sigma-Restricted Model... 3 Overparameterized Model... 4 Reference Coding... 4 Model Summary (Summary Tab)... 5 Summary

### 5 Double Integrals over Rectangular Regions

Chapter 7 Section 5 Doule Integrals over Rectangular Regions 569 5 Doule Integrals over Rectangular Regions In Prolems 5 through 53, use the method of Lagrange multipliers to find the indicated maximum

### Using Excel (Microsoft Office 2007 Version) for Graphical Analysis of Data

Using Excel (Microsoft Office 2007 Version) for Graphical Analysis of Data Introduction In several upcoming labs, a primary goal will be to determine the mathematical relationship between two variable

### Correlation key concepts:

CORRELATION Correlation key concepts: Types of correlation Methods of studying correlation a) Scatter diagram b) Karl pearson s coefficient of correlation c) Spearman s Rank correlation coefficient d)

### 8. Time Series and Prediction

8. Time Series and Prediction Definition: A time series is given by a sequence of the values of a variable observed at sequential points in time. e.g. daily maximum temperature, end of day share prices,

### Microeconomics Sept. 16, 2010 NOTES ON CALCULUS AND UTILITY FUNCTIONS

DUSP 11.203 Frank Levy Microeconomics Sept. 16, 2010 NOTES ON CALCULUS AND UTILITY FUNCTIONS These notes have three purposes: 1) To explain why some simple calculus formulae are useful in understanding

### e = random error, assumed to be normally distributed with mean 0 and standard deviation σ

1 Linear Regression 1.1 Simple Linear Regression Model The linear regression model is applied if we want to model a numeric response variable and its dependency on at least one numeric factor variable.

### Unit 31 A Hypothesis Test about Correlation and Slope in a Simple Linear Regression

Unit 31 A Hypothesis Test about Correlation and Slope in a Simple Linear Regression Objectives: To perform a hypothesis test concerning the slope of a least squares line To recognize that testing for a

### Psychology 205: Research Methods in Psychology

Psychology 205: Research Methods in Psychology Using R to analyze the data for study 2 Department of Psychology Northwestern University Evanston, Illinois USA November, 2012 1 / 38 Outline 1 Getting ready

### Time Series Analysis

Time Series Analysis Identifying possible ARIMA models Andrés M. Alonso Carolina García-Martos Universidad Carlos III de Madrid Universidad Politécnica de Madrid June July, 2012 Alonso and García-Martos

### Introduction to time series analysis

Introduction to time series analysis Margherita Gerolimetto November 3, 2010 1 What is a time series? A time series is a collection of observations ordered following a parameter that for us is time. Examples

### Multiple Linear Regression

Multiple Linear Regression A regression with two or more explanatory variables is called a multiple regression. Rather than modeling the mean response as a straight line, as in simple regression, it is

### Learning Objectives. Essential Concepts

Learning Objectives After reading Chapter 7 and working the problems for Chapter 7 in the textbook and in this Workbook, you should be able to: Specify an empirical demand function both linear and nonlinear

### Lesson Lesson Outline Outline

Lesson 15 Linear Regression Lesson 15 Outline Review correlation analysis Dependent and Independent variables Least Squares Regression line Calculating l the slope Calculating the Intercept Residuals and

### Prentice Hall Mathematics: Algebra 1 2007 Correlated to: Michigan Merit Curriculum for Algebra 1

STRAND 1: QUANTITATIVE LITERACY AND LOGIC STANDARD L1: REASONING ABOUT NUMBERS, SYSTEMS, AND QUANTITATIVE SITUATIONS Based on their knowledge of the properties of arithmetic, students understand and reason

### 0 Introduction to Data Analysis Using an Excel Spreadsheet

Experiment 0 Introduction to Data Analysis Using an Excel Spreadsheet I. Purpose The purpose of this introductory lab is to teach you a few basic things about how to use an EXCEL 2010 spreadsheet to do

### Scatter Plot, Correlation, and Regression on the TI-83/84

Scatter Plot, Correlation, and Regression on the TI-83/84 Summary: When you have a set of (x,y) data points and want to find the best equation to describe them, you are performing a regression. This page

### INTRODUCTORY STATISTICS

INTRODUCTORY STATISTICS FIFTH EDITION Thomas H. Wonnacott University of Western Ontario Ronald J. Wonnacott University of Western Ontario WILEY JOHN WILEY & SONS New York Chichester Brisbane Toronto Singapore

### EXCEL Tutorial: How to use EXCEL for Graphs and Calculations.

EXCEL Tutorial: How to use EXCEL for Graphs and Calculations. Excel is powerful tool and can make your life easier if you are proficient in using it. You will need to use Excel to complete most of your

### LOGISTIC REGRESSION. Nitin R Patel. where the dependent variable, y, is binary (for convenience we often code these values as

LOGISTIC REGRESSION Nitin R Patel Logistic regression extends the ideas of multiple linear regression to the situation where the dependent variable, y, is binary (for convenience we often code these values

### Forecasting in STATA: Tools and Tricks

Forecasting in STATA: Tools and Tricks Introduction This manual is intended to be a reference guide for time series forecasting in STATA. It will be updated periodically during the semester, and will be

### Answer: C. The strength of a correlation does not change if units change by a linear transformation such as: Fahrenheit = 32 + (5/9) * Centigrade

Statistics Quiz Correlation and Regression -- ANSWERS 1. Temperature and air pollution are known to be correlated. We collect data from two laboratories, in Boston and Montreal. Boston makes their measurements

### Technology Step-by-Step Using StatCrunch

Technology Step-by-Step Using StatCrunch Section 1.3 Simple Random Sampling 1. Select Data, highlight Simulate Data, then highlight Discrete Uniform. 2. Fill in the following window with the appropriate

### Categorical Data Analysis

Richard L. Scheaffer University of Florida The reference material and many examples for this section are based on Chapter 8, Analyzing Association Between Categorical Variables, from Statistical Methods

### Appendix C: Graphs. Vern Lindberg

Vern Lindberg 1 Making Graphs A picture is worth a thousand words. Graphical presentation of data is a vital tool in the sciences and engineering. Good graphs convey a great deal of information and can

### , has mean A) 0.3. B) the smaller of 0.8 and 0.5. C) 0.15. D) which cannot be determined without knowing the sample results.

BA 275 Review Problems - Week 9 (11/20/06-11/24/06) CD Lessons: 69, 70, 16-20 Textbook: pp. 520-528, 111-124, 133-141 An SRS of size 100 is taken from a population having proportion 0.8 of successes. An

### DEPARTMENT OF PSYCHOLOGY UNIVERSITY OF LANCASTER MSC IN PSYCHOLOGICAL RESEARCH METHODS ANALYSING AND INTERPRETING DATA 2 PART 1 WEEK 9

DEPARTMENT OF PSYCHOLOGY UNIVERSITY OF LANCASTER MSC IN PSYCHOLOGICAL RESEARCH METHODS ANALYSING AND INTERPRETING DATA 2 PART 1 WEEK 9 Analysis of covariance and multiple regression So far in this course,

### FINAL EXAM SECTIONS AND OBJECTIVES FOR COLLEGE ALGEBRA

FINAL EXAM SECTIONS AND OBJECTIVES FOR COLLEGE ALGEBRA 1.1 Solve linear equations and equations that lead to linear equations. a) Solve the equation: 1 (x + 5) 4 = 1 (2x 1) 2 3 b) Solve the equation: 3x

### Numerical Methods Lecture 5 - Curve Fitting Techniques

Numerical Methods Lecture 5 - Curve Fitting Techniques Topics motivation interpolation linear regression higher order polynomial form exponential form Curve fitting - motivation For root finding, we used

### Chapter 8 Graphs and Functions:

Chapter 8 Graphs and Functions: Cartesian axes, coordinates and points 8.1 Pictorially we plot points and graphs in a plane (flat space) using a set of Cartesian axes traditionally called the x and y axes

### CURVE FITTING LEAST SQUARES APPROXIMATION

CURVE FITTING LEAST SQUARES APPROXIMATION Data analysis and curve fitting: Imagine that we are studying a physical system involving two quantities: x and y Also suppose that we expect a linear relationship

### CHAPTER FIVE. Solutions for Section 5.1. Skill Refresher. Exercises

CHAPTER FIVE 5.1 SOLUTIONS 265 Solutions for Section 5.1 Skill Refresher S1. Since 1,000,000 = 10 6, we have x = 6. S2. Since 0.01 = 10 2, we have t = 2. S3. Since e 3 = ( e 3) 1/2 = e 3/2, we have z =

### Poisson Models for Count Data

Chapter 4 Poisson Models for Count Data In this chapter we study log-linear models for count data under the assumption of a Poisson error structure. These models have many applications, not only to the

### Week 5: Multiple Linear Regression

BUS41100 Applied Regression Analysis Week 5: Multiple Linear Regression Parameter estimation and inference, forecasting, diagnostics, dummy variables Robert B. Gramacy The University of Chicago Booth School