Introduction to Time Series Data

Size: px
Start display at page:

Download "Introduction to Time Series Data"

Transcription

1 Topic 8 Introduction to Time Series Data ARE/ECN 240 A Graduate Econometrics Professor: Òscar Jordà

2 Outline of this topic Dependence and covariance-stationarity, ergodicity and CLT for MDS Wold representation theorem Autoregressive models Properties Forecasting Estimation Moving average models

3 Dependent Samples So far we have assumed availability of random i samples, i.e. fy i ;X i g n i:i:d: i=1 with y i ;X i» D(¹; Ð) Now, the joint density for fy 1 ;:::;y T g is: f(y 1 ; :::; Y T jx; ) 6=f(y 1 jx; ):::f(y T jx; ) =f(y 1 jx; )f(y 2 jy 1 ;X; )::: f(y t jy t 1 ;:::;y 1 ;X; ):::f(y T jy T 1 ; :::; y 1 ;X; ) Key: find a way to limit the amount of dependence on the past, limit the memory

4 Example: Okun s Law Recall, Okun s law relates changes in GDP with changes in the unemployment rate. But GDP today is correlated with past GDP. Suppose that y t = x t + u t i:i:d u t = ½u t 1 + ² t ; ² t» D(0;¾ 2 ) Hence y t 1 = x t 1 + u t 1 so the residual process is (y t x t ) = ½(y t 1 1 x t 1 ) + ² t or in regression form: y t = x t + ½y t 1 x t 1 ½ + ² t y t = x t + ½y t 1 + x t 1 ± + ² t

5 Okun s law continued Therefore, if serial correlation is limited to one period, f(y t jy t 1 ;:::;y 1 ;X; ) =f(y t jy t 1 ;X; ) and dhence f(y 1 ;:::;y T jx; ) =f(y 1 jx; ) T t=2f(y t jy t 1 ;X; ) which except for the marginal density for the first observation, looks like the usual maximum likelihood.

6 STATA Example: Okun s Law. reg dy du Source SS df MS Number of obs = 243 F( 1, 241) = Model Prob > F = Residual R-squared = Adj R-squared = Total Root MSE = dy Coef. Std. Err. t P> t [95% Conf. Interval] du _cons estat dwatson Durbin-Watson d-statistic( 2, 243) =

7 Residual Serial Correlation. corrgram e LAG AC PAC Q Prob>Q [Autocorrelation] [Partial Autocor]

8 STATA Example (cont.). reg dy du l1.dy l1.du Source SS df MS Number of obs = 242 F( 3, 238) = Model Prob > F = Residual R-squared = Adj R-squared = Total Root MSE = dy Coef. Std. Err. t P> t [95% Conf. Interval] du dy L du L _cons estat dwatson Durbin-Watson d-statistic( 4, 242) =

9 Residual Serial Correlation. corrgram e LAG AC PAC Q Prob>Q [Autocorrelation] [Partial Autocor]

10 Covariance stationarity A basic concept in time series meant to give limits to the amount of memory that is acceptable. fy t gis covariance (weakly) stationary if E(y t )=¹ is independent of t and cov(y t ; y t j ) = j is independent of t for all j. (j) is called the autocovariance function. Notice that corr(y j t ; y t j ) = = ½ j 0 ½(j) is called the autocorrelation function

11 Ergodicity fy t gis strictly stationary if the joint distribution of (y t ; :::; y t j ) is the same as that for (y s ; :::; y s j ) for any t and j. Ergodicity: a stationary time series is ergodic if (j)! 0asj!1 Ergodic Theorem: (LLN) If fy t g is strictly stationary and ergodic with Ejy t j < 1 then as T!1 1 X T p yt y t! E(yt t ) T t=1

12 Ergodic Theorem (cont.) If in addition E(y t 2 ) < 1 then as T!1 T ^¹ p! ¹ ^¹ = 1 TX y t ; ¹ = E(y t ) p T ^ t=1 j! j j p ^½ j! ½j ^ j = 1 TX (y t ^¹)(y t j ^¹) T j j t=j+1

13 Common Transformations gdp u q1 1960q1 1970q1 1980q1 1990q1 2000q1 2010q1 qtr 1950q1 1960q1 1970q1 1980q1 1990q1 2000q1 2010q1 qtr -5 0 d dy du q1 1960q1 1970q1 1980q1 1990q1 2000q1 2010q1 qtr q1 1960q1 1970q1 1980q1 1990q1 2000q1 2010q1 qtr

14 Common Transformations Detrending: Linear trend: y t = + t + y t First difference transformation Growth rate transformation: log(y t )=log(y t ) log(y t 1 ) s-difference transformation: s-growth transformation y t = y t y t 1 s y t = y t y t s s log(y t ) = log(y t ) log(y t s )

15 Seasonal Adjustments Dummy variable adjustments: SX y t = s d s t + y t with d s t =1ift 2 season s; 0otherwise s=1 X11; X12: these are seasonal filters used by statistical ti ti agencies when they report seasonally adjusted data.

16 Wold representation theorem Any covariance-stationary series y t can be written as an infinite moving-average process MA( 1) of its innovation process or prediction error, i.e. 1 1X y t = ¹ + à j ² t j ; with the convention à 0 =1 and j=1 E(² t )=0;E(² t ² t j )=¾ 2 < 1 if j =0; 0otherwise Sometimes also called the impulse response representation. Notice: IR(y t+j ; ² t =1) = E(y t+j j² t =1; F t 1 1) ) E(y t+j j² t =0; F t 1 1) ) = à j

17 Autoregressions The simplest time series model, the AR(1) y t = + ½y t 1 + ² t! E(y t jf t 1 )= + ½y t 1 if E(² t jf t 1 )=0 Definition: ² t is a martingale difference sequence if E(² t jf t 1 ) =0 Recall, previously correct specification meant Now E(² i jx i )=0! E(Xi² 0 i )=0 E(² t jf t 1 )=0! E(y t j ² t )=0foranyj>0 0

18 AR(1) zero-mean Model Suppose f² t gis i.i.d. with E(² t )=0;E(² 2 t )=¾ 2 < 1 y t = ½y t 1 + ² t = ½(½y t 2 + ² t 1 )+² t we will need the = ½y condition j to t 2 + ² t + ½² j½j < 1 t 1 limit the memory. = ::: If j½j = 1then we have X t 1 = ½y infinite memory. 1 + ½ j ² t j j=0 If j½j > 1 then the 1X process is explosive. = ½ j ² t j Wold representation j=0

19 Properties of the AR(1) If j½j < 1 then fy t g is strictly stationary and 1 ergodic and 1X E(yt t )= ½ j E(² t )=0 V (y t )= Lag operator notation: j=0 1X ½ 2j V (² t )= j=0 0 L j y t = y t j ¾2 1 ½ 2 y t = ½y t 1 + ² t =) (1 ½L)y t = ² t =) y t = ² t 1 ½L = 1X 1X ½ j L j ² = j t ½ ² t j j=0 j=0 ² t

20 The AR(1) Impulse Response Function 1.2 Response of Y to Nonfactorized One Unit Y Innovation RHO = Response of Y to Nonfactorized One Unit Y Innovation RHO =

21 Forecasting with the AR(1) Recall y t = + ½y t 1 + ² t By recursive substitution: y T +h = + ½ + ::: + ½ h 1 + ½ h y T + ² T +h + ½² +h 1 + ::: + h 1 T ½ ² T For simplicity, assume =0, then ^y T (h) = E(y T +h jy T ) = ½ h y T Notice h 1 ^u T (h) = y T +h ^y T (h) = ² T +h + ::: + ½ h 1 ² T

22 Forecasting (cont.) Hence, the forecast error variance for the conditional mean forecast ^y T (h) = E(y T +h jy T ) is V (^u T (h)) = V (² T +h + ::: + ½ h 1 ² T ) = ¾ 2 (1+½ 2 + ::: + ½ 2(h 1) )

23 Statistical ti ti Properties of the AR(1) Estimation: y t = + ½y t 1 + ² t with Y where T T = T p; p = 1 1 Define: x t = (1 y t 1 ) with X =( ½) 0 Using least-squares: T 2 y t = x t + ² t! ^ =(X 0 X) 1 X 0 Y For example, if = 0 then: ^½ = ^ 1 ½ ^ 0

24 Consistency Define: u t = x 0 t² t with u t amartingaledi.sequence(mds)since E(u t jf t 1 )=E(x 0 t² t jf t 1 )=0 1 TX x 0 T t² t = 1 TX p u t! E(ut )=0 T t=p+1 t=p+1 1 TX By the ergodic theorem: x 0 p T tx t! E(x 0 t x t )=Q t=p+1 Ã! 1 Ã! 1 TX ^ = + x 0 1 TX T tx t x 0 p T t² t! Q 1 0=0 T t=p+1 T t=p+1

25 CLT for MDS If u t is a strictly stationary and ergodic MDS and E(u 0 tu t )=Ð< 1 then as T!1 1 TX d 1 TX d pt u t! N(0; Ð)! p x 0 t² t! N(0; Ð) T t=p+1 T t=p+1 Ð=E(x 0 tx t ² 2 t ) Hence, if y t is strictly stationary and ergodic with E(y t 4 ) < 1 then p d T ( ^ )! N(0;Q 1 ÐQ 1 )

26 AR(p) Models More generally: y t = + ½ 1 y t 1 + ::: + ½ p y t p + ² t Stationarity: (1 ½ 1 L ::: ½ p L p )y t = ² t From the fundamental theorem of algebra: ½(L) =(1 ½ 1 L :::½ p L p ) =) ½(z) =(1 1 1 z):::(1 1 p z) 1;:::; p are the roots (possibly some complex) such that ½( j) =0: Stationarity =) ) j jj j outside the unit circle

27 The Unit Circle Let j = a + bi

28 The VAR(1) representation of an AR(1) A convenient way to express an AR(p): y t = ½ 1 y t 1 + ::: + ½ p y t p + ² t yt ½1 ::: yt 1 ²t y 6 t = 6 ½ 1 ½ 2 ½ p 1 0 ::: y t ::: ::: ::: ::: y t p+1 0 ::: 1 0 y t p 0 Y t = BY t 1 + V t Stationarity: ti it all eigenvalues of B inside id the unit circle

29 Example Suppose: y t = y t 1 0:25y t 2 + ² t Therefore: 1 0:25 B = 1 0 with eigenvalues:» b = 1~ ~0;» eig(b); Notice: (1 0:5L)(1 0:5L) =1 L +0:25L 2

30 VAR(1) state-space t representation ti Also useful to generate forecasts since: Y t+h = B h Y t + V t+h + BV t+h 1 + ::: + B h 1 V t+1 Hence the forecast for y t+h we can just read off the first row from Y t+h Choosing the lag length p: Use Wald tests Use information criteria, e.g. AIC(p) =log^¾ 2 + 2p T

31 AR(p)! MA(1) If AR(p) is stationary, then the lag polynomial is invertible as an infinite MA process (actually, its Wold representation). A recursive formula: note (1 ½ 1 L ::: ½ p L p )y t =² t ½(L)y 1 t = ² t =) ½(L) ½(L)y t =(1 + à 1 L + :::)² t or (1 ½L ::: ½ p L p )(1 + à 1 + :::) =1 equating terms in L j à 1 L ½ 1 L =0 =) à 1 = ½ 1 à 2 L 2 ½ 2 L 2 ½ 1 à 1 L 2 =0 =) à 2 = ½ 1 à 1 + ½ 2 ::: à j = ½ 1 à j 1 + ½ 2 à j 2 + ::: + ½ j 1 à 1 + ½ j

32 Whyisthisuseful? Several reasons: 1. Recall that the variance of the forecast error of an AR(p) is: V (y t+h ^y t (h)) = (1 + Ã1 2 + Ã2 2 + ::: + Ãh 1)¾ To calculate impulse responses (sort of a treatment effect): IR(y t ; h) =E(y t+h j² t =1; F t 1 ) E(y t+h j² t =0; F t 1 ) =(0 + Ã 1 0+::: + Ã h 1+Ã h+1 0+:::) (0 + Ã 1 0+::: + Ã h 0+Ã h+1 0+:::) =Ã h

33 MA(q) Models The Wold representation theorem says that any covariance-stationary process has a (possibly) infinite MA representation. Now let me discuss MA(q) models briefly General specification: MA(1) y t = ¹ + ² t + μ 1 ² t 1 + ::: + μ q ² t q y t =¹ + ² t + μ² t 1 =¹ +(1+μL)² t

34 Properties of the MA(1) Expectation: E(y t )=E(¹ + ² t + μ² t 1 )=¹ Variance: Autocovariance: Autocorrelation: E(y t ¹) 2 = E(² t + μ² t 1 ) 2 =(1+μ 2 )¾ 2 E[(y t ¹)(y t j ¹)] = j =0forj>1 1 = E[(y t ¹)(y t 1 ¹) =E(² t + μ² t 1 )(² t 1 + μ² t 2 )] = μ¾ 2 Forecasts: ½ 1 = μ=(1 + μ 2 ); ½ j =0forj>1 ^y T (1) = ^¹ + ^μ^² T ;^y T (h) =^¹ for h>1 Forecast error variance: Impulse Response: E[(y T +h ^y T (h)) 2 ]=¾ 2 for h =1;(1+μ 2 )¾ 2 for h>1 IR(y t ; h) =μ for h =1;0otherwise

35 Estimation of MA models Usually by MLE (involving nonlinear numerical optimization routines). Assume: Then, conditional on y t j² t 1» N((¹ + μ² t 1 );¾ 2 ) ² 0 =0! ² 1 = y 1 ¹! ² 2 = y 2 ¹ μ(y 1 ¹)::: ² t = y t ¹ μ(y t 1 1 ¹ μ(y t 2 2 ¹ :::))) So that the likelihood of the t observation is f(y t j² t 1 ; ¹; μ) = 1 ( p exp (y t ¹ μ² t 1 ) 2 2¼¾ 2 2¾ 2

36 Log-LikelihoodLikelihood The log-likelihood therefore is: L(¹; μ) = T 2 log(2¼) T 2 log(¾2 ) TX t=1 ² 2 t 2¾ 2 A simpler way. Notice that if jμj < 1, i.e., the MA(1) is invertible, then y t = ¹ +(1+μL)² t =) y t (1 + μl) 1 = ¹ 1+μ + ² t y t (1 μl + μ 2 L 2 ::::) = ¹ + ² t 1 + μ y t = ¹ 1+μ + μy t 1 μ 2 y t 2 + ::: + ² t y t = c + 1y t 1 + 2y t 2 + ::: + ² t

37 Approximate Least-Squares MA(1) Thus: y ¹ 2 t = + μy t 1 μ y t 2 + ::: + ² t 1+μ Ory t = c + 1y t 1 + 2y t 2 + ::: + ² t So one approach is to estimate a truncated version since if jμj < 1thenμ j! 0;j!1 Choose a finite it p using, say AIC Regress by OLS y t = c + 1y t 1 + ::: + py t p + v t Obtain and hence Define And hence: (^ (c; 1; ^ :::; p) ^ ) = ¼ ^ ^Ð ¹ h(¹; μ) =( 1+μ ; μ; μ2 ; :::) g(^¼ g(¼; ¹; μ) = ¼ ^¼ h(¹; μ) Ð^¼

38 Classical Minimum Distance Thus, an estimator is max ¹;μ ^Q T (^¼ T ; ¹; μ) = g(^¼; ¹; μ) 0 ^Ð 1 ^¼ g(^¼;¹;μ) This is a two-step t estimator. t The first step consists in an auxiliary regression that produces some reducedform parameters. The second step specifies the relation between the reduced-form parameters and the parameters of interest. The usual extremum-estimation estimation results can be used here. This is just another way of doing the delta method

Univariate Time Series Analysis; ARIMA Models

Univariate Time Series Analysis; ARIMA Models Econometrics 2 Spring 25 Univariate Time Series Analysis; ARIMA Models Heino Bohn Nielsen of4 Outline of the Lecture () Introduction to univariate time series analysis. (2) Stationarity. (3) Characterizing

More information

Univariate Time Series Analysis; ARIMA Models

Univariate Time Series Analysis; ARIMA Models Econometrics 2 Fall 25 Univariate Time Series Analysis; ARIMA Models Heino Bohn Nielsen of4 Univariate Time Series Analysis We consider a single time series, y,y 2,..., y T. We want to construct simple

More information

Time Series Analysis

Time Series Analysis Time Series Analysis Autoregressive, MA and ARMA processes Andrés M. Alonso Carolina García-Martos Universidad Carlos III de Madrid Universidad Politécnica de Madrid June July, 212 Alonso and García-Martos

More information

Sales forecasting # 2

Sales forecasting # 2 Sales forecasting # 2 Arthur Charpentier arthur.charpentier@univ-rennes1.fr 1 Agenda Qualitative and quantitative methods, a very general introduction Series decomposition Short versus long term forecasting

More information

1 Short Introduction to Time Series

1 Short Introduction to Time Series ECONOMICS 7344, Spring 202 Bent E. Sørensen January 24, 202 Short Introduction to Time Series A time series is a collection of stochastic variables x,.., x t,.., x T indexed by an integer value t. The

More information

3.1 Stationary Processes and Mean Reversion

3.1 Stationary Processes and Mean Reversion 3. Univariate Time Series Models 3.1 Stationary Processes and Mean Reversion Definition 3.1: A time series y t, t = 1,..., T is called (covariance) stationary if (1) E[y t ] = µ, for all t Cov[y t, y t

More information

Please follow the directions once you locate the Stata software in your computer. Room 114 (Business Lab) has computers with Stata software

Please follow the directions once you locate the Stata software in your computer. Room 114 (Business Lab) has computers with Stata software STATA Tutorial Professor Erdinç Please follow the directions once you locate the Stata software in your computer. Room 114 (Business Lab) has computers with Stata software 1.Wald Test Wald Test is used

More information

Lab 5 Linear Regression with Within-subject Correlation. Goals: Data: Use the pig data which is in wide format:

Lab 5 Linear Regression with Within-subject Correlation. Goals: Data: Use the pig data which is in wide format: Lab 5 Linear Regression with Within-subject Correlation Goals: Data: Fit linear regression models that account for within-subject correlation using Stata. Compare weighted least square, GEE, and random

More information

Forecasting in STATA: Tools and Tricks

Forecasting in STATA: Tools and Tricks Forecasting in STATA: Tools and Tricks Introduction This manual is intended to be a reference guide for time series forecasting in STATA. It will be updated periodically during the semester, and will be

More information

Lecture 15. Endogeneity & Instrumental Variable Estimation

Lecture 15. Endogeneity & Instrumental Variable Estimation Lecture 15. Endogeneity & Instrumental Variable Estimation Saw that measurement error (on right hand side) means that OLS will be biased (biased toward zero) Potential solution to endogeneity instrumental

More information

HURDLE AND SELECTION MODELS Jeff Wooldridge Michigan State University BGSE/IZA Course in Microeconometrics July 2009

HURDLE AND SELECTION MODELS Jeff Wooldridge Michigan State University BGSE/IZA Course in Microeconometrics July 2009 HURDLE AND SELECTION MODELS Jeff Wooldridge Michigan State University BGSE/IZA Course in Microeconometrics July 2009 1. Introduction 2. A General Formulation 3. Truncated Normal Hurdle Model 4. Lognormal

More information

Department of Economics Session 2012/2013. EC352 Econometric Methods. Solutions to Exercises from Week 10 + 0.0077 (0.052)

Department of Economics Session 2012/2013. EC352 Econometric Methods. Solutions to Exercises from Week 10 + 0.0077 (0.052) Department of Economics Session 2012/2013 University of Essex Spring Term Dr Gordon Kemp EC352 Econometric Methods Solutions to Exercises from Week 10 1 Problem 13.7 This exercise refers back to Equation

More information

Advanced Forecasting Techniques and Models: ARIMA

Advanced Forecasting Techniques and Models: ARIMA Advanced Forecasting Techniques and Models: ARIMA Short Examples Series using Risk Simulator For more information please visit: www.realoptionsvaluation.com or contact us at: admin@realoptionsvaluation.com

More information

Lecture 2: ARMA(p,q) models (part 3)

Lecture 2: ARMA(p,q) models (part 3) Lecture 2: ARMA(p,q) models (part 3) Florian Pelgrin University of Lausanne, École des HEC Department of mathematics (IMEA-Nice) Sept. 2011 - Jan. 2012 Florian Pelgrin (HEC) Univariate time series Sept.

More information

Marginal Effects for Continuous Variables Richard Williams, University of Notre Dame, http://www3.nd.edu/~rwilliam/ Last revised February 21, 2015

Marginal Effects for Continuous Variables Richard Williams, University of Notre Dame, http://www3.nd.edu/~rwilliam/ Last revised February 21, 2015 Marginal Effects for Continuous Variables Richard Williams, University of Notre Dame, http://www3.nd.edu/~rwilliam/ Last revised February 21, 2015 References: Long 1997, Long and Freese 2003 & 2006 & 2014,

More information

ECON 142 SKETCH OF SOLUTIONS FOR APPLIED EXERCISE #2

ECON 142 SKETCH OF SOLUTIONS FOR APPLIED EXERCISE #2 University of California, Berkeley Prof. Ken Chay Department of Economics Fall Semester, 005 ECON 14 SKETCH OF SOLUTIONS FOR APPLIED EXERCISE # Question 1: a. Below are the scatter plots of hourly wages

More information

The following postestimation commands for time series are available for regress:

The following postestimation commands for time series are available for regress: Title stata.com regress postestimation time series Postestimation tools for regress with time series Description Syntax for estat archlm Options for estat archlm Syntax for estat bgodfrey Options for estat

More information

Univariate and Multivariate Methods PEARSON. Addison Wesley

Univariate and Multivariate Methods PEARSON. Addison Wesley Time Series Analysis Univariate and Multivariate Methods SECOND EDITION William W. S. Wei Department of Statistics The Fox School of Business and Management Temple University PEARSON Addison Wesley Boston

More information

ESTIMATING AVERAGE TREATMENT EFFECTS: IV AND CONTROL FUNCTIONS, II Jeff Wooldridge Michigan State University BGSE/IZA Course in Microeconometrics

ESTIMATING AVERAGE TREATMENT EFFECTS: IV AND CONTROL FUNCTIONS, II Jeff Wooldridge Michigan State University BGSE/IZA Course in Microeconometrics ESTIMATING AVERAGE TREATMENT EFFECTS: IV AND CONTROL FUNCTIONS, II Jeff Wooldridge Michigan State University BGSE/IZA Course in Microeconometrics July 2009 1. Quantile Treatment Effects 2. Control Functions

More information

August 2012 EXAMINATIONS Solution Part I

August 2012 EXAMINATIONS Solution Part I August 01 EXAMINATIONS Solution Part I (1) In a random sample of 600 eligible voters, the probability that less than 38% will be in favour of this policy is closest to (B) () In a large random sample,

More information

IAPRI Quantitative Analysis Capacity Building Series. Multiple regression analysis & interpreting results

IAPRI Quantitative Analysis Capacity Building Series. Multiple regression analysis & interpreting results IAPRI Quantitative Analysis Capacity Building Series Multiple regression analysis & interpreting results How important is R-squared? R-squared Published in Agricultural Economics 0.45 Best article of the

More information

Non-Stationary Time Series andunitroottests

Non-Stationary Time Series andunitroottests Econometrics 2 Fall 2005 Non-Stationary Time Series andunitroottests Heino Bohn Nielsen 1of25 Introduction Many economic time series are trending. Important to distinguish between two important cases:

More information

TIME SERIES ANALYSIS

TIME SERIES ANALYSIS TIME SERIES ANALYSIS L.M. BHAR AND V.K.SHARMA Indian Agricultural Statistics Research Institute Library Avenue, New Delhi-0 02 lmb@iasri.res.in. Introduction Time series (TS) data refers to observations

More information

Time Series Analysis 1. Lecture 8: Time Series Analysis. Time Series Analysis MIT 18.S096. Dr. Kempthorne. Fall 2013 MIT 18.S096

Time Series Analysis 1. Lecture 8: Time Series Analysis. Time Series Analysis MIT 18.S096. Dr. Kempthorne. Fall 2013 MIT 18.S096 Lecture 8: Time Series Analysis MIT 18.S096 Dr. Kempthorne Fall 2013 MIT 18.S096 Time Series Analysis 1 Outline Time Series Analysis 1 Time Series Analysis MIT 18.S096 Time Series Analysis 2 A stochastic

More information

Time Series Analysis

Time Series Analysis Time Series Analysis Forecasting with ARIMA models Andrés M. Alonso Carolina García-Martos Universidad Carlos III de Madrid Universidad Politécnica de Madrid June July, 2012 Alonso and García-Martos (UC3M-UPM)

More information

Analysis and Computation for Finance Time Series - An Introduction

Analysis and Computation for Finance Time Series - An Introduction ECMM703 Analysis and Computation for Finance Time Series - An Introduction Alejandra González Harrison 161 Email: mag208@exeter.ac.uk Time Series - An Introduction A time series is a sequence of observations

More information

Time Series Analysis III

Time Series Analysis III Lecture 12: Time Series Analysis III MIT 18.S096 Dr. Kempthorne Fall 2013 MIT 18.S096 Time Series Analysis III 1 Outline Time Series Analysis III 1 Time Series Analysis III MIT 18.S096 Time Series Analysis

More information

Introduction to Time Series Regression and Forecasting

Introduction to Time Series Regression and Forecasting Introduction to Time Series Regression and Forecasting (SW Chapter 14) Time series data are data collected on the same observational unit at multiple time periods Aggregate consumption and GDP for a country

More information

Some useful concepts in univariate time series analysis

Some useful concepts in univariate time series analysis Some useful concepts in univariate time series analysis Autoregressive moving average models Autocorrelation functions Model Estimation Diagnostic measure Model selection Forecasting Assumptions: 1. Non-seasonal

More information

Impulse Response Functions

Impulse Response Functions Impulse Response Functions Wouter J. Den Haan University of Amsterdam April 28, 2011 General definition IRFs The IRF gives the j th -period response when the system is shocked by a one-standard-deviation

More information

Handling missing data in Stata a whirlwind tour

Handling missing data in Stata a whirlwind tour Handling missing data in Stata a whirlwind tour 2012 Italian Stata Users Group Meeting Jonathan Bartlett www.missingdata.org.uk 20th September 2012 1/55 Outline The problem of missing data and a principled

More information

Chapter 1. Vector autoregressions. 1.1 VARs and the identi cation problem

Chapter 1. Vector autoregressions. 1.1 VARs and the identi cation problem Chapter Vector autoregressions We begin by taking a look at the data of macroeconomics. A way to summarize the dynamics of macroeconomic data is to make use of vector autoregressions. VAR models have become

More information

Luciano Rispoli Department of Economics, Mathematics and Statistics Birkbeck College (University of London)

Luciano Rispoli Department of Economics, Mathematics and Statistics Birkbeck College (University of London) Luciano Rispoli Department of Economics, Mathematics and Statistics Birkbeck College (University of London) 1 Forecasting: definition Forecasting is the process of making statements about events whose

More information

ARMA, GARCH and Related Option Pricing Method

ARMA, GARCH and Related Option Pricing Method ARMA, GARCH and Related Option Pricing Method Author: Yiyang Yang Advisor: Pr. Xiaolin Li, Pr. Zari Rachev Department of Applied Mathematics and Statistics State University of New York at Stony Brook September

More information

Standard errors of marginal effects in the heteroskedastic probit model

Standard errors of marginal effects in the heteroskedastic probit model Standard errors of marginal effects in the heteroskedastic probit model Thomas Cornelißen Discussion Paper No. 320 August 2005 ISSN: 0949 9962 Abstract In non-linear regression models, such as the heteroskedastic

More information

Time Series Analysis

Time Series Analysis Time Series Analysis hm@imm.dtu.dk Informatics and Mathematical Modelling Technical University of Denmark DK-2800 Kgs. Lyngby 1 Outline of the lecture Identification of univariate time series models, cont.:

More information

Overview of Violations of the Basic Assumptions in the Classical Normal Linear Regression Model

Overview of Violations of the Basic Assumptions in the Classical Normal Linear Regression Model Overview of Violations of the Basic Assumptions in the Classical Normal Linear Regression Model 1 September 004 A. Introduction and assumptions The classical normal linear regression model can be written

More information

How To Model A Series With Sas

How To Model A Series With Sas Chapter 7 Chapter Table of Contents OVERVIEW...193 GETTING STARTED...194 TheThreeStagesofARIMAModeling...194 IdentificationStage...194 Estimation and Diagnostic Checking Stage...... 200 Forecasting Stage...205

More information

Interaction effects between continuous variables (Optional)

Interaction effects between continuous variables (Optional) Interaction effects between continuous variables (Optional) Richard Williams, University of Notre Dame, http://www.nd.edu/~rwilliam/ Last revised February 0, 05 This is a very brief overview of this somewhat

More information

Nonlinear relationships Richard Williams, University of Notre Dame, http://www3.nd.edu/~rwilliam/ Last revised February 20, 2015

Nonlinear relationships Richard Williams, University of Notre Dame, http://www3.nd.edu/~rwilliam/ Last revised February 20, 2015 Nonlinear relationships Richard Williams, University of Notre Dame, http://www.nd.edu/~rwilliam/ Last revised February, 5 Sources: Berry & Feldman s Multiple Regression in Practice 985; Pindyck and Rubinfeld

More information

Time Series - ARIMA Models. Instructor: G. William Schwert

Time Series - ARIMA Models. Instructor: G. William Schwert APS 425 Fall 25 Time Series : ARIMA Models Instructor: G. William Schwert 585-275-247 schwert@schwert.ssb.rochester.edu Topics Typical time series plot Pattern recognition in auto and partial autocorrelations

More information

MULTIPLE REGRESSION EXAMPLE

MULTIPLE REGRESSION EXAMPLE MULTIPLE REGRESSION EXAMPLE For a sample of n = 166 college students, the following variables were measured: Y = height X 1 = mother s height ( momheight ) X 2 = father s height ( dadheight ) X 3 = 1 if

More information

Multivariate time series analysis is used when one wants to model and explain the interactions and comovements among a group of time series variables:

Multivariate time series analysis is used when one wants to model and explain the interactions and comovements among a group of time series variables: Multivariate Time Series Consider n time series variables {y 1t },...,{y nt }. A multivariate time series is the (n 1) vector time series {Y t } where the i th row of {Y t } is {y it }.Thatis,for any time

More information

Statistics 104 Final Project A Culture of Debt: A Study of Credit Card Spending in America TF: Kevin Rader Anonymous Students: LD, MH, IW, MY

Statistics 104 Final Project A Culture of Debt: A Study of Credit Card Spending in America TF: Kevin Rader Anonymous Students: LD, MH, IW, MY Statistics 104 Final Project A Culture of Debt: A Study of Credit Card Spending in America TF: Kevin Rader Anonymous Students: LD, MH, IW, MY ABSTRACT: This project attempted to determine the relationship

More information

Time Series Analysis in Economics. Klaus Neusser

Time Series Analysis in Economics. Klaus Neusser Time Series Analysis in Economics Klaus Neusser May 26, 2015 Contents I Univariate Time Series Analysis 3 1 Introduction 1 1.1 Some examples.......................... 2 1.2 Formal definitions.........................

More information

Trend and Seasonal Components

Trend and Seasonal Components Chapter 2 Trend and Seasonal Components If the plot of a TS reveals an increase of the seasonal and noise fluctuations with the level of the process then some transformation may be necessary before doing

More information

Forecasting the US Dollar / Euro Exchange rate Using ARMA Models

Forecasting the US Dollar / Euro Exchange rate Using ARMA Models Forecasting the US Dollar / Euro Exchange rate Using ARMA Models LIUWEI (9906360) - 1 - ABSTRACT...3 1. INTRODUCTION...4 2. DATA ANALYSIS...5 2.1 Stationary estimation...5 2.2 Dickey-Fuller Test...6 3.

More information

Multicollinearity Richard Williams, University of Notre Dame, http://www3.nd.edu/~rwilliam/ Last revised January 13, 2015

Multicollinearity Richard Williams, University of Notre Dame, http://www3.nd.edu/~rwilliam/ Last revised January 13, 2015 Multicollinearity Richard Williams, University of Notre Dame, http://www3.nd.edu/~rwilliam/ Last revised January 13, 2015 Stata Example (See appendices for full example).. use http://www.nd.edu/~rwilliam/stats2/statafiles/multicoll.dta,

More information

Probability and Random Variables. Generation of random variables (r.v.)

Probability and Random Variables. Generation of random variables (r.v.) Probability and Random Variables Method for generating random variables with a specified probability distribution function. Gaussian And Markov Processes Characterization of Stationary Random Process Linearly

More information

Sales forecasting # 1

Sales forecasting # 1 Sales forecasting # 1 Arthur Charpentier arthur.charpentier@univ-rennes1.fr 1 Agenda Qualitative and quantitative methods, a very general introduction Series decomposition Short versus long term forecasting

More information

Wooldridge, Introductory Econometrics, 3d ed. Chapter 12: Serial correlation and heteroskedasticity in time series regressions

Wooldridge, Introductory Econometrics, 3d ed. Chapter 12: Serial correlation and heteroskedasticity in time series regressions Wooldridge, Introductory Econometrics, 3d ed. Chapter 12: Serial correlation and heteroskedasticity in time series regressions What will happen if we violate the assumption that the errors are not serially

More information

SYSTEMS OF REGRESSION EQUATIONS

SYSTEMS OF REGRESSION EQUATIONS SYSTEMS OF REGRESSION EQUATIONS 1. MULTIPLE EQUATIONS y nt = x nt n + u nt, n = 1,...,N, t = 1,...,T, x nt is 1 k, and n is k 1. This is a version of the standard regression model where the observations

More information

Sample Size Calculation for Longitudinal Studies

Sample Size Calculation for Longitudinal Studies Sample Size Calculation for Longitudinal Studies Phil Schumm Department of Health Studies University of Chicago August 23, 2004 (Supported by National Institute on Aging grant P01 AG18911-01A1) Introduction

More information

Introduction to General and Generalized Linear Models

Introduction to General and Generalized Linear Models Introduction to General and Generalized Linear Models General Linear Models - part I Henrik Madsen Poul Thyregod Informatics and Mathematical Modelling Technical University of Denmark DK-2800 Kgs. Lyngby

More information

Estimating an ARMA Process

Estimating an ARMA Process Statistics 910, #12 1 Overview Estimating an ARMA Process 1. Main ideas 2. Fitting autoregressions 3. Fitting with moving average components 4. Standard errors 5. Examples 6. Appendix: Simple estimators

More information

Time Series Analysis and Forecasting

Time Series Analysis and Forecasting Time Series Analysis and Forecasting Math 667 Al Nosedal Department of Mathematics Indiana University of Pennsylvania Time Series Analysis and Forecasting p. 1/11 Introduction Many decision-making applications

More information

ADVANCED FORECASTING MODELS USING SAS SOFTWARE

ADVANCED FORECASTING MODELS USING SAS SOFTWARE ADVANCED FORECASTING MODELS USING SAS SOFTWARE Girish Kumar Jha IARI, Pusa, New Delhi 110 012 gjha_eco@iari.res.in 1. Transfer Function Model Univariate ARIMA models are useful for analysis and forecasting

More information

ITSM-R Reference Manual

ITSM-R Reference Manual ITSM-R Reference Manual George Weigt June 5, 2015 1 Contents 1 Introduction 3 1.1 Time series analysis in a nutshell............................... 3 1.2 White Noise Variance.....................................

More information

MODEL I: DRINK REGRESSED ON GPA & MALE, WITHOUT CENTERING

MODEL I: DRINK REGRESSED ON GPA & MALE, WITHOUT CENTERING Interpreting Interaction Effects; Interaction Effects and Centering Richard Williams, University of Notre Dame, http://www3.nd.edu/~rwilliam/ Last revised February 20, 2015 Models with interaction effects

More information

Linear Regression Models with Logarithmic Transformations

Linear Regression Models with Logarithmic Transformations Linear Regression Models with Logarithmic Transformations Kenneth Benoit Methodology Institute London School of Economics kbenoit@lse.ac.uk March 17, 2011 1 Logarithmic transformations of variables Considering

More information

Correlation and Regression

Correlation and Regression Correlation and Regression Scatterplots Correlation Explanatory and response variables Simple linear regression General Principles of Data Analysis First plot the data, then add numerical summaries Look

More information

y t by left multiplication with 1 (L) as y t = 1 (L) t =ª(L) t 2.5 Variance decomposition and innovation accounting Consider the VAR(p) model where

y t by left multiplication with 1 (L) as y t = 1 (L) t =ª(L) t 2.5 Variance decomposition and innovation accounting Consider the VAR(p) model where . Variance decomposition and innovation accounting Consider the VAR(p) model where (L)y t = t, (L) =I m L L p L p is the lag polynomial of order p with m m coe±cient matrices i, i =,...p. Provided that

More information

Correlated Random Effects Panel Data Models

Correlated Random Effects Panel Data Models INTRODUCTION AND LINEAR MODELS Correlated Random Effects Panel Data Models IZA Summer School in Labor Economics May 13-19, 2013 Jeffrey M. Wooldridge Michigan State University 1. Introduction 2. The Linear

More information

Econometrics I: Econometric Methods

Econometrics I: Econometric Methods Econometrics I: Econometric Methods Jürgen Meinecke Research School of Economics, Australian National University 24 May, 2016 Housekeeping Assignment 2 is now history The ps tute this week will go through

More information

The average hotel manager recognizes the criticality of forecasting. However, most

The average hotel manager recognizes the criticality of forecasting. However, most Introduction The average hotel manager recognizes the criticality of forecasting. However, most managers are either frustrated by complex models researchers constructed or appalled by the amount of time

More information

Milk Data Analysis. 1. Objective Introduction to SAS PROC MIXED Analyzing protein milk data using STATA Refit protein milk data using PROC MIXED

Milk Data Analysis. 1. Objective Introduction to SAS PROC MIXED Analyzing protein milk data using STATA Refit protein milk data using PROC MIXED 1. Objective Introduction to SAS PROC MIXED Analyzing protein milk data using STATA Refit protein milk data using PROC MIXED 2. Introduction to SAS PROC MIXED The MIXED procedure provides you with flexibility

More information

Introduction to Time Series Analysis. Lecture 6.

Introduction to Time Series Analysis. Lecture 6. Introduction to Time Series Analysis. Lecture 6. Peter Bartlett www.stat.berkeley.edu/ bartlett/courses/153-fall2010 Last lecture: 1. Causality 2. Invertibility 3. AR(p) models 4. ARMA(p,q) models 1 Introduction

More information

STAT 830 Convergence in Distribution

STAT 830 Convergence in Distribution STAT 830 Convergence in Distribution Richard Lockhart Simon Fraser University STAT 830 Fall 2011 Richard Lockhart (Simon Fraser University) STAT 830 Convergence in Distribution STAT 830 Fall 2011 1 / 31

More information

MULTIVARIATE PROBABILITY DISTRIBUTIONS

MULTIVARIATE PROBABILITY DISTRIBUTIONS MULTIVARIATE PROBABILITY DISTRIBUTIONS. PRELIMINARIES.. Example. Consider an experiment that consists of tossing a die and a coin at the same time. We can consider a number of random variables defined

More information

MODELING AUTO INSURANCE PREMIUMS

MODELING AUTO INSURANCE PREMIUMS MODELING AUTO INSURANCE PREMIUMS Brittany Parahus, Siena College INTRODUCTION The findings in this paper will provide the reader with a basic knowledge and understanding of how Auto Insurance Companies

More information

MGT 267 PROJECT. Forecasting the United States Retail Sales of the Pharmacies and Drug Stores. Done by: Shunwei Wang & Mohammad Zainal

MGT 267 PROJECT. Forecasting the United States Retail Sales of the Pharmacies and Drug Stores. Done by: Shunwei Wang & Mohammad Zainal MGT 267 PROJECT Forecasting the United States Retail Sales of the Pharmacies and Drug Stores Done by: Shunwei Wang & Mohammad Zainal Dec. 2002 The retail sale (Million) ABSTRACT The present study aims

More information

Nonlinear Regression Functions. SW Ch 8 1/54/

Nonlinear Regression Functions. SW Ch 8 1/54/ Nonlinear Regression Functions SW Ch 8 1/54/ The TestScore STR relation looks linear (maybe) SW Ch 8 2/54/ But the TestScore Income relation looks nonlinear... SW Ch 8 3/54/ Nonlinear Regression General

More information

TIME SERIES ANALYSIS

TIME SERIES ANALYSIS TIME SERIES ANALYSIS Ramasubramanian V. I.A.S.R.I., Library Avenue, New Delhi- 110 012 ram_stat@yahoo.co.in 1. Introduction A Time Series (TS) is a sequence of observations ordered in time. Mostly these

More information

AUTOMATION OF ENERGY DEMAND FORECASTING. Sanzad Siddique, B.S.

AUTOMATION OF ENERGY DEMAND FORECASTING. Sanzad Siddique, B.S. AUTOMATION OF ENERGY DEMAND FORECASTING by Sanzad Siddique, B.S. A Thesis submitted to the Faculty of the Graduate School, Marquette University, in Partial Fulfillment of the Requirements for the Degree

More information

Performing Unit Root Tests in EViews. Unit Root Testing

Performing Unit Root Tests in EViews. Unit Root Testing Página 1 de 12 Unit Root Testing The theory behind ARMA estimation is based on stationary time series. A series is said to be (weakly or covariance) stationary if the mean and autocovariances of the series

More information

From the help desk: hurdle models

From the help desk: hurdle models The Stata Journal (2003) 3, Number 2, pp. 178 184 From the help desk: hurdle models Allen McDowell Stata Corporation Abstract. This article demonstrates that, although there is no command in Stata for

More information

Failure to take the sampling scheme into account can lead to inaccurate point estimates and/or flawed estimates of the standard errors.

Failure to take the sampling scheme into account can lead to inaccurate point estimates and/or flawed estimates of the standard errors. Analyzing Complex Survey Data: Some key issues to be aware of Richard Williams, University of Notre Dame, http://www3.nd.edu/~rwilliam/ Last revised January 24, 2015 Rather than repeat material that is

More information

10.2 Series and Convergence

10.2 Series and Convergence 10.2 Series and Convergence Write sums using sigma notation Find the partial sums of series and determine convergence or divergence of infinite series Find the N th partial sums of geometric series and

More information

The VAR models discussed so fare are appropriate for modeling I(0) data, like asset returns or growth rates of macroeconomic time series.

The VAR models discussed so fare are appropriate for modeling I(0) data, like asset returns or growth rates of macroeconomic time series. Cointegration The VAR models discussed so fare are appropriate for modeling I(0) data, like asset returns or growth rates of macroeconomic time series. Economic theory, however, often implies equilibrium

More information

Centre for Central Banking Studies

Centre for Central Banking Studies Centre for Central Banking Studies Technical Handbook No. 4 Applied Bayesian econometrics for central bankers Andrew Blake and Haroon Mumtaz CCBS Technical Handbook No. 4 Applied Bayesian econometrics

More information

DETERMINANTS OF CAPITAL ADEQUACY RATIO IN SELECTED BOSNIAN BANKS

DETERMINANTS OF CAPITAL ADEQUACY RATIO IN SELECTED BOSNIAN BANKS DETERMINANTS OF CAPITAL ADEQUACY RATIO IN SELECTED BOSNIAN BANKS Nađa DRECA International University of Sarajevo nadja.dreca@students.ius.edu.ba Abstract The analysis of a data set of observation for 10

More information

xtmixed & denominator degrees of freedom: myth or magic

xtmixed & denominator degrees of freedom: myth or magic xtmixed & denominator degrees of freedom: myth or magic 2011 Chicago Stata Conference Phil Ender UCLA Statistical Consulting Group July 2011 Phil Ender xtmixed & denominator degrees of freedom: myth or

More information

Statistics and Probability Letters

Statistics and Probability Letters Statistics and Probability Letters 79 (2009) 1884 1889 Contents lists available at ScienceDirect Statistics and Probability Letters journal homepage: www.elsevier.com/locate/stapro Discrete-valued ARMA

More information

Vector Time Series Model Representations and Analysis with XploRe

Vector Time Series Model Representations and Analysis with XploRe 0-1 Vector Time Series Model Representations and Analysis with plore Julius Mungo CASE - Center for Applied Statistics and Economics Humboldt-Universität zu Berlin mungo@wiwi.hu-berlin.de plore MulTi Motivation

More information

Introduction to Time Series Analysis. Lecture 1.

Introduction to Time Series Analysis. Lecture 1. Introduction to Time Series Analysis. Lecture 1. Peter Bartlett 1. Organizational issues. 2. Objectives of time series analysis. Examples. 3. Overview of the course. 4. Time series models. 5. Time series

More information

Discrete Time Series Analysis with ARMA Models

Discrete Time Series Analysis with ARMA Models Discrete Time Series Analysis with ARMA Models Veronica Sitsofe Ahiati (veronica@aims.ac.za) African Institute for Mathematical Sciences (AIMS) Supervised by Tina Marquardt Munich University of Technology,

More information

9th Russian Summer School in Information Retrieval Big Data Analytics with R

9th Russian Summer School in Information Retrieval Big Data Analytics with R 9th Russian Summer School in Information Retrieval Big Data Analytics with R Introduction to Time Series with R A. Karakitsiou A. Migdalas Industrial Logistics, ETS Institute Luleå University of Technology

More information

INDIRECT INFERENCE (prepared for: The New Palgrave Dictionary of Economics, Second Edition)

INDIRECT INFERENCE (prepared for: The New Palgrave Dictionary of Economics, Second Edition) INDIRECT INFERENCE (prepared for: The New Palgrave Dictionary of Economics, Second Edition) Abstract Indirect inference is a simulation-based method for estimating the parameters of economic models. Its

More information

Chapter 9: Univariate Time Series Analysis

Chapter 9: Univariate Time Series Analysis Chapter 9: Univariate Time Series Analysis In the last chapter we discussed models with only lags of explanatory variables. These can be misleading if: 1. The dependent variable Y t depends on lags of

More information

Forecasting Using Eviews 2.0: An Overview

Forecasting Using Eviews 2.0: An Overview Forecasting Using Eviews 2.0: An Overview Some Preliminaries In what follows it will be useful to distinguish between ex post and ex ante forecasting. In terms of time series modeling, both predict values

More information

From the help desk: Swamy s random-coefficients model

From the help desk: Swamy s random-coefficients model The Stata Journal (2003) 3, Number 3, pp. 302 308 From the help desk: Swamy s random-coefficients model Brian P. Poi Stata Corporation Abstract. This article discusses the Swamy (1970) random-coefficients

More information

Time Series Analysis

Time Series Analysis Time Series 1 April 9, 2013 Time Series Analysis This chapter presents an introduction to the branch of statistics known as time series analysis. Often the data we collect in environmental studies is collected

More information

Lecture 4: Seasonal Time Series, Trend Analysis & Component Model Bus 41910, Time Series Analysis, Mr. R. Tsay

Lecture 4: Seasonal Time Series, Trend Analysis & Component Model Bus 41910, Time Series Analysis, Mr. R. Tsay Lecture 4: Seasonal Time Series, Trend Analysis & Component Model Bus 41910, Time Series Analysis, Mr. R. Tsay Business cycle plays an important role in economics. In time series analysis, business cycle

More information

Chapter 5. Analysis of Multiple Time Series. 5.1 Vector Autoregressions

Chapter 5. Analysis of Multiple Time Series. 5.1 Vector Autoregressions Chapter 5 Analysis of Multiple Time Series Note: The primary references for these notes are chapters 5 and 6 in Enders (2004). An alternative, but more technical treatment can be found in chapters 10-11

More information

Econometrics Simple Linear Regression

Econometrics Simple Linear Regression Econometrics Simple Linear Regression Burcu Eke UC3M Linear equations with one variable Recall what a linear equation is: y = b 0 + b 1 x is a linear equation with one variable, or equivalently, a straight

More information

Time Series Analysis of Aviation Data

Time Series Analysis of Aviation Data Time Series Analysis of Aviation Data Dr. Richard Xie February, 2012 What is a Time Series A time series is a sequence of observations in chorological order, such as Daily closing price of stock MSFT in

More information

Chapter 4: Vector Autoregressive Models

Chapter 4: Vector Autoregressive Models Chapter 4: Vector Autoregressive Models 1 Contents: Lehrstuhl für Department Empirische of Wirtschaftsforschung Empirical Research and und Econometrics Ökonometrie IV.1 Vector Autoregressive Models (VAR)...

More information

Lecture Notes on Univariate Time Series Analysis and Box Jenkins Forecasting John Frain Economic Analysis, Research and Publications April 1992 (reprinted with revisions) January 1999 Abstract These are

More information

A course in Time Series Analysis. Suhasini Subba Rao Email: suhasini.subbarao@stat.tamu.edu

A course in Time Series Analysis. Suhasini Subba Rao Email: suhasini.subbarao@stat.tamu.edu A course in Time Series Analysis Suhasini Subba Rao Email: suhasini.subbarao@stat.tamu.edu August 5, 205 Contents Introduction 8. Time Series data................................. 8.. R code....................................2

More information

Multivariate Normal Distribution

Multivariate Normal Distribution Multivariate Normal Distribution Lecture 4 July 21, 2011 Advanced Multivariate Statistical Methods ICPSR Summer Session #2 Lecture #4-7/21/2011 Slide 1 of 41 Last Time Matrices and vectors Eigenvalues

More information