Time Series Analysis 1. Lecture 8: Time Series Analysis. Time Series Analysis MIT 18.S096. Dr. Kempthorne. Fall 2013 MIT 18.S096


 Anna Berry
 3 years ago
 Views:
Transcription
1 Lecture 8: Time Series Analysis MIT 18.S096 Dr. Kempthorne Fall 2013 MIT 18.S096 Time Series Analysis 1
2 Outline Time Series Analysis 1 Time Series Analysis MIT 18.S096 Time Series Analysis 2
3 A stochastic process {..., X t 1, X t, X t+1,...} consisting of random variables indexed by time index t is a time series. The stochastic behavior of {X t } is determined by specifying the probability density/mass functions (pdf s) p(x t1, x t2,..., x tm ) for all finite collections of time indexes {(t 1, t 2,..., t m ), m < } i.e., all finitedimensional distributions of {X t }. Definition: A time series {X t } is Strictly Stationary if p(t 1 + τ, t 2 + τ,..., t m + τ) = p(t 1, t 2,..., t m ), τ, m, (t 1, t 2,..., t m ). (Invariance under time translation) MIT 18.S096 Time Series Analysis 3
4 Definitions of Stationarity Definition: A time series {X t } is Covariance Stationary if E(X t ) = µ Var(X t ) = σ 2 X Cov(X t, X t+τ ) = γ(τ) (all constant over time t) The autocorrelation function of {X t } is ρ(τ) = Cov(X t, X t+τ )/ Var(X t ) Var(X t+τ ) = γ(τ)/γ(0) MIT 18.S096 Time Series Analysis 4
5 Representation Theorem Wold Representation Theorem: Any zeromean covariance stationary time series {X t } can be decomposed as X t = V t + S t where {V t } is a linearly deterministic process, i.e., a linear combination of past values of V t with constant coefficients. S t = i=0 ψ iη t i is an infinite moving average process of error terms, where ψ 0 = 1, i=0 ψ2 i < {η t } is linearly unpredictable white noise, i.e., E(η t ) = 0, E(η 2 t ) = σ 2, E(η t η s ) = 0 t, s t, and {η t } is uncorrelated with {V t } : E(η t V s ) = 0, t, s MIT 18.S096 Time Series Analysis 5
6 Intuitive Application of the Wold Representation Theorem Suppose we want to specify a covariance stationary time series {X t } to model actual data from a real time series {x t, t = 0, 1,..., T } Consider the following strategy: Initialize a parameter p, the number of past observations in the linearly deterministic term of the Wold Decomposition of {X t } Estimate the linear projection of X t on (X t 1, X t 2,..., X t p ) Consider an estimation sample of size n with endpoint t 0 T. Let {j = (p 1),..., 0, 1, 2,... n} index the subseries of {t = 0, 1,..., T } corresponding to the estimation sample and define {y j : y j = x t0 n+j}, (with t 0 n + p) Define the vector Y (T 1) and matrix Z (T [p + 1]) as: MIT 18.S096 Time Series Analysis 6
7 Estimate the linear projection of X t on (X t 1, X t 2,..., X t p ) (continued) y1 1 y0 y 1 y (p 1) y 2 1 y 1 y 0 y (p 2) y = Z = yn 1 y n 1 yn 2 yn p Apply OLS to specify the projection: ŷ = Z(Z T Z) 1 Zy = Pˆ(Y t Y t 1, Y t 2,... Y t p ) = ( ŷ p) Compute the projection residual ˆɛ (p) = y ŷ (p) MIT 18.S096 Time Series Analysis 7
8 Apply time series methods to the time series of residuals { ɛˆj (p) } to specify a moving average model: (p) ɛ t = i=0 ψ jη t i yielding {ψˆj} and {ηˆt}, estimates of parameters and innovations. Conduct a case analysis diagnosing consistency with model assumptions Evaluate orthogonality of ɛˆ(p) to Y t s, s > p. If evidence of correlation, increase p and start again. Evaluate the consistency of {ηˆt} with the white noise assumptions of the theorem. If evidence otherwise, consider revisions to the overall model Changing the specification of the moving average model. Adding additional deterministic variables to the projection model. MIT 18.S096 Time Series Analysis 8
9 Note: Theoretically, lim p ŷ (p) = ŷ = P(Y t Y t 1, Y t 2,...) but if p is required, then n while p/n 0. Useful models of covariance stationary time series have Modest finite values of p and/or include Moving average models depending on a parsimonious number of parameters. MIT 18.S096 Time Series Analysis 9
10 Lag Operator L() Time Series Analysis Definition The lag operator L() shifts a time series back by one time increment. For a time series {X t } : L(X t ) = X t 1. Applying the operator recursively we define: L 0 (X t ) = X t L 1 (X t ) = X t 1 L 2 (X t ) = L(L(X t )) = X t 2 L n (X t ) = L(L n 1 (X t )) = X t n Inverses of these operators are well defined as: L n (X t ) = X t+n, for n = 1, 2,... MIT 18.S096 Time Series Analysis 10
11 Wold Representation with Lag Operators The Wold Representation for a covariance stationary time series {X t } can be expressed as X t = i=0 ψ iη t i + V t = i=0 ψ il i (η t ) + V t = ψ(l)η t + V t where ψ(l) = i=0 ψ il i. Definition The Impulse Response Function of the covariance stationary process {X t } is IR(j) = Xt η t j = ψ j. The longrun cumulative response of {X t} is i=0 IR(j) = i=0 ψ i = ψ(l) with L = 1. MIT 18.S096 Time Series Analysis 11
12 Equivalent Autoregressive Representation Suppose that the operator ψ(l) is invertible, i.e., ψ 1 (L) = i=0 ψ i L i such that ψ 1 (L)ψ(L) = I = L 0. Then, assuming V t = 0 (i.e., X t has been adjusted to X t = X t V t ), we have the following equivalent expressions of the time series model for {X t } X t = ψ(l)η t ψ 1 (L)X t = η t Definition When ψ 1 (L) exists, the time series {X t } is Invertible and has an autoregressive representation: X t = ( i=0 ψ i X t i ) + η t MIT 18.S096 Time Series Analysis 12
13 Outline Time Series Analysis 1 Time Series Analysis MIT 18.S096 Time Series Analysis 13
14 ARMA(p,q) Models Time Series Analysis Definition: The times series {X t } follows the ARMA(p, q) Model with autoregressive order p and movingaverage order q if X t = µ + φ 1 (X t 1 µ) + φ 2 (X t 1 µ ) + φ p (X t p µ) + η t + θ 1 η t 1 + θ 2 η t 2 + θ q η t q where {η t } is WN(0, σ 2 ), White Noise with E(η t ) = 0, t E(ηt 2 ) = σ 2 <, t, and E(η t η s ) = 0, t s With lag operators φ(l) = (1 φ 2 P 1L φ 2 L φ p L ) and θ(l) = (1 + θ 1 L + θ 2 L θ q L q ) we can write φ(l) (X t µ) = θ(l)η t and the Wold decomposition is X t = µ + ψ(l)η t, where ψ(l) = [φ(l)]) 1 θ(l) MIT 18.S096 Time Series Analysis 14
15 AR(p) Models Time Series Analysis Orderp AutoRegression Model: AR(p) φ(l) (X t µ) = η t where {η t } is WN(0, σ 2 ) and φ(l) = 1 φ 1 L φ 2 L 2 + φ p L p Properties: Linear combination of {X t, X t 1,... X t p } is WN(0, σ 2 ). X t follows a linear regression model on explanatory variables (X t 1, X t 2,..., X t p ), i.e X t = c + p j=1 φ jx t j + η where c = µ φ(1), (replacing L by 1 in φ(l)). t MIT 18.S096 Time Series Analysis 15
16 AR(p) Models Time Series Analysis Stationarity Conditions Consider φ(z) replacing L with a complex variable z. φ(z) = 1 φ 1 z φ 2 z 2 φpz p. Let λ 1, λ 2,... λ p be the p roots of φ(z) = 0. φ(l) = (1 1 λ 1 L) (1 1 λ 2 L) (1 1 λ p L) Claim: {X t } is covariance stationary if and only if all the roots of φ(z) = 0 (the characteristic equation ) lie outside the unit circle {z : z 1}, i.e., λ j > 1, j = 1, 2,..., p For complex number λ: λ > 1, (1 1 λ L) 1 = 1 + ( 1 λ )L + ( 1 λ )2 L 2 + ( 1 λ ) 3 L 3 + = i=0 ( 1 λ )i L i p φ 1 (L) = [ ( ) ] 1 j=1 1 1 λ j L MIT 18.S096 Time Series Analysis 16
17 AR(1) Model Time Series Analysis Suppose {X t } follows the AR(1) process, i.e., X t µ = φ(x t 1 µ) + η t, t = 1, 2,... where η 2 t WN(0, σ ). The characteristic equation for the AR(1) model is (1 φz) = 0 with root λ = 1 φ. The AR(1) model is covariance stationary if (and only if) φ < 1 (equivalently λ > 1) The first and second moments of {X t } are E(X t ) = µ Var(X t ) = σx 2 = σ2 /(1 φ) (= γ(0)) Cov(X t, X t 1 ) = φ σ 2 X Cov(X t, X t j ) = φ j σ 2 X (= γ(j)) Corr(X t, X t j ) = φ j = ρ(j) (= γ(j)/γ(0)) MIT 18.S096 Time Series Analysis 17
18 AR(1) Model Time Series Analysis For φ : φ < 1, the W old decomposition of the AR(1) model is: X t = µ + j=0 φj η t j For φ : 0 < φ < 1, the AR(1) process exhibits exponential meanreversion to µ For φ : 0 > φ > 1, the AR(1) process exhibits oscillating exponential meanreversion to µ For φ = 1, the Wold decomposition does not exist and the process is the simple random walk (nonstationary!). For φ > 1, the AR(1) process is explosive. Examples of AR(1) Models (mean reverting with 0 < φ < 1) Interest rates (Ornstein Uhlenbeck Process; Vasicek Model) Interest rate spreads Real exchange rates Valuation ratios (dividendtoprice, earningstoprice) MIT 18.S096 Time Series Analysis 18
19 Yule Walker Equations for AR(p) Processes Second Order Moments of AR(p) Processes From the specification of the AR(p) model: (X t µ) = φ 1 (X t 1 µ) + φ 2 (X t 1 µ) + + φ p (X µ t p ) + η t we can write the YuleWalker Equations (j = 0, 1,...) E[(X t µ)(x t j µ)] = φ 1 E[(X t 1 µ)(x t j µ)] + φ 2 E[(X t 1 µ)(x t j µ)]+ + φ p E[(X t p µ)(x t j µ)] + E[η t (X t j µ)] γ(j) = φ 1 γ(j 1) + φ 2 γ(j 2)+ + φ p γ(j p) + δ 2 0,jσ Equations j = 1, 2,... p yield a system of p linear equations in φ j : MIT 18.S096 Time Series Analysis 19
20 YuleWalker Equations γ(1) γ(0) γ( 1) γ( 2) γ( (p 1)) φ 1 γ(2) γ(1) γ(0) γ( 1) γ( ( p 2)) φ = γ(p) γ(p 1) γ(p 2) γ(p 3) γ(0)) φp Given estimates γˆ(j), j = 0,..., p (and µˆ) the solution of these equations are the YuleWalker estimates of the φ j ; using the property γ( j) = γ(+j), j Using these in equation 0 γ(0) = φ 1 γ( 1) + φ 2 γ( 2) + + φ pγ( p) + δ 0,0 σ 2 provides an estimate of σ 2 p σˆ2 = γˆ(0) j 1 φˆ j γˆ(j) When all the estimates γˆ(j) and µˆ are unbiased, then the YuleWalker estimates apply the Method of Moments Principle of Estimation. MIT 18.S096 Time Series Analysis 20
21 MA(q) Models Time Series Analysis Orderq MovingAverage Model: MA(q) (X t µ) = θ(l)η t, where {η 2 t} is WN(0, σ ) and θ(l) = 1 + θ 1 L + θ 2 L θ q L q Properties: The process {X t } is invertible if all the roots of θ(z) = 0 are outside the complex unit circle. The moments of X t are: E(X t ) = µ Var(X t ) = γ(0) = σ 2 (1 + θ1 2 + θ θ2 q) { 0, j > q Cov(X t, X t+j ) = σ 2 (θ j + θ j+1 θ 1 + θ j+2 θ 2 + θ qθ q j ), 1 < j q MIT 18.S096 Time Series Analysis 21
22 Outline Time Series Analysis 1 Time Series Analysis MIT 18.S096 Time Series Analysis 22
23 Accommodating NonStationarity by Differencing Many economic time series exhibit nonstationary behavior consistent with random walks. Box and Jenkins advocate removal of nonstationary trending behavior using Differencing Operators: = 1 L 2 = (1 L) 2 = 1 2L + L 2 k = (1 L) k k = ( k j=0 j ) ( L) j, (integral k > 0) If the process {X t } has a linear trend in time, then the process { X t } has no trend. If the process {X t } has a quadratic trend in time, then the seconddifferenced process { 2 X t } has no trend. MIT 18.S096 Time Series Analysis 23
24 Examples of NonStationary Processes Linear Trend Reversion Model: Suppose the model for the time series {X t } is: X t = TD t + η t, where TD t = a + bt, a deterministic (linear) trend η t AR(1), i.e., η t = φη t 1 + ξ t, where φ < 1 and {ξ t } is WN(0, σ 2 ). The moments of {X t } are: E(X t ) = E(TD t ) + E(η t ) = a + bt Var(X t ) = Var(η t ) = σ 2 /(1 φ). The differenced process { X t } can be expressed as X t = b + η t = b + (η t η t 1 ) = b + (1 L)η t = b + MIT (118.S096 L)(1 Time φl) Series 1 Analysis ξ t 24
25 NonStationary Trend Processes Pure Integrated Process I(1) for {X t }: X t = X 2 t 1 + η t, where η t is WN(0, σ ). Equivalently: X t = (1 L)X t + η t, where {η t } is WN(0, σ 2 ). Given X 0, we can write X t = X 0 + TS t where t TS t = j=0 η j The process {TS t } is a Stochastic Trend process with TS t = TS t 1 + η t, where {η t } is WN(0, σ 2 ). Note: The Stochastic Trend process is not perfectliy predictable. The process {X t } is a Simple Random Walk with whitenoise steps. It is nonstationary because given X 0 : Var(X t) = tσ 2 Cov(X t, X t j ) = (t j)σ 2 for 0 < j < t. Corr = (X t, X t j ) = t j/ t = 1 j/t MIT 18.S096 Time Series Analysis 25
26 ARIMA(p,d,q) Models Definition: The time series {X t } follows an ARIMA(p, d, q) model ( Integrated ARMA ) if { d X t } is stationary (and nonstationary for lowerorder differencing) and follows an ARMA(p, q) model. Issues: Determining the order of differencing required to remove time trends (deterministic or stochastic). Estimating the unknown parameters of an ARIMA(p, d, q) model. Model Selection: choosing among alternative models with different (p, d, q) specifications. MIT 18.S096 Time Series Analysis 26
27 Outline Time Series Analysis 1 Time Series Analysis MIT 18.S096 Time Series Analysis 27
28 Estimation of ARMA Models MaximumLikelihood Estimation Assume that {η t } are i.i.d. N(0, σ 2 ) r.v. s. Express the ARMA(p, q) model in statespace form. Apply the predictionerror decomposition of the loglikelihood function. Apply either or both of Limited Information MaximumLikelihood (LIML) Method Condition on the first p values of {X t } Assume that the first q values of {η t } are zero. Full Information MaximumLikelihood (FIML) Method Use the stationary distribution of the first p values to specify the exact likelihood. MIT 18.S096 Time Series Analysis 28
29 Model Selection Time Series Analysis Statistical model selection critera are used to select the orders (p, q) of an ARMA process: Fit all ARMA(p, q) models with 0 p p max and 0 q q max, for chosen values of maximal orders. Let σ 2(p, q) be the MLE of σ 2 = Var(η t ), the variance of ARMA innovations under Gaussian/Normal assumption. Choose (p, q) to minimize one of: Akaike Information Criterion p AIC(p, q) = log(σ 2(p, q)) + 2 +q n Bayes Information Criterion BIC(p, q) = log(σ 2(p, q)) + log(n) p+q n HannanQuinn Criterion HQ(p, q) = log(σ 2(p, q)) + 2log(log(n)) p+q n MIT 18.S096 Time Series Analysis 29
30 Outline Time Series Analysis 1 Time Series Analysis MIT 18.S096 Time Series Analysis 30
31 Testing for Stationarity/NonStationarity DickeyFuller (DF) Test : Suppose {X t } follows the AR(1) model X t = φx t 1 + η t, with {η t } a WN(0, σ 2 ). Consider testing the following hypotheses: H 0 : φ = 1 (unit root, nonstationarity) H 1 : φ < 1 (stationarity) ( Autoregressive Unit Root Test ) Fit the AR(1) model by least squares and define the test ˆ statistic: t φ=1 = φ 1 se(φˆ) where φˆ is the leastsquares estimate of φ and se(φˆ) is the leastsquares estimate of the standard error of φ. ˆ If φ < 1, then T ( ˆφ φ) d N(0, (1 φ2 )). If φ = 1, then φˆ is superconsistent with rate (1/T ), T t φ=1 has DF distribution. MIT 18.S096 Time Series Analysis 31
32 References on * Unit Root Tests (H 0 : Nonstationarity) Dickey and Fuller (1979): DickeyFuller (DF) Test Said and Dickey (1984): Augmented DickeyFuller (ADF) Test Phillips and Perron (1988) Unit root (PP) tests Elliot, Rothenberg, and Stock (2001) Efficient unit root (ERS) test statistics. Stationarity Tests (H 0 : stationarity) Kwiatkowski, Phillips, Schmidt, and Shin (1922): KPSS test. * Optional reading MIT 18.S096 Time Series Analysis 32
33 MIT OpenCourseWare 18.S096 Topics in Mathematics with Applications in Finance Fall 2013 For information about citing these materials or our Terms of Use, visit:
3.1 Stationary Processes and Mean Reversion
3. Univariate Time Series Models 3.1 Stationary Processes and Mean Reversion Definition 3.1: A time series y t, t = 1,..., T is called (covariance) stationary if (1) E[y t ] = µ, for all t Cov[y t, y t
More informationTime Series Analysis III
Lecture 12: Time Series Analysis III MIT 18.S096 Dr. Kempthorne Fall 2013 MIT 18.S096 Time Series Analysis III 1 Outline Time Series Analysis III 1 Time Series Analysis III MIT 18.S096 Time Series Analysis
More informationLecture 2: ARMA(p,q) models (part 3)
Lecture 2: ARMA(p,q) models (part 3) Florian Pelgrin University of Lausanne, École des HEC Department of mathematics (IMEANice) Sept. 2011  Jan. 2012 Florian Pelgrin (HEC) Univariate time series Sept.
More informationIntroduction to ARMA Models
Statistics 910, #8 1 Overview Introduction to ARMA Models 1. Modeling paradigm 2. Review stationary linear processes 3. ARMA processes 4. Stationarity of ARMA processes 5. Identifiability of ARMA processes
More informationAnalysis and Computation for Finance Time Series  An Introduction
ECMM703 Analysis and Computation for Finance Time Series  An Introduction Alejandra González Harrison 161 Email: mag208@exeter.ac.uk Time Series  An Introduction A time series is a sequence of observations
More informationTime Series Analysis
Time Series Analysis Andrea Beccarini Center for Quantitative Economics Winter 2013/2014 Andrea Beccarini (CQE) Time Series Analysis Winter 2013/2014 1 / 143 Introduction Objectives Time series are ubiquitous
More informationA Multiplicative Seasonal BoxJenkins Model to Nigerian Stock Prices
A Multiplicative Seasonal BoxJenkins Model to Nigerian Stock Prices Ette Harrison Etuk Department of Mathematics/Computer Science, Rivers State University of Science and Technology, Nigeria Email: ettetuk@yahoo.com
More informationUnivariate and Multivariate Methods PEARSON. Addison Wesley
Time Series Analysis Univariate and Multivariate Methods SECOND EDITION William W. S. Wei Department of Statistics The Fox School of Business and Management Temple University PEARSON Addison Wesley Boston
More informationEstimating an ARMA Process
Statistics 910, #12 1 Overview Estimating an ARMA Process 1. Main ideas 2. Fitting autoregressions 3. Fitting with moving average components 4. Standard errors 5. Examples 6. Appendix: Simple estimators
More informationSales forecasting # 2
Sales forecasting # 2 Arthur Charpentier arthur.charpentier@univrennes1.fr 1 Agenda Qualitative and quantitative methods, a very general introduction Series decomposition Short versus long term forecasting
More informationDiscrete Time Series Analysis with ARMA Models
Discrete Time Series Analysis with ARMA Models Veronica Sitsofe Ahiati (veronica@aims.ac.za) African Institute for Mathematical Sciences (AIMS) Supervised by Tina Marquardt Munich University of Technology,
More information1 Short Introduction to Time Series
ECONOMICS 7344, Spring 202 Bent E. Sørensen January 24, 202 Short Introduction to Time Series A time series is a collection of stochastic variables x,.., x t,.., x T indexed by an integer value t. The
More informationTime Series Analysis in Economics. Klaus Neusser
Time Series Analysis in Economics Klaus Neusser May 26, 2015 Contents I Univariate Time Series Analysis 3 1 Introduction 1 1.1 Some examples.......................... 2 1.2 Formal definitions.........................
More information4.3 Moving Average Process MA(q)
66 CHAPTER 4. STATIONARY TS MODELS 4.3 Moving Average Process MA(q) Definition 4.5. {X t } is a movingaverage process of order q if X t = Z t + θ 1 Z t 1 +... + θ q Z t q, (4.9) where and θ 1,...,θ q
More informationUnivariate Time Series Analysis; ARIMA Models
Econometrics 2 Spring 25 Univariate Time Series Analysis; ARIMA Models Heino Bohn Nielsen of4 Outline of the Lecture () Introduction to univariate time series analysis. (2) Stationarity. (3) Characterizing
More informationChapter 9: Univariate Time Series Analysis
Chapter 9: Univariate Time Series Analysis In the last chapter we discussed models with only lags of explanatory variables. These can be misleading if: 1. The dependent variable Y t depends on lags of
More informationELECE8104 Stochastics models and estimation, Lecture 3b: Linear Estimation in Static Systems
Stochastics models and estimation, Lecture 3b: Linear Estimation in Static Systems Minimum Mean Square Error (MMSE) MMSE estimation of Gaussian random vectors Linear MMSE estimator for arbitrarily distributed
More informationPerforming Unit Root Tests in EViews. Unit Root Testing
Página 1 de 12 Unit Root Testing The theory behind ARMA estimation is based on stationary time series. A series is said to be (weakly or covariance) stationary if the mean and autocovariances of the series
More informationNonStationary Time Series andunitroottests
Econometrics 2 Fall 2005 NonStationary Time Series andunitroottests Heino Bohn Nielsen 1of25 Introduction Many economic time series are trending. Important to distinguish between two important cases:
More informationPITFALLS IN TIME SERIES ANALYSIS. Cliff Hurvich Stern School, NYU
PITFALLS IN TIME SERIES ANALYSIS Cliff Hurvich Stern School, NYU The t Test If x 1,..., x n are independent and identically distributed with mean 0, and n is not too small, then t = x 0 s n has a standard
More informationSome useful concepts in univariate time series analysis
Some useful concepts in univariate time series analysis Autoregressive moving average models Autocorrelation functions Model Estimation Diagnostic measure Model selection Forecasting Assumptions: 1. Nonseasonal
More informationThe VAR models discussed so fare are appropriate for modeling I(0) data, like asset returns or growth rates of macroeconomic time series.
Cointegration The VAR models discussed so fare are appropriate for modeling I(0) data, like asset returns or growth rates of macroeconomic time series. Economic theory, however, often implies equilibrium
More informationTIME SERIES ANALYSIS
TIME SERIES ANALYSIS L.M. BHAR AND V.K.SHARMA Indian Agricultural Statistics Research Institute Library Avenue, New Delhi0 02 lmb@iasri.res.in. Introduction Time series (TS) data refers to observations
More informationLuciano Rispoli Department of Economics, Mathematics and Statistics Birkbeck College (University of London)
Luciano Rispoli Department of Economics, Mathematics and Statistics Birkbeck College (University of London) 1 Forecasting: definition Forecasting is the process of making statements about events whose
More informationFinancial TIme Series Analysis: Part II
Department of Mathematics and Statistics, University of Vaasa, Finland January 29 February 13, 2015 Feb 14, 2015 1 Univariate linear stochastic models: further topics Unobserved component model Signal
More informationTime Series in Mathematical Finance
Instituto Superior Técnico (IST, Portugal) and CEMAT cnunes@math.ist.utl.pt European Summer School in Industrial Mathematics Universidad Carlos III de Madrid July 2013 Outline The objective of this short
More informationIntroduction to Time Series Analysis. Lecture 6.
Introduction to Time Series Analysis. Lecture 6. Peter Bartlett www.stat.berkeley.edu/ bartlett/courses/153fall2010 Last lecture: 1. Causality 2. Invertibility 3. AR(p) models 4. ARMA(p,q) models 1 Introduction
More informationChapter 6: Multivariate Cointegration Analysis
Chapter 6: Multivariate Cointegration Analysis 1 Contents: Lehrstuhl für Department Empirische of Wirtschaftsforschung Empirical Research and und Econometrics Ökonometrie VI. Multivariate Cointegration
More informationTime Series  ARIMA Models. Instructor: G. William Schwert
APS 425 Fall 25 Time Series : ARIMA Models Instructor: G. William Schwert 585275247 schwert@schwert.ssb.rochester.edu Topics Typical time series plot Pattern recognition in auto and partial autocorrelations
More informationITSMR Reference Manual
ITSMR Reference Manual George Weigt June 5, 2015 1 Contents 1 Introduction 3 1.1 Time series analysis in a nutshell............................... 3 1.2 White Noise Variance.....................................
More informationLecture Notes on Univariate Time Series Analysis and Box Jenkins Forecasting John Frain Economic Analysis, Research and Publications April 1992 (reprinted with revisions) January 1999 Abstract These are
More informationTime Series Analysis
Time Series Analysis Forecasting with ARIMA models Andrés M. Alonso Carolina GarcíaMartos Universidad Carlos III de Madrid Universidad Politécnica de Madrid June July, 2012 Alonso and GarcíaMartos (UC3MUPM)
More informationLecture 4: Seasonal Time Series, Trend Analysis & Component Model Bus 41910, Time Series Analysis, Mr. R. Tsay
Lecture 4: Seasonal Time Series, Trend Analysis & Component Model Bus 41910, Time Series Analysis, Mr. R. Tsay Business cycle plays an important role in economics. In time series analysis, business cycle
More informationUnivariate Time Series Analysis; ARIMA Models
Econometrics 2 Fall 25 Univariate Time Series Analysis; ARIMA Models Heino Bohn Nielsen of4 Univariate Time Series Analysis We consider a single time series, y,y 2,..., y T. We want to construct simple
More informationAnalysis of algorithms of time series analysis for forecasting sales
SAINTPETERSBURG STATE UNIVERSITY Mathematics & Mechanics Faculty Chair of Analytical Information Systems Garipov Emil Analysis of algorithms of time series analysis for forecasting sales Course Work Scientific
More informationChapter 5: Bivariate Cointegration Analysis
Chapter 5: Bivariate Cointegration Analysis 1 Contents: Lehrstuhl für Department Empirische of Wirtschaftsforschung Empirical Research and und Econometrics Ökonometrie V. Bivariate Cointegration Analysis...
More informationTime Series Analysis
Time Series Analysis Autoregressive, MA and ARMA processes Andrés M. Alonso Carolina GarcíaMartos Universidad Carlos III de Madrid Universidad Politécnica de Madrid June July, 212 Alonso and GarcíaMartos
More informationAdvanced Linear Modeling
Ronald Christensen Advanced Linear Modeling Multivariate, Time Series, and Spatial Data; Nonparametric Regression and Response Surface Maximization Second Edition Springer Preface to the Second Edition
More informationState Space Time Series Analysis
State Space Time Series Analysis p. 1 State Space Time Series Analysis Siem Jan Koopman http://staff.feweb.vu.nl/koopman Department of Econometrics VU University Amsterdam Tinbergen Institute 2011 State
More informationAR(p) + MA(q) = ARMA(p, q)
AR(p) + MA(q) = ARMA(p, q) Outline 1 3.4: ARMA(p, q) Model 2 Homework 3a Arthur Berg AR(p) + MA(q) = ARMA(p, q) 2/ 12 ARMA(p, q) Model Definition (ARMA(p, q) Model) A time series is ARMA(p, q) if it is
More informationTIME SERIES ANALYSIS
TIME SERIES ANALYSIS Ramasubramanian V. I.A.S.R.I., Library Avenue, New Delhi 110 012 ram_stat@yahoo.co.in 1. Introduction A Time Series (TS) is a sequence of observations ordered in time. Mostly these
More informationEstimation and Inference in Cointegration Models Economics 582
Estimation and Inference in Cointegration Models Economics 582 Eric Zivot May 17, 2012 Tests for Cointegration Let the ( 1) vector Y be (1). Recall, Y is cointegrated with 0 cointegrating vectors if there
More informationTime Series Analysis
Time Series Analysis hm@imm.dtu.dk Informatics and Mathematical Modelling Technical University of Denmark DK2800 Kgs. Lyngby 1 Outline of the lecture Identification of univariate time series models, cont.:
More informationTime Series Analysis
Time Series 1 April 9, 2013 Time Series Analysis This chapter presents an introduction to the branch of statistics known as time series analysis. Often the data we collect in environmental studies is collected
More informationTime Series Analysis of Aviation Data
Time Series Analysis of Aviation Data Dr. Richard Xie February, 2012 What is a Time Series A time series is a sequence of observations in chorological order, such as Daily closing price of stock MSFT in
More informationForecasting the US Dollar / Euro Exchange rate Using ARMA Models
Forecasting the US Dollar / Euro Exchange rate Using ARMA Models LIUWEI (9906360)  1  ABSTRACT...3 1. INTRODUCTION...4 2. DATA ANALYSIS...5 2.1 Stationary estimation...5 2.2 DickeyFuller Test...6 3.
More informationPowerful new tools for time series analysis
Christopher F Baum Boston College & DIW August 2007 hristopher F Baum ( Boston College & DIW) NASUG2007 1 / 26 Introduction This presentation discusses two recent developments in time series analysis by
More informationChapter 7 The ARIMA Procedure. Chapter Table of Contents
Chapter 7 Chapter Table of Contents OVERVIEW...193 GETTING STARTED...194 TheThreeStagesofARIMAModeling...194 IdentificationStage...194 Estimation and Diagnostic Checking Stage...... 200 Forecasting Stage...205
More informationTime Series Graphs. Model ACF PACF. White Noise All zeros All zeros. AR(p) Exponential Decay P significant lags before dropping to zero
Time Series Graphs Model ACF PACF White Noise All zeros All zeros AR(p) Exponential Decay P significant lags before dropping to zero MA(q) q significant lags before dropping to zero Exponential Decay ARMA(p,q)
More informationTime Series Analysis
Time Series Analysis Identifying possible ARIMA models Andrés M. Alonso Carolina GarcíaMartos Universidad Carlos III de Madrid Universidad Politécnica de Madrid June July, 2012 Alonso and GarcíaMartos
More informationMaximum Likelihood Estimation of an ARMA(p,q) Model
Maximum Likelihood Estimation of an ARMA(p,q) Model Constantino Hevia The World Bank. DECRG. October 8 This note describes the Matlab function arma_mle.m that computes the maximum likelihood estimates
More informationDetekce změn v autoregresních posloupnostech
Nové Hrady 2012 Outline 1 Introduction 2 3 4 Change point problem (retrospective) The data Y 1,..., Y n follow a statistical model, which may change once or several times during the observation period
More informationRob J Hyndman. Forecasting using. 11. Dynamic regression OTexts.com/fpp/9/1/ Forecasting using R 1
Rob J Hyndman Forecasting using 11. Dynamic regression OTexts.com/fpp/9/1/ Forecasting using R 1 Outline 1 Regression with ARIMA errors 2 Example: Japanese cars 3 Using Fourier terms for seasonality 4
More informationEconometria dei mercati finanziari c.a. A.A. 20112012. 4. AR, MA and ARMA Time Series Models. Luca Fanelli. University of Bologna
Econometria dei mercati finanziari c.a. A.A. 20112012 4. AR, MA and ARMA Time Series Models Luca Fanelli University of Bologna luca.fanelli@unibo.it For each class of models considered in these slides
More informationChapter 12: Time Series Models
Chapter 12: Time Series Models In this chapter: 1. Estimating ad hoc distributed lag & Koyck distributed lag models (UE 12.1.3) 2. Testing for serial correlation in Koyck distributed lag models (UE 12.2.2)
More informationDepartment of Economics
Department of Economics Working Paper Do Stock Market Risk Premium Respond to Consumer Confidence? By Abdur Chowdhury Working Paper 2011 06 College of Business Administration Do Stock Market Risk Premium
More informationTime Series Analysis
Time Series Analysis Lecture Notes for 475.726 Ross Ihaka Statistics Department University of Auckland April 14, 2005 ii Contents 1 Introduction 1 1.1 Time Series.............................. 1 1.2 Stationarity
More informationLecture 1: Univariate Time Series B41910: Autumn Quarter, 2008, by Mr. Ruey S. Tsay
Lecture 1: Univariate Time Series B41910: Autumn Quarter, 2008, by Mr. Ruey S. Tsay 1 Some Basic Concepts 1. Time Series: A sequence of random variables measuring certain quantity of interest over time.
More informationSYSTEMS OF REGRESSION EQUATIONS
SYSTEMS OF REGRESSION EQUATIONS 1. MULTIPLE EQUATIONS y nt = x nt n + u nt, n = 1,...,N, t = 1,...,T, x nt is 1 k, and n is k 1. This is a version of the standard regression model where the observations
More informationAdvanced Forecasting Techniques and Models: ARIMA
Advanced Forecasting Techniques and Models: ARIMA Short Examples Series using Risk Simulator For more information please visit: www.realoptionsvaluation.com or contact us at: admin@realoptionsvaluation.com
More informationUnit Root Tests. 4.1 Introduction. This is page 111 Printer: Opaque this
4 Unit Root Tests This is page 111 Printer: Opaque this 4.1 Introduction Many economic and financial time series exhibit trending behavior or nonstationarity in the mean. Leading examples are asset prices,
More informationChapter 4: Vector Autoregressive Models
Chapter 4: Vector Autoregressive Models 1 Contents: Lehrstuhl für Department Empirische of Wirtschaftsforschung Empirical Research and und Econometrics Ökonometrie IV.1 Vector Autoregressive Models (VAR)...
More informationTime Series Analysis
JUNE 2012 Time Series Analysis CONTENT A time series is a chronological sequence of observations on a particular variable. Usually the observations are taken at regular intervals (days, months, years),
More informationAn Introduction to Time Series Regression
An Introduction to Time Series Regression Henry Thompson Auburn University An economic model suggests examining the effect of exogenous x t on endogenous y t with an exogenous control variable z t. In
More informationProbability and Random Variables. Generation of random variables (r.v.)
Probability and Random Variables Method for generating random variables with a specified probability distribution function. Gaussian And Markov Processes Characterization of Stationary Random Process Linearly
More information9th Russian Summer School in Information Retrieval Big Data Analytics with R
9th Russian Summer School in Information Retrieval Big Data Analytics with R Introduction to Time Series with R A. Karakitsiou A. Migdalas Industrial Logistics, ETS Institute Luleå University of Technology
More informationMGT 267 PROJECT. Forecasting the United States Retail Sales of the Pharmacies and Drug Stores. Done by: Shunwei Wang & Mohammad Zainal
MGT 267 PROJECT Forecasting the United States Retail Sales of the Pharmacies and Drug Stores Done by: Shunwei Wang & Mohammad Zainal Dec. 2002 The retail sale (Million) ABSTRACT The present study aims
More informationForecasting model of electricity demand in the Nordic countries. Tone Pedersen
Forecasting model of electricity demand in the Nordic countries Tone Pedersen 3/19/2014 Abstract A model implemented in order to describe the electricity demand on hourly basis for the Nordic countries.
More informationTraffic Safety Facts. Research Note. Time Series Analysis and Forecast of Crash Fatalities during Six Holiday Periods Cejun Liu* and ChouLin Chen
Traffic Safety Facts Research Note March 2004 DOT HS 809 718 Time Series Analysis and Forecast of Crash Fatalities during Six Holiday Periods Cejun Liu* and ChouLin Chen Summary This research note uses
More informationA Trading Strategy Based on the LeadLag Relationship of Spot and Futures Prices of the S&P 500
A Trading Strategy Based on the LeadLag Relationship of Spot and Futures Prices of the S&P 500 FE8827 Quantitative Trading Strategies 2010/11 MiniTerm 5 Nanyang Technological University Submitted By:
More informationADVANCED FORECASTING MODELS USING SAS SOFTWARE
ADVANCED FORECASTING MODELS USING SAS SOFTWARE Girish Kumar Jha IARI, Pusa, New Delhi 110 012 gjha_eco@iari.res.in 1. Transfer Function Model Univariate ARIMA models are useful for analysis and forecasting
More informationRegression Analysis. Regression Analysis MIT 18.S096. Dr. Kempthorne. Fall 2013
Lecture 6: Regression Analysis MIT 18.S096 Dr. Kempthorne Fall 2013 MIT 18.S096 Regression Analysis 1 Outline Regression Analysis 1 Regression Analysis MIT 18.S096 Regression Analysis 2 Multiple Linear
More informationEnergy Load Mining Using Univariate Time Series Analysis
Energy Load Mining Using Univariate Time Series Analysis By: Taghreed Alghamdi & Ali Almadan 03/02/2015 Caruth Hall 0184 Energy Forecasting Energy Saving Energy consumption Introduction: Energy consumption.
More informationMaximum likelihood estimation of mean reverting processes
Maximum likelihood estimation of mean reverting processes José Carlos García Franco Onward, Inc. jcpollo@onwardinc.com Abstract Mean reverting processes are frequently used models in real options. For
More informationUnit root properties of natural gas spot and futures prices: The relevance of heteroskedasticity in high frequency data
DEPARTMENT OF ECONOMICS ISSN 14415429 DISCUSSION PAPER 20/14 Unit root properties of natural gas spot and futures prices: The relevance of heteroskedasticity in high frequency data Vinod Mishra and Russell
More informationA course in Time Series Analysis. Suhasini Subba Rao Email: suhasini.subbarao@stat.tamu.edu
A course in Time Series Analysis Suhasini Subba Rao Email: suhasini.subbarao@stat.tamu.edu August 5, 205 Contents Introduction 8. Time Series data................................. 8.. R code....................................2
More informationChapter 5. Analysis of Multiple Time Series. 5.1 Vector Autoregressions
Chapter 5 Analysis of Multiple Time Series Note: The primary references for these notes are chapters 5 and 6 in Enders (2004). An alternative, but more technical treatment can be found in chapters 1011
More informationGraphical Tools for Exploring and Analyzing Data From ARIMA Time Series Models
Graphical Tools for Exploring and Analyzing Data From ARIMA Time Series Models William Q. Meeker Department of Statistics Iowa State University Ames, IA 50011 January 13, 2001 Abstract Splus is a highly
More informationStatistics and Probability Letters
Statistics and Probability Letters 79 (2009) 1884 1889 Contents lists available at ScienceDirect Statistics and Probability Letters journal homepage: www.elsevier.com/locate/stapro Discretevalued ARMA
More informationTable 1: Unit Root Tests KPSS Test Augmented DickeyFuller Test with Time Trend
Table 1: Unit Root Tests KPSS Test Augmented DickeyFuller Test with Time Trend with Time Trend test statistic pvalue test statistic Corn 2.953.146.179 Soy 2.663.252.353 Corn 2.752.215.171 Soy 2.588.285.32
More informationForecasting of Paddy Production in Sri Lanka: A Time Series Analysis using ARIMA Model
Tropical Agricultural Research Vol. 24 (): 23 (22) Forecasting of Paddy Production in Sri Lanka: A Time Series Analysis using ARIMA Model V. Sivapathasundaram * and C. Bogahawatte Postgraduate Institute
More informationTHE SVM APPROACH FOR BOX JENKINS MODELS
REVSTAT Statistical Journal Volume 7, Number 1, April 2009, 23 36 THE SVM APPROACH FOR BOX JENKINS MODELS Authors: Saeid Amiri Dep. of Energy and Technology, Swedish Univ. of Agriculture Sciences, P.O.Box
More informationFactor analysis. Angela Montanari
Factor analysis Angela Montanari 1 Introduction Factor analysis is a statistical model that allows to explain the correlations between a large number of observed correlated variables through a small number
More informationL10: Probability, statistics, and estimation theory
L10: Probability, statistics, and estimation theory Review of probability theory Bayes theorem Statistics and the Normal distribution Least Squares Error estimation Maximum Likelihood estimation Bayesian
More informationTime Series Analysis: Basic Forecasting.
Time Series Analysis: Basic Forecasting. As published in Benchmarks RSS Matters, April 2015 http://web3.unt.edu/benchmarks/issues/2015/04/rssmatters Jon Starkweather, PhD 1 Jon Starkweather, PhD jonathan.starkweather@unt.edu
More informationIs the Forward Exchange Rate a Useful Indicator of the Future Exchange Rate?
Is the Forward Exchange Rate a Useful Indicator of the Future Exchange Rate? Emily Polito, Trinity College In the past two decades, there have been many empirical studies both in support of and opposing
More informationMaster s Theory Exam Spring 2006
Spring 2006 This exam contains 7 questions. You should attempt them all. Each question is divided into parts to help lead you through the material. You should attempt to complete as much of each problem
More informationTesting against a Change from Short to Long Memory
Testing against a Change from Short to Long Memory Uwe Hassler and Jan Scheithauer GoetheUniversity Frankfurt This version: January 2, 2008 Abstract This paper studies some wellknown tests for the null
More informationAPPLICATION OF THE VARMA MODEL FOR SALES FORECAST: CASE OF URMIA GRAY CEMENT FACTORY
APPLICATION OF THE VARMA MODEL FOR SALES FORECAST: CASE OF URMIA GRAY CEMENT FACTORY DOI: 10.2478/tjeb20140005 Ramin Bashir KHODAPARASTI 1 Samad MOSLEHI 2 To forecast sales as reliably as possible is
More informationEmpirical Properties of the Indonesian Rupiah: Testing for Structural Breaks, Unit Roots, and White Noise
Volume 24, Number 2, December 1999 Empirical Properties of the Indonesian Rupiah: Testing for Structural Breaks, Unit Roots, and White Noise Reza Yamora Siregar * 1 This paper shows that the real exchange
More informationChapter 1. Vector autoregressions. 1.1 VARs and the identi cation problem
Chapter Vector autoregressions We begin by taking a look at the data of macroeconomics. A way to summarize the dynamics of macroeconomic data is to make use of vector autoregressions. VAR models have become
More informationPromotional Analysis and Forecasting for Demand Planning: A Practical Time Series Approach Michael Leonard, SAS Institute Inc.
Promotional Analysis and Forecasting for Demand Planning: A Practical Time Series Approach Michael Leonard, SAS Institute Inc. Cary, NC, USA Abstract Many businesses use sales promotions to increase the
More informationOverview of Violations of the Basic Assumptions in the Classical Normal Linear Regression Model
Overview of Violations of the Basic Assumptions in the Classical Normal Linear Regression Model 1 September 004 A. Introduction and assumptions The classical normal linear regression model can be written
More informationTesting against a Change from Short to Long Memory
Testing against a Change from Short to Long Memory Uwe Hassler and Jan Scheithauer GoetheUniversity Frankfurt This version: December 9, 2007 Abstract This paper studies some wellknown tests for the null
More informationSystem Identification for Acoustic Comms.:
System Identification for Acoustic Comms.: New Insights and Approaches for Tracking Sparse and Rapidly Fluctuating Channels Weichang Li and James Preisig Woods Hole Oceanographic Institution The demodulation
More informationIn this paper we study how the timeseries structure of the demand process affects the value of information
MANAGEMENT SCIENCE Vol. 51, No. 6, June 25, pp. 961 969 issn 25199 eissn 1526551 5 516 961 informs doi 1.1287/mnsc.15.385 25 INFORMS Information Sharing in a Supply Chain Under ARMA Demand Vishal Gaur
More information2. What are the theoretical and practical consequences of autocorrelation?
Lecture 10 Serial Correlation In this lecture, you will learn the following: 1. What is the nature of autocorrelation? 2. What are the theoretical and practical consequences of autocorrelation? 3. Since
More informationTime Series Analysis
Time Series Analysis Time series and stochastic processes Andrés M. Alonso Carolina GarcíaMartos Universidad Carlos III de Madrid Universidad Politécnica de Madrid June July, 2012 Alonso and GarcíaMartos
More informationTrading Basket Construction. Mean Reversion Trading. Haksun Li haksun.li@numericalmethod.com www.numericalmethod.com
Trading Basket Construction Mean Reversion Trading Haksun Li haksun.li@numericalmethod.com www.numericalmethod.com Speaker Profile Dr. Haksun Li CEO, Numerical Method Inc. (Ex)Adjunct Professors, Industry
More informationSections 2.11 and 5.8
Sections 211 and 58 Timothy Hanson Department of Statistics, University of South Carolina Stat 704: Data Analysis I 1/25 Gesell data Let X be the age in in months a child speaks his/her first word and
More information