Sales forecasting # 2


 Brandon Cobb
 2 years ago
 Views:
Transcription
1 Sales forecasting # 2 Arthur Charpentier 1
2 Agenda Qualitative and quantitative methods, a very general introduction Series decomposition Short versus long term forecasting Regression techniques Regression and econometric methods Box & Jenkins ARIMA time series method Forecasting with ARIMA series Practical issues : forecasting with MSExcel 2
3 Time series decomposition A13 Highway
4 Time series decomposition A13 Highway
5 Time series decomposition A13 Highway, removing trending
6 Time series decomposition A13 Highway, removing trending Months 6
7 Time series decomposition A13 Highway, removing trending Months 7
8 Time series decomposition A13 Highway: trend and cycle
9 Time series decomposition A13 Highway: random part
10 Time series decomposition A13 Highway: random part
11 Time series decomposition A13 Highway: random part
12 Time series decomposition A13 Highway, prediction
13 Time series decomposition A13 Highway, prediction
14 Time series decomposition A13 Highway: random part (v2) 14
15 Time series decomposition A13 Highway: random part (v2) 15
16 Time series decomposition, modeling the random part Histogram of residuals (v2) Density 0e+00 2e 04 4e
17 Time series decomposition, modeling the random part Normal QQ plot of residuals (v2) Theoretical Quantiles Sample Quantiles 17
18 Time series decomposition, forecasting A13 Highway, forecast scenario
19 Time series decomposition, forecasting A13 Highway, forecast scenario
20 Time series decomposition, forecasting A13 Highway, forecast scenario
21 Time series decomposition, forecasting A13 Highway, forecast scenario
22 Time series decomposition, modeling the seasonal componant A13 Highway, removing trending Months 22
23 Time series decomposition, modeling the seasonal componant A13 Highway: trend and cycle
24 Time series decomposition, modeling the seasonal componant A13 Highway: random part 24
25 Modeling the random component The unpredictible random component is the key element when forecasting. Most of the uncertainty comes from this random component ε t. The lower the variance, the smaller the uncertainty on forecasts. The general theoritical framework related to randomness of time series is related to weakly stationary. 25
26 Dening stationarity Time series (X t ) is weakly stationary if for all t, E ( ) Xt 2 < +, for all t, E (X t ) = µ, constant independent of t, for all t and for all h, cov (X t, X t+h ) = E ([X t µ] [X t+h µ]) = γ (h), independent of t. Function γ ( ) is called autocovariance function. Given a stationary series (X t ), dene the autocovariance function, as h γ X (h) = cov (X t, X t h ) = E (X t X t h ) E (X t ).E (X t h ). and dene the autocorrelation function, as h ρ X (h) = corr (X t, X t h ) = cov (X t, X t h ) V (Xt ) V (X t h ) = γ X (h) γ X (0). 26
27 Dening stationarity A process (X t ) is said to be strongly stationary if for all t 1,..., t n and h we have the following law equality L (X t1,..., X tn ) = L (X t1 +h,..., X tn +h). A time series (ε t ) is a white noise if all autocovariances are null, i.e. γ (h) = 0 for all h 0. Thus, a process (ε t ) is a white noise if it is stationary, centred and noncorrelated, i.e. E (ε t ) = 0, V (ε t ) = σ 2 and ρ ε (h) = 0 for any h 0. 27
28 Statistical issues Consider a set of observations {X 1,..., X T }. The empirical mean is dened as X T = 1 T T X t. t=1 The empirical autocovariance function is dened as γ T (h) = 1 T h T h t=1 ( Xt X T ) ( Xt h X T ), while the empirical autocorrelation function is dened as ρ T (h) = γ T (h) γ T (0). Remark those estimators can be biased, but asymptotically unbiased. More precisely γ T (h) γ (h) and ρ T (h) ρ (h) as T. 28
29 Backward and forward operators Dene the lag operator L (or B for backward) the linear operator dened as L : X t L (X t ) = LX t = X t 1, and the forward operator F, F : X t F (X t ) = F X t = X t+1, Note that L F = F L = I (identity operator) and further F = L 1 and L = F 1. it is possible to compose those operators : L 2 = L L, and more generally L p = L L... L } {{ } where p N with convention L 0 = I. Note that L p (X t ) = X t p. Let A denote a polynom,a (z) = a 0 + a 1 z + a 2 z a p z p. Then A (L) is the 29
30 operator p A (L) = a 0 I + a 1 L + a 2 L a p L p = a k L k. Let (X t ) denote a time series. Series (Y t ) dened by Y t = A (L) X t satises k=0 Y t = A (L) X t = p a k X t k. k=0 or, more generally, assuming that we can formally the limit, A (z) = a k z k et A (L) = k=0 a k L k. k=0 30
31 Backward and forward operators Note that for all moving average A and B, then A (L) + B (L) = (A + B) (L) α R, αa (L) = (αa) (L) A (L) B (L) = (AB) (L) = B (L) A (L). Moving average C = AB = BA satises ( ) ( ) ( ) a k L k b k L k = c i L i k=0 k=0 i=0 où c i = i a k b i k. k=0 31
32 Geometry and probability Recall that it is possible to dene an inner product in L 2 (space of squared integrable variables, i.e. nite variance), < X, Y >= E ([X E(X)] [Y E(Y )]) = cov([x E(X)], [Y E(Y )]) Then the associated norm is X 2 = E ( [X E(X)] 2) = V (X). Two random variables are then orthogonal if < X, Y >= 0, i.e. cov([x E(X)], [Y E(Y )]) = 0. Hence conditional expectation is simply a projection in the L 2, E(X Y ) is the the projection is the space generated by Y of random variable X, i.e. E(X Y ) = φ(y ), such that X φ(y ) X, i.e. < X φ(y ), X >= 0, φ(y ) = Z = argmin{z = h(y ), X Z 2 } E(φ(Y )) <. 32
33 Linear projection The conditional expectation E(X Y ) is a projection if the set of all functions {h(y )}. In linear regression, the projection if made in the subset of linear functions h( ). We call this linear function conditional linear expectation, or linear projection, denoted EL(X Y ). In purely endogeneous models, the best forecast for X T +1 given past informations {X T, X T 1, X T 2,, X T h,...} is X T +1 = E(X T +1 {X T, X T 1, X T 2,, X T h, }) = φ(x T, X T 1, X T 2,, X T h, Since estimating a nonlinear function is dicult (especially in high dimension), we focus on linear functions, i.e. autoregressive models, X T +1 = EL(X T +1 {X T, X T 1, X T 2,, X T h, }) = α 0 X T +α 1 X T 1 +α 2 X T
34 Dening partial autocorrelations Given a stationary series (X t ), dene the partial autocorrelation function h ψ X (h) as ( ψ X (h) = corr Xt, X ) t h, where X t h = X t h EL (X t h X t 1,..., X t h+1 ) X t = X t EL (X t X t 1,..., X t h+1 ). 34
35 Time series decomposition, modeling the random part A13 Highway: random part (v2) 35
36 Time series decomposition, modeling the random part Autocorrelations of residuals (v2) ACF Lag 36
37 Time series decomposition, modeling the random part Partial autocorrelations of residuals (v2) Partial ACF Lag 37
38 Time series decomposition, modeling the detrended series A13 Highway, removing trending
39 Time series decomposition, modeling the detrended series Autocorrelations of detrended series ACF Lag 39
40 Time series decomposition, modeling the detrended series Partial autocorrelations of detrended series Partial ACF Lag 40
41 Time series decomposition, modeling Y t = X t X t 12 A13 Highway: lagged detrended series
42 Time series decomposition, modeling Y t = X t X t 12 A13 Highway: lagged detrended series
43 Time series decomposition, modeling Y t = X t X t 12 Autocorrelations of lagged detrended series ACF Lag 43
44 Time series decomposition, modeling Y t = X t X t 12 Partial autocorrelations of lagged detrended series Partial ACF Lag 44
45 Time series decomposition, forecasting A13 Highway: forecasting detrended series (ARMA)
46 Time series decomposition, forecasting A13 Highway: forecasting detrended series (ARMA)
47 47
48 Estimating autocorrelations with MSExcel 48
49 A white noise A white noise is dened as a centred process (E(ε t ) = 0), stationary (V (ε t ) = σ 2 ), such that cov (ε t, ε t h ) = 0 for all h 0. The socalled BoxPierce test can be used to test H 0 : ρ (1) = ρ (2) =... = ρ (h) = 0 H a : there exists i such that ρ (i) 0. The idea is to use Q h = T where h is the lag number and T the total number of observations. h k=1 Under H 0, Q h has a χ 2 distribution, with h degrees of freedom. ρ 2 k, 49
50 A white noise Another statistics with better properties is a modied version of Q, Q h = T (T + 2) h k=1 ρ 2 k T k, Most of the softwares return Q h for h = 1, 2,, and the associated pvalue. If p exceeds 5% (the standard signicance level) we feel condent in accepting H 0, while if p is less than 5%, we should reject H 0. 50
51 A white noise Simulated white noise White noise autocorrelations White noise partial autocorrelations ACF Partial ACF Lag Lag 51
52 Time series decomposition, testing for white noise Box Pierce statistic, testing for white noise on lagged detrended series Q Box Pierce statistics p value
53 Time series decomposition, testing for white noise Box Pierce statistic, testing for white noise on residuals (v2) Q Box Pierce statistics p value
54 Autoregressive process AR(p) We call autoregressive process of order p, denoted AR (p), a stationnary process (X t ) satisfying equation X t p φ i X t i = ε t for all t Z, (1) i=1 where the φ i 's are realvalued coecients and where (ε t ) is a white noise process with variance σ 2. (1) is equivalent to Φ (L) X t = ε t where Φ (L) = I φ 1 L φ p L p 54
55 Autoregressive process AR(1), order 1 The general expression for AR (1) process is X t φx t 1 = ε t for all t Z, where (ε t ) is a white noise with variance σ 2. If φ = ±1, process (X t ) is not stationary. E.g. if φ = 1, X t = X t 1 + ε t (called random walk) can be written and thus E (X t X t h ) 2 = hσ 2. X t X t h = ε t + ε t ε t h+1, But it is possible to prove that for any stationary process E (X t X t h ) 2 4V (X t ). Since it is impossible to have for any h, hσ 2 4V (X t ), it means that the process cannot be stationary. 55
56 Autoregressive process AR(1), order 1 If φ < 1 it is possible to invert the polynomial lag operator X t = (1 φl) 1 ε t = φ i ε t i (as a function of the past) (ε t ) ). (2) i=0 For a stationary process,the aucorelation function is given by ρ (h) = φ h. Further, ψ(1) = φ and ψ(h) = 0 for h 2. 56
57 A AR(1) process, X t = 0.7X t 1 + ε t Simulated AR(1) AR(1) autocorrelations AR(1) partial autocorrelations ACF Partial ACF Lag Lag 57
58 A AR(1) process, X t = 0.4X t 1 + ε t Simulated AR(1) AR(1) autocorrelations AR(1) partial autocorrelations ACF Partial ACF Lag Lag 58
59 A AR(1) process, X t = 0.5X t 1 + ε t Simulated AR(1) AR(1) autocorrelations AR(1) partial autocorrelations ACF Partial ACF Lag Lag 59
60 A AR(1) process, X t = 0.99X t 1 + ε t Simulated AR(1) AR(1) autocorrelations AR(1) partial autocorrelations ACF Partial ACF Lag Lag 60
61 Autoregressive process AR(2), order 2 Those processes are also called Yule process, and they satisfy ( 1 φ1 L φ 2 L 2) X t = ε t, where the roots of Φ (z) = 1 φ 1 z φ 2 z 2 are assumed to lie outside the unit circle, i.e. 1 φ 1 + φ 2 > φ 1 φ 2 > 0 φ φ 2 > 0, 61
62 Autoregressive process AR(2), order 2 Autocorrelation function satises equation ρ (h) = φ 1 ρ (h 1) + φ 2 ρ (h 2) for any h 2, and the partial autocorrelation function satises ρ (1) for h = 1 [ ψ (h) = ρ (2) ρ (1) 2] [ / 1 ρ (1) 2] for h = 2 0 for h 3. 62
63 A AR(2) process, X t = 0.6X t X t 2 + ε t Simulated AR(2) AR(2) autocorrelations AR(2) partial autocorrelations ACF Partial ACF Lag Lag 63
64 A AR(2) process, X t = 0.4X t 1 0.5X t 2 + ε t Simulated AR(2) AR(2) autocorrelations AR(2) partial autocorrelations ACF Partial ACF Lag Lag 64
65 Moving average process M A(q) We call moving average process of order q, denoted MA (q), a stationnary process (X t ) satisfying equation q X t = ε t + θ i ε t i for all t Z, (3) i=1 where the θ i 's are realvalued coecients, and process (ε t ) is a white noise process with variance σ 2. (3) processes can be written equivalently X t = Θ (L) ε t whereθ (L) = I + θ 1 L θ q L q. The autocovariance function satises γ (h) = E (X t X t h ) = E ([ε t + θ 1 ε t θ q ε t q ] [ε t h + θ 1 ε t h θ q ε t h q ]) [θ h + θ h+1 θ θ q θ q h ] σ 2 if 1 h q = 0 if h > q, 65
66 Moving average process M A(q) If h = 0, then γ (0) = [ 1 + θ θ θ 2 q] σ 2. This equation can be written γ (k) = σ 2 q θ j θ j+k with convention θ 0 = 1. j=0 Autocovariance function satises ρ (h) = θ h + θ h+1 θ θ q θ q h 1 + θ θ θ2 q if 1 h q, and ρ (h) = 0 if h > q. 66
67 Moving average process M A(1), order 1 The general expression of MA (1) is X t = ε t + θε t 1, for all t Z, where (ε t ) is a white noise with variance σ 2. Autocorrelations are given by ρ (1) = θ, and ρ (h) = 0, for h θ2 Note that 1/2 ρ (1) 1/2 : MA (1) processes only have small autocorrelations. Partial autocorrelation of order h is given by ψ (h) = ( 1)h θ h ( θ 2 1 ) 1 θ 2(h+1). 67
68 A MA(1) process, X t = ε t + 0.7ε t 1 Simulated MA(1) MA(1) autocorrelations MA(1) partial autocorrelations ACF Partial ACF Lag Lag 68
69 A MA(1) process, X t = ε t 0.6ε t 1 Simulated MA(1) MA(1) autocorrelations MA(1) partial autocorrelations ACF Partial ACF Lag Lag 69
70 Autoregressive moving average process ARM A(p, q) We call autoregressive moving average process of orders p and q, denoted ARMA (p, q), a stationnary process (X t ) satisfying equation X t = p φ j X t j + ε t + j=1 q θ i ε t i for all t Z, (4) i=1 where the φ j 's and θ i 's are realvalued coecients, and process (ε t ) is a white noise process with variance σ 2. (4) processes can be written equivalently Φ (L) X t = Θ (L) ε t, where Φ (L) = I φ 1 L... φ q L q and Θ (L) = I + θ 1 L θ q L q. 70
71 Autoregressive moving average process ARM A(p, q) Note that under some technical assumptions, one can write X t = Φ 1 (L) Θ (L) ε t, i.e. the ARMA(p, q) process is also an MA( ) process, and Φ (L) Θ 1 (L) X t = ε t, i.e. the ARMA(p, q) process is also an AR( ) process. Wald's theorem claims that any stationary process (satisfying further technical conditions) can be written as a MA process. More generally, in practice, a stationary series can be modeled either by an AR(p) process, a MA(q), or an ARMA(p, q ) whith p < p and q < q. 71
72 A ARMA(1, 1) process, X t = 0.7X t 1 ε t 0.6ε t 1 Simulated ARMA(1,1) ARMA(1,1) autocorrelations ARMA(1,1) partial autocorrelations ACF Partial ACF Lag Lag 72
73 A ARMA(2, 1) process, X t = 0.7X t 1 0.2X t 2 ε t 0.6ε t 1 Simulated ARMA(2,1) ARMA(2,1) autocorrelations ARMA(2,1) partial autocorrelations ACF Partial ACF Lag Lag 73
74 Fitting ARM A processes with MSExcel 74
75 Forecasting with AR(1) processes Consider an AR (1) process, X t = µ + φx t 1 + ε t then T X T +1 = µ + φx T, T X T +2 = µ + φ. T X T +1 = µ + φ [µ + φx T ] = µ [1 + φ] + φ 2 X T, T X T +3 = µ + φ. T X T +2 = µ + φ [µ + φ [µ + φx T ]] = µ [ 1 + φ + φ 2] + φ 3 X T, and recursively T X T +h can be written T X T +h = µ + φ. T X T +h 1 = µ [ 1 + φ + φ φ h 1] + φ h X T. or equivalently T X T +h = µ φ + φh [ X T µ φ ] 1 φ h = µ + φ h X T. 1 φ } {{ } 1+φ+φ φ h 1 75
76 Forecasting with AR(1) processes The forecasting error made at time T for horizon h is T h = T XT +h X T +h = T XT +h [φx T +h 1 + µ + ε T +h ] =... = T XT +h [ φ h 1X T + ( φ h φ + 1 ) µ +ε T +h + φε T +h φ h 1 ε T +1, (6) thus, T h = ε T +h + φε T +h φ h 1 ε T +1, with variance having variance V = [ 1 + φ 2 + φ φ 2h 2] σ 2, where V (ε t ) = σ 2. thus, variance of the forecast error increasing with horizon. 76
Lecture 2: ARMA(p,q) models (part 3)
Lecture 2: ARMA(p,q) models (part 3) Florian Pelgrin University of Lausanne, École des HEC Department of mathematics (IMEANice) Sept. 2011  Jan. 2012 Florian Pelgrin (HEC) Univariate time series Sept.
More informationA Multiplicative Seasonal BoxJenkins Model to Nigerian Stock Prices
A Multiplicative Seasonal BoxJenkins Model to Nigerian Stock Prices Ette Harrison Etuk Department of Mathematics/Computer Science, Rivers State University of Science and Technology, Nigeria Email: ettetuk@yahoo.com
More informationUnivariate Time Series Analysis; ARIMA Models
Econometrics 2 Spring 25 Univariate Time Series Analysis; ARIMA Models Heino Bohn Nielsen of4 Outline of the Lecture () Introduction to univariate time series analysis. (2) Stationarity. (3) Characterizing
More informationSome useful concepts in univariate time series analysis
Some useful concepts in univariate time series analysis Autoregressive moving average models Autocorrelation functions Model Estimation Diagnostic measure Model selection Forecasting Assumptions: 1. Nonseasonal
More informationTime Series Analysis
Time Series Analysis Autoregressive, MA and ARMA processes Andrés M. Alonso Carolina GarcíaMartos Universidad Carlos III de Madrid Universidad Politécnica de Madrid June July, 212 Alonso and GarcíaMartos
More informationTime Series Graphs. Model ACF PACF. White Noise All zeros All zeros. AR(p) Exponential Decay P significant lags before dropping to zero
Time Series Graphs Model ACF PACF White Noise All zeros All zeros AR(p) Exponential Decay P significant lags before dropping to zero MA(q) q significant lags before dropping to zero Exponential Decay ARMA(p,q)
More informationTime Series Analysis
Time Series Analysis hm@imm.dtu.dk Informatics and Mathematical Modelling Technical University of Denmark DK2800 Kgs. Lyngby 1 Outline of the lecture Identification of univariate time series models, cont.:
More informationTime Series Analysis and Forecasting
Time Series Analysis and Forecasting Math 667 Al Nosedal Department of Mathematics Indiana University of Pennsylvania Time Series Analysis and Forecasting p. 1/11 Introduction Many decisionmaking applications
More informationExam Solutions. X t = µ + βt + A t,
Exam Solutions Please put your answers on these pages. Write very carefully and legibly. HIT Shenzhen Graduate School James E. Gentle, 2015 1. 3 points. There was a transcription error on the registrar
More informationUnivariate Time Series Analysis; ARIMA Models
Econometrics 2 Fall 25 Univariate Time Series Analysis; ARIMA Models Heino Bohn Nielsen of4 Univariate Time Series Analysis We consider a single time series, y,y 2,..., y T. We want to construct simple
More informationITSMR Reference Manual
ITSMR Reference Manual George Weigt June 5, 2015 1 Contents 1 Introduction 3 1.1 Time series analysis in a nutshell............................... 3 1.2 White Noise Variance.....................................
More informationSales forecasting # 1
Sales forecasting # 1 Arthur Charpentier arthur.charpentier@univrennes1.fr 1 Agenda Qualitative and quantitative methods, a very general introduction Series decomposition Short versus long term forecasting
More information2.2 Elimination of Trend and Seasonality
26 CHAPTER 2. TREND AND SEASONAL COMPONENTS 2.2 Elimination of Trend and Seasonality Here we assume that the TS model is additive and there exist both trend and seasonal components, that is X t = m t +
More information1 Short Introduction to Time Series
ECONOMICS 7344, Spring 202 Bent E. Sørensen January 24, 202 Short Introduction to Time Series A time series is a collection of stochastic variables x,.., x t,.., x T indexed by an integer value t. The
More informationNonStationary Time Series andunitroottests
Econometrics 2 Fall 2005 NonStationary Time Series andunitroottests Heino Bohn Nielsen 1of25 Introduction Many economic time series are trending. Important to distinguish between two important cases:
More informationAnalysis and Computation for Finance Time Series  An Introduction
ECMM703 Analysis and Computation for Finance Time Series  An Introduction Alejandra González Harrison 161 Email: mag208@exeter.ac.uk Time Series  An Introduction A time series is a sequence of observations
More informationForecasting methods applied to engineering management
Forecasting methods applied to engineering management Áron SzászGábor Abstract. This paper presents arguments for the usefulness of a simple forecasting application package for sustaining operational
More informationUnivariate and Multivariate Methods PEARSON. Addison Wesley
Time Series Analysis Univariate and Multivariate Methods SECOND EDITION William W. S. Wei Department of Statistics The Fox School of Business and Management Temple University PEARSON Addison Wesley Boston
More informationARMA, GARCH and Related Option Pricing Method
ARMA, GARCH and Related Option Pricing Method Author: Yiyang Yang Advisor: Pr. Xiaolin Li, Pr. Zari Rachev Department of Applied Mathematics and Statistics State University of New York at Stony Brook September
More informationEconometria dei mercati finanziari c.a. A.A. 20112012. 4. AR, MA and ARMA Time Series Models. Luca Fanelli. University of Bologna
Econometria dei mercati finanziari c.a. A.A. 20112012 4. AR, MA and ARMA Time Series Models Luca Fanelli University of Bologna luca.fanelli@unibo.it For each class of models considered in these slides
More informationAn Introduction to Time Series Regression
An Introduction to Time Series Regression Henry Thompson Auburn University An economic model suggests examining the effect of exogenous x t on endogenous y t with an exogenous control variable z t. In
More informationTIME SERIES ANALYSIS
TIME SERIES ANALYSIS L.M. BHAR AND V.K.SHARMA Indian Agricultural Statistics Research Institute Library Avenue, New Delhi0 02 lmb@iasri.res.in. Introduction Time series (TS) data refers to observations
More informationTime Series Analysis
Time Series Analysis Identifying possible ARIMA models Andrés M. Alonso Carolina GarcíaMartos Universidad Carlos III de Madrid Universidad Politécnica de Madrid June July, 2012 Alonso and GarcíaMartos
More informationTopic 5: Stochastic Growth and Real Business Cycles
Topic 5: Stochastic Growth and Real Business Cycles Yulei Luo SEF of HKU October 1, 2015 Luo, Y. (SEF of HKU) Macro Theory October 1, 2015 1 / 45 Lag Operators The lag operator (L) is de ned as Similar
More informationTime Series  ARIMA Models. Instructor: G. William Schwert
APS 425 Fall 25 Time Series : ARIMA Models Instructor: G. William Schwert 585275247 schwert@schwert.ssb.rochester.edu Topics Typical time series plot Pattern recognition in auto and partial autocorrelations
More informationChapter 4: Vector Autoregressive Models
Chapter 4: Vector Autoregressive Models 1 Contents: Lehrstuhl für Department Empirische of Wirtschaftsforschung Empirical Research and und Econometrics Ökonometrie IV.1 Vector Autoregressive Models (VAR)...
More informationEstimating an ARMA Process
Statistics 910, #12 1 Overview Estimating an ARMA Process 1. Main ideas 2. Fitting autoregressions 3. Fitting with moving average components 4. Standard errors 5. Examples 6. Appendix: Simple estimators
More informationLecture Notes on Univariate Time Series Analysis and Box Jenkins Forecasting John Frain Economic Analysis, Research and Publications April 1992 (reprinted with revisions) January 1999 Abstract These are
More informationLuciano Rispoli Department of Economics, Mathematics and Statistics Birkbeck College (University of London)
Luciano Rispoli Department of Economics, Mathematics and Statistics Birkbeck College (University of London) 1 Forecasting: definition Forecasting is the process of making statements about events whose
More informationTime Series Analysis 1. Lecture 8: Time Series Analysis. Time Series Analysis MIT 18.S096. Dr. Kempthorne. Fall 2013 MIT 18.S096
Lecture 8: Time Series Analysis MIT 18.S096 Dr. Kempthorne Fall 2013 MIT 18.S096 Time Series Analysis 1 Outline Time Series Analysis 1 Time Series Analysis MIT 18.S096 Time Series Analysis 2 A stochastic
More informationAdvanced Forecasting Techniques and Models: ARIMA
Advanced Forecasting Techniques and Models: ARIMA Short Examples Series using Risk Simulator For more information please visit: www.realoptionsvaluation.com or contact us at: admin@realoptionsvaluation.com
More informationEconometrics Simple Linear Regression
Econometrics Simple Linear Regression Burcu Eke UC3M Linear equations with one variable Recall what a linear equation is: y = b 0 + b 1 x is a linear equation with one variable, or equivalently, a straight
More informationVector autoregressions, VAR
1 / 45 Vector autoregressions, VAR Chapter 2 Financial Econometrics Michael Hauser WS15/16 2 / 45 Content Crosscorrelations VAR model in standard/reduced form Properties of VAR(1), VAR(p) Structural VAR,
More informationMGT 267 PROJECT. Forecasting the United States Retail Sales of the Pharmacies and Drug Stores. Done by: Shunwei Wang & Mohammad Zainal
MGT 267 PROJECT Forecasting the United States Retail Sales of the Pharmacies and Drug Stores Done by: Shunwei Wang & Mohammad Zainal Dec. 2002 The retail sale (Million) ABSTRACT The present study aims
More informationIntroduction to Hypothesis Testing. Point estimation and confidence intervals are useful statistical inference procedures.
Introduction to Hypothesis Testing Point estimation and confidence intervals are useful statistical inference procedures. Another type of inference is used frequently used concerns tests of hypotheses.
More informationNotes for STA 437/1005 Methods for Multivariate Data
Notes for STA 437/1005 Methods for Multivariate Data Radford M. Neal, 26 November 2010 Random Vectors Notation: Let X be a random vector with p elements, so that X = [X 1,..., X p ], where denotes transpose.
More information2. What are the theoretical and practical consequences of autocorrelation?
Lecture 10 Serial Correlation In this lecture, you will learn the following: 1. What is the nature of autocorrelation? 2. What are the theoretical and practical consequences of autocorrelation? 3. Since
More informationChapter 7 The ARIMA Procedure. Chapter Table of Contents
Chapter 7 Chapter Table of Contents OVERVIEW...193 GETTING STARTED...194 TheThreeStagesofARIMAModeling...194 IdentificationStage...194 Estimation and Diagnostic Checking Stage...... 200 Forecasting Stage...205
More informationChapter 1. Vector autoregressions. 1.1 VARs and the identi cation problem
Chapter Vector autoregressions We begin by taking a look at the data of macroeconomics. A way to summarize the dynamics of macroeconomic data is to make use of vector autoregressions. VAR models have become
More informationDiscrete Time Series Analysis with ARMA Models
Discrete Time Series Analysis with ARMA Models Veronica Sitsofe Ahiati (veronica@aims.ac.za) African Institute for Mathematical Sciences (AIMS) Supervised by Tina Marquardt Munich University of Technology,
More informationGraphical Tools for Exploring and Analyzing Data From ARIMA Time Series Models
Graphical Tools for Exploring and Analyzing Data From ARIMA Time Series Models William Q. Meeker Department of Statistics Iowa State University Ames, IA 50011 January 13, 2001 Abstract Splus is a highly
More informationTIME SERIES ANALYSIS
TIME SERIES ANALYSIS Ramasubramanian V. I.A.S.R.I., Library Avenue, New Delhi 110 012 ram_stat@yahoo.co.in 1. Introduction A Time Series (TS) is a sequence of observations ordered in time. Mostly these
More informationLecture 4: Seasonal Time Series, Trend Analysis & Component Model Bus 41910, Time Series Analysis, Mr. R. Tsay
Lecture 4: Seasonal Time Series, Trend Analysis & Component Model Bus 41910, Time Series Analysis, Mr. R. Tsay Business cycle plays an important role in economics. In time series analysis, business cycle
More information4.3 Moving Average Process MA(q)
66 CHAPTER 4. STATIONARY TS MODELS 4.3 Moving Average Process MA(q) Definition 4.5. {X t } is a movingaverage process of order q if X t = Z t + θ 1 Z t 1 +... + θ q Z t q, (4.9) where and θ 1,...,θ q
More informationIntroduction to Time Series Analysis. Lecture 6.
Introduction to Time Series Analysis. Lecture 6. Peter Bartlett www.stat.berkeley.edu/ bartlett/courses/153fall2010 Last lecture: 1. Causality 2. Invertibility 3. AR(p) models 4. ARMA(p,q) models 1 Introduction
More informationTraffic Safety Facts. Research Note. Time Series Analysis and Forecast of Crash Fatalities during Six Holiday Periods Cejun Liu* and ChouLin Chen
Traffic Safety Facts Research Note March 2004 DOT HS 809 718 Time Series Analysis and Forecast of Crash Fatalities during Six Holiday Periods Cejun Liu* and ChouLin Chen Summary This research note uses
More informationAnalysis of algorithms of time series analysis for forecasting sales
SAINTPETERSBURG STATE UNIVERSITY Mathematics & Mechanics Faculty Chair of Analytical Information Systems Garipov Emil Analysis of algorithms of time series analysis for forecasting sales Course Work Scientific
More information4. Simple regression. QBUS6840 Predictive Analytics. https://www.otexts.org/fpp/4
4. Simple regression QBUS6840 Predictive Analytics https://www.otexts.org/fpp/4 Outline The simple linear model Least squares estimation Forecasting with regression Nonlinear functional forms Regression
More informationTime Series Analysis
Time Series Analysis Time series and stochastic processes Andrés M. Alonso Carolina GarcíaMartos Universidad Carlos III de Madrid Universidad Politécnica de Madrid June July, 2012 Alonso and GarcíaMartos
More informationStudying Achievement
Journal of Business and Economics, ISSN 21557950, USA November 2014, Volume 5, No. 11, pp. 20522056 DOI: 10.15341/jbe(21557950)/11.05.2014/009 Academic Star Publishing Company, 2014 http://www.academicstar.us
More informationSimple Linear Regression Inference
Simple Linear Regression Inference 1 Inference requirements The Normality assumption of the stochastic term e is needed for inference even if it is not a OLS requirement. Therefore we have: Interpretation
More informationAdvanced timeseries analysis
UCL DEPARTMENT OF SECURITY AND CRIME SCIENCE Advanced timeseries analysis Lisa Tompson Research Associate UCL Jill Dando Institute of Crime Science l.tompson@ucl.ac.uk Overview Fundamental principles
More informationRandom Vectors and the Variance Covariance Matrix
Random Vectors and the Variance Covariance Matrix Definition 1. A random vector X is a vector (X 1, X 2,..., X p ) of jointly distributed random variables. As is customary in linear algebra, we will write
More information3. Regression & Exponential Smoothing
3. Regression & Exponential Smoothing 3.1 Forecasting a Single Time Series Two main approaches are traditionally used to model a single time series z 1, z 2,..., z n 1. Models the observation z t as a
More informationRob J Hyndman. Forecasting using. 11. Dynamic regression OTexts.com/fpp/9/1/ Forecasting using R 1
Rob J Hyndman Forecasting using 11. Dynamic regression OTexts.com/fpp/9/1/ Forecasting using R 1 Outline 1 Regression with ARIMA errors 2 Example: Japanese cars 3 Using Fourier terms for seasonality 4
More information3.1 Stationary Processes and Mean Reversion
3. Univariate Time Series Models 3.1 Stationary Processes and Mean Reversion Definition 3.1: A time series y t, t = 1,..., T is called (covariance) stationary if (1) E[y t ] = µ, for all t Cov[y t, y t
More informationTime Series Analysis
Time Series 1 April 9, 2013 Time Series Analysis This chapter presents an introduction to the branch of statistics known as time series analysis. Often the data we collect in environmental studies is collected
More informationTime Series Analysis of Aviation Data
Time Series Analysis of Aviation Data Dr. Richard Xie February, 2012 What is a Time Series A time series is a sequence of observations in chorological order, such as Daily closing price of stock MSFT in
More informationIntegrated Resource Plan
Integrated Resource Plan March 19, 2004 PREPARED FOR KAUA I ISLAND UTILITY COOPERATIVE LCG Consulting 4962 El Camino Real, Suite 112 Los Altos, CA 94022 6509629670 1 IRP 1 ELECTRIC LOAD FORECASTING 1.1
More informationTime Series Analysis
Time Series Analysis Forecasting with ARIMA models Andrés M. Alonso Carolina GarcíaMartos Universidad Carlos III de Madrid Universidad Politécnica de Madrid June July, 2012 Alonso and GarcíaMartos (UC3MUPM)
More information9th Russian Summer School in Information Retrieval Big Data Analytics with R
9th Russian Summer School in Information Retrieval Big Data Analytics with R Introduction to Time Series with R A. Karakitsiou A. Migdalas Industrial Logistics, ETS Institute Luleå University of Technology
More informationForecasting the US Dollar / Euro Exchange rate Using ARMA Models
Forecasting the US Dollar / Euro Exchange rate Using ARMA Models LIUWEI (9906360)  1  ABSTRACT...3 1. INTRODUCTION...4 2. DATA ANALYSIS...5 2.1 Stationary estimation...5 2.2 DickeyFuller Test...6 3.
More informationDemand Forecasting LEARNING OBJECTIVES IEEM 517. 1. Understand commonly used forecasting techniques. 2. Learn to evaluate forecasts
IEEM 57 Demand Forecasting LEARNING OBJECTIVES. Understand commonly used forecasting techniques. Learn to evaluate forecasts 3. Learn to choose appropriate forecasting techniques CONTENTS Motivation Forecast
More informationTime Series Analysis
JUNE 2012 Time Series Analysis CONTENT A time series is a chronological sequence of observations on a particular variable. Usually the observations are taken at regular intervals (days, months, years),
More informationAutocovariance and Autocorrelation
Chapter 3 Autocovariance and Autocorrelation If the {X n } process is weakly stationary, the covariance of X n and X n+k depends only on the lag k. This leads to the following definition of the autocovariance
More informationTime Series in Mathematical Finance
Instituto Superior Técnico (IST, Portugal) and CEMAT cnunes@math.ist.utl.pt European Summer School in Industrial Mathematics Universidad Carlos III de Madrid July 2013 Outline The objective of this short
More informationFractionally integrated data and the autodistributed lag model: results from a simulation study
Fractionally integrated data and the autodistributed lag model: results from a simulation study Justin Esarey July 1, 215 Abstract Two contributions in this issue, Grant and Lebo (215) and Keele, Linn
More informationForecasting model of electricity demand in the Nordic countries. Tone Pedersen
Forecasting model of electricity demand in the Nordic countries Tone Pedersen 3/19/2014 Abstract A model implemented in order to describe the electricity demand on hourly basis for the Nordic countries.
More information16 : Demand Forecasting
16 : Demand Forecasting 1 Session Outline Demand Forecasting Subjective methods can be used only when past data is not available. When past data is available, it is advisable that firms should use statistical
More informationForecasting of Paddy Production in Sri Lanka: A Time Series Analysis using ARIMA Model
Tropical Agricultural Research Vol. 24 (): 23 (22) Forecasting of Paddy Production in Sri Lanka: A Time Series Analysis using ARIMA Model V. Sivapathasundaram * and C. Bogahawatte Postgraduate Institute
More informationCOMP6053 lecture: Time series analysis, autocorrelation. jn2@ecs.soton.ac.uk
COMP6053 lecture: Time series analysis, autocorrelation jn2@ecs.soton.ac.uk Time series analysis The basic idea of time series analysis is simple: given an observed sequence, how can we build a model that
More informationTime Series Analysis: Basic Forecasting.
Time Series Analysis: Basic Forecasting. As published in Benchmarks RSS Matters, April 2015 http://web3.unt.edu/benchmarks/issues/2015/04/rssmatters Jon Starkweather, PhD 1 Jon Starkweather, PhD jonathan.starkweather@unt.edu
More informationPractical. I conometrics. data collection, analysis, and application. Christiana E. Hilmer. Michael J. Hilmer San Diego State University
Practical I conometrics data collection, analysis, and application Christiana E. Hilmer Michael J. Hilmer San Diego State University Mi Table of Contents PART ONE THE BASICS 1 Chapter 1 An Introduction
More informationPITFALLS IN TIME SERIES ANALYSIS. Cliff Hurvich Stern School, NYU
PITFALLS IN TIME SERIES ANALYSIS Cliff Hurvich Stern School, NYU The t Test If x 1,..., x n are independent and identically distributed with mean 0, and n is not too small, then t = x 0 s n has a standard
More informationMonte Carlo Simulation
1 Monte Carlo Simulation Stefan Weber Leibniz Universität Hannover email: sweber@stochastik.unihannover.de web: www.stochastik.unihannover.de/ sweber Monte Carlo Simulation 2 Quantifying and Hedging
More informationSTAT 520 FORECASTING AND TIME SERIES
STAT 520 FORECASTING AND TIME SERIES Fall, 2013 Lecture Notes Joshua M. Tebbs Department of Statistics University of South Carolina TABLE OF CONTENTS Contents 1 Introduction and Examples 1 2 Fundamental
More informationIntroduction to Time Series Analysis. Lecture 1.
Introduction to Time Series Analysis. Lecture 1. Peter Bartlett 1. Organizational issues. 2. Objectives of time series analysis. Examples. 3. Overview of the course. 4. Time series models. 5. Time series
More informationVector Time Series Model Representations and Analysis with XploRe
01 Vector Time Series Model Representations and Analysis with plore Julius Mungo CASE  Center for Applied Statistics and Economics HumboldtUniversität zu Berlin mungo@wiwi.huberlin.de plore MulTi Motivation
More informationThreshold Autoregressive Models in Finance: A Comparative Approach
University of Wollongong Research Online Applied Statistics Education and Research Collaboration (ASEARC)  Conference Papers Faculty of Informatics 2011 Threshold Autoregressive Models in Finance: A Comparative
More informationCh.3 Demand Forecasting.
Part 3 : Acquisition & Production Support. Ch.3 Demand Forecasting. Edited by Dr. Seung Hyun Lee (Ph.D., CPL) IEMS Research Center, Email : lkangsan@iems.co.kr Demand Forecasting. Definition. An estimate
More informationA RegimeSwitching Model for Electricity Spot Prices. Gero Schindlmayr EnBW Trading GmbH g.schindlmayr@enbw.com
A RegimeSwitching Model for Electricity Spot Prices Gero Schindlmayr EnBW Trading GmbH g.schindlmayr@enbw.com May 31, 25 A RegimeSwitching Model for Electricity Spot Prices Abstract Electricity markets
More informationTURUN YLIOPISTO UNIVERSITY OF TURKU TALOUSTIEDE DEPARTMENT OF ECONOMICS RESEARCH REPORTS. A nonlinear moving average test as a robust test for ARCH
TURUN YLIOPISTO UNIVERSITY OF TURKU TALOUSTIEDE DEPARTMENT OF ECONOMICS RESEARCH REPORTS ISSN 0786 656 ISBN 951 9 1450 6 A nonlinear moving average test as a robust test for ARCH Jussi Tolvi No 81 May
More informationPrediction of Stock Price usingautoregressiveintegrated Moving AverageFilter Arima P,D,Q
Global Journal of Science Frontier Research Mathematics and Decision Sciences Volume 13 Issue 8 Version 1.0 Year Type : Double Blind Peer Reviewed International Research Journal Publisher: Global Journals
More informationTesting against a Change from Short to Long Memory
Testing against a Change from Short to Long Memory Uwe Hassler and Jan Scheithauer GoetheUniversity Frankfurt This version: January 2, 2008 Abstract This paper studies some wellknown tests for the null
More informationFinancial TIme Series Analysis: Part II
Department of Mathematics and Statistics, University of Vaasa, Finland January 29 February 13, 2015 Feb 14, 2015 1 Univariate linear stochastic models: further topics Unobserved component model Signal
More informationAPPLICATION OF THE VARMA MODEL FOR SALES FORECAST: CASE OF URMIA GRAY CEMENT FACTORY
APPLICATION OF THE VARMA MODEL FOR SALES FORECAST: CASE OF URMIA GRAY CEMENT FACTORY DOI: 10.2478/tjeb20140005 Ramin Bashir KHODAPARASTI 1 Samad MOSLEHI 2 To forecast sales as reliably as possible is
More informationForecasting Using Eviews 2.0: An Overview
Forecasting Using Eviews 2.0: An Overview Some Preliminaries In what follows it will be useful to distinguish between ex post and ex ante forecasting. In terms of time series modeling, both predict values
More informationTesting against a Change from Short to Long Memory
Testing against a Change from Short to Long Memory Uwe Hassler and Jan Scheithauer GoetheUniversity Frankfurt This version: December 9, 2007 Abstract This paper studies some wellknown tests for the null
More informationMATH4427 Notebook 2 Spring 2016. 2 MATH4427 Notebook 2 3. 2.1 Definitions and Examples... 3. 2.2 Performance Measures for Estimators...
MATH4427 Notebook 2 Spring 2016 prepared by Professor Jenny Baglivo c Copyright 20092016 by Jenny A. Baglivo. All Rights Reserved. Contents 2 MATH4427 Notebook 2 3 2.1 Definitions and Examples...................................
More informationTime Series Analysis
Time Series Analysis Lecture Notes for 475.726 Ross Ihaka Statistics Department University of Auckland April 14, 2005 ii Contents 1 Introduction 1 1.1 Time Series.............................. 1 1.2 Stationarity
More informationWooldridge, Introductory Econometrics, 3d ed. Chapter 12: Serial correlation and heteroskedasticity in time series regressions
Wooldridge, Introductory Econometrics, 3d ed. Chapter 12: Serial correlation and heteroskedasticity in time series regressions What will happen if we violate the assumption that the errors are not serially
More informationproblem arises when only a nonrandom sample is available differs from censored regression model in that x i is also unobserved
4 Data Issues 4.1 Truncated Regression population model y i = x i β + ε i, ε i N(0, σ 2 ) given a random sample, {y i, x i } N i=1, then OLS is consistent and efficient problem arises when only a nonrandom
More informationChicago Booth BUSINESS STATISTICS 41000 Final Exam Fall 2011
Chicago Booth BUSINESS STATISTICS 41000 Final Exam Fall 2011 Name: Section: I pledge my honor that I have not violated the Honor Code Signature: This exam has 34 pages. You have 3 hours to complete this
More informationTHE SVM APPROACH FOR BOX JENKINS MODELS
REVSTAT Statistical Journal Volume 7, Number 1, April 2009, 23 36 THE SVM APPROACH FOR BOX JENKINS MODELS Authors: Saeid Amiri Dep. of Energy and Technology, Swedish Univ. of Agriculture Sciences, P.O.Box
More informationAdvanced Linear Modeling
Ronald Christensen Advanced Linear Modeling Multivariate, Time Series, and Spatial Data; Nonparametric Regression and Response Surface Maximization Second Edition Springer Preface to the Second Edition
More informationPredicting Indian GDP. And its relation with FMCG Sales
Predicting Indian GDP And its relation with FMCG Sales GDP A Broad Measure of Economic Activity Definition The monetary value of all the finished goods and services produced within a country's borders
More informationSummary of Formulas and Concepts. Descriptive Statistics (Ch. 14)
Summary of Formulas and Concepts Descriptive Statistics (Ch. 14) Definitions Population: The complete set of numerical information on a particular quantity in which an investigator is interested. We assume
More informationAR(p) + MA(q) = ARMA(p, q)
AR(p) + MA(q) = ARMA(p, q) Outline 1 3.4: ARMA(p, q) Model 2 Homework 3a Arthur Berg AR(p) + MA(q) = ARMA(p, q) 2/ 12 ARMA(p, q) Model Definition (ARMA(p, q) Model) A time series is ARMA(p, q) if it is
More informationA Study on the Comparison of Electricity Forecasting Models: Korea and China
Communications for Statistical Applications and Methods 2015, Vol. 22, No. 6, 675 683 DOI: http://dx.doi.org/10.5351/csam.2015.22.6.675 Print ISSN 22877843 / Online ISSN 23834757 A Study on the Comparison
More informationMath 141. Lecture 7: Variance, Covariance, and Sums. Albyn Jones 1. 1 Library 304. jones/courses/141
Math 141 Lecture 7: Variance, Covariance, and Sums Albyn Jones 1 1 Library 304 jones@reed.edu www.people.reed.edu/ jones/courses/141 Last Time Variance: expected squared deviation from the mean: Standard
More information