Introduction to Time Series Analysis. Lecture 6.


 Abel Lang
 2 years ago
 Views:
Transcription
1 Introduction to Time Series Analysis. Lecture 6. Peter Bartlett bartlett/courses/153fall2010 Last lecture: 1. Causality 2. Invertibility 3. AR(p) models 4. ARMA(p,q) models 1
2 Introduction to Time Series Analysis. Lecture 6. Peter Bartlett bartlett/courses/153fall ARMA(p,q) models 2. Stationarity, causality and invertibility 3. The linear process representation of ARMA processes: ψ. 4. Autocovariance of an ARMA process. 5. Homogeneous linear difference equations. 2
3 Review: Causality A linear process {X t } is causal (strictly, a causal function of {W t }) if there is a ψ(b) = ψ 0 + ψ 1 B + ψ 2 B 2 + with ψ j < j=0 and X t = ψ(b)w t. 3
4 Review: Invertibility A linear process {X t } is invertible (strictly, an invertible function of {W t }) if there is a π(b) = π 0 + π 1 B + π 2 B 2 + with π j < j=0 and W t = π(b)x t. 4
5 Review: AR(p), Autoregressive models of order p An AR(p) process {X t } is a stationary process that satisfies X t φ 1 X t 1 φ p X t p = W t, where {W t } WN(0, σ 2 ). Equivalently, φ(b)x t = W t, where φ(b) = 1 φ 1 B φ p B p. 5
6 Review: AR(p), Autoregressive models of order p Theorem: A (unique) stationary solution to φ(b)x t = W t exists iff the roots of φ(z) avoid the unit circle: z = 1 φ(z) = 1 φ 1 z φ p z p 0. This AR(p) process is causal iff the roots of φ(z) are outside the unit circle: z 1 φ(z) = 1 φ 1 z φ p z p 0. 6
7 Reminder: Polynomials of a complex variable Every degree p polynomial a(z) can be factorized as a(z) = a 0 + a 1 z + + a p z p = a p (z z 1 )(z z 2 ) (z z p ), where z 1,...,z p C are the roots of a(z). If the coefficients a 0, a 1,...,a p are all real, then the roots are all either real or come in complex conjugate pairs, z i = z j. Example: z + z 3 = z(1 + z 2 ) = (z 0)(z i)(z + i), that is, z 1 = 0, z 2 = i, z 3 = i. So z 1 R; z 2, z 3 R; z 2 = z 3. Recall notation: A complex number z = a + ib has Re(z) = a, Im(z) = b, z = a ib, z = a 2 + b 2, arg(z) = tan 1 (b/a) ( π, π]. 7
8 Review: Calculating ψ for an AR(p): general case φ(b)x t = W t, X t = ψ(b)w t so 1 = ψ(b)φ(b) 1 = (ψ 0 + ψ 1 B + )(1 φ 1 B φ p B p ) 1 = ψ 0, 0 = ψ j (j < 0), 0 = φ(b)ψ j (j > 0). We can solve these linear difference equations in several ways: numerically, or by guessing the form of a solution and using an inductive proof, or by using the theory of linear difference equations. 8
9 Introduction to Time Series Analysis. Lecture Review: Causality, invertibility, AR(p) models 2. ARMA(p,q) models 3. Stationarity, causality and invertibility 4. The linear process representation of ARMA processes: ψ. 5. Autocovariance of an ARMA process. 6. Homogeneous linear difference equations. 9
10 ARMA(p,q): Autoregressive moving average models An ARMA(p,q) process {X t } is a stationary process that satisfies X t φ 1 X t 1 φ p X t p = W t +θ 1 W t 1 + +θ q W t q, where {W t } WN(0, σ 2 ). AR(p) = ARMA(p,0): θ(b) = 1. MA(q) = ARMA(0,q): φ(b) = 1. 10
11 ARMA(p,q): Autoregressive moving average models An ARMA(p,q) process {X t } is a stationary process that satisfies X t φ 1 X t 1 φ p X t p = W t +θ 1 W t 1 + +θ q W t q, where {W t } WN(0, σ 2 ). Usually, we insist that φ p, θ q 0 and that the polynomials φ(z) = 1 φ 1 z φ p z p, θ(z) = 1 + θ 1 z + + θ q z q have no common factors. This implies it is not a lower order ARMA model. 11
12 ARMA(p,q): An example of parameter redundancy Consider a white noise process W t. We can write X t = W t X t X t X t 2 = W t W t W t 2 (1 B B 2 )X t = (1 B B 2 )W t This is in the form of an ARMA(2,2) process, with φ(b) = 1 B B 2, θ(b) = 1 B B 2. But it is white noise. 12
13 ARMA(p,q): An example of parameter redundancy ARMA model: φ(b)x t = θ(b)w t, with φ(b) = 1 B B 2, θ(b) = 1 B B 2 X t = ψ(b)w t ψ(b) = θ(b) φ(b) = 1. i.e., X t = W t. 13
14 Introduction to Time Series Analysis. Lecture Review: Causality, invertibility, AR(p) models 2. ARMA(p,q) models 3. Stationarity, causality and invertibility 4. The linear process representation of ARMA processes: ψ. 5. Autocovariance of an ARMA process. 6. Homogeneous linear difference equations. 14
15 Recall: Causality and Invertibility A linear process {X t } is causal if there is a ψ(b) = ψ 0 + ψ 1 B + ψ 2 B 2 + with ψ j < and X t = ψ(b)w t. j=0 It is invertible if there is a π(b) = π 0 + π 1 B + π 2 B 2 + with π j < and W t = π(b)x t. j=0 15
16 ARMA(p,q): Stationarity, causality, and invertibility Theorem: If φ and θ have no common factors, a (unique) stationary solution to φ(b)x t = θ(b)w t exists iff the roots of φ(z) avoid the unit circle: z = 1 φ(z) = 1 φ 1 z φ p z p 0. This ARMA(p,q) process is causal iff the roots of φ(z) are outside the unit circle: z 1 φ(z) = 1 φ 1 z φ p z p 0. It is invertible iff the roots of θ(z) are outside the unit circle: z 1 θ(z) = 1 + θ 1 z + + θ q z q 0. 16
17 ARMA(p,q): Stationarity, causality, and invertibility Example: (1 1.5B)X t = ( B)W t. φ(z) = 1 1.5z = 3 2 ( z 2 ), 3 θ(z) = z = 1 5 (z + 5). 1. φ and θ have no common factors, and φ s root is at 2/3, which is not on the unit circle, so {X t } is an ARMA(1,1) process. 2. φ s root (at 2/3) is inside the unit circle, so {X t } is not causal. 3. θ s root is at 5, which is outside the unit circle, so {X t } is invertible. 17
18 ARMA(p,q): Stationarity, causality, and invertibility Example: ( B 2 )X t = (1 + 2B)W t. φ(z) = z 2 = 1 ( z ) = 1 (z + 2i)(z 2i), 4 ( 4 θ(z) = 1 + 2z = 2 z + 1 ) φ and θ have no common factors, and φ s roots are at ±2i, which is not on the unit circle, so {X t } is an ARMA(2,1) process. 2. φ s roots (at ±2i) are outside the unit circle, so {X t } is causal. 3. θ s root (at 1/2) is inside the unit circle, so {X t } is not invertible. 18
19 Causality and Invertibility Theorem: Let {X t } be an ARMA process defined by φ(b)x t = θ(b)w t. If all z = 1 have θ(z) 0, then there are polynomials φ and θ and a white noise sequence W t such that {X t } satisfies φ(b)x t = θ(b) W t, and this is a causal, invertible ARMA process. So we ll stick to causal, invertible ARMA processes. 19
20 Introduction to Time Series Analysis. Lecture Review: Causality, invertibility, AR(p) models 2. ARMA(p,q) models 3. Stationarity, causality and invertibility 4. The linear process representation of ARMA processes: ψ. 5. Autocovariance of an ARMA process. 6. Homogeneous linear difference equations. 20
21 Calculating ψ for an ARMA(p,q): matching coefficients Example: X t = ψ(b)w t ( B 2 )X t = ( B)W t, so B = ( B 2 )ψ(b) B = ( B 2 )(ψ 0 + ψ 1 B + ψ 2 B 2 + ) 1 = ψ 0, 0.2 = ψ 1, 0 = ψ ψ 0, 0 = ψ ψ 1,. 21
22 Calculating ψ for an ARMA(p,q): example 1 = ψ 0, 0.2 = ψ 1, 0 = ψ j ψ j 2 (j 2). We can think of this as θ j = φ(b)ψ j, with θ 0 = 1, θ j = 0 for j < 0, j > q. This is a first order difference equation in the ψ j s. We can use the θ j s to give the initial conditions and solve it using the theory of homogeneous difference equations. ψ j = ( 1, 1 5, 1 4, 1 20, 1 16, 1 80, 1 64, 1 320,...). 22
23 Calculating ψ for an ARMA(p,q): general case so φ(b)x t = θ(b)w t, X t = ψ(b)w t θ(b) = ψ(b)φ(b) 1 + θ 1 B + + θ q B q = (ψ 0 + ψ 1 B + )(1 φ 1 B φ p B p ) 1 = ψ 0, θ 1 = ψ 1 φ 1 ψ 0, θ 2 = ψ 2 φ 1 ψ 1 φ 2 ψ 0,. This is equivalent to θ j = φ(b)ψ j, with θ 0 = 1, θ j = 0 for j < 0, j > q. 23
24 Introduction to Time Series Analysis. Lecture Review: Causality, invertibility, AR(p) models 2. ARMA(p,q) models 3. Stationarity, causality and invertibility 4. The linear process representation of ARMA processes: ψ. 5. Autocovariance of an ARMA process. 6. Homogeneous linear difference equations. 24
25 Autocovariance functions of linear processes Consider a (mean 0) linear process {X t } defined by X t = ψ(b)w t. γ(h) = E (X t X t+h ) = E (ψ 0 W t + ψ 1 W t 1 + ψ 2 W t 2 + ) (ψ 0 W t+h + ψ 1 W t+h 1 + ψ 2 W t+h 2 + ) = σw 2 (ψ 0 ψ h + ψ 1 ψ h+1 + ψ 2 ψ h+2 + ). 25
26 Autocovariance functions of MA processes Consider an MA(q) process {X t } defined by X t = θ(b)w t. σ 2 q h w j=0 γ(h) = θ jθ j+h if h q, 0 if h > q. 26
27 Autocovariance functions of ARMA processes ARMA process: φ(b)x t = θ(b)w t. To compute γ, we can compute ψ, and then use γ(h) = σ 2 w (ψ 0 ψ h + ψ 1 ψ h+1 + ψ 2 ψ h+2 + ). 27
28 Autocovariance functions of ARMA processes An alternative approach: X t φ 1 X t 1 φ p X t p = W t + θ 1 W t θ q W t q, so E((X t φ 1 X t 1 φ p X t p ) X t h ) = E((W t + θ 1 W t θ q W t q )X t h ), that is, γ(h) φ 1 γ(h 1) φ p γ(h p) = E(θ h W t h X t h + + θ q W t q X t h ) = σ 2 w q h j=0 This is a linear difference equation. θ h+j ψ j. (Write θ 0 = 1). 28
29 Autocovariance functions of ARMA processes: Example ( B 2 )X t = ( B)W t, X t = ψ(b)w t, ( ψ j = 1, 1 5, 1 4, 1 20, 1 16, 1 80, 1 64, 1 ) 320,.... γ(h) φ 1 γ(h 1) φ 2 γ(h 2) = σ 2 w γ(h) γ(h 2) = q h j=0 θ h+j ψ j σ 2 w (ψ ψ 1 ) if h = 0, 0.2σ 2 wψ 0 if h = 1, 0 otherwise. 29
30 Autocovariance functions of ARMA processes: Example We have the homogeneous linear difference equation for h 2, with initial conditions γ(h) γ(h 2) = 0 γ(0) γ( 2) = σ 2 w (1 + 1/25) γ(1) γ( 1) = σ 2 w/5. We can solve these linear equations to determine γ. Or we can use the theory of linear difference equations... 30
31 Introduction to Time Series Analysis. Lecture 6. Peter Bartlett bartlett/courses/153fall ARMA(p,q) models 2. Stationarity, causality and invertibility 3. The linear process representation of ARMA processes: ψ. 4. Autocovariance of an ARMA process. 5. Homogeneous linear difference equations. 31
32 Difference equations Examples: x t 3x t 1 = 0 x t x t 1 x t 2 = 0 x t + 2x t 1 x 2 t 3 = 0 (first order, linear) (2nd order, nonlinear) (3rd order, nonlinear) 32
33 Homogeneous linear diff eqns with constant coefficients a 0 x t + a 1 x t a k x t k = 0 ( a0 + a 1 B + + a k B k) x t = 0 a(b)x t = 0 auxiliary equation: a 0 + a 1 z + + a k z k = 0 (z z 1 )(z z 2 ) (z z k ) = 0 where z 1, z 2,...,z k C are the roots of this characteristic polynomial. Thus, a(b)x t = 0 (B z 1 )(B z 2 ) (B z k )x t = 0. 33
34 Homogeneous linear diff eqns with constant coefficients a(b)x t = 0 (B z 1 )(B z 2 ) (B z k )x t = 0. So any {x t } satisfying (B z i )x t = 0 for some i also satisfies a(b)x t = 0. Three cases: 1. The z i are real and distinct. 2. The z i are complex and distinct. 3. Some z i are repeated. 34
35 Homogeneous linear diff eqns with constant coefficients 1. The z i are real and distinct. a(b)x t = 0 (B z 1 )(B z 2 ) (B z k )x t = 0 for some constants c 1,...,c k. x t is a linear combination of solutions to (B z 1 )x t = 0, (B z 2 )x t = 0,..., (B z k )x t = 0 x t = c 1 z t 1 + c 2 z t c k z t k, 35
36 Homogeneous linear diff eqns with constant coefficients 1. The z i are real and distinct. e.g., z 1 = 1.2, z 2 = c 1 z 1 t + c2 z 2 t c 1 =1, c 2 =0 c 1 =0, c 2 =1 c 1 = 0.8, c 2 =
37 Reminder: Complex exponentials a + ib = re iθ = r(cosθ + isinθ), where r = a + ib = a 2 + b 2 ( ) b θ = tan 1 ( π, π]. a Thus, r 1 e iθ 1 r 2 e iθ 2 = (r 1 r 2 )e i(θ 1+θ 2 ), z z = z 2. 37
38 Homogeneous linear diff eqns with constant coefficients 2. The z i are complex and distinct. As before, a(b)x t = 0 x t = c 1 z t 1 + c 2 z t c k z t k. If z 1 R, since a 1,...,a k are real, we must have the complex conjugate root, z j = z 1. And for x t to be real, we must have c j = c 1. For example: x t = c z t 1 + c z 1 t = r e iθ z 1 t e iωt + r e iθ z 1 t e iωt = r z 1 t ( e i(θ ωt) + e i(θ ωt)) = 2r z 1 t cos(ωt θ) where z 1 = z 1 e iω and c = re iθ. 38
39 Homogeneous linear diff eqns with constant coefficients 2. The z i are complex and distinct. e.g., z 1 = i, z 2 = 1.2 i c 1 z 1 t + c2 z 2 t c= i c= i c= i
40 Homogeneous linear diff eqns with constant coefficients 2. The z i are complex and distinct. e.g., z 1 = i, z 2 = 1 0.1i c 1 z 1 t + c2 z 2 t c= i c= i c= i
AR(p) + MA(q) = ARMA(p, q)
AR(p) + MA(q) = ARMA(p, q) Outline 1 3.4: ARMA(p, q) Model 2 Homework 3a Arthur Berg AR(p) + MA(q) = ARMA(p, q) 2/ 12 ARMA(p, q) Model Definition (ARMA(p, q) Model) A time series is ARMA(p, q) if it is
More informationIntroduction to ARMA Models
Statistics 910, #8 1 Overview Introduction to ARMA Models 1. Modeling paradigm 2. Review stationary linear processes 3. ARMA processes 4. Stationarity of ARMA processes 5. Identifiability of ARMA processes
More informationLecture 2: ARMA(p,q) models (part 3)
Lecture 2: ARMA(p,q) models (part 3) Florian Pelgrin University of Lausanne, École des HEC Department of mathematics (IMEANice) Sept. 2011  Jan. 2012 Florian Pelgrin (HEC) Univariate time series Sept.
More informationDiscrete Time Series Analysis with ARMA Models
Discrete Time Series Analysis with ARMA Models Veronica Sitsofe Ahiati (veronica@aims.ac.za) African Institute for Mathematical Sciences (AIMS) Supervised by Tina Marquardt Munich University of Technology,
More information4.3 Moving Average Process MA(q)
66 CHAPTER 4. STATIONARY TS MODELS 4.3 Moving Average Process MA(q) Definition 4.5. {X t } is a movingaverage process of order q if X t = Z t + θ 1 Z t 1 +... + θ q Z t q, (4.9) where and θ 1,...,θ q
More informationLecture 1: Univariate Time Series B41910: Autumn Quarter, 2008, by Mr. Ruey S. Tsay
Lecture 1: Univariate Time Series B41910: Autumn Quarter, 2008, by Mr. Ruey S. Tsay 1 Some Basic Concepts 1. Time Series: A sequence of random variables measuring certain quantity of interest over time.
More informationITSMR Reference Manual
ITSMR Reference Manual George Weigt June 5, 2015 1 Contents 1 Introduction 3 1.1 Time series analysis in a nutshell............................... 3 1.2 White Noise Variance.....................................
More information1 Short Introduction to Time Series
ECONOMICS 7344, Spring 202 Bent E. Sørensen January 24, 202 Short Introduction to Time Series A time series is a collection of stochastic variables x,.., x t,.., x T indexed by an integer value t. The
More informationSales forecasting # 2
Sales forecasting # 2 Arthur Charpentier arthur.charpentier@univrennes1.fr 1 Agenda Qualitative and quantitative methods, a very general introduction Series decomposition Short versus long term forecasting
More informationTime Series  ARIMA Models. Instructor: G. William Schwert
APS 425 Fall 25 Time Series : ARIMA Models Instructor: G. William Schwert 585275247 schwert@schwert.ssb.rochester.edu Topics Typical time series plot Pattern recognition in auto and partial autocorrelations
More informationDEFINITION 5.1.1 A complex number is a matrix of the form. x y. , y x
Chapter 5 COMPLEX NUMBERS 5.1 Constructing the complex numbers One way of introducing the field C of complex numbers is via the arithmetic of matrices. DEFINITION 5.1.1 A complex number is a matrix of
More informationLecture 4: Seasonal Time Series, Trend Analysis & Component Model Bus 41910, Time Series Analysis, Mr. R. Tsay
Lecture 4: Seasonal Time Series, Trend Analysis & Component Model Bus 41910, Time Series Analysis, Mr. R. Tsay Business cycle plays an important role in economics. In time series analysis, business cycle
More informationTime Series Analysis
Time Series Analysis Forecasting with ARIMA models Andrés M. Alonso Carolina GarcíaMartos Universidad Carlos III de Madrid Universidad Politécnica de Madrid June July, 2012 Alonso and GarcíaMartos (UC3MUPM)
More informationTime Series Analysis
Time Series Analysis Autoregressive, MA and ARMA processes Andrés M. Alonso Carolina GarcíaMartos Universidad Carlos III de Madrid Universidad Politécnica de Madrid June July, 212 Alonso and GarcíaMartos
More informationTime Series Analysis 1. Lecture 8: Time Series Analysis. Time Series Analysis MIT 18.S096. Dr. Kempthorne. Fall 2013 MIT 18.S096
Lecture 8: Time Series Analysis MIT 18.S096 Dr. Kempthorne Fall 2013 MIT 18.S096 Time Series Analysis 1 Outline Time Series Analysis 1 Time Series Analysis MIT 18.S096 Time Series Analysis 2 A stochastic
More informationLecture Notes on Polynomials
Lecture Notes on Polynomials Arne Jensen Department of Mathematical Sciences Aalborg University c 008 Introduction These lecture notes give a very short introduction to polynomials with real and complex
More informationAnalysis and Computation for Finance Time Series  An Introduction
ECMM703 Analysis and Computation for Finance Time Series  An Introduction Alejandra González Harrison 161 Email: mag208@exeter.ac.uk Time Series  An Introduction A time series is a sequence of observations
More informationUnivariate Time Series Analysis; ARIMA Models
Econometrics 2 Spring 25 Univariate Time Series Analysis; ARIMA Models Heino Bohn Nielsen of4 Outline of the Lecture () Introduction to univariate time series analysis. (2) Stationarity. (3) Characterizing
More informationUnivariate Time Series Analysis; ARIMA Models
Econometrics 2 Fall 25 Univariate Time Series Analysis; ARIMA Models Heino Bohn Nielsen of4 Univariate Time Series Analysis We consider a single time series, y,y 2,..., y T. We want to construct simple
More informationA Multiplicative Seasonal BoxJenkins Model to Nigerian Stock Prices
A Multiplicative Seasonal BoxJenkins Model to Nigerian Stock Prices Ette Harrison Etuk Department of Mathematics/Computer Science, Rivers State University of Science and Technology, Nigeria Email: ettetuk@yahoo.com
More informationFinancial TIme Series Analysis: Part II
Department of Mathematics and Statistics, University of Vaasa, Finland January 29 February 13, 2015 Feb 14, 2015 1 Univariate linear stochastic models: further topics Unobserved component model Signal
More informationTIME SERIES. Syllabus... Keywords...
TIME SERIES Contents Syllabus.................................. Books................................... Keywords................................. iii iii iv 1 Models for time series 1 1.1 Time series
More informationTime Series Analysis
Time Series Analysis Andrea Beccarini Center for Quantitative Economics Winter 2013/2014 Andrea Beccarini (CQE) Time Series Analysis Winter 2013/2014 1 / 143 Introduction Objectives Time series are ubiquitous
More informationTime Series Analysis
Time Series Analysis Lecture Notes for 475.726 Ross Ihaka Statistics Department University of Auckland April 14, 2005 ii Contents 1 Introduction 1 1.1 Time Series.............................. 1 1.2 Stationarity
More informationSome useful concepts in univariate time series analysis
Some useful concepts in univariate time series analysis Autoregressive moving average models Autocorrelation functions Model Estimation Diagnostic measure Model selection Forecasting Assumptions: 1. Nonseasonal
More informationTime Series Analysis in Economics. Klaus Neusser
Time Series Analysis in Economics Klaus Neusser May 26, 2015 Contents I Univariate Time Series Analysis 3 1 Introduction 1 1.1 Some examples.......................... 2 1.2 Formal definitions.........................
More informationTime Series Graphs. Model ACF PACF. White Noise All zeros All zeros. AR(p) Exponential Decay P significant lags before dropping to zero
Time Series Graphs Model ACF PACF White Noise All zeros All zeros AR(p) Exponential Decay P significant lags before dropping to zero MA(q) q significant lags before dropping to zero Exponential Decay ARMA(p,q)
More informationThinkwell s Homeschool Algebra 2 Course Lesson Plan: 34 weeks
Thinkwell s Homeschool Algebra 2 Course Lesson Plan: 34 weeks Welcome to Thinkwell s Homeschool Algebra 2! We re thrilled that you ve decided to make us part of your homeschool curriculum. This lesson
More informationUnivariate and Multivariate Methods PEARSON. Addison Wesley
Time Series Analysis Univariate and Multivariate Methods SECOND EDITION William W. S. Wei Department of Statistics The Fox School of Business and Management Temple University PEARSON Addison Wesley Boston
More informationTime Series HILARY TERM 2010 PROF. GESINE REINERT http://www.stats.ox.ac.uk/~reinert
Time Series HILARY TERM 2010 PROF. GESINE REINERT http://www.stats.ox.ac.uk/~reinert Overview Chapter 1: What are time series? Types of data, examples, objectives. Definitions, stationarity and autocovariances.
More informationAnalysis of algorithms of time series analysis for forecasting sales
SAINTPETERSBURG STATE UNIVERSITY Mathematics & Mechanics Faculty Chair of Analytical Information Systems Garipov Emil Analysis of algorithms of time series analysis for forecasting sales Course Work Scientific
More informationZeros of Polynomial Functions
Review: Synthetic Division Find (x 25x  5x 3 + x 4 ) (5 + x). Factor Theorem Solve 2x 35x 2 + x + 2 =0 given that 2 is a zero of f(x) = 2x 35x 2 + x + 2. Zeros of Polynomial Functions Introduction
More informationComplex Numbers and the Complex Exponential
Complex Numbers and the Complex Exponential Frank R. Kschischang The Edward S. Rogers Sr. Department of Electrical and Computer Engineering University of Toronto September 5, 2005 Numbers and Equations
More information4. Matrix inverses. left and right inverse. linear independence. nonsingular matrices. matrices with linearly independent columns
L. Vandenberghe EE133A (Spring 2016) 4. Matrix inverses left and right inverse linear independence nonsingular matrices matrices with linearly independent columns matrices with linearly independent rows
More informationTIME SERIES ANALYSIS: AN OVERVIEW
Outline TIME SERIES ANALYSIS: AN OVERVIEW Hernando Ombao University of California at Irvine November 26, 2012 Outline OUTLINE OF TALK 1 TIME SERIES DATA 2 OVERVIEW OF TIME DOMAIN ANALYSIS 3 OVERVIEW SPECTRAL
More informationIntroduction to Time Series Analysis. Lecture 1.
Introduction to Time Series Analysis. Lecture 1. Peter Bartlett 1. Organizational issues. 2. Objectives of time series analysis. Examples. 3. Overview of the course. 4. Time series models. 5. Time series
More informationGeneral Theory of Differential Equations Sections 2.8, 3.13.2, 4.1
A B I L E N E C H R I S T I A N U N I V E R S I T Y Department of Mathematics General Theory of Differential Equations Sections 2.8, 3.13.2, 4.1 Dr. John Ehrke Department of Mathematics Fall 2012 Questions
More informationLuciano Rispoli Department of Economics, Mathematics and Statistics Birkbeck College (University of London)
Luciano Rispoli Department of Economics, Mathematics and Statistics Birkbeck College (University of London) 1 Forecasting: definition Forecasting is the process of making statements about events whose
More information3.1 Stationary Processes and Mean Reversion
3. Univariate Time Series Models 3.1 Stationary Processes and Mean Reversion Definition 3.1: A time series y t, t = 1,..., T is called (covariance) stationary if (1) E[y t ] = µ, for all t Cov[y t, y t
More informationEconometria dei mercati finanziari c.a. A.A. 20112012. 4. AR, MA and ARMA Time Series Models. Luca Fanelli. University of Bologna
Econometria dei mercati finanziari c.a. A.A. 20112012 4. AR, MA and ARMA Time Series Models Luca Fanelli University of Bologna luca.fanelli@unibo.it For each class of models considered in these slides
More informationMATH 304 Linear Algebra Lecture 8: Inverse matrix (continued). Elementary matrices. Transpose of a matrix.
MATH 304 Linear Algebra Lecture 8: Inverse matrix (continued). Elementary matrices. Transpose of a matrix. Inverse matrix Definition. Let A be an n n matrix. The inverse of A is an n n matrix, denoted
More information8. Linear leastsquares
8. Linear leastsquares EE13 (Fall 21112) definition examples and applications solution of a leastsquares problem, normal equations 81 Definition overdetermined linear equations if b range(a), cannot
More informationNonhomogeneous Linear Equations
Nonhomogeneous Linear Equations In this section we learn how to solve secondorder nonhomogeneous linear differential equations with constant coefficients, that is, equations of the form ay by cy G x where
More informationTraffic Safety Facts. Research Note. Time Series Analysis and Forecast of Crash Fatalities during Six Holiday Periods Cejun Liu* and ChouLin Chen
Traffic Safety Facts Research Note March 2004 DOT HS 809 718 Time Series Analysis and Forecast of Crash Fatalities during Six Holiday Periods Cejun Liu* and ChouLin Chen Summary This research note uses
More informationIntroduction to Time Series Analysis. Lecture 22.
Introduction to Time Series Analysis. Lecture 22. 1. Review: The smoothed periodogram. 2. Examples. 3. Parametric spectral density estimation. 1 Review: Periodogram The periodogram is defined as I(ν) =
More informationMath 313 Lecture #10 2.2: The Inverse of a Matrix
Math 1 Lecture #10 2.2: The Inverse of a Matrix Matrix algebra provides tools for creating many useful formulas just like real number algebra does. For example, a real number a is invertible if there is
More informationDo Electricity Prices Reflect Economic Fundamentals?: Evidence from the California ISO
Do Electricity Prices Reflect Economic Fundamentals?: Evidence from the California ISO Kevin F. Forbes and Ernest M. Zampelli Department of Business and Economics The Center for the Study of Energy and
More informationSect 6.7  Solving Equations Using the Zero Product Rule
Sect 6.7  Solving Equations Using the Zero Product Rule 116 Concept #1: Definition of a Quadratic Equation A quadratic equation is an equation that can be written in the form ax 2 + bx + c = 0 (referred
More informationPower Series Lecture Notes
Power Series Lecture Notes A power series is a polynomial with infinitely many terms. Here is an example: $ 0ab œ â Like a polynomial, a power series is a function of. That is, we can substitute in different
More informationGraphical Tools for Exploring and Analyzing Data From ARIMA Time Series Models
Graphical Tools for Exploring and Analyzing Data From ARIMA Time Series Models William Q. Meeker Department of Statistics Iowa State University Ames, IA 50011 January 13, 2001 Abstract Splus is a highly
More information5.1 The Remainder and Factor Theorems; Synthetic Division
5.1 The Remainder and Factor Theorems; Synthetic Division In this section you will learn to: understand the definition of a zero of a polynomial function use long and synthetic division to divide polynomials
More information11.7 Polar Form of Complex Numbers
11.7 Polar Form of Complex Numbers 989 11.7 Polar Form of Complex Numbers In this section, we return to our study of complex numbers which were first introduced in Section.. Recall that a complex number
More informationMatrices and Polynomials
APPENDIX 9 Matrices and Polynomials he Multiplication of Polynomials Let α(z) =α 0 +α 1 z+α 2 z 2 + α p z p and y(z) =y 0 +y 1 z+y 2 z 2 + y n z n be two polynomials of degrees p and n respectively. hen,
More informationSoftware Review: ITSM 2000 Professional Version 6.0.
Lee, J. & Strazicich, M.C. (2002). Software Review: ITSM 2000 Professional Version 6.0. International Journal of Forecasting, 18(3): 455459 (June 2002). Published by Elsevier (ISSN: 01692070). http://0
More information2 Complex Functions and the CauchyRiemann Equations
2 Complex Functions and the CauchyRiemann Equations 2.1 Complex functions In onevariable calculus, we study functions f(x) of a real variable x. Likewise, in complex analysis, we study functions f(z)
More information2.3. Finding polynomial functions. An Introduction:
2.3. Finding polynomial functions. An Introduction: As is usually the case when learning a new concept in mathematics, the new concept is the reverse of the previous one. Remember how you first learned
More informationMultiplicity. Chapter 6
Chapter 6 Multiplicity The fundamental theorem of algebra says that any polynomial of degree n 0 has exactly n roots in the complex numbers if we count with multiplicity. The zeros of a polynomial are
More informationLecture Notes on Univariate Time Series Analysis and Box Jenkins Forecasting John Frain Economic Analysis, Research and Publications April 1992 (reprinted with revisions) January 1999 Abstract These are
More informationRecursive Algorithms. Recursion. Motivating Example Factorial Recall the factorial function. { 1 if n = 1 n! = n (n 1)! if n > 1
Recursion Slides by Christopher M Bourke Instructor: Berthe Y Choueiry Fall 007 Computer Science & Engineering 35 Introduction to Discrete Mathematics Sections 717 of Rosen cse35@cseunledu Recursive Algorithms
More informationForecasting model of electricity demand in the Nordic countries. Tone Pedersen
Forecasting model of electricity demand in the Nordic countries Tone Pedersen 3/19/2014 Abstract A model implemented in order to describe the electricity demand on hourly basis for the Nordic countries.
More informationPromotional Analysis and Forecasting for Demand Planning: A Practical Time Series Approach Michael Leonard, SAS Institute Inc.
Promotional Analysis and Forecasting for Demand Planning: A Practical Time Series Approach Michael Leonard, SAS Institute Inc. Cary, NC, USA Abstract Many businesses use sales promotions to increase the
More informationTime series analysis. Jan Grandell
Time series analysis Jan Grandell 2 Preface The course Time series analysis is based on the book [7] and replaces our previous course Stationary stochastic processes which was based on [6]. The books,
More informationTime Series Analysis
Time Series 1 April 9, 2013 Time Series Analysis This chapter presents an introduction to the branch of statistics known as time series analysis. Often the data we collect in environmental studies is collected
More informationFinding y p in ConstantCoefficient Nonhomogenous Linear DEs
Finding y p in ConstantCoefficient Nonhomogenous Linear DEs Introduction and procedure When solving DEs of the form the solution looks like ay + by + cy =, y = y c + y p where y c is the complementary
More informationa 1 x + a 0 =0. (3) ax 2 + bx + c =0. (4)
ROOTS OF POLYNOMIAL EQUATIONS In this unit we discuss polynomial equations. A polynomial in x of degree n, where n 0 is an integer, is an expression of the form P n (x) =a n x n + a n 1 x n 1 + + a 1 x
More informationFACTORING POLYNOMIALS IN THE RING OF FORMAL POWER SERIES OVER Z
FACTORING POLYNOMIALS IN THE RING OF FORMAL POWER SERIES OVER Z DANIEL BIRMAJER, JUAN B GIL, AND MICHAEL WEINER Abstract We consider polynomials with integer coefficients and discuss their factorization
More information3 1. Note that all cubes solve it; therefore, there are no more
Math 13 Problem set 5 Artin 11.4.7 Factor the following polynomials into irreducible factors in Q[x]: (a) x 3 3x (b) x 3 3x + (c) x 9 6x 6 + 9x 3 3 Solution: The first two polynomials are cubics, so if
More informationSolving for the Roots of the Cubic Equation. Finding the solution to the roots of a polynomial equation has been a fundamental
Dallas Gosselin and Jonathan Fernandez Professor Buckmire April 18, 014 Complex Analysis Project Solving for the Roots of the Cubic Equation Finding the solution to the roots of a polynomial equation has
More informationPRECALCULUS GRADE 12
PRECALCULUS GRADE 12 [C] Communication Trigonometry General Outcome: Develop trigonometric reasoning. A1. Demonstrate an understanding of angles in standard position, expressed in degrees and radians.
More informationSolutions for Math 311 Assignment #1
Solutions for Math 311 Assignment #1 (1) Show that (a) Re(iz) Im(z); (b) Im(iz) Re(z). Proof. Let z x + yi with x Re(z) and y Im(z). Then Re(iz) Re( y + xi) y Im(z) and Im(iz) Im( y + xi) x Re(z). () Verify
More informationChapter 6. Orthogonality
6.3 Orthogonal Matrices 1 Chapter 6. Orthogonality 6.3 Orthogonal Matrices Definition 6.4. An n n matrix A is orthogonal if A T A = I. Note. We will see that the columns of an orthogonal matrix must be
More informationInverses and powers: Rules of Matrix Arithmetic
Contents 1 Inverses and powers: Rules of Matrix Arithmetic 1.1 What about division of matrices? 1.2 Properties of the Inverse of a Matrix 1.2.1 Theorem (Uniqueness of Inverse) 1.2.2 Inverse Test 1.2.3
More informationMATRIX ALGEBRA AND SYSTEMS OF EQUATIONS. + + x 2. x n. a 11 a 12 a 1n b 1 a 21 a 22 a 2n b 2 a 31 a 32 a 3n b 3. a m1 a m2 a mn b m
MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS 1. SYSTEMS OF EQUATIONS AND MATRICES 1.1. Representation of a linear system. The general system of m equations in n unknowns can be written a 11 x 1 + a 12 x 2 +
More informationThere are four common ways of finding the inverse ztransform:
Inverse ztransforms and Difference Equations Preliminaries We have seen that given any signal x[n], the twosided ztransform is given by n x[n]z n and X(z) converges in a region of the complex plane
More informationTime Series in Mathematical Finance
Instituto Superior Técnico (IST, Portugal) and CEMAT cnunes@math.ist.utl.pt European Summer School in Industrial Mathematics Universidad Carlos III de Madrid July 2013 Outline The objective of this short
More informationEstimating an ARMA Process
Statistics 910, #12 1 Overview Estimating an ARMA Process 1. Main ideas 2. Fitting autoregressions 3. Fitting with moving average components 4. Standard errors 5. Examples 6. Appendix: Simple estimators
More informationMatrix Inverse and Determinants
DM554 Linear and Integer Programming Lecture 5 and Marco Chiarandini Department of Mathematics & Computer Science University of Southern Denmark Outline 1 2 3 4 and Cramer s rule 2 Outline 1 2 3 4 and
More informationLecture Notes 1: Matrix Algebra Part B: Determinants and Inverses
University of Warwick, EC9A0 Maths for Economists Peter J. Hammond 1 of 57 Lecture Notes 1: Matrix Algebra Part B: Determinants and Inverses Peter J. Hammond email: p.j.hammond@warwick.ac.uk Autumn 2012,
More informationVieta s Formulas and the Identity Theorem
Vieta s Formulas and the Identity Theorem This worksheet will work through the material from our class on 3/21/2013 with some examples that should help you with the homework The topic of our discussion
More informationALGEBRA I / ALGEBRA I SUPPORT
Suggested Sequence: CONCEPT MAP ALGEBRA I / ALGEBRA I SUPPORT August 2011 1. Foundations for Algebra 2. Solving Equations 3. Solving Inequalities 4. An Introduction to Functions 5. Linear Functions 6.
More informationMarch 29, 2011. 171S4.4 Theorems about Zeros of Polynomial Functions
MAT 171 Precalculus Algebra Dr. Claude Moore Cape Fear Community College CHAPTER 4: Polynomial and Rational Functions 4.1 Polynomial Functions and Models 4.2 Graphing Polynomial Functions 4.3 Polynomial
More informationminimal polyonomial Example
Minimal Polynomials Definition Let α be an element in GF(p e ). We call the monic polynomial of smallest degree which has coefficients in GF(p) and α as a root, the minimal polyonomial of α. Example: We
More informationMATHEMATICS (CLASSES XI XII)
MATHEMATICS (CLASSES XI XII) General Guidelines (i) All concepts/identities must be illustrated by situational examples. (ii) The language of word problems must be clear, simple and unambiguous. (iii)
More informationSince [L : K(α)] < [L : K] we know from the inductive assumption that [L : K(α)] s < [L : K(α)]. It follows now from Lemma 6.
Theorem 7.1. Let L K be a finite extension. Then a)[l : K] [L : K] s b) the extension L K is separable iff [L : K] = [L : K] s. Proof. Let M be a normal closure of L : K. Consider first the case when L
More informationTime Series Analysis of Aviation Data
Time Series Analysis of Aviation Data Dr. Richard Xie February, 2012 What is a Time Series A time series is a sequence of observations in chorological order, such as Daily closing price of stock MSFT in
More informationThe Method of Partial Fractions Math 121 Calculus II Spring 2015
Rational functions. as The Method of Partial Fractions Math 11 Calculus II Spring 015 Recall that a rational function is a quotient of two polynomials such f(x) g(x) = 3x5 + x 3 + 16x x 60. The method
More informationRoots of Polynomials
Roots of Polynomials (Com S 477/577 Notes) YanBin Jia Sep 24, 2015 A direct corollary of the fundamental theorem of algebra is that p(x) can be factorized over the complex domain into a product a n (x
More informationTime Series Analysis III
Lecture 12: Time Series Analysis III MIT 18.S096 Dr. Kempthorne Fall 2013 MIT 18.S096 Time Series Analysis III 1 Outline Time Series Analysis III 1 Time Series Analysis III MIT 18.S096 Time Series Analysis
More informationA course in Time Series Analysis. Suhasini Subba Rao Email: suhasini.subbarao@stat.tamu.edu
A course in Time Series Analysis Suhasini Subba Rao Email: suhasini.subbarao@stat.tamu.edu August 5, 205 Contents Introduction 8. Time Series data................................. 8.. R code....................................2
More informationThe SAS Time Series Forecasting System
The SAS Time Series Forecasting System An Overview for Public Health Researchers Charles DiMaggio, PhD College of Physicians and Surgeons Departments of Anesthesiology and Epidemiology Columbia University
More informationB such that AB = I and BA = I. (We say B is an inverse of A.) Definition A square matrix A is invertible (or nonsingular) if matrix
Matrix inverses Recall... Definition A square matrix A is invertible (or nonsingular) if matrix B such that AB = and BA =. (We say B is an inverse of A.) Remark Not all square matrices are invertible.
More informationPUTNAM TRAINING POLYNOMIALS. Exercises 1. Find a polynomial with integral coefficients whose zeros include 2 + 5.
PUTNAM TRAINING POLYNOMIALS (Last updated: November 17, 2015) Remark. This is a list of exercises on polynomials. Miguel A. Lerma Exercises 1. Find a polynomial with integral coefficients whose zeros include
More informationTIME SERIES ANALYSIS
TIME SERIES ANALYSIS L.M. BHAR AND V.K.SHARMA Indian Agricultural Statistics Research Institute Library Avenue, New Delhi0 02 lmb@iasri.res.in. Introduction Time series (TS) data refers to observations
More informationIndiana State Core Curriculum Standards updated 2009 Algebra I
Indiana State Core Curriculum Standards updated 2009 Algebra I Strand Description Boardworks High School Algebra presentations Operations With Real Numbers Linear Equations and A1.1 Students simplify and
More informationTime Series Analysis: Basic Forecasting.
Time Series Analysis: Basic Forecasting. As published in Benchmarks RSS Matters, April 2015 http://web3.unt.edu/benchmarks/issues/2015/04/rssmatters Jon Starkweather, PhD 1 Jon Starkweather, PhD jonathan.starkweather@unt.edu
More informationIRREDUCIBLE OPERATOR SEMIGROUPS SUCH THAT AB AND BA ARE PROPORTIONAL. 1. Introduction
IRREDUCIBLE OPERATOR SEMIGROUPS SUCH THAT AB AND BA ARE PROPORTIONAL R. DRNOVŠEK, T. KOŠIR Dedicated to Prof. Heydar Radjavi on the occasion of his seventieth birthday. Abstract. Let S be an irreducible
More informationIn this paper we study how the timeseries structure of the demand process affects the value of information
MANAGEMENT SCIENCE Vol. 51, No. 6, June 25, pp. 961 969 issn 25199 eissn 1526551 5 516 961 informs doi 1.1287/mnsc.15.385 25 INFORMS Information Sharing in a Supply Chain Under ARMA Demand Vishal Gaur
More informationSan Jose State University Engineering 10 1
KY San Jose State University Engineering 10 1 Select Insert from the main menu Plotting in Excel Select All Chart Types San Jose State University Engineering 10 2 Definition: A chart that consists of multiple
More information1.7. Partial Fractions. 1.7.1. Rational Functions and Partial Fractions. A rational function is a quotient of two polynomials: R(x) = P (x) Q(x).
.7. PRTIL FRCTIONS 3.7. Partial Fractions.7.. Rational Functions and Partial Fractions. rational function is a quotient of two polynomials: R(x) = P (x) Q(x). Here we discuss how to integrate rational
More informationTHE SVM APPROACH FOR BOX JENKINS MODELS
REVSTAT Statistical Journal Volume 7, Number 1, April 2009, 23 36 THE SVM APPROACH FOR BOX JENKINS MODELS Authors: Saeid Amiri Dep. of Energy and Technology, Swedish Univ. of Agriculture Sciences, P.O.Box
More information