Time Series Analysis


 Dwight Taylor
 2 years ago
 Views:
Transcription
1 Time Series Analysis Informatics and Mathematical Modelling Technical University of Denmark DK2800 Kgs. Lyngby 1
2 Outline of the lecture Identification of univariate time series models, cont.: Estimation of model parameters, Sec. 6.4 (cont.) Model order selection, Sec. 6.5 Model validation, Sec
3 Estimation methods (from previous lecture) We have an appropriate model structure AR(p), M A(q), ARMA(p,q), ARIMA(p,d,q) with p, d, and q known Task: Based on the observations find appropriate values of the parameters The book describes many methods: Moment estimates LSestimates Prediction error estimates Conditioned Unconditioned MLestimates Conditioned Unconditioned (exact) 3
4 Maximum likelihood estimates ARM A(p, q)process: Y t + φ 1 Y t φ p Y t p = ε t + θ 1 ε t θ q ε t q Notation: θ T = (φ 1,...,φ p,θ 1,...,θ q ) Y T t = (Y t,y t 1,...,Y 1 ) The Likelihood function is the joint probability distribution function for all observations for given values of θ and σ 2 ε: L(Y N ;θ,σ 2 ε) = f(y N θ,σ 2 ε) Given the observations Y N we estimate θ and σ 2 ε as the values for which the likelihood is maximized. 4
5 The likelihood function for ARM A(p, q)models The random variable Y N Y N 1 only contains ε N as a random component ε N is a white noise process at time N and does therefore not depend on anything We therefore know that the random variables Y N Y N 1 and Y N 1 are independent, hence (see also page 3): f(y N θ,σ 2 ε) = f(y N Y N 1,θ,σ 2 ε)f(y N 1 θ,σ 2 ε) Repeating these arguments: L(Y N ;θ,σ 2 ε) = N t=p+1 f(y t Y t 1,θ,σε) 2 f(y p θ,σε) 2 5
6 The conditional likelihood function Evaluation of f(y p θ,σ 2 ε) requires special attention It turns out that the estimates obtained using the conditional likelihood function: N L(Y N ;θ,σε) 2 = f(y t Y t 1,θ,σε) 2 t=p+1 results in the same estimates as the exact likelihood function when many observations are available For small samples there can be some difference Software: The SPLUS function arima.mle calculate conditional estimates The R function arima calculate exact estimates 6
7 Evaluating the conditional likelihood function Task: Find the conditional densities given specified values of the parameters θ and σ 2 ε The mean of the random variable Y t Y t 1 is the the 1step forecast Ŷt t 1 The prediction error ε t = Y t Ŷ t t 1 has variance σ 2 ε We assume that the process is Gaussian: f(y t Y t 1,θ,σ 2 ε) = 1 e (Y t Y b t t 1(θ))2 /2σ2 ε σ ε 2π And therefore: L(Y N ;θ,σ 2 ε) = (σ 2 ε2π) N p 2 exp 1 2σ 2 ε N ε 2 t(θ) t=p+1 7
8 MLestimates The (conditional) MLestimate θ is a prediction error estimate since it is obtained by minimizing S(θ) = N t=p+1 ε 2 t(θ) By differentiating w.r.t. σ 2 ε it can be shown that the MLestimate of σ 2 ε is σ 2 ε = S( θ)/(n p) The estimate θ is asymptoticly good and the variancecovariance matrix is approximately 2σ 2 εh 1 where H contains the 2nd order partial derivatives of S(θ) at the minimum 8
9 Finding the MLestimates using the PEmethod 1step predictions: Ŷ t t 1 = φ 1 Y t 1 φ p Y t p θ 1 ε t θ q ε t q If we use ε p = ε p 1 = = ε p+1 q = 0 we can find: Ŷ p+1 p = φ 1 Y p φ p Y θ 1 ε p + + θ q ε p+1 q Which will give us ε p+1 = Y p+1 Ŷ p+1 p and we can then calculate Ŷp+2 p+1 and ε p+2... and so on until we have all the 1step prediction errors we need. We use numerical optimization to find the parameters which minimize the sum of squared prediction errors 9
10 S(θ) for ( B)Y t = (1 0.4B)ε t with σ 2 ε = Data: arima.sim(model=list(ar= 0.7,ma=0.4), n=500, sd=0.25) AR parameter MA parameter 10
11 Moment estimates Given the model structure: Find formulas for the theoretical autocorrelation or autocovariance as function of the parameters in the model Estimate, e.g. calculate the SACF Solve the equations by using the lowest lags necessary Complicated! General properties of the estimator unknown! 11
12 Moment estimates for AR(p)processes In this case moment estimates are simple to find due to the YuleWalker equations (page 104). We simply plug in the estimated autocorrelation function in lags 1 to p: ρ(1) 1 ρ(1) ρ(p 1) φ 1 ρ(2). = ρ(1) 1 ρ(p 2) φ ρ(p) ρ(p 1) ρ(p 2) 1 φ p and solve w.r.t. the φ s The function ar in SPLUS or R use this approach as default 12
13 Model building 1. Identification (Specifying the model order) Data Theory physical insight 2. Estimation (of the model parameters) No 3. Model checking Is the model OK? Yes Applications using the model (Prediction, simulation, etc.) 13
14 Validation of the model and extensions / reductions Residual analysis (Sec ): Is it possible to detect problems with residuals? (the 1step prediction errors using the estimates, i.e. {ε t ( θ)}, should be white noise) If the SACF or the SPACF of {ε t ( θ)} points towards a particular ARMAstructure we can derive how the original model should be extended (Sec ) If the model pass the residual analysis it makes sense to test null hypotheses about the parameters (Sec ) 14
15 Residual analysis Plot {ε t ( θ)}; do the residuals look stationary? Tests in the autocorrelation. If {ε t ( θ)} is white noise then ˆρ ε (k) is approximately Gaussian distributed with mean 0 and variance 1/N. If the model fails calculate SPACF also and see if an ARMAstructure for the residuals can be derived (Sec ) Since ˆρ ε (k 1 ) and ˆρ ε (k 2 ) are independent (Eq. 6.4) the test m ( ) 2 statistic Q 2 = N ˆρεt( bθ) (k) is approximately distributed k=1 as χ 2 (m n), where n is the number of parameters. SPLUS: arima.diag( output from arima.mle ) 15
16 Residual analysis (continued) Test for the number of changes in sign. In a series of length N there is N 1 possibilities for changes in sign. If the series is white noise (with mean zero) the probability of change is 1/2 and the changes will be independent. Therefore the number of changes is distributed as Bin(N 1, 1/2) SPLUS: binom.test(n1, No. of changes ) Test in the scaled cumulated periodogram of the residuals is done by plotting it and adding lines at ±K α / q, where q = (N 2)/2 for N even and q = (N 1)/2 for N odd. For 1 α confidence limits K α can be found in Table 6.2 SPLUS (95% confidence interval): library(mass) cpgram( residuals ) 16
17 Sum of squared residuals depend on the model size S( ^θ 1 ) x x x x x x x i = number of parameters (It is assumed that the models are nested) 17
18 Test is the model The test essentially checks if the reduction in SSE (S 1 S 2 ) is large enough to justify the extra parameters in model 2 (n 2 parameters) as compared to model 1 (n 1 parameters). The number of observations used is called N. If vector θ extra is used to denote the extra parameters in model 2 as compared to model 1, then the test is formally: H 0 : θ extra = 0 vs. H 0 : θ extra 0 If H 0 is true it (approximately) hold that (S 1 S 2 )/(n 2 n 1 ) S 2 /(N n 2 ) F(n 2 n 1,N n 2 ) (The likelihood ratio test is also a possibility) 18
19 Testing one parameter for significance H 0 : θ i = 0 against H 1 : θ i 0 Can be done as described on the previous slide Alternatively we can use a ttest based on the estimate and its standard error: ˆθ i / ˆV (ˆθ i ) Under H 0 and for an ARMA(p,q)model this follows a t(n p q) distribution (or t(n 1 p q) if we estimated an overall mean of the series) Often N is so large compared to the number of parameters that we can just use the standard normal distribution 19
20 Information criteria Select the model which minimize some information criterion Akaike s Information Criterion AIC = 2log(L(Y N ; θ, ˆσ ε)) 2 + 2n par Bayesian Information Criterion BIC = 2log(L(Y N ; θ, ˆσ ε)) 2 + logn n par Except for an additive constant this can also be expressed as AIC = N log ˆσ ε 2 + 2n par BIC = N log ˆσ ε 2 + logn n par BIC yields a consistent estimate of the model order 20
21 Example A model for CO
Univariate Time Series Analysis; ARIMA Models
Econometrics 2 Spring 25 Univariate Time Series Analysis; ARIMA Models Heino Bohn Nielsen of4 Outline of the Lecture () Introduction to univariate time series analysis. (2) Stationarity. (3) Characterizing
More informationUnivariate Time Series Analysis; ARIMA Models
Econometrics 2 Fall 25 Univariate Time Series Analysis; ARIMA Models Heino Bohn Nielsen of4 Univariate Time Series Analysis We consider a single time series, y,y 2,..., y T. We want to construct simple
More informationSales forecasting # 2
Sales forecasting # 2 Arthur Charpentier arthur.charpentier@univrennes1.fr 1 Agenda Qualitative and quantitative methods, a very general introduction Series decomposition Short versus long term forecasting
More informationLecture 2: ARMA(p,q) models (part 3)
Lecture 2: ARMA(p,q) models (part 3) Florian Pelgrin University of Lausanne, École des HEC Department of mathematics (IMEANice) Sept. 2011  Jan. 2012 Florian Pelgrin (HEC) Univariate time series Sept.
More informationITSMR Reference Manual
ITSMR Reference Manual George Weigt June 5, 2015 1 Contents 1 Introduction 3 1.1 Time series analysis in a nutshell............................... 3 1.2 White Noise Variance.....................................
More informationTime Series Graphs. Model ACF PACF. White Noise All zeros All zeros. AR(p) Exponential Decay P significant lags before dropping to zero
Time Series Graphs Model ACF PACF White Noise All zeros All zeros AR(p) Exponential Decay P significant lags before dropping to zero MA(q) q significant lags before dropping to zero Exponential Decay ARMA(p,q)
More informationAnalysis and Computation for Finance Time Series  An Introduction
ECMM703 Analysis and Computation for Finance Time Series  An Introduction Alejandra González Harrison 161 Email: mag208@exeter.ac.uk Time Series  An Introduction A time series is a sequence of observations
More informationAdvanced Forecasting Techniques and Models: ARIMA
Advanced Forecasting Techniques and Models: ARIMA Short Examples Series using Risk Simulator For more information please visit: www.realoptionsvaluation.com or contact us at: admin@realoptionsvaluation.com
More informationMaximum Likelihood Estimation of an ARMA(p,q) Model
Maximum Likelihood Estimation of an ARMA(p,q) Model Constantino Hevia The World Bank. DECRG. October 8 This note describes the Matlab function arma_mle.m that computes the maximum likelihood estimates
More informationRob J Hyndman. Forecasting using. 11. Dynamic regression OTexts.com/fpp/9/1/ Forecasting using R 1
Rob J Hyndman Forecasting using 11. Dynamic regression OTexts.com/fpp/9/1/ Forecasting using R 1 Outline 1 Regression with ARIMA errors 2 Example: Japanese cars 3 Using Fourier terms for seasonality 4
More informationIntroduction to General and Generalized Linear Models
Introduction to General and Generalized Linear Models General Linear Models  part I Henrik Madsen Poul Thyregod Informatics and Mathematical Modelling Technical University of Denmark DK2800 Kgs. Lyngby
More informationExercise 1. 1) Using Eviews (file named return.wf1), plot the ACF and PACF function for the series returns. Identify the series.
Exercise 1 1) Using Eviews (file named return.wf1), plot the ACF and PACF function for the series returns. Identify the series. 2) Read the paper Do we really know that financial markets are efficient?
More informationTime Series Analysis and Forecasting
Time Series Analysis and Forecasting Math 667 Al Nosedal Department of Mathematics Indiana University of Pennsylvania Time Series Analysis and Forecasting p. 1/11 Introduction Many decisionmaking applications
More informationSTATISTICA Formula Guide: Logistic Regression. Table of Contents
: Table of Contents... 1 Overview of Model... 1 Dispersion... 2 Parameterization... 3 SigmaRestricted Model... 3 Overparameterized Model... 4 Reference Coding... 4 Model Summary (Summary Tab)... 5 Summary
More information2. What are the theoretical and practical consequences of autocorrelation?
Lecture 10 Serial Correlation In this lecture, you will learn the following: 1. What is the nature of autocorrelation? 2. What are the theoretical and practical consequences of autocorrelation? 3. Since
More informationUnivariate and Multivariate Methods PEARSON. Addison Wesley
Time Series Analysis Univariate and Multivariate Methods SECOND EDITION William W. S. Wei Department of Statistics The Fox School of Business and Management Temple University PEARSON Addison Wesley Boston
More informationForecasting of Paddy Production in Sri Lanka: A Time Series Analysis using ARIMA Model
Tropical Agricultural Research Vol. 24 (): 23 (22) Forecasting of Paddy Production in Sri Lanka: A Time Series Analysis using ARIMA Model V. Sivapathasundaram * and C. Bogahawatte Postgraduate Institute
More informationTIME SERIES ANALYSIS
TIME SERIES ANALYSIS Ramasubramanian V. I.A.S.R.I., Library Avenue, New Delhi 110 012 ram_stat@yahoo.co.in 1. Introduction A Time Series (TS) is a sequence of observations ordered in time. Mostly these
More information5. Multiple regression
5. Multiple regression QBUS6840 Predictive Analytics https://www.otexts.org/fpp/5 QBUS6840 Predictive Analytics 5. Multiple regression 2/39 Outline Introduction to multiple linear regression Some useful
More informationARMA, GARCH and Related Option Pricing Method
ARMA, GARCH and Related Option Pricing Method Author: Yiyang Yang Advisor: Pr. Xiaolin Li, Pr. Zari Rachev Department of Applied Mathematics and Statistics State University of New York at Stony Brook September
More informationMemento on Eviews output
Memento on Eviews output Jonathan Benchimol 10 th June 2013 Abstract This small paper, presented as a memento format, reviews almost all frequent results Eviews produces following standard econometric
More informationTIME SERIES ANALYSIS
TIME SERIES ANALYSIS L.M. BHAR AND V.K.SHARMA Indian Agricultural Statistics Research Institute Library Avenue, New Delhi0 02 lmb@iasri.res.in. Introduction Time series (TS) data refers to observations
More informationPrediction of Stock Price usingautoregressiveintegrated Moving AverageFilter Arima P,D,Q
Global Journal of Science Frontier Research Mathematics and Decision Sciences Volume 13 Issue 8 Version 1.0 Year Type : Double Blind Peer Reviewed International Research Journal Publisher: Global Journals
More informationTime Series Analysis
Time Series Analysis Autoregressive, MA and ARMA processes Andrés M. Alonso Carolina GarcíaMartos Universidad Carlos III de Madrid Universidad Politécnica de Madrid June July, 212 Alonso and GarcíaMartos
More informationLecture 8. Confidence intervals and the central limit theorem
Lecture 8. Confidence intervals and the central limit theorem Mathematical Statistics and Discrete Mathematics November 25th, 2015 1 / 15 Central limit theorem Let X 1, X 2,... X n be a random sample of
More informationNotes for STA 437/1005 Methods for Multivariate Data
Notes for STA 437/1005 Methods for Multivariate Data Radford M. Neal, 26 November 2010 Random Vectors Notation: Let X be a random vector with p elements, so that X = [X 1,..., X p ], where denotes transpose.
More informationNote: We will use EViews 5.1 in this tutorial. There may be minor differences in EViews 6.
ECON 604 EVIEWS TUTORIAL #2 IDENTIFYING AND ESTIMATING ARMA MODELS Note: We will use EViews 5.1 in this tutorial. There may be minor differences in EViews 6. Preliminary Analysis In this tutorial we will
More informationFinancial Econometrics Jeffrey R. Russell Final Exam
Name Financial Econometrics Jeffrey R. Russell Final Exam You have 3 hours to complete the exam. Use can use a calculator. Try to fit all your work in the space provided. If you find you need more space
More informationGeneralized Linear Model Theory
Appendix B Generalized Linear Model Theory We describe the generalized linear model as formulated by Nelder and Wedderburn (1972), and discuss estimation of the parameters and tests of hypotheses. B.1
More informationLuciano Rispoli Department of Economics, Mathematics and Statistics Birkbeck College (University of London)
Luciano Rispoli Department of Economics, Mathematics and Statistics Birkbeck College (University of London) 1 Forecasting: definition Forecasting is the process of making statements about events whose
More informationNPTEL STRUCTURAL RELIABILITY
NPTEL Course On STRUCTURAL RELIABILITY Module # 02 Lecture 6 Course Format: Web Instructor: Dr. Arunasis Chakraborty Department of Civil Engineering Indian Institute of Technology Guwahati 6. Lecture 06:
More informationChapter 7 The ARIMA Procedure. Chapter Table of Contents
Chapter 7 Chapter Table of Contents OVERVIEW...193 GETTING STARTED...194 TheThreeStagesofARIMAModeling...194 IdentificationStage...194 Estimation and Diagnostic Checking Stage...... 200 Forecasting Stage...205
More informationChapter 4: Vector Autoregressive Models
Chapter 4: Vector Autoregressive Models 1 Contents: Lehrstuhl für Department Empirische of Wirtschaftsforschung Empirical Research and und Econometrics Ökonometrie IV.1 Vector Autoregressive Models (VAR)...
More informationAutocovariance and Autocorrelation
Chapter 3 Autocovariance and Autocorrelation If the {X n } process is weakly stationary, the covariance of X n and X n+k depends only on the lag k. This leads to the following definition of the autocovariance
More informationThe general form of the PROC GLM statement is
Linear Regression Analysis using PROC GLM Regression analysis is a statistical method of obtaining an equation that represents a linear relationship between two variables (simple linear regression), or
More informationChapter 6: Multivariate Cointegration Analysis
Chapter 6: Multivariate Cointegration Analysis 1 Contents: Lehrstuhl für Department Empirische of Wirtschaftsforschung Empirical Research and und Econometrics Ökonometrie VI. Multivariate Cointegration
More informationTime Series Analysis
Time Series Analysis hm@imm.dtu.dk Informatics and Mathematical Modelling Technical University of Denmark DK2800 Kgs. Lyngby 1 Outline of the lecture Recursive and adaptive estimation: Introduction to
More informationSYSM 6304: Risk and Decision Analysis Lecture 3 Monte Carlo Simulation
SYSM 6304: Risk and Decision Analysis Lecture 3 Monte Carlo Simulation M. Vidyasagar Cecil & Ida Green Chair The University of Texas at Dallas Email: M.Vidyasagar@utdallas.edu September 19, 2015 Outline
More informationRegression Analysis Prof. Soumen Maity Department of Mathematics Indian Institute of Technology, Kharagpur. Lecture  2 Simple Linear Regression
Regression Analysis Prof. Soumen Maity Department of Mathematics Indian Institute of Technology, Kharagpur Lecture  2 Simple Linear Regression Hi, this is my second lecture in module one and on simple
More informationEviews Tutorial. File New Workfile. Start observation End observation Annual
APS 425 Professor G. William Schwert Advanced Managerial Data Analysis CS3110L, 5852752470 Fax: 5854615475 email: schwert@schwert.ssb.rochester.edu Eviews Tutorial 1. Creating a Workfile: First you
More informationTopic 5: Stochastic Growth and Real Business Cycles
Topic 5: Stochastic Growth and Real Business Cycles Yulei Luo SEF of HKU October 1, 2015 Luo, Y. (SEF of HKU) Macro Theory October 1, 2015 1 / 45 Lag Operators The lag operator (L) is de ned as Similar
More informationMaximum Likelihood Estimation
Math 541: Statistical Theory II Lecturer: Songfeng Zheng Maximum Likelihood Estimation 1 Maximum Likelihood Estimation Maximum likelihood is a relatively simple method of constructing an estimator for
More informationBasics of Statistical Machine Learning
CS761 Spring 2013 Advanced Machine Learning Basics of Statistical Machine Learning Lecturer: Xiaojin Zhu jerryzhu@cs.wisc.edu Modern machine learning is rooted in statistics. You will find many familiar
More informationRegression Analysis Prof. Soumen Maity Department of Mathematics Indian Institute of Technology, Kharagpur
Regression Analysis Prof. Soumen Maity Department of Mathematics Indian Institute of Technology, Kharagpur Lecture  7 Multiple Linear Regression (Contd.) This is my second lecture on Multiple Linear Regression
More informationIntroduction to Time Series Analysis. Lecture 1.
Introduction to Time Series Analysis. Lecture 1. Peter Bartlett 1. Organizational issues. 2. Objectives of time series analysis. Examples. 3. Overview of the course. 4. Time series models. 5. Time series
More information9th Russian Summer School in Information Retrieval Big Data Analytics with R
9th Russian Summer School in Information Retrieval Big Data Analytics with R Introduction to Time Series with R A. Karakitsiou A. Migdalas Industrial Logistics, ETS Institute Luleå University of Technology
More informationOverview of Violations of the Basic Assumptions in the Classical Normal Linear Regression Model
Overview of Violations of the Basic Assumptions in the Classical Normal Linear Regression Model 1 September 004 A. Introduction and assumptions The classical normal linear regression model can be written
More informationELECE8104 Stochastics models and estimation, Lecture 3b: Linear Estimation in Static Systems
Stochastics models and estimation, Lecture 3b: Linear Estimation in Static Systems Minimum Mean Square Error (MMSE) MMSE estimation of Gaussian random vectors Linear MMSE estimator for arbitrarily distributed
More informationLecture 6 BlackScholes PDE
Lecture 6 BlackScholes PDE Lecture Notes by Andrzej Palczewski Computational Finance p. 1 Pricing function Let the dynamics of underlining S t be given in the riskneutral measure Q by If the contingent
More informationMultivariate Normal Distribution
Multivariate Normal Distribution Lecture 4 July 21, 2011 Advanced Multivariate Statistical Methods ICPSR Summer Session #2 Lecture #47/21/2011 Slide 1 of 41 Last Time Matrices and vectors Eigenvalues
More informationSimple Linear Regression Inference
Simple Linear Regression Inference 1 Inference requirements The Normality assumption of the stochastic term e is needed for inference even if it is not a OLS requirement. Therefore we have: Interpretation
More informationC: LEVEL 800 {MASTERS OF ECONOMICS( ECONOMETRICS)}
C: LEVEL 800 {MASTERS OF ECONOMICS( ECONOMETRICS)} 1. EES 800: Econometrics I Simple linear regression and correlation analysis. Specification and estimation of a regression model. Interpretation of regression
More informationPromotional Forecast Demonstration
Exhibit 2: Promotional Forecast Demonstration Consider the problem of forecasting for a proposed promotion that will start in December 1997 and continues beyond the forecast horizon. Assume that the promotion
More informationTime Series  ARIMA Models. Instructor: G. William Schwert
APS 425 Fall 25 Time Series : ARIMA Models Instructor: G. William Schwert 585275247 schwert@schwert.ssb.rochester.edu Topics Typical time series plot Pattern recognition in auto and partial autocorrelations
More informationProbability and Statistics Prof. Dr. Somesh Kumar Department of Mathematics Indian Institute of Technology, Kharagpur
Probability and Statistics Prof. Dr. Somesh Kumar Department of Mathematics Indian Institute of Technology, Kharagpur Module No. #01 Lecture No. #15 Special DistributionsVI Today, I am going to introduce
More informationSoftware Review: ITSM 2000 Professional Version 6.0.
Lee, J. & Strazicich, M.C. (2002). Software Review: ITSM 2000 Professional Version 6.0. International Journal of Forecasting, 18(3): 455459 (June 2002). Published by Elsevier (ISSN: 01692070). http://0
More informationTHE UNIVERSITY OF CHICAGO, Booth School of Business Business 41202, Spring Quarter 2014, Mr. Ruey S. Tsay. Solutions to Homework Assignment #2
THE UNIVERSITY OF CHICAGO, Booth School of Business Business 41202, Spring Quarter 2014, Mr. Ruey S. Tsay Solutions to Homework Assignment #2 Assignment: 1. Consumer Sentiment of the University of Michigan.
More informationA Primer on Mathematical Statistics and Univariate Distributions; The Normal Distribution; The GLM with the Normal Distribution
A Primer on Mathematical Statistics and Univariate Distributions; The Normal Distribution; The GLM with the Normal Distribution PSYC 943 (930): Fundamentals of Multivariate Modeling Lecture 4: September
More informationSome useful concepts in univariate time series analysis
Some useful concepts in univariate time series analysis Autoregressive moving average models Autocorrelation functions Model Estimation Diagnostic measure Model selection Forecasting Assumptions: 1. Nonseasonal
More informationLecture 15: Time Series Modeling Steven Skiena. skiena
Lecture 15: Time Series Modeling Steven Skiena Department of Computer Science State University of New York Stony Brook, NY 11794 4400 http://www.cs.sunysb.edu/ skiena Modeling and Forecasting We seek to
More informationShort Term Load Forecasting Using Time Series Analysis: A Case Study for Karnataka, India
ISO 91:28 Certified Volume 1, Issue 2, November 212 Short Term Load Forecasting Using Time Series Analysis: A Case Study for Karnataka, India Nataraja.C 1, M.B.Gorawar 2, Shilpa.G.N. 3, Shri Harsha.J.
More informationTime Series Analysis
Time Series Analysis Identifying possible ARIMA models Andrés M. Alonso Carolina GarcíaMartos Universidad Carlos III de Madrid Universidad Politécnica de Madrid June July, 2012 Alonso and GarcíaMartos
More informationBoxJenkins modelling and forecasting of Brent crude oil price
MPRA Munich Personal RePEc Archive BoxJenkins modelling and forecasting of Brent crude oil price Emmanuel Kwasi Mensah Department of Information Engineering, Computer Science and Mathematics, University
More information93.4 Likelihood ratio test. NeymanPearson lemma
93.4 Likelihood ratio test NeymanPearson lemma 91 Hypothesis Testing 91.1 Statistical Hypotheses Statistical hypothesis testing and confidence interval estimation of parameters are the fundamental
More informationA Multiplicative Seasonal BoxJenkins Model to Nigerian Stock Prices
A Multiplicative Seasonal BoxJenkins Model to Nigerian Stock Prices Ette Harrison Etuk Department of Mathematics/Computer Science, Rivers State University of Science and Technology, Nigeria Email: ettetuk@yahoo.com
More informationNonStationary Time Series andunitroottests
Econometrics 2 Fall 2005 NonStationary Time Series andunitroottests Heino Bohn Nielsen 1of25 Introduction Many economic time series are trending. Important to distinguish between two important cases:
More informationAUTOMATION OF ENERGY DEMAND FORECASTING. Sanzad Siddique, B.S.
AUTOMATION OF ENERGY DEMAND FORECASTING by Sanzad Siddique, B.S. A Thesis submitted to the Faculty of the Graduate School, Marquette University, in Partial Fulfillment of the Requirements for the Degree
More informationEconometria dei mercati finanziari c.a. A.A. 20112012. 4. AR, MA and ARMA Time Series Models. Luca Fanelli. University of Bologna
Econometria dei mercati finanziari c.a. A.A. 20112012 4. AR, MA and ARMA Time Series Models Luca Fanelli University of Bologna luca.fanelli@unibo.it For each class of models considered in these slides
More informationTime Series Laboratory
Time Series Laboratory Computing in Weber Classrooms 205206: To log in, make sure that the DOMAIN NAME is set to MATHSTAT. Use the workshop username: primesw The password will be distributed during the
More informationTraffic Safety Facts. Research Note. Time Series Analysis and Forecast of Crash Fatalities during Six Holiday Periods Cejun Liu* and ChouLin Chen
Traffic Safety Facts Research Note March 2004 DOT HS 809 718 Time Series Analysis and Forecast of Crash Fatalities during Six Holiday Periods Cejun Liu* and ChouLin Chen Summary This research note uses
More informationImpulse Response Functions
Impulse Response Functions Wouter J. Den Haan University of Amsterdam April 28, 2011 General definition IRFs The IRF gives the j th period response when the system is shocked by a onestandarddeviation
More informationGeneralized Linear Models. Today: definition of GLM, maximum likelihood estimation. Involves choice of a link function (systematic component)
Generalized Linear Models Last time: definition of exponential family, derivation of mean and variance (memorize) Today: definition of GLM, maximum likelihood estimation Include predictors x i through
More informationRegression Estimation  Least Squares and Maximum Likelihood. Dr. Frank Wood
Regression Estimation  Least Squares and Maximum Likelihood Dr. Frank Wood Least Squares Max(min)imization Function to minimize w.r.t. b 0, b 1 Q = n (Y i (b 0 + b 1 X i )) 2 i=1 Minimize this by maximizing
More informationForecasting Stock Market Series. with ARIMA Model
Journal of Statistical and Econometric Methods, vol.3, no.3, 2014, 6577 ISSN: 22410384 (print), 22410376 (online) Scienpress Ltd, 2014 Forecasting Stock Market Series with ARIMA Model Fatai Adewole
More informationChapter 13 Introduction to Nonlinear Regression( 非 線 性 迴 歸 )
Chapter 13 Introduction to Nonlinear Regression( 非 線 性 迴 歸 ) and Neural Networks( 類 神 經 網 路 ) 許 湘 伶 Applied Linear Regression Models (Kutner, Nachtsheim, Neter, Li) hsuhl (NUK) LR Chap 10 1 / 35 13 Examples
More informationPattern Analysis. Logistic Regression. 12. Mai 2009. Joachim Hornegger. Chair of Pattern Recognition Erlangen University
Pattern Analysis Logistic Regression 12. Mai 2009 Joachim Hornegger Chair of Pattern Recognition Erlangen University Pattern Analysis 2 / 43 1 Logistic Regression Posteriors and the Logistic Function Decision
More informationCalculating Interval Forecasts
Calculating Chapter 7 (Chatfield) Monika Turyna & Thomas Hrdina Department of Economics, University of Vienna Summer Term 2009 Terminology An interval forecast consists of an upper and a lower limit between
More information3. Regression & Exponential Smoothing
3. Regression & Exponential Smoothing 3.1 Forecasting a Single Time Series Two main approaches are traditionally used to model a single time series z 1, z 2,..., z n 1. Models the observation z t as a
More informationTesting for Granger causality between stock prices and economic growth
MPRA Munich Personal RePEc Archive Testing for Granger causality between stock prices and economic growth Pasquale Foresti 2006 Online at http://mpra.ub.unimuenchen.de/2962/ MPRA Paper No. 2962, posted
More informationFinancial Econometrics Review Session Notes 1
Financial Econometrics Review Session Notes 1 January 7, 011 Contents 1 Loading data to EViews 1.1 Using menus to create an empty workfile:................... 1. Using command panel to create an empty
More informationUsing JMP Version 4 for Time Series Analysis Bill Gjertsen, SAS, Cary, NC
Using JMP Version 4 for Time Series Analysis Bill Gjertsen, SAS, Cary, NC Abstract Three examples of time series will be illustrated. One is the classical airline passenger demand data with definite seasonal
More informationPackage EstCRM. July 13, 2015
Version 1.4 Date 2015711 Package EstCRM July 13, 2015 Title Calibrating Parameters for the Samejima's Continuous IRT Model Author Cengiz Zopluoglu Maintainer Cengiz Zopluoglu
More informationFitting Subjectspecific Curves to Grouped Longitudinal Data
Fitting Subjectspecific Curves to Grouped Longitudinal Data Djeundje, Viani HeriotWatt University, Department of Actuarial Mathematics & Statistics Edinburgh, EH14 4AS, UK Email: vad5@hw.ac.uk Currie,
More information" Y. Notation and Equations for Regression Lecture 11/4. Notation:
Notation: Notation and Equations for Regression Lecture 11/4 m: The number of predictor variables in a regression Xi: One of multiple predictor variables. The subscript i represents any number from 1 through
More informationNonlinear Regression:
Zurich University of Applied Sciences School of Engineering IDP Institute of Data Analysis and Process Design Nonlinear Regression: A Powerful Tool With Considerable Complexity HalfDay : Improved Inference
More informationUSE OF ARIMA TIME SERIES AND REGRESSORS TO FORECAST THE SALE OF ELECTRICITY
Paper PO10 USE OF ARIMA TIME SERIES AND REGRESSORS TO FORECAST THE SALE OF ELECTRICITY Beatrice Ugiliweneza, University of Louisville, Louisville, KY ABSTRACT Objectives: To forecast the sales made by
More informationAssignment 2: Option Pricing and the BlackScholes formula The University of British Columbia Science One CS 20152016 Instructor: Michael Gelbart
Assignment 2: Option Pricing and the BlackScholes formula The University of British Columbia Science One CS 20152016 Instructor: Michael Gelbart Overview Due Thursday, November 12th at 11:59pm Last updated
More informationTime Series Analysis
Time Series 1 April 9, 2013 Time Series Analysis This chapter presents an introduction to the branch of statistics known as time series analysis. Often the data we collect in environmental studies is collected
More informationConfidence Intervals for Exponential Reliability
Chapter 408 Confidence Intervals for Exponential Reliability Introduction This routine calculates the number of events needed to obtain a specified width of a confidence interval for the reliability (proportion
More informationMonte Carlo and Empirical Methods for Stochastic Inference (MASM11/FMS091)
Monte Carlo and Empirical Methods for Stochastic Inference (MASM11/FMS091) Magnus Wiktorsson Centre for Mathematical Sciences Lund University, Sweden Lecture 5 Sequential Monte Carlo methods I February
More informationParametric Models Part I: Maximum Likelihood and Bayesian Density Estimation
Parametric Models Part I: Maximum Likelihood and Bayesian Density Estimation Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr CS 551, Fall 2015 CS 551, Fall 2015
More informationIntroduction to Hypothesis Testing. Point estimation and confidence intervals are useful statistical inference procedures.
Introduction to Hypothesis Testing Point estimation and confidence intervals are useful statistical inference procedures. Another type of inference is used frequently used concerns tests of hypotheses.
More informationStatistical Machine Learning
Statistical Machine Learning UoC Stats 37700, Winter quarter Lecture 4: classical linear and quadratic discriminants. 1 / 25 Linear separation For two classes in R d : simple idea: separate the classes
More informationEstimating an ARMA Process
Statistics 910, #12 1 Overview Estimating an ARMA Process 1. Main ideas 2. Fitting autoregressions 3. Fitting with moving average components 4. Standard errors 5. Examples 6. Appendix: Simple estimators
More informationChapter 4: Statistical Hypothesis Testing
Chapter 4: Statistical Hypothesis Testing Christophe Hurlin November 20, 2015 Christophe Hurlin () Advanced Econometrics  Master ESA November 20, 2015 1 / 225 Section 1 Introduction Christophe Hurlin
More informationProjects in time series analysis MAP565
Projects in time series analysis MAP565 Programming : Any software can be used: Scilab, Matlab, R, Octave, Python,... The scripts must be archived in a single file (zip, tar or tgz) and should not be printed
More informationMonte Carlobased statistical methods (MASM11/FMS091)
Monte Carlobased statistical methods (MASM11/FMS091) Jimmy Olsson Centre for Mathematical Sciences Lund University, Sweden Lecture 5 Sequential Monte Carlo methods I February 5, 2013 J. Olsson Monte Carlobased
More informationPart 2: Oneparameter models
Part 2: Oneparameter models Bernoilli/binomial models Return to iid Y 1,...,Y n Bin(1, θ). The sampling model/likelihood is p(y 1,...,y n θ) =θ P y i (1 θ) n P y i When combined with a prior p(θ), Bayes
More informationIntroduction to Multivariate Models: Modeling Multivariate Outcomes with Mixed Model Repeated Measures Analyses
Introduction to Multivariate Models: Modeling Multivariate Outcomes with Mixed Model Repeated Measures Analyses Applied Multilevel Models for Cross Sectional Data Lecture 11 ICPSR Summer Workshop University
More informationStatistics in Retail Finance. Chapter 6: Behavioural models
Statistics in Retail Finance 1 Overview > So far we have focussed mainly on application scorecards. In this chapter we shall look at behavioural models. We shall cover the following topics: Behavioural
More information