# AR(1) TIME SERIES PROCESS Econometrics 7590

Save this PDF as:

Size: px
Start display at page:

## Transcription

1 AR(1) TIME SERIES PROCESS Econometrics 7590 Zsuzsanna HORVÁTH and Ryan JOHNSTON Abstract: We define the AR(1) process and its properties and applications. We demonstrate the applicability of our method to model time series data consisting of daily values of the interest rate on federal funds. We show that correctly identifying the distribution of the errors terms allows for correct modelling of the data. Furthermore, we show our conclusions concerning the hypothesis test for goodness-of-fit cannot be rejected. 1

2 Contents 1 Introduction 3 2 AR(1) Time Series 4 3 Fitting the Data to the Model 6 4 Proof 8 5 Time Series 9 6 Conclusion: Modeling High Volatility 10 7 Bibliography 12 2

3 1 Introduction Any array of time and numbers that are associated can be considered a time series, however, we typically think of a time series as an ordered sequence of values (data points) of variables at equally spaced time intervals. Time series models are used in an attempt make sense of time series. They are used to obtain an understanding of the underlying factors and theory (where did the data come from? What are the statistical properties of the data? What trends are present?) that produce the observed data. The results are then used to fit these models for predictive forecasting and monitoring. Time series analysis is the study of these models and is used in many applications including budgetary analysis, census analysis, economic forecasting, inventory studies, process and quality control, stock market analysis, utility studies, workload projections, and yield projections. There exist many models used for time series, however, there are three very broad classes that are used most often. These are the autoregressive (AR) models, the integrated (I) models, and the moving average (MA) models. These models are often intertwined to generate new models. For example, the autoregressive moving average model (ARMA) combines the (AR) model and the (MA) model. Another example of this is the autoregressive integrated moving average (ARIMA) model, which combine all three of the models previously mentioned. The most commonly used model for time series data is the autoregressive process. The autoregressive process is a difference equation determined by random variables. The distribution of such random variables is the key component in modeling time series. The time series considered in this paper is the first order autoregressive equation, written as AR(1). The AR(1) equation is a standard linear difference equation X k = ρx k 1 + ε k. k = 0, ±1, ±2,... where the ε k are called the error terms or innovations and are what make up the variability in the time series. For practical reasons, it is desirable to have a unique solution that is independent of time (stationary) and a function of the past error terms. A solution that is independent of time allows one to be able to avoid an initial condition, which may be difficult to find or at an inconvenient location in a time series. A solution as a function of the past error terms is necessary in models used to forecast. It is important to note that the existence of a unique stationary solution is non-trivial. Assumptions about the error terms are made to guarantee a unique stationary solution. Much of the literature on AR models assume that the error terms are an uncorrelated sequence of random variables with a probability distribution that has zero for the mean and a finite variance. These assumptions limit our ability to model time series that exhibit 3

4 2 AR(1) TIME SERIES 4 more volatile behavior such as the stock market or interest rates. Fortunately it has been shown that weaker assumptions can be made to allow the use of distributions that more closely model high volatility time series data without losing the guarantee that there exists a unique stationary solution. 2 AR(1) Time Series The pth order autoregressive time series (often written as AR(p)) X k is given by the following equation p ρ i X k i = ε k, k = 0, ±1, ±2,... i=0 where ρ 0 0, ρ p 0 and the ε t are typically assumed to be uncorrelated (0, σ 2 ) random variables (i.e. E[ε 0 ] = 0, E[ε 2 0 ] = σ2 ). Thus, the AR(1) process is a first order autoregressive time series and most commonly defined by the following equations X k = ρx k 1 + ε k k = 0, ±1, ±2,... which is simply a first order linear difference equation. A difference equation is an expression relating a variable X k to its previous values. For example, a difference equation is an equation directly relating the value X at time k to the value of X at a previous time period, plus another variable ε dependent on time k (ε k ). A difference equation written as (2.1.1) X k = ρx k 1 + ε k is called a first-order difference equation because only the first backshift or lag of the variable appears in the equation. Note that X k is represented as a linear function of X k 1 and ε k. For the AR(1) process, the ε k s are regarded as random variables and are often referred to as the error terms or innovations. They generally make up the variability that is part of the system when it moves from one time period to the next. Nothing has yet been mentioned about the variable ρ, which is a constant. The value of ρ will be considered shortly. Using the difference equation above, X k is obtained from knowing the value of X k 1, and in turn X k 1 is obtained from knowing X k 2 and so on. Observe that X k can be obtained from an initial value X 0 that is k-time periods prior. Thus, a solution for X k can be found through recursive substitution

5 2 AR(1) TIME SERIES 5 X k =ρx k 1 + ε k =ρ(ρx k 2 + ε k 1 ) + ε k =ρ 2 X k 2 + ρε k 1 + ε k =ρ 3 X k 3 + ρ 2 ε k 2 + ρε k 1 + ε k. =ρ k X 0 + ρ k 1 ε ρε k 1 + ε k, where X 0 is the initial value. This can be generalized to the case wherein the initial value is X k N. For example, consider two time periods, one at time k and the other counted N time periods back from k, denoted as k N. The value of X at time k N is like the initial value, so X k N becomes the value of X known at time k N. Thus, in the general case, the value of X at time k (X k ) can be obtained using recursive substitution X k =ρx k 1 + ε k =ρ(ρx k 2 + ε k 1 ) + ε k =ρ 2 X k 2 + ρε k 1 + ε k =ρ 3 X k 3 + ρ 2 ε k 2 + ρε k 1 + ε k. =ρ N X k N + ρ N 1 ε k (N 1) + + ρε k 1 + ε k. Thus, for every N (2.2.1) X k = ρ N X k N + N 1 i=0 ρ i ε k i. The limit as N of equation (2.2.1) and for ρ < 1 indicates X k = i=0 ρi ε k i must be the solution of the difference equation, assuming that the infinite sum i=0 ρi ε k i exists. If ε k is stationary, then i=0 ρi ε k i is also stationary. Recall that stationary implies that the time series is independent of time, in other words, the joint distribution of (X k1, X k2,..., X kj ) is the same as that of (X k1+h, X k2+h,...,x kj+h ). More specifically, F Xk1,X k2,...,x kj (x k1, x k2,...,x kj ) = F Xk1+h,X k2+h,...,x kj+h (x k1+h, x k2+h,...,x kj+h ). The joint distribution depends only on the difference h, not on the time (k 1,...,k j ). It may also be observed that the effect of ε k (N 1) on X k is ρ N 1. Thus for ρ < 1, ρ N 1 geometrically goes to zero. Whereas when ρ > 1, ρ N 1 grows exponentially over

6 3 FITTING THE DATA TO THE MODEL 6 time. Thus, for ρ < 1, the system is considered stable, or the further back in time a given change occurs, the less it will affect the present. The given change eventually dies out over time. For ρ > 1, the system blows up. A given change from the past increasingly affects the future as time goes on. For practical purposes, it is desirable to have a system that is less effected the further we go into the past. It is important to note that for ρ < 1, the solution is given as a function of the error terms from the past. For ρ > 1, it is possible to obtain a stable solution, but the solution is given as a function of the error terms from the future. For obvious reasons it is typically assumed the value of ρ to be less than one since it would not serve to be practical to use a model that requires knowledge of observations from the future rather than the past. We now take a look at a time series data set taken from the Economagic website (http://www.economagic.com). The data consists of roughly 18 months of daily values of the interest rate on federal funds. There are approximately 500 data points from October 29, 1992 to March 13, We desire to obtain the distribution of the solution to this time series. Thus, we need to obtain the distribution of the error terms since the AR(1) equation is determined simply by past observations of the random variable X and the error terms. So, if we knew the distribution of the error terms, we would have the distribution of the AR(1) equation. In addition, we would need to know the value of ρ, which we find an estimator for using the method of least squares. The chi-squared goodness-of-fit test is considered a good test in trying to determine the distribution of a random variable even when the paramaters are unknown, which is the case we are faced with. First, we observe a plot of the data to get an idea of what trends there might be. We hope for the data to be stationary, which in fact is the reason we chose the data set that we did. We also create a histogram of the observed data to begin to get an idea of what distribution we could use to test for goodness-of-fit. It may be necessary to play around with the parameters of the histogram by decreasing or increasing the interval length for the data to be binned. This is done in order to try to fit the shape of the histogram as closely to a distribution curve of a specific probability distribution. Now we calculute the estimators for ρ and our distribution function and use the chi-squared goodness-of-fit test to determing whether the observed data could be of the hypothesized distribution. The details of obtaining all of this information is explained in the following section. 3 Fitting the Data to the Model The first step in fitting the collected data to the AR(1) model described in the previous section is to estimate the value of ρ. This will be accomplished using the least squares estimation. The error term is ǫ k. We want to minimize the sum of the square of errors

7 3 FITTING THE DATA TO THE MODEL 7 for our observed values with respect to ρ. We take the derivative of the sum of squares to get n n (X k ρx k 1 ) 2 = 2 (X k ρx k 1 )( X k 1 ). ρ We set the derivative equal to 0 and obtain the following: 2 n (X k ρx k 1 ) ( X k 1 ) = 0 n ( ) Xk X k 1 + ρxk 1 2 = 0 n X k X k+1 + ρ ρ n Xk 1 2 = 0 n n Xk 1 2 = X k X k 1 Hence, we obtain our least squares estimator for ρ: (3.1) ˆρ = n X kx k 1 n. X2 k 1 From our observed data, the least squares estimator yields that ˆρ = Our next step in modelling the data is to determine the approximate distribution that the data may have come from. To find the distribution of our data, we need to first find the distribution of our error terms. Therefore, we solve for ǫ k. Recall, X k = ρx k 1 + ǫ k ˆǫ k = X k ˆρX k 1 We now have all of the information necessary to generate the histogram. By estimating ˆρ, we can see the correlation between each observation from time period to time period. The only thing that is different between the observations are the random error terms, ǫ k. Hence, knowing the distribution of the ǫ k s will give us the exact distribution of the observed data. To determine this, we create a histogram of ˆǫ 1, ˆǫ 2... ˆ ǫ 500. In order to obtain a detailed picture, we generate a histogram that has 40 equally spaced bins. The distribution is clearly Cauchy. The question now becomes estimating the parameters of the Cauchy to get a nice fit for the error terms. We find that a Cauchy with parameters,

8 4 PROOF 8 location = 1.02, scale =.0499 provides a good fit. The histogram of the error terms, along with the density of a Cauchy can be found in Figure 4.1. To further strengthen the assumption that the ǫ k s came from a Cauchy distribution, we provide a χ2 test. 4 Proof H 0 : time series data has Cauchy Distribution with parameter: location=1.02, scale=.0499 H a : H 0 is not true We will divide the interval into K cells and calculate the number of observations that fall into each cell. We define this as Y 1, Y 2,...,Y 8. We define the range of our 8 cells as [, 0.96), [0.96, 0.97), [0.97, 0.98), [0.98, 1.02), [1.02, 1.5), [1.5, 1.8), [1.8, 2.8), [2.8, ) Let K = 8 and n = 500. Recall, the density of the Cauchy distribution: We define Recall We obtain that: f(x) = 1 π ( x 2 ). ti E i = 500 f(x)dx. t i 1 K (Y i E i ) 2 χ 2 (K 1) E i i=1 Y 1 = 90 Y 5 = 258 Y 2 = 10 Y 6 = 4 Y 3 = 20 Y 7 = 6 Y 4 = 111 Y 8 = 1 Using the definition of E i gives: E 1 = 110 E 5 = 234 E 2 = 14 E 6 = 6 E 3 = 18 E 7 = 6 E 4 = 107 E 8 = 4

9 5 TIME SERIES Figure 4.1 Histogram of ˆǫ 1, ˆǫ 2... ǫ 500 ˆ Using the definition of χ 2 we get: (90 110) 2 (10 14)2 (20 18) ( ) 2 (4 6)2 (6 6) More succinctly, we have just computed K (Y i E i ) 2 = E i i=1 + ( ) (1 4)2 4 χ 2 (7) Referencing a standard χ 2 table shows that χ 2 (7) can be as large as with 95% probability. Hence, the null hypothesis that these values are Cauchy cannot be rejected (at a significance level of 5%). Furthermore, the corresponding p-value is , which strengthens our conclusion that the null hypothesis cannot be rejected at any reasonable levels of significance. 5 Time Series We generate X 1, X 2,..., X n satisfying the equation, X n = ρx n 1 + ǫ n.

10 6 CONCLUSION: MODELING HIGH VOLATILITY Figure simulated values of X 1,X 2,...,X n As previously discussed, the random error term, ǫ n, was generated using a Cauchy distribution with parameters: location = 1.02, scale = The plot of the 500 simulated values of X 1, X 2,..., X n can be found in Figure 5.1.Essentially, Figure 5.1 is a simulation of the AR(1) time series for the value of ρ = In each case the error terms are Cauchy random variables. The original 500 observed values from the data set can be found in Figure 5.2. To further compare Figures 5.1 and 5.2 we superimpose the two graphs. This result is shown on Figure Conclusion: Modeling High Volatility We have capitalized upon the properties of the Cauchy distribution, namely that it does not have a defined mean or variance. These characteristics are essential for the modelling of volatile data. Having such a distribution has not only become convenient, but necessary in forecasting and monitoring data sets in economics, finance and other various fields. The properties of the Cauchy distribution satisfy the requirements from the literature, which guarantee a stationary solution to the time series. We have shown that correctly identifying the distribution of the error terms, allows for the correct modelling of our data. Due to our extemely high p-value, our conclusions concerning the hypothesis test for goodness-of-fit cannot be rejected at any reasonable level of significance.

11 6 CONCLUSION: MODELING HIGH VOLATILITY Figure observed values from original dataset Figure 5.3 Simultaneous plot of observed and simulated values

12 7 BIBLIOGRAPHY 12 7 Bibliography Brockwell, Peter J. and Richard A. Davis. Time Series: Theory and Methods. New York: Springer Verlag, Chatfield, Christopher. The Analysis of Time Series: An Introduction. New York, NY: Chapman and Hall, Chung, Kai Lai. A Course in Probability Theory. New York: Academic Press, Fuller, Wayne A. Introduction To Statistical Time Series. New York: John Wiley & Sons Inc., Gunnip, Jon. Analyzing Aggregated AR(1) Processes. University of Utah: Hamilton, James D. Time Series Analysis. Princeton, NJ: Princeton University Press, Harris, Richard and Robert Sollis. Applied Time Series Modelling and Forecasting. Hoboken, NJ: John Wiley & Sons Inc., Horvath, Lajos and Remigijus Leipus. Effect of Aggregation On Estimators in AR(1) Sequence. Preprint, Williams, David. Probability with Martingales. New York, NY: Cambridge University Press, 1991.

### Analysis of Financial Time Series with EViews

Analysis of Financial Time Series with EViews Enrico Foscolo Contents 1 Asset Returns 2 1.1 Empirical Properties of Returns................. 2 2 Heteroskedasticity and Autocorrelation 4 2.1 Testing for

### A Multiplicative Seasonal Box-Jenkins Model to Nigerian Stock Prices

A Multiplicative Seasonal Box-Jenkins Model to Nigerian Stock Prices Ette Harrison Etuk Department of Mathematics/Computer Science, Rivers State University of Science and Technology, Nigeria Email: ettetuk@yahoo.com

### On the Durbin Watson statistic based on a Z-test in large samples

114 Int. J. Computational Economics and Econometrics, Vol. 6, No. 1, 2016 On the Durbin Watson statistic based on a Z-test in large samples Mei-Yu Lee Department of Applied Finance, Yuanpei University,

### Simple Linear Regression Chapter 11

Simple Linear Regression Chapter 11 Rationale Frequently decision-making situations require modeling of relationships among business variables. For instance, the amount of sale of a product may be related

### Forecasting the US Dollar / Euro Exchange rate Using ARMA Models

Forecasting the US Dollar / Euro Exchange rate Using ARMA Models LIUWEI (9906360) - 1 - ABSTRACT...3 1. INTRODUCTION...4 2. DATA ANALYSIS...5 2.1 Stationary estimation...5 2.2 Dickey-Fuller Test...6 3.

### Regression analysis in the Assistant fits a model with one continuous predictor and one continuous response and can fit two types of models:

This paper explains the research conducted by Minitab statisticians to develop the methods and data checks used in the Assistant in Minitab 17 Statistical Software. The simple regression procedure in the

### Time Series Graphs. Model ACF PACF. White Noise All zeros All zeros. AR(p) Exponential Decay P significant lags before dropping to zero

Time Series Graphs Model ACF PACF White Noise All zeros All zeros AR(p) Exponential Decay P significant lags before dropping to zero MA(q) q significant lags before dropping to zero Exponential Decay ARMA(p,q)

### TIME SERIES REGRESSION

DEPARTMENT OF POLITICAL SCIENCE AND INTERNATIONAL RELATIONS Posc/Uapp 816 TIME SERIES REGRESSION I. AGENDA: A. A couple of general considerations in analyzing time series data B. Intervention analysis

### 3.6: General Hypothesis Tests

3.6: General Hypothesis Tests The χ 2 goodness of fit tests which we introduced in the previous section were an example of a hypothesis test. In this section we now consider hypothesis tests more generally.

### Lecture Topic 6: Chapter 9 Hypothesis Testing

Lecture Topic 6: Chapter 9 Hypothesis Testing 9.1 Developing Null and Alternative Hypotheses Hypothesis testing can be used to determine whether a statement about the value of a population parameter should

### Exercise 1. 1) Using Eviews (file named return.wf1), plot the ACF and PACF function for the series returns. Identify the series.

Exercise 1 1) Using Eviews (file named return.wf1), plot the ACF and PACF function for the series returns. Identify the series. 2) Read the paper Do we really know that financial markets are efficient?

### PITFALLS IN TIME SERIES ANALYSIS. Cliff Hurvich Stern School, NYU

PITFALLS IN TIME SERIES ANALYSIS Cliff Hurvich Stern School, NYU The t -Test If x 1,..., x n are independent and identically distributed with mean 0, and n is not too small, then t = x 0 s n has a standard

### t-statistics for Weighted Means with Application to Risk Factor Models

t-statistics for Weighted Means with Application to Risk Factor Models Lisa R. Goldberg Barra, Inc. 00 Milvia St. Berkeley, CA 94704 Alec N. Kercheval Dept. of Mathematics Florida State University Tallahassee,

### Calculating Interval Forecasts

Calculating Chapter 7 (Chatfield) Monika Turyna & Thomas Hrdina Department of Economics, University of Vienna Summer Term 2009 Terminology An interval forecast consists of an upper and a lower limit between

### AP Statistics 1998 Scoring Guidelines

AP Statistics 1998 Scoring Guidelines These materials are intended for non-commercial use by AP teachers for course and exam preparation; permission for any other use must be sought from the Advanced Placement

### Robustness of the Ljung-Box Test and its Rank Equivalent

Robustness of the Test and its Rank Equivalent Patrick Burns patrick@burns-stat.com http://www.burns-stat.com This Draft: 6 October 2002 Abstract: The test is known to be robust. This paper reports on

### 2. What are the theoretical and practical consequences of autocorrelation?

Lecture 10 Serial Correlation In this lecture, you will learn the following: 1. What is the nature of autocorrelation? 2. What are the theoretical and practical consequences of autocorrelation? 3. Since

### Definition The covariance of X and Y, denoted by cov(x, Y ) is defined by. cov(x, Y ) = E(X µ 1 )(Y µ 2 ).

Correlation Regression Bivariate Normal Suppose that X and Y are r.v. s with joint density f(x y) and suppose that the means of X and Y are respectively µ 1 µ 2 and the variances are 1 2. Definition The

### Time Series Analysis

Time Series Analysis Identifying possible ARIMA models Andrés M. Alonso Carolina García-Martos Universidad Carlos III de Madrid Universidad Politécnica de Madrid June July, 2012 Alonso and García-Martos

### MINISTRY OF EDUCATION AND SCIENCE OF THE REPUBLIC OF KAZAKHSTAN SULEYMAN DEMIREL UNIVERSITY FACULTY OF ECNOMICS

MINISTRY OF EDUCATION AND SCIENCE OF THE REPUBLIC OF KAZAKHSTAN SULEYMAN DEMIREL UNIVERSITY FACULTY OF ECNOMICS CONFIRM Vice-rector on Academic Affairs Mr. Halit Yilmaz 2009 Educational Program: Baccalaureate

### Linear and Piecewise Linear Regressions

Tarigan Statistical Consulting & Coaching statistical-coaching.ch Doctoral Program in Computer Science of the Universities of Fribourg, Geneva, Lausanne, Neuchâtel, Bern and the EPFL Hands-on Data Analysis

### On Small Sample Properties of Permutation Tests: A Significance Test for Regression Models

On Small Sample Properties of Permutation Tests: A Significance Test for Regression Models Hisashi Tanizaki Graduate School of Economics Kobe University (tanizaki@kobe-u.ac.p) ABSTRACT In this paper we

### 1 Short Introduction to Time Series

ECONOMICS 7344, Spring 202 Bent E. Sørensen January 24, 202 Short Introduction to Time Series A time series is a collection of stochastic variables x,.., x t,.., x T indexed by an integer value t. The

### tests whether there is an association between the outcome variable and a predictor variable. In the Assistant, you can perform a Chi-Square Test for

This paper explains the research conducted by Minitab statisticians to develop the methods and data checks used in the Assistant in Minitab 17 Statistical Software. In practice, quality professionals sometimes

### Estimation and Inference in Cointegration Models Economics 582

Estimation and Inference in Cointegration Models Economics 582 Eric Zivot May 17, 2012 Tests for Cointegration Let the ( 1) vector Y be (1). Recall, Y is cointegrated with 0 cointegrating vectors if there

### Time Series and Forecasting

Chapter 22 Page 1 Time Series and Forecasting A time series is a sequence of observations of a random variable. Hence, it is a stochastic process. Examples include the monthly demand for a product, the

### Chapter 4: Vector Autoregressive Models

Chapter 4: Vector Autoregressive Models 1 Contents: Lehrstuhl für Department Empirische of Wirtschaftsforschung Empirical Research and und Econometrics Ökonometrie IV.1 Vector Autoregressive Models (VAR)...

### Statistics for Management II-STAT 362-Final Review

Statistics for Management II-STAT 362-Final Review Multiple Choice Identify the letter of the choice that best completes the statement or answers the question. 1. The ability of an interval estimate to

### CF4103 Financial Time Series. 1 Financial Time Series and Their Characteristics

CF4103 Financial Time Series 1 Financial Time Series and Their Characteristics Financial time series analysis is concerned with theory and practice of asset valuation over time. For example, there are

### AUTOCORRELATED RESIDUALS OF ROBUST REGRESSION

AUTOCORRELATED RESIDUALS OF ROBUST REGRESSION Jan Kalina Abstract The work is devoted to the Durbin-Watson test for robust linear regression methods. First we explain consequences of the autocorrelation

### Testing for Serial Correlation in Fixed-Effects Panel Data Models

Testing for Serial Correlation in Fixed-Effects Panel Data Models Benjamin Born Jörg Breitung In this paper, we propose three new tests for serial correlation in the disturbances of fixed-effects panel

### Is the Forward Exchange Rate a Useful Indicator of the Future Exchange Rate?

Is the Forward Exchange Rate a Useful Indicator of the Future Exchange Rate? Emily Polito, Trinity College In the past two decades, there have been many empirical studies both in support of and opposing

### ITSM-R Reference Manual

ITSM-R Reference Manual George Weigt June 5, 2015 1 Contents 1 Introduction 3 1.1 Time series analysis in a nutshell............................... 3 1.2 White Noise Variance.....................................

### Sales forecasting # 2

Sales forecasting # 2 Arthur Charpentier arthur.charpentier@univ-rennes1.fr 1 Agenda Qualitative and quantitative methods, a very general introduction Series decomposition Short versus long term forecasting

### ˆ Y i = X 1i

For the Parameter Model Y i = β 0 + β 1 X 1i + ε i It is assumed that the error vector is: ε i ~ NID(0,σ ) The errors Normally and Independently Distributed with a constant variance (σ ) throughout the

### . This specification assumes individual specific means with Ey ( ) = µ. We know from Nickell (1981) that OLS estimates of (1.1) are biased for S S

UNIT ROOT TESTS WITH PANEL DATA. Consider the AR model y = αy ( ), it it + α µ + ε i it i =,... N, t =,..., T. (.) where the ε 2 IN(0, σ ) it. This specification assumes individual specific means with

### Time Series Analysis

Time Series Analysis Autoregressive, MA and ARMA processes Andrés M. Alonso Carolina García-Martos Universidad Carlos III de Madrid Universidad Politécnica de Madrid June July, 212 Alonso and García-Martos

### The scatterplot indicates a positive linear relationship between waist size and body fat percentage:

STAT E-150 Statistical Methods Multiple Regression Three percent of a man's body is essential fat, which is necessary for a healthy body. However, too much body fat can be dangerous. For men between the

### Chapter 11: Two Variable Regression Analysis

Department of Mathematics Izmir University of Economics Week 14-15 2014-2015 In this chapter, we will focus on linear models and extend our analysis to relationships between variables, the definitions

### 4.3 Moving Average Process MA(q)

66 CHAPTER 4. STATIONARY TS MODELS 4.3 Moving Average Process MA(q) Definition 4.5. {X t } is a moving-average process of order q if X t = Z t + θ 1 Z t 1 +... + θ q Z t q, (4.9) where and θ 1,...,θ q

### Hypothesis Testing Level I Quantitative Methods. IFT Notes for the CFA exam

Hypothesis Testing 2014 Level I Quantitative Methods IFT Notes for the CFA exam Contents 1. Introduction... 3 2. Hypothesis Testing... 3 3. Hypothesis Tests Concerning the Mean... 10 4. Hypothesis Tests

### Chapter 3 RANDOM VARIATE GENERATION

Chapter 3 RANDOM VARIATE GENERATION In order to do a Monte Carlo simulation either by hand or by computer, techniques must be developed for generating values of random variables having known distributions.

### Simple Linear Regression

Inference for Regression Simple Linear Regression IPS Chapter 10.1 2009 W.H. Freeman and Company Objectives (IPS Chapter 10.1) Simple linear regression Statistical model for linear regression Estimating

### Threshold Autoregressive Models in Finance: A Comparative Approach

University of Wollongong Research Online Applied Statistics Education and Research Collaboration (ASEARC) - Conference Papers Faculty of Informatics 2011 Threshold Autoregressive Models in Finance: A Comparative

### Using Excel For Principles of Econometrics, Fourth Edition

Using Excel For Principles of Econometrics, Fourth Edition GENEVIEVE BRIAND Washington State University R. CARTER HILL Louisiana State University JOHN WILEY & SONS, INC New York / Chichester / Weinheim

### DISTRIBUTION FITTING 1

1 DISTRIBUTION FITTING What Is Distribution Fitting? Distribution fitting is the procedure of selecting a statistical distribution that best fits to a data set generated by some random process. In other

### Instrumental Variables & 2SLS

Instrumental Variables & 2SLS y 1 = β 0 + β 1 y 2 + β 2 z 1 +... β k z k + u y 2 = π 0 + π 1 z k+1 + π 2 z 1 +... π k z k + v Economics 20 - Prof. Schuetze 1 Why Use Instrumental Variables? Instrumental

### Statistiek (WISB361)

Statistiek (WISB361) Final exam June 29, 2015 Schrijf uw naam op elk in te leveren vel. Schrijf ook uw studentnummer op blad 1. The maximum number of points is 100. Points distribution: 23 20 20 20 17

### Testing for serial correlation in linear panel-data models

The Stata Journal (2003) 3, Number 2, pp. 168 177 Testing for serial correlation in linear panel-data models David M. Drukker Stata Corporation Abstract. Because serial correlation in linear panel-data

### where b is the slope of the line and a is the intercept i.e. where the line cuts the y axis.

Least Squares Introduction We have mentioned that one should not always conclude that because two variables are correlated that one variable is causing the other to behave a certain way. However, sometimes

### Inferential Statistics

Inferential Statistics Sampling and the normal distribution Z-scores Confidence levels and intervals Hypothesis testing Commonly used statistical methods Inferential Statistics Descriptive statistics are

### 7. Autocorrelation (Violation of Assumption #B3)

7. Autocorrelation (Violation of Assumption #B3) Assumption #B3: The error term u i is not autocorrelated, i.e. Cov(u i, u j ) = 0 for all i = 1,..., N and j = 1,..., N where i j Where do we typically

### Testing for the Benford Property

Testing for the Benford Property Daniel P. Pike School of Mathematical Sciences, Rochester Institute of Technology, 85 Lomb Memorial Drive, Rochester, New York 14623 6627 USA. E-mail: dpp1382@rit.edu Sponsor

### Study & Development of Short Term Load Forecasting Models Using Stochastic Time Series Analysis

International Journal of Engineering Research and Development e-issn: 2278-067X, p-issn: 2278-800X, www.ijerd.com Volume 9, Issue 11 (February 2014), PP. 31-36 Study & Development of Short Term Load Forecasting

### TIME SERIES ANALYSIS

TIME SERIES ANALYSIS Ramasubramanian V. I.A.S.R.I., Library Avenue, New Delhi- 110 012 ram_stat@yahoo.co.in 1. Introduction A Time Series (TS) is a sequence of observations ordered in time. Mostly these

### Monte Carlo Method: Probability

John (ARC/ICAM) Virginia Tech... Math/CS 4414: The Monte Carlo Method: PROBABILITY http://people.sc.fsu.edu/ jburkardt/presentations/ monte carlo probability.pdf... ARC: Advanced Research Computing ICAM:

### Short Term Load Forecasting Using Time Series Analysis: A Case Study for Karnataka, India

ISO 91:28 Certified Volume 1, Issue 2, November 212 Short Term Load Forecasting Using Time Series Analysis: A Case Study for Karnataka, India Nataraja.C 1, M.B.Gorawar 2, Shilpa.G.N. 3, Shri Harsha.J.

### Forecasting Geographic Data Michael Leonard and Renee Samy, SAS Institute Inc. Cary, NC, USA

Forecasting Geographic Data Michael Leonard and Renee Samy, SAS Institute Inc. Cary, NC, USA Abstract Virtually all businesses collect and use data that are associated with geographic locations, whether

### Inference in Regression Analysis. Dr. Frank Wood

Inference in Regression Analysis Dr. Frank Wood Inference in the Normal Error Regression Model Y i = β 0 + β 1 X i + ɛ i Y i value of the response variable in the i th trial β 0 and β 1 are parameters

### fifty Fathoms Statistics Demonstrations for Deeper Understanding Tim Erickson

fifty Fathoms Statistics Demonstrations for Deeper Understanding Tim Erickson Contents What Are These Demos About? How to Use These Demos If This Is Your First Time Using Fathom Tutorial: An Extended Example

### ANALYTICAL MATHEMATICS FOR APPLICATIONS 2016 LECTURE NOTES Series

ANALYTICAL MATHEMATICS FOR APPLICATIONS 206 LECTURE NOTES 8 ISSUED 24 APRIL 206 A series is a formal sum. Series a + a 2 + a 3 + + + where { } is a sequence of real numbers. Here formal means that we don

### Market Risk: FROM VALUE AT RISK TO STRESS TESTING. Agenda. Agenda (Cont.) Traditional Measures of Market Risk

Market Risk: FROM VALUE AT RISK TO STRESS TESTING Agenda The Notional Amount Approach Price Sensitivity Measure for Derivatives Weakness of the Greek Measure Define Value at Risk 1 Day to VaR to 10 Day

### Sampling Distribution of a Normal Variable

Ismor Fischer, 5/9/01 5.-1 5. Formal Statement and Examples Comments: Sampling Distribution of a Normal Variable Given a random variable. Suppose that the population distribution of is known to be normal,

### The Delta Method and Applications

Chapter 5 The Delta Method and Applications 5.1 Linear approximations of functions In the simplest form of the central limit theorem, Theorem 4.18, we consider a sequence X 1, X,... of independent and

### Time Series - ARIMA Models. Instructor: G. William Schwert

APS 425 Fall 25 Time Series : ARIMA Models Instructor: G. William Schwert 585-275-247 schwert@schwert.ssb.rochester.edu Topics Typical time series plot Pattern recognition in auto and partial autocorrelations

### Lecture 15: Time Series Modeling Steven Skiena. skiena

Lecture 15: Time Series Modeling Steven Skiena Department of Computer Science State University of New York Stony Brook, NY 11794 4400 http://www.cs.sunysb.edu/ skiena Modeling and Forecasting We seek to

### The purpose of this section is to derive the asymptotic distribution of the Pearson chi-square statistic. k (n j np j ) 2. np j.

Chapter 7 Pearson s chi-square test 7. Null hypothesis asymptotics Let X, X 2, be independent from a multinomial(, p) distribution, where p is a k-vector with nonnegative entries that sum to one. That

### SUBMODELS (NESTED MODELS) AND ANALYSIS OF VARIANCE OF REGRESSION MODELS

1 SUBMODELS (NESTED MODELS) AND ANALYSIS OF VARIANCE OF REGRESSION MODELS We will assume we have data (x 1, y 1 ), (x 2, y 2 ),, (x n, y n ) and make the usual assumptions of independence and normality.

### Financial Time Series Analysis (FTSA) Lecture 1: Introduction

Financial Time Series Analysis (FTSA) Lecture 1: Introduction Brief History of Time Series Analysis Statistical analysis of time series data (Yule, 1927) v/s forecasting (even longer). Forecasting is often

### Financial TIme Series Analysis: Part II

Department of Mathematics and Statistics, University of Vaasa, Finland January 29 February 13, 2015 Feb 14, 2015 1 Univariate linear stochastic models: further topics Unobserved component model Signal

### Introduction to Regression and Data Analysis

Statlab Workshop Introduction to Regression and Data Analysis with Dan Campbell and Sherlock Campbell October 28, 2008 I. The basics A. Types of variables Your variables may take several forms, and it

### 7. Tests of association and Linear Regression

7. Tests of association and Linear Regression In this chapter we consider 1. Tests of Association for 2 qualitative variables. 2. Measures of the strength of linear association between 2 quantitative variables.

### Analysis and Computation for Finance Time Series - An Introduction

ECMM703 Analysis and Computation for Finance Time Series - An Introduction Alejandra González Harrison 161 Email: mag208@exeter.ac.uk Time Series - An Introduction A time series is a sequence of observations

### Statistics revision. Dr. Inna Namestnikova. Statistics revision p. 1/8

Statistics revision Dr. Inna Namestnikova inna.namestnikova@brunel.ac.uk Statistics revision p. 1/8 Introduction Statistics is the science of collecting, analyzing and drawing conclusions from data. Statistics

### 2 Testing under Normality Assumption

1 Hypothesis testing A statistical test is a method of making a decision about one hypothesis (the null hypothesis in comparison with another one (the alternative using a sample of observations of known

### PROBABILITY AND STATISTICS. Ma 527. 1. To teach a knowledge of combinatorial reasoning.

PROBABILITY AND STATISTICS Ma 527 Course Description Prefaced by a study of the foundations of probability and statistics, this course is an extension of the elements of probability and statistics introduced

### E205 Final: Version B

Name: Class: Date: E205 Final: Version B Multiple Choice Identify the choice that best completes the statement or answers the question. 1. The owner of a local nightclub has recently surveyed a random

### Fairfield Public Schools

Mathematics Fairfield Public Schools AP Statistics AP Statistics BOE Approved 04/08/2014 1 AP STATISTICS Critical Areas of Focus AP Statistics is a rigorous course that offers advanced students an opportunity

### Time Series Analysis

JUNE 2012 Time Series Analysis CONTENT A time series is a chronological sequence of observations on a particular variable. Usually the observations are taken at regular intervals (days, months, years),

### Time Series Analysis: Basic Forecasting.

Time Series Analysis: Basic Forecasting. As published in Benchmarks RSS Matters, April 2015 http://web3.unt.edu/benchmarks/issues/2015/04/rss-matters Jon Starkweather, PhD 1 Jon Starkweather, PhD jonathan.starkweather@unt.edu

### Wording of Final Conclusion. Slide 1

Wording of Final Conclusion Slide 1 8.3: Assumptions for Testing Slide 2 Claims About Population Means 1) The sample is a simple random sample. 2) The value of the population standard deviation σ is known

### Test of Hypotheses. Since the Neyman-Pearson approach involves two statistical hypotheses, one has to decide which one

Test of Hypotheses Hypothesis, Test Statistic, and Rejection Region Imagine that you play a repeated Bernoulli game: you win \$1 if head and lose \$1 if tail. After 10 plays, you lost \$2 in net (4 heads

### ECONOMETICS FOR THE UNINITIATED. by D.S.G. POLLOCK University of Leicester

1 ECONOMETICS FOR THE UNINITIATED by D.S.G. POLLOCK University of Leicester This lecture can be supplemented by the texts that are available at the following website, where each of the topics is pursued

### The Chi-Square Distributions

MATH 183 The Chi-Square Distributions Dr. Neal, WKU The chi-square distributions can be used in statistics to analyze the standard deviation " of a normally distributed measurement and to test the goodness

### Hypothesis Testing in the Classical Regression Model

LECTURE 5 Hypothesis Testing in the Classical Regression Model The Normal Distribution and the Sampling Distributions It is often appropriate to assume that the elements of the disturbance vector ε within

### ELEC-E8104 Stochastics models and estimation, Lecture 3b: Linear Estimation in Static Systems

Stochastics models and estimation, Lecture 3b: Linear Estimation in Static Systems Minimum Mean Square Error (MMSE) MMSE estimation of Gaussian random vectors Linear MMSE estimator for arbitrarily distributed

### Bonds historical simulation value at risk

Bonds historical simulation value at risk J. Beleza Sousa, M. L. Esquível, R. M. Gaspar, P. C. Real February 29, 2012 Abstract Bonds historical returns can not be used directly to compute VaR by historical

### The Modified Kolmogorov-Smirnov One-Sample Test Statistic

Thailand Statistician July 00; 8() : 43-55 http://statassoc.or.th Contributed paper The Modified Kolmogorov-Smirnov One-Sample Test Statistic Jantra Sukkasem epartment of Mathematics, Faculty of Science,

### Estimating an ARMA Process

Statistics 910, #12 1 Overview Estimating an ARMA Process 1. Main ideas 2. Fitting autoregressions 3. Fitting with moving average components 4. Standard errors 5. Examples 6. Appendix: Simple estimators

### Chapter 7 Part 2. Hypothesis testing Power

Chapter 7 Part 2 Hypothesis testing Power November 6, 2008 All of the normal curves in this handout are sampling distributions Goal: To understand the process of hypothesis testing and the relationship

### THE UNIVERSITY OF CHICAGO, Booth School of Business Business 41202, Spring Quarter 2014, Mr. Ruey S. Tsay. Solutions to Homework Assignment #2

THE UNIVERSITY OF CHICAGO, Booth School of Business Business 41202, Spring Quarter 2014, Mr. Ruey S. Tsay Solutions to Homework Assignment #2 Assignment: 1. Consumer Sentiment of the University of Michigan.

### 1. The Classical Linear Regression Model: The Bivariate Case

Business School, Brunel University MSc. EC5501/5509 Modelling Financial Decisions and Markets/Introduction to Quantitative Methods Prof. Menelaos Karanasos (Room SS69, Tel. 018956584) Lecture Notes 3 1.

### OPTIMIZATION AND OPERATIONS RESEARCH Vol. IV - Markov Decision Processes - Ulrich Rieder

MARKOV DECISIO PROCESSES Ulrich Rieder University of Ulm, Germany Keywords: Markov decision problem, stochastic dynamic program, total reward criteria, average reward, optimal policy, optimality equation,

### AP Statistics: Syllabus 3

AP Statistics: Syllabus 3 Scoring Components SC1 The course provides instruction in exploring data. 4 SC2 The course provides instruction in sampling. 5 SC3 The course provides instruction in experimentation.

EC151.02 Statistics for Business and Economics (MWF 8:00-8:50) Instructor: Chiu Yu Ko Office: 462D, 21 Campenalla Way Phone: 2-6093 Email: kocb@bc.edu Office Hours: by appointment Description This course

### CHAPTER 14 NONPARAMETRIC TESTS

CHAPTER 14 NONPARAMETRIC TESTS Everything that we have done up until now in statistics has relied heavily on one major fact: that our data is normally distributed. We have been able to make inferences

### Univariate and Multivariate Methods PEARSON. Addison Wesley

Time Series Analysis Univariate and Multivariate Methods SECOND EDITION William W. S. Wei Department of Statistics The Fox School of Business and Management Temple University PEARSON Addison Wesley Boston