Nowcasting with Dynamic Data Masking and Regularized Regression
|
|
|
- Reginald Sparks
- 9 years ago
- Views:
Transcription
1 Nowcasting with Dynamic Data Masking and Regularized Regression Erik Alpkvist 1 Jonas Hallgren 2 Timo Koski 2 Johannes Siven 1 Ard den Reijer 4 1 GSA Capital London, UK Corresponding and presenting author 2 KTH, Royal Institute of Technology Stockholm, Sweden 4 Sveriges Riksbank (Central Bank of Sweden) Stockholm, Sweden CFE 2015 Dec 12, 2015, University of London 1 / 22
2 In nowcasting, one wants to forecast a low frequency time series, y, using observations of several higher frequency time series, Z. A typical setting is: y quarterly real GDP growth. Z a broad cross section of higher frequency economic indicators (e.g. weekly and monthly.) Task: Find E[y N Z t ]. 2 / 22
3 5 4 3 US GDP QoQ Nonfarm payrolls Chicago Purchasing Manager Durable Goods Orders 2 Standardzied observations Time 3 / 22
4 DATA Release time stamps are essential. ALFRED is used in the study. 4 / 22
5 MODELS Models are on the form We seek the projections F. y N = w T F(Z t ) + ɛ = w T X + ɛ. Two popular approaches: MIDAS-type and Dynamic Linear Factor models (DLM). The suggested approach is related to MIDAS. 5 / 22
6 MIDAS Mixed-data sampling (MIDAS) 1 projects the time series onto each quarter F MIDAS (Z t ) = X MIDAS t by e.g. averaging the values. The prediction is ŷ N t = w T X MIDAS t. Fine for historical regression. Forecasting is more difficult due to the ragged edge problem. 1 Ghysels et al. (2004) 6 / 22
7 MIDAS Z N 2 X N 2 y N 2 Z N 1 X N 1 y N 1 Z t X N y N 7 / 22
8 DYNAMIC MASKING Z N 2 Z M t N 2 X N 2 y N 2 Z N 1 Z M t N 1 X N 1 y N 1 Z t X N y N 8 / 22
9 DYNAMIC MASKING Simple idea: Construct regression features dynamically. Similar to MIDAS but the ragged edge problem disappears! Features are constructed for immediate use. The model is updated when data is updated. In both DLM and MIDAS the model is constant throughout the quarter and only data is updated. 9 / 22
10 ALGORITHM 1. Find shape of the data available today. 2. Mask out unavailable data from old data-vintages. 3. Use MIDAS-type projection of masked data onto each quarter. 4. Regress on the masked data to get w. 5. Predict: ŷ N t = w T F Mask t 10 / 22
11 ALGORITHM 1. Find shape of the data available today. 2. Mask out unavailable data from old data-vintages. 3. Use MIDAS-type projection of masked data onto each quarter. 4. Regress on the masked data to get w. 5. Predict: ŷ N t = w T F Mask t = w T X Mask t. 11 / 22
12 TIME t Z N 2 Z M t N 2 X N 2 y N 2 Z N 1 Z M t N 1 X N 1 y N 1 Z t X N y N 12 / 22
13 TIME t + 1 Z N 2 Z M t+1 N 2 X N 2 y N 2 Z N 1 Z M t+1 N 1 X N 1 y N 1 Z t+1 X N y N 13 / 22
14 Why Masking? 14 / 22
15 Why Masking? Theoretical motivation Flexible and easy in implementation Good results 15 / 22
16 Time t Time t + 1 GDP N 1 NFPAY N 1 GDP N 1 NFPAY N 1 GDP N NFPAY N GDP N NFPAY N USD EUR t USD EUR t+1 p θ (GDP N NFPAY N 1, USD EUR t ) p θ(gdp N NFPAY N ) In general: θ θ! 16 / 22
17 METHODS Given X Mask we predict ŷ = w T Φ(X Mask ). Regression: Φ is the identity and the estimates are w OLS arg min w y w T F Mask 2, w Ridge arg min w y w T F Mask 2 + λ w 2. Neural Network ŷ = w T Φ NN (X Mask ) = M w k h(θk T XMask ), k=1 where h is the activation function. Kernel methods predict using training data: Φ Kernel (X Mask ) = k(x Mask, X Mask Train ). 17 / 22
18 US GDP Masked Ridge Factor model Masked NN Ridge 0.58 RMSE Fraction of quarter 18 / 22
19 WHY MASKING? Theoretical motivation Flexible and easy in implementation Good results 19 / 22
20 Any remark, question or suggestion is welcomed! jhallg/ 20 / 22
21 REFERENCES Doz, Catherine and Giannone, Domenico and Reichlin, Lucrezia A two-step estimator for large approximate dynamic factor models based on Kalman filtering. Journal of Econometrics, 164(1):, , Kees E Bouwman and Jan PAM Jacobs. Forecasting with real-time macroeconomic data: the ragged-edge problem and revisions. Journal of Macroeconomics, 33(4): , Eric Ghysels, Pedro Santa-Clara, and Rossen Valkanov. The MIDAS touch: Mixed data sampling regression models. Finance, Kenneth F Wallis. Forecasting with an econometric model: The ragged edge problem. Journal of Forecasting, 5(1):1 13, / 22
22 RAGGED EDGE 3 1,6 are published with lags. 2,3,5 are preliminary. 4 is given: interest rate. Revision can take time: In 2004 US revised the money supply (M2) series from January 1959 onwards 2! 2 Bouwman and Jacobs (2011) 3 Wallis (1986) 22 / 22
Nominal GDP now-casting
Nominal GDP now-casting Michele Modugno, ECARES Lucrezia Reichlin, London Business School and CEPR Frontiers of Macroeconometrics Bank of England, UCL and cemmap workshop 25 and 26 April 2013 Motivation
Big data in macroeconomics Lucrezia Reichlin London Business School and now-casting economics ltd. COEURE workshop Brussels 3-4 July 2015
Big data in macroeconomics Lucrezia Reichlin London Business School and now-casting economics ltd COEURE workshop Brussels 3-4 July 2015 WHAT IS BIG DATA IN ECONOMICS? Frank Diebold claimed to have introduced
Introduction: Overview of Kernel Methods
Introduction: Overview of Kernel Methods Statistical Data Analysis with Positive Definite Kernels Kenji Fukumizu Institute of Statistical Mathematics, ROIS Department of Statistical Science, Graduate University
Introduction to Support Vector Machines. Colin Campbell, Bristol University
Introduction to Support Vector Machines Colin Campbell, Bristol University 1 Outline of talk. Part 1. An Introduction to SVMs 1.1. SVMs for binary classification. 1.2. Soft margins and multi-class classification.
Topics in Time Series Analysis
Topics in Time Series Analysis Massimiliano Marcellino EUI and Bocconi University This course reviews some recent developments in the analysis of time series data in economics, with a special emphasis
Nowcasting US GDP: The role of ISM Business Surveys
Nowcasting US GDP: The role of ISM Business Surveys Kajal Lahiri George Monokroussos Department of Economics - University at Albany, SUNY y November 2011 Abstract We study the role of the well-known monthly
Forecasting Retail Credit Market Conditions
Forecasting Retail Credit Market Conditions Eric McVittie Experian Experian and the marks used herein are service marks or registered trademarks of Experian Limited. Other products and company names mentioned
Testing for Granger causality between stock prices and economic growth
MPRA Munich Personal RePEc Archive Testing for Granger causality between stock prices and economic growth Pasquale Foresti 2006 Online at http://mpra.ub.uni-muenchen.de/2962/ MPRA Paper No. 2962, posted
The use of projections and forecasts in the ECB s monetary policy
The use of projections and forecasts in the ECB s monetary policy AIECE Conference, Brussels 6 November 2007 Hans-Joachim Klöckers Director Economic Developments ECB The views expressed in this presentation
Does global liquidity help to forecast US inflation?
MPRA Munich Personal RePEc Archive Does global liquidity help to forecast US inflation? A D Agostino and P Surico Central Bank and Financial Services Authority of Ireland, Bank of England November 2007
Statistics Paper Series
Statistics Paper Series John W. Galbraith and Greg Tkacz Nowcasting GDP with electronic payments data No 10 / 2015 Note: This Statistics Paper should not be reported as representing the views of the European
Forecasting of Economic Quantities using Fuzzy Autoregressive Model and Fuzzy Neural Network
Forecasting of Economic Quantities using Fuzzy Autoregressive Model and Fuzzy Neural Network Dušan Marček 1 Abstract Most models for the time series of stock prices have centered on autoregressive (AR)
(Arbitrage-Free, Practical) Modeling of Term Structures of Government Bond Yields
(Arbitrage-Free, Practical) Modeling of Term Structures of Government Bond Yields Background Diebold and Li (2006), Forecasting the Term Structure of Government Bond Yields, J. Econometrics. Diebold, Rudebusch
Economic Outlook: Middle-Class Families Find Little Relief from Stagnant Wages and Rising Prices
Economic Outlook: Middle-Class Families Find Little Relief from Stagnant Wages and Rising Prices The first half of 2005 was hard on middle-class families. As wage and employment growth trends remain at
Rob J Hyndman. Forecasting using. 11. Dynamic regression OTexts.com/fpp/9/1/ Forecasting using R 1
Rob J Hyndman Forecasting using 11. Dynamic regression OTexts.com/fpp/9/1/ Forecasting using R 1 Outline 1 Regression with ARIMA errors 2 Example: Japanese cars 3 Using Fourier terms for seasonality 4
11. Time series and dynamic linear models
11. Time series and dynamic linear models Objective To introduce the Bayesian approach to the modeling and forecasting of time series. Recommended reading West, M. and Harrison, J. (1997). models, (2 nd
The economic situation and monetary policy
The economic situation and monetary policy Statistics Sweden 6 October 14 Deputy Governor Per Jansson Topics I will discuss today Recent monetary policy (including the most recent decision on 3 September)
Forecasting at the Ministry of Finance
Forecasting at the Ministry of Finance Åsa Andersson, PhD Senior Advisor, Division for Public Finances Anna Breman, PhD Deputy Director, Forecasting Division Welcome to the Ministry of Finance Outline
Macroeconomic drivers of private health insurance coverage. nib Health Insurance
Macroeconomic drivers of private health insurance coverage nib Health Insurance 1 September 2011 Contents Executive Summary...i 1 Methodology and modelling results... 2 2 Forecasts... 6 References... 8
Forecasting industrial production: the role of information and methods
Forecasting industrial production: the role of information and methods Guido Bulligan, 1 Roberto Golinelli 2 and Giuseppe Parigi 3 1. Introduction One of the main tasks of the economy watcher is to extract
Observing the Changing Relationship Between Natural Gas Prices and Power Prices
Observing the Changing Relationship Between Natural Gas Prices and Power Prices The research views expressed herein are those of the author and do not necessarily represent the views of the CME Group or
ROYAL LONDON ABSOLUTE RETURN GOVERNMENT BOND FUND
ROYAL LONDON ABSOLUTE RETURN GOVERNMENT BOND FUND For professional investors only A NEW OPPORTUNITY Absolute return funds offer an attractive, alternative source of alpha outright or as part of a balanced
Corporate Defaults and Large Macroeconomic Shocks
Corporate Defaults and Large Macroeconomic Shocks Mathias Drehmann Bank of England Andrew Patton London School of Economics and Bank of England Steffen Sorensen Bank of England The presentation expresses
Java Modules for Time Series Analysis
Java Modules for Time Series Analysis Agenda Clustering Non-normal distributions Multifactor modeling Implied ratings Time series prediction 1. Clustering + Cluster 1 Synthetic Clustering + Time series
Chapter 1. Vector autoregressions. 1.1 VARs and the identi cation problem
Chapter Vector autoregressions We begin by taking a look at the data of macroeconomics. A way to summarize the dynamics of macroeconomic data is to make use of vector autoregressions. VAR models have become
The Effects of the Current Economic Conditions on Sport Participation. Chris Gratton and Themis Kokolakakis
The Effects of the Current Economic Conditions on Sport Participation Chris Gratton and Themis Kokolakakis Sport Industry Research Centre Sheffield Hallam University A118 Collegiate Hall Sheffield S10
SHORT-TERM FORECASTING OF INDIRECT TAX REVENUES: AN APPLICATION FOR PORTUGAL*
SHORT-TERM FORECASTING OF INDIRECT TAX REVENUES: AN APPLICATION FOR PORTUGAL* 49 Paulo Soares Esteves ** Cláudia Rodrigues Braz*** Articles Abstract In recent times the prompt assessment of the evolution
Long-term Stock Market Forecasting using Gaussian Processes
Long-term Stock Market Forecasting using Gaussian Processes 1 2 3 4 Anonymous Author(s) Affiliation Address email 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35
Impulse Response Functions
Impulse Response Functions Wouter J. Den Haan University of Amsterdam April 28, 2011 General definition IRFs The IRF gives the j th -period response when the system is shocked by a one-standard-deviation
Economic Data Release Calendar May 29, 2016 - June 3, 2016
Economic Data Release Calendar May 29, 2016 - June 3, 2016 www.dailyfx.com [email protected] AUD 1.75% NZD 2.25% EUR 0.00% CAD 0.50% GBP 0.50% USD 0.50% CHF -0.75% JPY -0.10% Date Currency Event GMT
Should we Really Care about Building Business. Cycle Coincident Indexes!
Should we Really Care about Building Business Cycle Coincident Indexes! Alain Hecq University of Maastricht The Netherlands August 2, 2004 Abstract Quite often, the goal of the game when developing new
Big Data Analytics CSCI 4030
High dim. data Graph data Infinite data Machine learning Apps Locality sensitive hashing PageRank, SimRank Filtering data streams SVM Recommen der systems Clustering Community Detection Web advertising
Methodology For Illinois Electric Customers and Sales Forecasts: 2016-2025
Methodology For Illinois Electric Customers and Sales Forecasts: 2016-2025 In December 2014, an electric rate case was finalized in MEC s Illinois service territory. As a result of the implementation of
Introduction to Time Series Analysis and Forecasting. 2nd Edition. Wiley Series in Probability and Statistics
Brochure More information from http://www.researchandmarkets.com/reports/3024948/ Introduction to Time Series Analysis and Forecasting. 2nd Edition. Wiley Series in Probability and Statistics Description:
Option Valuation Using Intraday Data
Option Valuation Using Intraday Data Peter Christoffersen Rotman School of Management, University of Toronto, Copenhagen Business School, and CREATES, University of Aarhus 2nd Lecture on Thursday 1 Model
Ron Shaham. Expert Witness in Islamic Courts : Medicine and Crafts in the Service of Law. : University of Chicago Press,. p 38
: University of Chicago Press,. p 38 http://site.ebrary.com/id/10381149?ppg=38 : University of Chicago Press,. p 39 http://site.ebrary.com/id/10381149?ppg=39 : University of Chicago Press,. p 40 http://site.ebrary.com/id/10381149?ppg=40
. Perspectives on the Economics of Aging. : University of Chicago Press,. p 3 http://site.ebrary.com/id/10209979?ppg=3 Copyright University of
: University of Chicago Press,. p 3 http://site.ebrary.com/id/10209979?ppg=3 : University of Chicago Press,. p 4 http://site.ebrary.com/id/10209979?ppg=4 : University of Chicago Press,. p 297 http://site.ebrary.com/id/10209979?ppg=297
May not be reproduced in any form without permission from the publisher, except fair uses permitted under U.S. or applicable copyright law.
: University of Chicago Press,. p 24 http://site.ebrary.com/id/10292358?ppg=24 : University of Chicago Press,. p 25 http://site.ebrary.com/id/10292358?ppg=25 : University of Chicago Press,. p 26 http://site.ebrary.com/id/10292358?ppg=26
Linear regression methods for large n and streaming data
Linear regression methods for large n and streaming data Large n and small or moderate p is a fairly simple problem. The sufficient statistic for β in OLS (and ridge) is: The concept of sufficiency is
The Use of Ever Increasing Datasets in Macroeconomic Forecasting
The Use of Ever Increasing Datasets in Macroeconomic Forecasting Prof. Dr. Jan-Egbert Sturm 12. Juni 215 Macroeconomic Forecasting Methods Indicator approach Business tendency surveys Buildings permits
Regularized Logistic Regression for Mind Reading with Parallel Validation
Regularized Logistic Regression for Mind Reading with Parallel Validation Heikki Huttunen, Jukka-Pekka Kauppi, Jussi Tohka Tampere University of Technology Department of Signal Processing Tampere, Finland
Stock Market Liquidity and the Business Cycle
Stock Market Liquidity and the Business Cycle Forthcoming, Journal of Finance Randi Næs a Johannes Skjeltorp b Bernt Arne Ødegaard b,c Jun 2010 a: Ministry of Trade and Industry b: Norges Bank c: University
Plan Design Information Form BUSINESS INFORMATION
T (801) 224-1900 F (801) 224-1930 W hawkinsretirement.com Plan Design Information Form BUSINESS INFORMATION Referred by: Phone: Employer Legal Name: dba: Primary Contact: Phone: Fax: Email: Employer Tax
The European Central Bank s Minimum Bid Rate and Its Effect on Major Currency Pairs
The European Central Bank s Minimum Bid Rate and Its Effect on Major Currency Pairs Ikhlaas Gurrib Abstract The paper looks at the effects of Minimum Bid Rate on three major currency pairs namely the Australian
Sales forecasting # 2
Sales forecasting # 2 Arthur Charpentier [email protected] 1 Agenda Qualitative and quantitative methods, a very general introduction Series decomposition Short versus long term forecasting
SchedulAir. Airline planning & airline scheduling with Unified Optimization. decisal. Copyright 2014 Decisal Ltd. All rights reserved.
Copyright 2014 Decisal Ltd. All rights reserved. Airline planning & airline scheduling with Unified Optimization SchedulAir Overview Unified Optimization Benders decomposition Airline planning & scheduling
Moving averages. Rob J Hyndman. November 8, 2009
Moving averages Rob J Hyndman November 8, 009 A moving average is a time series constructed by taking averages of several sequential values of another time series. It is a type of mathematical convolution.
How To Consistently Make $900 - $9,000 in 48 Hours or Less
Forex & Gold Trading Bootcamp Break-Out Session How To Consistently Make $900 - $9,000 in 48 Hours or Less CHEAT & ACTIVITY SHEET MARK SO (THE HANDSOMEST FOREX TRADER THAT EVER EXISTED ;-) MARK SO (THE
Event driven trading new studies on innovative way. of trading in Forex market. Michał Osmoła INIME live 23 February 2016
Event driven trading new studies on innovative way of trading in Forex market Michał Osmoła INIME live 23 February 2016 Forex market From Wikipedia: The foreign exchange market (Forex, FX, or currency
Finance and Economics Discussion Series Divisions of Research & Statistics and Monetary Affairs Federal Reserve Board, Washington, D.C.
Finance and Economics Discussion Series Divisions of Research & Statistics and Monetary Affairs Federal Reserve Board, Washington, D.C. A Global Trade Model for the Euro Area Antonello D Agostino, Michele
Follow links Class Use and other Permissions. For more information, send email to: [email protected]
COPYRIGHT NOTICE: David A. Kendrick, P. Ruben Mercado, and Hans M. Amman: Computational Economics is published by Princeton University Press and copyrighted, 2006, by Princeton University Press. All rights
Support Vector Machines with Clustering for Training with Very Large Datasets
Support Vector Machines with Clustering for Training with Very Large Datasets Theodoros Evgeniou Technology Management INSEAD Bd de Constance, Fontainebleau 77300, France [email protected] Massimiliano
Yangon, Myanmar February 16 27, 2015. Jan Gottschalk. IMF-TAOLAM training activities are supported by funding of the Government of Japan
Refresher on Real Sector &G Generating a first GDP Forecast Financial Programming and Policies Yangon, Myanmar February 16 27, 2015 Jan Gottschalk TAOLAM IMF-TAOLAM training activities are supported by
Introduction to Machine Learning Lecture 1. Mehryar Mohri Courant Institute and Google Research [email protected]
Introduction to Machine Learning Lecture 1 Mehryar Mohri Courant Institute and Google Research [email protected] Introduction Logistics Prerequisites: basics concepts needed in probability and statistics
Lasso on Categorical Data
Lasso on Categorical Data Yunjin Choi, Rina Park, Michael Seo December 14, 2012 1 Introduction In social science studies, the variables of interest are often categorical, such as race, gender, and nationality.
Big Data, Socio- Psychological Theory, Algorithmic Text Analysis, and Predicting the Michigan Consumer Sentiment Index
Big Data, Socio- Psychological Theory, Algorithmic Text Analysis, and Predicting the Michigan Consumer Sentiment Index Rickard Nyman *, Paul Ormerod Centre for the Study of Decision Making Under Uncertainty,
The U.S. Presidency and the Stock Market: A political relationship study of the market performance
1 The U.S. Presidency and the Stock Market: A political relationship study of the market performance ABSTRACT Ray M. Valadez Pepperdine University With the presidential election taking shape this year
GLAM Array Methods in Statistics
GLAM Array Methods in Statistics Iain Currie Heriot Watt University A Generalized Linear Array Model is a low-storage, high-speed, GLAM method for multidimensional smoothing, when data forms an array,
Week 2: Exponential Functions
Week 2: Exponential Functions Goals: Introduce exponential functions Study the compounded interest and introduce the number e Suggested Textbook Readings: Chapter 4: 4.1, and Chapter 5: 5.1. Practice Problems:
Government of Russian Federation. Faculty of Computer Science School of Data Analysis and Artificial Intelligence
Government of Russian Federation Federal State Autonomous Educational Institution of High Professional Education National Research University «Higher School of Economics» Faculty of Computer Science School
Introduction on monetary policy
Introduction on monetary policy Riksdag Committee on Finance 6 March Governor Stefan Ingves Today's presentation The Swedish economy and monetary policy - where are we heading? The Swedish economy has
Economic Forecast OUTPUT AND EMPLOYMENT WHAT THE TABLE SHOWS:
Economic Forecast OUTPUT AND EMPLOYMENT 7 8 9 1 11 1 13 1 United States Real GDP $ billions (fourth quarter) $1,996 $1,575 $1,5 $1,9 $15, $15,5 $15,97 $16,6 % change over the four quarters 1.9% -.8% -.%.8%.%.%.%
n Economic Commentaries
n Economic Commentaries In recent years, the analysis of household indebtedness has been based on aggregate data or random samples of new borrowers. It is not possible to analyse the allocation of debt
Chapter 10: Basic Linear Unobserved Effects Panel Data. Models:
Chapter 10: Basic Linear Unobserved Effects Panel Data Models: Microeconomic Econometrics I Spring 2010 10.1 Motivation: The Omitted Variables Problem We are interested in the partial effects of the observable
Analyzing the Effect of Change in Money Supply on Stock Prices
72 Analyzing the Effect of Change in Money Supply on Stock Prices I. Introduction Billions of dollars worth of shares are traded in the stock market on a daily basis. Many people depend on the stock market
Oil and Natural Gas Analysis at Norges Bank. Pål Winje ( International Department), workshop on modeling and forecasting oil prices, 22 March 2012
Oil and Natural Gas Analysis at Norges Bank Pål Winje ( International Department), workshop on modeling and forecasting oil prices, 22 March 212 The Norwegian Petroleum Sector as a Share of Macroeconomic
Investment based on Merrill Lynch Investment Cycle
Investment based on Merrill Lynch Investment Cycle Tiantian Li Faculty Advisor: David Aldous Date: Dec 10 th 2014 First Draft Introduction Trevor Greetham, a former Asset Allocation Director at Fidelity,
Erik Hjalmarsson Last updated: 2015-10-20
Erik Hjalmarsson Last updated: 2015-10-20 Queen Mary University of London University of Gothenburg School of Economics and Finance Department of Economics Mile End Road P.O. Box 640 London E1 4NS, UK SE
2. Descriptive statistics in EViews
2. Descriptive statistics in EViews Features of EViews: Data processing (importing, editing, handling, exporting data) Basic statistical tools (descriptive statistics, inference, graphical tools) Regression
Adaptive Demand-Forecasting Approach based on Principal Components Time-series an application of data-mining technique to detection of market movement
Adaptive Demand-Forecasting Approach based on Principal Components Time-series an application of data-mining technique to detection of market movement Toshio Sugihara Abstract In this study, an adaptive
Traffic Management Systems with Air Quality Monitoring Feedback. Phil Govier City & County of Swansea
Traffic Management Systems with Air Quality Monitoring Feedback Phil Govier City & County of Swansea The Swansea Project - what are we trying to achieve? Develop a working traffic emissions forecast model
Towards running complex models on big data
Towards running complex models on big data Working with all the genomes in the world without changing the model (too much) Daniel Lawson Heilbronn Institute, University of Bristol 2013 1 / 17 Motivation
