EVALUATION OF MAXIMUM LIKELIHOOD ENSEMBLE FILTER FOR REAL-TIME ASSIMILATION OF STREAMFLOW DATA IN OPERATIONAL STREAMFLOW FORECASTING

Size: px
Start display at page:

Download "EVALUATION OF MAXIMUM LIKELIHOOD ENSEMBLE FILTER FOR REAL-TIME ASSIMILATION OF STREAMFLOW DATA IN OPERATIONAL STREAMFLOW FORECASTING"

Transcription

1 EVALUATION OF MAXIMUM LIKELIHOOD ENSEMBLE FILTER FOR REAL-TIME ASSIMILATION OF STREAMFLOW DATA IN OPERATIONAL STREAMFLOW FORECASTING Arezoo Raieei Nasab 1, Dong-Jun Seo 1, Haksu Lee 2,3, Sunghee Kim 4 1 Dept. o Civil Eng., The Univ. o Texas at Arlington, Arlington, TX 2 NOAA/NWS, Oice o Climate, Water and Weather Services, Silver Spring, MD 3 Len Technologies, Oak Hill, VA 4 Consultant, Bethesda, MD 1

2 In this presentation Motivation Methodology EnKF, MLEF Problem ormulation Error modeling Model, observation errors Comparative evaluation o EnKF and MLEF Under homoscedastic, heteroscedastic errors Sensitivity analysis Conclusions and uture research recommendations Dec 3, 2012 AGU Fall Meeting 2

3 Motivation Streamlow is the most widely available, high inormationcontent hydrologic data or inerence o soil moisture states o the basin Assimilating streamlow data, however, involves highly nonlinear observation equations Ensemble Kalman ilter (EnKF) Relative simple and easy to implement Optimal only i the observation equation is linear Maximum likelihood ensemble ilter (MLEF) Ensemble extension o variational assimilation (VAR) Can handle nonlinear observation equations No need or adjoint code Dec 3, 2012 AGU Fall Meeting 3

4 Ensemble Kalman ilter Monte Carlo Approximation X t M t t Z Ht. ( X ) 1 t X t Recursive updating o each ensemble trace Problem: Nonlinear observation operation Y n = X t Z t Solution?: Augment the state vector x with H(x) (still assuming Gaussian pd or new model vector) H =

5 Maximum likelihood ensemble ilter Use square-root orecast (prior) error covariance P p 1 2 [ p1 p2 pn i a M( x p ) M( x) i s ] Ensemble size p i p1, i p2, i ps, i N Statespace dimension Minimize cost unction in the ensemble subspace J 1 T -1 x ] P [ x x ] 1 obs [ x 2 1 [ y 2 T - H ( x) ] R [ y - H ( x) ] obs Similar to VAR, but: Non-dierentiable iterative minimization with superior (Hessian) preconditioning Reduced rank solution in ensemble subspace Estimate o analysis uncertainty available From Zupanski (2005) 5

6 MLEF Extension or model error Zupanski (2005) does not consider model error To account or model uncertainty, augment the square root o the orecast covariance matrix P ( k) M k 1, k P a ( k 1) M T k 1, k Q( k 1) { M k 1, k P a ( k 1)} 1/ 2 { M k 1, k P a ( k 1)} T / 2 Q 1/ 2 ( k 1) Q T / 2 ( k 1) P T / 2 ( k) [{ M k 1, k P a ( k 1)} 1/ 2 Q 1/ 2 ( k 1)] Dec 3, 2012 AGU Fall Meeting 6

7 Fixed-lag smoother ormulation Beginning o the assimilation window End o the assimilation window=prediction time Assimilation window ~ length o unit hydrograph Assimilation cycle ~ nominally once per hour k-l-1 k-l k-l+1 k-1 k k+1 k+2 Time (hrs) All or part o the precipitation, PE, and streamlow data valid within the assimilation window is assimilated. 7

8 Fixed-lag smoother ormulation (cont.) 1) Prescribe the initial background model states and their covariance 3) Solve or the initial model states, biases or precipitation and PE utilizing all available data within the current assimilation window 4) Integrate the model to the end o the assimilation window to obtain the updated IC s valid at the current prediction time, k 2) Propagate the model states and their uncertainty an hour orward k-1 k k+1 k+2 Time (hrs) 8

9 Comparatively evaluation o EnKF and MLEF Homoscedastic errors Study basin MTPT2 in WGRFC (435 km 2, time-to-peak o 17 hrs) Nominal parameter settings Streamlow obs error variance: 0.01 (cms) 2 Precipitation obs error variance: 10 (mm/hr) 2 Potential evaporation obs error variance = 1 (mm/hr) 2 Runo obs error variance = 0.1 (mm/hr) 2 Model error (as a raction o soil water bucket size)= 0.05 (i.e. 5%) Ensemble size = 30 Number o streamlow data used in DA = 1 (valid at the end o the assimilation window) The same settings are used or both MLEF and EnKF Dec 3, 2012 AGU Fall Meeting 9

10 10

11 11

12 All y-axis units are in mm 12

13 13

14 All y-axis units are in mm 14

15 15

16 All y-axis units are in mm 16

17 Sensitivity analysis Model error (rac) raction o soil water bucket size: 0, 0.05, 5, 25 Streamlow obs error variance ( ) 0.01, 0.1, 1 and 10 (cms) 2 Ensemble size (ns) 9, 30, 50 and 100 members σ 2 q Number o streamlow obs assimilated per cycle (n) 1, 2, 4 and 8 obs within the assimilation window Obs error variances in precipitation, PE and runo Dec 3, 2012 AGU Fall Meeting 17

18 Streamlow Prediction 18

19 σ 2 q = (cms) σ2 Streamlow Prediction q = 0. 1 (cms) σ 2 q = 1(cms) σ 2 q = 10 (cms) 19

20 20

21 Streamlow Prediction 21

22 Heteroscedastic error modeling Error variance in model runo t Q t = {I τ + w(τ)} 0 σ 2 eq = σ2 w 0 t t u(t τ) 0 u t τ dτ σ 2 eq = Q obs u t s dsdτ 2 (mm/hr) 2 Error variance in obs σ 2 q = C q Q obs + additive 2 (cms) 2 σ 2 P = (C p P obs + additive)2 (mm/hr) 2 σ 2 e = 1 (mm/hr)2 22

23 Streamlow Prediction 23

24 Conclusions & uture research recommendations MLEF generally improves streamlow prediction over EnKF; the improvement is: very signiicant at short lead times consistent over varying conditions o observational and model errors and ensemble size At large lead times, EnKF tends to perorm slightly better than MLEF suggests possible overitting by MLEF Perormance o MLEF is much less sensitive to error modeling and ensemble size than that o EnKF important consideration or operational applications While the streamlow results appear similar, the soil moisture results are quite dierent between MLEF and EnKF relects large dierences in their solutions Dec 3, 2012 AGU Fall Meeting 24

25 Conclusions & uture research recommendations (cont.) Approximate gradient evaluation in MLEF is not always successul (compared to the adjoint-based) May result in temporal discontinuity streamlow and soil moisture results Improved error modeling may alleviate the problem Need to test on larger-dimensional problems with varying degree o under-determinedness Assess computational requirements as well Assess the quality o analysis (i.e. updated) ensembles via rigorous ensemble veriication or both streamlow and soil moisture Compare with iterative EnKF Dec 3, 2012 AGU Fall Meeting 25

26 THANK YOU Questions? For more ino, please contact 26

An Integrated Ensemble/Variational Hybrid Data Assimilation System

An Integrated Ensemble/Variational Hybrid Data Assimilation System An Integrated Ensemble/Variational Hybrid Data Assimilation System DAOS Working Group Meeting September 2012 Tom Auligné, National Center for Atmospheric Research Acknowledgements: Contributors: Luke Peffers

More information

Real-Time Reservoir Model Updating Using Ensemble Kalman Filter Xian-Huan Wen, SPE and Wen. H. Chen, SPE, ChevronTexaco Energy Technology Company

Real-Time Reservoir Model Updating Using Ensemble Kalman Filter Xian-Huan Wen, SPE and Wen. H. Chen, SPE, ChevronTexaco Energy Technology Company SPE 92991 Real-Time Reservoir Model Updating Using Ensemble Kalman Filter Xian-Huan Wen, SPE and Wen. H. Chen, SPE, ChevronTexaco Energy Technology Company Copyright 2004, Society o Petroleum Engineers

More information

PTE505: Inverse Modeling for Subsurface Flow Data Integration (3 Units)

PTE505: Inverse Modeling for Subsurface Flow Data Integration (3 Units) PTE505: Inverse Modeling for Subsurface Flow Data Integration (3 Units) Instructor: Behnam Jafarpour, Mork Family Department of Chemical Engineering and Material Science Petroleum Engineering, HED 313,

More information

Hybrid-DA in NWP. Experience at the Met Office and elsewhere. GODAE OceanView DA Task Team. Andrew Lorenc, Met Office, Exeter.

Hybrid-DA in NWP. Experience at the Met Office and elsewhere. GODAE OceanView DA Task Team. Andrew Lorenc, Met Office, Exeter. Hybrid-DA in NWP Experience at the Met Office and elsewhere GODAE OceanView DA Task Team Andrew Lorenc, Met Office, Exeter. 21 May 2015 Crown copyright Met Office Recent History of DA for NWP 4DVar was

More information

EE 570: Location and Navigation

EE 570: Location and Navigation EE 570: Location and Navigation On-Line Bayesian Tracking Aly El-Osery 1 Stephen Bruder 2 1 Electrical Engineering Department, New Mexico Tech Socorro, New Mexico, USA 2 Electrical and Computer Engineering

More information

Università di Bologna

Università di Bologna Dipartimento di Scienze della Terra e Geologico Ambientali UNDERSTANDNG AND REDUCNG UNCERTANTY N FLOOD FORECASTNG ACTF Work Package 5 WORKNG GROUP 1 Ezio TODN University o Bologna (TL) Coordinator Paul

More information

Hybrid Data Assimilation in the GSI

Hybrid Data Assimilation in the GSI Hybrid Data Assimilation in the GSI Rahul Mahajan NOAA / NWS / NCEP / EMC IMSG GSI Hybrid DA Team: Daryl Kleist (UMD), Jeff Whitaker (NOAA/ESRL), John Derber (EMC), Dave Parrish (EMC), Xuguang Wang (OU)

More information

ICES REPORT 12-01. January 2012. Reza Tavakoli, Gergina Pencheva, Mary F. Wheeler, Benjamin Ganis

ICES REPORT 12-01. January 2012. Reza Tavakoli, Gergina Pencheva, Mary F. Wheeler, Benjamin Ganis ICES REPORT 12-01 January 2012 Petroleum Reservoir Parameter Estimation and Uncertainty Assessment with the Parallel Ensemble Based Framework Coupled with IPARS by Reza Tavakoli, Gergina Pencheva, Mary

More information

The Complex Step Method Applied to Waterflooding Optimization

The Complex Step Method Applied to Waterflooding Optimization JOSE L. CARBALLAL JR. and BERNARDO HOROWITZ. THE COMPLEX STEP METHOD APPLIED TO WATERFLOODING 45 The Complex Step Method Applied to Waterlooding Optimization José L. Carballal Jr. 1, Bernardo Horowitz

More information

Next Generation Flood Alert in Houston

Next Generation Flood Alert in Houston Next Generation Flood Alert in Houston Philip B. Bedient Civil and Environmental Eng., Rice University Houston, TX Major Causes of Urban Flooding (Excess Water that Inundates) Highly Developed (urbanized)

More information

Stock Option Pricing Using Bayes Filters

Stock Option Pricing Using Bayes Filters Stock Option Pricing Using Bayes Filters Lin Liao liaolin@cs.washington.edu Abstract When using Black-Scholes formula to price options, the key is the estimation of the stochastic return variance. In this

More information

A State Space Model for Wind Forecast Correction

A State Space Model for Wind Forecast Correction A State Space Model for Wind Forecast Correction Valérie Monbe, Pierre Ailliot 2, and Anne Cuzol 1 1 Lab-STICC, Université Européenne de Bretagne, France (e-mail: valerie.monbet@univ-ubs.fr, anne.cuzol@univ-ubs.fr)

More information

The Method of Least Squares

The Method of Least Squares Hervé Abdi 1 1 Introduction The least square methods (LSM) is probably the most popular technique in statistics. This is due to several factors. First, most common estimators can be casted within this

More information

by the matrix A results in a vector which is a reflection of the given

by the matrix A results in a vector which is a reflection of the given Eigenvalues & Eigenvectors Example Suppose Then So, geometrically, multiplying a vector in by the matrix A results in a vector which is a reflection of the given vector about the y-axis We observe that

More information

Lecture 8: Signal Detection and Noise Assumption

Lecture 8: Signal Detection and Noise Assumption ECE 83 Fall Statistical Signal Processing instructor: R. Nowak, scribe: Feng Ju Lecture 8: Signal Detection and Noise Assumption Signal Detection : X = W H : X = S + W where W N(, σ I n n and S = [s, s,...,

More information

Advances in data assimilation techniques

Advances in data assimilation techniques Advances in data assimilation techniques and their relevance to satellite data assimilation ECMWF Seminar on Use of Satellite Observations in NWP Andrew Lorenc,, 8-12 September 2014. Crown copyright Met

More information

Science Infusion, RTO Transition & Phase-2 Planning

Science Infusion, RTO Transition & Phase-2 Planning Science Infusion, RTO Transition & Phase-2 Planning D.-J. Seo and Yuqiong Liu Hydrologic Ensemble Prediction Group (HEP) Hydrologic Science and Modeling Branch Hydrology Laboratory Office of Hydrologic

More information

Adaptive Demand-Forecasting Approach based on Principal Components Time-series an application of data-mining technique to detection of market movement

Adaptive Demand-Forecasting Approach based on Principal Components Time-series an application of data-mining technique to detection of market movement Adaptive Demand-Forecasting Approach based on Principal Components Time-series an application of data-mining technique to detection of market movement Toshio Sugihara Abstract In this study, an adaptive

More information

Master s thesis tutorial: part III

Master s thesis tutorial: part III for the Autonomous Compliant Research group Tinne De Laet, Wilm Decré, Diederik Verscheure Katholieke Universiteit Leuven, Department of Mechanical Engineering, PMA Division 30 oktober 2006 Outline General

More information

Linear regression methods for large n and streaming data

Linear regression methods for large n and streaming data Linear regression methods for large n and streaming data Large n and small or moderate p is a fairly simple problem. The sufficient statistic for β in OLS (and ridge) is: The concept of sufficiency is

More information

A new approach for dynamic optimization of water flooding problems

A new approach for dynamic optimization of water flooding problems A new approach for dynamic optimization of water flooding problems Rolf J. Lorentzen Aina M. Berg Geir Nævdal Erlend H. Vefring IRIS International Research Institute of Stavanger (formerly Rogaland Research)

More information

SMART SENSORS FOR MEASURING FLUID FLOW USING A VENTURI CHANNEL

SMART SENSORS FOR MEASURING FLUID FLOW USING A VENTURI CHANNEL SMART SENSORS FOR MEASURING FLUID FLOW USING A VENTURI CHANNEL Cornelius E. Agu and Bernt Lie 1 Faculty of Technology, Telemark University College Norway ABSTRACT In certain applications, the use of a

More information

1 Teaching notes on GMM 1.

1 Teaching notes on GMM 1. Bent E. Sørensen January 23, 2007 1 Teaching notes on GMM 1. Generalized Method of Moment (GMM) estimation is one of two developments in econometrics in the 80ies that revolutionized empirical work in

More information

Automated Stellar Classification for Large Surveys with EKF and RBF Neural Networks

Automated Stellar Classification for Large Surveys with EKF and RBF Neural Networks Chin. J. Astron. Astrophys. Vol. 5 (2005), No. 2, 203 210 (http:/www.chjaa.org) Chinese Journal of Astronomy and Astrophysics Automated Stellar Classification for Large Surveys with EKF and RBF Neural

More information

Comparing hybrid data assimilation methods on the Lorenz 1963 model with increasing non-linearity

Comparing hybrid data assimilation methods on the Lorenz 1963 model with increasing non-linearity PUBLISHED BY THE INTERNATIONAL METEOROLOGICAL INSTITUTE IN STOCKHOLM SERIES A DYNAMIC METEOROLOGY AND OCEANOGRAPHY Comparing hybrid data assimilation methods on the Lorenz 963 model with increasing non-linearity

More information

Joint parameter and state estimation algorithms for real-time traffic monitoring

Joint parameter and state estimation algorithms for real-time traffic monitoring USDOT Region V Regional University Transportation Center Final Report NEXTRANS Project No 097IY04. Joint parameter and state estimation algorithms for real-time traffic monitoring By Ren Wang PhD Candidate

More information

System Identification for Acoustic Comms.:

System Identification for Acoustic Comms.: System Identification for Acoustic Comms.: New Insights and Approaches for Tracking Sparse and Rapidly Fluctuating Channels Weichang Li and James Preisig Woods Hole Oceanographic Institution The demodulation

More information

Since it is necessary to consider the ability of the lter to predict many data over a period of time a more meaningful metric is the expected value of

Since it is necessary to consider the ability of the lter to predict many data over a period of time a more meaningful metric is the expected value of Chapter 11 Tutorial: The Kalman Filter Tony Lacey. 11.1 Introduction The Kalman lter ë1ë has long been regarded as the optimal solution to many tracing and data prediction tass, ë2ë. Its use in the analysis

More information

Deterministic Sampling-based Switching Kalman Filtering for Vehicle Tracking

Deterministic Sampling-based Switching Kalman Filtering for Vehicle Tracking Proceedings of the IEEE ITSC 2006 2006 IEEE Intelligent Transportation Systems Conference Toronto, Canada, September 17-20, 2006 WA4.1 Deterministic Sampling-based Switching Kalman Filtering for Vehicle

More information

Ensemble Data Assimilation: How Many Members Do We Need?

Ensemble Data Assimilation: How Many Members Do We Need? University of Reading School of Mathematics, Meteorology and Physics Ensemble Data Assimilation: How Many Members Do We Need? Joanne A. Pocock August 2009 This dissertation is submitted to the Department

More information

Inverse modelling of emissions using in situ and satellite (OMI, GOME2, IASI) data

Inverse modelling of emissions using in situ and satellite (OMI, GOME2, IASI) data Inverse modelling of emissions using in situ and satellite (OMI, GOME2, IASI) data J.Resler, K.Eben, P.Juruš, P.Krč Institute of Computer Science Academy of Sciences of the Czech Rep., Prague Setup of

More information

A Tutorial on Particle Filters for Online Nonlinear/Non-Gaussian Bayesian Tracking

A Tutorial on Particle Filters for Online Nonlinear/Non-Gaussian Bayesian Tracking 174 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 50, NO. 2, FEBRUARY 2002 A Tutorial on Particle Filters for Online Nonlinear/Non-Gaussian Bayesian Tracking M. Sanjeev Arulampalam, Simon Maskell, Neil

More information

STA 4273H: Statistical Machine Learning

STA 4273H: Statistical Machine Learning STA 4273H: Statistical Machine Learning Russ Salakhutdinov Department of Statistics! rsalakhu@utstat.toronto.edu! http://www.cs.toronto.edu/~rsalakhu/ Lecture 6 Three Approaches to Classification Construct

More information

Use of numerical weather forecast predictions in soil moisture modelling

Use of numerical weather forecast predictions in soil moisture modelling Use of numerical weather forecast predictions in soil moisture modelling Ari Venäläinen Finnish Meteorological Institute Meteorological research ari.venalainen@fmi.fi OBJECTIVE The weather forecast models

More information

NOWCASTING OF PRECIPITATION Isztar Zawadzki* McGill University, Montreal, Canada

NOWCASTING OF PRECIPITATION Isztar Zawadzki* McGill University, Montreal, Canada NOWCASTING OF PRECIPITATION Isztar Zawadzki* McGill University, Montreal, Canada 1. INTRODUCTION Short-term methods of precipitation nowcasting range from the simple use of regional numerical forecasts

More information

11. Time series and dynamic linear models

11. Time series and dynamic linear models 11. Time series and dynamic linear models Objective To introduce the Bayesian approach to the modeling and forecasting of time series. Recommended reading West, M. and Harrison, J. (1997). models, (2 nd

More information

Copyright 2005 IEEE. Reprinted from IEEE MTT-S International Microwave Symposium 2005

Copyright 2005 IEEE. Reprinted from IEEE MTT-S International Microwave Symposium 2005 Copyright 2005 IEEE Reprinted rom IEEE MTT-S International Microwave Symposium 2005 This material is posted here with permission o the IEEE. Such permission o the IEEE does t in any way imply IEEE endorsement

More information

Estimating Potential Reduction Flood Benefits of Restored Wetlands

Estimating Potential Reduction Flood Benefits of Restored Wetlands Estimating Potential Reduction Flood Benefits of Restored Wetlands Kenneth W. Potter University of Wisconsin Introduction Throughout the summer of 1993 a recurring question was the impact of wetland drainage

More information

4-D-Var or ensemble Kalman filter?

4-D-Var or ensemble Kalman filter? Tellus (2007), 59A, 758 773 Printed in Singapore. All rights reserved C 2007 The Authors Journal compilation C 2007 Blackwell Munksgaard TELLUS 4-D-Var or ensemble Kalman filter? By EUGENIA KALNAY 1, HONG

More information

Software and Hardware Solutions for Accurate Data and Profitable Operations. Miguel J. Donald J. Chmielewski Contributor. DuyQuang Nguyen Tanth

Software and Hardware Solutions for Accurate Data and Profitable Operations. Miguel J. Donald J. Chmielewski Contributor. DuyQuang Nguyen Tanth Smart Process Plants Software and Hardware Solutions for Accurate Data and Profitable Operations Miguel J. Bagajewicz, Ph.D. University of Oklahoma Donald J. Chmielewski Contributor DuyQuang Nguyen Tanth

More information

Logistic Regression. Vibhav Gogate The University of Texas at Dallas. Some Slides from Carlos Guestrin, Luke Zettlemoyer and Dan Weld.

Logistic Regression. Vibhav Gogate The University of Texas at Dallas. Some Slides from Carlos Guestrin, Luke Zettlemoyer and Dan Weld. Logistic Regression Vibhav Gogate The University of Texas at Dallas Some Slides from Carlos Guestrin, Luke Zettlemoyer and Dan Weld. Generative vs. Discriminative Classifiers Want to Learn: h:x Y X features

More information

Java Modules for Time Series Analysis

Java Modules for Time Series Analysis Java Modules for Time Series Analysis Agenda Clustering Non-normal distributions Multifactor modeling Implied ratings Time series prediction 1. Clustering + Cluster 1 Synthetic Clustering + Time series

More information

Neural Decoding of Cursor Motion Using a Kalman Filter

Neural Decoding of Cursor Motion Using a Kalman Filter Neural Decoding of Cursor Motion Using a Kalman Filter W. Wu M. J. Black Y. Gao E. Bienenstock M. Serruya A. Shaikhouni J. P. Donoghue Division of Applied Mathematics, Dept. of Computer Science, Dept.

More information

Advanced Signal Processing and Digital Noise Reduction

Advanced Signal Processing and Digital Noise Reduction Advanced Signal Processing and Digital Noise Reduction Saeed V. Vaseghi Queen's University of Belfast UK WILEY HTEUBNER A Partnership between John Wiley & Sons and B. G. Teubner Publishers Chichester New

More information

Two Topics in Parametric Integration Applied to Stochastic Simulation in Industrial Engineering

Two Topics in Parametric Integration Applied to Stochastic Simulation in Industrial Engineering Two Topics in Parametric Integration Applied to Stochastic Simulation in Industrial Engineering Department of Industrial Engineering and Management Sciences Northwestern University September 15th, 2014

More information

Use of Ensemble Kalman Filter to 3-Dimensional Reservoir Characterization during Waterflooding (SPE100178)

Use of Ensemble Kalman Filter to 3-Dimensional Reservoir Characterization during Waterflooding (SPE100178) Use of Ensemble Kalman Filter to 3-Dimensional Reservoir Characterization during Waterflooding (SPE78) J. Choe (Seoul Natl. U.) & K. Par* (Seoul Natl. U.) EAGE 68 th Conference & Exhibition Vienna, Austria,

More information

2.8 Objective Integration of Satellite, Rain Gauge, and Radar Precipitation Estimates in the Multisensor Precipitation Estimator Algorithm

2.8 Objective Integration of Satellite, Rain Gauge, and Radar Precipitation Estimates in the Multisensor Precipitation Estimator Algorithm 2.8 Objective Integration of Satellite, Rain Gauge, and Radar Precipitation Estimates in the Multisensor Precipitation Estimator Algorithm Chandra Kondragunta*, David Kitzmiller, Dong-Jun Seo and Kiran

More information

DESWAT project (Destructive Water Abatement and Control of Water Disasters)

DESWAT project (Destructive Water Abatement and Control of Water Disasters) A new national hydrological forecast and warning system is now in advanced implementation phase, within the Romanian Waters National Administration, in the framework of DESWAT project. The main objectives

More information

Tutorial on Markov Chain Monte Carlo

Tutorial on Markov Chain Monte Carlo Tutorial on Markov Chain Monte Carlo Kenneth M. Hanson Los Alamos National Laboratory Presented at the 29 th International Workshop on Bayesian Inference and Maximum Entropy Methods in Science and Technology,

More information

118358 SUPERENSEMBLE FORECASTS WITH A SUITE OF MESOSCALE MODELS OVER THE CONTINENTAL UNITED STATES

118358 SUPERENSEMBLE FORECASTS WITH A SUITE OF MESOSCALE MODELS OVER THE CONTINENTAL UNITED STATES 118358 SUPERENSEMBLE FORECASTS WITH A SUITE OF MESOSCALE MODELS OVER THE CONTINENTAL UNITED STATES Donald F. Van Dyke III * Florida State University, Tallahassee, Florida T. N. Krishnamurti Florida State

More information

Review Jeopardy. Blue vs. Orange. Review Jeopardy

Review Jeopardy. Blue vs. Orange. Review Jeopardy Review Jeopardy Blue vs. Orange Review Jeopardy Jeopardy Round Lectures 0-3 Jeopardy Round $200 How could I measure how far apart (i.e. how different) two observations, y 1 and y 2, are from each other?

More information

A Movement Tracking Management Model with Kalman Filtering Global Optimization Techniques and Mahalanobis Distance

A Movement Tracking Management Model with Kalman Filtering Global Optimization Techniques and Mahalanobis Distance Loutraki, 21 26 October 2005 A Movement Tracking Management Model with ing Global Optimization Techniques and Raquel Ramos Pinho, João Manuel R. S. Tavares, Miguel Velhote Correia Laboratório de Óptica

More information

NEURAL NETWORKS A Comprehensive Foundation

NEURAL NETWORKS A Comprehensive Foundation NEURAL NETWORKS A Comprehensive Foundation Second Edition Simon Haykin McMaster University Hamilton, Ontario, Canada Prentice Hall Prentice Hall Upper Saddle River; New Jersey 07458 Preface xii Acknowledgments

More information

MAT 200, Midterm Exam Solution. a. (5 points) Compute the determinant of the matrix A =

MAT 200, Midterm Exam Solution. a. (5 points) Compute the determinant of the matrix A = MAT 200, Midterm Exam Solution. (0 points total) a. (5 points) Compute the determinant of the matrix 2 2 0 A = 0 3 0 3 0 Answer: det A = 3. The most efficient way is to develop the determinant along the

More information

SYSTEMS OF REGRESSION EQUATIONS

SYSTEMS OF REGRESSION EQUATIONS SYSTEMS OF REGRESSION EQUATIONS 1. MULTIPLE EQUATIONS y nt = x nt n + u nt, n = 1,...,N, t = 1,...,T, x nt is 1 k, and n is k 1. This is a version of the standard regression model where the observations

More information

STATISTICS AND DATA ANALYSIS IN GEOLOGY, 3rd ed. Clarificationof zonationprocedure described onpp. 238-239

STATISTICS AND DATA ANALYSIS IN GEOLOGY, 3rd ed. Clarificationof zonationprocedure described onpp. 238-239 STATISTICS AND DATA ANALYSIS IN GEOLOGY, 3rd ed. by John C. Davis Clarificationof zonationprocedure described onpp. 38-39 Because the notation used in this section (Eqs. 4.8 through 4.84) is inconsistent

More information

Havnepromenade 9, DK-9000 Aalborg, Denmark. Denmark. Sohngaardsholmsvej 57, DK-9000 Aalborg, Denmark

Havnepromenade 9, DK-9000 Aalborg, Denmark. Denmark. Sohngaardsholmsvej 57, DK-9000 Aalborg, Denmark Urban run-off volumes dependency on rainfall measurement method - Scaling properties of precipitation within a 2x2 km radar pixel L. Pedersen 1 *, N. E. Jensen 2, M. R. Rasmussen 3 and M. G. Nicolajsen

More information

Variance Reduction. Pricing American Options. Monte Carlo Option Pricing. Delta and Common Random Numbers

Variance Reduction. Pricing American Options. Monte Carlo Option Pricing. Delta and Common Random Numbers Variance Reduction The statistical efficiency of Monte Carlo simulation can be measured by the variance of its output If this variance can be lowered without changing the expected value, fewer replications

More information

Least-Squares Intersection of Lines

Least-Squares Intersection of Lines Least-Squares Intersection of Lines Johannes Traa - UIUC 2013 This write-up derives the least-squares solution for the intersection of lines. In the general case, a set of lines will not intersect at a

More information

Predicting U.S. Industrial Production with Oil and Natural Gas Prices

Predicting U.S. Industrial Production with Oil and Natural Gas Prices Predicting U.S. Industrial Production with Oil and Natural Gas Prices Matthew L. Higgins Department of Economics Western Michigan University Prediction is very important in economic analysis. The prediction

More information

Assimilation of cloudy infrared satellite observations: The Met Office perspective

Assimilation of cloudy infrared satellite observations: The Met Office perspective Assimilation of cloudy infrared satellite observations: The Met Office perspective Ed Pavelin, Met Office International Symposium on Data Assimilation 2014, Munich Contents This presentation covers the

More information

PEST - Beyond Basic Model Calibration. Presented by Jon Traum

PEST - Beyond Basic Model Calibration. Presented by Jon Traum PEST - Beyond Basic Model Calibration Presented by Jon Traum Purpose of Presentation Present advance techniques available in PEST for model calibration High level overview Inspire more people to use PEST!

More information

Capturing Real-Time Power System Dynamics: Opportunities and Challenges. Zhenyu(Henry) Huang, PNNL, Zhenyu.huang@pnnl.gov

Capturing Real-Time Power System Dynamics: Opportunities and Challenges. Zhenyu(Henry) Huang, PNNL, Zhenyu.huang@pnnl.gov 1 Capturing Real-Time Power System Dynamics: Opportunities and Challenges Zhenyu(Henry) Huang, PNNL, Zhenyu.huang@pnnl.gov Frequency trending away from nominal requires tools capturing real-time dynamics

More information

RAPIDS Operational Blending of Nowcasting and NWP QPF

RAPIDS Operational Blending of Nowcasting and NWP QPF RAPIDS Operational Blending of Nowcasting and NWP QPF Wai-kin Wong and Edwin ST Lai Hong Kong Observatory The Second International Symposium on Quantitative Precipitation Forecasting and Hydrology 5-8

More information

An innovative approach to Floods and Fire Risk Assessment and Management: the FLIRE Project

An innovative approach to Floods and Fire Risk Assessment and Management: the FLIRE Project 8 th International Conference of EWRA Water Resources Management in an Interdisciplinary and Changing Context 26-29 June 2013, Porto, Portugal An innovative approach to Floods and Fire Risk Assessment

More information

Supervised Feature Selection & Unsupervised Dimensionality Reduction

Supervised Feature Selection & Unsupervised Dimensionality Reduction Supervised Feature Selection & Unsupervised Dimensionality Reduction Feature Subset Selection Supervised: class labels are given Select a subset of the problem features Why? Redundant features much or

More information

Parallel Data Selection Based on Neurodynamic Optimization in the Era of Big Data

Parallel Data Selection Based on Neurodynamic Optimization in the Era of Big Data Parallel Data Selection Based on Neurodynamic Optimization in the Era of Big Data Jun Wang Department of Mechanical and Automation Engineering The Chinese University of Hong Kong Shatin, New Territories,

More information

Course 8. An Introduction to the Kalman Filter

Course 8. An Introduction to the Kalman Filter Course 8 An Introduction to the Kalman Filter Speakers Greg Welch Gary Bishop Kalman Filters in 2 hours? Hah! No magic. Pretty simple to apply. Tolerant of abuse. Notes are a standalone reference. These

More information

Application of global 1-degree data sets to simulate runoff from MOPEX experimental river basins

Application of global 1-degree data sets to simulate runoff from MOPEX experimental river basins 18 Large Sample Basin Experiments for Hydrological Model Parameterization: Results of the Model Parameter Experiment. IAHS Publ. 37, 26. Application of global 1-degree data sets to simulate from experimental

More information

Kalman Filter Applied to a Active Queue Management Problem

Kalman Filter Applied to a Active Queue Management Problem IOSR Journal of Electrical and Electronics Engineering (IOSR-JEEE) e-issn: 2278-1676,p-ISSN: 2320-3331, Volume 9, Issue 4 Ver. III (Jul Aug. 2014), PP 23-27 Jyoti Pandey 1 and Prof. Aashih Hiradhar 2 Department

More information

7.10 INCORPORATING HYDROCLIMATIC VARIABILITY IN RESERVOIR MANAGEMENT AT FOLSOM LAKE, CALIFORNIA

7.10 INCORPORATING HYDROCLIMATIC VARIABILITY IN RESERVOIR MANAGEMENT AT FOLSOM LAKE, CALIFORNIA 7.10 INCORPORATING HYDROCLIMATIC VARIABILITY IN RESERVOIR MANAGEMENT AT FOLSOM LAKE, CALIFORNIA Theresa M. Carpenter 1, Konstantine P. Georgakakos 1,2, Nicholas E. Graham 1,2, Aris P. Georgakakos 3,4,

More information

Background: State Estimation

Background: State Estimation State Estimation Cyber Security of the Smart Grid Dr. Deepa Kundur Background: State Estimation University of Toronto Dr. Deepa Kundur (University of Toronto) Cyber Security of the Smart Grid 1 / 81 Dr.

More information

Time Series Analysis III

Time Series Analysis III Lecture 12: Time Series Analysis III MIT 18.S096 Dr. Kempthorne Fall 2013 MIT 18.S096 Time Series Analysis III 1 Outline Time Series Analysis III 1 Time Series Analysis III MIT 18.S096 Time Series Analysis

More information

Corporate Defaults and Large Macroeconomic Shocks

Corporate Defaults and Large Macroeconomic Shocks Corporate Defaults and Large Macroeconomic Shocks Mathias Drehmann Bank of England Andrew Patton London School of Economics and Bank of England Steffen Sorensen Bank of England The presentation expresses

More information

Sales Rate and Cumulative Sales Forecasting Using Kalman Filtering Techniques

Sales Rate and Cumulative Sales Forecasting Using Kalman Filtering Techniques 1 Sales Rate and Cumulative Sales Forecasting Using Kalman Filtering Techniques Michael Munroe, Intel Corporation Ted Hench, Arizona State University, 480 614 1496, ted.hench@asu.edu Matthew Timmons, Arizona

More information

Regression III: Advanced Methods

Regression III: Advanced Methods Lecture 16: Generalized Additive Models Regression III: Advanced Methods Bill Jacoby Michigan State University http://polisci.msu.edu/jacoby/icpsr/regress3 Goals of the Lecture Introduce Additive Models

More information

Testing and Evaluation of GSI-Hybrid Data Assimilation and Its Applications for HWRF at the Developmental Testbed Center

Testing and Evaluation of GSI-Hybrid Data Assimilation and Its Applications for HWRF at the Developmental Testbed Center 214 Tropical Cyclone Research Forum (TCRF)/68th IHC, March 3-6, 214, College Park, MD Testing and Evaluation of GSI-Hybrid Data Assimilation and Its Applications for HWRF at the Developmental Testbed Center

More information

Univariate and Multivariate Methods PEARSON. Addison Wesley

Univariate and Multivariate Methods PEARSON. Addison Wesley Time Series Analysis Univariate and Multivariate Methods SECOND EDITION William W. S. Wei Department of Statistics The Fox School of Business and Management Temple University PEARSON Addison Wesley Boston

More information

Drought Monitoring and Forecasting in Sub-Saharan African. Justin Sheffield Princeton University

Drought Monitoring and Forecasting in Sub-Saharan African. Justin Sheffield Princeton University Drought Monitoring and Forecasting in Sub-Saharan African Justin Sheffield Princeton University Outline Challenges for sub-saharan Africa (SSA) Current capabilities (national, regional, international) Princeton

More information

Missing Data: Part 1 What to Do? Carol B. Thompson Johns Hopkins Biostatistics Center SON Brown Bag 3/20/13

Missing Data: Part 1 What to Do? Carol B. Thompson Johns Hopkins Biostatistics Center SON Brown Bag 3/20/13 Missing Data: Part 1 What to Do? Carol B. Thompson Johns Hopkins Biostatistics Center SON Brown Bag 3/20/13 Overview Missingness and impact on statistical analysis Missing data assumptions/mechanisms Conventional

More information

Data Assimilation and Operational Oceanography: The Mercator experience

Data Assimilation and Operational Oceanography: The Mercator experience www.mercator.eu.org Data Assimilation and Operational Oceanography: The Mercator experience Benoît Tranchant btranchant@mercator-ocean.fr And the Mercator-Ocean Assimilation Team (Marie Drevillon, Elisabeth

More information

How To Forecast Solar Power

How To Forecast Solar Power Forecasting Solar Power with Adaptive Models A Pilot Study Dr. James W. Hall 1. Introduction Expanding the use of renewable energy sources, primarily wind and solar, has become a US national priority.

More information

Meteorological Forecasting of DNI, clouds and aerosols

Meteorological Forecasting of DNI, clouds and aerosols Meteorological Forecasting of DNI, clouds and aerosols DNICast 1st End-User Workshop, Madrid, 2014-05-07 Heiner Körnich (SMHI), Jan Remund (Meteotest), Marion Schroedter-Homscheidt (DLR) Overview What

More information

A Hybrid ETKF 3DVAR Data Assimilation Scheme for the WRF Model. Part II: Real Observation Experiments

A Hybrid ETKF 3DVAR Data Assimilation Scheme for the WRF Model. Part II: Real Observation Experiments 5132 M O N T H L Y W E A T H E R R E V I E W VOLUME 136 A Hybrid ETKF 3DVAR Data Assimilation Scheme for the WRF Model. Part II: Real Observation Experiments XUGUANG WANG Cooperative Institute for Research

More information

A Log-Robust Optimization Approach to Portfolio Management

A Log-Robust Optimization Approach to Portfolio Management A Log-Robust Optimization Approach to Portfolio Management Dr. Aurélie Thiele Lehigh University Joint work with Ban Kawas Research partially supported by the National Science Foundation Grant CMMI-0757983

More information

A performance analysis of EtherCAT and PROFINET IRT

A performance analysis of EtherCAT and PROFINET IRT A perormance analysis o EtherCAT and PROFINET IRT Conerence paper by Gunnar Prytz ABB AS Corporate Research Center Bergerveien 12 NO-1396 Billingstad, Norway Copyright 2008 IEEE. Reprinted rom the proceedings

More information

Real-time Visual Tracker by Stream Processing

Real-time Visual Tracker by Stream Processing Real-time Visual Tracker by Stream Processing Simultaneous and Fast 3D Tracking of Multiple Faces in Video Sequences by Using a Particle Filter Oscar Mateo Lozano & Kuzahiro Otsuka presented by Piotr Rudol

More information

LONG TERM FOREIGN CURRENCY EXCHANGE RATE PREDICTIONS

LONG TERM FOREIGN CURRENCY EXCHANGE RATE PREDICTIONS LONG TERM FOREIGN CURRENCY EXCHANGE RATE PREDICTIONS The motivation of this work is to predict foreign currency exchange rates between countries using the long term economic performance of the respective

More information

An extension of the factoring likelihood approach for non-monotone missing data

An extension of the factoring likelihood approach for non-monotone missing data An extension of the factoring likelihood approach for non-monotone missing data Jae Kwang Kim Dong Wan Shin January 14, 2010 ABSTRACT We address the problem of parameter estimation in multivariate distributions

More information

Manual for SOA Exam MLC.

Manual for SOA Exam MLC. Chapter 4. Life insurance. Extract from: Arcones Fall 2009 Edition, available at http://www.actexmadriver.com/ (#1, Exam M, Fall 2005) For a special whole life insurance on (x), you are given: (i) Z is

More information

Pa8ern Recogni6on. and Machine Learning. Chapter 4: Linear Models for Classifica6on

Pa8ern Recogni6on. and Machine Learning. Chapter 4: Linear Models for Classifica6on Pa8ern Recogni6on and Machine Learning Chapter 4: Linear Models for Classifica6on Represen'ng the target values for classifica'on If there are only two classes, we typically use a single real valued output

More information

Dynamic data processing

Dynamic data processing Dynamic data processing recursive least-squares P.J.G. Teunissen Series on Mathematical Geodesy and Positioning Dynamic data processing recursive least-squares Dynamic data processing recursive least-squares

More information

MISSING DATA TECHNIQUES WITH SAS. IDRE Statistical Consulting Group

MISSING DATA TECHNIQUES WITH SAS. IDRE Statistical Consulting Group MISSING DATA TECHNIQUES WITH SAS IDRE Statistical Consulting Group ROAD MAP FOR TODAY To discuss: 1. Commonly used techniques for handling missing data, focusing on multiple imputation 2. Issues that could

More information

The impact of ensemble filter definition on the assimilation of temperature profiles in the tropical Pacific

The impact of ensemble filter definition on the assimilation of temperature profiles in the tropical Pacific Q. J. R. Meteorol. Soc. (2005), 131, pp. 3291 3300 doi: 10.1256/qj.05.90 The impact of ensemble filter definition on the assimilation of temperature profiles in the tropical Pacific By O. LEEUWENBURGH

More information

Logistic Regression. Jia Li. Department of Statistics The Pennsylvania State University. Logistic Regression

Logistic Regression. Jia Li. Department of Statistics The Pennsylvania State University. Logistic Regression Logistic Regression Department of Statistics The Pennsylvania State University Email: jiali@stat.psu.edu Logistic Regression Preserve linear classification boundaries. By the Bayes rule: Ĝ(x) = arg max

More information

Application of Numerical Weather Prediction Models for Drought Monitoring. Gregor Gregorič Jožef Roškar Environmental Agency of Slovenia

Application of Numerical Weather Prediction Models for Drought Monitoring. Gregor Gregorič Jožef Roškar Environmental Agency of Slovenia Application of Numerical Weather Prediction Models for Drought Monitoring Gregor Gregorič Jožef Roškar Environmental Agency of Slovenia Contents 1. Introduction 2. Numerical Weather Prediction Models -

More information

Extreme Value Modeling for Detection and Attribution of Climate Extremes

Extreme Value Modeling for Detection and Attribution of Climate Extremes Extreme Value Modeling for Detection and Attribution of Climate Extremes Jun Yan, Yujing Jiang Joint work with Zhuo Wang, Xuebin Zhang Department of Statistics, University of Connecticut February 2, 2016

More information

Digital Imaging and Multimedia. Filters. Ahmed Elgammal Dept. of Computer Science Rutgers University

Digital Imaging and Multimedia. Filters. Ahmed Elgammal Dept. of Computer Science Rutgers University Digital Imaging and Multimedia Filters Ahmed Elgammal Dept. of Computer Science Rutgers University Outlines What are Filters Linear Filters Convolution operation Properties of Linear Filters Application

More information

Rainfall generator for the Meuse basin

Rainfall generator for the Meuse basin KNMI publication; 196 - IV Rainall generator or the Meuse basin Description o 20 000-year simulations R. Leander and T.A. Buishand De Bilt, 2008 KNMI publication = KNMI publicatie; 196 - IV De Bilt, 2008

More information

Supervised Learning (Big Data Analytics)

Supervised Learning (Big Data Analytics) Supervised Learning (Big Data Analytics) Vibhav Gogate Department of Computer Science The University of Texas at Dallas Practical advice Goal of Big Data Analytics Uncover patterns in Data. Can be used

More information