EVALUATION OF MAXIMUM LIKELIHOOD ENSEMBLE FILTER FOR REAL-TIME ASSIMILATION OF STREAMFLOW DATA IN OPERATIONAL STREAMFLOW FORECASTING
|
|
- Rudolf Griffin
- 7 years ago
- Views:
Transcription
1 EVALUATION OF MAXIMUM LIKELIHOOD ENSEMBLE FILTER FOR REAL-TIME ASSIMILATION OF STREAMFLOW DATA IN OPERATIONAL STREAMFLOW FORECASTING Arezoo Raieei Nasab 1, Dong-Jun Seo 1, Haksu Lee 2,3, Sunghee Kim 4 1 Dept. o Civil Eng., The Univ. o Texas at Arlington, Arlington, TX 2 NOAA/NWS, Oice o Climate, Water and Weather Services, Silver Spring, MD 3 Len Technologies, Oak Hill, VA 4 Consultant, Bethesda, MD 1
2 In this presentation Motivation Methodology EnKF, MLEF Problem ormulation Error modeling Model, observation errors Comparative evaluation o EnKF and MLEF Under homoscedastic, heteroscedastic errors Sensitivity analysis Conclusions and uture research recommendations Dec 3, 2012 AGU Fall Meeting 2
3 Motivation Streamlow is the most widely available, high inormationcontent hydrologic data or inerence o soil moisture states o the basin Assimilating streamlow data, however, involves highly nonlinear observation equations Ensemble Kalman ilter (EnKF) Relative simple and easy to implement Optimal only i the observation equation is linear Maximum likelihood ensemble ilter (MLEF) Ensemble extension o variational assimilation (VAR) Can handle nonlinear observation equations No need or adjoint code Dec 3, 2012 AGU Fall Meeting 3
4 Ensemble Kalman ilter Monte Carlo Approximation X t M t t Z Ht. ( X ) 1 t X t Recursive updating o each ensemble trace Problem: Nonlinear observation operation Y n = X t Z t Solution?: Augment the state vector x with H(x) (still assuming Gaussian pd or new model vector) H =
5 Maximum likelihood ensemble ilter Use square-root orecast (prior) error covariance P p 1 2 [ p1 p2 pn i a M( x p ) M( x) i s ] Ensemble size p i p1, i p2, i ps, i N Statespace dimension Minimize cost unction in the ensemble subspace J 1 T -1 x ] P [ x x ] 1 obs [ x 2 1 [ y 2 T - H ( x) ] R [ y - H ( x) ] obs Similar to VAR, but: Non-dierentiable iterative minimization with superior (Hessian) preconditioning Reduced rank solution in ensemble subspace Estimate o analysis uncertainty available From Zupanski (2005) 5
6 MLEF Extension or model error Zupanski (2005) does not consider model error To account or model uncertainty, augment the square root o the orecast covariance matrix P ( k) M k 1, k P a ( k 1) M T k 1, k Q( k 1) { M k 1, k P a ( k 1)} 1/ 2 { M k 1, k P a ( k 1)} T / 2 Q 1/ 2 ( k 1) Q T / 2 ( k 1) P T / 2 ( k) [{ M k 1, k P a ( k 1)} 1/ 2 Q 1/ 2 ( k 1)] Dec 3, 2012 AGU Fall Meeting 6
7 Fixed-lag smoother ormulation Beginning o the assimilation window End o the assimilation window=prediction time Assimilation window ~ length o unit hydrograph Assimilation cycle ~ nominally once per hour k-l-1 k-l k-l+1 k-1 k k+1 k+2 Time (hrs) All or part o the precipitation, PE, and streamlow data valid within the assimilation window is assimilated. 7
8 Fixed-lag smoother ormulation (cont.) 1) Prescribe the initial background model states and their covariance 3) Solve or the initial model states, biases or precipitation and PE utilizing all available data within the current assimilation window 4) Integrate the model to the end o the assimilation window to obtain the updated IC s valid at the current prediction time, k 2) Propagate the model states and their uncertainty an hour orward k-1 k k+1 k+2 Time (hrs) 8
9 Comparatively evaluation o EnKF and MLEF Homoscedastic errors Study basin MTPT2 in WGRFC (435 km 2, time-to-peak o 17 hrs) Nominal parameter settings Streamlow obs error variance: 0.01 (cms) 2 Precipitation obs error variance: 10 (mm/hr) 2 Potential evaporation obs error variance = 1 (mm/hr) 2 Runo obs error variance = 0.1 (mm/hr) 2 Model error (as a raction o soil water bucket size)= 0.05 (i.e. 5%) Ensemble size = 30 Number o streamlow data used in DA = 1 (valid at the end o the assimilation window) The same settings are used or both MLEF and EnKF Dec 3, 2012 AGU Fall Meeting 9
10 10
11 11
12 All y-axis units are in mm 12
13 13
14 All y-axis units are in mm 14
15 15
16 All y-axis units are in mm 16
17 Sensitivity analysis Model error (rac) raction o soil water bucket size: 0, 0.05, 5, 25 Streamlow obs error variance ( ) 0.01, 0.1, 1 and 10 (cms) 2 Ensemble size (ns) 9, 30, 50 and 100 members σ 2 q Number o streamlow obs assimilated per cycle (n) 1, 2, 4 and 8 obs within the assimilation window Obs error variances in precipitation, PE and runo Dec 3, 2012 AGU Fall Meeting 17
18 Streamlow Prediction 18
19 σ 2 q = (cms) σ2 Streamlow Prediction q = 0. 1 (cms) σ 2 q = 1(cms) σ 2 q = 10 (cms) 19
20 20
21 Streamlow Prediction 21
22 Heteroscedastic error modeling Error variance in model runo t Q t = {I τ + w(τ)} 0 σ 2 eq = σ2 w 0 t t u(t τ) 0 u t τ dτ σ 2 eq = Q obs u t s dsdτ 2 (mm/hr) 2 Error variance in obs σ 2 q = C q Q obs + additive 2 (cms) 2 σ 2 P = (C p P obs + additive)2 (mm/hr) 2 σ 2 e = 1 (mm/hr)2 22
23 Streamlow Prediction 23
24 Conclusions & uture research recommendations MLEF generally improves streamlow prediction over EnKF; the improvement is: very signiicant at short lead times consistent over varying conditions o observational and model errors and ensemble size At large lead times, EnKF tends to perorm slightly better than MLEF suggests possible overitting by MLEF Perormance o MLEF is much less sensitive to error modeling and ensemble size than that o EnKF important consideration or operational applications While the streamlow results appear similar, the soil moisture results are quite dierent between MLEF and EnKF relects large dierences in their solutions Dec 3, 2012 AGU Fall Meeting 24
25 Conclusions & uture research recommendations (cont.) Approximate gradient evaluation in MLEF is not always successul (compared to the adjoint-based) May result in temporal discontinuity streamlow and soil moisture results Improved error modeling may alleviate the problem Need to test on larger-dimensional problems with varying degree o under-determinedness Assess computational requirements as well Assess the quality o analysis (i.e. updated) ensembles via rigorous ensemble veriication or both streamlow and soil moisture Compare with iterative EnKF Dec 3, 2012 AGU Fall Meeting 25
26 THANK YOU Questions? For more ino, please contact 26
An Integrated Ensemble/Variational Hybrid Data Assimilation System
An Integrated Ensemble/Variational Hybrid Data Assimilation System DAOS Working Group Meeting September 2012 Tom Auligné, National Center for Atmospheric Research Acknowledgements: Contributors: Luke Peffers
More informationReal-Time Reservoir Model Updating Using Ensemble Kalman Filter Xian-Huan Wen, SPE and Wen. H. Chen, SPE, ChevronTexaco Energy Technology Company
SPE 92991 Real-Time Reservoir Model Updating Using Ensemble Kalman Filter Xian-Huan Wen, SPE and Wen. H. Chen, SPE, ChevronTexaco Energy Technology Company Copyright 2004, Society o Petroleum Engineers
More informationPTE505: Inverse Modeling for Subsurface Flow Data Integration (3 Units)
PTE505: Inverse Modeling for Subsurface Flow Data Integration (3 Units) Instructor: Behnam Jafarpour, Mork Family Department of Chemical Engineering and Material Science Petroleum Engineering, HED 313,
More informationHybrid-DA in NWP. Experience at the Met Office and elsewhere. GODAE OceanView DA Task Team. Andrew Lorenc, Met Office, Exeter.
Hybrid-DA in NWP Experience at the Met Office and elsewhere GODAE OceanView DA Task Team Andrew Lorenc, Met Office, Exeter. 21 May 2015 Crown copyright Met Office Recent History of DA for NWP 4DVar was
More informationEE 570: Location and Navigation
EE 570: Location and Navigation On-Line Bayesian Tracking Aly El-Osery 1 Stephen Bruder 2 1 Electrical Engineering Department, New Mexico Tech Socorro, New Mexico, USA 2 Electrical and Computer Engineering
More informationUniversità di Bologna
Dipartimento di Scienze della Terra e Geologico Ambientali UNDERSTANDNG AND REDUCNG UNCERTANTY N FLOOD FORECASTNG ACTF Work Package 5 WORKNG GROUP 1 Ezio TODN University o Bologna (TL) Coordinator Paul
More informationHybrid Data Assimilation in the GSI
Hybrid Data Assimilation in the GSI Rahul Mahajan NOAA / NWS / NCEP / EMC IMSG GSI Hybrid DA Team: Daryl Kleist (UMD), Jeff Whitaker (NOAA/ESRL), John Derber (EMC), Dave Parrish (EMC), Xuguang Wang (OU)
More informationICES REPORT 12-01. January 2012. Reza Tavakoli, Gergina Pencheva, Mary F. Wheeler, Benjamin Ganis
ICES REPORT 12-01 January 2012 Petroleum Reservoir Parameter Estimation and Uncertainty Assessment with the Parallel Ensemble Based Framework Coupled with IPARS by Reza Tavakoli, Gergina Pencheva, Mary
More informationThe Complex Step Method Applied to Waterflooding Optimization
JOSE L. CARBALLAL JR. and BERNARDO HOROWITZ. THE COMPLEX STEP METHOD APPLIED TO WATERFLOODING 45 The Complex Step Method Applied to Waterlooding Optimization José L. Carballal Jr. 1, Bernardo Horowitz
More informationNext Generation Flood Alert in Houston
Next Generation Flood Alert in Houston Philip B. Bedient Civil and Environmental Eng., Rice University Houston, TX Major Causes of Urban Flooding (Excess Water that Inundates) Highly Developed (urbanized)
More informationStock Option Pricing Using Bayes Filters
Stock Option Pricing Using Bayes Filters Lin Liao liaolin@cs.washington.edu Abstract When using Black-Scholes formula to price options, the key is the estimation of the stochastic return variance. In this
More informationA State Space Model for Wind Forecast Correction
A State Space Model for Wind Forecast Correction Valérie Monbe, Pierre Ailliot 2, and Anne Cuzol 1 1 Lab-STICC, Université Européenne de Bretagne, France (e-mail: valerie.monbet@univ-ubs.fr, anne.cuzol@univ-ubs.fr)
More informationThe Method of Least Squares
Hervé Abdi 1 1 Introduction The least square methods (LSM) is probably the most popular technique in statistics. This is due to several factors. First, most common estimators can be casted within this
More informationby the matrix A results in a vector which is a reflection of the given
Eigenvalues & Eigenvectors Example Suppose Then So, geometrically, multiplying a vector in by the matrix A results in a vector which is a reflection of the given vector about the y-axis We observe that
More informationLecture 8: Signal Detection and Noise Assumption
ECE 83 Fall Statistical Signal Processing instructor: R. Nowak, scribe: Feng Ju Lecture 8: Signal Detection and Noise Assumption Signal Detection : X = W H : X = S + W where W N(, σ I n n and S = [s, s,...,
More informationAdvances in data assimilation techniques
Advances in data assimilation techniques and their relevance to satellite data assimilation ECMWF Seminar on Use of Satellite Observations in NWP Andrew Lorenc,, 8-12 September 2014. Crown copyright Met
More informationScience Infusion, RTO Transition & Phase-2 Planning
Science Infusion, RTO Transition & Phase-2 Planning D.-J. Seo and Yuqiong Liu Hydrologic Ensemble Prediction Group (HEP) Hydrologic Science and Modeling Branch Hydrology Laboratory Office of Hydrologic
More informationAdaptive Demand-Forecasting Approach based on Principal Components Time-series an application of data-mining technique to detection of market movement
Adaptive Demand-Forecasting Approach based on Principal Components Time-series an application of data-mining technique to detection of market movement Toshio Sugihara Abstract In this study, an adaptive
More informationMaster s thesis tutorial: part III
for the Autonomous Compliant Research group Tinne De Laet, Wilm Decré, Diederik Verscheure Katholieke Universiteit Leuven, Department of Mechanical Engineering, PMA Division 30 oktober 2006 Outline General
More informationLinear regression methods for large n and streaming data
Linear regression methods for large n and streaming data Large n and small or moderate p is a fairly simple problem. The sufficient statistic for β in OLS (and ridge) is: The concept of sufficiency is
More informationA new approach for dynamic optimization of water flooding problems
A new approach for dynamic optimization of water flooding problems Rolf J. Lorentzen Aina M. Berg Geir Nævdal Erlend H. Vefring IRIS International Research Institute of Stavanger (formerly Rogaland Research)
More informationSMART SENSORS FOR MEASURING FLUID FLOW USING A VENTURI CHANNEL
SMART SENSORS FOR MEASURING FLUID FLOW USING A VENTURI CHANNEL Cornelius E. Agu and Bernt Lie 1 Faculty of Technology, Telemark University College Norway ABSTRACT In certain applications, the use of a
More information1 Teaching notes on GMM 1.
Bent E. Sørensen January 23, 2007 1 Teaching notes on GMM 1. Generalized Method of Moment (GMM) estimation is one of two developments in econometrics in the 80ies that revolutionized empirical work in
More informationAutomated Stellar Classification for Large Surveys with EKF and RBF Neural Networks
Chin. J. Astron. Astrophys. Vol. 5 (2005), No. 2, 203 210 (http:/www.chjaa.org) Chinese Journal of Astronomy and Astrophysics Automated Stellar Classification for Large Surveys with EKF and RBF Neural
More informationComparing hybrid data assimilation methods on the Lorenz 1963 model with increasing non-linearity
PUBLISHED BY THE INTERNATIONAL METEOROLOGICAL INSTITUTE IN STOCKHOLM SERIES A DYNAMIC METEOROLOGY AND OCEANOGRAPHY Comparing hybrid data assimilation methods on the Lorenz 963 model with increasing non-linearity
More informationJoint parameter and state estimation algorithms for real-time traffic monitoring
USDOT Region V Regional University Transportation Center Final Report NEXTRANS Project No 097IY04. Joint parameter and state estimation algorithms for real-time traffic monitoring By Ren Wang PhD Candidate
More informationSystem Identification for Acoustic Comms.:
System Identification for Acoustic Comms.: New Insights and Approaches for Tracking Sparse and Rapidly Fluctuating Channels Weichang Li and James Preisig Woods Hole Oceanographic Institution The demodulation
More informationSince it is necessary to consider the ability of the lter to predict many data over a period of time a more meaningful metric is the expected value of
Chapter 11 Tutorial: The Kalman Filter Tony Lacey. 11.1 Introduction The Kalman lter ë1ë has long been regarded as the optimal solution to many tracing and data prediction tass, ë2ë. Its use in the analysis
More informationDeterministic Sampling-based Switching Kalman Filtering for Vehicle Tracking
Proceedings of the IEEE ITSC 2006 2006 IEEE Intelligent Transportation Systems Conference Toronto, Canada, September 17-20, 2006 WA4.1 Deterministic Sampling-based Switching Kalman Filtering for Vehicle
More informationEnsemble Data Assimilation: How Many Members Do We Need?
University of Reading School of Mathematics, Meteorology and Physics Ensemble Data Assimilation: How Many Members Do We Need? Joanne A. Pocock August 2009 This dissertation is submitted to the Department
More informationInverse modelling of emissions using in situ and satellite (OMI, GOME2, IASI) data
Inverse modelling of emissions using in situ and satellite (OMI, GOME2, IASI) data J.Resler, K.Eben, P.Juruš, P.Krč Institute of Computer Science Academy of Sciences of the Czech Rep., Prague Setup of
More informationA Tutorial on Particle Filters for Online Nonlinear/Non-Gaussian Bayesian Tracking
174 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 50, NO. 2, FEBRUARY 2002 A Tutorial on Particle Filters for Online Nonlinear/Non-Gaussian Bayesian Tracking M. Sanjeev Arulampalam, Simon Maskell, Neil
More informationSTA 4273H: Statistical Machine Learning
STA 4273H: Statistical Machine Learning Russ Salakhutdinov Department of Statistics! rsalakhu@utstat.toronto.edu! http://www.cs.toronto.edu/~rsalakhu/ Lecture 6 Three Approaches to Classification Construct
More informationUse of numerical weather forecast predictions in soil moisture modelling
Use of numerical weather forecast predictions in soil moisture modelling Ari Venäläinen Finnish Meteorological Institute Meteorological research ari.venalainen@fmi.fi OBJECTIVE The weather forecast models
More informationNOWCASTING OF PRECIPITATION Isztar Zawadzki* McGill University, Montreal, Canada
NOWCASTING OF PRECIPITATION Isztar Zawadzki* McGill University, Montreal, Canada 1. INTRODUCTION Short-term methods of precipitation nowcasting range from the simple use of regional numerical forecasts
More information11. Time series and dynamic linear models
11. Time series and dynamic linear models Objective To introduce the Bayesian approach to the modeling and forecasting of time series. Recommended reading West, M. and Harrison, J. (1997). models, (2 nd
More informationCopyright 2005 IEEE. Reprinted from IEEE MTT-S International Microwave Symposium 2005
Copyright 2005 IEEE Reprinted rom IEEE MTT-S International Microwave Symposium 2005 This material is posted here with permission o the IEEE. Such permission o the IEEE does t in any way imply IEEE endorsement
More informationEstimating Potential Reduction Flood Benefits of Restored Wetlands
Estimating Potential Reduction Flood Benefits of Restored Wetlands Kenneth W. Potter University of Wisconsin Introduction Throughout the summer of 1993 a recurring question was the impact of wetland drainage
More information4-D-Var or ensemble Kalman filter?
Tellus (2007), 59A, 758 773 Printed in Singapore. All rights reserved C 2007 The Authors Journal compilation C 2007 Blackwell Munksgaard TELLUS 4-D-Var or ensemble Kalman filter? By EUGENIA KALNAY 1, HONG
More informationSoftware and Hardware Solutions for Accurate Data and Profitable Operations. Miguel J. Donald J. Chmielewski Contributor. DuyQuang Nguyen Tanth
Smart Process Plants Software and Hardware Solutions for Accurate Data and Profitable Operations Miguel J. Bagajewicz, Ph.D. University of Oklahoma Donald J. Chmielewski Contributor DuyQuang Nguyen Tanth
More informationLogistic Regression. Vibhav Gogate The University of Texas at Dallas. Some Slides from Carlos Guestrin, Luke Zettlemoyer and Dan Weld.
Logistic Regression Vibhav Gogate The University of Texas at Dallas Some Slides from Carlos Guestrin, Luke Zettlemoyer and Dan Weld. Generative vs. Discriminative Classifiers Want to Learn: h:x Y X features
More informationJava Modules for Time Series Analysis
Java Modules for Time Series Analysis Agenda Clustering Non-normal distributions Multifactor modeling Implied ratings Time series prediction 1. Clustering + Cluster 1 Synthetic Clustering + Time series
More informationNeural Decoding of Cursor Motion Using a Kalman Filter
Neural Decoding of Cursor Motion Using a Kalman Filter W. Wu M. J. Black Y. Gao E. Bienenstock M. Serruya A. Shaikhouni J. P. Donoghue Division of Applied Mathematics, Dept. of Computer Science, Dept.
More informationAdvanced Signal Processing and Digital Noise Reduction
Advanced Signal Processing and Digital Noise Reduction Saeed V. Vaseghi Queen's University of Belfast UK WILEY HTEUBNER A Partnership between John Wiley & Sons and B. G. Teubner Publishers Chichester New
More informationTwo Topics in Parametric Integration Applied to Stochastic Simulation in Industrial Engineering
Two Topics in Parametric Integration Applied to Stochastic Simulation in Industrial Engineering Department of Industrial Engineering and Management Sciences Northwestern University September 15th, 2014
More informationUse of Ensemble Kalman Filter to 3-Dimensional Reservoir Characterization during Waterflooding (SPE100178)
Use of Ensemble Kalman Filter to 3-Dimensional Reservoir Characterization during Waterflooding (SPE78) J. Choe (Seoul Natl. U.) & K. Par* (Seoul Natl. U.) EAGE 68 th Conference & Exhibition Vienna, Austria,
More information2.8 Objective Integration of Satellite, Rain Gauge, and Radar Precipitation Estimates in the Multisensor Precipitation Estimator Algorithm
2.8 Objective Integration of Satellite, Rain Gauge, and Radar Precipitation Estimates in the Multisensor Precipitation Estimator Algorithm Chandra Kondragunta*, David Kitzmiller, Dong-Jun Seo and Kiran
More informationDESWAT project (Destructive Water Abatement and Control of Water Disasters)
A new national hydrological forecast and warning system is now in advanced implementation phase, within the Romanian Waters National Administration, in the framework of DESWAT project. The main objectives
More informationTutorial on Markov Chain Monte Carlo
Tutorial on Markov Chain Monte Carlo Kenneth M. Hanson Los Alamos National Laboratory Presented at the 29 th International Workshop on Bayesian Inference and Maximum Entropy Methods in Science and Technology,
More information118358 SUPERENSEMBLE FORECASTS WITH A SUITE OF MESOSCALE MODELS OVER THE CONTINENTAL UNITED STATES
118358 SUPERENSEMBLE FORECASTS WITH A SUITE OF MESOSCALE MODELS OVER THE CONTINENTAL UNITED STATES Donald F. Van Dyke III * Florida State University, Tallahassee, Florida T. N. Krishnamurti Florida State
More informationReview Jeopardy. Blue vs. Orange. Review Jeopardy
Review Jeopardy Blue vs. Orange Review Jeopardy Jeopardy Round Lectures 0-3 Jeopardy Round $200 How could I measure how far apart (i.e. how different) two observations, y 1 and y 2, are from each other?
More informationA Movement Tracking Management Model with Kalman Filtering Global Optimization Techniques and Mahalanobis Distance
Loutraki, 21 26 October 2005 A Movement Tracking Management Model with ing Global Optimization Techniques and Raquel Ramos Pinho, João Manuel R. S. Tavares, Miguel Velhote Correia Laboratório de Óptica
More informationNEURAL NETWORKS A Comprehensive Foundation
NEURAL NETWORKS A Comprehensive Foundation Second Edition Simon Haykin McMaster University Hamilton, Ontario, Canada Prentice Hall Prentice Hall Upper Saddle River; New Jersey 07458 Preface xii Acknowledgments
More informationMAT 200, Midterm Exam Solution. a. (5 points) Compute the determinant of the matrix A =
MAT 200, Midterm Exam Solution. (0 points total) a. (5 points) Compute the determinant of the matrix 2 2 0 A = 0 3 0 3 0 Answer: det A = 3. The most efficient way is to develop the determinant along the
More informationSYSTEMS OF REGRESSION EQUATIONS
SYSTEMS OF REGRESSION EQUATIONS 1. MULTIPLE EQUATIONS y nt = x nt n + u nt, n = 1,...,N, t = 1,...,T, x nt is 1 k, and n is k 1. This is a version of the standard regression model where the observations
More informationSTATISTICS AND DATA ANALYSIS IN GEOLOGY, 3rd ed. Clarificationof zonationprocedure described onpp. 238-239
STATISTICS AND DATA ANALYSIS IN GEOLOGY, 3rd ed. by John C. Davis Clarificationof zonationprocedure described onpp. 38-39 Because the notation used in this section (Eqs. 4.8 through 4.84) is inconsistent
More informationHavnepromenade 9, DK-9000 Aalborg, Denmark. Denmark. Sohngaardsholmsvej 57, DK-9000 Aalborg, Denmark
Urban run-off volumes dependency on rainfall measurement method - Scaling properties of precipitation within a 2x2 km radar pixel L. Pedersen 1 *, N. E. Jensen 2, M. R. Rasmussen 3 and M. G. Nicolajsen
More informationVariance Reduction. Pricing American Options. Monte Carlo Option Pricing. Delta and Common Random Numbers
Variance Reduction The statistical efficiency of Monte Carlo simulation can be measured by the variance of its output If this variance can be lowered without changing the expected value, fewer replications
More informationLeast-Squares Intersection of Lines
Least-Squares Intersection of Lines Johannes Traa - UIUC 2013 This write-up derives the least-squares solution for the intersection of lines. In the general case, a set of lines will not intersect at a
More informationPredicting U.S. Industrial Production with Oil and Natural Gas Prices
Predicting U.S. Industrial Production with Oil and Natural Gas Prices Matthew L. Higgins Department of Economics Western Michigan University Prediction is very important in economic analysis. The prediction
More informationAssimilation of cloudy infrared satellite observations: The Met Office perspective
Assimilation of cloudy infrared satellite observations: The Met Office perspective Ed Pavelin, Met Office International Symposium on Data Assimilation 2014, Munich Contents This presentation covers the
More informationPEST - Beyond Basic Model Calibration. Presented by Jon Traum
PEST - Beyond Basic Model Calibration Presented by Jon Traum Purpose of Presentation Present advance techniques available in PEST for model calibration High level overview Inspire more people to use PEST!
More informationCapturing Real-Time Power System Dynamics: Opportunities and Challenges. Zhenyu(Henry) Huang, PNNL, Zhenyu.huang@pnnl.gov
1 Capturing Real-Time Power System Dynamics: Opportunities and Challenges Zhenyu(Henry) Huang, PNNL, Zhenyu.huang@pnnl.gov Frequency trending away from nominal requires tools capturing real-time dynamics
More informationRAPIDS Operational Blending of Nowcasting and NWP QPF
RAPIDS Operational Blending of Nowcasting and NWP QPF Wai-kin Wong and Edwin ST Lai Hong Kong Observatory The Second International Symposium on Quantitative Precipitation Forecasting and Hydrology 5-8
More informationAn innovative approach to Floods and Fire Risk Assessment and Management: the FLIRE Project
8 th International Conference of EWRA Water Resources Management in an Interdisciplinary and Changing Context 26-29 June 2013, Porto, Portugal An innovative approach to Floods and Fire Risk Assessment
More informationSupervised Feature Selection & Unsupervised Dimensionality Reduction
Supervised Feature Selection & Unsupervised Dimensionality Reduction Feature Subset Selection Supervised: class labels are given Select a subset of the problem features Why? Redundant features much or
More informationParallel Data Selection Based on Neurodynamic Optimization in the Era of Big Data
Parallel Data Selection Based on Neurodynamic Optimization in the Era of Big Data Jun Wang Department of Mechanical and Automation Engineering The Chinese University of Hong Kong Shatin, New Territories,
More informationCourse 8. An Introduction to the Kalman Filter
Course 8 An Introduction to the Kalman Filter Speakers Greg Welch Gary Bishop Kalman Filters in 2 hours? Hah! No magic. Pretty simple to apply. Tolerant of abuse. Notes are a standalone reference. These
More informationApplication of global 1-degree data sets to simulate runoff from MOPEX experimental river basins
18 Large Sample Basin Experiments for Hydrological Model Parameterization: Results of the Model Parameter Experiment. IAHS Publ. 37, 26. Application of global 1-degree data sets to simulate from experimental
More informationKalman Filter Applied to a Active Queue Management Problem
IOSR Journal of Electrical and Electronics Engineering (IOSR-JEEE) e-issn: 2278-1676,p-ISSN: 2320-3331, Volume 9, Issue 4 Ver. III (Jul Aug. 2014), PP 23-27 Jyoti Pandey 1 and Prof. Aashih Hiradhar 2 Department
More information7.10 INCORPORATING HYDROCLIMATIC VARIABILITY IN RESERVOIR MANAGEMENT AT FOLSOM LAKE, CALIFORNIA
7.10 INCORPORATING HYDROCLIMATIC VARIABILITY IN RESERVOIR MANAGEMENT AT FOLSOM LAKE, CALIFORNIA Theresa M. Carpenter 1, Konstantine P. Georgakakos 1,2, Nicholas E. Graham 1,2, Aris P. Georgakakos 3,4,
More informationBackground: State Estimation
State Estimation Cyber Security of the Smart Grid Dr. Deepa Kundur Background: State Estimation University of Toronto Dr. Deepa Kundur (University of Toronto) Cyber Security of the Smart Grid 1 / 81 Dr.
More informationTime Series Analysis III
Lecture 12: Time Series Analysis III MIT 18.S096 Dr. Kempthorne Fall 2013 MIT 18.S096 Time Series Analysis III 1 Outline Time Series Analysis III 1 Time Series Analysis III MIT 18.S096 Time Series Analysis
More informationCorporate Defaults and Large Macroeconomic Shocks
Corporate Defaults and Large Macroeconomic Shocks Mathias Drehmann Bank of England Andrew Patton London School of Economics and Bank of England Steffen Sorensen Bank of England The presentation expresses
More informationSales Rate and Cumulative Sales Forecasting Using Kalman Filtering Techniques
1 Sales Rate and Cumulative Sales Forecasting Using Kalman Filtering Techniques Michael Munroe, Intel Corporation Ted Hench, Arizona State University, 480 614 1496, ted.hench@asu.edu Matthew Timmons, Arizona
More informationRegression III: Advanced Methods
Lecture 16: Generalized Additive Models Regression III: Advanced Methods Bill Jacoby Michigan State University http://polisci.msu.edu/jacoby/icpsr/regress3 Goals of the Lecture Introduce Additive Models
More informationTesting and Evaluation of GSI-Hybrid Data Assimilation and Its Applications for HWRF at the Developmental Testbed Center
214 Tropical Cyclone Research Forum (TCRF)/68th IHC, March 3-6, 214, College Park, MD Testing and Evaluation of GSI-Hybrid Data Assimilation and Its Applications for HWRF at the Developmental Testbed Center
More informationUnivariate and Multivariate Methods PEARSON. Addison Wesley
Time Series Analysis Univariate and Multivariate Methods SECOND EDITION William W. S. Wei Department of Statistics The Fox School of Business and Management Temple University PEARSON Addison Wesley Boston
More informationDrought Monitoring and Forecasting in Sub-Saharan African. Justin Sheffield Princeton University
Drought Monitoring and Forecasting in Sub-Saharan African Justin Sheffield Princeton University Outline Challenges for sub-saharan Africa (SSA) Current capabilities (national, regional, international) Princeton
More informationMissing Data: Part 1 What to Do? Carol B. Thompson Johns Hopkins Biostatistics Center SON Brown Bag 3/20/13
Missing Data: Part 1 What to Do? Carol B. Thompson Johns Hopkins Biostatistics Center SON Brown Bag 3/20/13 Overview Missingness and impact on statistical analysis Missing data assumptions/mechanisms Conventional
More informationData Assimilation and Operational Oceanography: The Mercator experience
www.mercator.eu.org Data Assimilation and Operational Oceanography: The Mercator experience Benoît Tranchant btranchant@mercator-ocean.fr And the Mercator-Ocean Assimilation Team (Marie Drevillon, Elisabeth
More informationHow To Forecast Solar Power
Forecasting Solar Power with Adaptive Models A Pilot Study Dr. James W. Hall 1. Introduction Expanding the use of renewable energy sources, primarily wind and solar, has become a US national priority.
More informationMeteorological Forecasting of DNI, clouds and aerosols
Meteorological Forecasting of DNI, clouds and aerosols DNICast 1st End-User Workshop, Madrid, 2014-05-07 Heiner Körnich (SMHI), Jan Remund (Meteotest), Marion Schroedter-Homscheidt (DLR) Overview What
More informationA Hybrid ETKF 3DVAR Data Assimilation Scheme for the WRF Model. Part II: Real Observation Experiments
5132 M O N T H L Y W E A T H E R R E V I E W VOLUME 136 A Hybrid ETKF 3DVAR Data Assimilation Scheme for the WRF Model. Part II: Real Observation Experiments XUGUANG WANG Cooperative Institute for Research
More informationA Log-Robust Optimization Approach to Portfolio Management
A Log-Robust Optimization Approach to Portfolio Management Dr. Aurélie Thiele Lehigh University Joint work with Ban Kawas Research partially supported by the National Science Foundation Grant CMMI-0757983
More informationA performance analysis of EtherCAT and PROFINET IRT
A perormance analysis o EtherCAT and PROFINET IRT Conerence paper by Gunnar Prytz ABB AS Corporate Research Center Bergerveien 12 NO-1396 Billingstad, Norway Copyright 2008 IEEE. Reprinted rom the proceedings
More informationReal-time Visual Tracker by Stream Processing
Real-time Visual Tracker by Stream Processing Simultaneous and Fast 3D Tracking of Multiple Faces in Video Sequences by Using a Particle Filter Oscar Mateo Lozano & Kuzahiro Otsuka presented by Piotr Rudol
More informationLONG TERM FOREIGN CURRENCY EXCHANGE RATE PREDICTIONS
LONG TERM FOREIGN CURRENCY EXCHANGE RATE PREDICTIONS The motivation of this work is to predict foreign currency exchange rates between countries using the long term economic performance of the respective
More informationAn extension of the factoring likelihood approach for non-monotone missing data
An extension of the factoring likelihood approach for non-monotone missing data Jae Kwang Kim Dong Wan Shin January 14, 2010 ABSTRACT We address the problem of parameter estimation in multivariate distributions
More informationManual for SOA Exam MLC.
Chapter 4. Life insurance. Extract from: Arcones Fall 2009 Edition, available at http://www.actexmadriver.com/ (#1, Exam M, Fall 2005) For a special whole life insurance on (x), you are given: (i) Z is
More informationPa8ern Recogni6on. and Machine Learning. Chapter 4: Linear Models for Classifica6on
Pa8ern Recogni6on and Machine Learning Chapter 4: Linear Models for Classifica6on Represen'ng the target values for classifica'on If there are only two classes, we typically use a single real valued output
More informationDynamic data processing
Dynamic data processing recursive least-squares P.J.G. Teunissen Series on Mathematical Geodesy and Positioning Dynamic data processing recursive least-squares Dynamic data processing recursive least-squares
More informationMISSING DATA TECHNIQUES WITH SAS. IDRE Statistical Consulting Group
MISSING DATA TECHNIQUES WITH SAS IDRE Statistical Consulting Group ROAD MAP FOR TODAY To discuss: 1. Commonly used techniques for handling missing data, focusing on multiple imputation 2. Issues that could
More informationThe impact of ensemble filter definition on the assimilation of temperature profiles in the tropical Pacific
Q. J. R. Meteorol. Soc. (2005), 131, pp. 3291 3300 doi: 10.1256/qj.05.90 The impact of ensemble filter definition on the assimilation of temperature profiles in the tropical Pacific By O. LEEUWENBURGH
More informationLogistic Regression. Jia Li. Department of Statistics The Pennsylvania State University. Logistic Regression
Logistic Regression Department of Statistics The Pennsylvania State University Email: jiali@stat.psu.edu Logistic Regression Preserve linear classification boundaries. By the Bayes rule: Ĝ(x) = arg max
More informationApplication of Numerical Weather Prediction Models for Drought Monitoring. Gregor Gregorič Jožef Roškar Environmental Agency of Slovenia
Application of Numerical Weather Prediction Models for Drought Monitoring Gregor Gregorič Jožef Roškar Environmental Agency of Slovenia Contents 1. Introduction 2. Numerical Weather Prediction Models -
More informationExtreme Value Modeling for Detection and Attribution of Climate Extremes
Extreme Value Modeling for Detection and Attribution of Climate Extremes Jun Yan, Yujing Jiang Joint work with Zhuo Wang, Xuebin Zhang Department of Statistics, University of Connecticut February 2, 2016
More informationDigital Imaging and Multimedia. Filters. Ahmed Elgammal Dept. of Computer Science Rutgers University
Digital Imaging and Multimedia Filters Ahmed Elgammal Dept. of Computer Science Rutgers University Outlines What are Filters Linear Filters Convolution operation Properties of Linear Filters Application
More informationRainfall generator for the Meuse basin
KNMI publication; 196 - IV Rainall generator or the Meuse basin Description o 20 000-year simulations R. Leander and T.A. Buishand De Bilt, 2008 KNMI publication = KNMI publicatie; 196 - IV De Bilt, 2008
More informationSupervised Learning (Big Data Analytics)
Supervised Learning (Big Data Analytics) Vibhav Gogate Department of Computer Science The University of Texas at Dallas Practical advice Goal of Big Data Analytics Uncover patterns in Data. Can be used
More information