Inference on Phasetype Models via MCMC


 Amberly Harrell
 2 years ago
 Views:
Transcription
1 Inference on Phasetype Models via MCMC with application to networks of repairable redundant systems Louis JM Aslett and Simon P Wilson Trinity College Dublin 28 th June 202
2 Toy Example : Redundant Repairable Components C C2 State Meaning both C and C2 work 2 C failed, C2 working 3 C working, C2 failed 4 system failed a general stochastic process, e.g. Y (t) t System Failed
3 Continuoustime Markov Chain Model C up C2 up State Meaning both C and C2 work 2 C failed, C2 working 3 C working, C2 failed 4 system failed λ r C down C2 up λ f λ f λ u λ f λ f λ r C up C2 down C down C2 down = π = 0 0, T = 2λ f λ f λ f 0 λ r λ r λ f 0 λ f λ r 0 λ r λ f λ f
4 Inferential Setting Cano & Rios (2006) provide conjugate posterior calculations in the context of analysing repairable systems when the stochastic process leading to absorption is observed. Data For each system failure time, one has: Starting state Length of time in each state Number of transitions between each state Ultimate system failure time
5 Inferential Setting Cano & Rios (2006) provide conjugate posterior calculations in the context of analysing repairable systems when the stochastic process leading to absorption is observed. Data For each system failure time, one has: Starting state Length of time in each state Number of transitions between each state Ultimate system failure time Reduced information scenario = Bladt et al. (2003) provide a Bayesian MCMC algorithm, or Asmussen et al. (996) provide a frequentist EM algorithm.
6 Definition of Phasetype Distributions An absorbing continuous time Markov chain is one in which there is a state that, once entered, is never left. That is, the n + state intensity matrix can be written: ( ) S s T = 0 0 where S is n n, s is n and 0 is n, with s = Se Then, a Phasetype distribution (PHT) is defined to be the distribution of the time to entering the absorbing state. F Y (y) = π T exp{ys}e Y PHT(π, S) = f Y (y) = π T exp{ys}s
7 Relating to the Toy Example State Meaning both C and C2 work 2 C failed, C2 working 3 C working, C2 failed 4 system failed = T = λ r C down C2 up λ f λ f C up C2 up λ u λ f C down C2 down 2λ f λ f λ f 0 λ r λ r λ f 0 λ f λ r S0 λ r λ f sλ f λ f λ r C up C2 down f Y (y) = π T exp{ys}s F Y (y) = π T exp{ys}e
8 Bladt et al: Gibbs Sampling from Posterior Strategy is a Gibbs MCMC algorithm which achieves the goal of simulating from p(π, S y) by sampling from through the iterative process p(π, S, paths y) p(π, S paths, y) p(paths π, S, y)
9 Bladt et al: MetropolisHastings Simulation of Process In summary: Can simulate chain from p(path Y i y i ) trivially by rejection sampling. A MetropolisHastings acceptance ratio (ratio of exit rates) exists st truncating chain to time y i (at which point it absorbs) will be a draw from p(path Y i = y i ) MetropolisHastings p(path π, S, Y = y) Rejection Sampling p(path π, S, Y y) CTMC Sampling p(path π, S)
10 Motivation for Modifications Certain state transitions make no physical sense. (eg 2 3 in earlier example) 2 When part of a larger system, it is highly likely there will be censored observations. 3 Where there is no reason to believe distributional differences between parameters, they should (in idealised modelling sense) be constrained to be equal. This is as much to assist with reducing parameter dimensionality. 4 Computation time!
11 Toy Example Results uncensored observations simulated from PHT with S = = λ f =.8, λ r = 9.5 Density Parameter Value Param S2 S3 s2 2 s3 3 λf f
12 Toy Example Results 00 uncensored observations simulated from PHT with S = = λ f =.8, λ r = 9.5 Density Parameter Value Param S2 S3 Rλ r Reliability less sensitive to λ r (Daneshkhah & Bedford 2008)
13 Toy Example Results 2 00 uncensored observations simulated from PHT with S = = λ f =.8, λ r = 9.5 Density Parameter Value Param s S23 S32
14 The Big Issue Intractable computation time for many applications!
15 The Big Issue Intractable computation time for many applications! longer chains and MCMC jumps to states for which observations are far in the tails can stall rejection sampling step of MH algorithm. P(Y i y i π, S) = 0 6 p(π, S paths, y) p(paths π, S, y)
16 The Big Issue Intractable computation time for many applications! longer chains and MCMC jumps to states for which observations are far in the tails can stall rejection sampling step of MH algorithm. P(Y i y i π, S) = 0 6 p(π, S paths, y) p(paths π, S, y) E(RS iter.) = % CI = [2537, ]
17 The Big Issue Intractable computation time for many applications! longer chains and MCMC jumps to states for which observations are far in the tails can stall rejection sampling step of MH algorithm. 2 states from which absorption impossible wasteful to resample whole chain because state at time y i unsuitable for truncation invalid truncation y i simulation
18 The Big Issue Intractable computation time for many applications! longer chains and MCMC jumps to states for which observations are far in the tails can stall rejection sampling step of MH algorithm. 2 states from which absorption impossible wasteful to resample whole chain because state at time y i unsuitable for truncation. State Meaning P(state) both PS working = E(MH iter) = failed, 2 working working, 2 failed % CI = [36, 5267]
19 The Big Issue Intractable computation time for many applications! longer chains and MCMC jumps to states for which observations are far in the tails can stall rejection sampling step of MH algorithm. 2 states from which absorption impossible wasteful to resample whole chain because state at time y i unsuitable for truncation. 3 time for MH algorithm to reach stationarity can grow rapidly. Total Variation Distance Iterations
20 Solution: Exact Conditional Sampling MetropolisHastings p(path π, S, Y = y) Rejection Sampling p(path π, S, Y y) CTMC Sampling p(path π, S)
21 Solution: Exact Conditional Sampling MetropolisHastings i) Starting state ~ discrete p(path π, S, Y = y) Y {0} π ii) Advance time ~ Exponential Rejection Sampling δ Exp( S Y {t},y {t} ) p(path π, S, Y y) iii) Select next state ~ discrete Y {t + δ} { S Y {t}, Y {t} /S Y {t},y {t} } CTMC Sampling iv) If not absorbed, t = t + δ, loop to ii p(path π, S)
22 Solution: Exact Conditional Sampling MetropolisHastings e.g. Starting state mass function changes p(path π, S, Y = y) with conditioning: Rejection Sampling p(path π, S, Y y) P(Y {0} = i π, S) =π i CTMC Sampling p(path p(path π, π, S, Y S) = y) P(Y {0} = i π, S,Y = y) = et i exp{sy}s π i π T exp{sy}s
23 Tail Depth Performance Improvement 0 2 log[time (secs)] Method ECS MH Upper tail probability (0^x)
24 Overall Performance Improvement This shows the new method keeping pace in nice problems and significantly outperforming otherwise. T = ( No problems iiii MH ECS t.6 µs 7.2 µs s t 04 µs 9 µs ) T = ( All problems iiii ) MH ECS 0.2 hours 0.06 secs 9.4 hours 0.05 secs 2,300,000 faster on average in hard problem
25 Networks/Systems of Components Quick overview now of current research focus: inference for networks/systems comprising nodes/components which may be of Phasetype.
26 Networks/Systems of Components Quick overview now of current research focus: inference for networks/systems comprising nodes/components which may be of Phasetype. 2
27 Networks/Systems of Components Quick overview now of current research focus: inference for networks/systems comprising nodes/components which may be of Phasetype. 2 2
28 Networks/Systems of Components Quick overview now of current research focus: inference for networks/systems comprising nodes/components which may be of Phasetype. 2 2
29 Networks/Systems of Components Quick overview now of current research focus: inference for networks/systems comprising nodes/components which may be of Phasetype. 2 2
30 Networks/Systems of Components Quick overview now of current research focus: inference for networks/systems comprising nodes/components which may be of Phasetype. 2 2
31 Networks/Systems of Components Quick overview now of current research focus: inference for networks/systems comprising nodes/components which may be of Phasetype. 2 2
32 Networks/Systems of Components Quick overview now of current research focus: inference for networks/systems comprising nodes/components which may be of Phasetype. 2 2
33 Networks/Systems of Components Quick overview now of current research focus: inference for networks/systems comprising nodes/components which may be of Phasetype. 2
34 Networks/Systems of Components Quick overview now of current research focus: inference for networks/systems comprising nodes/components which may be of Phasetype. 2 3
35 Networks/Systems of Components Quick overview now of current research focus: inference for networks/systems comprising nodes/components which may be of Phasetype. 2 3
36 Networks/Systems of Components Quick overview now of current research focus: inference for networks/systems comprising nodes/components which may be of Phasetype.??? T = t? Again, reduced information setting: overall network failure time, or socalled Masked system lifetime data.
37 Direct Masked System Lifetime Inference Even a very simple setting quite hard to tackle directly. X X 2 X i iid Weibull(scale = α, shape = β) System lifetimes t = {t,..., t n } X 3 F T (t) = ( F X (t) F X2 (t))( F X3 (t)) = L(α, β; t) = m i= { t i β(t i /α) β exp 3(t i /α) β} [ 2 exp {(t i /α) β} { + exp 2(t i /α) β} ] 3 p(α, β t) L(α, β; t)p(α, β) awkward.
38 MCMC Solution (Independent Case) Proposed solution in the tradition of Tanner & Wong (987), since inference easy in the presence of (augmented) component lifetimes. Thus, for X i iid FX ( ; ψ) sample from the natural completion of the posterior distribution: p(ψ, x,..., x n t) by blocked Gibbs sampling using the conditional distributions: p(x,..., x n ψ, t) p(ψ x,..., x n, t) where x i = {x i,..., x im } are the m component failure times for the i th of n systems (x ij = t j some j)
39 p(ψ x,..., x n, t) is now simple Bayesian inference for system lifetime distribution well understood and in Phasetype case, above algorithm slots in here. Problem shifted to sampling p(x,..., x n ψ, t)
40 p(ψ x,..., x n, t) is now simple Bayesian inference for system lifetime distribution well understood and in Phasetype case, above algorithm slots in here. Problem shifted to sampling p(x,..., x n ψ, t) Propose using Samaniego s system signature s j = P(T = X j:n ) e.g. p(x i,..., x im ψ, t) = m {p(x i,..., x im ψ, X j:n = t i ) j= P(T = X j:n ψ, t i )} where ( ) m P(T = X j:n ψ, t i ) s j F X (t i ) j FX (t i ) m j j
41 Algorithm to sample p(x,..., x n ψ, t) For each system i =,..., n: Sample j {,..., m} from the discrete probability distribution defined by the conditioned system signature, P(T = X j:n ψ, t i ). This samples the order statistic indicating that the j th failure caused system failure. 2 Sample: j values, x i,..., x i(j ), from F X X<ti ( ; ψ), the distribution of the component lifetime conditional on failure before t i m j values, x i(j+),..., x in, from F X X>ti ( ; ψ), the distribution of the component lifetime conditional on failure after t i and set x ij = t i. Each iteration provides x i
42 All Systems of 4 Components, Exponential (λ = 0.4) Network Rate
43 Exchangeable Failure Rate Parameters It is straightforward to allow the more general setting of exchangeable failure rate parameters between networks: i X ij T i j =,...,n i =,...,m However, exchangeability within network would break the signaturebased sampling of node failure times so this is probably as general as this particular approach can go.
44 All Systems of 4 Components, Ψ Gam(α = 9, β = 2 ) Network Population Mean of Rate Distribution
45 All Systems of 4 Components, Ψ Gam(α = 9, β = 2 ) Network Population Variance of Rate Distribution
46 Extend to Topological Inference It is now possible to add topology detection to the inferential process.? T = t??? It is simple to sample from p(m ψ, t) as an additional Gibbs update, moving between network topologies. With care, reversible jump between component numbers is also feasible.
47 True Topology with Signature No. 2 (40 observation) 0.25 Posterior Probability Network
48 Asmussen, S., Nerman, O. & Olsson, M. (996), Fitting phasetype distributions via the EM algorithm, Scand. J. Statist. 23(4), Bladt, M., Gonzalez, A. & Lauritzen, S. L. (2003), The estimation of phasetype related functionals using Markov chain Monte Carlo methods, Scand. Actuar. J. 2003(4), Cano, J. & Rios, D. (2006), Reliability forecasting in complex hardware/software systems, Proceedings of the First International Conference on Availability, Reliability and Security (ARES 06). Daneshkhah, A. & Bedford, T. (2008), Sensitivity analysis of a reliability system using gaussian processes, in T. Bedford, ed., Advances in Mathematical Modeling for Reliability, IOS Press, pp Tanner, M. A. & Wong, W. H. (987), The calculation of posterior distributions by data augmentation, Journal of the American Statistical Association 82(398),
Markov Chain Monte Carlo Simulation Made Simple
Markov Chain Monte Carlo Simulation Made Simple Alastair Smith Department of Politics New York University April2,2003 1 Markov Chain Monte Carlo (MCMC) simualtion is a powerful technique to perform numerical
More informationBayesian Statistics in One Hour. Patrick Lam
Bayesian Statistics in One Hour Patrick Lam Outline Introduction Bayesian Models Applications Missing Data Hierarchical Models Outline Introduction Bayesian Models Applications Missing Data Hierarchical
More informationGaussian Processes to Speed up Hamiltonian Monte Carlo
Gaussian Processes to Speed up Hamiltonian Monte Carlo Matthieu Lê Murray, Iain http://videolectures.net/mlss09uk_murray_mcmc/ Rasmussen, Carl Edward. "Gaussian processes to speed up hybrid Monte Carlo
More informationBayesian Techniques for Parameter Estimation. He has Van Gogh s ear for music, Billy Wilder
Bayesian Techniques for Parameter Estimation He has Van Gogh s ear for music, Billy Wilder Statistical Inference Goal: The goal in statistical inference is to make conclusions about a phenomenon based
More informationA Bootstrap MetropolisHastings Algorithm for Bayesian Analysis of Big Data
A Bootstrap MetropolisHastings Algorithm for Bayesian Analysis of Big Data Faming Liang University of Florida August 9, 2015 Abstract MCMC methods have proven to be a very powerful tool for analyzing
More informationIntroduction to Markov chain Monte Carlo with examples from Bayesian statistics
Introduction to Markov chain Monte Carlo with examples from Bayesian statistics First winter school in escience Geilo, Wednesday January 31st 2007 Håkon Tjelmeland Department of Mathematical Sciences Norwegian
More informationTutorial on Markov Chain Monte Carlo
Tutorial on Markov Chain Monte Carlo Kenneth M. Hanson Los Alamos National Laboratory Presented at the 29 th International Workshop on Bayesian Inference and Maximum Entropy Methods in Science and Technology,
More informationPosterior probability!
Posterior probability! P(x θ): old name direct probability It gives the probability of contingent events (i.e. observed data) for a given hypothesis (i.e. a model with known parameters θ) L(θ)=P(x θ):
More informationIntroduction to Monte Carlo. Astro 542 Princeton University Shirley Ho
Introduction to Monte Carlo Astro 542 Princeton University Shirley Ho Agenda Monte Carlo  definition, examples Sampling Methods (Rejection, Metropolis, MetropolisHasting, Exact Sampling) Markov Chains
More informationParallelization Strategies for Multicore Data Analysis
Parallelization Strategies for Multicore Data Analysis WeiChen Chen 1 Russell Zaretzki 2 1 University of Tennessee, Dept of EEB 2 University of Tennessee, Dept. Statistics, Operations, and Management
More informationEC 6310: Advanced Econometric Theory
EC 6310: Advanced Econometric Theory July 2008 Slides for Lecture on Bayesian Computation in the Nonlinear Regression Model Gary Koop, University of Strathclyde 1 Summary Readings: Chapter 5 of textbook.
More informationIntroduction to Markov Chain Monte Carlo
Introduction to Markov Chain Monte Carlo Monte Carlo: sample from a distribution to estimate the distribution to compute max, mean Markov Chain Monte Carlo: sampling using local information Generic problem
More informationDirichlet Processes A gentle tutorial
Dirichlet Processes A gentle tutorial SELECT Lab Meeting October 14, 2008 Khalid ElArini Motivation We are given a data set, and are told that it was generated from a mixture of Gaussian distributions.
More informationProbabilistic Models for Big Data. Alex Davies and Roger Frigola University of Cambridge 13th February 2014
Probabilistic Models for Big Data Alex Davies and Roger Frigola University of Cambridge 13th February 2014 The State of Big Data Why probabilistic models for Big Data? 1. If you don t have to worry about
More informationSpatial Statistics Chapter 3 Basics of areal data and areal data modeling
Spatial Statistics Chapter 3 Basics of areal data and areal data modeling Recall areal data also known as lattice data are data Y (s), s D where D is a discrete index set. This usually corresponds to data
More information11. Time series and dynamic linear models
11. Time series and dynamic linear models Objective To introduce the Bayesian approach to the modeling and forecasting of time series. Recommended reading West, M. and Harrison, J. (1997). models, (2 nd
More informationheavytailed insurance claim size distribution
Bayesian estimation of ruin probabilities with heterogeneous and heavytailed insurance claim size distribution M. Concepcion Ausin Department of Mathematics University of A Coruña, Spain mausin@udc.es
More informationbayesian inference: principles and practice
bayesian inference: and http://jakehofman.com july 9, 2009 bayesian inference: and motivation background bayes theorem bayesian probability bayesian inference would like models that: provide predictive
More informationAn Introduction to Using WinBUGS for CostEffectiveness Analyses in Health Economics
Slide 1 An Introduction to Using WinBUGS for CostEffectiveness Analyses in Health Economics Dr. Christian Asseburg Centre for Health Economics Part 1 Slide 2 Talk overview Foundations of Bayesian statistics
More informationLecture 6: The Bayesian Approach
Lecture 6: The Bayesian Approach What Did We Do Up to Now? We are given a model Loglinear model, Markov network, Bayesian network, etc. This model induces a distribution P(X) Learning: estimate a set
More informationBayesian Statistics: Indian Buffet Process
Bayesian Statistics: Indian Buffet Process Ilker Yildirim Department of Brain and Cognitive Sciences University of Rochester Rochester, NY 14627 August 2012 Reference: Most of the material in this note
More informationSTA 4273H: Statistical Machine Learning
STA 4273H: Statistical Machine Learning Russ Salakhutdinov Department of Statistics! rsalakhu@utstat.toronto.edu! http://www.cs.toronto.edu/~rsalakhu/ Lecture 6 Three Approaches to Classification Construct
More informationModelbased Synthesis. Tony O Hagan
Modelbased Synthesis Tony O Hagan Stochastic models Synthesising evidence through a statistical model 2 Evidence Synthesis (Session 3), Helsinki, 28/10/11 Graphical modelling The kinds of models that
More informationOptimizing Prediction with Hierarchical Models: Bayesian Clustering
1 Technical Report 06/93, (August 30, 1993). Presidencia de la Generalidad. Caballeros 9, 46001  Valencia, Spain. Tel. (34)(6) 386.6138, Fax (34)(6) 386.3626, email: bernardo@mac.uv.es Optimizing Prediction
More informationBayesian analysis of nongaussian LongRange Dependent processes
Bayesian analysis of nongaussian LongRange Dependent processes Tim Graves 1, Christian Franzke 2, Nick Watkins 2, and Bobby Gramacy 3 Statistical Laboratory, University of Cambridge, Cambridge, UK British
More informationAN ACCESSIBLE TREATMENT OF MONTE CARLO METHODS, TECHNIQUES, AND APPLICATIONS IN THE FIELD OF FINANCE AND ECONOMICS
Brochure More information from http://www.researchandmarkets.com/reports/2638617/ Handbook in Monte Carlo Simulation. Applications in Financial Engineering, Risk Management, and Economics. Wiley Handbooks
More informationSampling via Moment Sharing: A New Framework for Distributed Bayesian Inference for Big Data
Sampling via Moment Sharing: A New Framework for Distributed Bayesian Inference for Big Data (Oxford) in collaboration with: Minjie Xu, Jun Zhu, Bo Zhang (Tsinghua) Balaji Lakshminarayanan (Gatsby) Bayesian
More informationBasics of Statistical Machine Learning
CS761 Spring 2013 Advanced Machine Learning Basics of Statistical Machine Learning Lecturer: Xiaojin Zhu jerryzhu@cs.wisc.edu Modern machine learning is rooted in statistics. You will find many familiar
More informationConsidering covariates in the covariance structure of spatial processes
Considering covariates in the covariance structure of spatial processes Alexandra M. Schmidt Universidade Federal do Rio de Janeiro, Brazil Peter Guttorp University of Washington, USA and Norwegian Computing
More informationBayesian Machine Learning (ML): Modeling And Inference in Big Data. Zhuhua Cai Google, Rice University caizhua@gmail.com
Bayesian Machine Learning (ML): Modeling And Inference in Big Data Zhuhua Cai Google Rice University caizhua@gmail.com 1 Syllabus Bayesian ML Concepts (Today) Bayesian ML on MapReduce (Next morning) Bayesian
More informationDURATION ANALYSIS OF FLEET DYNAMICS
DURATION ANALYSIS OF FLEET DYNAMICS Garth Holloway, University of Reading, garth.holloway@reading.ac.uk David Tomberlin, NOAA Fisheries, david.tomberlin@noaa.gov ABSTRACT Though long a standard technique
More informationMarkov Chain Monte Carlo
CS731 Spring 2011 Advanced Artificial Intelligence Markov Chain Monte Carlo Lecturer: Xiaojin Zhu jerryzhu@cs.wisc.edu A fundamental problem in machine learning is to generate samples from a distribution:
More informationBayesian analysis of aggregate loss models.
Bayesian analysis of aggregate loss models. M. C. Ausín,J.M.Vilar,R.CaoandC.GonzálezFragueiro. Department of Mathematics, Universidade da Coruña Abstract This paper describes a Bayesian approach to make
More informationEstimating the evidence for statistical models
Estimating the evidence for statistical models Nial Friel University College Dublin nial.friel@ucd.ie March, 2011 Introduction Bayesian model choice Given data y and competing models: m 1,..., m l, each
More informationImperfect Debugging in Software Reliability
Imperfect Debugging in Software Reliability Tevfik Aktekin and Toros Caglar University of New Hampshire Peter T. Paul College of Business and Economics Department of Decision Sciences and United Health
More information2WB05 Simulation Lecture 8: Generating random variables
2WB05 Simulation Lecture 8: Generating random variables Marko Boon http://www.win.tue.nl/courses/2wb05 January 7, 2013 Outline 2/36 1. How do we generate random variables? 2. Fitting distributions Generating
More information38. STATISTICS. 38. Statistics 1. 38.1. Fundamental concepts
38. Statistics 1 38. STATISTICS Revised September 2013 by G. Cowan (RHUL). This chapter gives an overview of statistical methods used in highenergy physics. In statistics, we are interested in using a
More informationEstimation and comparison of multiple changepoint models
Journal of Econometrics 86 (1998) 221 241 Estimation and comparison of multiple changepoint models Siddhartha Chib* John M. Olin School of Business, Washington University, 1 Brookings Drive, Campus Box
More informationSampling for Bayesian computation with large datasets
Sampling for Bayesian computation with large datasets Zaiying Huang Andrew Gelman April 27, 2005 Abstract Multilevel models are extremely useful in handling large hierarchical datasets. However, computation
More informationMarkov Chains and Applications
Markov Chains and Applications Alexander Volfovsky August 7, 2007 Abstract In this paper I provide a quick overview of Stochastic processes and then quickly delve into a discussion of Markov Chains. There
More informationMonte Carlo and Empirical Methods for Stochastic Inference (MASM11/FMS091)
Monte Carlo and Empirical Methods for Stochastic Inference (MASM11/FMS091) Magnus Wiktorsson Centre for Mathematical Sciences Lund University, Sweden Lecture 5 Sequential Monte Carlo methods I February
More informationSamplingbased optimization
Samplingbased optimization Richard Combes October 11, 2013 The topic of this lecture is a family of mathematical techniques called samplingbased methods. These methods are called sampling mathods because
More informationStatistical Machine Learning from Data
Samy Bengio Statistical Machine Learning from Data 1 Statistical Machine Learning from Data Gaussian Mixture Models Samy Bengio IDIAP Research Institute, Martigny, Switzerland, and Ecole Polytechnique
More informationM. CONCEPCION AUSIN 1 AND HEDIBERT F. LOPES 2
Aust.N.Z.J.Stat.49(4, 2007, 415 434 doi: 10.1111/j.1467842X.2007.00492.x BAYESIAN ESTIMATION OF RUIN PROBABILITIES WITH A HETEROGENEOUS AND HEAVYTAILED INSURANCE CLAIMSIZE DISTRIBUTION M. CONCEPCION
More informationHandbook in. Monte Carlo Simulation. Applications in Financial Engineering, Risk Management, and Economics
Handbook in Monte Carlo Simulation Applications in Financial Engineering, Risk Management, and Economics PAOLO BRANDIMARTE Department of Mathematical Sciences Politecnico di Torino Torino, Italy WlLEY
More informationMS&E 226: Small Data
MS&E 226: Small Data Lecture 16: Bayesian inference (v3) Ramesh Johari ramesh.johari@stanford.edu 1 / 35 Priors 2 / 35 Frequentist vs. Bayesian inference Frequentists treat the parameters as fixed (deterministic).
More informationMonte Carlobased statistical methods (MASM11/FMS091)
Monte Carlobased statistical methods (MASM11/FMS091) Jimmy Olsson Centre for Mathematical Sciences Lund University, Sweden Lecture 5 Sequential Monte Carlo methods I February 5, 2013 J. Olsson Monte Carlobased
More informationComputational Statistics for Big Data
Lancaster University Computational Statistics for Big Data Author: 1 Supervisors: Paul Fearnhead 1 Emily Fox 2 1 Lancaster University 2 The University of Washington September 1, 2015 Abstract The amount
More informationBayesX  Software for Bayesian Inference in Structured Additive Regression
BayesX  Software for Bayesian Inference in Structured Additive Regression Thomas Kneib Faculty of Mathematics and Economics, University of Ulm Department of Statistics, LudwigMaximiliansUniversity Munich
More information1 Simulating Brownian motion (BM) and geometric Brownian motion (GBM)
Copyright c 2013 by Karl Sigman 1 Simulating Brownian motion (BM) and geometric Brownian motion (GBM) For an introduction to how one can construct BM, see the Appendix at the end of these notes A stochastic
More informationα α λ α = = λ λ α ψ = = α α α λ λ ψ α = + β = > θ θ β > β β θ θ θ β θ β γ θ β = γ θ > β > γ θ β γ = θ β = θ β = θ β = β θ = β β θ = = = β β θ = + α α α α α = = λ λ λ λ λ λ λ = λ λ α α α α λ ψ + α =
More informationMANBITESDOG BUSINESS CYCLES ONLINE APPENDIX
MANBITESDOG BUSINESS CYCLES ONLINE APPENDIX KRISTOFFER P. NIMARK The next section derives the equilibrium expressions for the beauty contest model from Section 3 of the main paper. This is followed by
More informationProgramma della seconda parte del corso
Programma della seconda parte del corso Introduction Reliability Performance Risk Software Performance Engineering Layered Queueing Models Stochastic Petri Nets New trends in software modeling: Metamodeling,
More informationStatistical Machine Learning
Statistical Machine Learning UoC Stats 37700, Winter quarter Lecture 4: classical linear and quadratic discriminants. 1 / 25 Linear separation For two classes in R d : simple idea: separate the classes
More informationMarkov chains and Markov Random Fields (MRFs)
Markov chains and Markov Random Fields (MRFs) 1 Why Markov Models We discuss Markov models now. This is the simplest statistical model in which we don t assume that all variables are independent; we assume
More informationReliability estimators for the components of series and parallel systems: The Weibull model
Reliability estimators for the components of series and parallel systems: The Weibull model Felipe L. Bhering 1, Carlos Alberto de Bragança Pereira 1, Adriano Polpo 2 1 Department of Statistics, University
More informationValidation of Software for Bayesian Models using Posterior Quantiles. Samantha R. Cook Andrew Gelman Donald B. Rubin DRAFT
Validation of Software for Bayesian Models using Posterior Quantiles Samantha R. Cook Andrew Gelman Donald B. Rubin DRAFT Abstract We present a simulationbased method designed to establish that software
More informationPortfolio Distribution Modelling and Computation. Harry Zheng Department of Mathematics Imperial College h.zheng@imperial.ac.uk
Portfolio Distribution Modelling and Computation Harry Zheng Department of Mathematics Imperial College h.zheng@imperial.ac.uk Workshop on Fast Financial Algorithms Tanaka Business School Imperial College
More informationAdvanced Statistical Computing Fall Steve Qin
Advanced Statistical Computing Fall 2016 Steve Qin Outline Today Introduction to Monte Carlo strategy and methods, Random number generation, Importance sampling. 2 MCMC Next lectures Gibbs Sampler, MetropolisHastings
More informationRecent Developments of Statistical Application in. Finance. Ruey S. Tsay. Graduate School of Business. The University of Chicago
Recent Developments of Statistical Application in Finance Ruey S. Tsay Graduate School of Business The University of Chicago Guanghua Conference, June 2004 Summary Focus on two parts: Applications in Finance:
More informationInference and Analysis of Climate Models via Bayesian Approaches
Inference and Analysis of Climate Models via Bayesian Approaches Gabriel Huerta Department of Mathematics and Statistics University of New Mexico http://math.unm.edu joint work with Charles Jackson (UTAustin)
More informationABC methods for model choice in Gibbs random fields
ABC methods for model choice in Gibbs random fields JeanMichel Marin Institut de Mathématiques et Modélisation Université Montpellier 2 Joint work with Aude Grelaud, Christian Robert, François Rodolphe,
More informationMonte Carlo Simulation
1 Monte Carlo Simulation Stefan Weber Leibniz Universität Hannover email: sweber@stochastik.unihannover.de web: www.stochastik.unihannover.de/ sweber Monte Carlo Simulation 2 Quantifying and Hedging
More informationBAYESIAN ECONOMETRICS
BAYESIAN ECONOMETRICS VICTOR CHERNOZHUKOV Bayesian econometrics employs Bayesian methods for inference about economic questions using economic data. In the following, we briefly review these methods and
More informationWebbased Supplementary Materials for Bayesian Effect Estimation. Accounting for Adjustment Uncertainty by Chi Wang, Giovanni
1 Webbased Supplementary Materials for Bayesian Effect Estimation Accounting for Adjustment Uncertainty by Chi Wang, Giovanni Parmigiani, and Francesca Dominici In Web Appendix A, we provide detailed
More informationC: LEVEL 800 {MASTERS OF ECONOMICS( ECONOMETRICS)}
C: LEVEL 800 {MASTERS OF ECONOMICS( ECONOMETRICS)} 1. EES 800: Econometrics I Simple linear regression and correlation analysis. Specification and estimation of a regression model. Interpretation of regression
More informationLinear Classification. Volker Tresp Summer 2015
Linear Classification Volker Tresp Summer 2015 1 Classification Classification is the central task of pattern recognition Sensors supply information about an object: to which class do the object belong
More informationParameter estimation for nonlinear models: Numerical approaches to solving the inverse problem. Lecture 12 04/08/2008. Sven Zenker
Parameter estimation for nonlinear models: Numerical approaches to solving the inverse problem Lecture 12 04/08/2008 Sven Zenker Assignment no. 8 Correct setup of likelihood function One fixed set of observation
More informationNeural Networks. CAP5610 Machine Learning Instructor: GuoJun Qi
Neural Networks CAP5610 Machine Learning Instructor: GuoJun Qi Recap: linear classifier Logistic regression Maximizing the posterior distribution of class Y conditional on the input vector X Support vector
More informationA LOGNORMAL MODEL FOR INSURANCE CLAIMS DATA
REVSTAT Statistical Journal Volume 4, Number 2, June 2006, 131 142 A LOGNORMAL MODEL FOR INSURANCE CLAIMS DATA Authors: Daiane Aparecida Zuanetti Departamento de Estatística, Universidade Federal de São
More informationMonte Carlobased statistical methods (MASM11/FMS091)
Monte Carlobased statistical methods (MASM11/FMS091) Jimmy Olsson Centre for Mathematical Sciences Lund University, Sweden Lecture 6 Sequential Monte Carlo methods II February 3, 2012 Changes in HA1 Problem
More informationMeasuring the tracking error of exchange traded funds: an unobserved components approach
Measuring the tracking error of exchange traded funds: an unobserved components approach Giuliano De Rossi Quantitative analyst +44 20 7568 3072 UBS Investment Research June 2012 Analyst Certification
More informationMore details on the inputs, functionality, and output can be found below.
Overview: The SMEEACT (Software for More Efficient, Ethical, and Affordable Clinical Trials) web interface (http://research.mdacc.tmc.edu/smeeactweb) implements a single analysis of a twoarmed trial comparing
More informationSupplement to Regional climate model assessment. using statistical upscaling and downscaling techniques
Supplement to Regional climate model assessment using statistical upscaling and downscaling techniques Veronica J. Berrocal 1,2, Peter F. Craigmile 3, Peter Guttorp 4,5 1 Department of Biostatistics, University
More informationFinite Markov Chains and Algorithmic Applications. Matematisk statistik, Chalmers tekniska högskola och Göteborgs universitet
Finite Markov Chains and Algorithmic Applications Olle Häggström Matematisk statistik, Chalmers tekniska högskola och Göteborgs universitet PUBLISHED BY THE PRESS SYNDICATE OF THE UNIVERSITY OF CAMBRIDGE
More informationBAYESIAN ANALYSIS OF AN AGGREGATE CLAIM MODEL USING VARIOUS LOSS DISTRIBUTIONS. by Claire Dudley
BAYESIAN ANALYSIS OF AN AGGREGATE CLAIM MODEL USING VARIOUS LOSS DISTRIBUTIONS by Claire Dudley A dissertation submitted for the award of the degree of Master of Science in Actuarial Management School
More informationBayesian Learning. CSL465/603  Fall 2016 Narayanan C Krishnan
Bayesian Learning CSL465/603  Fall 2016 Narayanan C Krishnan ckn@iitrpr.ac.in Outline Bayes Theorem MAP Learners Bayes optimal classifier Naïve Bayes classifier Example text classification Bayesian networks
More informationExamining credit card consumption pattern
Examining credit card consumption pattern Yuhao Fan (Economics Department, Washington University in St. Louis) Abstract: In this paper, I analyze the consumer s credit card consumption data from a commercial
More informationProbabilistic Fitting
Probabilistic Fitting Shape Modeling April 2016 Sandro Schönborn University of Basel 1 Probabilistic Inference for Face Model Fitting Approximate Inference with Markov Chain Monte Carlo 2 Face Image Manipulation
More informationArtificial Intelligence Mar 27, Bayesian Networks 1 P (T D)P (D) + P (T D)P ( D) =
Artificial Intelligence 15381 Mar 27, 2007 Bayesian Networks 1 Recap of last lecture Probability: precise representation of uncertainty Probability theory: optimal updating of knowledge based on new information
More informationMCMC Using Hamiltonian Dynamics
5 MCMC Using Hamiltonian Dynamics Radford M. Neal 5.1 Introduction Markov chain Monte Carlo (MCMC) originated with the classic paper of Metropolis et al. (1953), where it was used to simulate the distribution
More informationHT2015: SC4 Statistical Data Mining and Machine Learning
HT2015: SC4 Statistical Data Mining and Machine Learning Dino Sejdinovic Department of Statistics Oxford http://www.stats.ox.ac.uk/~sejdinov/sdmml.html Bayesian Nonparametrics Parametric vs Nonparametric
More informationNonparametric adaptive age replacement with a onecycle criterion
Nonparametric adaptive age replacement with a onecycle criterion P. CoolenSchrijner, F.P.A. Coolen Department of Mathematical Sciences University of Durham, Durham, DH1 3LE, UK email: Pauline.Schrijner@durham.ac.uk
More informationContinuous Time Markov Chains
Continuous Time Markov Chains Dan Crytser March 11, 2011 1 Introduction The theory of Markov chains of the discrete form X 1, X 2,... can be adapted to a continuous form X t, t [0, ). This requires use
More informationBayesian Methods. 1 The Joint Posterior Distribution
Bayesian Methods Every variable in a linear model is a random variable derived from a distribution function. A fixed factor becomes a random variable with possibly a uniform distribution going from a lower
More informationTopic models for Sentiment analysis: A Literature Survey
Topic models for Sentiment analysis: A Literature Survey Nikhilkumar Jadhav 123050033 June 26, 2014 In this report, we present the work done so far in the field of sentiment analysis using topic models.
More informationMarkov Chains. Chapter Introduction and Definitions 110SOR201(2002)
page 5 SOR() Chapter Markov Chains. Introduction and Definitions Consider a sequence of consecutive times ( or trials or stages): n =,,,... Suppose that at each time a probabilistic experiment is performed,
More informationParametric fractional imputation for missing data analysis
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 Biometrika (????,??,?, pp. 1 14 C???? Biometrika Trust Printed in
More informationIntroduction to Mobile Robotics Bayes Filter Particle Filter and Monte Carlo Localization
Introduction to Mobile Robotics Bayes Filter Particle Filter and Monte Carlo Localization Wolfram Burgard, Maren Bennewitz, Diego Tipaldi, Luciano Spinello 1 Motivation Recall: Discrete filter Discretize
More informationChapter 9: Hypothesis Testing Sections
Chapter 9: Hypothesis Testing Sections 9.1 Problems of Testing Hypotheses Skip: 9.2 Testing Simple Hypotheses Skip: 9.3 Uniformly Most Powerful Tests Skip: 9.4 TwoSided Alternatives 9.5 The t Test 9.6
More informationEstimating survival functions has interested statisticians for numerous years.
ZHAO, GUOLIN, M.A. Nonparametric and Parametric Survival Analysis of Censored Data with Possible Violation of Method Assumptions. (2008) Directed by Dr. Kirsten Doehler. 55pp. Estimating survival functions
More informationModeling the Distribution of Environmental Radon Levels in Iowa: Combining Multiple Sources of Spatially Misaligned Data
Modeling the Distribution of Environmental Radon Levels in Iowa: Combining Multiple Sources of Spatially Misaligned Data Brian J. Smith, Ph.D. The University of Iowa Joint Statistical Meetings August 10,
More informationA Tutorial on Particle Filters for Online Nonlinear/NonGaussian Bayesian Tracking
174 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 50, NO. 2, FEBRUARY 2002 A Tutorial on Particle Filters for Online Nonlinear/NonGaussian Bayesian Tracking M. Sanjeev Arulampalam, Simon Maskell, Neil
More informationProbabilistic Methods for TimeSeries Analysis
Probabilistic Methods for TimeSeries Analysis 2 Contents 1 Analysis of Changepoint Models 1 1.1 Introduction................................ 1 1.1.1 Model and Notation....................... 2 1.1.2 Example:
More informationCredit Risk Models: An Overview
Credit Risk Models: An Overview Paul Embrechts, Rüdiger Frey, Alexander McNeil ETH Zürich c 2003 (Embrechts, Frey, McNeil) A. Multivariate Models for Portfolio Credit Risk 1. Modelling Dependent Defaults:
More informationFinal Mathematics 5010, Section 1, Fall 2004 Instructor: D.A. Levin
Final Mathematics 51, Section 1, Fall 24 Instructor: D.A. Levin Name YOU MUST SHOW YOUR WORK TO RECEIVE CREDIT. A CORRECT ANSWER WITHOUT SHOWING YOUR REASONING WILL NOT RECEIVE CREDIT. Problem Points Possible
More informationPattern Analysis. Logistic Regression. 12. Mai 2009. Joachim Hornegger. Chair of Pattern Recognition Erlangen University
Pattern Analysis Logistic Regression 12. Mai 2009 Joachim Hornegger Chair of Pattern Recognition Erlangen University Pattern Analysis 2 / 43 1 Logistic Regression Posteriors and the Logistic Function Decision
More informationOptimal Stopping in Software Testing
Optimal Stopping in Software Testing Nilgun Morali, 1 Refik Soyer 2 1 Department of Statistics, Dokuz Eylal Universitesi, Turkey 2 Department of Management Science, The George Washington University, 2115
More informationStatistics Graduate Courses
Statistics Graduate Courses STAT 7002Topics in StatisticsBiological/Physical/Mathematics (cr.arr.).organized study of selected topics. Subjects and earnable credit may vary from semester to semester.
More informationSPECTRAL POLYNOMIAL ALGORITHMS FOR COMPUTING BIDIAGONAL REPRESENTATIONS FOR PHASE TYPE DISTRIBUTIONS AND MATRIXEXPONENTIAL DISTRIBUTIONS
Stochastic Models, 22:289 317, 2006 Copyright Taylor & Francis Group, LLC ISSN: 15326349 print/15324214 online DOI: 10.1080/15326340600649045 SPECTRAL POLYNOMIAL ALGORITHMS FOR COMPUTING BIDIAGONAL
More information