Probabilistic Fitting
|
|
- Bryan Elliott
- 7 years ago
- Views:
Transcription
1 Probabilistic Fitting Shape Modeling April 2016 Sandro Schönborn University of Basel 1
2 Probabilistic Inference for Face Model Fitting Approximate Inference with Markov Chain Monte Carlo 2
3 Face Image Manipulation 3
4 Probabilistic Registration Model-based image registration Probabilistic framework of Gaussian Processes Combination? Probabilistic registration? 4
5 Face Model Fitting Target: 2D face image More difficulties: pose, illumination, color n Deformation h is now a complicated function 5
6 Goal: Fit the 3D Morphable Model of Faces 3D face model: Color model: I $ + h & Shape model: I $ h ( 3DMM: I $ + h & h ( 3D-2D computer graphics: x *+ = T./0 Pr T 34 S x 3+ Rigid 3D T 34, transform in image T./0 Projection Pr x = x/z y/z I x *+ = C < L n x 3+, C x 3+, x 3+ Normal n, Color transform C < c, illumination L n, c, x Corresponding x *+ and x 3+ 6
7 Overview Probabilistic Setup & Bayesian Inference Approximate Inference with Sampling Markov Chain Monte Carlo 3D Fitting Problem Landmarks Computer Graphics Overview 2D Face Image Analysis Filtering with unreliable information 7
8 Posterior vs. Optimization Registration, so far optimized (MAP): p h I B, I $ p h p I B h, I $ ) h = arg max K p h p I B h, I $ ) But it is actually a distribution: p h I B, I $ ( posterior ) Each solution is assigned a certain degree of belief Bayesian inference 8
9 Bayesian Inference Probability to express beliefs: credibility we assign a hypothesis, based on our current knowledge Observations change our knowledge -> beliefs change too! Bayes rule to update beliefs: p q p q D p q D, D * p q D, D *, D 3 p q D = p D q p D p q = p D q p q p D q p q dq Posterior becomes prior of next inference step 9
10 Example: Coin Toss With prior knowledge to capture prior beliefs No point estimate but posterior distribution Likelihood of observation HHH Prior p q HHH = V W p HHH q p(q) p HHH q p(q)dq Belief update with Bayes rule Posterior : Whole distribution available to express our knowledge about q! 10
11 Estimation Overview Maximum Likelihood: Single value Maximum of likelihood only Maximum-A-Posteriori: Single value Maximum of posterior distribution regularized Bayes Whole posterior distribution Belief update (Bayes rule, Bayesian inference ) Captures uncertainty qx = arg max l(q; D) Y qx = arg max Y l q;d p(q) l q; D p(q) p(q D) = l q;d p q dq 11
12 3D Morphable Model: Probabilistic Setup Prior: deformations of the mean face: p h Shape & Color: h ~ GP μ, k : h b μ + d α f α ~ N(0, E i ) i f λ f Φ f Pose (camera setup), illumination, color transform: all independent Likelihood: p I B α, I $ ) parameterization: low-rank models 12
13 3DMM Posterior Posterior captures the plausibility of each solution p θ I B, I $ = p θ p I B θ, I $ ) dθp θ p I B θ, I $ ) Intractable posterior! Integration over complete parameter space! But expensive, point-wise and unnormalized evaluation is possible: p θ I B, I $ p θ p I B θ, I $ ) 13
14 Intractable Posteriors Cannot be represented in closed form Normalization often intractable in Bayesian setting p θ D = l(θ; D) p(θ) N(D) N D = n l(θ; D)p(θ)dθ Models are often designed to keep the posterior tractable For example through conjugate priors: posterior has same form as prior Is MAP the only option? No! Approximate posterior with tractable function l θ; D = p(d θ) 14
15 Approximate Bayesian Inference Variational methods Function approximation q(θ) arg max KL(q(θ) p(θ D)) Y Variational Message Passing, Mean- Field Theory, Moment matching, Sampling methods Numeric approximations through simulation Monte Carlo, Importance sampling, Particle Filters, MCMC, KL: Kullback-Leibler divergence 15
16 Sampling Methods Simulate a distribution p through random samples x f Evaluate expectations E f x = n f x p x dx s E f x fq = 1 N d f x f, x f ~ p x V fq ~ O 1 N f This is difficult! Independent of dimensionality More samples increase accuracy 16
17 Sampling from A Distribution Easy for standard distributions is it? Uniform Gaussian How to sample from more complex distributions? Beta, Exponential, Chi square, Gamma, Target posteriors are very often not in a nice standard text book form Sadly, only very few distributions are easy to sample from We need to sample from an unknown posterior with only unnormalized, expensive point-wise evaluation L General Samplers? Yes! Rejection, Importance, MCMC Random.nextDouble() Random.nextGaussian() 17
18 Markov Chain Monte Carlo Markov Chain Monte Carlo Methods (MCMC) Design a Markov Chain such that samples x obey the target distribution p Concept: Use an already existing sample to produce the next one Very powerful general sampling methods Many successful practical applications Proven: developed in the 1950/1970ies (Metropolis/Hastings) Recent: direct mapping of computing power to approximation accuracy Algorithms (buzz words): Metropolis/-Hastings, Gibbs, Slice Sampling 18
19 Markov Chain Sequence of random variables X f fwv s, X f S with joint distribution P X V,X *,, X s = P X V z P(X f X f{v ) s fw* State space Initial distribution Transition probability Simplifications: (for our analysis) Discrete state space: S = {1, 2,, K} Homogeneous Chain: P X f = l X f{v = m = T ƒ 19
20 Example: Markov Chain Simple weather model: dry (D) or rainy (R) hour State space S = {D, R} Condition in next hour? X V Stochastic: P(X V X ) Simple: depends only on current condition X Draw Samples from chain: Initial: X W = D Evolution: P X V X Long-term Behavior Does it converge? Average probability of rain? Dynamics? DDDDDDDDRRRRRRRRRRRDDDDDDDDDDD DDDDDDDDDDDDDDDDDDDDDDDDDDDDDD DDDDDDDDDRDD... 20
21 Discrete Homogeneous Markov Chain Formally linear algebra: Distribution (vector): P X f : p i = P(X f = 1) P(X f = K) Transition probability (transition matrix): P 1 1 P 1 K P X f X f{v : T = P K 1 P K K T ƒ = P l m = P X f = l X f{v = m 21
22 Evolution of the Initial Distribution Evolution of P X V P(X * ): P X * = l = d P l m P X V = m ƒ p* = Tp V Evolution of n steps: ( Is there a stable distribution p? p V = T p V p = Tp Eigenvector of T to eigenvalue λ = 1 22
23 Steady-State Distribution: p It exists: T subject to normalization constraint: left eigenvector to eigenvalue 1 d T ƒ = T = 1 1 T has eigenvalue λ = 1 (left-/right eigenvalues are the same) Steady-state distribution as corresponding right eigenvector Tp = p Does an arbitrary initial distribution evolve to p? Convergence? Uniqueness? 23
24 Equilibrium Distribution: p Additional requirement for T: T ƒ > 0 for n > N W The chain is called irreducible and aperiodic (implies ergodic) All states are connected using at most N W steps Return intervals to a certain state are irregular Perron-Frobenius theorem for positive matrices: PF1: λ V = 1 is a simple eigenvalue with 1d eigenspace (uniqueness) PF2: λ V = 1 is dominant, all λ f < 1, i 1 (convergence) p is a stable attractor, called equilibrium distribution Tp = p 24
25 Convergence Time evolution of arbitrary distribution p W p = T p W Expand p W in Eigen basis of T: Te f = λ f e f, λ f < λ V = 1, λ λ V œ p W = d c f e f f œ Tp W = d c f λ f e f f T p W = d c f λ f e f f = c V e V + λ * c * e * + λ 3 c 3 e
26 Convergence (II) T p W = d c f λ f e f (n 1) Convergence: f p + λ * c * e * = c V e 1 + λ * c * e * + λ 3 c 3 e 3 + T p W Ÿ p Rate of convergence: p p λ * c * e * = λ * c * c V e 1 = p Normalizations: e V = 1 f p f = 1 26
27 Example: Weather Dynamics Rain forecast for stable versus mixed weather: W = stable mixed W ƒ = p = 0.8 Long-term average 0.2 p = 0.8 probability of rain: 20% 0.2 Eigenvalues: 1, 0.75 Eigenvalues: 1, 0.25 Rainy now, next hours? RRRRDDDDDDDDDDDD DDDDDDDDDDDDD... Rainy now, next hours? RDDDDDDDDDDDDDDD RDDDRDDDDDDDD... 27
28 Detailed Balance Detailed Balance is a local equilibrium Distribution p satisfies detailed balance if the total flow of probability between every pair of states is equal, the chain is then reversible: P l m p m = P m l p(l) Detailed balance implies: p is the equilibrium distribution Tp = d T ƒ p ƒ ƒ = d T ƒ p ƒ = p Design Markov Chains with specific equilibrium distributions! 28
29 Example: Detailed Balance Local Equilibrium at 1 Global Equilibrium at same equilibrium distribution [1/3, 1/3, 1/3] different convergence mechanism 29
30 Summary: Markov Chains Sequential random variables: X V, X *, Aperiodic and irreducible chains are ergodic: Convergence towards a unique equilibrium distribution p Equilibrium distribution p Eigenvector of T with eigenvalue λ = 1: Tp = p Rate of convergence: decay with second largest eigenvalue λ * Detailed Balance: Local equilibrium global equilibrium 30
31 The Metropolis-Hastings Algorithm Convert samples from Q(x) into samples from P(x) Requires: Can draw samples from Q x x) Q x x > 0 if Q x x) > 0 Point-wise evaluation of P(x) Result: Sequence of samples approximately from P Behind the scenes: MH constructs a Markov chain 31
32 Metropolis-Hastings Algorithm Initialize: Initialize at state x Generate next sample, starting at x: 1. Draw a sample x from Q(x x) ( proposal ) 2. Update state x x with probability α = min ± ²³ ( accept or reject ) 3. Sample is current state x ± ² ² ² ³ ² ³ ², 1 32
33 Metropolis-Hastings Algorithm Defines a Markov Chain with transition kernel T µ x x = Q x x α x x + d Q x x (1 α x x ) Target distribution P obeys detailed balance: P is the equilibrium distribution! Sampling with algorithm samples from P (in asymptotia ) P appears only in ratios of point-wise evaluations ok for our unnormalized posterior! α = min Application: easily accessible Q, difficult target P ² P x P x δ ² ³ ² Q x x Q x x, 1 33
34 MH: Detailed Balance T µ x x = Q x x α x x + d Q x x (1 α x x ) Check: does it hold? T µ x x P x = T µ x x P x Expand: (blackboard) Result: P satisfies detailed balance for MH kernel P is the stable distribution P is the equilibrium distribution if the chain is irreducible Samples from chain converge to be drawn from P! ² δ ² ³ ² 34
35 Example: 2D Gaussian Target: P x = V *¹º» e{½» x{μ À Á½ (x{μ) Proposal: Q x x = N(x x, σ * I * ) Q x x = Q x x Random walk μ = Σ = μ = ΣÅ =
36 Different Proposals: 2D Gaussian σ = 0.2 σ =
37 Serial Correlation Memory of Markov Chain leads to dependent samples Chain remembers last sample(s) Different standard deviations Correlations are due to: Variation of proposal is too weak Too many rejections (rejects freeze the chain) May be relevant for estimation Resolve with subsampling 37
38 Metropolis-Hastings: Limitations Target distribution is approximate Need complicated diagnostics to know exactly how approximate There are methods for perfect sampling Serial correlation Vulnerable to highly correlated targets Proposal should match correlation Or be adapted to target Result depends on choice of proposal distribution Bishop. PRML, Springer,
39 Probabilistic Fitting with MCMC Probabilistic Registration Bayesian Inference Posterior distribution Approximate Inference Sampling Simulate posterior distribution Metropolis-Hastings MCMC, general sampler Sample from Q transform to P Choose P p θ I $, I B l(θ; D)p(θ) p θ I $, I B = l(θ; D)p(θ)dθ α = min P x P x Q x x Q x x, 1 39
40 3D Fitting Example right.eye.corner_outer left.eye.corner_outer right.lips.corner left.lips.corner 40
41 3D Fitting Setup 3D face with statistical model Discrete low-rank Gaussian Process Arbitrary rigid transformation Pose, Positioning in space Observations Observed positions xé V, xé *, xé Ê Correspondence: x V Ë, x * Ë,, x Ê Ë Goal: Find Posterior Distribution P θ xé V,, xé Ê l xé V,, xé Ê θ P(α) Parameters θ = (α, φ, ψ, θ, t) Shape i x = μ(x) + d α f λ f Φ f (x) Rigid Transform 3 angles (pitch, yaw, roll) φ, ψ, θ Translation t x = R Ñ R Ò R Ó x + t f 41
42 Proposals Choose simple Gaussian random walk proposals (Metropolis) "Q θ θ = N(θ θ, Σ Õ )" Normal perturbations of current state Block-wise to account for different parameter types Shape N(α α, σ * ( E ) Rotation N φ φ, σ * Ó + N ψ ψ, σ * Ò + N θ * θ, σ Ñ Translation N t t, σ * E 3 E i Identity matrix (I is image) Large mixture distributions as proposals Q θ θ = c f Q f (θ θ) 42
43 3DMM Landmarks Likelihood Simple models: Independent Gaussians Observation of L landmark locations xé f in image Single landmark position model: x f θ = R Ó,Ò,Ñ h α x f Ë Ø + t * l f θ; xé f = N xé f x f θ, σ Ê/ Independent model (conditional independence): Ù l θ; D = p(d θ) l θ; xé V, xé *,, xé Ù = z l f θ; xé f fwv Independence and Gaussian are just simple models (questionable) 43
44 3D Fit to Landmarks Influence of landmarks uncertainty on final posterior? σ Ê/ = 1mm σ Ê/ = 4mm σ Ê/ = 10mm Only 4 landmark observations: Expect only weak shape impact Should still constrain pose Uncertain LM should be looser 44
45 3D Fitting: Code val yawproposal = GaussianRotationProposal(AxisY, sdev = 0.05) val pitchproposal = GaussianRotationProposal(AxisX, sdev = 0.05) val rollproposal = GaussianRotationProposal(AxisZ, sdev = 0.05) val rotationproposal = MixtureProposal( 0.6 *: yawproposal *: pitchproposal *: rollproposal) val translationproposal = GaussianTranslationProposal(Vector(2, 2, 2)) val poseproposal = MixtureProposal( rotationproposal + translationproposal) val shapeproposal = GaussianShapeProposal(sdev = 0.05) val lmfitter = MetropolisHastings( proposal = 0.2 *: poseproposal *: shapeproposal, evaluator = lmlikelihood * shapeprior) val samples = lmfitter.iterator(initstate).drop(2000).take(8000).toindexedseq 45
46 Posterior: Pose & Shape, 4mm μ ÚÛÜ = σx ÚÛÜ = (4 ) μ Þ ß = 1 mm σx Þß = 4 mm (Estimation from samples) μ b ½ = 0.4 σx b½ =
47 Posterior: Pose & Shape, 4mm Posterior values (log, unnormalized!) 47
48 Posterior: Pose & Shape, 1mm μ ÚÛÜ = 0.50 σx ÚÛÜ = (2.4 ) μ Þ ß = 2 mm σx Þß = 0.8 mm μ b ½ = 1.5 σx b½ =
49 Posterior: Pose & Shape, 10mm μ ÚÛÜ = 0.49 σx ÚÛÜ = 0.11 (7 ) μ Þ ß = 5 mm σx Þß = 10 mm μ b ½ = 0 σx b½ =
50 Summary: MCMC for 3D Fitting Probabilistic inference for fitting probabilistic models Probabilistic inference is most often not tractable Use approximate inference methods Sampling methods approximate by simulation MCMC methods provide a powerful sampling framework Markov Chain with target distribution as equilibrium distribution General algorithms, e.g. Metropolis-Hastings 3D landmarks fitting example: Posterior distribution Model likelihood Define proposals 50
Basics of Statistical Machine Learning
CS761 Spring 2013 Advanced Machine Learning Basics of Statistical Machine Learning Lecturer: Xiaojin Zhu jerryzhu@cs.wisc.edu Modern machine learning is rooted in statistics. You will find many familiar
More informationProbabilistic Models for Big Data. Alex Davies and Roger Frigola University of Cambridge 13th February 2014
Probabilistic Models for Big Data Alex Davies and Roger Frigola University of Cambridge 13th February 2014 The State of Big Data Why probabilistic models for Big Data? 1. If you don t have to worry about
More informationStatistical Machine Learning from Data
Samy Bengio Statistical Machine Learning from Data 1 Statistical Machine Learning from Data Gaussian Mixture Models Samy Bengio IDIAP Research Institute, Martigny, Switzerland, and Ecole Polytechnique
More informationGaussian Processes to Speed up Hamiltonian Monte Carlo
Gaussian Processes to Speed up Hamiltonian Monte Carlo Matthieu Lê Murray, Iain http://videolectures.net/mlss09uk_murray_mcmc/ Rasmussen, Carl Edward. "Gaussian processes to speed up hybrid Monte Carlo
More informationBayesian Statistics in One Hour. Patrick Lam
Bayesian Statistics in One Hour Patrick Lam Outline Introduction Bayesian Models Applications Missing Data Hierarchical Models Outline Introduction Bayesian Models Applications Missing Data Hierarchical
More informationIntroduction to Markov Chain Monte Carlo
Introduction to Markov Chain Monte Carlo Monte Carlo: sample from a distribution to estimate the distribution to compute max, mean Markov Chain Monte Carlo: sampling using local information Generic problem
More informationInference on Phase-type Models via MCMC
Inference on Phase-type Models via MCMC with application to networks of repairable redundant systems Louis JM Aslett and Simon P Wilson Trinity College Dublin 28 th June 202 Toy Example : Redundant Repairable
More informationStatistical Machine Learning
Statistical Machine Learning UoC Stats 37700, Winter quarter Lecture 4: classical linear and quadratic discriminants. 1 / 25 Linear separation For two classes in R d : simple idea: separate the classes
More informationTutorial on Markov Chain Monte Carlo
Tutorial on Markov Chain Monte Carlo Kenneth M. Hanson Los Alamos National Laboratory Presented at the 29 th International Workshop on Bayesian Inference and Maximum Entropy Methods in Science and Technology,
More information11. Time series and dynamic linear models
11. Time series and dynamic linear models Objective To introduce the Bayesian approach to the modeling and forecasting of time series. Recommended reading West, M. and Harrison, J. (1997). models, (2 nd
More informationImperfect Debugging in Software Reliability
Imperfect Debugging in Software Reliability Tevfik Aktekin and Toros Caglar University of New Hampshire Peter T. Paul College of Business and Economics Department of Decision Sciences and United Health
More informationWeb-based Supplementary Materials for Bayesian Effect Estimation. Accounting for Adjustment Uncertainty by Chi Wang, Giovanni
1 Web-based Supplementary Materials for Bayesian Effect Estimation Accounting for Adjustment Uncertainty by Chi Wang, Giovanni Parmigiani, and Francesca Dominici In Web Appendix A, we provide detailed
More informationMarkov Chain Monte Carlo Simulation Made Simple
Markov Chain Monte Carlo Simulation Made Simple Alastair Smith Department of Politics New York University April2,2003 1 Markov Chain Monte Carlo (MCMC) simualtion is a powerful technique to perform numerical
More informationSampling via Moment Sharing: A New Framework for Distributed Bayesian Inference for Big Data
Sampling via Moment Sharing: A New Framework for Distributed Bayesian Inference for Big Data (Oxford) in collaboration with: Minjie Xu, Jun Zhu, Bo Zhang (Tsinghua) Balaji Lakshminarayanan (Gatsby) Bayesian
More informationIntroduction to Mobile Robotics Bayes Filter Particle Filter and Monte Carlo Localization
Introduction to Mobile Robotics Bayes Filter Particle Filter and Monte Carlo Localization Wolfram Burgard, Maren Bennewitz, Diego Tipaldi, Luciano Spinello 1 Motivation Recall: Discrete filter Discretize
More informationMonte Carlo and Empirical Methods for Stochastic Inference (MASM11/FMS091)
Monte Carlo and Empirical Methods for Stochastic Inference (MASM11/FMS091) Magnus Wiktorsson Centre for Mathematical Sciences Lund University, Sweden Lecture 5 Sequential Monte Carlo methods I February
More informationα α λ α = = λ λ α ψ = = α α α λ λ ψ α = + β = > θ θ β > β β θ θ θ β θ β γ θ β = γ θ > β > γ θ β γ = θ β = θ β = θ β = β θ = β β θ = = = β β θ = + α α α α α = = λ λ λ λ λ λ λ = λ λ α α α α λ ψ + α =
More information1 Prior Probability and Posterior Probability
Math 541: Statistical Theory II Bayesian Approach to Parameter Estimation Lecturer: Songfeng Zheng 1 Prior Probability and Posterior Probability Consider now a problem of statistical inference in which
More informationgloser og kommentarer til Macbeth ( sidetal henviser til "Illustrated Shakespeare") GS 96
side 1! " # $ % &! " '! ( $ ) *! " & +! '!, $ #! "! - % " "! &. / 0 1 & +! '! ' & ( ' 2 ) % $ 2 3 % # 2! &. 2! ' 2! '! $ $! " 2! $ ( ' 4! " 3 & % / ( / ( ' 5! * ( 2 & )! 2 5! 2 &! # '! " & +! '! ' & &!
More informationSTA 4273H: Statistical Machine Learning
STA 4273H: Statistical Machine Learning Russ Salakhutdinov Department of Statistics! rsalakhu@utstat.toronto.edu! http://www.cs.toronto.edu/~rsalakhu/ Lecture 6 Three Approaches to Classification Construct
More informationÔÔÖ Ò ÂÓÙÖÒÐ Ó ÓÑÔÙØÖ Ò ËÝ ØÑ ËÒ ÎÓк ½ ÆÓº ¾¼¼¼ ÔÔº ¾ß º ÈÖÐÑÒÖÝ ÚÖ ÓÒ Û Ò ÚÒ Ò ÖÝÔØÓÐÓÝ ß ÖÝÔØÓ ÈÖÓÒ ÄØÙÖ ÆÓØ Ò ÓÑÔÙØÖ ËÒ ÎÓк º ÑØ º ËÔÖÒÖ¹ÎÖÐ ½º Ì ËÙÖØÝ Ó Ø ÔÖ ÐÓ ÒÒ Å ÙØÒØØÓÒ Ó ÅÖ ÐÐÖ ÂÓ ÃÐÒ Ý ÈÐÐÔ
More informationA Bootstrap Metropolis-Hastings Algorithm for Bayesian Analysis of Big Data
A Bootstrap Metropolis-Hastings Algorithm for Bayesian Analysis of Big Data Faming Liang University of Florida August 9, 2015 Abstract MCMC methods have proven to be a very powerful tool for analyzing
More informationBayesian Statistics: Indian Buffet Process
Bayesian Statistics: Indian Buffet Process Ilker Yildirim Department of Brain and Cognitive Sciences University of Rochester Rochester, NY 14627 August 2012 Reference: Most of the material in this note
More informationÌÊÅ ÎÄÍ ÌÀÇÊ ÈÇÌÆÌÁÄ Æ ÄÁÅÁÌÌÁÇÆË Ë Æ ÁÆÌÊÌ ÊÁËà ÅÆÅÆÌ ÌÇÇÄ ÈÍÄ ÅÊÀÌË ÈÊÌÅÆÌ Ç ÅÌÀÅÌÁË ÌÀ ĐÍÊÁÀ ÈÙÐ ÑÖØ ÈÖÓ ÓÖ Ó ÅØÑØ Ø Ø ÌÀ ËÛ ÖÐ ÁÒ Ø¹ ØÙØ Ó ÌÒÓÐÓÝ ĐÙÖµ ÛÖ Ø Ò ÙÖÒ Ò ÒÒÐ ÑØÑع º À ÖÚ ÑØÑØ ÔÐÓÑ ÖÓÑ Ø
More informationÕÙ ØÝ ÌÖ Ò Ý ÁÒ Ø ØÙØ ÓÒ Ð ÁÒÚ ØÓÖ ÌÓ ÖÓ ÓÖ ÆÓØ ØÓ ÖÓ Ì Ó Ø ÆÓÖÛ Ò È ØÖÓÐ ÙÑ ÙÒ º Ê Ò Æ ÆÓÖ Ò ÖÒØ ÖÒ Ö ÆÓÖ Ò Ò ÆÓÖÛ Ò Ë ÓÓÐ Ó Å Ò Ñ ÒØ ½ Â ÒÙ ÖÝ ¾¼¼¼ ØÖ Ø Ì Ó Ø ØÓ Ò Ø ØÙØ ÓÒ Ð ÒÚ ØÓÖ Ó ØÖ Ò ÕÙ ØÝ Ö Ó
More informationÒ Ñ Ö Ð ÓÙÒ Ø ÓÒ ÓÖ ÙØÓÑ Ø Ï ÁÒØ Ö Ú ÐÙ Ø ÓÒ Ý Å ÐÓ Ý Ú ØØ ÁÚÓÖÝ ºËº ÈÙÖ Ù ÍÒ Ú Ö Øݵ ½ ź˺ ÍÒ Ú Ö ØÝ Ó Ð ÓÖÒ Ø Ö Ð Ýµ ½ ÖØ Ø ÓÒ Ù Ñ ØØ Ò ÖØ Ð Ø Ø ÓÒ Ó Ø Ö ÕÙ Ö Ñ ÒØ ÓÖ Ø Ö Ó ÓØÓÖ Ó È ÐÓ Ó Ý Ò ÓÑÙØ Ö
More informationMonte Carlo-based statistical methods (MASM11/FMS091)
Monte Carlo-based statistical methods (MASM11/FMS091) Jimmy Olsson Centre for Mathematical Sciences Lund University, Sweden Lecture 5 Sequential Monte Carlo methods I February 5, 2013 J. Olsson Monte Carlo-based
More informationÓÑÔ Ö Ø Ú Ê Ú Û Ó ÊÓ ÓØ ÈÖÓ Ö ÑÑ Ò Ä Ò Ù ÁÞÞ Ø È Ñ Ö ÓÖÝ À Ö Ù Ù Ø ½ ¾¼¼½ ØÖ Ø ÁÒ Ø Ô Ô Ö Û Ñ ÓÑÔ Ö Ø Ú Ö Ú Û Ó Ú Ö ØÝ Ó ÒØ ÖÑ Ø ¹Ð Ú Ð ÖÓ ÓØ Ð Ò Ù Ø Ø Ú Ñ Ö Ò Ö ÒØ Ý Ö º Ï Ð Ó Ö ÖÓ ÓØ ÔÖÓ Ö ÑÑ Ò Ð Ò Ù
More informationSpatial Statistics Chapter 3 Basics of areal data and areal data modeling
Spatial Statistics Chapter 3 Basics of areal data and areal data modeling Recall areal data also known as lattice data are data Y (s), s D where D is a discrete index set. This usually corresponds to data
More informationINDIRECT INFERENCE (prepared for: The New Palgrave Dictionary of Economics, Second Edition)
INDIRECT INFERENCE (prepared for: The New Palgrave Dictionary of Economics, Second Edition) Abstract Indirect inference is a simulation-based method for estimating the parameters of economic models. Its
More informationValidation of Software for Bayesian Models using Posterior Quantiles. Samantha R. Cook Andrew Gelman Donald B. Rubin DRAFT
Validation of Software for Bayesian Models using Posterior Quantiles Samantha R. Cook Andrew Gelman Donald B. Rubin DRAFT Abstract We present a simulation-based method designed to establish that software
More informationÌ ÈÖ Ò Ó ËØÖ ÔÔ ÅÓÖØ ¹ Ë ÙÖ Ø Â Ó ÓÙ ÓÙ Å ØØ Û Ê Ö ÓÒ Ê Ö ËØ ÒØÓÒ Ò ÊÓ ÖØ º Ï Ø Ð Û Â ÒÙ ÖÝ ½ ØÖ Ø ÁÒØ Ö Ø ÓÒÐÝ Áǵ Ò ÔÖ Ò Ô Ð ÓÒÐÝ Èǵ ØÖ ÔÔ ÑÓÖØ ¹ ÙÖ Ø Å Ëµ Ö Ö Ú Ø Ú ÙÖ Ø Û Ô Ý ÓÙØ ÓÒÐÝ Ø ÒØ Ö Ø ÓÑÔÓÒ
More informationCentre for Central Banking Studies
Centre for Central Banking Studies Technical Handbook No. 4 Applied Bayesian econometrics for central bankers Andrew Blake and Haroon Mumtaz CCBS Technical Handbook No. 4 Applied Bayesian econometrics
More informationExam C, Fall 2006 PRELIMINARY ANSWER KEY
Exam C, Fall 2006 PRELIMINARY ANSWER KEY Question # Answer Question # Answer 1 E 19 B 2 D 20 D 3 B 21 A 4 C 22 A 5 A 23 E 6 D 24 E 7 B 25 D 8 C 26 A 9 E 27 C 10 D 28 C 11 E 29 C 12 B 30 B 13 C 31 C 14
More informationMessage-passing sequential detection of multiple change points in networks
Message-passing sequential detection of multiple change points in networks Long Nguyen, Arash Amini Ram Rajagopal University of Michigan Stanford University ISIT, Boston, July 2012 Nguyen/Amini/Rajagopal
More informationÌÖ Ò Ø ÓÒ¹ Ö Ò Ò ÅÒ ÑÓ ÝÒ È Ö¹ØÓ¹È Ö ËØ ÒÓ Ö Ô ËØÓÖ ËÝ Ø Ñ Ì ÑÓØ Ý ÊÓ Ó ½ Ò ËØ Ú Ò À Ò ¾ ¾ ½ ËÔÖ ÒØ Ú Ò Ì ÒÓÐÓ Ý Ä ÓÖ ØÓÖÝ ÙÖÐ Ò Ñ ¼½¼ ÍË ÍÒ Ú Ö ØÝ Ó Ñ Ö ÓÑÔÙØ Ö Ä ÓÖ ØÓÖÝ Ñ Ö ¼ Íà ØÖ Øº ÅÒ ÑÓ ÝÒ Ô Ö¹ØÓ¹Ô
More informationØ Ö ØÒ ÓÑÔ Ð Â Ú ÈÖÓ º ÓÒÒ Ø ÔÖÓÚ º Ø Þº µ ÔÖ Ð ¾ ¾¼¼½ ØÖ Ø ÓÖ ÕÙ Ø ÓÑ Ø Ñ ÒÓÛ Ñ Ö Ó Â Ú Î ÖØÙ Ð Å Ò ÂÎÅ µ ÓÒ Â٠عÁÒ¹Ì Ñ ÂÁ̵ Ò ¹Ç ¹Ì Ñ Ç̵ ÓÑÔ Ð Ö Û Ø Óҹع Ý ÓÔØ Ñ Þ Ø ÓÒ Ú Ò ÙÒØ Ò Ø Ö ÈÖÓ ÙØ ÖÙÒÒ Ò
More informationBayesian Image Super-Resolution
Bayesian Image Super-Resolution Michael E. Tipping and Christopher M. Bishop Microsoft Research, Cambridge, U.K..................................................................... Published as: Bayesian
More informationBud row 1. Chips row 2. Coors. Bud. row 3 Milk. Chips. Cheesies. Coors row 4 Cheesies. Diapers. Milk. Diapers
Ð ØÖ ØÝ ÜØ ÖÒ Ð Ë Ñ Ð Ö ØÝ Ó Ø ÓÖ Ð ØØÖ ÙØ Ö ØÓÔ Ö Êº È ÐÑ Ö ½ Ò Ö ØÓ ÐÓÙØ Ó ¾ ¾ ½ Î Ú ÑÓ ÁÒº ¾ ÛÓÓ ÐÚ È ØØ ÙÖ È Ô ÐÑ ÖÚ Ú ÑÓºÓÑ ÓÑÔÙØ Ö Ë Ò Ô ÖØÑ ÒØ ÖÒ Å ÐÐÓÒ ÍÒ Ú Ö ØÝ ¼¼¼ ÓÖ Ú È ØØ ÙÖ È Ö ØÓ ºÑÙº Ù
More informationStatistics Graduate Courses
Statistics Graduate Courses STAT 7002--Topics in Statistics-Biological/Physical/Mathematics (cr.arr.).organized study of selected topics. Subjects and earnable credit may vary from semester to semester.
More informationÆ ÒØ Ò Ö Ø ÓÒ Ó ÊÓØ Ø Ò ÏÓÖ ÓÖ Ë ÙÐ ÆÝ Ö Ø ÅÙ Ð ÂÓ ÒÒ Đ ÖØÒ Ö Ò ÏÓÐ Ò ËÐ ÒÝ ØÖ Øº Ò Ö Ø Ò ¹ÕÙ Ð ØÝ ÙÐ ÓÖ ÖÓØ Ø Ò ÛÓÖ ÓÖ Ö Ø Ð Ø Ò ÐÐ ØÙ Ø ÓÒ Û Ö ÖØ Ò Ø ÆÒ Ð Ú Ð ÑÙ Ø Ù Ö¹ ÒØ Ù Ò Ò Ù ØÖ Ð ÔÐ ÒØ Ó Ô Ø Ð
More informationËØØ ØÐ ÒÐÝ Ó ÒÓÑÔÐØ Ø ØÓÖÝ ØÒÕÙ Ò ÓØÛÖ º ź ÆÓÖÓÚ ÈÖ Ò ÙÔÔÐÑÒØ ØÓ Ø ÊÙ Ò ØÓÒ Ó ÄØØРʺºº ÊÙÒ ºº ËØØ ØÐ ÒÐÝ ÏØ Å Ò Øº ÅÓ ÓÛ ÒÒ Ý ËØØ Ø ÔÔº ¹ ¾¹ ¾ ½½µ Ò ÊÙ Òµ ÈÖ ËØØ ØÐ ÒÐÝ ÛØ Ñ Ò Ø ÔÖÓÐÑ ÒÓÛÒ ØÓ ÐÑÓ Ø
More informationÅ Ò Ñ ÒØ Ö Ø ØÙÖ Ö Ñ ÛÓÖ ÓÖ Ø Ú Æ ØÛÓÖ Ð ÒϺ ÓÒ Â Ñ Èº ºËØ Ö ÒÞ Ñ Ñ Ò Ð Ü Ò ÖκÃÓÒ Ø ÒØ ÒÓÙ ÆÌ ÒÓÐÓ Î Ö ÞÓÒ ÓÐÙÑ ÍÒ Ú Ö ØÝÝ ¼ÂÙÒ ¾¼¼ ÝØ ÊÄÙÒ ÖÓÒØÖ Ø ¼ ¼¾¹ ¹ ¹¼½ ½º Ì ÛÓÖ Û ÔÓÒ ÓÖ ÝØ Ò Ú Ò Ê Ö ÈÖÓ Ø ÒÝ
More informationÊ ÔÓÒ Ú Ì ÒÛ Ö Î Ù Ð Þ Ø ÓÒ Ó Ä Ö Ó Ö Ô Ø Ø Ý Ã ÒÒ Ø Ò ÖØ Ø ÓÒ Ù Ñ ØØ Ò Ô ÖØ Ð ÙÐ ÐÐÑ ÒØ Ó Ø Ö ÕÙ Ö Ñ ÒØ ÓÖ Ø Ö Ó ÓØÓÖ Ó È ÐÓ ÓÔ Ý Ô ÖØÑ ÒØ Ó ÓÑÔÙØ Ö Ë Ò Æ Û ÓÖ ÍÒ Ú Ö ØÝ Ë ÔØ Ñ Ö ¾¼¼¾ ÔÔÖÓÚ Ô Ã ÒÒ Ø Ò
More information>?@CHJLC?JHLL >?@CHJLC?JHLL \ >?@CH >?JHLL >?JLC?!"#$%!&'!()+,-.+/0-1,.20.3456,.13.71+1,89:0-;,.-
More informationAn Introduction to Using WinBUGS for Cost-Effectiveness Analyses in Health Economics
Slide 1 An Introduction to Using WinBUGS for Cost-Effectiveness Analyses in Health Economics Dr. Christian Asseburg Centre for Health Economics Part 1 Slide 2 Talk overview Foundations of Bayesian statistics
More informationPS 271B: Quantitative Methods II. Lecture Notes
PS 271B: Quantitative Methods II Lecture Notes Langche Zeng zeng@ucsd.edu The Empirical Research Process; Fundamental Methodological Issues 2 Theory; Data; Models/model selection; Estimation; Inference.
More informationÊ ½µ ¼»¼»¼½ ÓÑÔÙØÖ ËÒ»ÅØÑØ ½ Ô Ê Ö ÊÔÓÖØ Ì ÈÊËÍË ËÝ ØÑ ÖØØÙÖ ÖØ ÈØÞÑÒÒ ½ ÂÑ ÊÓÖÒ ¾ Ö ØÒ ËØÐ ½ ÅÐ ÏÒÖ ¾ ÖÒ ÏÖ ½ ÍÒÚÖ ØØ ËÖÐÒ ÁÑ ËØØÛÐ ¹½¾ ËÖÖÒ ÖÑÒÝ ßÔØÞÑÒÒ ØÙÐÐ ºÙÒ¹ º ¾ ÁÅ ÙÖ Ê Ö ÄÓÖØÓÖÝ ËÙÑÖ ØÖ À¹¼ Ê
More informationLecture 3: Linear methods for classification
Lecture 3: Linear methods for classification Rafael A. Irizarry and Hector Corrada Bravo February, 2010 Today we describe four specific algorithms useful for classification problems: linear regression,
More informationCHAPTER 2 Estimating Probabilities
CHAPTER 2 Estimating Probabilities Machine Learning Copyright c 2016. Tom M. Mitchell. All rights reserved. *DRAFT OF January 24, 2016* *PLEASE DO NOT DISTRIBUTE WITHOUT AUTHOR S PERMISSION* This is a
More information(a) Hidden Terminal Problem. (b) Direct Interference. (c) Self Interference
ØÖ ÙØ ÝÒ Ñ ÒÒ Ð Ë ÙÐ Ò ÓÖ ÀÓ Æ ØÛÓÖ ½ Ä ÙÒ Ó Ò ÂºÂº Ö ¹ÄÙÒ ¹ Ú Ë ÓÓÐ Ó Ò Ò Ö Ò ÍÒ Ú Ö ØÝ Ó Ð ÓÖÒ Ë ÒØ ÖÙÞ ¼ ¹Ñ Ð ÓÐ Ó ºÙ º Ù Î Ö ÓÒ ¼»½»¾¼¼¾ Ì Ö ØÝÔ Ó ÓÐÐ ÓÒ¹ Ö ÒÒ Ð ÔÖÓØÓÓÐ ÓÖ Ó Ò ØÛÓÖ Ö ÔÖ ÒØ º Ì ÔÖÓØÓÓÐ
More informationIntroduction to Monte Carlo. Astro 542 Princeton University Shirley Ho
Introduction to Monte Carlo Astro 542 Princeton University Shirley Ho Agenda Monte Carlo -- definition, examples Sampling Methods (Rejection, Metropolis, Metropolis-Hasting, Exact Sampling) Markov Chains
More informationÆÏ ÈÈÊÇÀ ÌÇ Ëµ ÁÆÎÆÌÇÊ ËËÌÅË ÂÒ¹ÉÒ ÀÙ ÅÒÙØÙÖÒ ÒÒÖÒ Ó ØÓÒ ÍÒÚÖ ØÝ ËÓÖ ÆÒÒÙÙÐ Ý Ò Ï¹Ó ÓÒ Ý ÐØÖÐ Ò ÓÑÔÙØÖ ÒÒÖÒ ÍÒÚÖ ØÝ Ó Å Ù ØØ ÑÖ Ø ÖÙÖÝ ØÖØ ÁÒ Ø ÔÔÖ Û ÓÒ Ö ÔÖÓ ÖÚÛ Ëµ ÒÚÒØÓÖÝ Ý ØÑ ÛØ ÒÔÒÒØ Ò ÒØÐÐÝ ØÖÙØ
More informationÔØ Ö ½ ÊÇÍÌÁÆ ÁÆ ÅÇ ÁÄ ÀÇ Æ ÌÏÇÊÃË Å Ãº Å Ö Ò Ò Ë Ñ Ö Êº Ô ÖØÑ ÒØ Ó ÓÑÔÙØ Ö Ë Ò ËØ Ø ÍÒ Ú Ö ØÝ Ó Æ Û ÓÖ Ø ËØÓÒÝ ÖÓÓ ËØÓÒÝ ÖÓÓ Æ ½½ ¹ ¼¼ ØÖ Ø Æ ÒØ ÝÒ Ñ ÖÓÙØ Ò ÓÒ Ó Ø Ý ÐÐ Ò Ò ÑÓ Ð Ó Ò ØÛÓÖ º ÁÒ Ø Ö ÒØ Ô
More informationAnalysis of Bayesian Dynamic Linear Models
Analysis of Bayesian Dynamic Linear Models Emily M. Casleton December 17, 2010 1 Introduction The main purpose of this project is to explore the Bayesian analysis of Dynamic Linear Models (DLMs). The main
More informationÔØ Ö Ê Ö ÓÐÓ Ý ÁÒ Ø ÔØ Ö Ø Ö Ñ Ò ÛÓÖ Ø Ø ÓÒ Ú ÐÓÔ ÔÖ ÒØ º Ì ÛÓÖ Ø ¹ Ø ÓÒ ÓÑÔÙØ Ö Ø ÒÓ Ø ÑÓ ÙÐ Û Ö Ø ÓÖÓÒ ÖÝ ØÖ ÑÓ Ð ÐÐ ÔÐ Ý Ò ÑÔÓÖØ ÒØ ÖÓÐ Û Ò Ó Ò ÙØÓÑ Ø Ú Ð Ò ÐÝ Û Ø ÓÖÓÒ ÖÝ Ò Ó Ö ¹ Ô Ý Ñ º Ì ÔØ Ö Ò Û
More informationÅÓÖ Ð À Þ Ö ÁÒ ÙÖ Ò Ò ËÓÑ ÓÐÐÙ ÓÒ ÁÒ Ð Ð Ö Ò Ò ¹ØÓ Ð ÖØ Å Ö Ø Ú Ö ÓÒ Ù Ù Ø ½ Ì Ú Ö ÓÒ ÖÙ ÖÝ ¾¼¼½ ØÖ Ø Ï ÓÒ Ö ÑÓ Ð Ó Ò ÙÖ Ò Ò ÓÐÐÙ ÓÒº Æ ÒØ Ö Ö Ò Ö ÕÙ Ö Ø ÓÒ ÙÑ Ö ØÓ Ø ÑÓÒ Ø ÖÝ ÓÑÔ Ò Ø ÓÒ Ò Ó ÐÓ º ÙØ Ø
More informationÅÁÌ ½ º ÌÓÔ Ò Ì Ë ÁÒØ ÖÒ Ø Ê Ö ÈÖÓ Ð Ñ ËÔÖ Ò ¾¼¼¾ Ä ØÙÖ ½ ÖÙ ÖÝ ¾¼¼¾ Ä ØÙÖ Ö ÌÓÑ Ä ØÓÒ ËÖ ÇÑ Ö Ø ÑÓÒ Ï Ð ½º½ ÁÒØÖÓ ÙØ ÓÒ Ì Ð Û ÐÐ Ù Ú Ö Ð Ö Ö ÔÖÓ Ð Ñ Ø Ø Ö Ö Ð Ø ØÓ Ø ÁÒØ ÖÒ Øº Ð ØÙÖ Û ÐÐ Ù ÀÓÛ Ô ÖØ ÙÐ
More informationË ÓÒ Ð ØÝ Ò Ö ÙÐØÙÖ Ð ÓÑÑÓ ØÝ ÙØÙÖ Ö Ø Ò Ë Ö Ò Ò Ô ÖØÑ ÒØ Ó Ò Ò ÓÔ Ò Ò Ù Ò Ë ÓÓÐ ÊÓ Ò ÖÒ ÐÐ ½ ù½ ¼ Ö Ö Ö ÒÑ Ö Ì Ä ½ ½ ½ ¼¼ ¹Ñ Ð Óº º Ñ Ö ½ Ì ÙØ ÓÖ Ø Ò ÓÖ ÐÔ ÙÐ Ø Ò ÖÓÑ Â Ô Ö ĐÙÐÓÛ Ò ÓÑÑ ÒØ Ò Ù Ø ÓÒ ÖÓÑ
More informationØ Ú ÉÙ Ù Å Ò Ñ ÒØ ÓÒ Ø Ú Æ ØÛÓÖ ¹ ÍÒ Ø ÓÒ Ø ÓÒ ÓÒØÖÓÐ ÈÖÓØÓÓÐ Ê Ö ØÖ Ë Ö Ã Ö Ñ Ñ Ñ Æ ØÛÓÖ Ò Ê Ö ÖÓÙÔ Ë ÓÓÐ Ó ÓÑÔÙØ Ò ÍÒ Ú Ö ØÝ Ó Ä Ä Ä˾ ÂÌ ÍÒ Ø Ã Ò ÓÑ ßÖ Ö Ö ÑÐÓÑԺРº ºÙ ØØÔ»»ÛÛÛºÓÑԺРº ºÙ» ØѹÑÑ ØÖ
More informationÇÔ Ò ÈÖÓ Ð Ñ Ò Ø ¹Ë Ö Ò È Ö¹ØÓ¹È Ö ËÝ Ø Ñ Æ Ð Û Ò À ØÓÖ Ö ¹ÅÓÐ Ò Ò Ú ÖÐÝ Ò ËØ Ò ÓÖ ÍÒ Ú Ö ØÝ ËØ Ò ÓÖ ¼ ÍË Û Ò ØÓÖ Ý Ò º Ø Ò ÓÖ º Ù ØØÔ»»ÛÛÛ¹ º Ø Ò ÓÖ º Ù ØÖ Øº ÁÒ È Ö¹ÌÓ¹È Ö È¾Èµ Ý Ø Ñ ÙØÓÒÓÑÓÙ ÓÑÔÙØ Ö
More informationAuthor manuscript, published in "1st International IBM Cloud Academy Conference - ICA CON 2012 (2012)" hal-00684866, version 1-20 Apr 2012
Author manuscript, published in "1st International IBM Cloud Academy Conference - ICA CON 2012 (2012)" Á ÇÆ ¾¼½¾ ÌÓÛ Ö Ë Ð Ð Ø Å Ò Ñ ÒØ ÓÖ Å Ô¹Ê Ù ¹ Ø ¹ÁÒØ Ò Ú ÔÔÐ Ø ÓÒ ÓÒ ÐÓÙ Ò ÀÝ Ö ÁÒ Ö ØÖÙØÙÖ Ö Ð ÒØÓÒ
More informationÆÆ ÄË Ç ÇÆÇÅÁ Ë Æ ÁÆ Æ ½ ß½¼¼ ¾¼¼¼µ ÁÒÚ ØÑ ÒØ ÀÓÖ ÞÓÒ Ò Ø ÖÓ Ë Ø ÓÒ Ó ÜÔ Ø Ê ØÙÖÒ Ú Ò ÖÓÑ Ø ÌÓ ÝÓ ËØÓ Ü Ò È Ò¹ÀÙ Ò ÓÙ Ô ÖØÑ ÒØ Ó Ò Ò Æ Ø ÓÒ Ð ÒØÖ Ð ÍÒ Ú Ö ØÝ ÙÒ Ä Ì Û Ò ¾¼ Ù Ò¹Ä Ò À Ù Ô ÖØÑ ÒØ Ó Ò Ò Æ
More informationÌ ÈÒÒ ÝÐÚÒ ËØØ ÍÒÚÖ ØÝ Ì ÖÙØ ËÓÓÐ ÔÖØÑÒØ ÓËØØ Ø ËÌÊÌÁË ÇÊ Ì ÆÄËÁË ÏÁÌÀ ÌÏÇ ÌÈË Ç ÅÁËËÁÆ ÎÄÍË Ì Ò ËØØ Ø Ý ÇÖ ÀÖÐ ¾¼¼ ÇÖ ÀÖÐ ËÙÑØØ Ò ÈÖØÐ ÙÐ ÐÐÑÒØ Ó Ø ÊÕÙÖÑÒØ ÓÖ Ø Ö Ó ÓØÓÖ Ó ÈÐÓ ÓÔÝ ÙÙ Ø ¾¼¼ Ì Ø Ó ÇÖ ÀÖÐ
More informationInference of Probability Distributions for Trust and Security applications
Inference of Probability Distributions for Trust and Security applications Vladimiro Sassone Based on joint work with Mogens Nielsen & Catuscia Palamidessi Outline 2 Outline Motivations 2 Outline Motivations
More informationDeterministic Sampling-based Switching Kalman Filtering for Vehicle Tracking
Proceedings of the IEEE ITSC 2006 2006 IEEE Intelligent Transportation Systems Conference Toronto, Canada, September 17-20, 2006 WA4.1 Deterministic Sampling-based Switching Kalman Filtering for Vehicle
More informationChristfried Webers. Canberra February June 2015
c Statistical Group and College of Engineering and Computer Science Canberra February June (Many figures from C. M. Bishop, "Pattern Recognition and ") 1of 829 c Part VIII Linear Classification 2 Logistic
More informationGenerating Random Numbers Variance Reduction Quasi-Monte Carlo. Simulation Methods. Leonid Kogan. MIT, Sloan. 15.450, Fall 2010
Simulation Methods Leonid Kogan MIT, Sloan 15.450, Fall 2010 c Leonid Kogan ( MIT, Sloan ) Simulation Methods 15.450, Fall 2010 1 / 35 Outline 1 Generating Random Numbers 2 Variance Reduction 3 Quasi-Monte
More informationÌ È ÒÒ Ò ÌÖ Ò È Ö ËØÖÙØÙÖ ÒÒÓØ Ø ÓÒ Ó Ä Ö ÓÖÔÙ Æ ÒÛ Ò Ù Ù¹ ÓÒ ÓÙ Å ÖØ È ÐÑ Ö ÍÒ Ú Ö ØÝ Ó È ÒÒ ÝÐÚ Ò È Ð ÐÔ È ½ ½¼ ÍË ÜÙ Ò Û ÒÐ Òº ºÙÔ ÒÒº Ù Ü Ð Òº ºÙÔ ÒÒº Ù ÓÙ Ð Òº ºÙÔ ÒÒº Ù ÑÔ ÐÑ ÖÐ Òº ºÙÔ ÒÒº Ù ØÖ Ø
More informationParallelization Strategies for Multicore Data Analysis
Parallelization Strategies for Multicore Data Analysis Wei-Chen Chen 1 Russell Zaretzki 2 1 University of Tennessee, Dept of EEB 2 University of Tennessee, Dept. Statistics, Operations, and Management
More informationÄ ØÙÖ ËÐ ÁÒÚ ØÑ ÒØ Ò ÐÝ ½ ÌÖ Ò Ò ÁÒØÖÓ ØÓ ÌË Ó Ð ØÖ Ò Ø ÖÑ ÒÓÐÓ Ý ÜÔÐ Ò Ä Û Ó ÇÒ ÈÖ Ò Ö ØÖ ÐÙÐ Ø Ö ÔÐ Ø Ò ÔÓÖØ ÓÐ Ó Ó ÓÒ ÜÔÐ Ò Ö Ð Ø ÓÒ Ô Ö ØÖ Ò Ê ÔÐ Ø ÓÒ ËÔÓØ Ê Ø ÓÖÛ Ö Ê Ø Ä ØÙÖ ËÐ ÁÒÚ ØÑ ÒØ Ò ÐÝ ¾ ÇÖ
More informationLeast-Squares Intersection of Lines
Least-Squares Intersection of Lines Johannes Traa - UIUC 2013 This write-up derives the least-squares solution for the intersection of lines. In the general case, a set of lines will not intersect at a
More informationMaximum Likelihood Estimation
Math 541: Statistical Theory II Lecturer: Songfeng Zheng Maximum Likelihood Estimation 1 Maximum Likelihood Estimation Maximum likelihood is a relatively simple method of constructing an estimator for
More informationÉÙ ÖÝ Ò Ë Ñ ØÖÙØÙÖ Ø ÇÒ Ë Ñ Å Ø Ò Á Ë Ë Ê Ì Ì Á Ç Æ ÞÙÖ ÖÐ Ò ÙÒ Ñ Ò Ö ÓØÓÖ Ö ÖÙÑ Ò ØÙÖ Ð ÙÑ Öº Ö Öº Ò Øºµ Ñ ÁÒ ÓÖÑ Ø Ò Ö Ø Ò Ö Å Ø Ñ Ø ¹Æ ØÙÖÛ Ò ØÐ Ò ÙÐØĐ Ø ÁÁ ÀÙÑ ÓРعÍÒ Ú Ö ØĐ Ø ÞÙ ÖÐ Ò ÚÓÒ À ÖÖ Ôк¹ÁÒ
More informationCell Phone based Activity Detection using Markov Logic Network
Cell Phone based Activity Detection using Markov Logic Network Somdeb Sarkhel sxs104721@utdallas.edu 1 Introduction Mobile devices are becoming increasingly sophisticated and the latest generation of smart
More informationuniverse nonself self detection system false negatives false positives
Ö Ø ØÙÖ ÓÖ Ò ÖØ Ð ÁÑÑÙÒ ËÝ Ø Ñ ËØ Ú Ò º ÀÓ Ñ ÝÖ ½ Ò Ëº ÓÖÖ Ø ½ ¾ ½ Ô ÖØÑ ÒØ Ó ÓÑÔÙØ Ö Ë Ò ÍÆÅ Ð ÙÕÙ ÖÕÙ ÆÅ ½ ½ ¾ Ë ÒØ ÁÒ Ø ØÙØ ½ ÀÝ È Ö ÊÓ Ë ÒØ ÆÅ ¼½ ØÖ Ø Ò ÖØ Ð ÑÑÙÒ Ý Ø Ñ ÊÌÁ˵ Ö Û ÒÓÖÔÓÖ Ø Ñ ÒÝ ÔÖÓÔ
More informationFRAME. ... Data Slot S. Data Slot 1 Data Slot 2 C T S R T S. No. of Simultaneous Users. User 1 User 2 User 3. User U. No.
ÂÓÙÖÒ ÐÓ ÁÒØ ÖÓÒÒ Ø ÓÒÆ ØÛÓÖ ÎÓк¾ ÆÓº½ ¾¼¼½µ ¹ ÏÓÖÐ Ë ÒØ ÈÙ Ð Ò ÓÑÔ ÒÝ È Ê ÇÊÅ Æ Î ÄÍ ÌÁÇÆÇ Ê ÉÍ ËÌ¹Ì Å» Å ÈÊÇÌÇ ÇÄ ÇÊÏÁÊ Ä ËËÆ ÌÏÇÊÃË ÒØ Ö ÓÖÊ Ö ÒÏ Ö Ð ÅÓ Ð ØÝ Ò Æ ØÛÓÖ Ò Ê ÏŠƵ Ô ÖØÑ ÒØÓ ÓÑÔÙØ ÖË Ò
More informationControllability and Observability
Controllability and Observability Controllability and observability represent two major concepts of modern control system theory These concepts were introduced by R Kalman in 1960 They can be roughly defined
More informationÓÑÔ Ö Ø Ú ËØÙ Ý Ó ÌÛÓ ØÖÓÒÓÑ Ð ËÓ ØÛ Ö È Ò Ì Ø Ù Ñ ØØ Ò Ô ÖØ Ð ÙÐ ÐÐÑ ÒØ Ó Ø Ö ÕÙ Ö Ñ ÒØ ÓÖ Ø Ö Ó Å Ø Ö Ó Ë Ò Ò ÓÑÔÙØ Ö Ë Ò Ì ÍÒ Ú Ö ØÝ Ó Ù Ð Ò ½ ÌÓ ÅÙÑ Ò Ò ØÖ Ø Ì Ø ÓÑÔ Ö Ø Ú ØÙ Ý Ó ØÛÓ ÓÔ Ò ÓÙÖ ØÖÓÒÓÑ
More informationÓÒ ÖØÓÒ ÓÒ ÙÖÓÔÒ ÓÒÚÖ ÓÒ ÔÖÐÐÐ ÓÖÔÙ ÅÐÒ ÅÒ ÍÒÚÖ Ø ÈÚ ÑÐÒÑÒÑкÓÑ ÖÒ ¾ ÂÒÙÖÝ ¾¼¼ ½ ½µ ¾µ Ñ Ó Ø ÛÓÖ Ì ÛÓÖ ÒÐÝ Ø ÇÆÎÊË ÓÖ ÓÒÚÖÐ ÓÒ ØÖÙØÓÒ µ Û Ò ÓÙÒ Ò Ø Ç ÓÖÔÙ Ñ ÙÔ Ó Ø ØÖÒ ÐØÓÒ Ó ÚÒ ÔØÖ Ó Ó³ ÒÓÚÐ ÁÐ ÒÓÑ ÐÐ
More informationÆÓØ Ä ØÙÖ Ð Ñ Ø ØÖÙ ÙØ ÓÒ ØÓ Á ¼ ØÙ ÒØ ÓÖ ÐÐ ÓØ Ö Ö Ø Ö ÖÚ Á ¼ ÈÊÇ Í ÌÁÇÆ ÈÄ ÆÆÁÆ Æ ÇÆÌÊÇÄ Ê Æ Ô ÖØÑ ÒØ Ó ÁÒ Ù ØÖ Ð Ò Ò Ö Ò ÍÒ Ú Ö ØÝ Ø Ù«ÐÓ ¹ ËØ Ø ÍÒ Ú Ö ØÝ Ó Æ Û ÓÖ Ò Ù«ÐÓº Ù Á ¼ ÈÊÇ Í ÌÁÇÆ ÈÄ ÆÆÁÆ Æ
More informationMarkov Chain Monte Carlo and Numerical Differential Equations
Markov Chain Monte Carlo and Numerical Differential Equations J.M. Sanz-Serna 1 Introduction This contribution presents a hopefully readable introduction to Markov Chain Monte Carlo methods with particular
More informationÅÓÖÐ ÀÞÖ ÅÖØ ÈÓÛÖ Ò ËÓÒ Ø ÀÐØ ÁÒ ÙÖÒ Ý ÖØÓРͺ ÏÖ ÔÖØÑÒØ Ó ÓÒÓÑ ÍÒÚÖ ØÝ Ó ÅÒÒÑ ¹½ ½ ÅÒÒÑ ÛÖÓÒºÙÒ¹ÑÒÒѺ Ò ÅÖÙ ÒÐÙ ÎÖÒØ ÃÖÒÒÚÖ ÖÙÒ ¹½ ÅĐÙÒÒ ÑÖÙ ºÒÐÙÚÖÒغº ÙÙ Ø ¾¼¼½ ØÖØ ÁÒÚÙÐ ÑÓÖÐ ÞÖ ÒÒÖ Ý ÐØ Ò ÙÖÒ Ò ÑÓÒÓÔÓÐ
More informationErrata and updates for ASM Exam C/Exam 4 Manual (Sixteenth Edition) sorted by page
Errata for ASM Exam C/4 Study Manual (Sixteenth Edition) Sorted by Page 1 Errata and updates for ASM Exam C/Exam 4 Manual (Sixteenth Edition) sorted by page Practice exam 1:9, 1:22, 1:29, 9:5, and 10:8
More informationA Markov Chain Analysis of Blackjack Strategy
A Markov Chain Analysis of Blackjack Strategy Michael B. Wakin and Christopher J. Rozell Department of Electrical and Computer Engineering, Rice University, Houston, Texas 77251 1 Introduction Many statistical
More informationHierarchical Bayesian Modeling of the HIV Response to Therapy
Hierarchical Bayesian Modeling of the HIV Response to Therapy Shane T. Jensen Department of Statistics, The Wharton School, University of Pennsylvania March 23, 2010 Joint Work with Alex Braunstein and
More informationClient URL. List of object servers that contain object
ÄÓ Ø Ò ÓÔ Ó Ç Ø Í Ò Ø ÓÑ Ò Æ Ñ ËÝ Ø Ñ ÂÙ Ã Ò Ö Ù Ã Ø Ïº ÊÓ ÁÒ Ø ØÙØ ÙÖ ÓÑ ËÓÔ ÒØ ÔÓÐ Ö Ò Ò ÖÓ ÙÖ ÓѺ Ö Â Ñ Ïº ÊÓ ÖØ Ö Ò Ì Ð ÓÑ ß Æ Ì Á Ý Ð ÅÓÙÐ Ò ÙÜ Ö Ò ØÖ Ø ½ ÁÒØÖÓ ÙØ ÓÒ ÁÒ ÓÖ Ö ØÓ Ö Ù Ú Ö Ð Ý Ò Ò ¹
More informationHow to create OpenDocument URL s with SAP BusinessObjects BI 4.0
How to create OpenDocument URL s with SAP BusinessObjects BI 4.0 Creator: Twitter: Blog: Pieter Verstraeten http://www.twitter.com/pverstraeten http://www.pieterverstraeten.com/blog Hi, Thanks for downloading
More informationBayesian Analysis for the Social Sciences
Bayesian Analysis for the Social Sciences Simon Jackman Stanford University http://jackman.stanford.edu/bass November 9, 2012 Simon Jackman (Stanford) Bayesian Analysis for the Social Sciences November
More informationBayesian Machine Learning (ML): Modeling And Inference in Big Data. Zhuhua Cai Google, Rice University caizhua@gmail.com
Bayesian Machine Learning (ML): Modeling And Inference in Big Data Zhuhua Cai Google Rice University caizhua@gmail.com 1 Syllabus Bayesian ML Concepts (Today) Bayesian ML on MapReduce (Next morning) Bayesian
More informationLogistic Regression. Jia Li. Department of Statistics The Pennsylvania State University. Logistic Regression
Logistic Regression Department of Statistics The Pennsylvania State University Email: jiali@stat.psu.edu Logistic Regression Preserve linear classification boundaries. By the Bayes rule: Ĝ(x) = arg max
More informationTowards running complex models on big data
Towards running complex models on big data Working with all the genomes in the world without changing the model (too much) Daniel Lawson Heilbronn Institute, University of Bristol 2013 1 / 17 Motivation
More informationSliding Window ... Basic Window S[0] S[k 1] S[k] Digests Digests Digests
ËØØËØÖÑ ËØØ ØÐ ÅÓØÓÖ Ó ÌÓÙ Ó Ø ËØÖÑ ÊÐ ÌÑ ÙÝÙ Ù Ë ÓÙÖØ Á ØØÙØ Ó ÅØÑØÐ Ë ÔÖØÑØ Ó ÓÑÔÙØÖ Ë ÆÛ ÓÖ ÍÚÖ ØÝ ÝÙÝÙ ºÝÙºÙ ØÖØ Ó Ö Ø ÔÖÓÐÑ Ó ÑÓØÓÖ Ø Ó ØÓÙ Ó ØÑ Ö Ø ØÖÑ ÓÐ Ó Ñ Ó Ó ØѺ Á ØÓ ØÓ Ð ØÖÑ ØØ ¹ Ø Ù ÚÖ ØÖ
More informationUniversitat Autònoma de Barcelona
Universitat Autònoma de Barcelona ÙÐØ Ø Ò Ë Ó ³ Ò ÒÝ Ö ÁÒ ÓÖÑ Ø ÇÒ Ø Ò Ò ÓÒ ØÖÙØ ÓÒ Ó ÒØ¹Ñ Ø ÁÒ Ø ØÙØ ÓÒ Å Ñ ÓÖ ÔÖ ÒØ Ô Ö Ò ÂÙ Ò ÒØÓÒ Ó ÊÓ Ö Ù Þ Ù Ð Ö Ô Ö ÓÔØ Ö Ð Ö Ù ÓØÓÖ Ò ÒÝ Ö Ò ÁÒ ÓÖÑ Ø ÐÐ Ø ÖÖ Å ¾¼¼½
More informationSimple Linear Regression Inference
Simple Linear Regression Inference 1 Inference requirements The Normality assumption of the stochastic term e is needed for inference even if it is not a OLS requirement. Therefore we have: Interpretation
More informationÓÒØÖÓÐ ËÝ Ø Ñ Ò Ò Ö Ò ÖÓÙÔ Ò ÙØÓÑ Ø ÓÒ Ì ÒÓÐÓ Ý ÖÓÙÔ Ö¹ÁÒ Ò Ö ÂÓ Ñ ÔÙØݵ Ø ØÖ ½ ¼ ¼ À Ò È ÓÒ ¼¾ ½¹ ¹½½¼¼ Ü ¼¾ ½¹ ¹ ¹Å Ð Ò Ö Ó Ñ ÖÒÙÒ ¹ Ò Ñ Ø «È ÓÒ ÓÒØÖÓÐ ËÝ Ø Ñ Ò Ò Ö Ò ÖÓÙÔ ÔйÁÒ Ò Ö Ó«Ö¹ÁÒ ÍÐÖ ÓÖ ÓÐØ
More informationComputational Statistics for Big Data
Lancaster University Computational Statistics for Big Data Author: 1 Supervisors: Paul Fearnhead 1 Emily Fox 2 1 Lancaster University 2 The University of Washington September 1, 2015 Abstract The amount
More informationhospital physician(2)... disease(4) treat(2) W305(2) leukemia(3) leukemia(2) cancer
Ë ÙÖ ÅÄ ÈÙ Ð Ò Û Ø ÓÙØ ÁÒ ÓÖÑ Ø ÓÒ Ä Ò Ø ÈÖ Ò Ó Ø ÁÒ Ö Ò Ó ÙÒ Ò Ô ÖØÑ ÒØ Ó ÓÑÔÙØ Ö Ë Ò ÆÓÖØ Ø ÖÒ ÍÒ Ú Ö ØÝ Ä ÓÒ Ò ½½¼¼¼ Ò Ý Ò ÜÑ ÐºÒ Ùº ÙºÒ Ò Ä Ý Ë ÓÓÐ Ó ÁÒ ÓÖÑ Ø ÓÒ Ò ÓÑÔÙØ Ö Ë Ò ÍÒ Ú Ö ØÝ Ó Ð ÓÖÒ ÁÖÚ
More informationMaster s Theory Exam Spring 2006
Spring 2006 This exam contains 7 questions. You should attempt them all. Each question is divided into parts to help lead you through the material. You should attempt to complete as much of each problem
More informationNonlinear Regression:
Zurich University of Applied Sciences School of Engineering IDP Institute of Data Analysis and Process Design Nonlinear Regression: A Powerful Tool With Considerable Complexity Half-Day : Improved Inference
More information