FalseAlarm and NonDetection Probabilities for Online Quality Control via HMM


 Randall Malone
 2 years ago
 Views:
Transcription
1 Int. Journal of Math. Analysis, Vol. 6, 2012, no. 24, FalseAlarm and NonDetection Probabilities for Online Quality Control via HMM C.C.Y. Dorea a,1, C.R. Gonçalves a, P.G. Medeiros b and W.B. Santos a a Universidade de Brasilia BrasiliaDF, Brazil b Universidade Federal do Rio Grande do Norte NatalRN, Brazil Abstract Online quality control during production calls for monitoring produced items according to some prescribed strategy. It is reasonable to assume the existence of system internal nonobservable variables so that the carried out monitoring is only partially reliable. In this note, under the setting of a Hidden Markov Model (HMM) and assuming that the evolution of the internal state changes are governed by a twostate Markov chain, we derive estimates for falsealarm and nondetection malfunctioning probabilities. Kernel density methods are used to approximate the stable regime density and the stationary probabilities. As a side result, alternative monitoring strategies are proposed. Mathematics Subject Classification: 60J20, 60J10, 90B30 Keywords: Hidden Markov model; Falsealarm; Kernel density methods 1. Introduction Limited by the cost function a sampling interval m is selected and classical online quality control during production adopts the procedure of monitoring the sequence of items, independently produced, by examining a single item at every m produced items. Based on the quality requirements and on the distribution of the examined variable a control region C is prespecified. If the examined item satisfies the control limits, the process is said to be in 1 Corresponding author : Research partially supported by CNPq, CAPES, FAPDF and FINATEC.
2 1154 C.C.Y. Dorea, C.R. Gonçalves, P.G. Medeiros and W.B. Santos control and the production continues; otherwise, the process is declared out of control and the production is stopped for adjustments. After adjustments the production is resumed and it is in control again. At each stoppage a new production cycle is defined (see, for example, [4]). Suppose now the internal working status of the system is nonobservable and may change from a good working condition (on control) to a deteriorating status (out of control). In [2] it is proposed a model where these changes are governed by a twostate Markov chain {θ n } n 0. When θ n = 0 the process is said to be in control at time n; and, if θ n = 1 the process is out of control. In their proposal, an observable random variable X n, related to characteristics of interest, is examined at every m produced items. It is assumed that X n has a Gaussian distribution, N (μ, σ 2 ), with μ = μ θn. And values of m as well as the parameter d of the control region C =(μ 0 dσ, μ 0 + dσ) were determined by considering a given cost function to be minimized. Here, in the framework of a Hidden Markov Model (HMM), we compute and propose estimation techniques for the falsealarm and nondetection probabilities. Falsealarm occurs if the observed variable falls outside the control region but the nonobservable internal system state is 0, a good working state. When the opposite occurs we have a nondetection situation. It is assumed that all the working (good) states are lumped together as state 0 and the deteriorating states are gathered as state 1. A Markov chain {θ n } n 0 describes the evolution of the state of the production system. Associated with this chain we observe a sequence of conditionally independent random variables {X n } n 1, with the distribution of each X n depending on the corresponding state θ n. This process {θ n,x n } is generally referred to as a HMM. More specifically, we have P (X n+1 A X 1,...,X n,θ 0,...,θ n )=P (X n+1 A θ n ) (1) and n P (X 1 A 1,...,X n A n θ 1,...,θ n )= P (X j A j θ j ). (2) j=1 In section 2, we treat the special case where the transition matrix of {θ n } as well as the conditional densities of X n given θ n are known, but not necessarily Gaussian densities. For any initial distribution of θ 0, Proposition 1 and Proposition 2 give the falsealarm and the nondetection probabilities. As a side result, upper bounds for the sampling interval m are proposed. In section 3, we assume that the transition probabilities of the hidden chain {θ n } are unknown. Based on the observable sample X 1,...,X n kernel density methods are used to approximate the stable regime density. Theorem
3 HMM for online quality control analysis shows that the limiting stable density is a mixture of densities, which in the particular case treated in [2] reduces to NORMIX (mixture of normal densities). Corollary 1 provide an estimate for the stationary distribution of {θ n } and leads to an alternative monitoring strategy that takes into account the falsealarm situations. And the estimates for falsealarm and nondetection probabilities can be found in Corollary Falsealarm and Nondetection For the HMM process {θ n,x n } assume that the chain {θ n } has known transition probabilities given by ( ) 1 p p P = ɛ 1 ɛ 0 <p<1, ɛ > 0 and p + ɛ<1. (3) The conditional distribution of X n given θ n are also known and based on this distribution a control region C is preselected. It is assumed that P (X n A θ n = i) = f(x i)dx, 0 <q 0 = f(x 0)dx < 1 and 0 <q 1 = C c f(x 1)dx < 1. C c (4) If the sampling interval m = 1, the online quality monitoring adopts the following strategy : items X 1,X 2,... are inspected and verified whether X 1 C, X 2 C,...; maintenance is required at time n if X 1 C,...,X n 1 C and X n / C. Thus we can define the alert times by τ X = inf{k : k 1,X k / C}. Falsealarm occurs at time k if τ X = k but the nonobservable internal system state is 0, a good working state. Let τ θ be defined as the first time, after time 0, the system reaches state 1, A τ θ = inf{k : k 1,θ k =1}. (5) Then falsealarm and nondetection correspond, respectively, to the events (τ X < τ θ ) and (τ X > τ θ ). Let P ν denote the probability when the initial
4 1156 C.C.Y. Dorea, C.R. Gonçalves, P.G. Medeiros and W.B. Santos distribution of θ 0 is ν. Similarly, let P 0 and P 1 denote the probability when θ 0 = 0 and θ 0 = 1 respectively. Proposition 1. Let ν be the initial distribution of θ 0. Then the falsealarm probability is given by (1 p)q 0 P ν (τ X <τ θ )=ν(0) 1 (1 p)(1 q 0 ) + ν(1) ɛq 0 (6) 1 (1 p)(1 q 0 ) and the nondetection probability is given by p(1 q 1 ) P ν (τ X >τ θ )=ν(0) 1 (1 p)(1 q 0 ) + ν(1)[q 0(1 ɛ)+(1 q 0 )p](1 q 1 ). 1 (1 p)(1 q 0 ) (7) Proof. (i) For θ 0 = 0 we have from (3) and (4) P 0 (τ X =1,τ θ > 1) = P 0 (θ 1 =0,X 1 / C) =(1 p)q 0 and from (1) and (2) we have for k 2 P 0 (τ X = k, τ θ >k) = P 0 (X 1 C,,X k 1 C, X k / C, θ 1 = = θ k =0) = k 1 P 0 (θ 1 = = θ k = 0)[ P (X j C θ j = 0)]P (X k / C θ k =0) It follows that j=1 = (1 p)[(1 p)(1 q 0 )] k 1 q 0. P 0 (τ X <τ θ )= Similarly, if θ 0 = 1 we have and for k 2 (1 p)q 0 1 (1 p)(1 q 0 ). P 1 (τ X =1,τ θ > 1) = P (θ 1 =0 θ 0 =1)P (X 1 / C θ 1 =0)=ɛq 0 And (6) follows. (ii) To prove (7) note that and for k 2 P 1 (τ X = k, τ θ >k)=ɛ[(1 p)(1 q 0 )] k 1 q 0. P 0 (τ X = τ θ =1)=P (θ 1 =1 θ 0 =0)P (X 1 / C θ 1 =1)=pq 1 P 0 (τ X = τ θ = k) = [(1 p)(1 q 0 )] k 1 pq 1.
5 HMM for online quality control analysis 1157 Moreover, P 1 (τ X = τ θ =1)=(1 ɛ)q 1 and for k 2 P 1 (τ X = τ θ = k) =ɛ(1 q 0 )[(1 p)(1 q 0 )] k 2 pq 1. It follows that pq 1 P ν (τ X = τ θ )=ν(0) 1 (1 p)(1 q 0 ) + ν(1)[q 0(1 ɛ)+(1 q 0 )p]q 1. 1 (1 p)(1 q 0 ) This along with (6) give us (7). Now, assume that a single item is inspected at every m items produced. Then for m 2 we can define and and τ (m) X = inf{km : k 1,X km / C}. (8) Using the same type of arguments as above we get P 0 (τ (m) X = km, τ θ >km) = (1 p) km (1 q 0 ) k 1 q 0 = (1 p) m [(1 p) m (1 q 0 )] k 1 q 0 P 1 (τ (m) X = km, τ θ >km)=ɛ(1 p) m 1 [(1 p) m (1 q 0 )] k 1 q 0. Moreover, P 0 (τ (m) X = τ θ = km) = [(1 p) m (1 q 0 )] k 1 (1 p) m 1 pq 1 P 1 (τ (m) X = τ θ = km) = [(1 p) m (1 q 0 )] k 1 ɛ(1 p) m 2 pq 1. Proposition 2. Let ν be the initial distribution of θ 0. Assume that the monitoring strategy has sampling interval m. Then the falsealarm probability is given by P ν (τ (m) X <τ (1 p) m q 0 θ)=ν(0) 1 (1 p) m (1 q 0 ) + ν(1) ɛ(1 p) m 1 q 0 1 (1 p) m (1 q 0 ) (9)
6 1158 C.C.Y. Dorea, C.R. Gonçalves, P.G. Medeiros and W.B. Santos and for m 2 the nondetection probability is given by P ν (τ (m) X >τ θ) = ν(0) 1 (1 p)m 1 +(1 p) m 1 p(1 q 1 ) 1 (1 p) m (1 q 0 ) + ν(1) 1 (1 p)m (1 q 0 ) ɛ(1 p) m 2 [(1 p)q 0 + pq 1 ]. 1 (1 p) m (1 q 0 ) (10) Next, we propose upper bounds for the sampling interval m. Wemay assume that the process starts at good working conditions (θ 0 =0,X 0 C). Our aim is to detect whether the chain {θ n } has changed to state 1. A trivial upper bound is given by the mean changing time from state 0 to state 1. From (3) and (5) we have m kp(τ θ = k θ 0 =0)= k(1 p) k 1 p = 1 p. k 1 k 1 Since {θ n } is nonobservable, the designed monitoring strategy relies on the observable process {X n }. Taking this into account one should choose m smaller so that in average we will detect the first time the process {θ n,x n } reaches the alert zone. Alert occurs at time k if either X k C c or θ k =1. And this can be expressed by τ A = inf{k : k 1, (θ k,x k ) A}. where A =({0} C c ) ({1} C) ({1} C c ). Since P ((θ k+1,x k+1 ) A c (θ k,x k ) A c )=(1 p)(1 q 0 ), the expected first hitting time in alert zone is given by m E(τ A θ 0 =0,X 0 C) = 3. Estimation Results 1 1 (1 p)(1 q 0 ). In this section we assume that the hidden Markov chain {θ n } has transition matrix P of the form (3), but unknown. As for the process {X n }, we assume that the conditional densities are known and satisfy condition (4). Note that since all entries of P are strictly positive, {θ n } is an ergodic chain and the stationary (limiting) distribution exists, πp = π, π(0) = ɛ p + ɛ and π(1) = p p + ɛ. (11)
7 HMM for online quality control analysis 1159 Define the mixture density function f(x) = π(0)f(x 0) + π(1)f(x 1). (12) Then, in some sense, f( ) represents the density of {X n } when the process reaches some stable regime. Mixture models have been well recognized as useful in many practical applications. It is a popular modelbased approach to dealing with data in the presence of population heterogeneity, in the sense that, data consist of unlabelled observations, each of which is thought to belong to one of the distinct classes. For a comprehensive list of applications and literature survey in this area see, for example, [3]. Though we are assuming known conditional densities, the stable regime density (12) may indicate which type of distribution one should assume for the variables X n as well as which control region C one should select. Results from [1] show that, based on the observable sample X 1,...,X n, kernel density methods can be successfully used to estimate the stable regime density. For a probability density K on R define ˆf n (x) = 1 nh n k=1 K( X k x ),h= h n 0,nh n as n. (13) h Typically one takes K( ) either a Gaussian density or an uniform density centered at x. Using these results we have Theorem 1 which allows us to make inference on P. Its proof will be postponed to the end of this section. Theorem 1. Assume that the process {θ n,x n } satisfies (3) and (4) and let ν be any initial distribution of θ 0. Then given δ>0 there exist c 1 = c 1 (δ) > 0 and c 2 = c 2 (δ) > 0 such that P ν ( ˆf n (y) f(y) dy δ) c 1 exp{ c 2 n} (14) and almost surely (a.s.) lim n ˆf n (y) f(y) dy = 0 a.s. (15) Next, we estimate the stationary probabilities (11). Choose x so that f(x 0) f(x 1) and define ˆf n (x ) f(x 1) ˆπ n (0) = f(x 0) f(x 1) and ˆπ n(1) = 1 ˆπ n (0). (16)
8 1160 C.C.Y. Dorea, C.R. Gonçalves, P.G. Medeiros and W.B. Santos From (15) it follows that, Corollary 1. For any initial distribution of θ 0 we have with probability 1, ˆπ n (0) π(0) and ˆπ n (1) π(1) as n. (17) This result suggests an alternative online control procedure that will take into account the falsealarm situations. Let ˆf n (m) (x )= 1 n K( X km x ). nh h Then, from (15) we have lim n k=1 (m) ˆf n (x ) f(x ) a.s. (m) Thus, with ˆf n (x ) in place of ˆf n (x ) in (16) we get (17). It follows that the posterior distribution P (θ nm =0 X m,...,x nm ) can be approximated by ˆf n ˆP (m) (x ) f(x 1) f(x 0) (θ nm =0 X m,...,x nm )= f(x 0) f(x 1) ˆf n (m) (x ). Monitoring Strategy. Assume that the conditional densities f( 0) and f( 1) are both known. Suppose that the control region C and the sampling interval m have been preselected. Let τ (m) X be defined by (8) and let 0 <η<1 be a given significance level. Then intervention is carried out at time nm if τ (m) X = nm and ˆP (θnm =0 Xm,...,Xnm) <η. From (16) we can also estimate falsealarm and nondetection probabilities. Observe that, in longrun, the falsealarm can be computed as P (θ km =0 X km / C) = P (X km / C θ km =0)P (θ km =0). P (X km / C) But P (X km / C θ km =0)=q 0 and by (11) we have lim P (θ km =0)=π(0). n From Theorem 1 with f( ) given by (12) we have lim P (X km / C) = f(x)dx. n C c Similarly, we have for nondetection P (θ km =1 X km C) = P (X km C θ km =1)P (θ km =1). P (X km C)
9 HMM for online quality control analysis 1161 These results can be summarized by: Corollary 2. For any initial distribution of θ 0 we have with probability 1, q 0ˆπ n (0) ˆf C c n (x)dx P (falsealarm) and (1 q 1)ˆπ n (1) C ˆf P (nondetection). (18) n (x)dx Proof of Theorem 1. Enough to verify that the hypotheses of Theorem 2 and Corollary 1 from [1] are satisfied. First, we shown that {θ n } is is uniformly ergodic, that is, there exists 0 <ρ<1 such that From (3) we have, ɛ P n = p + ɛ P n ij π(j) ρ n i, j =0, 1. (19) + p(1 p ɛ)n p + ɛ ɛ p ɛ)n ɛ(1 p + ɛ p + ɛ p p ɛ)n p(1 p + ɛ p + ɛ p p ɛ)n + ɛ(1 p + ɛ p + ɛ and from (11) we get (19) by taking ρ =1 p ɛ. Next, we show that {θ n } satisfies the φmixing condition : A F k and B Fk+n P π (A B) P π (A)P π (B) φ(n)p π (A) (20) with n 1 φ(n) < and σalgebras defined by F n = σ(θ 0,...,θ n ) and F n = σ(θ n,θ n+1,...). Note that for A =(θ 0 = a 0,...,θ k = a k ), B =(θ k+n = b k+n,...) and P π (A) > 0 we have and P π (B A) =P π (B θ k = a k )=P n a k b k+n P π (θ k+n+1 = b k+n+1,... θ k+n = b k+n ) It follows that P π (B) =π(b k+n )P π (θ k+n+1 = b k+n+1,... θ k+n = b k+n ). P π (B A) P π (B) P n a k b k+n π(b k+n ) ρ n = φ(n) and (20) is satisfied. References :
10 1162 C.C.Y. Dorea, C.R. Gonçalves, P.G. Medeiros and W.B. Santos [1] Dorea, C.C.Y. and Zhao, L.C. (2002)  Nonparametric density estimation in Hidden Markov Models, Statis. Inference for Stoch. Processes, vol. 5, [2] Ho, L.L.; Medeiros, P.G. and Borges, W. (2007)  An alternative model for online quality monitoring for variables, Intern. Jour. of Production Economics, vol. 107, [3] McLachlan, G.L. and Peel, D. (2000)  Finite Mixture Models,John Wiley, New York. [4] Taguchi, G.; Elsayed, E.D. and Hsiang, T. (1989)  Quality Engineering in Production Systems, McGrawHill, New York. Received: November, 2011
1 Limiting distribution for a Markov chain
Copyright c 2009 by Karl Sigman Limiting distribution for a Markov chain In these Lecture Notes, we shall study the limiting behavior of Markov chains as time n In particular, under suitable easytocheck
More informationNON SINGULAR MATRICES. DEFINITION. (Non singular matrix) An n n A is called non singular or invertible if there exists an n n matrix B such that
NON SINGULAR MATRICES DEFINITION. (Non singular matrix) An n n A is called non singular or invertible if there exists an n n matrix B such that AB = I n = BA. Any matrix B with the above property is called
More informationChapter 4 Expected Values
Chapter 4 Expected Values 4. The Expected Value of a Random Variables Definition. Let X be a random variable having a pdf f(x). Also, suppose the the following conditions are satisfied: x f(x) converges
More informationChap2: The Real Number System (See Royden pp40)
Chap2: The Real Number System (See Royden pp40) 1 Open and Closed Sets of Real Numbers The simplest sets of real numbers are the intervals. We define the open interval (a, b) to be the set (a, b) = {x
More informationMonte Carlobased statistical methods (MASM11/FMS091)
Monte Carlobased statistical methods (MASM11/FMS091) Jimmy Olsson Centre for Mathematical Sciences Lund University, Sweden Lecture 6 Sequential Monte Carlo methods II February 3, 2012 Changes in HA1 Problem
More informationNonparametric adaptive age replacement with a onecycle criterion
Nonparametric adaptive age replacement with a onecycle criterion P. CoolenSchrijner, F.P.A. Coolen Department of Mathematical Sciences University of Durham, Durham, DH1 3LE, UK email: Pauline.Schrijner@durham.ac.uk
More informationTHE CENTRAL LIMIT THEOREM TORONTO
THE CENTRAL LIMIT THEOREM DANIEL RÜDT UNIVERSITY OF TORONTO MARCH, 2010 Contents 1 Introduction 1 2 Mathematical Background 3 3 The Central Limit Theorem 4 4 Examples 4 4.1 Roulette......................................
More informationSolution Using the geometric series a/(1 r) = x=1. x=1. Problem For each of the following distributions, compute
Math 472 Homework Assignment 1 Problem 1.9.2. Let p(x) 1/2 x, x 1, 2, 3,..., zero elsewhere, be the pmf of the random variable X. Find the mgf, the mean, and the variance of X. Solution 1.9.2. Using the
More information6.4 The Infinitely Many Alleles Model
6.4. THE INFINITELY MANY ALLELES MODEL 93 NE µ [F (X N 1 ) F (µ)] = + 1 i
More informationMonte Carlo and Empirical Methods for Stochastic Inference (MASM11/FMS091)
Monte Carlo and Empirical Methods for Stochastic Inference (MASM11/FMS091) Magnus Wiktorsson Centre for Mathematical Sciences Lund University, Sweden Lecture 5 Sequential Monte Carlo methods I February
More informationMathematics Course 111: Algebra I Part IV: Vector Spaces
Mathematics Course 111: Algebra I Part IV: Vector Spaces D. R. Wilkins Academic Year 19967 9 Vector Spaces A vector space over some field K is an algebraic structure consisting of a set V on which are
More informationDouble Sequences and Double Series
Double Sequences and Double Series Eissa D. Habil Islamic University of Gaza P.O. Box 108, Gaza, Palestine Email: habil@iugaza.edu Abstract This research considers two traditional important questions,
More informationMarkov Chains, Stochastic Processes, and Advanced Matrix Decomposition
Markov Chains, Stochastic Processes, and Advanced Matrix Decomposition Jack Gilbert Copyright (c) 2014 Jack Gilbert. Permission is granted to copy, distribute and/or modify this document under the terms
More informationContinued Fractions and the Euclidean Algorithm
Continued Fractions and the Euclidean Algorithm Lecture notes prepared for MATH 326, Spring 997 Department of Mathematics and Statistics University at Albany William F Hammond Table of Contents Introduction
More information6. Metric spaces. In this section we review the basic facts about metric spaces. d : X X [0, )
6. Metric spaces In this section we review the basic facts about metric spaces. Definitions. A metric on a nonempty set X is a map with the following properties: d : X X [0, ) (i) If x, y X are points
More informationProperties of BMO functions whose reciprocals are also BMO
Properties of BMO functions whose reciprocals are also BMO R. L. Johnson and C. J. Neugebauer The main result says that a nonnegative BMOfunction w, whose reciprocal is also in BMO, belongs to p> A p,and
More informationCHAPTER 5. Product Measures
54 CHAPTER 5 Product Measures Given two measure spaces, we may construct a natural measure on their Cartesian product; the prototype is the construction of Lebesgue measure on R 2 as the product of Lebesgue
More informationCycle transversals in bounded degree graphs
Electronic Notes in Discrete Mathematics 35 (2009) 189 195 www.elsevier.com/locate/endm Cycle transversals in bounded degree graphs M. Groshaus a,2,3 P. Hell b,3 S. Klein c,1,3 L. T. Nogueira d,1,3 F.
More informationSeries Convergence Tests Math 122 Calculus III D Joyce, Fall 2012
Some series converge, some diverge. Series Convergence Tests Math 22 Calculus III D Joyce, Fall 202 Geometric series. We ve already looked at these. We know when a geometric series converges and what it
More informationHow to Gamble If You Must
How to Gamble If You Must Kyle Siegrist Department of Mathematical Sciences University of Alabama in Huntsville Abstract In red and black, a player bets, at even stakes, on a sequence of independent games
More information5. Convergence of sequences of random variables
5. Convergence of sequences of random variables Throughout this chapter we assume that {X, X 2,...} is a sequence of r.v. and X is a r.v., and all of them are defined on the same probability space (Ω,
More informationThe Ergodic Theorem and randomness
The Ergodic Theorem and randomness Peter Gács Department of Computer Science Boston University March 19, 2008 Peter Gács (Boston University) Ergodic theorem March 19, 2008 1 / 27 Introduction Introduction
More informationMATH 461: Fourier Series and Boundary Value Problems
MATH 461: Fourier Series and Boundary Value Problems Chapter III: Fourier Series Greg Fasshauer Department of Applied Mathematics Illinois Institute of Technology Fall 2015 fasshauer@iit.edu MATH 461 Chapter
More informationON THE EXISTENCE AND LIMIT BEHAVIOR OF THE OPTIMAL BANDWIDTH FOR KERNEL DENSITY ESTIMATION
Statistica Sinica 17(27), 2893 ON THE EXISTENCE AND LIMIT BEHAVIOR OF THE OPTIMAL BANDWIDTH FOR KERNEL DENSITY ESTIMATION J. E. Chacón, J. Montanero, A. G. Nogales and P. Pérez Universidad de Extremadura
More informationSection 6.4: Work. We illustrate with an example.
Section 6.4: Work 1. Work Performed by a Constant Force Riemann sums are useful in many aspects of mathematics and the physical sciences than just geometry. To illustrate one of its major uses in physics,
More informationUniversal Algorithm for Trading in Stock Market Based on the Method of Calibration
Universal Algorithm for Trading in Stock Market Based on the Method of Calibration Vladimir V yugin Institute for Information Transmission Problems, Russian Academy of Sciences, Bol shoi Karetnyi per.
More informationSine and Cosine Series; Odd and Even Functions
Sine and Cosine Series; Odd and Even Functions A sine series on the interval [, ] is a trigonometric series of the form k = 1 b k sin πkx. All of the terms in a series of this type have values vanishing
More information1 if 1 x 0 1 if 0 x 1
Chapter 3 Continuity In this chapter we begin by defining the fundamental notion of continuity for real valued functions of a single real variable. When trying to decide whether a given function is or
More informationMetric Spaces. Chapter 7. 7.1. Metrics
Chapter 7 Metric Spaces A metric space is a set X that has a notion of the distance d(x, y) between every pair of points x, y X. The purpose of this chapter is to introduce metric spaces and give some
More informationMonte Carlobased statistical methods (MASM11/FMS091)
Monte Carlobased statistical methods (MASM11/FMS091) Jimmy Olsson Centre for Mathematical Sciences Lund University, Sweden Lecture 5 Sequential Monte Carlo methods I February 5, 2013 J. Olsson Monte Carlobased
More informationP (A) = lim P (A) = N(A)/N,
1.1 Probability, Relative Frequency and Classical Definition. Probability is the study of random or nondeterministic experiments. Suppose an experiment can be repeated any number of times, so that we
More informationFurther Study on Strong Lagrangian Duality Property for Invex Programs via Penalty Functions 1
Further Study on Strong Lagrangian Duality Property for Invex Programs via Penalty Functions 1 J. Zhang Institute of Applied Mathematics, Chongqing University of Posts and Telecommunications, Chongqing
More informationAverage System Performance Evaluation using Markov Chain
Designing high performant Systems: statistical timing analysis and optimization Average System Performance Evaluation using Markov Chain Weiyun Lu Supervisor: Martin Radetzki Sommer Semester 2006 Stuttgart
More informationON LIMIT LAWS FOR CENTRAL ORDER STATISTICS UNDER POWER NORMALIZATION. E. I. Pancheva, A. GacovskaBarandovska
Pliska Stud. Math. Bulgar. 22 (2015), STUDIA MATHEMATICA BULGARICA ON LIMIT LAWS FOR CENTRAL ORDER STATISTICS UNDER POWER NORMALIZATION E. I. Pancheva, A. GacovskaBarandovska Smirnov (1949) derived four
More informationNotes on metric spaces
Notes on metric spaces 1 Introduction The purpose of these notes is to quickly review some of the basic concepts from Real Analysis, Metric Spaces and some related results that will be used in this course.
More informationDefinition: Suppose that two random variables, either continuous or discrete, X and Y have joint density
HW MATH 461/561 Lecture Notes 15 1 Definition: Suppose that two random variables, either continuous or discrete, X and Y have joint density and marginal densities f(x, y), (x, y) Λ X,Y f X (x), x Λ X,
More informationORDERS OF ELEMENTS IN A GROUP
ORDERS OF ELEMENTS IN A GROUP KEITH CONRAD 1. Introduction Let G be a group and g G. We say g has finite order if g n = e for some positive integer n. For example, 1 and i have finite order in C, since
More information15 Markov Chains: Limiting Probabilities
MARKOV CHAINS: LIMITING PROBABILITIES 67 Markov Chains: Limiting Probabilities Example Assume that the transition matrix is given by 7 2 P = 6 Recall that the nstep transition probabilities are given
More informationINTRODUCTION TO THE CONVERGENCE OF SEQUENCES
INTRODUCTION TO THE CONVERGENCE OF SEQUENCES BECKY LYTLE Abstract. In this paper, we discuss the basic ideas involved in sequences and convergence. We start by defining sequences and follow by explaining
More informationSome Research Problems in Uncertainty Theory
Journal of Uncertain Systems Vol.3, No.1, pp.310, 2009 Online at: www.jus.org.uk Some Research Problems in Uncertainty Theory aoding Liu Uncertainty Theory Laboratory, Department of Mathematical Sciences
More informationSome stability results of parameter identification in a jump diffusion model
Some stability results of parameter identification in a jump diffusion model D. Düvelmeyer Technische Universität Chemnitz, Fakultät für Mathematik, 09107 Chemnitz, Germany Abstract In this paper we discuss
More informationk=1 k2, and therefore f(m + 1) = f(m) + (m + 1) 2 =
Math 104: Introduction to Analysis SOLUTIONS Alexander Givental HOMEWORK 1 1.1. Prove that 1 2 +2 2 + +n 2 = 1 n(n+1)(2n+1) for all n N. 6 Put f(n) = n(n + 1)(2n + 1)/6. Then f(1) = 1, i.e the theorem
More informationLecture 4: Random Variables
Lecture 4: Random Variables 1. Definition of Random variables 1.1 Measurable functions and random variables 1.2 Reduction of the measurability condition 1.3 Transformation of random variables 1.4 σalgebra
More informationROLLING HORIZON PROCEDURES FOR THE SOLUTION OF AN OPTIMAL REPLACEMENT
REVISTA INVESTIGACIÓN OPERACIONAL VOL 34, NO 2, 105116, 2013 ROLLING HORIZON PROCEDURES FOR THE SOLUTION OF AN OPTIMAL REPLACEMENT PROBLEM OF nmachines WITH RANDOM HORIZON Rocio Ilhuicatzi Roldán and
More informationMath 317 HW #7 Solutions
Math 17 HW #7 Solutions 1. Exercise..5. Decide which of the following sets are compact. For those that are not compact, show how Definition..1 breaks down. In other words, give an example of a sequence
More informationNotes V General Equilibrium: Positive Theory. 1 Walrasian Equilibrium and Excess Demand
Notes V General Equilibrium: Positive Theory In this lecture we go on considering a general equilibrium model of a private ownership economy. In contrast to the Notes IV, we focus on positive issues such
More informationMonte Carlo and Empirical Methods for Stochastic Inference (MASM11/FMS091)
Monte Carlo and Empirical Methods for Stochastic Inference (MASM11/FMS091) Magnus Wiktorsson Centre for Mathematical Sciences Lund University, Sweden Lecture 6 Sequential Monte Carlo methods II February
More informationJointly Distributed Random Variables
Jointly Distributed Random Variables COMP 245 STATISTICS Dr N A Heard Contents 1 Jointly Distributed Random Variables 1 1.1 Definition......................................... 1 1.2 Joint cdfs..........................................
More informationMATH 10: Elementary Statistics and Probability Chapter 5: Continuous Random Variables
MATH 10: Elementary Statistics and Probability Chapter 5: Continuous Random Variables Tony Pourmohamad Department of Mathematics De Anza College Spring 2015 Objectives By the end of this set of slides,
More information1. (First passage/hitting times/gambler s ruin problem:) Suppose that X has a discrete state space and let i be a fixed state. Let
Copyright c 2009 by Karl Sigman 1 Stopping Times 1.1 Stopping Times: Definition Given a stochastic process X = {X n : n 0}, a random time τ is a discrete random variable on the same probability space as
More informationAdaptive Search with Stochastic Acceptance Probabilities for Global Optimization
Adaptive Search with Stochastic Acceptance Probabilities for Global Optimization Archis Ghate a and Robert L. Smith b a Industrial Engineering, University of Washington, Box 352650, Seattle, Washington,
More informationLOGNORMAL MODEL FOR STOCK PRICES
LOGNORMAL MODEL FOR STOCK PRICES MICHAEL J. SHARPE MATHEMATICS DEPARTMENT, UCSD 1. INTRODUCTION What follows is a simple but important model that will be the basis for a later study of stock prices as
More informationx a x 2 (1 + x 2 ) n.
Limits and continuity Suppose that we have a function f : R R. Let a R. We say that f(x) tends to the limit l as x tends to a; lim f(x) = l ; x a if, given any real number ɛ > 0, there exists a real number
More informationMaster s Theory Exam Spring 2006
Spring 2006 This exam contains 7 questions. You should attempt them all. Each question is divided into parts to help lead you through the material. You should attempt to complete as much of each problem
More informationThe positive minimum degree game on sparse graphs
The positive minimum degree game on sparse graphs József Balogh Department of Mathematical Sciences University of Illinois, USA jobal@math.uiuc.edu András Pluhár Department of Computer Science University
More informationIrreducibility criteria for compositions and multiplicative convolutions of polynomials with integer coefficients
DOI: 10.2478/auom20140007 An. Şt. Univ. Ovidius Constanţa Vol. 221),2014, 73 84 Irreducibility criteria for compositions and multiplicative convolutions of polynomials with integer coefficients Anca
More informationAbout the inverse football pool problem for 9 games 1
Seventh International Workshop on Optimal Codes and Related Topics September 61, 013, Albena, Bulgaria pp. 15133 About the inverse football pool problem for 9 games 1 Emil Kolev Tsonka Baicheva Institute
More informationFourier Series. A Fourier series is an infinite series of the form. a + b n cos(nωx) +
Fourier Series A Fourier series is an infinite series of the form a b n cos(nωx) c n sin(nωx). Virtually any periodic function that arises in applications can be represented as the sum of a Fourier series.
More information{f 1 (U), U F} is an open cover of A. Since A is compact there is a finite subcover of A, {f 1 (U 1 ),...,f 1 (U n )}, {U 1,...
44 CHAPTER 4. CONTINUOUS FUNCTIONS In Calculus we often use arithmetic operations to generate new continuous functions from old ones. In a general metric space we don t have arithmetic, but much of it
More informationHandout #1: Mathematical Reasoning
Math 101 Rumbos Spring 2010 1 Handout #1: Mathematical Reasoning 1 Propositional Logic A proposition is a mathematical statement that it is either true or false; that is, a statement whose certainty or
More informationCourse 421: Algebraic Topology Section 1: Topological Spaces
Course 421: Algebraic Topology Section 1: Topological Spaces David R. Wilkins Copyright c David R. Wilkins 1988 2008 Contents 1 Topological Spaces 1 1.1 Continuity and Topological Spaces...............
More informationThe Expectation Maximization Algorithm A short tutorial
The Expectation Maximiation Algorithm A short tutorial Sean Borman Comments and corrections to: emtut at seanborman dot com July 8 2004 Last updated January 09, 2009 Revision history 2009009 Corrected
More informationLectures 56: Taylor Series
Math 1d Instructor: Padraic Bartlett Lectures 5: Taylor Series Weeks 5 Caltech 213 1 Taylor Polynomials and Series As we saw in week 4, power series are remarkably nice objects to work with. In particular,
More informationCourse 221: Analysis Academic year , First Semester
Course 221: Analysis Academic year 200708, First Semester David R. Wilkins Copyright c David R. Wilkins 1989 2007 Contents 1 Basic Theorems of Real Analysis 1 1.1 The Least Upper Bound Principle................
More informationRieszFredhölm Theory
RieszFredhölm Theory T. Muthukumar tmk@iitk.ac.in Contents 1 Introduction 1 2 Integral Operators 1 3 Compact Operators 7 4 Fredhölm Alternative 14 Appendices 18 A AscoliArzelá Result 18 B Normed Spaces
More informationThe Alternating Series Test
The Alternating Series Test So far we have considered mostly series all of whose terms are positive. If the signs of the terms alternate, then testing convergence is a much simpler matter. On the other
More informationBANACH AND HILBERT SPACE REVIEW
BANACH AND HILBET SPACE EVIEW CHISTOPHE HEIL These notes will briefly review some basic concepts related to the theory of Banach and Hilbert spaces. We are not trying to give a complete development, but
More informationOn the mathematical theory of splitting and Russian roulette
On the mathematical theory of splitting and Russian roulette techniques St.Petersburg State University, Russia 1. Introduction Splitting is an universal and potentially very powerful technique for increasing
More informationSequences and Convergence in Metric Spaces
Sequences and Convergence in Metric Spaces Definition: A sequence in a set X (a sequence of elements of X) is a function s : N X. We usually denote s(n) by s n, called the nth term of s, and write {s
More informationREAL ANALYSIS I HOMEWORK 2
REAL ANALYSIS I HOMEWORK 2 CİHAN BAHRAN The questions are from Stein and Shakarchi s text, Chapter 1. 1. Prove that the Cantor set C constructed in the text is totally disconnected and perfect. In other
More informationFourier series. Jan Philip Solovej. English summary of notes for Analysis 1. May 8, 2012
Fourier series Jan Philip Solovej English summary of notes for Analysis 1 May 8, 2012 1 JPS, Fourier series 2 Contents 1 Introduction 2 2 Fourier series 3 2.1 Periodic functions, trigonometric polynomials
More informationContinuous Random Variables and Probability Distributions. Stat 4570/5570 Material from Devore s book (Ed 8) Chapter 4  and Cengage
4 Continuous Random Variables and Probability Distributions Stat 4570/5570 Material from Devore s book (Ed 8) Chapter 4  and Cengage Continuous r.v. A random variable X is continuous if possible values
More informationInner Product Spaces
Math 571 Inner Product Spaces 1. Preliminaries An inner product space is a vector space V along with a function, called an inner product which associates each pair of vectors u, v with a scalar u, v, and
More information) + ˆf (n) sin( 2πnt. = 2 u x 2, t > 0, 0 < x < 1. u(0, t) = u(1, t) = 0, t 0. (x, 0) = 0 0 < x < 1.
Introduction to Fourier analysis This semester, we re going to study various aspects of Fourier analysis. In particular, we ll spend some time reviewing and strengthening the results from Math 425 on Fourier
More informationA crash course in probability and Naïve Bayes classification
Probability theory A crash course in probability and Naïve Bayes classification Chapter 9 Random variable: a variable whose possible values are numerical outcomes of a random phenomenon. s: A person s
More informationABOUT UNIQUELY COLORABLE MIXED HYPERTREES
Discussiones Mathematicae Graph Theory 20 (2000 ) 81 91 ABOUT UNIQUELY COLORABLE MIXED HYPERTREES Angela Niculitsa Department of Mathematical Cybernetics Moldova State University Mateevici 60, Chişinău,
More informationTesting predictive performance of binary choice models 1
Testing predictive performance of binary choice models 1 Bas Donkers Econometric Institute and Department of Marketing Erasmus University Rotterdam Bertrand Melenberg Department of Econometrics Tilburg
More informationF. ABTAHI and M. ZARRIN. (Communicated by J. Goldstein)
Journal of Algerian Mathematical Society Vol. 1, pp. 1 6 1 CONCERNING THE l p CONJECTURE FOR DISCRETE SEMIGROUPS F. ABTAHI and M. ZARRIN (Communicated by J. Goldstein) Abstract. For 2 < p
More informationI. GROUPS: BASIC DEFINITIONS AND EXAMPLES
I GROUPS: BASIC DEFINITIONS AND EXAMPLES Definition 1: An operation on a set G is a function : G G G Definition 2: A group is a set G which is equipped with an operation and a special element e G, called
More informationMetric Spaces Joseph Muscat 2003 (Last revised May 2009)
1 Distance J Muscat 1 Metric Spaces Joseph Muscat 2003 (Last revised May 2009) (A revised and expanded version of these notes are now published by Springer.) 1 Distance A metric space can be thought of
More informationSequences of Functions
Sequences of Functions Uniform convergence 9. Assume that f n f uniformly on S and that each f n is bounded on S. Prove that {f n } is uniformly bounded on S. Proof: Since f n f uniformly on S, then given
More informationThe fundamental group of the Hawaiian earring is not free (International Journal of Algebra and Computation Vol. 2, No. 1 (1992), 33 37) Bart de Smit
The fundamental group of the Hawaiian earring is not free Bart de Smit The fundamental group of the Hawaiian earring is not free (International Journal of Algebra and Computation Vol. 2, No. 1 (1992),
More informationFourier Series Chapter 3 of Coleman
Fourier Series Chapter 3 of Coleman Dr. Doreen De eon Math 18, Spring 14 1 Introduction Section 3.1 of Coleman The Fourier series takes its name from Joseph Fourier (1768183), who made important contributions
More information1. R In this and the next section we are going to study the properties of sequences of real numbers.
+a 1. R In this and the next section we are going to study the properties of sequences of real numbers. Definition 1.1. (Sequence) A sequence is a function with domain N. Example 1.2. A sequence of real
More informationPUTNAM TRAINING POLYNOMIALS. Exercises 1. Find a polynomial with integral coefficients whose zeros include 2 + 5.
PUTNAM TRAINING POLYNOMIALS (Last updated: November 17, 2015) Remark. This is a list of exercises on polynomials. Miguel A. Lerma Exercises 1. Find a polynomial with integral coefficients whose zeros include
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 5 9/17/2008 RANDOM VARIABLES
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 5 9/17/2008 RANDOM VARIABLES Contents 1. Random variables and measurable functions 2. Cumulative distribution functions 3. Discrete
More informationGeneral theory of stochastic processes
CHAPTER 1 General theory of stochastic processes 1.1. Definition of stochastic process First let us recall the definition of a random variable. A random variable is a random number appearing as a result
More informationHT2015: SC4 Statistical Data Mining and Machine Learning
HT2015: SC4 Statistical Data Mining and Machine Learning Dino Sejdinovic Department of Statistics Oxford http://www.stats.ox.ac.uk/~sejdinov/sdmml.html Bayesian Nonparametrics Parametric vs Nonparametric
More informationRESULTANT AND DISCRIMINANT OF POLYNOMIALS
RESULTANT AND DISCRIMINANT OF POLYNOMIALS SVANTE JANSON Abstract. This is a collection of classical results about resultants and discriminants for polynomials, compiled mainly for my own use. All results
More informationSHARP BOUNDS FOR THE SUM OF THE SQUARES OF THE DEGREES OF A GRAPH
31 Kragujevac J. Math. 25 (2003) 31 49. SHARP BOUNDS FOR THE SUM OF THE SQUARES OF THE DEGREES OF A GRAPH Kinkar Ch. Das Department of Mathematics, Indian Institute of Technology, Kharagpur 721302, W.B.,
More informationON TOPOLOGICAL SEQUENCE ENTROPY AND CHAOTIC MAPS ON INVERSE LIMIT SPACES. 1. Introduction
Acta Math. Univ. Comenianae Vol. LXVIII, 2(1999), pp. 205 211 205 ON TOPOLOGICAL SEQUENCE ENTROPY AND CHAOTIC MAPS ON INVERSE LIMIT SPACES J. S. CANOVAS Abstract. The aim of this paper is to prove the
More information1 Prior Probability and Posterior Probability
Math 541: Statistical Theory II Bayesian Approach to Parameter Estimation Lecturer: Songfeng Zheng 1 Prior Probability and Posterior Probability Consider now a problem of statistical inference in which
More information4.3 Limit of a Sequence: Theorems
4.3. LIMIT OF A SEQUENCE: THEOREMS 5 4.3 Limit of a Sequence: Theorems These theorems fall in two categories. The first category deals with ways to combine sequences. Like numbers, sequences can be added,
More informationDiscrete Convolution and the Discrete Fourier Transform
Discrete Convolution and the Discrete Fourier Transform Discrete Convolution First of all we need to introduce what we might call the wraparound convention Because the complex numbers w j e i πj N have
More informationTaylor and Maclaurin Series
Taylor and Maclaurin Series In the preceding section we were able to find power series representations for a certain restricted class of functions. Here we investigate more general problems: Which functions
More informationMonte Carlobased statistical methods (MASM11/FMS091)
Monte Carlobased statistical methods (MASM11/FMS091) Magnus Wiktorsson Centre for Mathematical Sciences Lund University, Sweden Lecture 6 Sequential Monte Carlo methods II February 7, 2014 M. Wiktorsson
More informationSome ergodic theorems of linear systems of interacting diffusions
Some ergodic theorems of linear systems of interacting diffusions 4], Â_ ŒÆ êæ ÆÆ Nov, 2009, uà ŒÆ liuyong@math.pku.edu.cn yangfx@math.pku.edu.cn 1 1 30 1 The ergodic theory of interacting systems has
More informationLimits and Continuity
Math 20C Multivariable Calculus Lecture Limits and Continuity Slide Review of Limit. Side limits and squeeze theorem. Continuous functions of 2,3 variables. Review: Limits Slide 2 Definition Given a function
More informationOn a comparison result for Markov processes
On a comparison result for Markov processes Ludger Rüschendorf University of Freiburg Abstract A comparison theorem is stated for Markov processes in polish state spaces. We consider a general class of
More informationRandom graphs with a given degree sequence
Sourav Chatterjee (NYU) Persi Diaconis (Stanford) Allan Sly (Microsoft) Let G be an undirected simple graph on n vertices. Let d 1,..., d n be the degrees of the vertices of G arranged in descending order.
More information