M/M/1 and M/M/m Queueing Systems


 Dwain Garrison
 2 years ago
 Views:
Transcription
1 M/M/ and M/M/m Queueing Systems M. Veeraraghavan; March 20, Preliminaries. Kendall s notation: G/G/n/k queue G: General  can be any distribution. First letter: Arrival process; M: memoryless  exponential interarrival times  Poisson arrival process Second letter: Service times distribution  M: exponential, D  Deterministic Third letter: Number of servers, n Fourth letter: Number in system (including number in queue and number being served) Important: In all cases, service times s n are mutually independent of each other, and are also independent of interarrival times. Successive interarrival times are iid with the distribution specified by the first letter. Successive service times are also iid with the distribution specified by the second letter. This means the arrival process and departure process are both renewal processes  iid random sequence..2 Relation between M/M/ queue and MC Why can the process Nt (), the number of customers in the system at time t in an M/M/ queue, be modeled as a Markov chain? Answer: [4, pg. 26] Given that the memoryless property PLUS the independence assumption of interarrival and service times, the number of customers in the system at a future time t + h only depends upon the number in the system now (at time t ) and the arrivals or departures that occur within the interval h. Past history of how the system got to its state at time t is irrelevant. Additional time needed to complete service of customer being served observes the memoryless property. Nt ( + h) Nt () + Xh ( ) Yh ( ), () where Xh ( ) is the number of arrivals in the time interval ( t, t+ h), and Yh ( ) is the number of departures in the time interval ( t, t+ h). Xh ( ) is dependent only on h because the arrival process
2 is Poisson. Yh ( ) is 0 if the service time of the customer being served, s > h. Yh ( ) is, if s h and s 2 + s > h, and so on. As the service times s, s 2,, s n are independent, neither Xh ( ) nor Yh ( ) depend on what happened prior to t. Thus, N( t+ h) only depends upon Nt () and not the past history. Hence it is a CTMC. 2. Analysis of the M/M/ queue using CTMC results: [3], page First consider a special case of an irreducible timehomogeneous MC, i.e., a birthdeath process. A homogeneous CTMC is a birthdeath process if there exists constants i, i 0,,, and µ i, i 0,, such that the transition rates are given by: q i i+, i, q ii, µ i, q i i + µ i and q ij 0 for i j >. (2) The reason q i i + µ i is as follows: See () in Markov Chain lecture, which states that p jj ( tt, + h) q j () t h + o( h), which for a homogeneous MC can be rewritten as (3) p jj ( h) q j h + o( h) Remembering that the sum of all transition probabilities out of a state is, p jj ( tt, + h) (4) should be equal to p ji ( tt, + h). This is equal to ( i + µ i )h + oh ( ). Therefore q j i + µ i. i Use the global balance equations derived for steadystate solution of an irreducible, homogeneous CTMC (eqn 32 of MC.pdf): k j p k q kj q j p j 0 (5) combined with the equation p j, where p j is the steadystate limiting probability of the j system being in state j and q kj and q j are the transition rates. Applying this to our birthdeath MC, we get ( j + µ j )p j p j + µ j + p j j µ p 0 (6) (7)
3 Eqn. (7) is the same as the detailed balance equation we showed for a birthdeath DTMC in MC.pdf. See Fig. for a birthdeath CTMC. Note the difference between the state diagram of a CTMC and the state diagram of a DTMC. In the latter the arcs are labeled with conditional probabilities; in the former they are labeled with transition rates  so the latter is sometime called transitionrate diagram  this from [3], page n n... n n+... µ µ 2 µ 3 µ n µ n + Figure :CTMC for a birthdeath process; interesting that we don t show the selfloops Rearranging (6), we get: Similarly, and so on until: j p j µ j + p j + j j p j µ j p j j 2 p j µ j p j p j 2 µ j p j (8) (9) p µ 2 p 2 0 µ p. (0) Therefore: j p j µ j + p j + j p j µ j p j j 2 p j 2 µ j p p µ j 0 () From (7), since 0 µ p 0, Therefore: Since p j : j j j p j µ j p j 0 and hence p j pj for (2) j j µ j j j 2 0 p j  for (3) µ j µ j µ p p  i j µ i + i 0
4 . (4) The number of customers in an M/M/ queue is a homogeneous, irreducible birthdeath CTMC in which for i and µ i µ for i. Applying (3) and (4) to this case yields: i p j and, if. (5) µ j p p 0 0 < + µ j µ j µ µ We define traffic intensity, µ. < for a stable system. Server utilization U. + j j i 0 The mean number of customers in the system in the steadystate can be computed: j i  µ i + j 0 EN [ ] np n n n ( ) ( ) n n n 0 n 0 n 0 (6) n EN [ ] ( ) ( ) n n 0 n 0 ( ) ( ) (7) EN [ ] ( ) ( ) 2 ( ) (8) Derive Var[ N] (9) ( ) 2 Mean response time (using Little s Law): Mean waiting time in queue: ET [ ] EN [ ] ( )  µ (20) EW [ ] ET [ ]  µ µ µ Mean number of customers in queue (again using Little s Law):  µ (2) EN [ Q ] EW [ ] ; also EN [ (22) ( ) Q ] EN [ ] ( ) ( ) 2 2
5 Subtract and not because is the probability that the server is busy. Above results hold for disciplines other than FCFS. It holds for any scheduling discipline as long as [3], page 370):. The server is not idle when there are jobs waiting for service (work conserving) 2. The scheduler is not allowed to use any deterministic a priori information about job service times (e.g., Shortest Remaining Processing Time First  SPRT will reduce E[R]). 3. The service time distribution is not affected by the scheduling discipline. 3. Derivation of M/M/ queue results using DTMC Both [4] and [5] analyze the M/M/ queue using a DTMC. Focus attention on the time instants: 0, δ, 2δ, 3δ,, where δ is a small positive number. Let N k be the number of customers in the system at time kδ. The process { N k k 0,, } is a DTMC with the same steadystate occupancy distribution as those of the CTMC Nt (). The DTMC for an M/M/ queue is shown in Fig. δ δ µδ δ µδ δ µδ δ µδ δ δ δ δ δ... n n+... µδ µδ µδ µδ µδ Figure 2:DTMC for an MM/ queue; transition probabilities are correct up to an o( δ) term 2. It is a birthdeath DTMC. The transition probabilities P ij P{ N k + j N k i} is independent of k for a timehomogeneous DTMC. P 00 δ + o( δ) e δ (Poisson arrival process) (23) P ii δ µδ + o( δ) e δ e µδ for i, (24) which is the prob. of 0 arrivals and 0 departures in interval ( kδ, ( k + )δ)., δ + o( δ) e µδ δe δ for i 0, (25) P i i+ which is the prob. of arrival and 0 departures in interval ( kδ, ( k + )δ), µδ + o( δ) e δ µδe µδ for i, (26) P i i which is the prob. of 0 arrivals and departure in interval ( kδ, ( k + )δ)
6 P ij o( δ) for i j > (27) Neglect all terms in the second order of δ. With this DTMC, we can find the stationary distribution (steadystate) using the derivation in MC.pdf for timehomogeneous irreducible DTMCs: ν n lim P{ N k n} k lim P{ N() t n} t Using the detailed balance equations (see the lecture MC.pdf)  since it is a birthdeath process: (28) ν n p nn+ n 0,, ( ) ν n + p ( n + )n Applying it to the DTMC of the M/M/ queue shown in Fig. 2: p n δ + o( δ) p n + µδ + o( δ) (29) (30) As δ 0, Setting µ 4. Distribution of response time + p n for (3) µ n 02,,, p n, we get the same results as with the CTMC derivation. This DOES depend upon the scheduling discipline (unlike the average response time). We derive the response time distribution assuming the FCFS (First Come First Serve) scheduling discipline. Let the arriving job find n jobs in the system. Response time R S+ S' + S S n, where S is the service time of the arriving job, S' is the remaining time of the job in service and S i, i 2,, n are the service times of the ( n ) jobs in the queue. These are n independent random variables. Given the memoryless property of the exponential distribution, we can write the Laplace transform of the conditional distribution of R given N n as L RN ( sn)  µ n + s + µ (32) Laplace transform of a nonnegative continuous random variable X is defined as [3], page 96: L X ( s) Ls ( ) M X ( s) e sx fx ( ) dx 0 (33) If X is a nonnegative integervalued discrete random variable, then we define its ztransform as:
7 G X ( z) Gz ( ) Ez [ X ] M X ( lnz) p X ()z i i, (34) i 0 where moment generating function M X ( θ) is given by (if X is a r.v., Xθ is also a r.v.): M X ( θ) Ee [ Xθ ] (35) The convolution theorem: Let X, X 2,, X n be mutually independent random variables and let Y n X i. Then if M Xi ( θ) exists for all i, then: i M Y ( θ) M X ( θ)m X2 ( θ) M Xn ( θ), (36) i.e., the moment generating function of a sum of independent random variables is the product of the moment generating functions. Proof: ( M Y ( θ) Ee X + X X n )θ [ ] E e X iθ n i n i Ee X iθ [ ] by independence (37) n Hence M Y ( θ) M Xi ( θ) (38) i Sum of mutually exclusive events PA ( B) PA ( ) + PB ( ) and product of independent random variables PX ( X 2 ) PX ( )PX ( 2 ). So for a sum of independent random variables, we use the theorem that the product of moment generating functions of the r.vs. is the moment generating function of the sum. Going back to (32), and applying the theorem of total Laplace transform (like the theorem of total probability), and using (5) for p n, we get: L R ( s) n 0  µ n + ( ) n s + µ (39)
8 L R ( s) µ ( ) s + µ  µ µ ( ) s + µ µ s + µ µ ( ) s + µ ( ) (40) This means R is exponentially distributed with parameter µ ( ). Laplace transform for an exponentially distributed random variable X is: L X ( s) e sx e x dx 0  s + (4) 5. M/M/m queue The underlying Markov chain is again a birthdeath process with k for k 02,,, and (42) kµ 0 < k< m µ k mµ k m (43) Plugging these into (3) yields: k p k p 0 p for, and (44) ( i + )µ 0 µ k  k< m k! m i 0 k p k  for. (45) ( i + )µ p mµ 0 µ k m!m k m k m i 0 j m Here is the interesting thing regarding traffic intensity. We called traffic intensity in the M/M/ queue derivation as it is called in [3], page 368. In [6], page 824, is called traffic load. In an M/M/ queue, the utilization ( ) (i.e., probability that the server is not idle) turns out to be equal to. For an M/M/m queue, the condition for stability is  <. Traffic load should not be mµ dependent on m. But here both [3] and [4] set ( mµ ). NOTE THIS REDEFINITION OF (confusing to redefine but it helps the analytics).
9 Using (45) and p k, we derive as: k 0 m k 0 ( m) k + k! k m ( m) k m!m k m (46) m ( m) k ( m) m + k!  m! k m k 0 k m m k 0 ( m) k ( m) m + k!  m! i i 0 (47) m k 0 ( m) k ( m) m  + k! m! ( ) (48) EN [ ] kp k m +  ( m)m m! ( ) 2 k 0 (Exercise: derive this) (49) If M is an r.v. denoting the number of busy servers, then: m EM [ ] kp k + m p k kp k + m ( m) k m!m k m k 0 m k m m k 0 k m m EM [ ] kp k  ( m) m  mp + kp m m! k +  k 0 m k 0 (50) (5) where p m ( m) m  (52) m! Exercise: Show that EM [ ] m µ. Therefore the utilization of any individual server is ( EM [ ]) m, while the average number of busy servers is equal to traffic intensity µ. I d define utilization of the system to be EM [ ] and hence equal to the traffic intensity (same as in M/M/ queue). See [7], page 492: is called perserver utilization and m is called total traffic intensity. Unit of µ is defined in [7], page 492 as measured in the Erlangs. µ is also referred to as total load on the system. Same as in [6].
10 Probability of an arriving job finding that all m is given by: servers are busy is called ErlangC formula and Pqueueing [ ] p k k m p m  (see (5) and (52)) (53) P Q P[ queueing] ( m) m   p0 (54) m! The above is a call queueing system in a telephone network with an infinite buffer. It s also called Erlang s delayedcall formula. Average number in queue (not in service) is: EN [ Q ] ( k m )p ( k m)p k 0 ( m) k m!m k m k m+ k m+ (55) ( m) m EN [ Q ]  ( k m) k m m! k m+ ( m) m p  0 m! n n n 0 (56) Using (54) and ( ) n n n 0 , we can express the mean number waiting in queue as Using Little s Law, EN [ Q ] P Q ( ) ( ) 2 P Q ( ) (57) EW [ ] P Q ( ) and (58) Using ( mµ ), we get ET [ ] EW [ ] + µ µ P Q + mµ (59) Using Little s Law, EN [ ] P Q µ + mµ P m +  Q, which is the same as (49). (60)
11 Compare M/M/ queue with a fast server operating at mµ with an M/M/m system: Average packet delay (mean response time) in the M/M/m system is: ET [ ] µ P Q + mµ (6) Average packet delay in an M/M/ queue with service rate mµ is: In an M/M/ queue ETˆ [ ] mµ  mµ P ˆ + Q mµ (62) P ˆ Q ( m) m p because p. (63) m! 0 ET [ ]  mµ mµ + mµ ( mµ ) + mµ  mµ ( mµ ) Under light loads «, P Q P ˆ Q 0 then ET  [ ] m ETˆ [ ] Under heavy loads, ˆ and µ «( mµ ), then P Q P Q . (64) ( mµ ) (65) ET [ ]  (66) ETˆ [ ] The above is a comparison of statistical multiplexing (where whole link capacity can be used) and TDM/FDM schemes where once a circuit capacity is assigned, it is not increased during the lifetime of the call. 6. M/M/ Suppose PXt ( () n) is the probability that n telephone lines are busy at time t. Assume that infinitely many lines are available and that the call arrival rate is while average call duration is µ. Find P( Xt () n) as t. Let ENt [ ()] denote the average number of busy lines at time t. Find the value of E[ Nt ()] time for this queueing system in the steady state. This is a M/M/ queueing system. when the system reaches steady state. Also find the average response
12 0 n µ 2µ nµ ( n + )µ State transition diagram As t, we have PX ( n) PX ( n ) nµ µ npx  ( 0 ) n! (67) Thus, PX ( 0)  e µ µ n! n 0 e (68) Since there are always enough telephone lines for any call, the response time follows exponential distribution with the average value of µ. EN [ ] np ( X n ) µ n References [] K. S. Trivedi, Probability, Statistics with Reliability, Queueing and Computer Science Applications, Second Edition, Wiley, 2002, ISBN [2] R. Yates and D. Goodman, Probability and Stochastic Processes, Wiley, ISBN [3] K. S. Trivedi, Probability, Statistics with Reliability, Queueing and Computer Science Applications, First Edition, Prentice Hall, 982, ISBN r. [4] D. Bertsekas and R. Gallager, Data Networks, Prentice Hall, 986, ISBN [5] Prof. Boorstyn s notes, Polytechnic University, NY. [6] A. Leon Garcia and I. Widjaja, Communication Networks, McGraw Hill, 2000, First Edition. [7] Mischa Schwartz, Telecommunications Networks, Protocols, Modeling and Analysis, Addison Wesley, 987. (69)
Performance Analysis of Computer Systems
Performance Analysis of Computer Systems Introduction to Queuing Theory Holger Brunst (holger.brunst@tudresden.de) Matthias S. Mueller (matthias.mueller@tudresden.de) Summary of Previous Lecture Simulation
More information6.263/16.37: Lectures 5 & 6 Introduction to Queueing Theory
6.263/16.37: Lectures 5 & 6 Introduction to Queueing Theory Massachusetts Institute of Technology Slide 1 Packet Switched Networks Messages broken into Packets that are routed To their destination PS PS
More informationIEOR 6711: Stochastic Models, I Fall 2012, Professor Whitt, Final Exam SOLUTIONS
IEOR 6711: Stochastic Models, I Fall 2012, Professor Whitt, Final Exam SOLUTIONS There are four questions, each with several parts. 1. Customers Coming to an Automatic Teller Machine (ATM) (30 points)
More informationRenewal Theory. (iv) For s < t, N(t) N(s) equals the number of events in (s, t].
Renewal Theory Def. A stochastic process {N(t), t 0} is said to be a counting process if N(t) represents the total number of events that have occurred up to time t. X 1, X 2,... times between the events
More informationPerformance Analysis, Autumn 2010
Performance Analysis, Autumn 2010 Bengt Jonsson November 16, 2010 Kendall Notation Queueing process described by A/B/X /Y /Z, where Example A is the arrival distribution B is the service pattern X the
More informationMarkov Chains and Queueing Networks
CS 797 Independent Study Report on Markov Chains and Queueing Networks By: Vibhu Saujanya Sharma (Roll No. Y211165, CSE, IIT Kanpur) Under the supervision of: Prof. S. K. Iyer (Dept. Of Mathematics, IIT
More informationLectures 5 & / Introduction to Queueing Theory
Lectures 5 & 6 6.263/16.37 Introduction to Queueing Theory MIT, LIDS Slide 1 Packet Switched Networks Messages broken into Packets that are routed To their destination PS PS PS PS Packet Network PS PS
More informationQueuing Model Dr. Yifeng Zhu. In queueing theory, the average number of tasks in a stable system (over some time interval), N, is given by
Note 3: M/M/ April, 007 ECE598 Advanced Computer Architecture URL: http://www.eece.maine.edu/ zhu/ece598/ Queuing Model Dr. Yifeng Zhu Little s law In queueing theory, the average number of tasks in a
More informationNetwork Design Performance Evaluation, and Simulation #6
Network Design Performance Evaluation, and Simulation #6 1 Network Design Problem Goal Given QoS metric, e.g., Average delay Loss probability Characterization of the traffic, e.g., Average interarrival
More informationThe Exponential Distribution
21 The Exponential Distribution From DiscreteTime to ContinuousTime: In Chapter 6 of the text we will be considering Markov processes in continuous time. In a sense, we already have a very good understanding
More informationContinuoustime Markov Chains
Continuoustime Markov Chains Gonzalo Mateos Dept. of ECE and Goergen Institute for Data Science University of Rochester gmateosb@ece.rochester.edu http://www.ece.rochester.edu/~gmateosb/ October 31, 2016
More information4 The M/M/1 queue. 4.1 Timedependent behaviour
4 The M/M/1 queue In this chapter we will analyze the model with exponential interarrival times with mean 1/λ, exponential service times with mean 1/µ and a single server. Customers are served in order
More information3. Renewal Theory. Definition 3 of the Poisson process can be generalized: Let X 1, X 2,..., iidf(x) be nonnegative interarrival times.
3. Renewal Theory Definition 3 of the Poisson process can be generalized: Let X 1, X 2,..., iidf(x) be nonnegative interarrival times. Set S n = n i=1 X i and N(t) = max {n : S n t}. Then {N(t)} is a
More information1. Repetition probability theory and transforms
1. Repetition probability theory and transforms 1.1. A prisoner is kept in a cell with three doors. Through one of them he can get out of the prison. The other one leads to a tunnel: through this he is
More informationMarkov Chains: An Introduction/Review
Markov Chains: An Introduction/Review David Sirl dsirl@maths.uq.edu.au http://www.maths.uq.edu.au/ dsirl/ AUSTRALIAN RESEARCH COUNCIL Centre of Excellence for Mathematics and Statistics of Complex Systems
More informationSimple Markovian Queueing Systems
Chapter 4 Simple Markovian Queueing Systems Poisson arrivals and exponential service make queueing models Markovian that are easy to analyze and get usable results. Historically, these are also the models
More informationThe Joint Distribution of Server State and Queue Length of M/M/1/1 Retrial Queue with Abandonment and Feedback
The Joint Distribution of Server State and Queue Length of M/M/1/1 Retrial Queue with Abandonment and Feedback Hamada Alshaer Université Pierre et Marie Curie  Lip 6 7515 Paris, France Hamada.alshaer@lip6.fr
More informationLECTURE 16. Readings: Section 5.1. Lecture outline. Random processes Definition of the Bernoulli process Basic properties of the Bernoulli process
LECTURE 16 Readings: Section 5.1 Lecture outline Random processes Definition of the Bernoulli process Basic properties of the Bernoulli process Number of successes Distribution of interarrival times The
More informationContinuousTime Markov Chains  Introduction
25 ContinuousTime Markov Chains  Introduction Prior to introducing continuoustime Markov chains today, let us start off with an example involving the Poisson process. Our particular focus in this example
More informationWorked examples Random Processes
Worked examples Random Processes Example 1 Consider patients coming to a doctor s office at random points in time. Let X n denote the time (in hrs) that the n th patient has to wait before being admitted
More informatione.g. arrival of a customer to a service station or breakdown of a component in some system.
Poisson process Events occur at random instants of time at an average rate of λ events per second. e.g. arrival of a customer to a service station or breakdown of a component in some system. Let N(t) be
More informationPerformance Analysis of a Telephone System with both Patient and Impatient Customers
Performance Analysis of a Telephone System with both Patient and Impatient Customers Yiqiang Quennel Zhao Department of Mathematics and Statistics University of Winnipeg Winnipeg, Manitoba Canada R3B 2E9
More informationA Uniform Asymptotic Estimate for Discounted Aggregate Claims with Subexponential Tails
12th International Congress on Insurance: Mathematics and Economics July 1618, 2008 A Uniform Asymptotic Estimate for Discounted Aggregate Claims with Subexponential Tails XUEMIAO HAO (Based on a joint
More informationQueueing Systems. Ivo Adan and Jacques Resing
Queueing Systems Ivo Adan and Jacques Resing Department of Mathematics and Computing Science Eindhoven University of Technology P.O. Box 513, 5600 MB Eindhoven, The Netherlands March 26, 2015 Contents
More information1. (First passage/hitting times/gambler s ruin problem:) Suppose that X has a discrete state space and let i be a fixed state. Let
Copyright c 2009 by Karl Sigman 1 Stopping Times 1.1 Stopping Times: Definition Given a stochastic process X = {X n : n 0}, a random time τ is a discrete random variable on the same probability space as
More informationQUEUING THEORY. 1. Introduction
QUEUING THEORY RYAN BERRY Abstract. This paper defines the building blocks of and derives basic queuing systems. It begins with a review of some probability theory and then defines processes used to analyze
More informationUNIT 2 QUEUING THEORY
UNIT 2 QUEUING THEORY LESSON 24 Learning Objective: Apply formulae to find solution that will predict the behaviour of the single server model II. Apply formulae to find solution that will predict the
More informationMarkov Chains. Chapter Introduction and Definitions 110SOR201(2002)
page 5 SOR() Chapter Markov Chains. Introduction and Definitions Consider a sequence of consecutive times ( or trials or stages): n =,,,... Suppose that at each time a probabilistic experiment is performed,
More information1 Limiting distribution for a Markov chain
Copyright c 2009 by Karl Sigman Limiting distribution for a Markov chain In these Lecture Notes, we shall study the limiting behavior of Markov chains as time n In particular, under suitable easytocheck
More informationOverview of Monte Carlo Simulation, Probability Review and Introduction to Matlab
Monte Carlo Simulation: IEOR E4703 Fall 2004 c 2004 by Martin Haugh Overview of Monte Carlo Simulation, Probability Review and Introduction to Matlab 1 Overview of Monte Carlo Simulation 1.1 Why use simulation?
More informationRandom access protocols for channel access. Markov chains and their stability. Laurent Massoulié.
Random access protocols for channel access Markov chains and their stability laurent.massoulie@inria.fr Aloha: the first random access protocol for channel access [Abramson, Hawaii 70] Goal: allow machines
More informationHydrodynamic Limits of Randomized Load Balancing Networks
Hydrodynamic Limits of Randomized Load Balancing Networks Kavita Ramanan and Mohammadreza Aghajani Brown University Stochastic Networks and Stochastic Geometry a conference in honour of François Baccelli
More informationMaster s Theory Exam Spring 2006
Spring 2006 This exam contains 7 questions. You should attempt them all. Each question is divided into parts to help lead you through the material. You should attempt to complete as much of each problem
More informationExponential Distribution
Exponential Distribution Definition: Exponential distribution with parameter λ: { λe λx x 0 f(x) = 0 x < 0 The cdf: F(x) = x Mean E(X) = 1/λ. f(x)dx = Moment generating function: φ(t) = E[e tx ] = { 1
More informationCS 147: Computer Systems Performance Analysis
CS 147: Computer Systems Performance Analysis Introduction to Queueing Theory CS 147: Computer Systems Performance Analysis Introduction to Queueing Theory 1 / 27 Overview Introduction and Terminology
More informationLECTURE 4. Last time: Lecture outline
LECTURE 4 Last time: Types of convergence Weak Law of Large Numbers Strong Law of Large Numbers Asymptotic Equipartition Property Lecture outline Stochastic processes Markov chains Entropy rate Random
More information1 Basic concepts from probability theory
Basic concepts from probability theory This chapter is devoted to some basic concepts from probability theory.. Random variable Random variables are denoted by capitals, X, Y, etc. The expected value or
More informationStochastic Performance Modelling
Stochastic Performance Modelling O. J. Boxma Department of Mathematics and Computer Science Eindhoven University of Technology P.O. Box 513, 5600 MB Eindhoven, The Netherlands 1 Preface This course presents
More informationA Proposal To Finding An Analytical Solution For The Probability Of j Units In An M/G/1 System
A Proposal To Finding An Analytical Solution For The Probability Of j Units In An M/G/1 System By Philip Kalinda * MSc Business Analytics and Decision Sciences University of Leeds, Leeds, UK Introduction
More informationResponse Times in an Accident and Emergency Service Unit. Apurva Udeshi aau03@doc.ic.ac.uk
IMPERIAL COLLEGE, LONDON Department of Computing Response Times in an Accident and Emergency Service Unit Apurva Udeshi aau03@doc.ic.ac.uk Supervisor: Professor Peter Harrison Second Marker: Dr. William
More informationAnalysis of a Production/Inventory System with Multiple Retailers
Analysis of a Production/Inventory System with Multiple Retailers Ann M. Noblesse 1, Robert N. Boute 1,2, Marc R. Lambrecht 1, Benny Van Houdt 3 1 Research Center for Operations Management, University
More informationCOUNTABLESTATE MARKOV CHAINS
Chapter 5 COUNTABLESTATE MARKOV CHAINS 5.1 Introduction and classification of states Markov chains with a countablyinfinite state space (more briefly, countablestate Markov chains) exhibit some types
More informationMarkov Chains. Gonzalo Mateos
Markov Chains Gonzalo Mateos Dept. of ECE and Goergen Institute for Data Science University of Rochester gmateosb@ece.rochester.edu http://www.ece.rochester.edu/~gmateosb/ October 5, 2016 Introduction
More informationOptimal Hiring of Cloud Servers A. Stephen McGough, Isi Mitrani. EPEW 2014, Florence
Optimal Hiring of Cloud Servers A. Stephen McGough, Isi Mitrani EPEW 2014, Florence Scenario How many cloud instances should be hired? Requests Host hiring servers The number of active servers is controlled
More informationA Note on the Ruin Probability in the Delayed Renewal Risk Model
Southeast Asian Bulletin of Mathematics 2004 28: 1 5 Southeast Asian Bulletin of Mathematics c SEAMS. 2004 A Note on the Ruin Probability in the Delayed Renewal Risk Model Chun Su Department of Statistics
More informationIntroduction to Stochastic Processes. Lothar Breuer
Introduction to Stochastic Processes Lothar Breuer Contents 1 Some general definitions 1 2 Markov Chains and Queues in Discrete Time 3 2.1 Definition.............................. 3 2.2 Classification
More informationExponential Approximation of MultiSkill Call Centers Architecture
Exponential Approximation of MultiSkill Call Centers Architecture Ger Koole and Jérôme Talim Vrije Universiteit  Division of Mathematics and Computer Science De Boelelaan 1081 a  1081 HV Amsterdam 
More informationStochastic Processes and Queueing Theory used in Cloud Computer Performance Simulations
56 Stochastic Processes and Queueing Theory used in Cloud Computer Performance Simulations Stochastic Processes and Queueing Theory used in Cloud Computer Performance Simulations FlorinCătălin ENACHE
More informationModelling the performance of computer mirroring with difference queues
Modelling the performance of computer mirroring with difference queues Przemyslaw Pochec Faculty of Computer Science University of New Brunswick, Fredericton, Canada E3A 5A3 email pochec@unb.ca ABSTRACT
More informationProbability II (MATH 2647)
Probability II (MATH 2647) Lecturer Dr. O. Hryniv email Ostap.Hryniv@durham.ac.uk office CM309 http://maths.dur.ac.uk/stats/courses/probmc2h/probability2h.html or via DUO This term we shall consider: Review
More informationLoad Balancing and Switch Scheduling
EE384Y Project Final Report Load Balancing and Switch Scheduling Xiangheng Liu Department of Electrical Engineering Stanford University, Stanford CA 94305 Email: liuxh@systems.stanford.edu Abstract Load
More informationSPARE PARTS INVENTORY SYSTEMS UNDER AN INCREASING FAILURE RATE DEMAND INTERVAL DISTRIBUTION
SPARE PARS INVENORY SYSEMS UNDER AN INCREASING FAILURE RAE DEMAND INERVAL DISRIBUION Safa Saidane 1, M. Zied Babai 2, M. Salah Aguir 3, Ouajdi Korbaa 4 1 National School of Computer Sciences (unisia),
More informationSimulation in der Logistik ehem.: Simulation in Logistics I. Queueing Models and its application in Dosimis3
UNIVERSITÄT D U I S B U R G E S S E N Campus Duisburg Department of Engineering Sciences Division of Mechanical Engineering Transport Systems and Logistics Lotharstraße 121 47057 Duisburg Phone: 0203
More informationTenth Problem Assignment
EECS 40 Due on April 6, 007 PROBLEM (8 points) Dave is taking a multiplechoice exam. You may assume that the number of questions is infinite. Simultaneously, but independently, his conscious and subconscious
More informationISyE 6650 Probabilistic Models Fall Homework 5 Solution
ISyE 6650 Probabilistic Models Fall 2007 Homework 5 Solution 1. (Ross 5.3) Due to the memoryless property of the exponential distribution, the conditional distribution of X, given that X > 1, is the same
More informationStructure Preserving Model Reduction for Logistic Networks
Structure Preserving Model Reduction for Logistic Networks Fabian Wirth Institute of Mathematics University of Würzburg Workshop on Stochastic Models of Manufacturing Systems Einhoven, June 24 25, 2010.
More informationNotes on Continuous Random Variables
Notes on Continuous Random Variables Continuous random variables are random quantities that are measured on a continuous scale. They can usually take on any value over some interval, which distinguishes
More informationFluid Approximation of Smart Grid Systems: Optimal Control of Energy Storage Units
Fluid Approximation of Smart Grid Systems: Optimal Control of Energy Storage Units by Rasha Ibrahim Sakr, B.Sc. A thesis submitted to the Faculty of Graduate and Postdoctoral Affairs in partial fulfillment
More informationSTAT 830 Convergence in Distribution
STAT 830 Convergence in Distribution Richard Lockhart Simon Fraser University STAT 830 Fall 2011 Richard Lockhart (Simon Fraser University) STAT 830 Convergence in Distribution STAT 830 Fall 2011 1 / 31
More informationA Quantitative Approach to the Performance of Internet Telephony to Ebusiness Sites
A Quantitative Approach to the Performance of Internet Telephony to Ebusiness Sites Prathiusha Chinnusamy TransSolutions Fort Worth, TX 76155, USA Natarajan Gautam Harold and Inge Marcus Department of
More informationThe Poisson process. Chapter Definition of the Poisson process
Chapter 3 The Poisson process The next part of the course deals with some fundamental models of events occurring randomly in continuous time. Many modelling applications involve events ( arrivals ) happening
More informationResource Provisioning and Network Traffic
Resource Provisioning and Network Traffic Network engineering: Feedback traffic control closedloop control ( adaptive ) small time scale: msec mainly by end systems e.g., congestion control Resource provisioning
More informationTopic 2: Scalar random variables. Definition of random variables
Topic 2: Scalar random variables Discrete and continuous random variables Probability distribution and densities (cdf, pmf, pdf) Important random variables Expectation, mean, variance, moments Markov and
More informationQueueing Networks. Page n. Queueing Networks
Queueing Networks Simonetta Balsamo, Andrea Marin Università Ca Foscari di Venezia Dipartimento di Informatica, Venezia, Italy School on Formal Methods 2007: Performance Evaluation Bertinoro, 28/5/2007
More informationOptimal Dynamic Resource Allocation in MultiClass Queueing Networks
Imperial College London Department of Computing Optimal Dynamic Resource Allocation in MultiClass Queueing Networks MEng Individual Project Report Diagoras Nicolaides Supervisor: Dr William Knottenbelt
More informationECE302 Spring 2006 HW4 Solutions February 6, 2006 1
ECE302 Spring 2006 HW4 Solutions February 6, 2006 1 Solutions to HW4 Note: Most of these solutions were generated by R. D. Yates and D. J. Goodman, the authors of our textbook. I have added comments in
More informationContinuous Time Markov Chains
Continuous Time Markov Chains Dan Crytser March 11, 2011 1 Introduction The theory of Markov chains of the discrete form X 1, X 2,... can be adapted to a continuous form X t, t [0, ). This requires use
More informationA QUEUEINGINVENTORY SYSTEM WITH DEFECTIVE ITEMS AND POISSON DEMAND. bhaji@usc.edu
A QUEUEINGINVENTORY SYSTEM WITH DEFECTIVE ITEMS AND POISSON DEMAND Rasoul Hai 1, Babak Hai 1 Industrial Engineering Department, Sharif University of Technology, +98166165708, hai@sharif.edu Industrial
More informationSupplement to Call Centers with Delay Information: Models and Insights
Supplement to Call Centers with Delay Information: Models and Insights Oualid Jouini 1 Zeynep Akşin 2 Yves Dallery 1 1 Laboratoire Genie Industriel, Ecole Centrale Paris, Grande Voie des Vignes, 92290
More informationChapter 2 DiscreteTime Markov Models
Chapter DiscreteTime Markov Models.1 DiscreteTime Markov Chains Consider a system that is observed at times 0;1;;:::: Let X n be the state of the system at time n for n D 0;1;;:::: Suppose we are currently
More informationIntroduction to Queueing Theory and Stochastic Teletraffic Models
Introduction to Queueing Theory and Stochastic Teletraffic Models Moshe Zukerman EE Department, City University of Hong Kong Copyright M. Zukerman c 2000 2015 Preface The aim of this textbook is to provide
More information1.5 / 1  Communication Networks II (Görg)  www.comnets.unibremen.de. 1.5 Transforms
.5 /  Communication Networks II (Görg)  www.comnets.unibremen.de.5 Transforms Using different summation and integral transformations pmf, pdf and cdf/ccdf can be transformed in such a way, that even
More informationSingle Workstation Factory Models
Chapter 3 Single Workstation Factory Models Throughout the analyses given in this textbook, emphasis is on the development of steadystate system measures such as the expected number of jobs in the system
More informationAn introduction to Markov chains
An introduction to Markov chains Jie Xiong Department of Mathematics The University of Tennessee, Knoxville [NIMBioS, March 16, 2011] Mathematical biology (WIKIPEDIA) Markov chains also have many applications
More informationChapter 2 Introduction to Renewal Theory
Chapter 2 Introduction to Renewal Theory 2. Introduction Let fx i g id be a series of independent and identically distributed nonnegative random variables. Assume they are continuous. In particular, there
More informationContents. TTM4155: Teletraffic Theory (Teletrafikkteori) Probability Theory Basics. Yuming Jiang. Basic Concepts Random Variables
TTM4155: Teletraffic Theory (Teletrafikkteori) Probability Theory Basics Yuming Jiang 1 Some figures taken from the web. Contents Basic Concepts Random Variables Discrete Random Variables Continuous Random
More informationLectures on Stochastic Processes. William G. Faris
Lectures on Stochastic Processes William G. Faris November 8, 2001 2 Contents 1 Random walk 7 1.1 Symmetric simple random walk................... 7 1.2 Simple random walk......................... 9 1.3
More informationChapter 1. Introduction
Chapter 1 Introduction 1.1. Motivation Network performance analysis, and the underlying queueing theory, was born at the beginning of the 20th Century when two Scandinavian engineers, Erlang 1 and Engset
More informationENGINEERING SOLUTION OF A BASIC CALLCENTER MODEL
ENGINEERING SOLUTION OF A BASIC CALLCENTER MODEL by Ward Whitt Department of Industrial Engineering and Operations Research Columbia University, New York, NY 10027 Abstract An algorithm is developed to
More information5. Continuous Random Variables
5. Continuous Random Variables Continuous random variables can take any value in an interval. They are used to model physical characteristics such as time, length, position, etc. Examples (i) Let X be
More information4.1 Introduction and underlying setup
Chapter 4 SemiMarkov processes in labor market theory 4.1 Introduction and underlying setup SemiMarkov processes are, like all stochastic processes, models of systems or behavior. As extensions of Markov
More information4. Poisson Processes
4. Poisson Processes 4.1 Definition 4.2 Derivation of exponential distribution 4.3 Properties of exponential distribution a. Normalized spacings b. Campbell s Theorem c. Minimum of several exponential
More informationCHAPTER III  MARKOV CHAINS
CHAPTER III  MARKOV CHAINS JOSEPH G. CONLON 1. General Theory of Markov Chains We have already discussed the standard random walk on the integers Z. A Markov Chain can be viewed as a generalization of
More informationMATH 56A SPRING 2008 STOCHASTIC PROCESSES 31
MATH 56A SPRING 2008 STOCHASTIC PROCESSES 3.3. Invariant probability distribution. Definition.4. A probability distribution is a function π : S [0, ] from the set of states S to the closed unit interval
More informationBasic Multiplexing models. Computer Networks  Vassilis Tsaoussidis
Basic Multiplexing models? Supermarket?? Computer Networks  Vassilis Tsaoussidis Schedule Where does statistical multiplexing differ from TDM and FDM Why are buffers necessary  what is their tradeoff,
More informationDefinition 6.1.1. A r.v. X has a normal distribution with mean µ and variance σ 2, where µ R, and σ > 0, if its density is f(x) = 1. 2σ 2.
Chapter 6 Brownian Motion 6. Normal Distribution Definition 6... A r.v. X has a normal distribution with mean µ and variance σ, where µ R, and σ > 0, if its density is fx = πσ e x µ σ. The previous definition
More informationJoint Exam 1/P Sample Exam 1
Joint Exam 1/P Sample Exam 1 Take this practice exam under strict exam conditions: Set a timer for 3 hours; Do not stop the timer for restroom breaks; Do not look at your notes. If you believe a question
More informationON SOME ANALOGUE OF THE GENERALIZED ALLOCATION SCHEME
ON SOME ANALOGUE OF THE GENERALIZED ALLOCATION SCHEME Alexey Chuprunov Kazan State University, Russia István Fazekas University of Debrecen, Hungary 2012 Kolchin s generalized allocation scheme A law of
More informationProbability Generating Functions
page 39 Chapter 3 Probability Generating Functions 3 Preamble: Generating Functions Generating functions are widely used in mathematics, and play an important role in probability theory Consider a sequence
More informationLecture 3 APPLICATION OF SIMULATION IN SERVICE OPERATIONS MANAGEMENT
Lecture 3 APPLICATION OF SIMULATION IN SERVICE OPERATIONS MANAGEMENT Learning Objective To discuss application of simulation in services 1. SIMULATION Simulation is a powerful technique for solving a wide
More informationBasic Queuing Relationships
Queueing Theory Basic Queuing Relationships Resident items Waiting items Residence time Single server Utilisation System Utilisation Little s formulae are the most important equation in queuing theory
More informationLecture 13: Martingales
Lecture 13: Martingales 1. Definition of a Martingale 1.1 Filtrations 1.2 Definition of a martingale and its basic properties 1.3 Sums of independent random variables and related models 1.4 Products of
More informationFinite Markov Chains and Algorithmic Applications. Matematisk statistik, Chalmers tekniska högskola och Göteborgs universitet
Finite Markov Chains and Algorithmic Applications Olle Häggström Matematisk statistik, Chalmers tekniska högskola och Göteborgs universitet PUBLISHED BY THE PRESS SYNDICATE OF THE UNIVERSITY OF CAMBRIDGE
More informationFluid models in performance analysis
Fluid models in performance analysis Marco Gribaudo 1, Miklós Telek 2 1 Dip. di Informatica, Università di Torino, marcog@di.unito.it 2 Dept. of Telecom., Technical University of Budapest telek@hitbme.hu
More information1 IEOR 6711: Notes on the Poisson Process
Copyright c 29 by Karl Sigman 1 IEOR 6711: Notes on the Poisson Process We present here the essentials of the Poisson point process with its many interesting properties. As preliminaries, we first define
More informationMaximum Likelihood Estimation
Math 541: Statistical Theory II Lecturer: Songfeng Zheng Maximum Likelihood Estimation 1 Maximum Likelihood Estimation Maximum likelihood is a relatively simple method of constructing an estimator for
More informationHow Useful Is Old Information?
6 IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, VOL. 11, NO. 1, JANUARY 2000 How Useful Is Old Information? Michael Mitzenmacher AbstractÐWe consider the problem of load balancing in dynamic distributed
More informationIntroduction to Markov Chain Monte Carlo
Introduction to Markov Chain Monte Carlo Monte Carlo: sample from a distribution to estimate the distribution to compute max, mean Markov Chain Monte Carlo: sampling using local information Generic problem
More informationSTABILITY OF LUKUMAR NETWORKS UNDER LONGESTQUEUE AND LONGESTDOMINATINGQUEUE SCHEDULING
Applied Probability Trust (28 December 2012) STABILITY OF LUKUMAR NETWORKS UNDER LONGESTQUEUE AND LONGESTDOMINATINGQUEUE SCHEDULING RAMTIN PEDARSANI and JEAN WALRAND, University of California, Berkeley
More information6. Jointly Distributed Random Variables
6. Jointly Distributed Random Variables We are often interested in the relationship between two or more random variables. Example: A randomly chosen person may be a smoker and/or may get cancer. Definition.
More information