# B. Maddah ENMG 501 Engineering Management I 03/17/07

Save this PDF as:

Size: px
Start display at page:

## Transcription

1 B. Maddah ENMG 501 Engineering Management I 03/17/07 Discrete Time Markov Chains (3) Long-run Properties of MC (Stationary Solution) Consider the two-state MC of the weather condition in Example 4. P = P = P P = = We see that the transition probability, p (n) i, is converging (as n ) to some limiting probabilities π. Other terms used to describe π are the steady-state or the stationary probabilities. That is, π represents the probability that the process will be in state after that the system has been operational for a long time (i.e., after two may transitions). Alternatively, we can interpret π as the long-run mean fraction of time the MC is in state. E.g., in the two-state weather MC, we conclude that it rains 57.14% of the time. Do the limiting probabilities exist for every MC? No. 1

2 E.g., For the two-state chain with P =. 1 0 P = = = = 0 1 I P 1 0 P Therefore, for n even P n = I and for n odd P n = P, regardless of how large n is. That is, the limiting probabilities π do not exist. When do the limiting probabilities exist? Theorem 1. For a finite state MC (with state space S) which is irreducible and aperiodic ( ) lim p n i exists and is independent of i. n Furthermore, letting π ( ) = lim p n i, then π n is the unique solution to π = π p, i S, S i i i S π = 1. In matrix form, lettingπ = ( π1,, π,, π S ), then the equations in the theorem reduce to π = π P, S π = 1. 2

3 Because π lim p ( n ) = i is independent of i, then we can n formally write that π = lim P{ Xn = }. n Mean Recurrence Time and Cost Models The interpretation of π as the long run fraction of time spent in state allows for the following useful facts. Suppose that each visit to state incurs a cost C. Then, the long-run mean cost per unit time is π C. The mean recurrence time of state, μ, is the mean number of transitions until the MC starting in state returns to. On average, the MC will have one transition out of state, for every μ transition from states other than, then if one measures time in number of transitions (imagine a transition happening once a day), then π = 1/μ μ = 1/ π. Example 8 Every year at the beginning of the gardening season (March), a gardener assesses the soil condition as (1) good, (2) fair, and (3) poor, and applies a fertilizer accordingly. The gardener estimates that the transition probabilities of the soil condition from one year to another by the following matrix: S 3

4 P = If fertilizing costs \$100, \$125, and \$160 in good, fair, and poor years respectively. What is the expected annual cost? The gardener situation can be represented by a MC with states {1,2,3} and a transition probability matrix P. It can be easily verified that this MC is irreducible and aperiodic. The limiting probabilities for the MC are given by πp = π ( π1 π2 π3) = ( π1 π2 π3), π + π + π = 1, which implies that the π i s are the solution to the following equations: 0.3π1+ 0.1π π3 = π1 0.7π1+ 0.1π π3 = 0 0.6π1+ 0.6π π3 = π2 0.6π1 0.4π2+ 0.4π3 = 0 π1+ π2 + π3 = 1 π1 + π2 + π3 = 1 Solving this system of linear equations gives π 1 = 0.102, π 2 = 0.525, and π 3 = The expected fertilizing cost is then = \$

5 If the soil is good this year, after how many years it is expected to be good again? μ 11 = 1/π 1 = 1/0.102 = 9.8 years. Example 9 An auto insurance company is using the Bonus Malus (Latin for Good-Bad) system. Each policyholder is given a positive integer valued state and the annual premium is a function of this state. A policyholder s state changes from year in response to number of claims made by that policy holder. Suppose there are four states in the Bonus Malus system. The policyholder will move from one state this year to another state next year based on the number of claims made this year as indicated in the following table. Next State if State Annual Premium 0 claims 1 claim 2 claims 3 claims 1 \$ \$ \$ \$ Suppose the number of claims a policyholder makes in a year has a Poisson distribution with mean 1/2. What is the average premium paid by a policyholder? 5

6 The policy holder situation can be modeled with a MC states {1,2,3,4}. The transition probability matrix for this MC is e 0.5 e (0.5 / 2) e 1 e 0.5 e (0.5 / 2) e e 0 0.5e 1 e 0.5e P = e 0 1 e e 1 e Then, P = The limiting probabilities of this MC are the solution to the following system of equations (obtained by setting πp = P, and Σπ = 1) π π = π π π = π π π π = π + π + π + π = Then, π 1 = , π 2 = , π 3 = , and π 4 = Finally, the average annual premium is 200π π π π 4 = \$

7 If a policyholder is in state 2 now, after how many years this policyholder is expected to be in state 2 again? μ 22 = 1/π 2 = 1/ = 4.17 years. Example 10 The failure probability of a computer component is p i when the age of the component is i years. Suppose the system starts fresh with a new component. In an effort to minimize failures during service, an age replacement policy is instituted. This policy calls for replacing the part upon its failure or upon its reaching the age of 4 years, whichever happens first. Suppose replacement costs C dollars. Furthermore, replacement during service incurs an additional interruption cost of K dollars. How would you find the expected annual cost of this system? This system can be modeled with a MC with states {1, 2, 3, 4} representing the age of the components at the end of a year. The transition probability matrix of this MC is P p p 1 p p = p p

8 Then, we can solve for the limiting probabilities π 1, π 2, π 3, and π 4. Note that π 1 is the fraction of years where the component is replaced (due to failure or reaching age 4), while π 4 is the fraction of years where the part is replaced due to reaching age 4. Therefore, the expected annual cost is Cπ 1 + K(π 1 π n ). Example 11 The transition matrix, P, of a MC with state space S, having n states, is said to be double-stochastic if n pi = 1, = 1, 2,, n, i= 1 assuming that states are numbered from 1 to n. Show that the limiting probabilities for a MC with a doublestochastic transition matrix are given by π = (1/ n,1/ n,,1/ n). Note that π satisfy the equations for the limiting probabilities p p p p p p π (1/ n,1/ n,,1/ n) P = p p p n n n1 n2 nn n n n = (1/ n p,1/ n p,,1/ n p ) = π. i1 i2 in i= 1 i= 1 i= 1 8

9 In addition, n = 1 π = 1. Therefore, the limiting probabilities are given by π = (1/ n,1/ n,,1/ n) since the equations for the limiting probabilities have a unique solution. Example 12 Consider a production line where each item has a probability p of being defective, independent of the condition of other items. Initially, every item is sampled as it is produced (100% inspection). This procedure continues until 4 consecutive nondefective items are found. Then, the sampling plan calls for sampling only 1 out of 3 items at random (1-out-of-3 inspection), until a defective item is found. When this happens, the plan calls for reverting to 100% inspection until 4 consecutive nondefective items are found. The process continues in the same way. What is the average fraction of items inspected (AFI)? The inspection process can be modeled as a MC with states, 0,1,2,3 representing the number of consecutive nondefective items found when 100% inspection is adopted, and state 4 representing the 1-out-of-3 inspection. The transition probability matrix for this MC is 9

10 p 1 p p 0 1 p 0 0 p p 0 P = p p p p Once can then determine, the limiting probabilities, π 0, π 1, π 2, π 3, and π 4. The average fraction inspected is then AFI = π 0 + π 1 + π 2 + π 3 + (π 4 / 3). Assume that each item found defective is replaced with a good item. What is the fraction of defective items in the output of the process (also called the average outgoing quality)? AOQ = p(1 AFI). 10

### 1/3 1/3 1/3 0.4 0.4 0.4 0.4 0.4 0.4 0.4 0 1 2 3 4 5 6 7 8 0.6 0.6 0.6 0.6 0.6 0.6 0.6

HOMEWORK 4: SOLUTIONS. 2. A Markov chain with state space {, 2, 3} has transition probability matrix /3 /3 /3 P = 0 /2 /2 0 0 Show that state 3 is absorbing and, starting from state, find the expected

### Chapter 2 Discrete-Time Markov Models

Chapter Discrete-Time Markov Models.1 Discrete-Time Markov Chains Consider a system that is observed at times 0;1;;:::: Let X n be the state of the system at time n for n D 0;1;;:::: Suppose we are currently

### 1. (First passage/hitting times/gambler s ruin problem:) Suppose that X has a discrete state space and let i be a fixed state. Let

Copyright c 2009 by Karl Sigman 1 Stopping Times 1.1 Stopping Times: Definition Given a stochastic process X = {X n : n 0}, a random time τ is a discrete random variable on the same probability space as

### Essentials of Stochastic Processes

i Essentials of Stochastic Processes Rick Durrett 70 60 50 10 Sep 10 Jun 10 May at expiry 40 30 20 10 0 500 520 540 560 580 600 620 640 660 680 700 Almost Final Version of the 2nd Edition, December, 2011

### Markov Chains. Chapter 4. 4.1 Stochastic Processes

Chapter 4 Markov Chains 4 Stochastic Processes Often, we need to estimate probabilities using a collection of random variables For example, an actuary may be interested in estimating the probability that

### 1 Gambler s Ruin Problem

Coyright c 2009 by Karl Sigman 1 Gambler s Ruin Problem Let N 2 be an integer and let 1 i N 1. Consider a gambler who starts with an initial fortune of \$i and then on each successive gamble either wins

### Practice Midterm IND E 411 Winter 2015 February 2, 2015

Name: Practice Midterm IND E 411 Winter 2015 February 2, 2015 Instructions: You have 110 minutes. The value of each problem is stated. Partial credit is given for the correct method of solution, so set

### IEOR 6711: Stochastic Models, I Fall 2012, Professor Whitt, Final Exam SOLUTIONS

IEOR 6711: Stochastic Models, I Fall 2012, Professor Whitt, Final Exam SOLUTIONS There are four questions, each with several parts. 1. Customers Coming to an Automatic Teller Machine (ATM) (30 points)

### Pull versus Push Mechanism in Large Distributed Networks: Closed Form Results

Pull versus Push Mechanism in Large Distributed Networks: Closed Form Results Wouter Minnebo, Benny Van Houdt Dept. Mathematics and Computer Science University of Antwerp - iminds Antwerp, Belgium Wouter

### Master s Theory Exam Spring 2006

Spring 2006 This exam contains 7 questions. You should attempt them all. Each question is divided into parts to help lead you through the material. You should attempt to complete as much of each problem

### Discrete Mathematics: Homework 7 solution. Due: 2011.6.03

EE 2060 Discrete Mathematics spring 2011 Discrete Mathematics: Homework 7 solution Due: 2011.6.03 1. Let a n = 2 n + 5 3 n for n = 0, 1, 2,... (a) (2%) Find a 0, a 1, a 2, a 3 and a 4. (b) (2%) Show that

### Tutorial: Stochastic Modeling in Biology Applications of Discrete- Time Markov Chains. NIMBioS Knoxville, Tennessee March 16-18, 2011

Tutorial: Stochastic Modeling in Biology Applications of Discrete- Time Markov Chains Linda J. S. Allen Texas Tech University Lubbock, Texas U.S.A. NIMBioS Knoxville, Tennessee March 16-18, 2011 OUTLINE

### Exam Introduction Mathematical Finance and Insurance

Exam Introduction Mathematical Finance and Insurance Date: January 8, 2013. Duration: 3 hours. This is a closed-book exam. The exam does not use scrap cards. Simple calculators are allowed. The questions

### A DISCRETE TIME MARKOV CHAIN MODEL IN SUPERMARKETS FOR A PERIODIC INVENTORY SYSTEM WITH ONE WAY SUBSTITUTION

A DISCRETE TIME MARKOV CHAIN MODEL IN SUPERMARKETS FOR A PERIODIC INVENTORY SYSTEM WITH ONE WAY SUBSTITUTION A Class Project for MATH 768: Applied Stochastic Processes Fall 2014 By Chudamani Poudyal &

### Calculating Term Life Insurance Premiums

Calculating Term Life Insurance Premiums Jacquelyn Mott May 1, 2015 Quinnipiac University MA 490: Math Senior Seminar Professor Nelan The mortality rate for 30-year-olds in the United States is 0.001,

### Manual for SOA Exam MLC.

Chapter 6. Benefit premiums. Extract from: Arcones Fall 2010 Edition, available at http://www.actexmadriver.com/ 1/24 Non-level premiums and/or benefits. Let b k be the benefit paid by an insurance company

### Homework set 4 - Solutions

Homework set 4 - Solutions Math 495 Renato Feres Problems R for continuous time Markov chains The sequence of random variables of a Markov chain may represent the states of a random system recorded at

### Master of Arts in Mathematics

Master of Arts in Mathematics Administrative Unit The program is administered by the Office of Graduate Studies and Research through the Faculty of Mathematics and Mathematics Education, Department of

### Hydrodynamic Limits of Randomized Load Balancing Networks

Hydrodynamic Limits of Randomized Load Balancing Networks Kavita Ramanan and Mohammadreza Aghajani Brown University Stochastic Networks and Stochastic Geometry a conference in honour of François Baccelli

### THE PROVISION OF SPARE CABLE

1962 The Operations Research Society of Japan THE PROVISION OF SPARE CABLE YOSHITSUGU OHMAE Nippon Telegraph and Telephone Public Corporation Tokyo, Japan (Received Sept., I, 1963) 1. INTRODUCTION The

### Single item inventory control under periodic review and a minimum order quantity

Single item inventory control under periodic review and a minimum order quantity G. P. Kiesmüller, A.G. de Kok, S. Dabia Faculty of Technology Management, Technische Universiteit Eindhoven, P.O. Box 513,

### An Extension Model of Financially-balanced Bonus-Malus System

An Extension Model of Financially-balanced Bonus-Malus System Other : Ratemaking, Experience Rating XIAO, Yugu Center for Applied Statistics, Renmin University of China, Beijing, 00872, P.R. China Phone:

### Characterization and Modeling of Packet Loss of a VoIP Communication

Characterization and Modeling of Packet Loss of a VoIP Communication L. Estrada, D. Torres, H. Toral Abstract In this work, a characterization and modeling of packet loss of a Voice over Internet Protocol

### M/M/1 and M/M/m Queueing Systems

M/M/ and M/M/m Queueing Systems M. Veeraraghavan; March 20, 2004. Preliminaries. Kendall s notation: G/G/n/k queue G: General - can be any distribution. First letter: Arrival process; M: memoryless - exponential

### A Sublinear Bipartiteness Tester for Bounded Degree Graphs

A Sublinear Bipartiteness Tester for Bounded Degree Graphs Oded Goldreich Dana Ron February 5, 1998 Abstract We present a sublinear-time algorithm for testing whether a bounded degree graph is bipartite

### 4 The M/M/1 queue. 4.1 Time-dependent behaviour

4 The M/M/1 queue In this chapter we will analyze the model with exponential interarrival times with mean 1/λ, exponential service times with mean 1/µ and a single server. Customers are served in order

### A linear algebraic method for pricing temporary life annuities

A linear algebraic method for pricing temporary life annuities P. Date (joint work with R. Mamon, L. Jalen and I.C. Wang) Department of Mathematical Sciences, Brunel University, London Outline Introduction

### Performance Analysis of a Telephone System with both Patient and Impatient Customers

Performance Analysis of a Telephone System with both Patient and Impatient Customers Yiqiang Quennel Zhao Department of Mathematics and Statistics University of Winnipeg Winnipeg, Manitoba Canada R3B 2E9

### Probability and Statistics

Probability and Statistics Syllabus for the TEMPUS SEE PhD Course (Podgorica, April 4 29, 2011) Franz Kappel 1 Institute for Mathematics and Scientific Computing University of Graz Žaneta Popeska 2 Faculty

### Big Data Technology Motivating NoSQL Databases: Computing Page Importance Metrics at Crawl Time

Big Data Technology Motivating NoSQL Databases: Computing Page Importance Metrics at Crawl Time Edward Bortnikov & Ronny Lempel Yahoo! Labs, Haifa Class Outline Link-based page importance measures Why

Advanced GMAT Math Questions Version Quantitative Fractions and Ratios 1. The current ratio of boys to girls at a certain school is to 5. If 1 additional boys were added to the school, the new ratio of

### Analysis of a Production/Inventory System with Multiple Retailers

Analysis of a Production/Inventory System with Multiple Retailers Ann M. Noblesse 1, Robert N. Boute 1,2, Marc R. Lambrecht 1, Benny Van Houdt 3 1 Research Center for Operations Management, University

### Analysis and its Applications. A unique opportunity for fully funded PhD study in Edinburgh in all areas of analysis and its applications.

A unique opportunity for fully funded PhD study in Edinburgh in all areas of analysis and its applications. A collaborative programme with joint degree from both Edinburgh and Heriot-Watt Universities.

### Math 370/408, Spring 2008 Prof. A.J. Hildebrand. Actuarial Exam Practice Problem Set 2 Solutions

Math 70/408, Spring 2008 Prof. A.J. Hildebrand Actuarial Exam Practice Problem Set 2 Solutions About this problem set: These are problems from Course /P actuarial exams that I have collected over the years,

### = 2 + 1 2 2 = 3 4, Now assume that P (k) is true for some fixed k 2. This means that

Instructions. Answer each of the questions on your own paper, and be sure to show your work so that partial credit can be adequately assessed. Credit will not be given for answers (even correct ones) without

### Lectures on Stochastic Processes. William G. Faris

Lectures on Stochastic Processes William G. Faris November 8, 2001 2 Contents 1 Random walk 7 1.1 Symmetric simple random walk................... 7 1.2 Simple random walk......................... 9 1.3

### Thursday, October 18, 2001 Page: 1 STAT 305. Solutions

Thursday, October 18, 2001 Page: 1 1. Page 226 numbers 2 3. STAT 305 Solutions S has eight states Notice that the first two letters in state n +1 must match the last two letters in state n because they

### ECE302 Spring 2006 HW3 Solutions February 2, 2006 1

ECE302 Spring 2006 HW3 Solutions February 2, 2006 1 Solutions to HW3 Note: Most of these solutions were generated by R. D. Yates and D. J. Goodman, the authors of our textbook. I have added comments in

### Monte Carlo Methods in Finance

Author: Yiyang Yang Advisor: Pr. Xiaolin Li, Pr. Zari Rachev Department of Applied Mathematics and Statistics State University of New York at Stony Brook October 2, 2012 Outline Introduction 1 Introduction

### 1 Sufficient statistics

1 Sufficient statistics A statistic is a function T = rx 1, X 2,, X n of the random sample X 1, X 2,, X n. Examples are X n = 1 n s 2 = = X i, 1 n 1 the sample mean X i X n 2, the sample variance T 1 =

### Dynamic Assignment of Dedicated and Flexible Servers in Tandem Lines

Dynamic Assignment of Dedicated and Flexible Servers in Tandem Lines Sigrún Andradóttir and Hayriye Ayhan School of Industrial and Systems Engineering Georgia Institute of Technology Atlanta, GA 30332-0205,

### Perron vector Optimization applied to search engines

Perron vector Optimization applied to search engines Olivier Fercoq INRIA Saclay and CMAP Ecole Polytechnique May 18, 2011 Web page ranking The core of search engines Semantic rankings (keywords) Hyperlink

### Markov Chains. Chapter 4. 4.1 Definitions and Examples

Chapter 4 Markov Chains 4.1 Definitions and Examples The importance of Markov chains comes from two facts: (i) there are a large number of physical, biological, economic, and social phenomena that can

### On the mathematical theory of splitting and Russian roulette

On the mathematical theory of splitting and Russian roulette techniques St.Petersburg State University, Russia 1. Introduction Splitting is an universal and potentially very powerful technique for increasing

### BX in ( u, v) basis in two ways. On the one hand, AN = u+

1. Let f(x) = 1 x +1. Find f (6) () (the value of the sixth derivative of the function f(x) at zero). Answer: 7. We expand the given function into a Taylor series at the point x = : f(x) = 1 x + x 4 x

### 12.5: CHI-SQUARE GOODNESS OF FIT TESTS

125: Chi-Square Goodness of Fit Tests CD12-1 125: CHI-SQUARE GOODNESS OF FIT TESTS In this section, the χ 2 distribution is used for testing the goodness of fit of a set of data to a specific probability

### MARTINGALES AND GAMBLING Louis H. Y. Chen Department of Mathematics National University of Singapore

MARTINGALES AND GAMBLING Louis H. Y. Chen Department of Mathematics National University of Singapore 1. Introduction The word martingale refers to a strap fastened belween the girth and the noseband of

### Alessandro Birolini. ineerin. Theory and Practice. Fifth edition. With 140 Figures, 60 Tables, 120 Examples, and 50 Problems.

Alessandro Birolini Re ia i it En ineerin Theory and Practice Fifth edition With 140 Figures, 60 Tables, 120 Examples, and 50 Problems ~ Springer Contents 1 Basic Concepts, Quality and Reliability Assurance

### Solution. Let us write s for the policy year. Then the mortality rate during year s is q 30+s 1. q 30+s 1

Solutions to the May 213 Course MLC Examination by Krzysztof Ostaszewski, http://wwwkrzysionet, krzysio@krzysionet Copyright 213 by Krzysztof Ostaszewski All rights reserved No reproduction in any form

### Terms and Conditions for Maybank Premier Wealth Total Rewards Programme ( Programme )

Terms and Conditions for Maybank Premier Wealth Total Rewards Programme ( Programme ) 1. General Terms 1.1 This Programme is only available to Premier Wealth individual account holders of Malayan Banking

### Optimal Charging Strategies for Electrical Vehicles under Real Time Pricing

1 Optimal Charging Strategies for Electrical Vehicles under Real Time Pricing Mohammad M. Karbasioun, Ioannis Lambadaris, Gennady Shaikhet, Evangelos Kranakis Carleton University, Ottawa, ON, Canada E-mails:

### Wald s Identity. by Jeffery Hein. Dartmouth College, Math 100

Wald s Identity by Jeffery Hein Dartmouth College, Math 100 1. Introduction Given random variables X 1, X 2, X 3,... with common finite mean and a stopping rule τ which may depend upon the given sequence,

### The Dirichlet Unit Theorem

Chapter 6 The Dirichlet Unit Theorem As usual, we will be working in the ring B of algebraic integers of a number field L. Two factorizations of an element of B are regarded as essentially the same if

### Optimal proportional reinsurance and dividend pay-out for insurance companies with switching reserves

Optimal proportional reinsurance and dividend pay-out for insurance companies with switching reserves Abstract: This paper presents a model for an insurance company that controls its risk and dividend

### Load Balancing and Switch Scheduling

EE384Y Project Final Report Load Balancing and Switch Scheduling Xiangheng Liu Department of Electrical Engineering Stanford University, Stanford CA 94305 Email: liuxh@systems.stanford.edu Abstract Load

### The Analysis of Data. Volume 1. Probability. Guy Lebanon

The Analysis of Data Volume 1 Probability Guy Lebanon First Edition 2012 Probability. The Analysis of Data, Volume 1. First Edition, First Printing, 2013 http://theanalysisofdata.com Copyright 2013 by

### Minimum Entry Age Maximum Entry Age. The minimum and maximum sum assured are \$50,000 and \$200,000* respectively.

PRODUCT SUMMARY DIRECT Whole Life (DWRA) 1. Policy Description DIRECT Whole Life is a participating, regular premium whole life insurance plan that provides financial protection against Death, Total &

### ECON1003: Analysis of Economic Data Fall 2003 Answers to Quiz #2 11:40a.m. 12:25p.m. (45 minutes) Tuesday, October 28, 2003

ECON1003: Analysis of Economic Data Fall 2003 Answers to Quiz #2 11:40a.m. 12:25p.m. (45 minutes) Tuesday, October 28, 2003 1. (4 points) The number of claims for missing baggage for a well-known airline

### ALGORITHMIC TRADING WITH MARKOV CHAINS

June 16, 2010 ALGORITHMIC TRADING WITH MARKOV CHAINS HENRIK HULT AND JONAS KIESSLING Abstract. An order book consists of a list of all buy and sell offers, represented by price and quantity, available

### Alabama Department of Postsecondary Education

Date Adopted 1998 Dates reviewed 2007, 2011, 2013 Dates revised 2004, 2008, 2011, 2013, 2015 Alabama Department of Postsecondary Education Representing Alabama s Public Two-Year College System Jefferson

### WEALTH MANAGEMENT PERPETUAL LIFE SERIES

WEALTH MANAGEMENT PERPETUAL LIFE SERIES Maintaining your wealth means keeping it safe and secure throughout your lifetime. With the Perpetual Life Series, ACE Life offers the key to whole life protection

### Robust Staff Level Optimisation in Call Centres

Robust Staff Level Optimisation in Call Centres Sam Clarke Jesus College University of Oxford A thesis submitted for the degree of M.Sc. Mathematical Modelling and Scientific Computing Trinity 2007 Abstract

### Manual for SOA Exam MLC.

Chapter 6. Benefit premiums. Extract from: Arcones Fall 2010 Edition, available at http://www.actexmadriver.com/ 1/77 Fully discrete benefit premiums In this section, we will consider the funding of insurance

### A Markovian Model for Investment Analysis in Advertising

Proceedings of the Seventh Young Statisticians Meeting Andrej Mrvar (Editor) Metodološki zvezki, 21, Ljubljana: FDV, 2003 A Markovian Model for Investment Analysis in Advertising Eugenio Novelli 1 Abstract

### QUEUEING THEORY WITH APPLICATIONS AND SPECIAL CONSIDERATION TO EMERGENCY CARE

QUEUEING THEORY WITH APPLICATIONS AND SPECIAL CONSIDERATION TO EMERGENCY CARE JAMES KEESLING. Introduction Much that is essential in modern life would not be possible without queueing theory. All communication

MATH ADVISEMENT GUIDE Recommendations for math courses are based on your placement results, degree program and career interests. Placement score: MAT 001 or MAT 00 You must complete required mathematics

### Queuing Theory II 2006 Samuel L. Baker

QUEUING THEORY II 1 More complex queues: Multiple Server Single Stage Queue Queuing Theory II 2006 Samuel L. Baker Assignment 8 is on page 7. Assignment 8A is on page 10. -- meaning that we have one line

### QUEUING THEORY. 1. Introduction

QUEUING THEORY RYAN BERRY Abstract. This paper defines the building blocks of and derives basic queuing systems. It begins with a review of some probability theory and then defines processes used to analyze

### False-Alarm and Non-Detection Probabilities for On-line Quality Control via HMM

Int. Journal of Math. Analysis, Vol. 6, 2012, no. 24, 1153-1162 False-Alarm and Non-Detection Probabilities for On-line Quality Control via HMM C.C.Y. Dorea a,1, C.R. Gonçalves a, P.G. Medeiros b and W.B.

### STAT 319 Probability and Statistics For Engineers PROBABILITY. Engineering College, Hail University, Saudi Arabia

STAT 319 robability and Statistics For Engineers LECTURE 03 ROAILITY Engineering College, Hail University, Saudi Arabia Overview robability is the study of random events. The probability, or chance, that

### Sampling Strategies for Error Rate Estimation and Quality Control

Project Number: JPA0703 Sampling Strategies for Error Rate Estimation and Quality Control A Major Qualifying Project Report Submitted to the faculty of the Worcester Polytechnic Institute in partial fulfillment

### Online edition (c)2009 Cambridge UP

DRAFT! April 1, 2009 Cambridge University Press. Feedback welcome. 461 21 Link analysis The analysis of hyperlinks and the graph structure of the Web has been instrumental in the development of web search.

### Chapter 4 and 5 solutions

Chapter 4 and 5 solutions 4.4. Three different washing solutions are being compared to study their effectiveness in retarding bacteria growth in five gallon milk containers. The analysis is done in a laboratory,

### Breaking The Code. Ryan Lowe. Ryan Lowe is currently a Ball State senior with a double major in Computer Science and Mathematics and

Breaking The Code Ryan Lowe Ryan Lowe is currently a Ball State senior with a double major in Computer Science and Mathematics and a minor in Applied Physics. As a sophomore, he took an independent study

### Project 2: Bejeweled

Project 2: Bejeweled Project Objective: Post: Tuesday March 26, 2013. Due: 11:59PM, Monday April 15, 2013 1. master the process of completing a programming project in UNIX. 2. get familiar with command

### Some applications of LLL

Some applications of LLL a. Factorization of polynomials As the title Factoring polynomials with rational coefficients of the original paper in which the LLL algorithm was first published (Mathematische

### E3: PROBABILITY AND STATISTICS lecture notes

E3: PROBABILITY AND STATISTICS lecture notes 2 Contents 1 PROBABILITY THEORY 7 1.1 Experiments and random events............................ 7 1.2 Certain event. Impossible event............................

### Nonparametric adaptive age replacement with a one-cycle criterion

Nonparametric adaptive age replacement with a one-cycle criterion P. Coolen-Schrijner, F.P.A. Coolen Department of Mathematical Sciences University of Durham, Durham, DH1 3LE, UK e-mail: Pauline.Schrijner@durham.ac.uk

### Lecture 1 Introduction Properties of Probability Methods of Enumeration Asrat Temesgen Stockholm University

Lecture 1 Introduction Properties of Probability Methods of Enumeration Asrat Temesgen Stockholm University 1 Chapter 1 Probability 1.1 Basic Concepts In the study of statistics, we consider experiments

### APPLICATIONS AND MODELING WITH QUADRATIC EQUATIONS

APPLICATIONS AND MODELING WITH QUADRATIC EQUATIONS Now that we are starting to feel comfortable with the factoring process, the question becomes what do we use factoring to do? There are a variety of classic

### Lectures 5-6: Taylor Series

Math 1d Instructor: Padraic Bartlett Lectures 5-: Taylor Series Weeks 5- Caltech 213 1 Taylor Polynomials and Series As we saw in week 4, power series are remarkably nice objects to work with. In particular,

### A QUEUEING-INVENTORY SYSTEM WITH DEFECTIVE ITEMS AND POISSON DEMAND. bhaji@usc.edu

A QUEUEING-INVENTORY SYSTEM WITH DEFECTIVE ITEMS AND POISSON DEMAND Rasoul Hai 1, Babak Hai 1 Industrial Engineering Department, Sharif University of Technology, +98-1-66165708, hai@sharif.edu Industrial

### SOLVING POLYNOMIAL EQUATIONS

C SOLVING POLYNOMIAL EQUATIONS We will assume in this appendix that you know how to divide polynomials using long division and synthetic division. If you need to review those techniques, refer to an algebra

### Lecture Notes on Polynomials

Lecture Notes on Polynomials Arne Jensen Department of Mathematical Sciences Aalborg University c 008 Introduction These lecture notes give a very short introduction to polynomials with real and complex

### Health Savings Accounts (HSA)

What is a Health Savings Account? Health Savings Accounts (HSAs) were created so that individuals covered by qualified highdeductible health plans could receive tax-preferred treatment for money saved

### We will define a consistent family of probability measures on the measurable space (S n,b(s n )) by putting Z

50 15. MARKOV CHAINS: DEFINITIONS AND EXAMPLES Along with the discussion of martingales, we have introduced the concept of a discrete-time stochastic process. In this chapter we will study a particular

### Optimal Hiring of Cloud Servers A. Stephen McGough, Isi Mitrani. EPEW 2014, Florence

Optimal Hiring of Cloud Servers A. Stephen McGough, Isi Mitrani EPEW 2014, Florence Scenario How many cloud instances should be hired? Requests Host hiring servers The number of active servers is controlled

### COMMERCIAL INSURANCE NEWS COINSURANCE: INSURANCE TO VALUE REVISITED

AN ESSENTIAL CONCEPT IN PROPERTY INSURANCE By Robert J. Prahl, CPCU The need to adequately insure property, whether it be commercial or personal, is one of the most fundamental concepts of insurance. Its

### FACTORING SPARSE POLYNOMIALS

FACTORING SPARSE POLYNOMIALS Theorem 1 (Schinzel): Let r be a positive integer, and fix non-zero integers a 0,..., a r. Let F (x 1,..., x r ) = a r x r + + a 1 x 1 + a 0. Then there exist finite sets S

### PB 50 TH ANNIVERSARY BONUS SAVERS REWARD TERMS AND CONDITIONS

PB 50 TH ANNIVERSARY BONUS SAVERS REWARD TERMS AND CONDITIONS The PB 50 th Anniversary Bonus Savers Reward ( Campaign ) is launched by Public Bank Berhad [6463-H] ( PBB ). The following terms and conditions

### Non-Life Insurance Mathematics

Thomas Mikosch Non-Life Insurance Mathematics An Introduction with the Poisson Process Second Edition 4y Springer Contents Part I Collective Risk Models 1 The Basic Model 3 2 Models for the Claim Number

### Direct Methods for Solving Linear Systems. Matrix Factorization

Direct Methods for Solving Linear Systems Matrix Factorization Numerical Analysis (9th Edition) R L Burden & J D Faires Beamer Presentation Slides prepared by John Carroll Dublin City University c 2011

### A Single-Unit Decomposition Approach to Multi-Echelon Inventory Systems

A Single-Unit Decomposition Approach to Multi-Echelon Inventory Systems Alp Muharremoğlu John N. sitsiklis July 200 Revised March 2003 Former version titled: Echelon Base Stock Policies in Uncapacitated

### SGN-1158 Introduction to Signal Processing Test. Solutions

SGN-1158 Introduction to Signal Processing Test. Solutions 1. Convolve the function ( ) with itself and show that the Fourier transform of the result is the square of the Fourier transform of ( ). (Hints:

### Web-based Supplementary Materials for Bayesian Effect Estimation. Accounting for Adjustment Uncertainty by Chi Wang, Giovanni

1 Web-based Supplementary Materials for Bayesian Effect Estimation Accounting for Adjustment Uncertainty by Chi Wang, Giovanni Parmigiani, and Francesca Dominici In Web Appendix A, we provide detailed

### Lecture 13: Factoring Integers

CS 880: Quantum Information Processing 0/4/0 Lecture 3: Factoring Integers Instructor: Dieter van Melkebeek Scribe: Mark Wellons In this lecture, we review order finding and use this to develop a method

### Math 370/408, Spring 2008 Prof. A.J. Hildebrand. Actuarial Exam Practice Problem Set 5 Solutions

Math 370/408, Spring 2008 Prof. A.J. Hildebrand Actuarial Exam Practice Problem Set 5 Solutions About this problem set: These are problems from Course 1/P actuarial exams that I have collected over the

### a 1 x + a 0 =0. (3) ax 2 + bx + c =0. (4)

ROOTS OF POLYNOMIAL EQUATIONS In this unit we discuss polynomial equations. A polynomial in x of degree n, where n 0 is an integer, is an expression of the form P n (x) =a n x n + a n 1 x n 1 + + a 1 x