# Random Variate Generation (Part 3)

Save this PDF as:

Size: px
Start display at page:

## Transcription

1 Random Variate Generation (Part 3) Dr.Çağatay ÜNDEĞER Öğretim Görevlisi Bilkent Üniversitesi Bilgisayar Mühendisliği Bölümü & Bilgisayar Mühendisliği Bölümü Bilkent Üniversitesi Fall Random Variate Generation (Outline) Random numbers Random number generators Random variate generation Factors to be considered General principles Inverse Transform Method Acceptance-Rejection Method Composition Method Relocate and Rescale Method Specific distributions 2 1

2 Random Numbers A random sequence of numbers obtained from a stochastic process. In real world, random numbers may be generated using a dice or a roulette wheel. 3 Random Numbers Random numbers are very important for a simulation, Since all the randomness required by the model is simulated by a random number generator, Whose output is assumed to be a sequence of independent and identically (uniformly) distributed random numbers between 0 and 1. Then these random numbers are transformed into required probability distributions. 4 2

3 Random Number Generator A computational or physical device designed to generate a sequence of numbers that lack any pattern (i.e. appear random). 5 Random Number Generators Computer-based generators are simple deterministic programs trying to fool the user by producing a deterministic squence that looks random (pseudo random numbers). Therefore, they should meet some statistical tests for randomness intended to ensure that they do not have any easily discernible patterns. 6 3

4 Random Number Seed Computer-based generators use random number seeds for seting the starting point of the random number squence. These seeds are often initialized using a computer's real time clock in order to have some external noise. Pseudo random number squence Seed 7 Random Variate Generation Refers to the generation of variates whose probability distribution is different from the uniform distribution on the interval (0,1). 8 4

5 Factors to Be Considered Exactness: Exact if distribution of variates generated has the exact form desired. Speed: Related with computing time required to generate variate. Contributions to time are: Setup time, Variable generation time. 9 Factors to Be Considered Space: Computer memory required for the generator. Simplicity: Refers to both algorithmic simplicity and implementation simplicity. 10 5

6 General Principles We assume that a pseudo random number generator RN(0,1) producing a sequence of independent between 0 and 1 is available. General methods: Inverse transform method Acceptance-rejection method Composite method Translations and other simple transforms 11 Inverse Transform Method A continuous distribution can be defined by its density function f(x). The probability that a value x lies between a and b, where a>b, is the integral of function between a and b. density (probability) P(a x b) = f(x) dx b a the area between a and b - + a b x 12 6

7 Inverse Transform Method The cummulative distribution function can be generated for all x by computing the integral of function between -infinite and x. density f(x) F(x) = - f(z) dz x - + x cummulative probability 1 F(x) x 13 Inverse Transform Method Function is strictly increasing and contiuous. F(x) = u gives a unique x. u cummulative probability 1 F(x) x x = F -1 (u) inverse of F(x) 14 7

8 Inverse Transform Method For generating random variates with f(x): Let u = RN(0,1) Return x = F -1 (u) cummulative probability A random number in range [0,1] u 1 F(x) 0 x + 15 Inverse Transform Method (Sample) For exponential distribution: Probability density function Cummulative distribution function x = F -1 (x,λ) = -ln(1-u)/λ 16 8

9 Acceptance-Rejection Method Suppose that we need to sample from a distribution whose inverse function is hard to solve. In that case, acceptance-rejection method can be used. 17 Acceptance-Rejection Method Generate a random point (X,Y) on the graph. If (X,Y) lies under the graph of f(x) then Accept X Otherwise Reject X An accepted point probability X A rejected point Y - + 0,0 18 9

10 Acceptance-Rejection Method (Drawback) Trials ratio: Average number of points (X,Y) needed to produce one accepted X. We need to make trial ratio close to 1. Else generator may not be efficient enough because of wasted computating effort. 19 Acceptance-Rejection Method (Making More Efficient) One way to make generator efficient is; To generate points uniformly scattered under a function e(x), where area between the graph of f and e be small. probability f(x) e(x) - + a b 20 10

11 Acceptance-Rejection Method (Constructing e(x)) Take e(x) = Kg(x) g(x) = density function of a distribution for which an easy way of generating variates already exists. K = scale factor probability K scales g(x) Kg(x) g(x) Acceptance-Rejection Method (Producing (X,Y)) Let X = a variate produced from Kg(x) Let U = RN(0,1) (X,Y) = (X, UKg(X)) probability Kg(x) U locates Y randomly under Kg(x) Kg(x) Y = UKg(x) (X,Y) - + X 22 11

12 Composition Method Soppose that density f is written as weighted sum of r other density functions (f i ), Where weights (p i ) satisfy: All p i > 0 Sum of all p i = 1 A mixture or a compound density f(x) = r p i f i (x) i = 1 23 Let U = RN(0,1) Set i = 1 Composition Method (Producing Variates) While ( F i < U ), where F i = p k k = 1 i = i+1 Return X = a variate produced from f i i p 1 p 2 p 3 p U selects one of the densities randomly 24 12

13 Relocate and Rescale Method If X is a random variate drawn from a continuous distribution f(x), We can reposition and rescale the distribution to get a random variate Y. Y = ax + b rescale relocate probability relocated f(x) rescaled - + b 25 Bernoulli Distributions Density: Value 1 with success probability p, and Value 0 with failure probability q = 1 p. Random variate production: Let U = RN(0,1) If (U p) Return X = 1 Else Return X =

14 Density: Uniform Distributions Values between a and b, where a>b, and probabilities of all the are equal. Production (relocate & rescale): Let U = RN(0,1) Return X = a + (b-a)u Probability for discrete : a + min( int[(b-a+1)u], b-a ) p a b 27 Triangular Distributions Density: A distribution with lower limit a, mode c, and upper limit b. Production (inverse transform, relocate & rescale): Let β = (c-a)/(b-a) Let U 1 = RN(0,1), U 2 = RN(0,1) If (U 1 β) Probability Return X = a + (c-a) U 2 2/(b-a) Else Return X = b - (b-c) U 2 a c b 28 14

15 Density: Symmetric Triangular Distributions A triangular distribution with c located at the center of a and b. Production (probability theory): If U 1 and U 2 are uniformly distributed between 0 and 1 then (U 1 +U 2 )/2 has a symmetric triangular distribution between 0 and Density: Symmetric Triangular Distributions A triangular distribution with c located at the center of a and b. Production (probability t., relocate & rescale): Let U 1 = RN(0,1), U 2 = RN(0,1) Return X = a + (b-a)(u 1 +U 2 )/2 Probability 2/(b-a) a c b 30 15

16 Normal (Gaussian) Distributions Density: A bell-like shaped function with µ and σ. Production (special transform): While (true) Let U 1 = RN(0,1), U 2 = RN(0,1) Let V 1 = 2U 1-1, V 2 = 2U 2-1 Let W = V 12 +V 2 2 If (W<1) Let Y = (-2lnW)/W Return X = µ + σv 1 Y 31 Log-Normal Distributions Density: Single-tailed distribution of any random variable whose logarithm is normally distributed. Production (special transform): Has no simple closed form. Use the property that; If Y is normal(µ, σ 2 ) then X = e Y is log-normal(µ, σ 2 ) 32 16

17 Log-Normal Distributions Production (special transform): Let Y = Normal(µ, σ 2 ) Return X = e Y 33 Exponential Distributions Density: Describes the times between events in a Poisson process with rate parameter, λ. Production (inverse transform, rescale): Let U = RN(0,1) Return X = -1/λ ln(1-u) 34 17

18 Weibull Distributions Density: Describe the size distribution of particles with shape, k, and scale, λ. Production (inverse transform, rescale): Let U = RN(0,1) Return X = λ [-ln(1-u)] 1/k 35 Poisson Distributions Density: Probability of a number of events occurring in a fixed period of time with; k : number of occurrences of an event λ > 0 : expected number of occurrences in the fixed interval. The probability that there are exactly k occurrences of event is equal to 36 18

19 Poisson Distributions Production (counting events): Let a = e -λ Let p = 1 Let k = -1 While (p > a) Let U = RN(0,1) Let p = pu Let k = k+1 Return k 37 Discrete Integer-Valued Random Numbers Assume we have n integer numbers with probability of being selected p i for each How can we write a random variate generator? 38 19

20 Discrete Integer-Valued Random Numbers Build a table for cummulative probabilities (P i ) of n numbers. Use U = RN(0,1) to select n i from the table with P i-1 < U P i (let P 0 < 0). p 1 p 2 p 3 p 4 n 0 1 n 2 n 3 n 4 1 U selects one of the numbers randomly 39 20

### 2WB05 Simulation Lecture 8: Generating random variables

2WB05 Simulation Lecture 8: Generating random variables Marko Boon http://www.win.tue.nl/courses/2wb05 January 7, 2013 Outline 2/36 1. How do we generate random variables? 2. Fitting distributions Generating

### Introduction to Probability

Introduction to Probability EE 179, Lecture 15, Handout #24 Probability theory gives a mathematical characterization for experiments with random outcomes. coin toss life of lightbulb binary data sequence

### Chapter 3 RANDOM VARIATE GENERATION

Chapter 3 RANDOM VARIATE GENERATION In order to do a Monte Carlo simulation either by hand or by computer, techniques must be developed for generating values of random variables having known distributions.

### 4. Joint Distributions

Virtual Laboratories > 2. Distributions > 1 2 3 4 5 6 7 8 4. Joint Distributions Basic Theory As usual, we start with a random experiment with probability measure P on an underlying sample space. Suppose

### Joint Exam 1/P Sample Exam 1

Joint Exam 1/P Sample Exam 1 Take this practice exam under strict exam conditions: Set a timer for 3 hours; Do not stop the timer for restroom breaks; Do not look at your notes. If you believe a question

### Expectation Discrete RV - weighted average Continuous RV - use integral to take the weighted average

PHP 2510 Expectation, variance, covariance, correlation Expectation Discrete RV - weighted average Continuous RV - use integral to take the weighted average Variance Variance is the average of (X µ) 2

### Notes on Continuous Random Variables

Notes on Continuous Random Variables Continuous random variables are random quantities that are measured on a continuous scale. They can usually take on any value over some interval, which distinguishes

### Aachen Summer Simulation Seminar 2014

Aachen Summer Simulation Seminar 2014 Lecture 07 Input Modelling + Experimentation + Output Analysis Peer-Olaf Siebers pos@cs.nott.ac.uk Motivation 1. Input modelling Improve the understanding about how

### UNIT I: RANDOM VARIABLES PART- A -TWO MARKS

UNIT I: RANDOM VARIABLES PART- A -TWO MARKS 1. Given the probability density function of a continuous random variable X as follows f(x) = 6x (1-x) 0

### General Sampling Methods

General Sampling Methods Reference: Glasserman, 2.2 and 2.3 Claudio Pacati academic year 2016 17 1 Inverse Transform Method Assume U U(0, 1) and let F be the cumulative distribution function of a distribution

### 3 SIMULATION BASICS. 3.1 Introduction. 3.2 Types of Simulation. Zeal without knowledge is fi re without light.

C H A P T E R 3 SIMULATION BASICS Zeal without knowledge is fi re without light. Dr. Thomas Fuller 3.1 Introduction Simulation is much more meaningful when we understand what it is actually doing. Understanding

### Probability and statistics; Rehearsal for pattern recognition

Probability and statistics; Rehearsal for pattern recognition Václav Hlaváč Czech Technical University in Prague Faculty of Electrical Engineering, Department of Cybernetics Center for Machine Perception

### Homework # 3 Solutions

Homework # 3 Solutions February, 200 Solution (2.3.5). Noting that and ( + 3 x) x 8 = + 3 x) by Equation (2.3.) x 8 x 8 = + 3 8 by Equations (2.3.7) and (2.3.0) =3 x 8 6x2 + x 3 ) = 2 + 6x 2 + x 3 x 8

### Math 461 Fall 2006 Test 2 Solutions

Math 461 Fall 2006 Test 2 Solutions Total points: 100. Do all questions. Explain all answers. No notes, books, or electronic devices. 1. [105+5 points] Assume X Exponential(λ). Justify the following two

### Monte Carlo Sampling Methods

[] Monte Carlo Sampling Methods Jasmina L. Vujic Nuclear Engineering Department University of California, Berkeley Email: vujic@nuc.berkeley.edu phone: (50) 643-8085 fax: (50) 643-9685 [2] Monte Carlo

### 59 A taste of Monte Carlo method

Chapter 17 Monte Carlo Methods 59 A taste of Monte Carlo method Monte Carlo methods is a class of numerical methods that relies on random sampling. For example, the following Monte Carlo method calculates

### Choosing Probability Distributions in Simulation

MBA elective - Models for Strategic Planning - Session 14 Choosing Probability Distributions in Simulation Probability Distributions may be selected on the basis of Data Theory Judgment a mix of the above

### IB Math 11 Assignment: Chapters 1 & 2 (A) NAME: (Functions, Sequences and Series)

IB Math 11 Assignment: Chapters 1 & 2 (A) NAME: (Functions, Sequences and Series) 1. Let f(x) = 7 2x and g(x) = x + 3. Find (g f)(x). Write down g 1 (x). (c) Find (f g 1 )(5). (Total 5 marks) 2. Consider

### Continuous Random Variables and Probability Distributions. Stat 4570/5570 Material from Devore s book (Ed 8) Chapter 4 - and Cengage

4 Continuous Random Variables and Probability Distributions Stat 4570/5570 Material from Devore s book (Ed 8) Chapter 4 - and Cengage Continuous r.v. A random variable X is continuous if possible values

### Examination 110 Probability and Statistics Examination

Examination 0 Probability and Statistics Examination Sample Examination Questions The Probability and Statistics Examination consists of 5 multiple-choice test questions. The test is a three-hour examination

### Algebra I Vocabulary Cards

Algebra I Vocabulary Cards Table of Contents Expressions and Operations Natural Numbers Whole Numbers Integers Rational Numbers Irrational Numbers Real Numbers Absolute Value Order of Operations Expression

### Introduction to Mobile Robotics Bayes Filter Particle Filter and Monte Carlo Localization

Introduction to Mobile Robotics Bayes Filter Particle Filter and Monte Carlo Localization Wolfram Burgard, Maren Bennewitz, Diego Tipaldi, Luciano Spinello 1 Motivation Recall: Discrete filter Discretize

### Generating Random Numbers Variance Reduction Quasi-Monte Carlo. Simulation Methods. Leonid Kogan. MIT, Sloan. 15.450, Fall 2010

Simulation Methods Leonid Kogan MIT, Sloan 15.450, Fall 2010 c Leonid Kogan ( MIT, Sloan ) Simulation Methods 15.450, Fall 2010 1 / 35 Outline 1 Generating Random Numbers 2 Variance Reduction 3 Quasi-Monte

### Supplement to Call Centers with Delay Information: Models and Insights

Supplement to Call Centers with Delay Information: Models and Insights Oualid Jouini 1 Zeynep Akşin 2 Yves Dallery 1 1 Laboratoire Genie Industriel, Ecole Centrale Paris, Grande Voie des Vignes, 92290

### Continuous Random Variables

Continuous Random Variables COMP 245 STATISTICS Dr N A Heard Contents 1 Continuous Random Variables 2 11 Introduction 2 12 Probability Density Functions 3 13 Transformations 5 2 Mean, Variance and Quantiles

### MT426 Notebook 3 Fall 2012 prepared by Professor Jenny Baglivo. 3 MT426 Notebook 3 3. 3.1 Definitions... 3. 3.2 Joint Discrete Distributions...

MT426 Notebook 3 Fall 2012 prepared by Professor Jenny Baglivo c Copyright 2004-2012 by Jenny A. Baglivo. All Rights Reserved. Contents 3 MT426 Notebook 3 3 3.1 Definitions............................................

### Institute of Actuaries of India Subject CT3 Probability and Mathematical Statistics

Institute of Actuaries of India Subject CT3 Probability and Mathematical Statistics For 2015 Examinations Aim The aim of the Probability and Mathematical Statistics subject is to provide a grounding in

### Functions and Equations

Centre for Education in Mathematics and Computing Euclid eworkshop # Functions and Equations c 014 UNIVERSITY OF WATERLOO Euclid eworkshop # TOOLKIT Parabolas The quadratic f(x) = ax + bx + c (with a,b,c

### Course 221: Analysis Academic year , First Semester

Course 221: Analysis Academic year 2007-08, First Semester David R. Wilkins Copyright c David R. Wilkins 1989 2007 Contents 1 Basic Theorems of Real Analysis 1 1.1 The Least Upper Bound Principle................

### Course Name: Course Code: ALEKS Course: Instructor: Course Dates: Course Content: Textbook: Dates Objective Prerequisite Topics

Course Name: MATH 1204 Fall 2015 Course Code: N/A ALEKS Course: College Algebra Instructor: Master Templates Course Dates: Begin: 08/22/2015 End: 12/19/2015 Course Content: 271 Topics (261 goal + 10 prerequisite)

### Lecture 8. Generating a non-uniform probability distribution

Discrete outcomes Lecture 8 Generating a non-uniform probability distribution Last week we discussed generating a non-uniform probability distribution for the case of finite discrete outcomes. An algorithm

### The basics of probability theory. Distribution of variables, some important distributions

The basics of probability theory. Distribution of variables, some important distributions 1 Random experiment The outcome is not determined uniquely by the considered conditions. For example, tossing a

### Department of Mathematics, Indian Institute of Technology, Kharagpur Assignment 2-3, Probability and Statistics, March 2015. Due:-March 25, 2015.

Department of Mathematics, Indian Institute of Technology, Kharagpur Assignment -3, Probability and Statistics, March 05. Due:-March 5, 05.. Show that the function 0 for x < x+ F (x) = 4 for x < for x

### 3. Continuous Random Variables

3. Continuous Random Variables A continuous random variable is one which can take any value in an interval (or union of intervals) The values that can be taken by such a variable cannot be listed. Such

### Overview of Monte Carlo Simulation, Probability Review and Introduction to Matlab

Monte Carlo Simulation: IEOR E4703 Fall 2004 c 2004 by Martin Haugh Overview of Monte Carlo Simulation, Probability Review and Introduction to Matlab 1 Overview of Monte Carlo Simulation 1.1 Why use simulation?

### Chapter 4 Lecture Notes

Chapter 4 Lecture Notes Random Variables October 27, 2015 1 Section 4.1 Random Variables A random variable is typically a real-valued function defined on the sample space of some experiment. For instance,

### Master s Theory Exam Spring 2006

Spring 2006 This exam contains 7 questions. You should attempt them all. Each question is divided into parts to help lead you through the material. You should attempt to complete as much of each problem

### LECTURE 16. Readings: Section 5.1. Lecture outline. Random processes Definition of the Bernoulli process Basic properties of the Bernoulli process

LECTURE 16 Readings: Section 5.1 Lecture outline Random processes Definition of the Bernoulli process Basic properties of the Bernoulli process Number of successes Distribution of interarrival times The

### 5. Continuous Random Variables

5. Continuous Random Variables Continuous random variables can take any value in an interval. They are used to model physical characteristics such as time, length, position, etc. Examples (i) Let X be

### Probabilities and Random Variables

Probabilities and Random Variables This is an elementary overview of the basic concepts of probability theory. 1 The Probability Space The purpose of probability theory is to model random experiments so

### Probability density function : An arbitrary continuous random variable X is similarly described by its probability density function f x = f X

Week 6 notes : Continuous random variables and their probability densities WEEK 6 page 1 uniform, normal, gamma, exponential,chi-squared distributions, normal approx'n to the binomial Uniform [,1] random

### Continuous Random Variables. and Probability Distributions. Continuous Random Variables and Probability Distributions ( ) ( ) Chapter 4 4.

UCLA STAT 11 A Applied Probability & Statistics for Engineers Instructor: Ivo Dinov, Asst. Prof. In Statistics and Neurology Teaching Assistant: Neda Farzinnia, UCLA Statistics University of California,

### Continuous Random Variables

Probability 2 - Notes 7 Continuous Random Variables Definition. A random variable X is said to be a continuous random variable if there is a function f X (x) (the probability density function or p.d.f.)

### Probability and Statistics Vocabulary List (Definitions for Middle School Teachers)

Probability and Statistics Vocabulary List (Definitions for Middle School Teachers) B Bar graph a diagram representing the frequency distribution for nominal or discrete data. It consists of a sequence

### Statistics I for QBIC. Contents and Objectives. Chapters 1 7. Revised: August 2013

Statistics I for QBIC Text Book: Biostatistics, 10 th edition, by Daniel & Cross Contents and Objectives Chapters 1 7 Revised: August 2013 Chapter 1: Nature of Statistics (sections 1.1-1.6) Objectives

### A Simple Pseudo Random Number algorithm

Lecture 7 Generating random numbers is a useful technique in many numerical applications in Physics. This is because many phenomena in physics are random, and algorithms that use random numbers have applications

### Lecture 7: Continuous Random Variables

Lecture 7: Continuous Random Variables 21 September 2005 1 Our First Continuous Random Variable The back of the lecture hall is roughly 10 meters across. Suppose it were exactly 10 meters, and consider

### Chapter 3: DISCRETE RANDOM VARIABLES AND PROBABILITY DISTRIBUTIONS

Chapter 3: DISCRETE RANDOM VARIABLES AND PROBABILITY DISTRIBUTIONS Part 4: Geometric Distribution Negative Binomial Distribution Hypergeometric Distribution Sections 3-7, 3-8 The remaining discrete random

### ( ) = 1 x. ! 2x = 2. The region where that joint density is positive is indicated with dotted lines in the graph below. y = x

Errata for the ASM Study Manual for Exam P, Eleventh Edition By Dr. Krzysztof M. Ostaszewski, FSA, CERA, FSAS, CFA, MAAA Web site: http://www.krzysio.net E-mail: krzysio@krzysio.net Posted September 21,

### Chapter 4 Expected Values

Chapter 4 Expected Values 4. The Expected Value of a Random Variables Definition. Let X be a random variable having a pdf f(x). Also, suppose the the following conditions are satisfied: x f(x) converges

### Generating Random Variables and Stochastic Processes

Monte Carlo Simulation: IEOR E4703 c 2010 by Martin Haugh Generating Random Variables and Stochastic Processes In these lecture notes we describe the principal methods that are used to generate random

### Important Probability Distributions OPRE 6301

Important Probability Distributions OPRE 6301 Important Distributions... Certain probability distributions occur with such regularity in real-life applications that they have been given their own names.

### CORRELATED TO THE SOUTH CAROLINA COLLEGE AND CAREER-READY FOUNDATIONS IN ALGEBRA

We Can Early Learning Curriculum PreK Grades 8 12 INSIDE ALGEBRA, GRADES 8 12 CORRELATED TO THE SOUTH CAROLINA COLLEGE AND CAREER-READY FOUNDATIONS IN ALGEBRA April 2016 www.voyagersopris.com Mathematical

### 6 Scalar, Stochastic, Discrete Dynamic Systems

47 6 Scalar, Stochastic, Discrete Dynamic Systems Consider modeling a population of sand-hill cranes in year n by the first-order, deterministic recurrence equation y(n + 1) = Ry(n) where R = 1 + r = 1

### Stochastic Processes and Queueing Theory used in Cloud Computer Performance Simulations

56 Stochastic Processes and Queueing Theory used in Cloud Computer Performance Simulations Stochastic Processes and Queueing Theory used in Cloud Computer Performance Simulations Florin-Cătălin ENACHE

### Algebra 1 Chapter 3 Vocabulary. equivalent - Equations with the same solutions as the original equation are called.

Chapter 3 Vocabulary equivalent - Equations with the same solutions as the original equation are called. formula - An algebraic equation that relates two or more real-life quantities. unit rate - A rate

### Slide 1 Math 1520, Lecture 23. This lecture covers mean, median, mode, odds, and expected value.

Slide 1 Math 1520, Lecture 23 This lecture covers mean, median, mode, odds, and expected value. Slide 2 Mean, Median and Mode Mean, Median and mode are 3 concepts used to get a sense of the central tendencies

### Lecture 4: Random Variables

Lecture 4: Random Variables 1. Definition of Random variables 1.1 Measurable functions and random variables 1.2 Reduction of the measurability condition 1.3 Transformation of random variables 1.4 σ-algebra

### Introduction to Simulation Using MATLAB

Chapter 12 Introduction to Simulation Using MATLAB A. Rakhshan and H. Pishro-Nik 12.1 Analysis versus Computer Simulation A computer simulation is a computer program which attempts to represent the real

### This document is published at www.agner.org/random, Feb. 2008, as part of a software package.

Sampling methods by Agner Fog This document is published at www.agner.org/random, Feb. 008, as part of a software package. Introduction A C++ class library of non-uniform random number generators is available

### MULTIPLE CHOICE. Choose the one alternative that best completes the statement or answers the question.

Math 110 Review for Final Examination 2012 Name MULTIPLE CHOICE. Choose the one alternative that best completes the statement or answers the question. Match the equation to the correct graph. 1) y = -

### The Variability of P-Values. Summary

The Variability of P-Values Dennis D. Boos Department of Statistics North Carolina State University Raleigh, NC 27695-8203 boos@stat.ncsu.edu August 15, 2009 NC State Statistics Departement Tech Report

### Chapter 10 Monte Carlo Methods

411 There is no result in nature without a cause; understand the cause and you will have no need for the experiment. Leonardo da Vinci (1452-1519) Chapter 10 Monte Carlo Methods In very broad terms one

### Introduction to Monte-Carlo Methods

Introduction to Monte-Carlo Methods Bernard Lapeyre Halmstad January 2007 Monte-Carlo methods are extensively used in financial institutions to compute European options prices to evaluate sensitivities

### Recursive Estimation

Recursive Estimation Raffaello D Andrea Spring 04 Problem Set : Bayes Theorem and Bayesian Tracking Last updated: March 8, 05 Notes: Notation: Unlessotherwisenoted,x, y,andz denoterandomvariables, f x

### Homework 4 - KEY. Jeff Brenion. June 16, 2004. Note: Many problems can be solved in more than one way; we present only a single solution here.

Homework 4 - KEY Jeff Brenion June 16, 2004 Note: Many problems can be solved in more than one way; we present only a single solution here. 1 Problem 2-1 Since there can be anywhere from 0 to 4 aces, the

### Sums of Independent Random Variables

Chapter 7 Sums of Independent Random Variables 7.1 Sums of Discrete Random Variables In this chapter we turn to the important question of determining the distribution of a sum of independent random variables

### Joint Probability Distributions and Random Samples (Devore Chapter Five)

Joint Probability Distributions and Random Samples (Devore Chapter Five) 1016-345-01 Probability and Statistics for Engineers Winter 2010-2011 Contents 1 Joint Probability Distributions 1 1.1 Two Discrete

### CA200 Quantitative Analysis for Business Decisions. File name: CA200_Section_04A_StatisticsIntroduction

CA200 Quantitative Analysis for Business Decisions File name: CA200_Section_04A_StatisticsIntroduction Table of Contents 4. Introduction to Statistics... 1 4.1 Overview... 3 4.2 Discrete or continuous

### Renewal Theory. (iv) For s < t, N(t) N(s) equals the number of events in (s, t].

Renewal Theory Def. A stochastic process {N(t), t 0} is said to be a counting process if N(t) represents the total number of events that have occurred up to time t. X 1, X 2,... times between the events

### Lecture 10: Other Continuous Distributions and Probability Plots

Lecture 10: Other Continuous Distributions and Probability Plots Devore: Section 4.4-4.6 Page 1 Gamma Distribution Gamma function is a natural extension of the factorial For any α > 0, Γ(α) = 0 x α 1 e

### e.g. arrival of a customer to a service station or breakdown of a component in some system.

Poisson process Events occur at random instants of time at an average rate of λ events per second. e.g. arrival of a customer to a service station or breakdown of a component in some system. Let N(t) be

### FEGYVERNEKI SÁNDOR, PROBABILITY THEORY AND MATHEmATICAL

FEGYVERNEKI SÁNDOR, PROBABILITY THEORY AND MATHEmATICAL STATIsTICs 4 IV. RANDOm VECTORs 1. JOINTLY DIsTRIBUTED RANDOm VARIABLEs If are two rom variables defined on the same sample space we define the joint

### Some Lecture Notes and In-Class Examples for Pre-Calculus:

Some Lecture Notes and In-Class Examples for Pre-Calculus: Section.7 Definition of a Quadratic Inequality A quadratic inequality is any inequality that can be put in one of the forms ax + bx + c < 0 ax

### Summary of Formulas and Concepts. Descriptive Statistics (Ch. 1-4)

Summary of Formulas and Concepts Descriptive Statistics (Ch. 1-4) Definitions Population: The complete set of numerical information on a particular quantity in which an investigator is interested. We assume

### Math 370, Spring 2008 Prof. A.J. Hildebrand. Practice Test 1 Solutions

Math 70, Spring 008 Prof. A.J. Hildebrand Practice Test Solutions About this test. This is a practice test made up of a random collection of 5 problems from past Course /P actuarial exams. Most of the

### Generating Random Variables and Stochastic Processes

Monte Carlo Simulation: IEOR E4703 Fall 2004 c 2004 by Martin Haugh Generating Random Variables and Stochastic Processes 1 Generating U(0,1) Random Variables The ability to generate U(0, 1) random variables

### Probability distributions

Probability distributions (Notes are heavily adapted from Harnett, Ch. 3; Hayes, sections 2.14-2.19; see also Hayes, Appendix B.) I. Random variables (in general) A. So far we have focused on single events,

### Information Theory (2)

Some Applications in Computer Science Jean-Marc Vincent MESCAL-INRIA Project Laboratoire d Informatique de Grenoble Universities of Grenoble, France Jean-Marc.Vincent@imag.fr LICIA - joint laboratory LIG

EXAM 3, FALL 003 Please note: On a one-time basis, the CAS is releasing annotated solutions to Fall 003 Examination 3 as a study aid to candidates. It is anticipated that for future sittings, only the

### Transformations and Expectations of random variables

Transformations and Epectations of random variables X F X (): a random variable X distributed with CDF F X. Any function Y = g(x) is also a random variable. If both X, and Y are continuous random variables,

### Quantum Computing Lecture 7. Quantum Factoring. Anuj Dawar

Quantum Computing Lecture 7 Quantum Factoring Anuj Dawar Quantum Factoring A polynomial time quantum algorithm for factoring numbers was published by Peter Shor in 1994. polynomial time here means that

### Probability for Estimation (review)

Probability for Estimation (review) In general, we want to develop an estimator for systems of the form: x = f x, u + η(t); y = h x + ω(t); ggggg y, ffff x We will primarily focus on discrete time linear

### Algebra 2 Final Exam Review Ch 7-14

Algebra 2 Final Exam Review Ch 7-14 Short Answer 1. Simplify the radical expression. Use absolute value symbols if needed. 2. Simplify. Assume that all variables are positive. 3. Multiply and simplify.

### WASSCE / WAEC ELECTIVE / FURTHER MATHEMATICS SYLLABUS

Visit this link to read the introductory text for this syllabus. 1. Circular Measure Lengths of Arcs of circles and Radians Perimeters of Sectors and Segments measure in radians 2. Trigonometry (i) Sine,

### LOGNORMAL MODEL FOR STOCK PRICES

LOGNORMAL MODEL FOR STOCK PRICES MICHAEL J. SHARPE MATHEMATICS DEPARTMENT, UCSD 1. INTRODUCTION What follows is a simple but important model that will be the basis for a later study of stock prices as

### CSE 312, 2011 Winter, W.L.Ruzzo. 7. continuous random variables

CSE 312, 2011 Winter, W.L.Ruzzo 7. continuous random variables continuous random variables Discrete random variable: takes values in a finite or countable set, e.g. X {1,2,..., 6} with equal probability

### CHAPTER 13: SENSITIVITY, PROBABILITY AND RELIABILITY ANALYSIS

CHAPTER 13: SENSITIVITY, PROBABILITY AND RELIABILITY ANALYSIS 1 13.1 Sensitivity Analysis Principles of static equilibrium to evaluate the balance of driving and resisting forces are used in limit equilibrium

TEACHING SIMULATION WITH SPREADSHEETS Jelena Pecherska and Yuri Merkuryev Deptartment of Modelling and Simulation Riga Technical University 1, Kalku Street, LV-1658 Riga, Latvia E-mail: merkur@itl.rtu.lv,

### The sample space for a pair of die rolls is the set. The sample space for a random number between 0 and 1 is the interval [0, 1].

Probability Theory Probability Spaces and Events Consider a random experiment with several possible outcomes. For example, we might roll a pair of dice, flip a coin three times, or choose a random real

### MATH 2300 review problems for Exam 3 ANSWERS

MATH 300 review problems for Exam 3 ANSWERS. Check whether the following series converge or diverge. In each case, justify your answer by either computing the sum or by by showing which convergence test

### The Cumulative Distribution and Stochastic Dominance

The Cumulative Distribution and Stochastic Dominance L A T E X file: StochasticDominance Daniel A. Graham, September 1, 2011 A decision problem under uncertainty is frequently cast as the problem of choosing

### Higher Education Math Placement

Higher Education Math Placement Placement Assessment Problem Types 1. Whole Numbers, Fractions, and Decimals 1.1 Operations with Whole Numbers Addition with carry Subtraction with borrowing Multiplication

### BNG 202 Biomechanics Lab. Descriptive statistics and probability distributions I

BNG 202 Biomechanics Lab Descriptive statistics and probability distributions I Overview The overall goal of this short course in statistics is to provide an introduction to descriptive and inferential

### Monte Carlo Simulations and MATLAB

Definitions: Monte Carlo Simulations and MATLAB Monte Carlo Simulation: A simulation of a random process using a large number of computer generated samples. MATLAB: Similar to SciLab Mean: The center of

### MATH 095, College Prep Mathematics: Unit Coverage Pre-algebra topics (arithmetic skills) offered through BSE (Basic Skills Education)

MATH 095, College Prep Mathematics: Unit Coverage Pre-algebra topics (arithmetic skills) offered through BSE (Basic Skills Education) Accurately add, subtract, multiply, and divide whole numbers, integers,

### Geometric Series. On the other hand, if 0 <r<1, then the exponential function of base r, the function g(x) =r x, has a graph that looks like this:

Geometric Series In the previous chapter we saw that if a>, then the exponential function with base a, the function f(x) =a x, has a graph that looks like this: On the other hand, if 0

### Chapter 3: DISCRETE RANDOM VARIABLES AND PROBABILITY DISTRIBUTIONS. Part 3: Discrete Uniform Distribution Binomial Distribution

Chapter 3: DISCRETE RANDOM VARIABLES AND PROBABILITY DISTRIBUTIONS Part 3: Discrete Uniform Distribution Binomial Distribution Sections 3-5, 3-6 Special discrete random variable distributions we will cover