MATHEMATICS 117/E217, SPRING 2012 PROBABILITY AND RANDOM PROCESSES WITH ECONOMIC APPLICATIONS Module #5 (Borel Field and Measurable Functions )


 Kelly Hunter
 2 years ago
 Views:
Transcription
1 MATHEMATICS 117/E217, SPRING 2012 PROBABILITY AND RANDOM PROCESSES WITH ECONOMIC APPLICATIONS Module #5 (Borel Field and Measurable Functions ) Last modified: May 1, 2012 Reading Dineen, pages Proof (may appear on an exam) Define the Borel sigmafield on R and prove that it is generated by the countable collection of open intervals {(, q) : q Q}. Warmups(intended to be done before lecture) Show that the subset of R that contains the single point π and the closed interval [3.5,3.7] belongs to the Borel sigmafield on [3,4]. (Just look at the definitions on page 58.) Let A be the event Dineen s pride, at odds 3:1, wins the Kentucky Derby and define X = 81 A. Thus X is the value of a $2 win ticket on Dineen s pride. Let B be the Borel set (1,0.5). Convince yourself that X 1 (B) belongs to the sigmafield generated by A. (See page 61. This is trivial once you understand the notation.) You are playing a game where you roll a single die. The payoff function X is $1 if the roll is an odd number, $10 if the roll is an even number, plus an extra $5 if the roll is greater than 3. Define an equivalence relation by saying that x y if the rolls have the same payoff. What partition of Ω = {1, 2, 3, 4, 5, 6} is generated by this equivalence relation? (See page 64.) 1
2 Lecture topics. 1. Random Variables and Measurable Functions One of our important goals will be to calculate the expected value of a random variable. For example, the expected value of a single throw of a dart can be obtained by taking all possible scores on the dart board (values of a random variable), multiplying each score by the probability of its occurrence, and summing. Clearly this calculation would be impossible if an event like the dart hits in the region where the score is 20 is not in the sigmafield. More generally, we want any event like the dart hits where the score is between 5 and 30 to be in the sigmafield, and so our choice of sigma field places a restriction on the scoring functions. The ones that are consistent with our chosen sigmafield are called measurable. Looking at the situation the other way around, the requirement that the scoring function for the sample space that corresponds to throwing a dart at a dart board be measurable imposes a requirement on a sigmafield, namely that an event like the dart hits in the 10point region must be in the sigmafield. This connection between sigmafields and measurable functions is independent of any specific probability function. It is the last topic that we will consider before introducing a probability space. 2. Borel sets and the Borel sigmafield So far we have steered clear of uncountable sample spaces except to mention that 2 Ω is too big to be a useful sigmafield when Ω is uncountable. Now we address the case where Ω = R. This case is important for its own sake, e.g. where the experiment is watch this unstable nucleus and see when it decays, but it also important because R is the codomain for a measurable function. The definition of the Borel sigmafield on R is that it is generated by the open intervals. However, the special role for open sets that this definition implies is illusory, since The intersection of all open intervals of the form (a 1, b + 1 ) is the n n closed interval [a, b]. The intersection of all open intervals of the form (x 1, x + 1 ) is the n n set that contains only the one point x. The union of all closed intervals of the form [a + 1, b 1 ] is the open n n interval (a, b). 2
3 So any countable union of open intervals, closed intervals, and isolated points is a Borel set. What is hard, in fact, is constructing a set that is not a Borel set, but such sets exist! It is especially convenient to know (your proof) that the intervals of the form (, q), where q ranges over the countable set of rational numbers, generate the Borel sigmafield. 3. Inverse images and measurable functions. Following a nearuniversal convention, we denote measurable functions and random variables by capital letters from near the end of the alphabet; e.g. X : Ω R. A point in the domain (the sample space) is traditionally denoted by ω. It is not in general a point in any R n. If C is a subset of the codomain of function f, the inverse image of C is the subset of the domain A that is mapped into C: f 1 (C) = {x A : f(x) C} Careful: there is no implication that X is an invertible function. Frequently, f 1 (C) is much larger than a single point or even a single interval. For example, if f(x) = cos x, f 1 ([0.5, 1]) is a countably infinite union of intervals. Any X : Ω R generates a sigmafield F X whose members are the inverse images of Borel sets. As a simple example, if a dart board is divided into three zones worth 0, 5, and 10 points respectively, the scoring function X generates a sigmafield in which a typical event is the score is not zero (the inverse image of the Borel set {5, 10}.) If F X F we say that X is Fmeasurable. To test for measurability, do not try to use the entire Borel field. To show that X is not F measurable, it is sufficient to find any Borel set (for example, a single point) whose inverse image is not in F. To show that X is F measurable, find the simplest collection of Borel sets that generate the image of X. For example, if the image is a finite or countable set of points, show that the inverse image of each point is in F. If the image of X is uncountable, consider the inverse image of an arbitrary set of the form (, q). 3
4 4. Indicator functions The indicator function of an event A Ω, denoted 1 A, has the value 1 if ω A, 0 otherwise. The inverse image of {1} is A; the inverse image of {0} is A c. For an arbitrary Borel set, the inverse image simply depends on whether or not 0 and 1 are or are not included on the set. For example, the inverse image of {0.3, 0.7} is the empty set. Elementary set operations can be recast in the language of indicator functions, as follows: 1 A B = 1 A 1 B. 1 A B = 1 A + 1 B 1 A 1 B. 1 A c = 1 1 A. Quite generally, we can make new Fmeasurable functions from old by means of addition, subtraction and multiplication. As a special case, we can make Fmeasurable functions by taking finite linear combinations of indicator functions on events in F. If Ω is finite, such functions necessarily have finite image. The level sets of the form X 1 ({c}) form a partition of Ω, though perhaps it is a coarser partition than the partition P X that generates F X. This could happen, for example, if P X includes {1} and {2} individually, but X = 1 {1,2} so that X(1) = X(2) = 1 and the only level set is {1, 2}. Now we have a new way to create sigmafields. Define a simple function, a finite linear combination of indicator functions X = n c i 1 Ai. i=1 The level sets of X partition Ω into a partition B j, and each set in the partition has an associated value d j. A convenient way to represent X is in the form X = n d j 1 Bj. j=1 4
5 5. Positive and negative functions It will be convenient later in the course to deal with functions that never have negative values. This can be achieved by writing X = X + X where X + = X when X is not negative, 0 otherwise, while X = X when X is not positive, 0 otherwise. With these definitions, X = X + X. X +, X, and X. If X is Fmeasurable, so are 6. Summary of results for countable partition or countable range (Dineen proposition 4.14) (a) If F is generated by a countable partition, then any Fmeasurable function X must be constant on each set A n in the partition and must therefore have countable range. (b) Conversely, if X has countable range, it can be expressed in the form X = x n 1 Bn n=1 when the sets B n are pairwise disjoint. They need not form a complete partition. If all the B n are are in sigmafield F, then X is F measurable. (c) If X has countable range, then any function Y that is F X  measurable must be constant on the level sets of X. (d) One easy way to create a function Y that is constant on the level sets of X is to define Y (ω) = f(x(ω)), where f : R R is Borel measurable (the inverse image of a Borel set is a Borel set not a hard requirement to meet). In this case, for any Borel set B Y 1 (B) = (f(x)) 1 (B) = X 1 (f 1 (B)). As a really simple example, let f be the squaring function and let B = {4}. Then f 1 (B) = { 2, +2} and the level sets of X for 2 and +2 coalesce into a single level set for Y. 5
6 Sample problems. 1. Explain how to generate the interval (1, π] (a Borel set) from intervals of the form (, q) (with rational q). 6
7 2. Let Ω = {1,, 6}. Specify for me three subsets of Ω that are not pairwise disjoint and that do not generate the sigmafield 2 Ω. Dineen s example 4.10, which uses {1, 2}, {1, 4}, and {2, 3, 5}, meets these requirements. My task is to determine what sigmafield F is generated by your three sets. 3. Now specify a function X as a linear combination of indicator functions on your three subsets and I will write it as a linear combination of indicator functions for subsets that generate the sigmafield F. 7
8 Small group exercises. 1. The connection between measurable functions and sigmafields. (a) Let Ω = {1,, 8}, and let X = 21 {1,3,5} +1 {2,3,5,7} 1 {3,7,8}. Determine the sigmafield F X. (b) Let Ω = {1,, 9}, and let F be the sigmafield corresponding to the partition {1, 2}, {3}, {4, 5, 8}, {6, 7, 9}. Invent a function X that is F measurable, and write it as a linear combination of indicator functions. Then invent a function Y that is not Fmeasurable. (c) Let Ω = R and define X = 31 [0,6] 51 [4,8] + 21 [5,7]. Show that X is Borelmeasurable and find a finite partition of R that generates F X. 8
9 2. Proofs for Borel set and measurable functions. (a) Consider the function X : Ω R. Show that the collection of inverse images of Borel subsets of R under X meets all the requirements for a sigmafield. (b) Consider X : Ω R, and let F be a sigmafield on Ω. Show that if A is a collection of subsets that generates the Borel field and A A, X 1 (A) F, then X is Fmeasurable. (c) Prove that if F is a sigmafield on Ω that is generated by a countable partition (A n ), then a realvalued function X on Ω is Fmeasurable if and only if X is constant on each A n. 9
10 Homework problems. 1. Dineen, exercise Dineen, exercise Let Ω = {1, 10} and let X = 61 {1,3,5} + 31 {1,5,7,9} 1 {2,4,7,9} Write X in the form X = n i=1 a i1 Ai where, if i j, a i a j and A i A j =. Find F x. 10
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 5 9/17/2008 RANDOM VARIABLES
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 5 9/17/2008 RANDOM VARIABLES Contents 1. Random variables and measurable functions 2. Cumulative distribution functions 3. Discrete
More informationElementary Number Theory We begin with a bit of elementary number theory, which is concerned
CONSTRUCTION OF THE FINITE FIELDS Z p S. R. DOTY Elementary Number Theory We begin with a bit of elementary number theory, which is concerned solely with questions about the set of integers Z = {0, ±1,
More informationSo let us begin our quest to find the holy grail of real analysis.
1 Section 5.2 The Complete Ordered Field: Purpose of Section We present an axiomatic description of the real numbers as a complete ordered field. The axioms which describe the arithmetic of the real numbers
More informationCombinatorics: The Fine Art of Counting
Combinatorics: The Fine Art of Counting Week 7 Lecture Notes Discrete Probability Continued Note Binomial coefficients are written horizontally. The symbol ~ is used to mean approximately equal. The Bernoulli
More informationBasic concepts in probability. Sue Gordon
Mathematics Learning Centre Basic concepts in probability Sue Gordon c 2005 University of Sydney Mathematics Learning Centre, University of Sydney 1 1 Set Notation You may omit this section if you are
More informationMath212a1010 Lebesgue measure.
Math212a1010 Lebesgue measure. October 19, 2010 Today s lecture will be devoted to Lebesgue measure, a creation of Henri Lebesgue, in his thesis, one of the most famous theses in the history of mathematics.
More informationE3: PROBABILITY AND STATISTICS lecture notes
E3: PROBABILITY AND STATISTICS lecture notes 2 Contents 1 PROBABILITY THEORY 7 1.1 Experiments and random events............................ 7 1.2 Certain event. Impossible event............................
More informationProbability Theory. Florian Herzog. A random variable is neither random nor variable. GianCarlo Rota, M.I.T..
Probability Theory A random variable is neither random nor variable. GianCarlo Rota, M.I.T.. Florian Herzog 2013 Probability space Probability space A probability space W is a unique triple W = {Ω, F,
More informationPOWER SETS AND RELATIONS
POWER SETS AND RELATIONS L. MARIZZA A. BAILEY 1. The Power Set Now that we have defined sets as best we can, we can consider a sets of sets. If we were to assume nothing, except the existence of the empty
More informationMath/Stats 425 Introduction to Probability. 1. Uncertainty and the axioms of probability
Math/Stats 425 Introduction to Probability 1. Uncertainty and the axioms of probability Processes in the real world are random if outcomes cannot be predicted with certainty. Example: coin tossing, stock
More informationApplications of Methods of Proof
CHAPTER 4 Applications of Methods of Proof 1. Set Operations 1.1. Set Operations. The settheoretic operations, intersection, union, and complementation, defined in Chapter 1.1 Introduction to Sets are
More informationMATRIX ALGEBRA AND SYSTEMS OF EQUATIONS. + + x 2. x n. a 11 a 12 a 1n b 1 a 21 a 22 a 2n b 2 a 31 a 32 a 3n b 3. a m1 a m2 a mn b m
MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS 1. SYSTEMS OF EQUATIONS AND MATRICES 1.1. Representation of a linear system. The general system of m equations in n unknowns can be written a 11 x 1 + a 12 x 2 +
More informationP (A) = lim P (A) = N(A)/N,
1.1 Probability, Relative Frequency and Classical Definition. Probability is the study of random or nondeterministic experiments. Suppose an experiment can be repeated any number of times, so that we
More informationMATRIX ALGEBRA AND SYSTEMS OF EQUATIONS
MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS Systems of Equations and Matrices Representation of a linear system The general system of m equations in n unknowns can be written a x + a 2 x 2 + + a n x n b a
More informationBasic Probability Concepts
page 1 Chapter 1 Basic Probability Concepts 1.1 Sample and Event Spaces 1.1.1 Sample Space A probabilistic (or statistical) experiment has the following characteristics: (a) the set of all possible outcomes
More informationa 11 x 1 + a 12 x 2 + + a 1n x n = b 1 a 21 x 1 + a 22 x 2 + + a 2n x n = b 2.
Chapter 1 LINEAR EQUATIONS 1.1 Introduction to linear equations A linear equation in n unknowns x 1, x,, x n is an equation of the form a 1 x 1 + a x + + a n x n = b, where a 1, a,..., a n, b are given
More informationLEARNING OBJECTIVES FOR THIS CHAPTER
CHAPTER 2 American mathematician Paul Halmos (1916 2006), who in 1942 published the first modern linear algebra book. The title of Halmos s book was the same as the title of this chapter. FiniteDimensional
More informationDiscrete Mathematics and Probability Theory Fall 2009 Satish Rao,David Tse Note 11
CS 70 Discrete Mathematics and Probability Theory Fall 2009 Satish Rao,David Tse Note Conditional Probability A pharmaceutical company is marketing a new test for a certain medical condition. According
More informationIAM 530 ELEMENTS OF PROBABILITY AND STATISTICS INTRODUCTION
IAM 530 ELEMENTS OF PROBABILITY AND STATISTICS INTRODUCTION 1 WHAT IS STATISTICS? Statistics is a science of collecting data, organizing and describing it and drawing conclusions from it. That is, statistics
More informationLecture Note 1 Set and Probability Theory. MIT 14.30 Spring 2006 Herman Bennett
Lecture Note 1 Set and Probability Theory MIT 14.30 Spring 2006 Herman Bennett 1 Set Theory 1.1 Definitions and Theorems 1. Experiment: any action or process whose outcome is subject to uncertainty. 2.
More informationDiscrete Mathematics: Solutions to Homework (12%) For each of the following sets, determine whether {2} is an element of that set.
Discrete Mathematics: Solutions to Homework 2 1. (12%) For each of the following sets, determine whether {2} is an element of that set. (a) {x R x is an integer greater than 1} (b) {x R x is the square
More information1. LINEAR EQUATIONS. A linear equation in n unknowns x 1, x 2,, x n is an equation of the form
1. LINEAR EQUATIONS A linear equation in n unknowns x 1, x 2,, x n is an equation of the form a 1 x 1 + a 2 x 2 + + a n x n = b, where a 1, a 2,..., a n, b are given real numbers. For example, with x and
More informationLecture 7: Continuous Random Variables
Lecture 7: Continuous Random Variables 21 September 2005 1 Our First Continuous Random Variable The back of the lecture hall is roughly 10 meters across. Suppose it were exactly 10 meters, and consider
More informationREAL ANALYSIS LECTURE NOTES: 1.4 OUTER MEASURE
REAL ANALYSIS LECTURE NOTES: 1.4 OUTER MEASURE CHRISTOPHER HEIL 1.4.1 Introduction We will expand on Section 1.4 of Folland s text, which covers abstract outer measures also called exterior measures).
More informationCHAPTER 5. Product Measures
54 CHAPTER 5 Product Measures Given two measure spaces, we may construct a natural measure on their Cartesian product; the prototype is the construction of Lebesgue measure on R 2 as the product of Lebesgue
More informationStudy Manual for Exam P/Exam 1. Probability
Study Manual for Exam P/Exam 1 Probability Eleventh Edition by Krzysztof Ostaszewski Ph.D., F.S.A., CFA, M.A.A.A. Note: NO RETURN IF OPENED TO OUR READERS: Please check A.S.M. s web site at www.studymanuals.com
More informationSections 2.1, 2.2 and 2.4
SETS Sections 2.1, 2.2 and 2.4 Chapter Summary Sets The Language of Sets Set Operations Set Identities Introduction Sets are one of the basic building blocks for the types of objects considered in discrete
More information1, 1 2, 1 3, 1 4,... 2 nd term. 1 st term
1 Sequences 11 Overview A (numerical) sequence is a list of real numbers in which each entry is a function of its position in the list The entries in the list are called terms For example, 1, 1, 1 3, 1
More informationBasic Concepts of Point Set Topology Notes for OU course Math 4853 Spring 2011
Basic Concepts of Point Set Topology Notes for OU course Math 4853 Spring 2011 A. Miller 1. Introduction. The definitions of metric space and topological space were developed in the early 1900 s, largely
More informationMATH10212 Linear Algebra. Systems of Linear Equations. Definition. An ndimensional vector is a row or a column of n numbers (or letters): a 1.
MATH10212 Linear Algebra Textbook: D. Poole, Linear Algebra: A Modern Introduction. Thompson, 2006. ISBN 0534405967. Systems of Linear Equations Definition. An ndimensional vector is a row or a column
More informationMathematics Review for MS Finance Students
Mathematics Review for MS Finance Students Anthony M. Marino Department of Finance and Business Economics Marshall School of Business Lecture 1: Introductory Material Sets The Real Number System Functions,
More informationA Little Set Theory (Never Hurt Anybody)
A Little Set Theory (Never Hurt Anybody) Matthew Saltzman Department of Mathematical Sciences Clemson University Draft: August 21, 2013 1 Introduction The fundamental ideas of set theory and the algebra
More informationThe Inverse of a Square Matrix
These notes closely follow the presentation of the material given in David C Lay s textbook Linear Algebra and its Applications (3rd edition) These notes are intended primarily for inclass presentation
More informationThe Language of Mathematics
CHPTER 2 The Language of Mathematics 2.1. Set Theory 2.1.1. Sets. set is a collection of objects, called elements of the set. set can be represented by listing its elements between braces: = {1, 2, 3,
More informationWe now explore a third method of proof: proof by contradiction.
CHAPTER 6 Proof by Contradiction We now explore a third method of proof: proof by contradiction. This method is not limited to proving just conditional statements it can be used to prove any kind of statement
More information1. The algebra of exponents 1.1. Natural Number Powers. It is easy to say what is meant by a n a (raised to) to the (power) n if n N.
CHAPTER 3: EXPONENTS AND POWER FUNCTIONS 1. The algebra of exponents 1.1. Natural Number Powers. It is easy to say what is meant by a n a (raised to) to the (power) n if n N. For example: In general, if
More informationSOLUTIONS TO ASSIGNMENT 1 MATH 576
SOLUTIONS TO ASSIGNMENT 1 MATH 576 SOLUTIONS BY OLIVIER MARTIN 13 #5. Let T be the topology generated by A on X. We want to show T = J B J where B is the set of all topologies J on X with A J. This amounts
More information1. Prove that the empty set is a subset of every set.
1. Prove that the empty set is a subset of every set. Basic Topology Written by MenGen Tsai email: b89902089@ntu.edu.tw Proof: For any element x of the empty set, x is also an element of every set since
More informationCardinality. The set of all finite strings over the alphabet of lowercase letters is countable. The set of real numbers R is an uncountable set.
Section 2.5 Cardinality (another) Definition: The cardinality of a set A is equal to the cardinality of a set B, denoted A = B, if and only if there is a bijection from A to B. If there is an injection
More informationNormal distribution. ) 2 /2σ. 2π σ
Normal distribution The normal distribution is the most widely known and used of all distributions. Because the normal distribution approximates many natural phenomena so well, it has developed into a
More informationINTRODUCTORY SET THEORY
M.Sc. program in mathematics INTRODUCTORY SET THEORY Katalin Károlyi Department of Applied Analysis, Eötvös Loránd University H1088 Budapest, Múzeum krt. 68. CONTENTS 1. SETS Set, equal sets, subset,
More informationCmSc 175 Discrete Mathematics Lesson 10: SETS A B, A B
CmSc 175 Discrete Mathematics Lesson 10: SETS Sets: finite, infinite, : empty set, U : universal set Describing a set: Enumeration = {a, b, c} Predicates = {x P(x)} Recursive definition, e.g. sequences
More informationCHAPTER 3 Numbers and Numeral Systems
CHAPTER 3 Numbers and Numeral Systems Numbers play an important role in almost all areas of mathematics, not least in calculus. Virtually all calculus books contain a thorough description of the natural,
More informationContinued Fractions and the Euclidean Algorithm
Continued Fractions and the Euclidean Algorithm Lecture notes prepared for MATH 326, Spring 997 Department of Mathematics and Statistics University at Albany William F Hammond Table of Contents Introduction
More informationNotes on counting finite sets
Notes on counting finite sets Murray Eisenberg February 26, 2009 Contents 0 Introduction 2 1 What is a finite set? 2 2 Counting unions and cartesian products 4 2.1 Sum rules......................................
More informationMarkov random fields and Gibbs measures
Chapter Markov random fields and Gibbs measures 1. Conditional independence Suppose X i is a random element of (X i, B i ), for i = 1, 2, 3, with all X i defined on the same probability space (.F, P).
More informationAnnouncements. CompSci 230 Discrete Math for Computer Science Sets. Introduction to Sets. Sets
CompSci 230 Discrete Math for Computer Science Sets September 12, 2013 Prof. Rodger Slides modified from Rosen 1 nnouncements Read for next time Chap. 2.32.6 Homework 2 due Tuesday Recitation 3 on Friday
More informationChapter 2: Systems of Linear Equations and Matrices:
At the end of the lesson, you should be able to: Chapter 2: Systems of Linear Equations and Matrices: 2.1: Solutions of Linear Systems by the Echelon Method Define linear systems, unique solution, inconsistent,
More informationMath 4310 Handout  Quotient Vector Spaces
Math 4310 Handout  Quotient Vector Spaces Dan Collins The textbook defines a subspace of a vector space in Chapter 4, but it avoids ever discussing the notion of a quotient space. This is understandable
More information1 if 1 x 0 1 if 0 x 1
Chapter 3 Continuity In this chapter we begin by defining the fundamental notion of continuity for real valued functions of a single real variable. When trying to decide whether a given function is or
More informationLecture 13  Basic Number Theory.
Lecture 13  Basic Number Theory. Boaz Barak March 22, 2010 Divisibility and primes Unless mentioned otherwise throughout this lecture all numbers are nonnegative integers. We say that A divides B, denoted
More informationLecture 1 Introduction Properties of Probability Methods of Enumeration Asrat Temesgen Stockholm University
Lecture 1 Introduction Properties of Probability Methods of Enumeration Asrat Temesgen Stockholm University 1 Chapter 1 Probability 1.1 Basic Concepts In the study of statistics, we consider experiments
More informationFoundations of Mathematics I Set Theory (only a draft)
Foundations of Mathematics I Set Theory (only a draft) Ali Nesin Mathematics Department Istanbul Bilgi University Kuştepe Şişli Istanbul Turkey anesin@bilgi.edu.tr February 12, 2004 2 Contents I Naive
More informationOur goal first will be to define a product measure on A 1 A 2.
1. Tensor product of measures and Fubini theorem. Let (A j, Ω j, µ j ), j = 1, 2, be two measure spaces. Recall that the new σ algebra A 1 A 2 with the unit element is the σ algebra generated by the
More information3 Some Integer Functions
3 Some Integer Functions A Pair of Fundamental Integer Functions The integer function that is the heart of this section is the modulo function. However, before getting to it, let us look at some very simple
More informationChapter 4. Probability and Probability Distributions
Chapter 4. robability and robability Distributions Importance of Knowing robability To know whether a sample is not identical to the population from which it was selected, it is necessary to assess the
More informationDiscrete Mathematics and Probability Theory Fall 2009 Satish Rao, David Tse Note 13. Random Variables: Distribution and Expectation
CS 70 Discrete Mathematics and Probability Theory Fall 2009 Satish Rao, David Tse Note 3 Random Variables: Distribution and Expectation Random Variables Question: The homeworks of 20 students are collected
More informationStudy Manual for Exam P/Exam 1. Probability
Study Manual for Exam P/Exam 1 Probability Seventh Edition by Krzysztof Ostaszewski Ph.D., F.S.A., CFA, M.A.A.A. Note: NO RETURN IF OPENED TO OUR READERS: Please check A.S.M. s web site at www.studymanuals.com
More informationSets and set operations
CS 441 Discrete Mathematics for CS Lecture 7 Sets and set operations Milos Hauskrecht milos@cs.pitt.edu 5329 Sennott Square asic discrete structures Discrete math = study of the discrete structures used
More information3. Mathematical Induction
3. MATHEMATICAL INDUCTION 83 3. Mathematical Induction 3.1. First Principle of Mathematical Induction. Let P (n) be a predicate with domain of discourse (over) the natural numbers N = {0, 1,,...}. If (1)
More informationMathematical Methods of Engineering Analysis
Mathematical Methods of Engineering Analysis Erhan Çinlar Robert J. Vanderbei February 2, 2000 Contents Sets and Functions 1 1 Sets................................... 1 Subsets.............................
More informationLESSON SUMMARY. Set Operations and Venn Diagrams
LESSON SUMMARY CXC CSEC MATHEMATICS UNIT Three: Set Theory Lesson 4 Set Operations and Venn Diagrams Textbook: Mathematics, A Complete Course by Raymond Toolsie, Volumes 1 and 2. (Some helpful exercises
More informationPattern Recognition. Probability Theory
Pattern Recognition Probability Theory Probability Space 2 is a threetuple with: the set of elementary events algebra probability measure algebra over is a system of subsets, i.e. ( is the power set)
More informationWe give a basic overview of the mathematical background required for this course.
1 Background We give a basic overview of the mathematical background required for this course. 1.1 Set Theory We introduce some concepts from naive set theory (as opposed to axiomatic set theory). The
More information1 Sets and Set Notation.
LINEAR ALGEBRA MATH 27.6 SPRING 23 (COHEN) LECTURE NOTES Sets and Set Notation. Definition (Naive Definition of a Set). A set is any collection of objects, called the elements of that set. We will most
More information3. Equivalence Relations. Discussion
3. EQUIVALENCE RELATIONS 33 3. Equivalence Relations 3.1. Definition of an Equivalence Relations. Definition 3.1.1. A relation R on a set A is an equivalence relation if and only if R is reflexive, symmetric,
More informationChapter 3: The basic concepts of probability
Chapter 3: The basic concepts of probability Experiment: a measurement process that produces quantifiable results (e.g. throwing two dice, dealing cards, at poker, measuring heights of people, recording
More informationMathematical Induction
Mathematical Induction (Handout March 8, 01) The Principle of Mathematical Induction provides a means to prove infinitely many statements all at once The principle is logical rather than strictly mathematical,
More informationChapter 4 Lecture Notes
Chapter 4 Lecture Notes Random Variables October 27, 2015 1 Section 4.1 Random Variables A random variable is typically a realvalued function defined on the sample space of some experiment. For instance,
More informationThe basic unit in matrix algebra is a matrix, generally expressed as: a 11 a 12. a 13 A = a 21 a 22 a 23
(copyright by Scott M Lynch, February 2003) Brief Matrix Algebra Review (Soc 504) Matrix algebra is a form of mathematics that allows compact notation for, and mathematical manipulation of, highdimensional
More informationThis chapter is all about cardinality of sets. At first this looks like a
CHAPTER Cardinality of Sets This chapter is all about cardinality of sets At first this looks like a very simple concept To find the cardinality of a set, just count its elements If A = { a, b, c, d },
More informationIntroduction to probability theory in the Discrete Mathematics course
Introduction to probability theory in the Discrete Mathematics course Jiří Matoušek (KAM MFF UK) Version: Oct/18/2013 Introduction This detailed syllabus contains definitions, statements of the main results
More informationMathematics for Econometrics, Fourth Edition
Mathematics for Econometrics, Fourth Edition Phoebus J. Dhrymes 1 July 2012 1 c Phoebus J. Dhrymes, 2012. Preliminary material; not to be cited or disseminated without the author s permission. 2 Contents
More informationNotes on Complexity Theory Last updated: August, 2011. Lecture 1
Notes on Complexity Theory Last updated: August, 2011 Jonathan Katz Lecture 1 1 Turing Machines I assume that most students have encountered Turing machines before. (Students who have not may want to look
More informationWorksheet for Teaching Module Probability (Lesson 1)
Worksheet for Teaching Module Probability (Lesson 1) Topic: Basic Concepts and Definitions Equipment needed for each student 1 computer with internet connection Introduction In the regular lectures in
More informationTaylor Polynomials and Taylor Series Math 126
Taylor Polynomials and Taylor Series Math 26 In many problems in science and engineering we have a function f(x) which is too complicated to answer the questions we d like to ask. In this chapter, we will
More information6.3 Conditional Probability and Independence
222 CHAPTER 6. PROBABILITY 6.3 Conditional Probability and Independence Conditional Probability Two cubical dice each have a triangle painted on one side, a circle painted on two sides and a square painted
More informationMathematical Background
Appendix A Mathematical Background A.1 Joint, Marginal and Conditional Probability Let the n (discrete or continuous) random variables y 1,..., y n have a joint joint probability probability p(y 1,...,
More informationAn example of a computable
An example of a computable absolutely normal number Verónica Becher Santiago Figueira Abstract The first example of an absolutely normal number was given by Sierpinski in 96, twenty years before the concept
More informationExtension of measure
1 Extension of measure Sayan Mukherjee Dynkin s π λ theorem We will soon need to define probability measures on infinite and possible uncountable sets, like the power set of the naturals. This is hard.
More information, for x = 0, 1, 2, 3,... (4.1) (1 + 1/n) n = 2.71828... b x /x! = e b, x=0
Chapter 4 The Poisson Distribution 4.1 The Fish Distribution? The Poisson distribution is named after SimeonDenis Poisson (1781 1840). In addition, poisson is French for fish. In this chapter we will
More information4. MATRICES Matrices
4. MATRICES 170 4. Matrices 4.1. Definitions. Definition 4.1.1. A matrix is a rectangular array of numbers. A matrix with m rows and n columns is said to have dimension m n and may be represented as follows:
More informationLinear Algebra I. Ronald van Luijk, 2012
Linear Algebra I Ronald van Luijk, 2012 With many parts from Linear Algebra I by Michael Stoll, 2007 Contents 1. Vector spaces 3 1.1. Examples 3 1.2. Fields 4 1.3. The field of complex numbers. 6 1.4.
More informationCHAPTER 3. Methods of Proofs. 1. Logical Arguments and Formal Proofs
CHAPTER 3 Methods of Proofs 1. Logical Arguments and Formal Proofs 1.1. Basic Terminology. An axiom is a statement that is given to be true. A rule of inference is a logical rule that is used to deduce
More informationMetric Spaces Joseph Muscat 2003 (Last revised May 2009)
1 Distance J Muscat 1 Metric Spaces Joseph Muscat 2003 (Last revised May 2009) (A revised and expanded version of these notes are now published by Springer.) 1 Distance A metric space can be thought of
More informationFinite and discrete probability distributions
8 Finite and discrete probability distributions To understand the algorithmic aspects of number theory and algebra, and applications such as cryptography, a firm grasp of the basics of probability theory
More informationRecursion Theory in Set Theory
Contemporary Mathematics Recursion Theory in Set Theory Theodore A. Slaman 1. Introduction Our goal is to convince the reader that recursion theoretic knowledge and experience can be successfully applied
More informationMathematics Course 111: Algebra I Part IV: Vector Spaces
Mathematics Course 111: Algebra I Part IV: Vector Spaces D. R. Wilkins Academic Year 19967 9 Vector Spaces A vector space over some field K is an algebraic structure consisting of a set V on which are
More informationSOLUTIONS TO EXERCISES FOR. MATHEMATICS 205A Part 3. Spaces with special properties
SOLUTIONS TO EXERCISES FOR MATHEMATICS 205A Part 3 Fall 2008 III. Spaces with special properties III.1 : Compact spaces I Problems from Munkres, 26, pp. 170 172 3. Show that a finite union of compact subspaces
More informationELEMENTARY PROBABILITY
ELEMENTARY PROBABILITY Events and event sets. Consider tossing a die. There are six possible outcomes, which we shall denote by elements of the set {A i ; i =1, 2,...,6}. A numerical value is assigned
More informationChapter 10. Abstract algebra
Chapter 10. Abstract algebra C.O.S. Sorzano Biomedical Engineering December 17, 2013 10. Abstract algebra December 17, 2013 1 / 62 Outline 10 Abstract algebra Sets Relations and functions Partitions and
More information2. Methods of Proof Types of Proofs. Suppose we wish to prove an implication p q. Here are some strategies we have available to try.
2. METHODS OF PROOF 69 2. Methods of Proof 2.1. Types of Proofs. Suppose we wish to prove an implication p q. Here are some strategies we have available to try. Trivial Proof: If we know q is true then
More informationFUNCTIONAL ANALYSIS LECTURE NOTES: QUOTIENT SPACES
FUNCTIONAL ANALYSIS LECTURE NOTES: QUOTIENT SPACES CHRISTOPHER HEIL 1. Cosets and the Quotient Space Any vector space is an abelian group under the operation of vector addition. So, if you are have studied
More informationChapter 7  Roots, Radicals, and Complex Numbers
Math 233  Spring 2009 Chapter 7  Roots, Radicals, and Complex Numbers 7.1 Roots and Radicals 7.1.1 Notation and Terminology In the expression x the is called the radical sign. The expression under the
More information4.1. Definitions. A set may be viewed as any well defined collection of objects, called elements or members of the set.
Section 4. Set Theory 4.1. Definitions A set may be viewed as any well defined collection of objects, called elements or members of the set. Sets are usually denoted with upper case letters, A, B, X, Y,
More informationRi and. i=1. S i N. and. R R i
The subset R of R n is a closed rectangle if there are n nonempty closed intervals {[a 1, b 1 ], [a 2, b 2 ],..., [a n, b n ]} so that R = [a 1, b 1 ] [a 2, b 2 ] [a n, b n ]. The subset R of R n is an
More information0 0 such that f x L whenever x a
EpsilonDelta Definition of the Limit Few statements in elementary mathematics appear as cryptic as the one defining the limit of a function f() at the point = a, 0 0 such that f L whenever a Translation:
More informationCS 3719 (Theory of Computation and Algorithms) Lecture 4
CS 3719 (Theory of Computation and Algorithms) Lecture 4 Antonina Kolokolova January 18, 2012 1 Undecidable languages 1.1 ChurchTuring thesis Let s recap how it all started. In 1990, Hilbert stated a
More informationInformation Theory and Coding Prof. S. N. Merchant Department of Electrical Engineering Indian Institute of Technology, Bombay
Information Theory and Coding Prof. S. N. Merchant Department of Electrical Engineering Indian Institute of Technology, Bombay Lecture  17 ShannonFanoElias Coding and Introduction to Arithmetic Coding
More informationTOPIC 3: CONTINUITY OF FUNCTIONS
TOPIC 3: CONTINUITY OF FUNCTIONS. Absolute value We work in the field of real numbers, R. For the study of the properties of functions we need the concept of absolute value of a number. Definition.. Let
More information