Bayesian Updating with Continuous Priors Class 13, 18.05, Spring 2014 Jeremy Orloff and Jonathan Bloom


 Ashlyn Norris
 2 years ago
 Views:
Transcription
1 Byesin Updting with Continuous Priors Clss 3, 8.05, Spring 04 Jeremy Orloff nd Jonthn Bloom Lerning Gols. Understnd prmeterized fmily of distriutions s representing continuous rnge of hypotheses for the oserved dt.. Be le to pply Byes theorem to updte prior pdf to posterior pdf given dt nd likelihood function. 3. Be le to interpret nd compute proilities using the posterior. Introduction Up to now we hve only done Byesin updting when we hd finite numer of hypothesis, e.g. our dice emple hd five hypotheses (4, 6, 8, or 0 sides). Now we will study Byesin updting when there is continuous rnge of hypothesis. The Byesin updte process will e essentilly the sme s in the discrete cse. As usul when moving from discrete to continuous we will need to replce pmf y pdf nd sums y integrls. Here re three stndrd emples with continuous rnges of hypotheses. Emple. Suppose you hve system tht cn succeed or fil with proility p. Then we cn hypothesize tht p is nywhere in the rnge [0, ]. Tht is, we hve continuous rnge of hypotheses. We will often model this emple with ent coin with unknown proility p of heds. Emple. The lifetime of certin isotope is modeled y n eponentil distriution ep(λ). In principl, the men lifetime /λ cn e ny rel numer in (0, ). Emple 3. We re not restricted to single prmeter. In principle, the prmeters μ nd σ of norml distriution cn e ny rel numers in (, )nd (0, ), respectively. If we model gesttionl length for single irths y norml distriution, then from millions of dt points we know tht μ is out 40 weeks nd σ is out one week. In ll of these emples hypothesis is model for the rndom process giving rise to the dt (successes nd filures, tomic lifetimes, gesttionl lengths). If we specify prmeterized fmily of distriutions, then hypothesis my e regrded s choice of prmeter(s). 3 Nottionl conventions 3. Prmetrized models As in the emples ove our hypotheses will often tke the form certin prmeter hs vlue θ. We will often use the letter θ to stnd for n ritrry hypothesis. This will leve
2 8.05 clss 3, Byesin Updting with Continuous Priors, Spring 04 symols like p, f, nd to tke there usul menings s pmf, pdf, nd dt. Rther thn sying the hypothesis tht the prmeter of interest hs vlue θ we will sy simply the hypothesis θ. 3. Big nd little letters We hve two prllel nottions for outcomes nd proility.. Event A, proility function P (A).. Vlue, pmf p() or pdf f(). These nottions re relted y P (X = ) = p(), where is vlue the discrete rndom vrile X nd X = is the corresponding event. We crry these nottions over to the conditionl proilities used in Byesin updting.. Hypotheses H nd dt D hve ssocited proilities P (H), P (D), P (H D), P (D H). In the coin emple we might hve H = the chosen coin hs proility.6 of heds, D = the flip ws heds, nd P (D H) =.6. Hypotheses (vlues) θ nd dt vlues hve proilities or proility densities: p(θ) p() p(θ ) p( θ) f(θ) f() f(θ ) f( θ) In the coin emple we might hve θ =.6 nd =, so p( θ) =.6. We might lso write p( = θ =.6) to emphsize the vlues of nd θ, ut we will never just write p(.6) since here its uncler which vlue is nd which is θ. Although we will still use oth types of nottion, we will mostly use the type involving pmf s nd pdf s from now on. Hypotheses will usully e prmeters represented y Greek letters (θ, λ, µ, σ,... ) while dt vlues will usully e represented y English letters (, i, y,... ). 4 Quick review of pdf nd proility Suppose X is rndom vrile with pdf f(). proility/(units of ). f() Recll f() is ; its units re f() proility f()d P (c X d) c d d The proility tht the vlue of X is in [c, d] is given y d f() d. c
3 8.05 clss 3, Byesin Updting with Continuous Priors, Spring 04 3 The proility tht X is in n infitesiml rnge d round is f() d. In fct, the integrl formul is just the sum of these infinitesiml proilities. We cn visulize these proilities y viewing the integrl s re under the grph of f(). In order to mnipulte proilities insted of densities, in wht follows we will mke frequent use of the notion tht f() d is the proility tht X is in n infinitesiml rnge round of width d. Plese mke sure tht you fully understnd this notion. 5 Byesin updting with continuous priors The tle for continuous priors is very simple. We cnnot hve row for ech of n infinite numer of hypotheses, so insted we hve just one row with vrile hypothesis θ. After lying out this tle, we will eplin how it rises nturlly y refining our tle for finite numer of hypotheses s the numer of hypotheses grows to infinity. In cses with discrete set of hypotheses we hd prior proility for ech hypothesis. Now suppose our hypotheses re tht the vlue of the prmeter θ lies in the rnge [, ]. In this cse we need prior pdf f(θ) which gives proility t ech hypothesis θ. In order to use proilities we will use infinitesiml rnges nd stte our hypothesis s: We cn then write The prmeter lies in rnge dθ round θ. H : θ ± dθ/, P (H) = f(θ) dθ. This is little cumersome nd it is esy to e sloppy. The dvntge of this nottion is twofold. First using dθ will provide clue s to when you need to do n integrl. Second, when it comes to simulting with computer it tells you ectly how to discretize your model. For tody we will ssume tht our dt cn only tke discrete set of vlues. In this cse our given dt nd hypothesis θ the likelihood function is p( θ), i.e. the proility of given θ. Net time we will consider continuous dt distriutions where our likelihood will hve the form f( θ) d. Our tle ecomes unnormlized hypothesis prior likelihood posterior posterior θ ± dθ/ f(θ) dθ p( θ) p( θ)f(θ) dθ p( θ)f(θ) dθ T totl f(θ) dθ = T = p( θ)f(θ) dθ Notes:. The sum T of the unnormlized posterior column is given y n integrl. In prctice, computing this integrl is difficult nd est left to computers to do numericlly.. By including dθ, ll the entries in the tle re proilities. The posterior pdf for θ is found y removing the dθ: f(θ ) = p( θ) f(θ) T 3. If the unnormlized posterior turns out to e multiple of fmilir type of distriution, then we cn often void computing T. We will see severl such emples in 8.05.
4 8.05 clss 3, Byesin Updting with Continuous Priors, Spring T = p(), the prior predictive proility of, i.e. the priori proility of oserving. By the lw of totl proility (see section elow), p() is weighted verge of likelihoods over ll hypotheses: p() = p( θ)f(θ) dθ. p( θ) f(θ) p( θ) f(θ) f(θ ) = = p( θ)f(θ) dθ p() unnormlized hypothesis prior likelihood posterior posterior θ ± dθ/ dθ θ θ dθ θdθ totl f(θ) dθ = T = θdθ =/ 0 Therefore the posterior pdf (fter seeing heds) is f(θ ) =θ. 5. With dθ removed, the tle orgnizes the continuous version of Byes theorem. Nmely, the posterior pdf is relted to the prior pdf nd likelihood function vi: Regrding oth sides s functions of θ, we cn gin epress Byes theorem in the form: f(θ ) p( θ) f(θ) 6. The use of θ ± dθ/ for hypotheses gets little tedious. At times we my llow ourselves to e it sloppy nd just write θ, ut we will still men θ ± dθ/ Emple 4. Coin with flt prior. Suppose we hve ent coin with unknown proility θ of heds. Also suppose we flip the coin once nd get heds. Strting from flt prior pdf compute the posterior pdf for θ. nswer: By flt prior we men f(θ) = on [0, ]; tht is, we ssume the true proility of heds is eqully likely to e ny proility. As we usully do with coin flips we let = for heds. In this cse the definition of θ sys the likelihood p( θ) = θ. We get the following tle: 5. From discrete to continuous Byesin updting To develop intuition for the trnsition from discrete to continuous Byesin updting, we ll wlk fmilir rod from clculus. Nmely we will: i) pproimte the continuous rnge of hypotheses y finite numer. ii) crete the discrete updting tle for the finite numer of hypotheses. iii) consider how the tle chnges s the numer of hypotheses goes to infinity. In this wy, will see the prior nd posterior pmf s converge to the prior nd posterior pdf s. Emple 5. To keep things concrete, we will work with the ent coin in Emple 4. We strt y slicing [0, ] into 4 equl intervls: [0, /4], [/4, /], [/, 3/4], [3/4, ]. Ech slice hs width Δθ = /4. We put our 4 hypotheses θ i t the centers of the four slices: θ : θ = /8, θ : θ = 3/8, θ 3 : θ = 5/8, θ 4 : θ = 7/8.
5 8.05 clss 3, Byesin Updting with Continuous Priors, Spring 04 5 The flt prior gives ech hypothesis proility of /4 = θ. We hve the tle: hypothesis prior likelihood un. posterior posterior θ = /8 /4 /8 (/4) (/8) /6 θ = 3/8 /4 3/8 (/4) (3/8) 3/6 θ = 5/8 /4 5/8 (/4) (5/8) 5/6 θ = 7/8 /4 7/8 (/4) (7/8) 7/6 Totl n θ i θ i= Here re the histogrms of the prior nd posterior pmf. The prior nd posterior pdfs from Emple 4 re superimposed on the histogrms in red. /8 3/8 5/8 7/8 /8 3/8 5/8 7/8 Net we slice [0,] into 8 intervls ech of width θ = /8 nd use the center of ech slice for our 8 hypotheses θ i. θ : θ = /6, θ : θ = 3/6, θ 3 : θ = 5/6, θ 4 : θ = 7/6 θ 5 : θ = 9/6, θ 6 : θ = /6, θ 7 : θ = 3/6, θ 8 : θ = 5/6 The flt prior gives ech hypothesis the prolility /8 = θ. Here re the tle nd histogrms. hypothesis prior likelihood un. posterior posterior θ = /6 /8 /6 (/8) (/6) /64 θ = 3/6 /8 3/6 (/8) (3/6) 3/64 θ = 5/6 /8 5/6 (/8) (5/6) 5/64 θ = 7/6 /8 7/6 (/8) (7/6) 7/64 θ = 9/6 /8 9/6 (/8) (9/6) 9/64 θ = /6 /8 /6 (/8) (/6) /64 θ = 3/6 /8 3/6 (/8) (3/6) 3/64 θ = 5/6 /8 5/6 (/8) (5/6) 5/64 n Totl θ i θ i=
6 8.05 clss 3, Byesin Updting with Continuous Priors, Spring 04 6 /6 3/6 5/6 7/6 9/6 /6 3/6 5/6 /6 3/6 5/6 7/6 9/6 /6 3/6 5/6 Finlly we slice [0,] into 0 pieces. This is essentilly identicl to the previous two cses. Let s skip right to the histogrms. Looking t the sequence of plots we see how the prior nd posterior histogrms converge to the prior nd posterior proility functions. 5. Using the posterior pdf Emple 6. In Emple 4, fter oserving one heds, wht is the (posterior) proility tht the coin is ised towrds heds? nswer: Since the prmeter θ is the proility the coin lnds heds, the prolem sks for P (θ > ). This is esily computed from the posterior pdf. P (θ > ) = f(θ ) dθ = θ dθ = θ = 4 3. This cn e compred with the prior proility tht the coin is ised towrds heds: P (θ > ) = f(θ) dθ =. 5 dθ = θ =. We see tht oserving one heds hs incresed the proility tht the coin is ised towrds heds from / to 3/4. 6 The lw of totl proility Recll tht for discrete hypotheses H, H,... H n the lw of totl proility sys the prior proility of dt D is n P (D) = P ( D H i )P (H i ). i=
7 8.05 clss 3, Byesin Updting with Continuous Priors, Spring 04 7 This is the prior proility of D ecuse we used the prior proility P (H i )Ifinsted we use the vlues, θ,θ,...,θ n for hypotheses nd for dt then this is written n p( )= p( θ i, )p(θ i ). i= p() = p( )= n p() = p( θ i )p(θ i ). i= We cll this the prior predictive proility of to distinguish it from the prior proility of θ. Suppose we then collect dt. Assuming dt nd re conditionlly independent (i.e., they re independent if we condition on hypothesis) then we cn replce the prior proility for θ y the posterior p(θ )toget the posterior predictive proility of given : n p( )= p( θ i )p(θ i ). i= If nd re not conditionlly independent then the proility of lso needs to e conditioned on. We get the somewht more complicted formul for the posterior predictive proility of given :(This is not something we will see in 8.05.) Likewise for continuous priors nd posteriors over the rnge [, ] nd discrete dt we hve p( θ)f(θ) dθ nd (ssuming nd re conditionlly independent) p( θ)f(θ ) dθ. Emple 7. In Emple 4, compute the prior predictive nd posterior predictive proility of heds on the second toss (i.e., prior nd posterior to tking into ccount tht the first toss ws heds). nswer: The prior predictive proility of = is p( )= p( θ) f(θ) dθ = θ dθ = dθ = The posterior predictive proility of = given = is p( )= p( θ) f(θ ) dθ = θ θdθ = θ dθ = =. 3 3 θ We see tht oserving heds on the first toss hs incresed the proility of heds on the second toss from / to /3.
8 MIT OpenCourseWre Introduction to Proility nd Sttistics Spring 04 For informtion out citing these mterils or our Terms of Use, visit:
Lecture 3 Gaussian Probability Distribution
Lecture 3 Gussin Probbility Distribution Introduction l Gussin probbility distribution is perhps the most used distribution in ll of science. u lso clled bell shped curve or norml distribution l Unlike
More informationLecture 3 Basic Probability and Statistics
Lecture 3 Bsic Probbility nd Sttistics The im of this lecture is to provide n extremely speedy introduction to the probbility nd sttistics which will be needed for the rest of this lecture course. The
More information10.5 Graphing Quadratic Functions
0.5 Grphing Qudrtic Functions Now tht we cn solve qudrtic equtions, we wnt to lern how to grph the function ssocited with the qudrtic eqution. We cll this the qudrtic function. Grphs of Qudrtic Functions
More informationAppendix D: Completing the Square and the Quadratic Formula. In Appendix A, two special cases of expanding brackets were considered:
Appendi D: Completing the Squre nd the Qudrtic Formul Fctoring qudrtic epressions such s: + 6 + 8 ws one of the topics introduced in Appendi C. Fctoring qudrtic epressions is useful skill tht cn help you
More informationExample A rectangular box without lid is to be made from a square cardboard of sides 18 cm by cutting equal squares from each corner and then folding
1 Exmple A rectngulr box without lid is to be mde from squre crdbord of sides 18 cm by cutting equl squres from ech corner nd then folding up the sides. 1 Exmple A rectngulr box without lid is to be mde
More informationReasoning to Solve Equations and Inequalities
Lesson4 Resoning to Solve Equtions nd Inequlities In erlier work in this unit, you modeled situtions with severl vriles nd equtions. For exmple, suppose you were given usiness plns for concert showing
More information9 CONTINUOUS DISTRIBUTIONS
9 CONTINUOUS DISTIBUTIONS A rndom vrible whose vlue my fll nywhere in rnge of vlues is continuous rndom vrible nd will be ssocited with some continuous distribution. Continuous distributions re to discrete
More informationHomework 3 Solutions
CS 341: Foundtions of Computer Science II Prof. Mrvin Nkym Homework 3 Solutions 1. Give NFAs with the specified numer of sttes recognizing ech of the following lnguges. In ll cses, the lphet is Σ = {,1}.
More informationOr more simply put, when adding or subtracting quantities, their uncertainties add.
Propgtion of Uncertint through Mthemticl Opertions Since the untit of interest in n eperiment is rrel otined mesuring tht untit directl, we must understnd how error propgtes when mthemticl opertions re
More informationSo there are two points of intersection, one being x = 0, y = 0 2 = 0 and the other being x = 2, y = 2 2 = 4. y = x 2 (2,4)
Ares The motivtion for our definition of integrl ws the problem of finding the re between some curve nd the is for running between two specified vlues. We pproimted the region b union of thin rectngles
More informationEQUATIONS OF LINES AND PLANES
EQUATIONS OF LINES AND PLANES MATH 195, SECTION 59 (VIPUL NAIK) Corresponding mteril in the ook: Section 12.5. Wht students should definitely get: Prmetric eqution of line given in pointdirection nd twopoint
More informationLesson 10. Parametric Curves
Return to List of Lessons Lesson 10. Prmetric Curves (A) Prmetric Curves If curve fils the Verticl Line Test, it cn t be expressed by function. In this cse you will encounter problem if you try to find
More informationSirindhorn International Institute of Technology Thammasat University at Rangsit
Sirindhorn Interntionl Institute of Technology Thmmst University t Rngsit School of Informtion, Computer nd Communiction Technology COURSE : ECS 204 Bsic Electricl Engineering L INSTRUCTOR : Asst. Prof.
More informationIntegration by Substitution
Integrtion by Substitution Dr. Philippe B. Lvl Kennesw Stte University August, 8 Abstrct This hndout contins mteril on very importnt integrtion method clled integrtion by substitution. Substitution is
More informationVariable Dry Run (for Python)
Vrile Dr Run (for Pthon) Age group: Ailities ssumed: Time: Size of group: Focus Vriles Assignment Sequencing Progrmming 7 dult Ver simple progrmming, sic understnding of ssignment nd vriles 2050 minutes
More informationCS99S Laboratory 2 Preparation Copyright W. J. Dally 2001 October 1, 2001
CS99S Lortory 2 Preprtion Copyright W. J. Dlly 2 Octoer, 2 Ojectives:. Understnd the principle of sttic CMOS gte circuits 2. Build simple logic gtes from MOS trnsistors 3. Evlute these gtes to oserve logic
More informationQuadratic Equations  1
Alger Module A60 Qudrtic Equtions  1 Copyright This puliction The Northern Alert Institute of Technology 00. All Rights Reserved. LAST REVISED Novemer, 008 Qudrtic Equtions  1 Sttement of Prerequisite
More informationDistributions. (corresponding to the cumulative distribution function for the discrete case).
Distributions Recll tht n integrble function f : R [,] such tht R f()d = is clled probbility density function (pdf). The distribution function for the pdf is given by F() = (corresponding to the cumultive
More informationSquare Roots Teacher Notes
Henri Picciotto Squre Roots Techer Notes This unit is intended to help students develop n understnding of squre roots from visul / geometric point of view, nd lso to develop their numer sense round this
More informationIntegration. 148 Chapter 7 Integration
48 Chpter 7 Integrtion 7 Integrtion t ech, by supposing tht during ech tenth of second the object is going t constnt speed Since the object initilly hs speed, we gin suppose it mintins this speed, but
More informationSection 2.3. Motion Along a Curve. The Calculus of Functions of Several Variables
The Clculus of Functions of Severl Vribles Section 2.3 Motion Along Curve Velocity ccelertion Consider prticle moving in spce so tht its position t time t is given by x(t. We think of x(t s moving long
More informationRegular Sets and Expressions
Regulr Sets nd Expressions Finite utomt re importnt in science, mthemtics, nd engineering. Engineers like them ecuse they re super models for circuits (And, since the dvent of VLSI systems sometimes finite
More information2 DIODE CLIPPING and CLAMPING CIRCUITS
2 DIODE CLIPPING nd CLAMPING CIRCUITS 2.1 Ojectives Understnding the operting principle of diode clipping circuit Understnding the operting principle of clmping circuit Understnding the wveform chnge of
More informationAlgebra Review. How well do you remember your algebra?
Algebr Review How well do you remember your lgebr? 1 The Order of Opertions Wht do we men when we write + 4? If we multiply we get 6 nd dding 4 gives 10. But, if we dd + 4 = 7 first, then multiply by then
More informationPolynomial Functions. Polynomial functions in one variable can be written in expanded form as ( )
Polynomil Functions Polynomil functions in one vrible cn be written in expnded form s n n 1 n 2 2 f x = x + x + x + + x + x+ n n 1 n 2 2 1 0 Exmples of polynomils in expnded form re nd 3 8 7 4 = 5 4 +
More information1. Find the zeros Find roots. Set function = 0, factor or use quadratic equation if quadratic, graph to find zeros on calculator
AP Clculus Finl Review Sheet When you see the words. This is wht you think of doing. Find the zeros Find roots. Set function =, fctor or use qudrtic eqution if qudrtic, grph to find zeros on clcultor.
More information1 Numerical Solution to Quadratic Equations
cs42: introduction to numericl nlysis 09/4/0 Lecture 2: Introduction Prt II nd Solving Equtions Instructor: Professor Amos Ron Scribes: Yunpeng Li, Mrk Cowlishw Numericl Solution to Qudrtic Equtions Recll
More informationFAULT TREES AND RELIABILITY BLOCK DIAGRAMS. Harry G. Kwatny. Department of Mechanical Engineering & Mechanics Drexel University
SYSTEM FAULT AND Hrry G. Kwtny Deprtment of Mechnicl Engineering & Mechnics Drexel University OUTLINE SYSTEM RBD Definition RBDs nd Fult Trees System Structure Structure Functions Pths nd Cutsets Reliility
More informationSection 54 Trigonometric Functions
5 Trigonometric Functions Section 5 Trigonometric Functions Definition of the Trigonometric Functions Clcultor Evlution of Trigonometric Functions Definition of the Trigonometric Functions Alternte Form
More informationWords Symbols Diagram. abcde. a + b + c + d + e
Logi Gtes nd Properties We will e using logil opertions to uild mhines tht n do rithmeti lultions. It s useful to think of these opertions s si omponents tht n e hooked together into omplex networks. To
More informationChapter 9: Quadratic Equations
Chpter 9: Qudrtic Equtions QUADRATIC EQUATIONS DEFINITION + + c = 0,, c re constnts (generlly integers) ROOTS Synonyms: Solutions or Zeros Cn hve 0, 1, or rel roots Consider the grph of qudrtic equtions.
More informationExperiment 6: Friction
Experiment 6: Friction In previous lbs we studied Newton s lws in n idel setting, tht is, one where friction nd ir resistnce were ignored. However, from our everydy experience with motion, we know tht
More informationSolutions to Section 1
Solutions to Section Exercise. Show tht nd. This follows from the fct tht mx{, } nd mx{, } Exercise. Show tht = { if 0 if < 0 Tht is, the bsolute vlue function is piecewise defined function. Grph this
More informationLINEAR TRANSFORMATIONS AND THEIR REPRESENTING MATRICES
LINEAR TRANSFORMATIONS AND THEIR REPRESENTING MATRICES DAVID WEBB CONTENTS Liner trnsformtions 2 The representing mtrix of liner trnsformtion 3 3 An ppliction: reflections in the plne 6 4 The lgebr of
More informationAssuming all values are initially zero, what are the values of A and B after executing this Verilog code inside an always block? C=1; A <= C; B = C;
B26 Appendix B The Bsics of Logic Design Check Yourself ALU n [Arthritic Logic Unit or (rre) Arithmetic Logic Unit] A rndomnumer genertor supplied s stndrd with ll computer systems Stn KellyBootle,
More informationNet Change and Displacement
mth 11, pplictions motion: velocity nd net chnge 1 Net Chnge nd Displcement We hve seen tht the definite integrl f (x) dx mesures the net re under the curve y f (x) on the intervl [, b] Any prt of the
More information5.2. LINE INTEGRALS 265. Let us quickly review the kind of integrals we have studied so far before we introduce a new one.
5.2. LINE INTEGRALS 265 5.2 Line Integrls 5.2.1 Introduction Let us quickly review the kind of integrls we hve studied so fr before we introduce new one. 1. Definite integrl. Given continuous relvlued
More informationIn the following there are presented four different kinds of simulation games for a given Büchi automaton A = :
Simultion Gmes Motivtion There re t lest two distinct purposes for which it is useful to compute simultion reltionships etween the sttes of utomt. Firstly, with the use of simultion reltions it is possile
More informationPROF. BOYAN KOSTADINOV NEW YORK CITY COLLEGE OF TECHNOLOGY, CUNY
MAT 0630 INTERNET RESOURCES, REVIEW OF CONCEPTS AND COMMON MISTAKES PROF. BOYAN KOSTADINOV NEW YORK CITY COLLEGE OF TECHNOLOGY, CUNY Contents 1. ACT Compss Prctice Tests 1 2. Common Mistkes 2 3. Distributive
More informationExample 27.1 Draw a Venn diagram to show the relationship between counting numbers, whole numbers, integers, and rational numbers.
2 Rtionl Numbers Integers such s 5 were importnt when solving the eqution x+5 = 0. In similr wy, frctions re importnt for solving equtions like 2x = 1. Wht bout equtions like 2x + 1 = 0? Equtions of this
More informationTests for One Poisson Mean
Chpter 412 Tests for One Poisson Men Introduction The Poisson probbility lw gives the probbility distribution of the number of events occurring in specified intervl of time or spce. The Poisson distribution
More informationMath 135 Circles and Completing the Square Examples
Mth 135 Circles nd Completing the Squre Exmples A perfect squre is number such tht = b 2 for some rel number b. Some exmples of perfect squres re 4 = 2 2, 16 = 4 2, 169 = 13 2. We wish to hve method for
More informationTreatment Spring Late Summer Fall 0.10 5.56 3.85 0.61 6.97 3.01 1.91 3.01 2.13 2.99 5.33 2.50 1.06 3.53 6.10 Mean = 1.33 Mean = 4.88 Mean = 3.
The nlysis of vrince (ANOVA) Although the ttest is one of the most commonly used sttisticl hypothesis tests, it hs limittions. The mjor limittion is tht the ttest cn be used to compre the mens of only
More informationA.7.1 Trigonometric interpretation of dot product... 324. A.7.2 Geometric interpretation of dot product... 324
A P P E N D I X A Vectors CONTENTS A.1 Scling vector................................................ 321 A.2 Unit or Direction vectors...................................... 321 A.3 Vector ddition.................................................
More information11. Fourier series. sin mx cos nx dx = 0 for any m, n, sin 2 mx dx = π.
. Fourier series Summry of the bsic ides The following is quick summry of the introductory tretment of Fourier series in MATH. We consider function f with period π, tht is, stisfying f(x + π) = f(x) for
More informationUniform convergence and its consequences
Uniform convergence nd its consequences The following issue is centrl in mthemtics: On some domin D, we hve sequence of functions {f n }. This mens tht we relly hve n uncountble set of ordinry sequences,
More informationPure C4. Revision Notes
Pure C4 Revision Notes Mrch 0 Contents Core 4 Alger Prtil frctions Coordinte Geometry 5 Prmetric equtions 5 Conversion from prmetric to Crtesin form 6 Are under curve given prmetriclly 7 Sequences nd
More informationEquations between labeled directed graphs
Equtions etween leled directed grphs Existence of solutions GrretFontelles A., Misnikov A., Ventur E. My 2013 Motivtionl prolem H 1 nd H 2 two sugroups of the free group generted y X A, F (X, A). H 1
More informationCurve Sketching. 96 Chapter 5 Curve Sketching
96 Chpter 5 Curve Sketching 5 Curve Sketching A B A B A Figure 51 Some locl mximum points (A) nd minimum points (B) If (x, f(x)) is point where f(x) reches locl mximum or minimum, nd if the derivtive of
More informationDouble Integrals over General Regions
Double Integrls over Generl egions. Let be the region in the plne bounded b the lines, x, nd x. Evlute the double integrl x dx d. Solution. We cn either slice the region verticll or horizontll. ( x x Slicing
More informationChapter 6 Solving equations
Chpter 6 Solving equtions Defining n eqution 6.1 Up to now we hve looked minly t epressions. An epression is n incomplete sttement nd hs no equl sign. Now we wnt to look t equtions. An eqution hs n = sign
More informationFinite Automata. Informatics 2A: Lecture 3. John Longley. 25 September School of Informatics University of Edinburgh
Lnguges nd Automt Finite Automt Informtics 2A: Lecture 3 John Longley School of Informtics University of Edinburgh jrl@inf.ed.c.uk 25 September 2015 1 / 30 Lnguges nd Automt 1 Lnguges nd Automt Wht is
More informationIn this section make precise the idea of a matrix inverse and develop a method to find the inverse of a given square matrix when it exists.
Mth 52 Sec S060/S0602 Notes Mtrices IV 5 Inverse Mtrices 5 Introduction In our erlier work on mtrix multipliction, we sw the ide of the inverse of mtrix Tht is, for squre mtrix A, there my exist mtrix
More informationThe Quadratic Formula and the Discriminant
99 The Qudrtic Formul nd the Discriminnt Objectives Solve qudrtic equtions by using the Qudrtic Formul. Determine the number of solutions of qudrtic eqution by using the discriminnt. Vocbulry discriminnt
More information5.6 POSITIVE INTEGRAL EXPONENTS
54 (5 ) Chpter 5 Polynoils nd Eponents 5.6 POSITIVE INTEGRAL EXPONENTS In this section The product rule for positive integrl eponents ws presented in Section 5., nd the quotient rule ws presented in Section
More informationAREA OF A SURFACE OF REVOLUTION
AREA OF A SURFACE OF REVOLUTION h cut r πr h A surfce of revolution is formed when curve is rotted bout line. Such surfce is the lterl boundr of solid of revolution of the tpe discussed in Sections 7.
More informationP.3 Polynomials and Factoring. P.3 an 1. Polynomial STUDY TIP. Example 1 Writing Polynomials in Standard Form. What you should learn
33337_0P03.qp 2/27/06 24 9:3 AM Chpter P Pge 24 Prerequisites P.3 Polynomils nd Fctoring Wht you should lern Polynomils An lgeric epression is collection of vriles nd rel numers. The most common type of
More informationMODULE 3. 0, y = 0 for all y
Topics: Inner products MOULE 3 The inner product of two vectors: The inner product of two vectors x, y V, denoted by x, y is (in generl) complex vlued function which hs the following four properties: i)
More informationAe2 Mathematics : Fourier Series
Ae Mthemtics : Fourier Series J. D. Gibbon (Professor J. D Gibbon, Dept of Mthemtics j.d.gibbon@ic.c.uk http://www.imperil.c.uk/ jdg These notes re not identicl wordforword with my lectures which will
More informationExponential and Logarithmic Functions
Nme Chpter Eponentil nd Logrithmic Functions Section. Eponentil Functions nd Their Grphs Objective: In this lesson ou lerned how to recognize, evlute, nd grph eponentil functions. Importnt Vocbulr Define
More informationReview guide for the final exam in Math 233
Review guide for the finl exm in Mth 33 1 Bsic mteril. This review includes the reminder of the mteril for mth 33. The finl exm will be cumultive exm with mny of the problems coming from the mteril covered
More informationHelicopter Theme and Variations
Helicopter Theme nd Vritions Or, Some Experimentl Designs Employing Pper Helicopters Some possible explntory vribles re: Who drops the helicopter The length of the rotor bldes The height from which the
More information15.6. The mean value and the rootmeansquare value of a function. Introduction. Prerequisites. Learning Outcomes. Learning Style
The men vlue nd the rootmensqure vlue of function 5.6 Introduction Currents nd voltges often vry with time nd engineers my wish to know the verge vlue of such current or voltge over some prticulr time
More informationSPECIAL PRODUCTS AND FACTORIZATION
MODULE  Specil Products nd Fctoriztion 4 SPECIAL PRODUCTS AND FACTORIZATION In n erlier lesson you hve lernt multipliction of lgebric epressions, prticulrly polynomils. In the study of lgebr, we come
More informationVersion 001 CIRCUITS holland (1290) 1
Version CRCUTS hollnd (9) This printout should hve questions Multiplechoice questions my continue on the next column or pge find ll choices efore nswering AP M 99 MC points The power dissipted in wire
More informationContinuous Random Variables: Derived Distributions
Continuous Rndom Vriles: Derived Distriutions Berlin Chen Deprtment o Computer Science & Inormtion Engineering Ntionl Tiwn Norml Universit Reerence:  D. P. Bertseks, J. N. Tsitsiklis, Introduction to
More information4: RIEMANN SUMS, RIEMANN INTEGRALS, FUNDAMENTAL THEOREM OF CALCULUS
4: RIEMA SUMS, RIEMA ITEGRALS, FUDAMETAL THEOREM OF CALCULUS STEVE HEILMA Contents 1. Review 1 2. Riemnn Sums 2 3. Riemnn Integrl 3 4. Fundmentl Theorem of Clculus 7 5. Appendix: ottion 10 1. Review Theorem
More informationr 2 F ds W = r 1 qe ds = q
Chpter 4 The Electric Potentil 4.1 The Importnt Stuff 4.1.1 Electricl Potentil Energy A chrge q moving in constnt electric field E experiences force F = qe from tht field. Also, s we know from our study
More informationSimple Electric Circuits
Simple Eletri Ciruits Gol: To uild nd oserve the opertion of simple eletri iruits nd to lern mesurement methods for eletri urrent nd voltge using mmeters nd voltmeters. L Preprtion Eletri hrges move through
More informationAlgorithms Chapter 4 Recurrences
Algorithms Chpter 4 Recurrences Outline The substitution method The recursion tree method The mster method Instructor: Ching Chi Lin 林清池助理教授 chingchilin@gmilcom Deprtment of Computer Science nd Engineering
More informationHomework #4: Answers. 1. Draw the array of world outputs that free trade allows by making use of each country s transformation schedule.
Text questions, Chpter 5, problems 15: Homework #4: Answers 1. Drw the rry of world outputs tht free trde llows by mking use of ech country s trnsformtion schedule.. Drw it. This digrm is constructed
More informationLecture 15  Curve Fitting Techniques
Lecture 15  Curve Fitting Techniques Topics curve fitting motivtion liner regression Curve fitting  motivtion For root finding, we used given function to identify where it crossed zero where does fx
More informationEcon 4721 Money and Banking Problem Set 2 Answer Key
Econ 472 Money nd Bnking Problem Set 2 Answer Key Problem (35 points) Consider n overlpping genertions model in which consumers live for two periods. The number of people born in ech genertion grows in
More information1.2 The Integers and Rational Numbers
.2. THE INTEGERS AND RATIONAL NUMBERS.2 The Integers n Rtionl Numers The elements of the set of integers: consist of three types of numers: Z {..., 5, 4, 3, 2,, 0,, 2, 3, 4, 5,...} I. The (positive) nturl
More informationSuffix Trees CMSC 423
Suffix Trees CMSC 423 Preprocessing Strings Over the next few lectures, we ll see severl methods for preprocessing string dt into dt structures tht mke mny questions (like serching) esy to nswer: Suffix
More informationN Mean SD Mean SD Shelf # Shelf # Shelf #
NOV xercises smple of 0 different types of cerels ws tken from ech of three grocery store shelves (1,, nd, counting from the floor). summry of the sugr content (grms per serving) nd dietry fiber (grms
More informationGeneralized Inverses: How to Invert a NonInvertible Matrix
Generlized Inverses: How to Invert NonInvertible Mtrix S. Swyer September 7, 2006 rev August 6, 2008. Introduction nd Definition. Let A be generl m n mtrix. Then nturl question is when we cn solve Ax
More information1+(dy/dx) 2 dx. We get dy dx = 3x1/2 = 3 x, = 9x. Hence 1 +
Mth.9 Em Solutions NAME: #.) / #.) / #.) /5 #.) / #5.) / #6.) /5 #7.) / Totl: / Instructions: There re 5 pges nd totl of points on the em. You must show ll necessr work to get credit. You m not use our
More informationAnswer, Key Homework 8 David McIntyre 1
Answer, Key Homework 8 Dvid McIntyre 1 This printout should hve 17 questions, check tht it is complete. Multiplechoice questions my continue on the net column or pge: find ll choices before mking your
More informationModule Summary Sheets. C3, Methods for Advanced Mathematics (Version B reference to new book) Topic 2: Natural Logarithms and Exponentials
MEI Mthemtics in Ection nd Instry Topic : Proof MEI Structured Mthemtics Mole Summry Sheets C, Methods for Anced Mthemtics (Version B reference to new book) Topic : Nturl Logrithms nd Eponentils Topic
More informationSCHOOL OF ENGINEERING & BUILT ENVIRONMENT. Mathematics. Basic Algebra
SCHOOL OF ENGINEERING & BUILT ENVIRONMENT Mthemtics Bsic Alger. Opertions nd Epressions. Common Mistkes. Division of Algeric Epressions. Eponentil Functions nd Logrithms. Opertions nd their Inverses. Mnipulting
More informationUse Geometry Expressions to create a more complex locus of points. Find evidence for equivalence using Geometry Expressions.
Lerning Objectives Loci nd Conics Lesson 3: The Ellipse Level: Preclculus Time required: 120 minutes In this lesson, students will generlize their knowledge of the circle to the ellipse. The prmetric nd
More informationExponentiation: Theorems, Proofs, Problems Pre/Calculus 11, Veritas Prep.
Exponentition: Theorems, Proofs, Problems Pre/Clculus, Verits Prep. Our Exponentition Theorems Theorem A: n+m = n m Theorem B: ( n ) m = nm Theorem C: (b) n = n b n ( ) n n Theorem D: = b b n Theorem E:
More informationSection A4 Rational Expressions: Basic Operations
A Appendi A A BASIC ALGEBRA REVIEW 7. Construction. A rectngulr opentopped bo is to be constructed out of 9 by 6inch sheets of thin crdbord by cutting inch squres out of ech corner nd bending the
More informationSolving Linear Equations  Formulas
1. Solving Liner Equtions  Formuls Ojective: Solve liner formuls for given vrile. Solving formuls is much like solving generl liner equtions. The only difference is we will hve severl vriles in the prolem
More information14.2. The Mean Value and the RootMeanSquare Value. Introduction. Prerequisites. Learning Outcomes
he Men Vlue nd the RootMenSqure Vlue 4. Introduction Currents nd voltges often vry with time nd engineers my wish to know the men vlue of such current or voltge over some prticulr time intervl. he men
More informationAntiderivatives/Indefinite Integrals of Basic Functions
Antiderivtives/Indefinite Integrls of Bsic Functions Power Rule: x n+ x n n + + C, dx = ln x + C, if n if n = In prticulr, this mens tht dx = ln x + C x nd x 0 dx = dx = dx = x + C Integrl of Constnt:
More informationArc Length. P i 1 P i (1) L = lim. i=1
Arc Length Suppose tht curve C is defined by the eqution y = f(x), where f is continuous nd x b. We obtin polygonl pproximtion to C by dividing the intervl [, b] into n subintervls with endpoints x, x,...,x
More informationDIGITAL CIRCUITS EXAMPLES (questions and solutions) Dr. N. AYDIN
DIGITAL CIRCUITS EXAMPLES (questions nd solutions) Dr. N. AYDIN nydin@yildiz.edu.tr Emple. Assume tht the inverter in the network elow hs propgtion dely of 5 ns nd the AND gte hs propgtion dely of ns.
More informationMath 314, Homework Assignment 1. 1. Prove that two nonvertical lines are perpendicular if and only if the product of their slopes is 1.
Mth 4, Homework Assignment. Prove tht two nonverticl lines re perpendiculr if nd only if the product of their slopes is. Proof. Let l nd l e nonverticl lines in R of slopes m nd m, respectively. Suppose
More informationContent Objectives: After completing the activity, students will gain experience of informally proving Pythagoras Theorem
Pythgors Theorem S Topic 1 Level: Key Stge 3 Dimension: Mesures, Shpe nd Spce Module: Lerning Geometry through Deductive Approch Unit: Pythgors Theorem Student ility: Averge Content Ojectives: After completing
More informationSTA 2023 Test #3 Practice Multiple Choice
STA 223 Test #3 Prctice Multiple Choice 1. A newspper conducted sttewide survey concerning the 1998 rce for stte sentor. The newspper took rndom smple (ssume it is n SRS) of 12 registered voters nd found
More information0.1 Basic Set Theory and Interval Notation
0.1 Bsic Set Theory nd Intervl Nottion 3 0.1 Bsic Set Theory nd Intervl Nottion 0.1.1 Some Bsic Set Theory Notions Like ll good Mth ooks, we egin with definition. Definition 0.1. A set is welldefined
More informationNewton s Three Laws. d dt F = If the mass is constant, this relationship becomes the familiar form of Newton s Second Law: dv dt
Newton s Three Lws For couple centuries before Einstein, Newton s Lws were the bsic principles of Physics. These lws re still vlid nd they re the bsis for much engineering nlysis tody. Forml sttements
More informationCalculus of variations with fractional derivatives and fractional integrals
Anis do CNMAC v.2 ISSN 1984820X Clculus of vritions with frctionl derivtives nd frctionl integrls Ricrdo Almeid, Delfim F. M. Torres Deprtment of Mthemtics, University of Aveiro 3810193 Aveiro, Portugl
More informationContinuous probability distributions
Chpter 8 Continuous probbility distributions 8.1 Introduction In Chpter 7, we explored the concepts of probbility in discrete setting, where outcomes of n experiment cn tke on only one of finite set of
More informationVectors 2. 1. Recap of vectors
Vectors 2. Recp of vectors Vectors re directed line segments  they cn be represented in component form or by direction nd mgnitude. We cn use trigonometry nd Pythgors theorem to switch between the forms
More information3 The Utility Maximization Problem
3 The Utility Mxiiztion Proble We hve now discussed how to describe preferences in ters of utility functions nd how to forulte siple budget sets. The rtionl choice ssuption, tht consuers pick the best
More informationQuadratic Equations. Math 99 N1 Chapter 8
Qudrtic Equtions Mth 99 N1 Chpter 8 1 Introduction A qudrtic eqution is n eqution where the unknown ppers rised to the second power t most. In other words, it looks for the vlues of x such tht second degree
More information