Incremental calculation of weighted mean and variance


 Cleopatra Pierce
 1 years ago
 Views:
Transcription
1 Icremetal calculatio of weighted mea ad variace Toy Fich Uiversity of Cambridge Computig Service February 009 Abstract I these otes I eplai how to derive formulae for umerically stable calculatio of the mea ad stadard deviatio, which are also suitable for icremetal olie calculatio. I the geeralize these formulae to weighted meas ad stadard deviatios. I upick the difficulties that arise whe geeralizig further to ormalized weights. Fially I show that the epoetially weighted movig average is a special case of the icremetal ormalized weighted mea formula, ad derive a formula for the epoetially weighted movig stadard deviatio. Simple mea Straightforward traslatio of equatio ito code ca suffer from loss of precisio because of the differece i magitude betwee a sample ad the sum of all samples. Equatio 4 calculates the mea i a way that is more umerically stable because it avoids accumulatig large sums. µ i ) + i ) ) This formula also provides us with some useful idetities. Simple variace + )µ ) 3) µ + µ ) 4) µ µ µ ) 5) µ µ µ ) µ + µ )µ µ ) 6) The defiitio of the stadard deviatio i equatio 7 below requires us to already kow the mea, which implies two passes over the data. This is t feasible for olie algorithms that eed to produce icremetal results after each sample becomes available. Equatio solves this problem sice it allows us to calculate the stadard deviatio from two ruig sums. σ i µ) 7) i i µ + µ ) 8)
2 3 Icremetal variace i µ i + µ 9) i µµ + µ 0) i µ ) ) ) i i ) Kuth otes [] that equatio is proe to loss of precisio because it takes the differece betwee two large sums of similar size, ad suggests equatio 4 as a alterative that avoids this problem. However he does ot say how it is derived. I the followig, equatio 0 is derived from the previous step usig equatio 5. Let S σ 3) i µ ) 4) i µ 5) S S i µ i + )µ 6) µ + )µ 7) µ + µ µ ) 8) µ + µ µ )µ + µ ) 9) µ + µ )µ + µ ) 0) µ + µ µ µ + µ µ ) µ µ + µ µ ) µ ) µ ) 3) S S + µ ) µ ) 4) σ S / 5) Mathworld [] has a alterative derivatio of a similar formula, which i our otatio is as follows. S i µ ) 6) i µ ) µ µ )) 7) i µ ) + µ µ ) i µ )µ µ ) 8) Simplify the first summatio: i µ ) µ ) + i µ ) 9) µ ) + S 30) S + µ µ ) 3)
3 Simplify the secod summatio: Simplify the third summatio: µ µ ) µ µ ) 3) i µ )µ µ ) µ µ ) i µ ) 33) ) µ µ ) µ + i µ ) ) µ µ ) µ )µ + i µ µ ) µ )µ + )µ ) 36) µ µ ) µ ) 37) µ µ ) 38) Back to the complete formula: S S + µ µ ) + µ µ ) µ µ ) 39) S + µ µ ) µ µ ) 40) S + )µ µ ) 4) We ca use equatios 6 ad 5 to show this is equivalet to equatio 4. S S + )µ µ ) 4) S + µ µ ) µ ) 43) S + µ ) µ ) 44) 4 Weighted mea The weighted mea is defied as follows. 34) 35) µ w i i w i 45) It is equivalet to the simple mea whe all the weights are equal, sice µ w i w w i i 46) w If the samples are all differet, the weights ca be thought of as sample frequecies, or they ca be used to calculate probabilities where p i w i / w i. The followig derivatio of the icremetal formula equatio 53) follows the same patter as the derivatio of equatio 4. For brevity we also defie as the sum of the weights. µ w i 47) w i i 48) ) w + w i i 3 49)
4 Useful idetities derived from this formula are: 5 Weighted variace w + W µ ) 50) w + w )µ ) 5) µ + w w µ ) 5) µ + w µ ) 53) µ µ ) w µ ) 54) µ µ ) w µ 55) µ w µ µ ) µ + µ w w µ µ ) 56) w µ ) 57) Similarly, we derive a umerically stable formula for calculatig the weighted variace equatio 68) usig the same patter as the derivatio of the uweighed wersio equatio 4). σ w i i µ) w i i µ 58) Let S σ 59) w i i µ 60) S S 6 Variable weights w i i µ w i i + W µ 6) w µ + W µ 6) w µ + w )µ 63) w µ ) + W µ µ ) 64) w µ ) + W µ µ )µ + µ ) 65) w µ + µ )µ + µ ) ) 66) w µ ) µ ) 67) S S + w µ ) µ ) 68) σ S / 69) I the previous three sectios, I have assumed that weights are costat oce assiged. However a commo requiremet is to ormalize the weights, such that W w i 70) If we are repeatedly addig ew data to our workig set, the we ca t have both costat weights ad ormalized weights. To allow us to keep weights ormalized, we eed to allow the weight of each 4
5 sample to chage as the set of samples chages. To idicate this we will give weights two idices, the first idetifyig the set of samples usig the sample cout as we have bee doig for µ etc.) ad the secod beig the ide of the sample i that set. We will ot make ay assumptios about the sum of the weights, that is we will ot require them to be ormalized. For eample, w,i, µ w,i i 7) Havig doe this we eed to reeamie some of the logical steps i the previous sectios to esure they are still valid. I equatios 49 5, we used the fact that i the fiedweight settig, w i i W µ w )µ 7) I the ew settig, this equality is fairly obviously o loger true. For eample, if we are keepig weights ormalized the W.) Fortuately there is a differet middle step which justifies equatio 7 whe weights vary, so the results of sectio 4 remai valid. w,i i w, )µ 73) w,i i w,i i w,i w,i w i,i w,j w,i w w,i i,i w,i i w,i w,i 74) 75) w,i w i 76),i w,j w,i where j 77) This says that for the weighted mea formulae to remai valid the ew ad old weights should be cosistet. Equatio 75 says that we get the same result whe we calculate the mea of the previous workig set whether we use the old weights or the ew weights. Equatio 77 says that whe we ormalize the weights across the previous set up to ) we get the same set of weights whether we start from the old weights or the ew oes. This requiremet is t eough by itself to make the weighted variace formulae work, so we will eamie it agai below. 7 The epectatio fuctio At this poit it is worth defiig some better otatio to reduce the umber of summatios we eed to write. The epectatio fuctio is a geeralized versio of the mea, whose argumet is some arbitrary fuctio of each sample. E f)) w,i f i ) 78) E k) k 79) E af)) ae f)) 80) E f) + g)) E f)) + E g)) 8) µ E ) 8) σ E µ ) ) 83) E + µ µ ) 84) E ) + µ µ E ) 85) 5
6 E ) µ 86) E ) E ) 87) The icremetal formula is derived i the usual way. Equatio 9 is particularly useful. E f)) w,i f i ) 88) 8 Variableweight variace w, f ) + w,i f i ) 89) w, f ) + w, ) w,if i ) w,i 90) w, f ) + w, ),if i ) w,i 9) w, f ) + w, )E f)) 9) E f)) E f)) + w, f ) E f))) 93) I equatios 6 63 we made the followig assumptios which are ot true whe weights ca vary. w,i i µ w,i i + W µ w, µ + W µ w, µ + w, )µ If we try to redo the short derivatio of the icremetal stadard deviatio formula startig from S S the we soo get stuck. Fortuately the loger derivatio shows how to made it work. S σ 94) E µ ) ) 95) Simplify the first term: E [ µ ] [µ µ ]) ) 96) E [ µ ] + [µ µ ] [ µ ][µ µ ] ) 97) E [ µ ] ) + E [µ µ ] ) E [ µ ][µ µ ]) 98) E [ µ ] ) w, [ µ ] + w, )E [ µ ] ) 99) Simplify the secod term: Simplify the third term: w, [ µ ] + w, ) S W 00) w, S + [µ µ ] 0) W w, E [µ µ ] ) [µ µ ] 0) E [ µ ][µ µ ]) [µ µ ] E [ µ ] 03) 6
7 Back to the complete formula: [µ µ ] w, [ µ ] + w, )E [ µ ]) 04) [µ µ ] w, [ µ ] + w, )[E ) E µ )]) 05) [µ µ ] w, [ µ ] + w, )[µ µ ]) 06) [µ µ ]w, [ µ ] 07) [µ µ ] 08) S w, S + [µ µ ] + [µ µ ] [µ µ ] 09) W w, w, S + [µ µ ] w, [µ µ ] 0) W w, w, w, S + w, ) [µ µ ] ) W w, w, W S + w, )[µ µ ] µ ) ) S w, W S + w, µ ) µ ) 3) This is the same as equatio 68, ecept for the multiplier W w, W which captures the chage i weights betwee the old ad ew sets. w,,i W w w,j,i w,j where j 4) Now that we kow the rescalig trick which makes it work, we ca write dow the short versio. S w, S W E ) µ ) W w, ) E ) µ ) 5) E ) µ ) W E ) + w, + w, )µ 6) w, µ + w, )µ 7) w, µ ) + W µ µ ) 8) w, µ ) + W µ µ )µ + µ ) 9) w, µ + µ )µ + µ ) ) 0) w, µ ) µ ) ) 9 Epoetiallyweighted mea ad variace Startig from equatio 53, let s set w, / to a costat 0 < α < ad let a α. This produces the stadard formula for the epoetially weighted movig average. µ µ + α µ ) ) α)µ + α 3) aµ + a) 4) I the followig it s more coveiet to use a lower boud of 0 istead of, i.e. 0 i. We are goig to show that the weights are reormalized each time a datum is added. First, we epad out the iductive defiitio of the mea. µ aµ + a) 5) a µ + a a) + a) 6) 7
8 a 3 µ 3 + a a) + a a) + a) 7) µ a 0 + a i a) i 8) This allows us to write dow the weights directly. Note that w, is idepedet of. w,0 a 9) w,i a i a), for i 30) w, a α 3) Sice w, α w, / we ca see that., that is, the weights are always ormalized. We ca get the same result by summig the geometric series. a i a j a a w,i j0 3) a i a) a 33) w,0 + These weights satisfy the cosistecy requiremet because w,j aw,j w,j w,i aw,i w,i w,i a + a ) 34) We ca use the epectatio fuctio to write dow the aïve formula for the variace. 35) E f)) E f)) + w, f ) E f))) 36) E f)) + αf ) E f))) 37) E ) E ) + α E )) 38) σ E ) µ 39) So usig the formula from the previous sectio we ca write the icremetal versio: S w, W S + w, µ ) µ ) 40) S α S + α µ ) µ ) 4) σ S S as + a) µ ) µ ) 4) This latter form is slightly more coveiet for code: diff :  mea icr : alpha * diff mea : mea + icr variace :  alpha) * variace + diff * icr) Refereces α)s + α µ ) ) 43) [] Doald E. Kuth. Semiumerical Algorithms, volume of The Art of Computer Programmig, chapter 4.., page 3. AddisoWesley, Bosto, third editio, 998. [] Eric W. Weisstei. Sample variace computatio. From Mathworld, a Wolfram web resource, 8
AQA Statistics 1. Numerical measures. Section 2: Measures of spread
Notes ad Eamples AQA Statistics 1 Numerical measures Sectio : Measures of spread Just as there are several differet measures of cetral tedecy (averages), there are a variety of statistical measures of
More informationExample: Consider the sequence {a i = i} i=1. Starting with i = 1, since a i = i,
Sequeces: Defiitio: A sequece is a fuctio whose domai is the set of atural umbers or a subset of the atural umbers. We usually use the symbol a to represet a sequece, where is a atural umber ad a is the
More informationPower and Sample Size Concepts and Calculations
Power ad Sample Size Cocepts ad Calculatios For a variety of statistical settigs, oe commoly approaches power ad sample size issues from oe of three startig poits: What sample size is required to achieve
More informationI. Chisquared Distributions
1 M 358K Supplemet to Chapter 23: CHISQUARED DISTRIBUTIONS, TDISTRIBUTIONS, AND DEGREES OF FREEDOM To uderstad tdistributios, we first eed to look at aother family of distributios, the chisquared distributios.
More informationDefinition. A variable X that takes on values X 1, X 2, X 3,...X k with respective frequencies f 1, f 2, f 3,...f k has mean
1 Social Studies 201 October 13, 2004 Note: The examples i these otes may be differet tha used i class. However, the examples are similar ad the methods used are idetical to what was preseted i class.
More informationSection IV.5: Recurrence Relations from Algorithms
Sectio IV.5: Recurrece Relatios from Algorithms Give a recursive algorithm with iput size, we wish to fid a Θ (best big O) estimate for its ru time T() either by obtaiig a explicit formula for T() or by
More informationModule 4: Mathematical Induction
Module 4: Mathematical Iductio Theme 1: Priciple of Mathematical Iductio Mathematical iductio is used to prove statemets about atural umbers. As studets may remember, we ca write such a statemet as a predicate
More informationMATH Testing a Series for Convergence
MATH 0  Testig a Series for Covergece Dr. Philippe B. Laval Keesaw State Uiversity October 4, 008 Abstract This hadout is a summary of the most commoly used tests which are used to determie if a series
More informationSECTION 1.5 : SUMMATION NOTATION + WORK WITH SEQUENCES
SECTION 1.5 : SUMMATION NOTATION + WORK WITH SEQUENCES Read Sectio 1.5 (pages 5 9) Overview I Sectio 1.5 we lear to work with summatio otatio ad formulas. We will also itroduce a brief overview of sequeces,
More informationTopic 6 Estimation. Correction Pages
Topic 6 Estimatio Correctio Pages Page 0 Corrected Recall that the basic structure of the required cofidece iterval is poit estimate + safety et: Lower limit = ( poit estimate )  ( multiple ) (SE of poit
More informationNow that we know what our sample looks like, we d like to be able to describe it numerically.
Descriptive Statistics: Now that we kow what our sample looks like, we d like to be able to describe it umerically. I other words, istead of havig a lot of umbers (oe for each record), we d like to be
More informationCombining Multiple Averaged Data Points And Their Errors
Combiig Multiple Averaged Data Poits Ad Their Errors Ke Tatebe August 10, 005 It is stadard practice to average measured data poits i order to suppress statistical errors i the fial results. Here, the
More informationProperties of MLE: consistency, asymptotic normality. Fisher information.
Lecture 3 Properties of MLE: cosistecy, asymptotic ormality. Fisher iformatio. I this sectio we will try to uderstad why MLEs are good. Let us recall two facts from probability that we be used ofte throughout
More informationThe second difference is the sequence of differences of the first difference sequence, 2
Differece Equatios I differetial equatios, you look for a fuctio that satisfies ad equatio ivolvig derivatives. I differece equatios, istead of a fuctio of a cotiuous variable (such as time), we look for
More informationZTEST / ZSTATISTIC: used to test hypotheses about. µ when the population standard deviation is unknown
ZTEST / ZSTATISTIC: used to test hypotheses about µ whe the populatio stadard deviatio is kow ad populatio distributio is ormal or sample size is large TTEST / TSTATISTIC: used to test hypotheses about
More informationMORE ON THE EQUALVARIANCE, TWOSAMPLE TTEST
1 MORE ON THE EQUALVARIANCE TWOSAMPLE TTEST Robustess: As poited out i the quote from Box (i the otes for Jauary 19 ad as the discussio (whe the example was itroduced of the example about comparig two
More informationTHE ABRACADABRA PROBLEM
THE ABRACADABRA PROBLEM FRANCESCO CARAVENNA Abstract. We preset a detailed solutio of Exercise E0.6 i [Wil9]: i a radom sequece of letters, draw idepedetly ad uiformly from the Eglish alphabet, the expected
More information8.1 Arithmetic Sequences
MCR3U Uit 8: Sequeces & Series Page 1 of 1 8.1 Arithmetic Sequeces Defiitio: A sequece is a comma separated list of ordered terms that follow a patter. Examples: 1, 2, 3, 4, 5 : a sequece of the first
More informationMarkov Chain Monte Carlo ( ) ( ) ( ) ( ) ( )
3/7/200 Z:\ jeh\self\book Kaa\Ja5200\5 Radom walks Chap 5 Part 3Markov Chai Mote Carlo Markov Chai Mote Carlo Markov Chai Mote Carlo methods sample from a probabilit distributio p( b creatig a Markov
More informationSteve Smith Tuition: Maths Notes
Steve Smith Tuitio: Maths Notes e iπ + 1 = 0 a 2 + b 2 = c 2 z +1 = z 2 + c V E + F = 2 Fidig Equatios of Regressio Lies Cotets 1 Itroductio 3 1.1 A Quick Overview of Correlatio.............................
More informationDiscrete Mathematics and Probability Theory Spring 2014 Anant Sahai Note 13
EECS 70 Discrete Mathematics ad Probability Theory Sprig 2014 Aat Sahai Note 13 Itroductio At this poit, we have see eough examples that it is worth just takig stock of our model of probability ad may
More informationThe interval and radius of convergence of a power series
The iterval ad radius of covergece of a power series Bro. David E. Brow, BYU Idaho Dept. of Mathematics. All rights reserved. Versio 1.1, of April, 014 Cotets 1 Itroductio 1 The ratio ad root tests 3 Examples
More informationThe standard deviation of the mean
Physics 116C Fall 01 The stadard deviatio of the mea These otes provide some clarificatio o the distictio betwee the stadard deviatio ad the stadard deviatio of the mea. 1. The sample mea ad variace Cosider
More informationConfidence Intervals for One Mean with Tolerance Probability
Chapter 421 Cofidece Itervals for Oe Mea with Tolerace Probability Itroductio This procedure calculates the sample size ecessary to achieve a specified distace from the mea to the cofidece limit(s) with
More informationThe Euler Totient, the Möbius and the Divisor Functions
The Euler Totiet, the Möbius ad the Divisor Fuctios Rosica Dieva July 29, 2005 Mout Holyoke College South Hadley, MA 01075 1 Ackowledgemets This work was supported by the Mout Holyoke College fellowship
More informationReview for College Algebra Final Exam
Review for College Algebra Fial Exam (Please remember that half of the fial exam will cover chapters 14. This review sheet covers oly the ew material, from chapters 5 ad 7.) 5.1 Systems of equatios i
More informationFourier Series and the Wave Equation Part 2
Fourier Series ad the Wave Equatio Part There are two big ideas i our work this week. The first is the use of liearity to break complicated problems ito simple pieces. The secod is the use of the symmetries
More informationDiscrete Mathematics and Probability Theory Fall 2009 Satish Rao, David Tse Note 14
CS 70 Discrete Mathematics ad Probability Theory Fall 2009 Satish Rao, David Tse Note 14 Some Importat Distributios The first importat distributio we leart i the last lecture ote is the biomial distributio
More information7. Convergence in Probability Lehmann 2.1; Ferguson 1
7. Covergece i robability ehma 2.1; Ferguso 1 Here, we cosider sequeces X 1, X 2,... of radom variables istead of real umbers. As with real umbers, we d like to have a idea of what it meas to coverge.
More informationConfidence Intervals for One Mean
Chapter 420 Cofidece Itervals for Oe Mea Itroductio This routie calculates the sample size ecessary to achieve a specified distace from the mea to the cofidece limit(s) at a stated cofidece level for a
More information1 Exercises and Solutions
Exercises ad Solutios Most of the exercises below have solutios but you should try first to solve them. Each subsectio with solutios is after the correspodig subsectio with exercises. T. Time complexity
More informationDr. Maddah 624 Financial Eng g I 12/12/07. Chapter 6 MeanVariance Portfolio Theory (continuous)
Dr. Maddah 624 Fiacial Eg g I 2/2/07 Chapter 6 MeaVariace Portfolio Theory (cotiuous) The Markowitz Model The Markowitz model determies the portfolio i the miimumvariace set correspodig to a mea retur
More informationStat 20: A guide to estimating regression parameters
Stat 0: A guide to estimatig regressio parameters B. M. Bolstad, bolstad@stat.berkeley.edu November 4, 003 The goal of this documet is to outlie the steps that you should go through to estimate regressio
More informationLesson 15 ANOVA (analysis of variance)
Outlie Variability betwee group variability withi group variability total variability Fratio Computatio sums of squares (betwee/withi/total degrees of freedom (betwee/withi/total mea square (betwee/withi
More informationSampling distributions and Estimation
Samplig distributios ad Estimatio Suppose we have a populatio about which we wat to kow some characteristic, e.g. height, icome, votig itetios. If it is a large populatio, it may be difficult to look at
More informationSection 8.2 Markov and Chebyshev Inequalities and the Weak Law of Large Numbers
Sectio 8. Markov ad Chebyshev Iequalities ad the Weak Law of Large Numbers THEOREM (Markov s Iequality): Suppose that X is a radom variable takig oly oegative values. The, for ay a > 0 we have X a} E[X]
More informationA Gentle Introduction to Algorithms: Part II
A Getle Itroductio to Algorithms: Part II Cotets of Part I:. Merge: (to merge two sorted lists ito a sigle sorted list.) 2. Bubble Sort 3. Merge Sort: 4. The BigO, BigΘ, BigΩ otatios: asymptotic bouds
More informationwhen n = 1, 2, 3, 4, 5, 6, This list represents the amount of dollars you have after n days. Note: The use of is read as and so on.
Geometric eries Before we defie what is meat by a series, we eed to itroduce a related topic, that of sequeces. Formally, a sequece is a fuctio that computes a ordered list. uppose that o day 1, you have
More informationRepeating Decimals are decimal numbers that have number(s) after the decimal point that repeat in a pattern.
5.5 Fractios ad Decimals Steps for Chagig a Fractio to a Decimal. Simplify the fractio, if possible. 2. Divide the umerator by the deomiator. d d Repeatig Decimals Repeatig Decimals are decimal umbers
More information1 The Binomial Theorem: Another Approach
The Biomial Theorem: Aother Approach Pascal s Triagle I class (ad i our text we saw that, for iteger, the biomial theorem ca be stated (a + b = c a + c a b + c a b + + c ab + c b, where the coefficiets
More informationLecture 1 Probability and Statistics
Lecture 1 Probability ad Statistics Itroductio: l Uderstadig of may physical pheomea deped o statistical ad probabilistic cocepts: H Statistical Mechaics (physics of systems composed of may parts: gases,
More information.04. This means $1000 is multiplied by 1.02 five times, once for each of the remaining sixmonth
Questio 1: What is a ordiary auity? Let s look at a ordiary auity that is certai ad simple. By this, we mea a auity over a fixed term whose paymet period matches the iterest coversio period. Additioally,
More informationChapter 6: Variance, the law of large numbers and the MonteCarlo method
Chapter 6: Variace, the law of large umbers ad the MoteCarlo method Expected value, variace, ad Chebyshev iequality. If X is a radom variable recall that the expected value of X, E[X] is the average value
More informationRevising algebra skills. Jackie Nicholas
Mathematics Learig Cetre Revisig algebra skills Jackie Nicholas c 005 Uiversity of Sydey Mathematics Learig Cetre, Uiversity of Sydey 1 1 Revisio of Algebraic Skills 1.1 Why use algebra? Algebra is used
More informationThe asymptotics of factorials, binomial coefficients and Catalan numbers. BarIlan University, Ramat Gan 52900, Israel
April 006 The asymptotics of factorials, biomial coefficiets ad Catala umbers David Kessler ad Jeremy Schiff Departmet of Physics Departmet of Mathematics BarIla Uiversity, Ramat Ga 5900, Israel kessler@davephbiuacil,
More information
Factoring x n 1: cyclotomic and Aurifeuillian polynomials Paul Garrett
(March 16, 004) Factorig x 1: cyclotomic ad Aurifeuillia polyomials Paul Garrett Polyomials of the form x 1, x 3 1, x 4 1 have at least oe systematic factorizatio x 1 = (x 1)(x 1
More informationChapter 9 Solutions Page 1 of 29 CHAPTER 9 EXERCISE SOLUTIONS
Chapter 9 Solutios Page 1 of 29 CHAPTER 9 EXERCISE SOLUTIONS 9.1 a. Statistic because it is a sample value. b. Parameter because it is a populatio value. c. Statistic because it is a sample value d. Parameter
More informationHandout: How to calculate time complexity? CSE 101 Winter 2014
Hadout: How to calculate time complexity? CSE 101 Witer 014 Recipe (a) Kow algorithm If you are usig a modied versio of a kow algorithm, you ca piggyback your aalysis o the complexity of the origial algorithm
More informationGEOMETRIC SEQUENCES BY JAMES D. NICKEL
I a arithmetic sequece, a commo differece separates each term i the sequece. For example, i the sequece 5,, 5, 0, 5,, the commo differece betwee terms is 5. I a geometric sequece, you calculate each successive
More informationSoving Recurrence Relations
Sovig Recurrece Relatios Part 1. Homogeeous liear 2d degree relatios with costat coefficiets. Cosider the recurrece relatio ( ) T () + at ( 1) + bt ( 2) = 0 This is called a homogeeous liear 2d degree
More informationMgr. ubomíra Tomková. Limit
Limit I mathematics, the cocept of a "limit" is used to describe the behaviour of a fuctio as its argumet either gets "close" to some poit, or as it becomes arbitrarily large; or the behaviour of a sequece's
More information4.1 Sigma Notation and Riemann Sums
0 the itegral. Sigma Notatio ad Riema Sums Oe strategy for calculatig the area of a regio is to cut the regio ito simple shapes, calculate the area of each simple shape, ad the add these smaller areas
More informationIEOR 165 Lecture 2 Method of Moments
IEOR 65 Lecture 2 Method of Momets Estimatig Mea ad Variace Imagie a sceario i which we are buildig a egieerig model for a telephoe call ceter to hadle airlie reservatios For the purpose of aalysis, we
More information5.3 Annuities. Question 1: What is an ordinary annuity? Question 2: What is an annuity due? Question 3: What is a sinking fund?
5.3 Auities Questio 1: What is a ordiary auity? Questio : What is a auity due? Questio 3: What is a sikig fud? A sequece of paymets or withdrawals made to or from a accout at regular time itervals is called
More informationA probabilistic proof of a binomial identity
A probabilistic proof of a biomial idetity Joatho Peterso Abstract We give a elemetary probabilistic proof of a biomial idetity. The proof is obtaied by computig the probability of a certai evet i two
More informationInferences On Two Samples
Overview Ifereces O Two Samples We cotiue with cofidece itervals ad hypothesis testig for more advaced models Models comparig two meas Whe the two meas are depedet Whe the two meas are idepedet Models
More informationINFERENCE ABOUT A POPULATION PROPORTION
CHAPTER 19 INFERENCE ABOUT A POPULATION PROPORTION OVERVIEW I this chapter, we cosider iferece about a populatio proportio p based o the sample proportio cout of successes i the sample p ˆ = cout of observatios
More informationLEARNING OBJECTIVES. 2.1 Derivation by Recursion: F/P factor. 2.1 Basic Derivations: F/P factor. 2.1 P/F factor discounting back in time
LEARNING OBJECTIVES Developed By: Dr. Do Smith, P.E. Departmet of Idustrial Egieerig Texas A&M Uiversity College Statio, Texas Executive Summary Versio Chapter 2 Factors: How Time ad Iterest Affect Moey.
More informationORDERS OF GROWTH KEITH CONRAD
ORDERS OF GROWTH KEITH CONRAD Itroductio Gaiig a ituitive feel for the relative growth of fuctios is importat if you really wat to uderstad their behavior It also helps you better grasp topics i calculus
More informationTHE REGRESSION MODEL IN MATRIX FORM. For simple linear regression, meaning one predictor, the model is. for i = 1, 2, 3,, n
We will cosider the liear regressio model i matrix form. For simple liear regressio, meaig oe predictor, the model is i = + x i + ε i for i =,,,, This model icludes the assumptio that the ε i s are a sample
More information2. Introduction to Statistics and Sampling
. Defiitios. Itroductio to Statistics ad Samplig.. Populatio.. Sample..3 Probability..4 Cotiuous vs. discrete variables we will cocetrate o cotiuous variables. Graphical Represetatio of a Fiite Sample
More informationChapter 9 Inferences from Two Samples. Section 91. Overview. Overview. Requirements. Section 92 Inferences About Two Proportions Key Concept
Chapter 9 Ifereces from Two Samples 9 Overview 9 Ifereces About Two Proportios 93 Ifereces About Two Meas: Idepedet Samples 94 Ifereces from Matched Pairs 95 Comparig Variatio i Two Samples Sectio
More informationLesson 12. Sequences and Series
Retur to List of Lessos Lesso. Sequeces ad Series A ifiite sequece { a, a, a,... a,...} ca be thought of as a list of umbers writte i defiite order ad certai patter. It is usually deoted by { a } =, or
More informationNPTEL STRUCTURAL RELIABILITY
NPTEL Course O STRUCTURAL RELIABILITY Module # 0 Lecture 1 Course Format: Web Istructor: Dr. Aruasis Chakraborty Departmet of Civil Egieerig Idia Istitute of Techology Guwahati 1. Lecture 01: Basic Statistics
More informationDerivation of the Poisson distribution
Gle Cowa RHUL Physics 1 December, 29 Derivatio of the Poisso distributio I this ote we derive the fuctioal form of the Poisso distributio ad ivestigate some of its properties. Cosider a time t i which
More informationSampling Error. Chapter 2 Student Lecture Notes 21. Chapter Goals. QM353 Business Statistics. Chapter Goals. Calculating Sampling Error.
Chapter Studet Lecture Notes 1 QM353 Busiess Statistics Chapter Samplig Distributios ad Estimatig Populatio Parameters Chapter Goals After completig this chapter, you should be able to: Defie the cocept
More informationAnalysis of DiscreteTime Linear TimeInvariant Systems
Chapter Aalysis of DiscreteTime Liear TimeIvariat Systems. Sigals.. Defiitios ad Notatio A sigal is a fuctio: sigal ad fuctio are syoymous. The two otios are the same, ad we will be usig them iterchageably.
More informationNormal Distribution.
Normal Distributio www.icrf.l Normal distributio I probability theory, the ormal or Gaussia distributio, is a cotiuous probability distributio that is ofte used as a first approimatio to describe realvalued
More informationIn nite Sequences. Dr. Philippe B. Laval Kennesaw State University. October 9, 2008
I ite Sequeces Dr. Philippe B. Laval Keesaw State Uiversity October 9, 2008 Abstract This had out is a itroductio to i ite sequeces. mai de itios ad presets some elemetary results. It gives the I ite Sequeces
More informationCSE 599d  Quantum Computing Simon s Algorithm
CSE 599d  Quatum Computig Simo s Algorithm Dave Baco Departmet of Computer Sciece & Egieerig, Uiversity of Washigto Berstei ad Vazirai showed the first superpolyomial separatio (relative to a oracle)
More informationAn Example of ASM Design: A Binary Multiplier
A Example of ASM Desig: A Biary Multiplier Itroductio Dr. D. Capso Electrical ad Computer Egieerig McMaster Uiversity A algorithmic state machie (ASM) is a Fiite State Machie that uses a sequetial circuit
More information7. Sample Covariance and Correlation
1 of 8 7/16/2009 6:06 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 7. Sample Covariace ad Correlatio The Bivariate Model Suppose agai that we have a basic radom experimet, ad that X ad Y
More informationStart with a general production function showing output (Y) as a function of capital (K) and labor (N):
Homewor 1 Le Cabrera Describe the effects o output per worer () ad capital per worer () b chages i savigs rate (s), labor growth rate (), depreciatio rate (δ), ad techical progress (A). There should be
More informationSolutions to InClass Problems Week 15, Mon
Massachusetts Istitute of Techology 6.042J/8.062J, Fall 02: Mathematics for Computer Sciece Prof. Albert Meyer ad Dr. Radhika Nagpal Solutios to IClass Problems Week 5, Mo Problem. Prove that the Cetral
More informationIntroduction to Algorithms / Algorithms I Lecturer: Michael Dinitz Topic: Probabilistic Analysis, randomized quicksort Date: 9/4/14
600.363 Itroductio to Algorithms / 600.463 Algorithms I Lecturer: Michael Diitz Topic: Probabilistic Aalysis, radomized quicksort Date: 9/4/14 3.1 Itroductio As we discussed the first lecture, oe issue
More informationLinear Algebra II. Notes 6 25th November 2010
MTH6140 Liear Algebra II Notes 6 25th November 2010 6 Quadratic forms A lot of applicatios of mathematics ivolve dealig with quadratic forms: you meet them i statistics (aalysis of variace) ad mechaics
More informationNotes 8 Autumn Some discrete random variables
MAS 108 Probability I Notes 8 Autum 2005 Some discrete radom variables We ow look at five types of discrete radom variables, each depedig o oe or more parameters. We describe for each type the situatios
More information5 Boolean Decision Trees (February 11)
5 Boolea Decisio Trees (February 11) 5.1 Graph Coectivity Suppose we are give a udirected graph G, represeted as a boolea adjacecy matrix = (a ij ), where a ij = 1 if ad oly if vertices i ad j are coected
More informationDepartment of Computer Science, University of Otago
Departmet of Computer Sciece, Uiversity of Otago Techical Report OUCS200609 Permutatios Cotaiig May Patters Authors: M.H. Albert Departmet of Computer Sciece, Uiversity of Otago Micah Colema, Rya Fly
More informationMATH 3070 Introduction to Probability and Statistics Lecture notes Relationships: Simple Regression
Objectives: MATH 3070 Itroductio to Probability ad Statistics Lecture otes Relatioships: Simple Regressio 1. Lear the equatio for simple regressio 2. Compute the regressio equatio for a give data set Simple
More information3. Continuous Random Variables
Statistics ad probability: 31 3. Cotiuous Radom Variables A cotiuous radom variable is a radom variable which ca take values measured o a cotiuous scale e.g. weights, stregths, times or legths. For ay
More informationPROBABILITY MODELS FOR ECONOMIC DECISIONS Chapter 3: Utility Theory with Constant Risk Tolerance
PROBABILITY MODELS FOR ECONOMIC DECISIONS Chapter 3: Utility Theory with Costat Risk Tolerace [excerpt] 3.4. Note o foudatios of utility theory Joh Vo Neuma ad Oskar Morgester showed i 1947 how simple
More informationRisk management Exercises Session 5 «Value at Risk»
Risk maagemet Exercises Sessio 5 «Value at Risk» «Small Questios» «Problems» Exercise Time horizo & Impact of correlatio Questio Suppose that the chage i the value of a portfolio over a day time period
More informationMATH 1D, WEEK 3 THE RATIO TEST, INTEGRAL TEST, AND ABSOLUTE CONVERGENCE
MATH D, WEEK 3 THE RATIO TEST, INTEGRAL TEST, AND ABSOLUTE CONVERGENCE INSTRUCTOR: PADRAIC BARTLETT Abstract. These are the lecture otes from week 3 of Mad, the Caltech mathematics course o sequeces ad
More informationThe Stable Marriage Problem
The Stable Marriage Problem William Hut Lae Departmet of Computer Sciece ad Electrical Egieerig, West Virgiia Uiversity, Morgatow, WV William.Hut@mail.wvu.edu 1 Itroductio Imagie you are a matchmaker,
More informationhp calculators HP 12C Statistics  average and standard deviation Average and standard deviation concepts HP12C average and standard deviation
HP 1C Statistics  average ad stadard deviatio Average ad stadard deviatio cocepts HP1C average ad stadard deviatio Practice calculatig averages ad stadard deviatios with oe or two variables HP 1C Statistics
More informationAsymptotic Growth of Functions
CMPS Itroductio to Aalysis of Algorithms Fall 3 Asymptotic Growth of Fuctios We itroduce several types of asymptotic otatio which are used to compare the performace ad efficiecy of algorithms As we ll
More informationThe following example will help us understand The Sampling Distribution of the Mean. C1 C2 C3 C4 C5 50 miles 84 miles 38 miles 120 miles 48 miles
The followig eample will help us uderstad The Samplig Distributio of the Mea Review: The populatio is the etire collectio of all idividuals or objects of iterest The sample is the portio of the populatio
More informationSection 1.6: Proof by Mathematical Induction
Sectio.6 Proof by Iductio Sectio.6: Proof by Mathematical Iductio Purpose of Sectio: To itroduce the Priciple of Mathematical Iductio, both weak ad the strog versios, ad show how certai types of theorems
More informationRandomized Algorithms I, Spring 2016, Department of Computer Science, University of Helsinki Homework 1: Solutions (Discussed January 29, 2016)
Radomized Algorithms I, Sprig 0, Departmet of Computer Sciece, Uiversity of Helsiki Homework : Solutios Discussed Jauary 9, 0). Exercise.: Cosider the followig ballsadbi game. We start with oe black
More informationHypothesis Tests Applied to Means
The Samplig Distributio of the Mea Hypothesis Tests Applied to Meas Recall that the samplig distributio of the mea is the distributio of sample meas that would be obtaied from a particular populatio (with
More informationSequences and Series
CHAPTER 9 Sequeces ad Series 9.. Covergece: Defiitio ad Examples Sequeces The purpose of this chapter is to itroduce a particular way of geeratig algorithms for fidig the values of fuctios defied by their
More informationThe Discrete Fourier Transform
The Discrete Fourier Trasform Fracis J. Narcowich October 4, 2005 1 Motivatio We wat to umerically approximate coefficiets i a Fourier series. The first step is to see how the trapezoidal rule applies
More informationAlternatives To Pearson s and Spearman s Correlation Coefficients
Alteratives To Pearso s ad Spearma s Correlatio Coefficiets Floreti Smaradache Chair of Math & Scieces Departmet Uiversity of New Mexico Gallup, NM 8730, USA Abstract. This article presets several alteratives
More informationLearning outcomes. Algorithms and Data Structures. Time Complexity Analysis. Time Complexity Analysis How fast is the algorithm? Prof. Dr.
Algorithms ad Data Structures Algorithm efficiecy Learig outcomes Able to carry out simple asymptotic aalysisof algorithms Prof. Dr. Qi Xi 2 Time Complexity Aalysis How fast is the algorithm? Code the
More information10 Moment generating functions
10 MOMENT GENERATING FUNCTIONS 119 10 Momet geeratig fuctios If X is a radom variable, the its momet geeratig fuctio is { φ(t) = φ X (t) = E(e tx x ) = etx P(X = x) i discrete case, etx f X (x)dx i cotiuous
More informationCHAPTER TWO PLANES AND LINES IN R 3
5 CHAPTER TWO PLANES AND LINES IN R 3.1 INTRODUCTION I this chapter we will use vector methods to derive equatios for plaes ad lies i three dimesioal space R 3. The derived equatios will be vector equatios
More informationA Recursive Formula for Moments of a Binomial Distribution
A Recursive Formula for Momets of a Biomial Distributio Árpád Béyi beyi@mathumassedu, Uiversity of Massachusetts, Amherst, MA 01003 ad Saverio M Maago smmaago@psavymil Naval Postgraduate School, Moterey,
More informationInvestigating Recursion Relations with Geometric Sequences
From Fiboacci to Fotrot: Ivestigatig Recursio Relatios with Geometric Sequeces 3 4 6 7 8 9 0 The Algebra Stadard from the Priciples ad Stadards for School Mathematics (NCTM, 000) states that all studets
More informationSection 9.2 Series and Convergence
Sectio 9. Series ad Covergece Goals of Chapter 9 Approximate Pi Prove ifiite series are aother importat applicatio of limits, derivatives, approximatio, slope, ad cocavity of fuctios. Fid challegig atiderivatives
More information