Chapter 7 Methods of Finding Estimators

Save this PDF as:
 WORD  PNG  TXT  JPG

Size: px
Start display at page:

Download "Chapter 7 Methods of Finding Estimators"

Transcription

1 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 Chapter 7 Methods of Fidig Estimators Sectio 7.1 Itroductio Defiitio A poit estimator is ay fuctio W( X) W( X1, X,, X ) of a sample; that is, ay statistic is a poit estimator. Notes: estimator: fuctio of the sample ( X ( X1, X,, X )) estimate: realized value (a umber) of a estimator (( x ( x1, x,, x ))) Sectio 7. Methods of Fidig Estimators 7..1 Method of Momets (MME) Notes: oldest method datig back at least to Karl Pearso i the late 1800s idea is simple, however, oftetimes, the resultig estimators may still be improved 1

2 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 Let X,, 1 X be iid from pmf or pdf f( x 1,, k ), we have 1 1 st sample momet: m1 X i1 1 st ' ' populatio momet: EX (,, ) k th sample momet: m k k X i1 i ' k ' k th populatio momet: EX (,, ) i k k 1 k k To get MME: Equate the first k sample momets to the correspodig k populatio momets ad solve these equatios for ( 1,, k ) i terms of ( m 1,, m ) ( X 1 1, X k k,, X ) i i1 i i1 i Example 7..1 (Normal method of momets) Suppose X,, 1 X are iid from a ad 1. (, ). I this case, k ad Solutio: 1 X i 1 i X ad 1 X i 1 i, we ca get:

3 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, X ad ( X ) i 1 i X S. Example 7.. (Biomial method of momets) Suppose X,, 1 X are iid from a biomial( mp, ) where both m ad p are ukow. I this case, k ad 1 m ad p. Solutio: From X mp ad 1 i1 X mp(1 p) m p mp(1 pmp), we have: i X m ad X 1/ ( X X ) i1 i p X m. Note: Method of momets may give estimates that are outside the rage of the parameters. 7.. Maximum Likelihood (MLE) Let X,, 1 X be iid from pmf or pdf f( x 1,, k ). The likelihood fuctio is defied by L( θ x) L(,, x,, x ) f( x,, ). 1 k 1 i 1 i 1 k 3

4 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 Defiitio 7..4 For each sample poit x, let ˆ( x ) be a parameter value at which L( θ x) attais its maximum as a fuctio of θ, with x held fixed. A maximum likelihood estimator (MLE) of the parameter θ based o a sample X is ˆ( X ). Notes: 1. Fidig the MLE ca be difficult i some cases.. MLE may be obtaied through differetiatio but i some cases differetiatio will ot work. 3. Whe differetiatio will be used to fid the MLE, it will be easier to deal with the atural log of the likelihood. 4. Maximizatio should be oly over the rage of the parameter. 5. If MLE caot be obtaied aalytically, it ca be obtaied umerically. Example 7..5 (Normal likelihood) Let X 1,, X are iid from a (,1). Show that X is the MLE of usig derivatives. Solutio: d Step 1: fid the solutio from the equatio: L ( x ) 0, which gives the possible solutios. d d Step : verify the solutio achieves the global maximum ( L( x) 0 x i this case). d 4

5 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 Step 3: check the boudaries ( i this case; it is ot ecessary i this case). Example 7..6 Recall Theorem 5..4 (p. 1) part (a): If x, 1 x are ay umbers ad For ay real umbers, we have: with equality if ad oly if a,. ( x ) ( ) 1 i a x i i 1 i x x. This implies that for ay, 1 1 exp( ( ) ) exp( ( ) ) i 1 i i 1 i x x x with equality if ad oly if x. So X is MLE. x 1 x i1 i, the Example 7..7 (Beroulli MLE) Let X,, 1 X are iid Beroulli( p ). Fid the MLE of p where 0 p 1. Note that we iclude the possibility that p 0 or p 1. Solutio: Use the atural log of the likelihood fuctio. Example 7..8 (Restricted rage MLE) Let X,, 1 X are iid from a (,1), where 0. Solutio: Without ay restrictio, X is the MLE. So whe x 0, ˆ x. Whe x 0, L( x ) achieves its maximum at ˆ 0 for 0, so ˆ 0 i this situatio. I summary: 5

6 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 ˆ X, X 0; XI[0, ) ( X ) 0, X 0. Example 7..9 (Biomial MLE, ukow umber of trials) Let X 1,, X are iid Biomial( k, p). Fid the MLE of k where p is kow ad k is ukow. (Example where differetiatio will ot be used to obtai the MLE.) Solutio: The likelihood fuctio is: (, ) k x i i (1 ) Lk px p p x. i1 x i The cosider the ratio: L( k p, x) / L( k 1 p, x ) Ivariace Property of Maximum Likelihood Estimators Defiitio Cosider a fuctio ( ) which may ot ecessarily be oe-to-oe fuctio so that for a give value, there may be more tha oe value such that ( ). The iduced likelihood fuctio, L *, of ( ) is give by: L*( x) sup L( x ). { : ( ) } The value ˆ that maximizes L *( x ) will be called the MLE of ( ). 6

7 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 Theorem (Ivariace Property of MLEs) If ˆ is the MLE of, the for ay fuctio ( ), the MLE of ( ) is ( ˆ ). Example Let X,, 1 X be iid (,1), the MLE of is X. Example Let X,, 1 X be iid biomial( k, p) where k is kow ad p is ukow. Fid the MLE of the variace ad stadard deviatio of X 1. Solutio: kp(1 p ), so ˆ kpˆ(1 pˆ) kx (1 X ). kp(1 p ), so ˆ kpˆ(1 pˆ) kx (1 X ). Example Let X,, 1 X be iid Poisso( ). Fid the MLE of PX ( 0). Solutio: The MLE of is: ˆ X. Because PX ( 0) exp( ), so the MLE of PX ( 0) is exp( X ). Note: Theorem icludes the multivariate case. If the MLE of ( 1,, k ) is ( ˆ ˆ 1,, k ), ad if ( 1,, k ) is ay fuctio of the parameter vector, the by the ivariace property of the MLE, the MLE of ( 1,, k ) is ( ˆ,, ˆ ). 1 k 7

8 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 Example (Normal MLEs, ad ukow) Let X,, 1 X are iid from a are ukow. The the MLE of is ˆ (, ) where both ad 1 1 X ad the MLE of is ˆ ( X ) i 1 i X S. Solutio: Verify these estimators usig (a) uivariate calculus (this Example, Example 7..11) ad (b) multivariate calculus (Example 7..1). Notes: 1. MLE is susceptible to problems associated with umerical istability if the MLEs do ot have explicitly expressio.. How sesitive is the MLE to measuremet error i the data? (see Example ) 7..3 Bayes Estimators Bayesia Approach to Statistics The parameter is a radom quatity described by a probability distributio kow as the prior distributio. A sample is the take from the populatio idexed by. The prior distributio is updated with this sample iformatio to get what is kow as the posterior distributio usig Bayes rule (Theorem p. 3). Let ( ) deote the prior distributio of ad let 8

9 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 f ( x ) be the samplig distributio of the sample. The posterior distributio of give the sample x is give by ( x) f ( x ) ( ), where m( x) is the margial distributio of x, i.e., m( x ) f( x ) ( ) d m( x). The posterior distributio is the used to make statemets about. For istace, the mea of the posterior distributio may be used as a poit estimate of. Example (Biomial Bayes estimatio) Let X 1,, X be iid Beroulli( p ), where p is ukow. The Y X is biomial(, p). We assume the prior distributio o p is beta(, ). The posterior distributio of i1 p give Y i y, f ( p y ), is beta( y, y ). Hece the Bayes estimate for p is the mea of the posterior distributio, i.e., Note that the mea of the prior distributio is ad pˆ B may be writte as pˆ B y. a y pˆ B. 9

10 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 Hece, the Bayes estimator is a liear combiatio of the sample mea ad the prior mea with weights determied by,, ad. Note: The prior ad the posterior distributios are both beta distributio. Defiitio Let deote the class of pdfs or pmfs f ( x ) (idexed by ). A class of prior distributios is a cojugate family for if the posterior distributio is the class of for all f, all priors i, ad all x. Example (Normal Bayes estimatio) Let X ~ (, ) where is kow. We assume the prior distributio o is (, ). The posterior distributio of give X x, is also ormal (Homework problem) with mea ad variace E( x) x Var( x). Notes: 10

11 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, The ormal family is its ow cojugate family.. If the prior iformatio is vague (i.e., is very large) the more weight is give to the sample data. 3. If the prior iformatio is good (i.e., ) the more weight is give to the prior mea. Sectio 7.3 Methods of Evaluatig Estimators Mea Squared Error Defiitio The mea squared error (MSE) of a estimator W of a parameter is the fuctio defied by where BiasW EW. MSE E ( W ) Var W ( Bias W ), Defiitio 7.3. The bias of a poit estimator W of a parameter is the differece betwee the expected value of W ad. A estimator whose bias is idetically (i ) equal to 0 is called ubiased ad satisfies E W. for all If W is ubiased the MSE E( W ) VarW. 11

12 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 Example (Normal MSE) Let X 1,, X be iid from a estimators of ad, respectively, (, ). We kow that X ad S are ubiased EX ad ES (which is true eve without ormality see Theorem 5..6), i.e., for all ad. Thus ad MSE( X ) E( X ) /, (Recall that ( 1) S / ~ 4 MSES ( ) ES ( ) VarS. 1 Chi-square with 1 degrees of freedom, which is gamma( ( 1) /, ) ad Var( Y ) if ~ (, ) Y gamma.) Example Let X,, 1 X be iid from a (, ). Recall that the MLE (ad MME) of is Note that 1 1 ˆ ( X ) i 1 i X S. 1

13 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 ad so that From these formulas, you ca verify that 1 1 E( ˆ ) E( S ). 1 1 ( 1) 4 Var ˆ Var( S ) Var( S ), ( 1) MSE( ˆ ) Var( ˆ ) [ Bias( ˆ )]. ˆ has the smaller MSE tha S. Example (MSE of biomial Bayes estimators) Suppose X,, 1 X are iid from a Beroulli( p ). (1) MLE: ˆp X is ubiased estimator for p ad () Bayes estimator: pˆ B The MSE of p ˆ B is Y p(1 p) MSE( pˆ) E ( ˆ p p p) Varp( X ). p ( ) p is a Biased estimator because E ( ˆ p pb) p. 13

14 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 MSE( pˆ ) Var ( pˆ ) [ E ( pˆ p)] B p B p B Y pp Varp ( ) ( ) p(1 p) p p ( ) ( ). If we choose /4, we have MSE( pˆ B) 4( ) as a costat ad pˆ B Y /4. I this situatio, we ca determie which of these two estimators is better i terms of the MSE. Skip equivariace example (Example 7.3.6) 7.3. Best Ubiased Estimator Cosider the class of estimators C { W : EW ( )}. For ay W1, W C, we have BiasW1 BiasW ( ), so MSE( W ) MSE( W ) E ( W ) E ( W ) Var ( W ) Var ( W )

15 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 Defiitio A estimator W * is a best ubiased estimator of ( ) if it satisfies EW * ( ) for all ad, for ay other estimator W with EW ( ), we have Var ( W*) Var ( W ) for all. W * is also called a uiform miimum variace ubiased estimator (UMVUE) of ( ). Note: UMVUE may ot ecessarily exist. If UMVUE exists, it is uique (Theorem ). Example (Poisso ubiased estimatio) Let X,, 1 X be iid from a Poisso( ). Note that E ( X) ad ES for all. Thus, both X ad Also, ote that the class of estimators give by is a class of ubiased estimators for 0 a 1. S are ubiased estimators of. W (, ) (1 ) a X S ax a S To determie which estimator has the smallest MSE, we eed to calculate Var ( X ) Var ax ( (1 a) S ). The calculatio ca be very legthy., Var S ( ), ad The questio here is, how ca we fid the best, i.e., smallest variace, of these ubiased estimators? 15

16 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 Theorem (Cramer-Rao iequality) Let X,, 1 X be a sample with pdf f ( x ) ad let W W X1 X ( X) (,, ) be ay estimator satisfyig d E W ( X) [ W ( ) f ( )] d d x x x ad The Var ( W ( X )). where log is the atural logarithm. d ( EW ( X)) Var ( ( )) d W X. E (( log f( X )) ) Corollary (Cram er-rao iequality, iid case) If the assumptios of Theorem are satisfied ad, additioally, X,, 1 X are iid with pdf f ( x ), the d ( EW ( X)) Var ( ( )) d W X. E (( log f ( X )) ) Notes: 16

17 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, The quatity E (( log f( X )) ) is called iformatio umber, or Fisher iformatio, of the sample.. The iformatio umber gives a boud o the variace of the best ubiased estimator of. 3. As the iformatio umber icreases, we have more iformatio about, ad we have a smaller boud. The followig lemma helps i the computatio of the CRLB. Lemma If f ( x ) satisfies d E ( log f ( X )) [( log f ( x )) f ( x )] dx d (true for a expoetial family), the E f X E f X {[ log ( )] } ( log ( )). Example Recall the Poisso problem. We will show that X is the UMVUE of. Note: 17

18 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 Key assumptio of the Cram er-rao Theorem is that oe ca differetiate uder the itegral sig. Below is a example where this assumptio is ot satisfied. Example (Ubiased estimator for the scale uiform) Let X,, 1 X be iid with pdf f ( x ) 1/,0 x. Note: Cramer-Rao Lower Boud (CRLB) is ot guarateed to be sharp, i.e., there is o guaratee that the CRLB ca be attaied. Example (Normal variace boud) Let X,, 1 X be iid (, ). We have: hece S has variace larger tha the CRLB. 4 4 CRLB but Var( S ), 1 Questio: How do we kow if there exists a ubiased estimator that achieves the CRLB? 18

19 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 Corollary (Attaimet) Let X,, 1 X be iid with pdf f ( x ), where f ( x ) satisfies the coditios of the Cramer-Rao Theorem. Let i 1 L( x ) f( x ) deote the likelihood fuctio. If W( X) W( X1,, X ) is ay ubiased estimator of ( ), the W ( X ) attais the CRLB if ad oly if i for some fuctio a( ). a( )[ W( X) ( )] log L( x ) Example Recall the ormal problem. so that 1 1 L(, x ) exp{ ( ) } / x i 1 i, ( ) ( x ) 1 i i L 4 log (, x ) ( ). 1 If μ is kow, CRLB is achieved ad the UMVUE is W( X ) ( X ) i 1 i of will achieve the CRLB.. Otherwise, o ubiased estimator Questio: 19

20 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, What ca we do to fid the best estimator if f ( x ) does ot satisfy the assumptios of the Cramer-Rao Theorem.. What if the CRLB is ot attaiable, how do we kow if our estimator is the best? Sufficiecy ad Ubiasedess Recall two importat results: E( X) E[ E( X Y)] ad Var( X ) Var[ E( X Y )] E[ Var( X Y )]. Theorem (Rao-Blackwell) Let W be ay ubiased estimator of ( ), ad let T be a sufficiet statistic for. Defie ( T) E( W T). The E ( ( T)) ( ) ad Var( ( T )) Var( W ) for all ; i.e., ( T ) is a uiformly better ubiased estimator of ( ). Notes: 1. Coditioig ay ubiased estimator o a sufficiet statistic will result i a improved estimator.. To fid the UMVUE, oly eed to cosider fuctios of the sufficiet statistic. 3. Sufficiecy is eeded so that the resultig quatity (estimator) after coditioig o the sufficiet statistic will ot deped o. 0

21 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 Example (Coditioig o a isufficiet statistic) Let X 1 ad X be iid from (,1). The X is a ubiased estimator (ad a sufficiet statistic) of. Suppose we coditio X o X 1 which is ot a sufficiet statistic. Let ( X1) E ( X1) E( X X1). The ( X1) is ubiased for ad has a smaller variace tha X but is ot a valid estimator. Theorem If W is a best ubiased estimator of ( ), the W is uique. Let W be such that E ( W) ( ) ad let U be such that E ( U) 0 for all. The a W au, where a is a costat forms a class of ubiased estimators of with Var( a) VarW acov( W, U ) a VarU. Questio: Which is a better estimator, W or a? Theorem If E ( W) ( ), W is the best ubiased estimator of ( ) if ad oly if W is ucorrelated with all ubiased estimators of 0. 1

22 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 Example (Ubiased estimators of 0) Let X be a observatio from uiform(, 1) distributio. The Therefore, EX xdx ad Var X. 1 1 X is a ubiased estimator of. We will show that of 0, ad hece caot be a best ubiased estimator of. 1 X is correlated with a ubiased estimator Note: If a family of pdfs f ( x ) has the property that there are o ubiased estimators of 0 other tha 0 itself, the our search would be eded sice Cov( W,0) 0. What is this property called? Example 7.3. (cotiuatio of Example ) Let X 1,, X be iid uiform (0, ) The Y X is a ubiased estimator of. ( ) 1 Y where Solutio: 1. Coditios of Cramer-Rao Theorem were ot satisfied.. By Rao-Blackwell Theorem, we oly eed to cosider ubiased estimator of based o Y. 3. Y is a complete sufficiet statistic, therefore Y is ucorrelated with all ubiased estimators of 0 sice this would just be 0 itself.

23 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, Y is the best ubiased estimator of. Importat Note: What is critical is the completeess of the family of distributios of the sufficiet statistics ot the completeess of the origial family. Theorem Let T be a complete sufficiet statistic for a parameter, ad let ( T ) be ay estimator based oly o T. The ( T ) is the uique best ubiased estimator of its expected value. Result: If T is a complete sufficiet statistic for a parameter ad hx ( 1,, X ) is ay ubiased estimator of ( ), the ( T) E[ h( X1,, X) T] is the uique best ubiased estimator of ( ). Example (Biomial best ubiased estimatio) Let X,, 1 X be iid biomial( k, ). We wat to estimate ( ) ( 1) (1 ) k 1 P X k. Solutio: Recall that X i ~ biomial( k, ) is a complete sufficiet statistic for. i1 3

24 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 Questio: How about a ubiased estimator for ( )? Oce we fid a ubiased estimator, how do we get the best ubiased estimator? Loss Fuctio Optimality Decisio Theory: Settig: Observed data: X x where X~ f ( x ). Let = actio space, i.e., set of allowable decisios regardig. Defiitio: Loss fuctio is a oegative fuctio that geerally icreases as the distace betwee a actio, a, ad icreases. Note: L(, ) 0 (What does this mea? the loss is miimum if the actio is correct) If is real-valued, two commoly used loss fuctios are absolute error loss L(, a) a : more pealty o small discrepacies 4

25 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 squared error loss L(, a) ( a) : more pealty o large discrepacies Other examples: L(, a) which pealizes overestimatio more tha uderestimatio. ( a), a ; 10( a), a. L(, a) [( a) ]/( 1), pealizes errors i estimatio more if is ear 0 tha if is large Defiitio: I decisio theoretic aalysis, the quality of a estimator, ( X ), is quatified by its risk fuctio defied by R(, ) E L(, ( X )), i.e., at a give the risk fuctio is the average loss that will be icurred if the estimator ( X ) is used. Notes: MSE is a example of a risk fuctio with respect to the squared error loss. R(, ) E L(, ( X)) E ( ( X)) Var ( ( X)) ( Bias ( ( X ))). We wat to fid a estimator that has a small risk fuctio for all relative to aother estimator. However, most of the time the risk fuctios of two estimators cross. 5

26 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 Example (Biomial risk fuctios) Recall Example comparig the Bayes estimator ad the MLE of the Beroulli parameter p. pˆ B X /4 i 1 i ad p 1 ˆ X X i1 i. Example (Risk of ormal variace) Let X 1,, X be iid from (, ). We wat to estimate cosiderig estimators of the form ( X ) bs. Solutio: Recall that ES b 4 ad for ormal samples Var( S ). 1 The risk fuctio with respect to the squared error loss is R((, ), ) Var( bs ) ( E( bs ) ) b b Var( bs ) ( b ) b 1 4 [ ( b 1) ]. Notes: 1. The resultig risk fuctio does ot deped o. 6

27 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, b value that miimizes this risk fuctio is give by b. Thus, for every value of 1 estimator with the smallest risk amog all estimators of the form ( X ) bs is 1 1 ( ) (See Figure 7.3. p. 351 for =5). 1 1 S S X i 1 i X b (, ), the Example (Variace estimatio usig Stei s loss) Let X,, 1 X be iid from a populatio with positive fiite variace,. We wat to estimate. Solutio: Cosiderig estimators of the form ( X ) bs ad the loss fuctio I this case, the risk fuctio is give by Note that L b a a (attributed to Stei) (, a) 1 log bs bs S R E b b E (, b) ( 1log ) 1log (log ). S E(log ) does ot deped o b. To miimize this risk fuctio, we fid b that miimizes log( ) b b which is whe b 1. Hece, the estimator with the smallest risk for all values of 1 1( X ) S ( ) i 1 i 1 X X. is 7

28 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 Bayesia Approach to Loss Fuctio Defiitio: Give a prior distributio ( ), the Bayes risk x x x R(, ) ( ) d ( L(, ( )) f( ) d ) ( ) d ad the estimator that results i the smallest value of the Bayes risk is kow as the Bayes rule with respect to a prior ( ). Note that R(, ) ( ) d [ L(, ( x)) ( x) d] m( x) dx where the quatity i the square brackets is kow as the posterior expected loss. The actio ( X ) that miimizes the posterior expected loss will also miimize the Bayes risk. Example (Two Bayes rules) Suppose we wat to estimate. 1. For the squared error loss, the posterior expected loss is x X x, ( a) ( ) d E(( a) ) 8

29 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 where ~ ( x ). This is miimized by ( x) E( x ) so that the Bayes rule is the mea of the posterior distributio (Example..6).. For the absolute error loss, the posterior expected loss is a ( x) d E( a Xx ) miimized by ( x) E( x ) = media of the posterior distributio (Exercise.18). Example (Normal Bayes estimates) Let X,, 1 X be iid from (, ) ad let ( ) be (, ), where,, are kow. From Example ad your homework problem (Exercise 7.), the posterior distributio of give X x is ormal with mea ad / E( x) x ( / ) ( / ) / Var( x). / 1. For the squared error loss, ( x ) E( x). For the absolute error loss, 9

30 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 ( x ) = media of the posterior distributio = E( x). 30

Properties of MLE: consistency, asymptotic normality. Fisher information.

Properties of MLE: consistency, asymptotic normality. Fisher information. Lecture 3 Properties of MLE: cosistecy, asymptotic ormality. Fisher iformatio. I this sectio we will try to uderstad why MLEs are good. Let us recall two facts from probability that we be used ofte throughout

More information

Chapter 7 - Sampling Distributions. 1 Introduction. What is statistics? It consist of three major areas:

Chapter 7 - Sampling Distributions. 1 Introduction. What is statistics? It consist of three major areas: Chapter 7 - Samplig Distributios 1 Itroductio What is statistics? It cosist of three major areas: Data Collectio: samplig plas ad experimetal desigs Descriptive Statistics: umerical ad graphical summaries

More information

BASIC STATISTICS. f(x 1,x 2,..., x n )=f(x 1 )f(x 2 ) f(x n )= f(x i ) (1)

BASIC STATISTICS. f(x 1,x 2,..., x n )=f(x 1 )f(x 2 ) f(x n )= f(x i ) (1) BASIC STATISTICS. SAMPLES, RANDOM SAMPLING AND SAMPLE STATISTICS.. Radom Sample. The radom variables X,X 2,..., X are called a radom sample of size from the populatio f(x if X,X 2,..., X are mutually idepedet

More information

Maximum Likelihood Estimators.

Maximum Likelihood Estimators. Lecture 2 Maximum Likelihood Estimators. Matlab example. As a motivatio, let us look at oe Matlab example. Let us geerate a radom sample of size 00 from beta distributio Beta(5, 2). We will lear the defiitio

More information

University of California, Los Angeles Department of Statistics. Distributions related to the normal distribution

University of California, Los Angeles Department of Statistics. Distributions related to the normal distribution Uiversity of Califoria, Los Ageles Departmet of Statistics Statistics 100B Istructor: Nicolas Christou Three importat distributios: Distributios related to the ormal distributio Chi-square (χ ) distributio.

More information

I. Chi-squared Distributions

I. Chi-squared Distributions 1 M 358K Supplemet to Chapter 23: CHI-SQUARED DISTRIBUTIONS, T-DISTRIBUTIONS, AND DEGREES OF FREEDOM To uderstad t-distributios, we first eed to look at aother family of distributios, the chi-squared distributios.

More information

Chapter 6: Variance, the law of large numbers and the Monte-Carlo method

Chapter 6: Variance, the law of large numbers and the Monte-Carlo method Chapter 6: Variace, the law of large umbers ad the Mote-Carlo method Expected value, variace, ad Chebyshev iequality. If X is a radom variable recall that the expected value of X, E[X] is the average value

More information

Normal Distribution.

Normal Distribution. Normal Distributio www.icrf.l Normal distributio I probability theory, the ormal or Gaussia distributio, is a cotiuous probability distributio that is ofte used as a first approimatio to describe realvalued

More information

Asymptotic Growth of Functions

Asymptotic Growth of Functions CMPS Itroductio to Aalysis of Algorithms Fall 3 Asymptotic Growth of Fuctios We itroduce several types of asymptotic otatio which are used to compare the performace ad efficiecy of algorithms As we ll

More information

Solutions to Selected Problems In: Pattern Classification by Duda, Hart, Stork

Solutions to Selected Problems In: Pattern Classification by Duda, Hart, Stork Solutios to Selected Problems I: Patter Classificatio by Duda, Hart, Stork Joh L. Weatherwax February 4, 008 Problem Solutios Chapter Bayesia Decisio Theory Problem radomized rules Part a: Let Rx be the

More information

Confidence Intervals for One Mean

Confidence Intervals for One Mean Chapter 420 Cofidece Itervals for Oe Mea Itroductio This routie calculates the sample size ecessary to achieve a specified distace from the mea to the cofidece limit(s) at a stated cofidece level for a

More information

Statistical inference: example 1. Inferential Statistics

Statistical inference: example 1. Inferential Statistics Statistical iferece: example 1 Iferetial Statistics POPULATION SAMPLE A clothig store chai regularly buys from a supplier large quatities of a certai piece of clothig. Each item ca be classified either

More information

Output Analysis (2, Chapters 10 &11 Law)

Output Analysis (2, Chapters 10 &11 Law) B. Maddah ENMG 6 Simulatio 05/0/07 Output Aalysis (, Chapters 10 &11 Law) Comparig alterative system cofiguratio Sice the output of a simulatio is radom, the comparig differet systems via simulatio should

More information

THE REGRESSION MODEL IN MATRIX FORM. For simple linear regression, meaning one predictor, the model is. for i = 1, 2, 3,, n

THE REGRESSION MODEL IN MATRIX FORM. For simple linear regression, meaning one predictor, the model is. for i = 1, 2, 3,, n We will cosider the liear regressio model i matrix form. For simple liear regressio, meaig oe predictor, the model is i = + x i + ε i for i =,,,, This model icludes the assumptio that the ε i s are a sample

More information

1 Computing the Standard Deviation of Sample Means

1 Computing the Standard Deviation of Sample Means Computig the Stadard Deviatio of Sample Meas Quality cotrol charts are based o sample meas ot o idividual values withi a sample. A sample is a group of items, which are cosidered all together for our aalysis.

More information

1. C. The formula for the confidence interval for a population mean is: x t, which was

1. C. The formula for the confidence interval for a population mean is: x t, which was s 1. C. The formula for the cofidece iterval for a populatio mea is: x t, which was based o the sample Mea. So, x is guarateed to be i the iterval you form.. D. Use the rule : p-value

More information

SAMPLE QUESTIONS FOR FINAL EXAM. (1) (2) (3) (4) Find the following using the definition of the Riemann integral: (2x + 1)dx

SAMPLE QUESTIONS FOR FINAL EXAM. (1) (2) (3) (4) Find the following using the definition of the Riemann integral: (2x + 1)dx SAMPLE QUESTIONS FOR FINAL EXAM REAL ANALYSIS I FALL 006 3 4 Fid the followig usig the defiitio of the Riema itegral: a 0 x + dx 3 Cosider the partitio P x 0 3, x 3 +, x 3 +,......, x 3 3 + 3 of the iterval

More information

0.7 0.6 0.2 0 0 96 96.5 97 97.5 98 98.5 99 99.5 100 100.5 96.5 97 97.5 98 98.5 99 99.5 100 100.5

0.7 0.6 0.2 0 0 96 96.5 97 97.5 98 98.5 99 99.5 100 100.5 96.5 97 97.5 98 98.5 99 99.5 100 100.5 Sectio 13 Kolmogorov-Smirov test. Suppose that we have a i.i.d. sample X 1,..., X with some ukow distributio P ad we would like to test the hypothesis that P is equal to a particular distributio P 0, i.e.

More information

Hypothesis testing. Null and alternative hypotheses

Hypothesis testing. Null and alternative hypotheses Hypothesis testig Aother importat use of samplig distributios is to test hypotheses about populatio parameters, e.g. mea, proportio, regressio coefficiets, etc. For example, it is possible to stipulate

More information

5: Introduction to Estimation

5: Introduction to Estimation 5: Itroductio to Estimatio Cotets Acroyms ad symbols... 1 Statistical iferece... Estimatig µ with cofidece... 3 Samplig distributio of the mea... 3 Cofidece Iterval for μ whe σ is kow before had... 4 Sample

More information

Overview of some probability distributions.

Overview of some probability distributions. Lecture Overview of some probability distributios. I this lecture we will review several commo distributios that will be used ofte throughtout the class. Each distributio is usually described by its probability

More information

Measures of Spread and Boxplots Discrete Math, Section 9.4

Measures of Spread and Boxplots Discrete Math, Section 9.4 Measures of Spread ad Boxplots Discrete Math, Sectio 9.4 We start with a example: Example 1: Comparig Mea ad Media Compute the mea ad media of each data set: S 1 = {4, 6, 8, 10, 1, 14, 16} S = {4, 7, 9,

More information

Sampling Distribution And Central Limit Theorem

Sampling Distribution And Central Limit Theorem () Samplig Distributio & Cetral Limit Samplig Distributio Ad Cetral Limit Samplig distributio of the sample mea If we sample a umber of samples (say k samples where k is very large umber) each of size,

More information

Sequences and Series

Sequences and Series CHAPTER 9 Sequeces ad Series 9.. Covergece: Defiitio ad Examples Sequeces The purpose of this chapter is to itroduce a particular way of geeratig algorithms for fidig the values of fuctios defied by their

More information

UC Berkeley Department of Electrical Engineering and Computer Science. EE 126: Probablity and Random Processes. Solutions 9 Spring 2006

UC Berkeley Department of Electrical Engineering and Computer Science. EE 126: Probablity and Random Processes. Solutions 9 Spring 2006 Exam format UC Bereley Departmet of Electrical Egieerig ad Computer Sciece EE 6: Probablity ad Radom Processes Solutios 9 Sprig 006 The secod midterm will be held o Wedesday May 7; CHECK the fial exam

More information

CHAPTER 7: Central Limit Theorem: CLT for Averages (Means)

CHAPTER 7: Central Limit Theorem: CLT for Averages (Means) CHAPTER 7: Cetral Limit Theorem: CLT for Averages (Meas) X = the umber obtaied whe rollig oe six sided die oce. If we roll a six sided die oce, the mea of the probability distributio is X P(X = x) Simulatio:

More information

A probabilistic proof of a binomial identity

A probabilistic proof of a binomial identity A probabilistic proof of a biomial idetity Joatho Peterso Abstract We give a elemetary probabilistic proof of a biomial idetity. The proof is obtaied by computig the probability of a certai evet i two

More information

Case Study. Normal and t Distributions. Density Plot. Normal Distributions

Case Study. Normal and t Distributions. Density Plot. Normal Distributions Case Study Normal ad t Distributios Bret Halo ad Bret Larget Departmet of Statistics Uiversity of Wiscosi Madiso October 11 13, 2011 Case Study Body temperature varies withi idividuals over time (it ca

More information

Soving Recurrence Relations

Soving Recurrence Relations Sovig Recurrece Relatios Part 1. Homogeeous liear 2d degree relatios with costat coefficiets. Cosider the recurrece relatio ( ) T () + at ( 1) + bt ( 2) = 0 This is called a homogeeous liear 2d degree

More information

1 Correlation and Regression Analysis

1 Correlation and Regression Analysis 1 Correlatio ad Regressio Aalysis I this sectio we will be ivestigatig the relatioship betwee two cotiuous variable, such as height ad weight, the cocetratio of a ijected drug ad heart rate, or the cosumptio

More information

Chapter 14 Nonparametric Statistics

Chapter 14 Nonparametric Statistics Chapter 14 Noparametric Statistics A.K.A. distributio-free statistics! Does ot deped o the populatio fittig ay particular type of distributio (e.g, ormal). Sice these methods make fewer assumptios, they

More information

Convexity, Inequalities, and Norms

Convexity, Inequalities, and Norms Covexity, Iequalities, ad Norms Covex Fuctios You are probably familiar with the otio of cocavity of fuctios. Give a twicedifferetiable fuctio ϕ: R R, We say that ϕ is covex (or cocave up) if ϕ (x) 0 for

More information

In nite Sequences. Dr. Philippe B. Laval Kennesaw State University. October 9, 2008

In nite Sequences. Dr. Philippe B. Laval Kennesaw State University. October 9, 2008 I ite Sequeces Dr. Philippe B. Laval Keesaw State Uiversity October 9, 2008 Abstract This had out is a itroductio to i ite sequeces. mai de itios ad presets some elemetary results. It gives the I ite Sequeces

More information

Z-TEST / Z-STATISTIC: used to test hypotheses about. µ when the population standard deviation is unknown

Z-TEST / Z-STATISTIC: used to test hypotheses about. µ when the population standard deviation is unknown Z-TEST / Z-STATISTIC: used to test hypotheses about µ whe the populatio stadard deviatio is kow ad populatio distributio is ormal or sample size is large T-TEST / T-STATISTIC: used to test hypotheses about

More information

Chapter 5: Inner Product Spaces

Chapter 5: Inner Product Spaces Chapter 5: Ier Product Spaces Chapter 5: Ier Product Spaces SECION A Itroductio to Ier Product Spaces By the ed of this sectio you will be able to uderstad what is meat by a ier product space give examples

More information

LECTURE 13: Cross-validation

LECTURE 13: Cross-validation LECTURE 3: Cross-validatio Resampli methods Cross Validatio Bootstrap Bias ad variace estimatio with the Bootstrap Three-way data partitioi Itroductio to Patter Aalysis Ricardo Gutierrez-Osua Texas A&M

More information

3. Greatest Common Divisor - Least Common Multiple

3. Greatest Common Divisor - Least Common Multiple 3 Greatest Commo Divisor - Least Commo Multiple Defiitio 31: The greatest commo divisor of two atural umbers a ad b is the largest atural umber c which divides both a ad b We deote the greatest commo gcd

More information

STATISTICAL METHODS FOR BUSINESS

STATISTICAL METHODS FOR BUSINESS STATISTICAL METHODS FOR BUSINESS UNIT 7: INFERENTIAL TOOLS. DISTRIBUTIONS ASSOCIATED WITH SAMPLING 7.1.- Distributios associated with the samplig process. 7.2.- Iferetial processes ad relevat distributios.

More information

Infinite Sequences and Series

Infinite Sequences and Series CHAPTER 4 Ifiite Sequeces ad Series 4.1. Sequeces A sequece is a ifiite ordered list of umbers, for example the sequece of odd positive itegers: 1, 3, 5, 7, 9, 11, 13, 15, 17, 19, 21, 23, 25, 27, 29...

More information

Overview. Learning Objectives. Point Estimate. Estimation. Estimating the Value of a Parameter Using Confidence Intervals

Overview. Learning Objectives. Point Estimate. Estimation. Estimating the Value of a Parameter Using Confidence Intervals Overview Estimatig the Value of a Parameter Usig Cofidece Itervals We apply the results about the sample mea the problem of estimatio Estimatio is the process of usig sample data estimate the value of

More information

PSYCHOLOGICAL STATISTICS

PSYCHOLOGICAL STATISTICS UNIVERSITY OF CALICUT SCHOOL OF DISTANCE EDUCATION B Sc. Cousellig Psychology (0 Adm.) IV SEMESTER COMPLEMENTARY COURSE PSYCHOLOGICAL STATISTICS QUESTION BANK. Iferetial statistics is the brach of statistics

More information

Unbiased Estimation. Topic 14. 14.1 Introduction

Unbiased Estimation. Topic 14. 14.1 Introduction Topic 4 Ubiased Estimatio 4. Itroductio I creatig a parameter estimator, a fudametal questio is whether or ot the estimator differs from the parameter i a systematic maer. Let s examie this by lookig a

More information

Our aim is to show that under reasonable assumptions a given 2π-periodic function f can be represented as convergent series

Our aim is to show that under reasonable assumptions a given 2π-periodic function f can be represented as convergent series 8 Fourier Series Our aim is to show that uder reasoable assumptios a give -periodic fuctio f ca be represeted as coverget series f(x) = a + (a cos x + b si x). (8.) By defiitio, the covergece of the series

More information

Determining the sample size

Determining the sample size Determiig the sample size Oe of the most commo questios ay statisticia gets asked is How large a sample size do I eed? Researchers are ofte surprised to fid out that the aswer depeds o a umber of factors

More information

Chapter 7: Confidence Interval and Sample Size

Chapter 7: Confidence Interval and Sample Size Chapter 7: Cofidece Iterval ad Sample Size Learig Objectives Upo successful completio of Chapter 7, you will be able to: Fid the cofidece iterval for the mea, proportio, ad variace. Determie the miimum

More information

Math C067 Sampling Distributions

Math C067 Sampling Distributions Math C067 Samplig Distributios Sample Mea ad Sample Proportio Richard Beigel Some time betwee April 16, 2007 ad April 16, 2007 Examples of Samplig A pollster may try to estimate the proportio of voters

More information

arxiv:1506.03481v1 [stat.me] 10 Jun 2015

arxiv:1506.03481v1 [stat.me] 10 Jun 2015 BEHAVIOUR OF ABC FOR BIG DATA By Wetao Li ad Paul Fearhead Lacaster Uiversity arxiv:1506.03481v1 [stat.me] 10 Ju 2015 May statistical applicatios ivolve models that it is difficult to evaluate the likelihood,

More information

Lesson 17 Pearson s Correlation Coefficient

Lesson 17 Pearson s Correlation Coefficient Outlie Measures of Relatioships Pearso s Correlatio Coefficiet (r) -types of data -scatter plots -measure of directio -measure of stregth Computatio -covariatio of X ad Y -uique variatio i X ad Y -measurig

More information

Research Article Sign Data Derivative Recovery

Research Article Sign Data Derivative Recovery Iteratioal Scholarly Research Network ISRN Applied Mathematics Volume 0, Article ID 63070, 7 pages doi:0.540/0/63070 Research Article Sig Data Derivative Recovery L. M. Housto, G. A. Glass, ad A. D. Dymikov

More information

Taking DCOP to the Real World: Efficient Complete Solutions for Distributed Multi-Event Scheduling

Taking DCOP to the Real World: Efficient Complete Solutions for Distributed Multi-Event Scheduling Taig DCOP to the Real World: Efficiet Complete Solutios for Distributed Multi-Evet Schedulig Rajiv T. Maheswara, Milid Tambe, Emma Bowrig, Joatha P. Pearce, ad Pradeep araatham Uiversity of Souther Califoria

More information

Non-life insurance mathematics. Nils F. Haavardsson, University of Oslo and DNB Skadeforsikring

Non-life insurance mathematics. Nils F. Haavardsson, University of Oslo and DNB Skadeforsikring No-life isurace mathematics Nils F. Haavardsso, Uiversity of Oslo ad DNB Skadeforsikrig Mai issues so far Why does isurace work? How is risk premium defied ad why is it importat? How ca claim frequecy

More information

PROCEEDINGS OF THE YEREVAN STATE UNIVERSITY AN ALTERNATIVE MODEL FOR BONUS-MALUS SYSTEM

PROCEEDINGS OF THE YEREVAN STATE UNIVERSITY AN ALTERNATIVE MODEL FOR BONUS-MALUS SYSTEM PROCEEDINGS OF THE YEREVAN STATE UNIVERSITY Physical ad Mathematical Scieces 2015, 1, p. 15 19 M a t h e m a t i c s AN ALTERNATIVE MODEL FOR BONUS-MALUS SYSTEM A. G. GULYAN Chair of Actuarial Mathematics

More information

CS103A Handout 23 Winter 2002 February 22, 2002 Solving Recurrence Relations

CS103A Handout 23 Winter 2002 February 22, 2002 Solving Recurrence Relations CS3A Hadout 3 Witer 00 February, 00 Solvig Recurrece Relatios Itroductio A wide variety of recurrece problems occur i models. Some of these recurrece relatios ca be solved usig iteratio or some other ad

More information

THE HEIGHT OF q-binary SEARCH TREES

THE HEIGHT OF q-binary SEARCH TREES THE HEIGHT OF q-binary SEARCH TREES MICHAEL DRMOTA AND HELMUT PRODINGER Abstract. q biary search trees are obtaied from words, equipped with the geometric distributio istead of permutatios. The average

More information

Confidence Intervals. CI for a population mean (σ is known and n > 30 or the variable is normally distributed in the.

Confidence Intervals. CI for a population mean (σ is known and n > 30 or the variable is normally distributed in the. Cofidece Itervals A cofidece iterval is a iterval whose purpose is to estimate a parameter (a umber that could, i theory, be calculated from the populatio, if measuremets were available for the whole populatio).

More information

Universal coding for classes of sources

Universal coding for classes of sources Coexios module: m46228 Uiversal codig for classes of sources Dever Greee This work is produced by The Coexios Project ad licesed uder the Creative Commos Attributio Licese We have discussed several parametric

More information

Section 11.3: The Integral Test

Section 11.3: The Integral Test Sectio.3: The Itegral Test Most of the series we have looked at have either diverged or have coverged ad we have bee able to fid what they coverge to. I geeral however, the problem is much more difficult

More information

Modified Line Search Method for Global Optimization

Modified Line Search Method for Global Optimization Modified Lie Search Method for Global Optimizatio Cria Grosa ad Ajith Abraham Ceter of Excellece for Quatifiable Quality of Service Norwegia Uiversity of Sciece ad Techology Trodheim, Norway {cria, ajith}@q2s.tu.o

More information

MEI Structured Mathematics. Module Summary Sheets. Statistics 2 (Version B: reference to new book)

MEI Structured Mathematics. Module Summary Sheets. Statistics 2 (Version B: reference to new book) MEI Mathematics i Educatio ad Idustry MEI Structured Mathematics Module Summary Sheets Statistics (Versio B: referece to ew book) Topic : The Poisso Distributio Topic : The Normal Distributio Topic 3:

More information

Lecture 13. Lecturer: Jonathan Kelner Scribe: Jonathan Pines (2009)

Lecture 13. Lecturer: Jonathan Kelner Scribe: Jonathan Pines (2009) 18.409 A Algorithmist s Toolkit October 27, 2009 Lecture 13 Lecturer: Joatha Keler Scribe: Joatha Pies (2009) 1 Outlie Last time, we proved the Bru-Mikowski iequality for boxes. Today we ll go over the

More information

INFINITE SERIES KEITH CONRAD

INFINITE SERIES KEITH CONRAD INFINITE SERIES KEITH CONRAD. Itroductio The two basic cocepts of calculus, differetiatio ad itegratio, are defied i terms of limits (Newto quotiets ad Riema sums). I additio to these is a third fudametal

More information

Department of Computer Science, University of Otago

Department of Computer Science, University of Otago Departmet of Computer Sciece, Uiversity of Otago Techical Report OUCS-2006-09 Permutatios Cotaiig May Patters Authors: M.H. Albert Departmet of Computer Sciece, Uiversity of Otago Micah Colema, Rya Fly

More information

MARTINGALES AND A BASIC APPLICATION

MARTINGALES AND A BASIC APPLICATION MARTINGALES AND A BASIC APPLICATION TURNER SMITH Abstract. This paper will develop the measure-theoretic approach to probability i order to preset the defiitio of martigales. From there we will apply this

More information

Ekkehart Schlicht: Economic Surplus and Derived Demand

Ekkehart Schlicht: Economic Surplus and Derived Demand Ekkehart Schlicht: Ecoomic Surplus ad Derived Demad Muich Discussio Paper No. 2006-17 Departmet of Ecoomics Uiversity of Muich Volkswirtschaftliche Fakultät Ludwig-Maximilias-Uiversität Müche Olie at http://epub.ub.ui-mueche.de/940/

More information

, a Wishart distribution with n -1 degrees of freedom and scale matrix.

, a Wishart distribution with n -1 degrees of freedom and scale matrix. UMEÅ UNIVERSITET Matematisk-statistiska istitutioe Multivariat dataaalys D MSTD79 PA TENTAMEN 004-0-9 LÖSNINGSFÖRSLAG TILL TENTAMEN I MATEMATISK STATISTIK Multivariat dataaalys D, 5 poäg.. Assume that

More information

The analysis of the Cournot oligopoly model considering the subjective motive in the strategy selection

The analysis of the Cournot oligopoly model considering the subjective motive in the strategy selection The aalysis of the Courot oligopoly model cosiderig the subjective motive i the strategy selectio Shigehito Furuyama Teruhisa Nakai Departmet of Systems Maagemet Egieerig Faculty of Egieerig Kasai Uiversity

More information

CS103X: Discrete Structures Homework 4 Solutions

CS103X: Discrete Structures Homework 4 Solutions CS103X: Discrete Structures Homewor 4 Solutios Due February 22, 2008 Exercise 1 10 poits. Silico Valley questios: a How may possible six-figure salaries i whole dollar amouts are there that cotai at least

More information

CHAPTER 3 THE TIME VALUE OF MONEY

CHAPTER 3 THE TIME VALUE OF MONEY CHAPTER 3 THE TIME VALUE OF MONEY OVERVIEW A dollar i the had today is worth more tha a dollar to be received i the future because, if you had it ow, you could ivest that dollar ad ear iterest. Of all

More information

Week 3 Conditional probabilities, Bayes formula, WEEK 3 page 1 Expected value of a random variable

Week 3 Conditional probabilities, Bayes formula, WEEK 3 page 1 Expected value of a random variable Week 3 Coditioal probabilities, Bayes formula, WEEK 3 page 1 Expected value of a radom variable We recall our discussio of 5 card poker hads. Example 13 : a) What is the probability of evet A that a 5

More information

Incremental calculation of weighted mean and variance

Incremental calculation of weighted mean and variance Icremetal calculatio of weighted mea ad variace Toy Fich faf@cam.ac.uk dot@dotat.at Uiversity of Cambridge Computig Service February 009 Abstract I these otes I eplai how to derive formulae for umerically

More information

Class Meeting # 16: The Fourier Transform on R n

Class Meeting # 16: The Fourier Transform on R n MATH 18.152 COUSE NOTES - CLASS MEETING # 16 18.152 Itroductio to PDEs, Fall 2011 Professor: Jared Speck Class Meetig # 16: The Fourier Trasform o 1. Itroductio to the Fourier Trasform Earlier i the course,

More information

Hypergeometric Distributions

Hypergeometric Distributions 7.4 Hypergeometric Distributios Whe choosig the startig lie-up for a game, a coach obviously has to choose a differet player for each positio. Similarly, whe a uio elects delegates for a covetio or you

More information

Lecture 3. denote the orthogonal complement of S k. Then. 1 x S k. n. 2 x T Ax = ( ) λ x. with x = 1, we have. i = λ k x 2 = λ k.

Lecture 3. denote the orthogonal complement of S k. Then. 1 x S k. n. 2 x T Ax = ( ) λ x. with x = 1, we have. i = λ k x 2 = λ k. 18.409 A Algorithmist s Toolkit September 17, 009 Lecture 3 Lecturer: Joatha Keler Scribe: Adre Wibisoo 1 Outlie Today s lecture covers three mai parts: Courat-Fischer formula ad Rayleigh quotiets The

More information

A Recursive Formula for Moments of a Binomial Distribution

A Recursive Formula for Moments of a Binomial Distribution A Recursive Formula for Momets of a Biomial Distributio Árpád Béyi beyi@mathumassedu, Uiversity of Massachusetts, Amherst, MA 01003 ad Saverio M Maago smmaago@psavymil Naval Postgraduate School, Moterey,

More information

GCSE STATISTICS. 4) How to calculate the range: The difference between the biggest number and the smallest number.

GCSE STATISTICS. 4) How to calculate the range: The difference between the biggest number and the smallest number. GCSE STATISTICS You should kow: 1) How to draw a frequecy diagram: e.g. NUMBER TALLY FREQUENCY 1 3 5 ) How to draw a bar chart, a pictogram, ad a pie chart. 3) How to use averages: a) Mea - add up all

More information

TIGHT BOUNDS ON EXPECTED ORDER STATISTICS

TIGHT BOUNDS ON EXPECTED ORDER STATISTICS Probability i the Egieerig ad Iformatioal Scieces, 20, 2006, 667 686+ Prited i the U+S+A+ TIGHT BOUNDS ON EXPECTED ORDER STATISTICS DIMITRIS BERTSIMAS Sloa School of Maagemet ad Operatios Research Ceter

More information

Building Blocks Problem Related to Harmonic Series

Building Blocks Problem Related to Harmonic Series TMME, vol3, o, p.76 Buildig Blocks Problem Related to Harmoic Series Yutaka Nishiyama Osaka Uiversity of Ecoomics, Japa Abstract: I this discussio I give a eplaatio of the divergece ad covergece of ifiite

More information

hp calculators HP 12C Statistics - average and standard deviation Average and standard deviation concepts HP12C average and standard deviation

hp calculators HP 12C Statistics - average and standard deviation Average and standard deviation concepts HP12C average and standard deviation HP 1C Statistics - average ad stadard deviatio Average ad stadard deviatio cocepts HP1C average ad stadard deviatio Practice calculatig averages ad stadard deviatios with oe or two variables HP 1C Statistics

More information

Confidence Intervals

Confidence Intervals Cofidece Itervals Cofidece Itervals are a extesio of the cocept of Margi of Error which we met earlier i this course. Remember we saw: The sample proportio will differ from the populatio proportio by more

More information

The following example will help us understand The Sampling Distribution of the Mean. C1 C2 C3 C4 C5 50 miles 84 miles 38 miles 120 miles 48 miles

The following example will help us understand The Sampling Distribution of the Mean. C1 C2 C3 C4 C5 50 miles 84 miles 38 miles 120 miles 48 miles The followig eample will help us uderstad The Samplig Distributio of the Mea Review: The populatio is the etire collectio of all idividuals or objects of iterest The sample is the portio of the populatio

More information

THE TWO-VARIABLE LINEAR REGRESSION MODEL

THE TWO-VARIABLE LINEAR REGRESSION MODEL THE TWO-VARIABLE LINEAR REGRESSION MODEL Herma J. Bieres Pesylvaia State Uiversity April 30, 202. Itroductio Suppose you are a ecoomics or busiess maor i a college close to the beach i the souther part

More information

NEW HIGH PERFORMANCE COMPUTATIONAL METHODS FOR MORTGAGES AND ANNUITIES. Yuri Shestopaloff,

NEW HIGH PERFORMANCE COMPUTATIONAL METHODS FOR MORTGAGES AND ANNUITIES. Yuri Shestopaloff, NEW HIGH PERFORMNCE COMPUTTIONL METHODS FOR MORTGGES ND NNUITIES Yuri Shestopaloff, Geerally, mortgage ad auity equatios do ot have aalytical solutios for ukow iterest rate, which has to be foud usig umerical

More information

Estimating Probability Distributions by Observing Betting Practices

Estimating Probability Distributions by Observing Betting Practices 5th Iteratioal Symposium o Imprecise Probability: Theories ad Applicatios, Prague, Czech Republic, 007 Estimatig Probability Distributios by Observig Bettig Practices Dr C Lych Natioal Uiversity of Irelad,

More information

Basic Elements of Arithmetic Sequences and Series

Basic Elements of Arithmetic Sequences and Series MA40S PRE-CALCULUS UNIT G GEOMETRIC SEQUENCES CLASS NOTES (COMPLETED NO NEED TO COPY NOTES FROM OVERHEAD) Basic Elemets of Arithmetic Sequeces ad Series Objective: To establish basic elemets of arithmetic

More information

Parameter estimation for nonlinear models: Numerical approaches to solving the inverse problem. Lecture 11 04/01/2008. Sven Zenker

Parameter estimation for nonlinear models: Numerical approaches to solving the inverse problem. Lecture 11 04/01/2008. Sven Zenker Parameter estimatio for oliear models: Numerical approaches to solvig the iverse problem Lecture 11 04/01/2008 Sve Zeker Review: Trasformatio of radom variables Cosider probability distributio of a radom

More information

Heavy Traffic Analysis of a Simple Closed Loop Supply Chain

Heavy Traffic Analysis of a Simple Closed Loop Supply Chain Heavy Traffic Aalysis of a Simple Closed Loop Supply Chai Arka Ghosh, Sarah M. Rya, Lizhi Wag, ad Aada Weerasighe April 8, 2 Abstract We cosider a closed loop supply chai where ew products are produced

More information

FIBONACCI NUMBERS: AN APPLICATION OF LINEAR ALGEBRA. 1. Powers of a matrix

FIBONACCI NUMBERS: AN APPLICATION OF LINEAR ALGEBRA. 1. Powers of a matrix FIBONACCI NUMBERS: AN APPLICATION OF LINEAR ALGEBRA. Powers of a matrix We begi with a propositio which illustrates the usefuless of the diagoalizatio. Recall that a square matrix A is diogaalizable if

More information

7. Concepts in Probability, Statistics and Stochastic Modelling

7. Concepts in Probability, Statistics and Stochastic Modelling 7. Cocepts i Probability, Statistics ad Stochastic Modellig 1. Itroductio 169. Probability Cocepts ad Methods 170.1. Radom Variables ad Distributios 170.. Expectatio 173.3. Quatiles, Momets ad Their Estimators

More information

Vladimir N. Burkov, Dmitri A. Novikov MODELS AND METHODS OF MULTIPROJECTS MANAGEMENT

Vladimir N. Burkov, Dmitri A. Novikov MODELS AND METHODS OF MULTIPROJECTS MANAGEMENT Keywords: project maagemet, resource allocatio, etwork plaig Vladimir N Burkov, Dmitri A Novikov MODELS AND METHODS OF MULTIPROJECTS MANAGEMENT The paper deals with the problems of resource allocatio betwee

More information

Discrete Mathematics and Probability Theory Spring 2014 Anant Sahai Note 13

Discrete Mathematics and Probability Theory Spring 2014 Anant Sahai Note 13 EECS 70 Discrete Mathematics ad Probability Theory Sprig 2014 Aat Sahai Note 13 Itroductio At this poit, we have see eough examples that it is worth just takig stock of our model of probability ad may

More information

Lecture 4: Cauchy sequences, Bolzano-Weierstrass, and the Squeeze theorem

Lecture 4: Cauchy sequences, Bolzano-Weierstrass, and the Squeeze theorem Lecture 4: Cauchy sequeces, Bolzao-Weierstrass, ad the Squeeze theorem The purpose of this lecture is more modest tha the previous oes. It is to state certai coditios uder which we are guarateed that limits

More information

where: T = number of years of cash flow in investment's life n = the year in which the cash flow X n i = IRR = the internal rate of return

where: T = number of years of cash flow in investment's life n = the year in which the cash flow X n i = IRR = the internal rate of return EVALUATING ALTERNATIVE CAPITAL INVESTMENT PROGRAMS By Ke D. Duft, Extesio Ecoomist I the March 98 issue of this publicatio we reviewed the procedure by which a capital ivestmet project was assessed. The

More information

Center, Spread, and Shape in Inference: Claims, Caveats, and Insights

Center, Spread, and Shape in Inference: Claims, Caveats, and Insights Ceter, Spread, ad Shape i Iferece: Claims, Caveats, ad Isights Dr. Nacy Pfeig (Uiversity of Pittsburgh) AMATYC November 2008 Prelimiary Activities 1. I would like to produce a iterval estimate for the

More information

1. MATHEMATICAL INDUCTION

1. MATHEMATICAL INDUCTION 1. MATHEMATICAL INDUCTION EXAMPLE 1: Prove that for ay iteger 1. Proof: 1 + 2 + 3 +... + ( + 1 2 (1.1 STEP 1: For 1 (1.1 is true, sice 1 1(1 + 1. 2 STEP 2: Suppose (1.1 is true for some k 1, that is 1

More information

A Mathematical Perspective on Gambling

A Mathematical Perspective on Gambling A Mathematical Perspective o Gamblig Molly Maxwell Abstract. This paper presets some basic topics i probability ad statistics, icludig sample spaces, probabilistic evets, expectatios, the biomial ad ormal

More information

Trigonometric Form of a Complex Number. The Complex Plane. axis. ( 2, 1) or 2 i FIGURE 6.44. The absolute value of the complex number z a bi is

Trigonometric Form of a Complex Number. The Complex Plane. axis. ( 2, 1) or 2 i FIGURE 6.44. The absolute value of the complex number z a bi is 0_0605.qxd /5/05 0:45 AM Page 470 470 Chapter 6 Additioal Topics i Trigoometry 6.5 Trigoometric Form of a Complex Number What you should lear Plot complex umbers i the complex plae ad fid absolute values

More information

Research Method (I) --Knowledge on Sampling (Simple Random Sampling)

Research Method (I) --Knowledge on Sampling (Simple Random Sampling) Research Method (I) --Kowledge o Samplig (Simple Radom Samplig) 1. Itroductio to samplig 1.1 Defiitio of samplig Samplig ca be defied as selectig part of the elemets i a populatio. It results i the fact

More information

Irreducible polynomials with consecutive zero coefficients

Irreducible polynomials with consecutive zero coefficients Irreducible polyomials with cosecutive zero coefficiets Theodoulos Garefalakis Departmet of Mathematics, Uiversity of Crete, 71409 Heraklio, Greece Abstract Let q be a prime power. We cosider the problem

More information

Lesson 15 ANOVA (analysis of variance)

Lesson 15 ANOVA (analysis of variance) Outlie Variability -betwee group variability -withi group variability -total variability -F-ratio Computatio -sums of squares (betwee/withi/total -degrees of freedom (betwee/withi/total -mea square (betwee/withi

More information

1 The Gaussian channel

1 The Gaussian channel ECE 77 Lecture 0 The Gaussia chael Objective: I this lecture we will lear about commuicatio over a chael of practical iterest, i which the trasmitted sigal is subjected to additive white Gaussia oise.

More information