Chapter 7 Methods of Finding Estimators


 Meredith Molly Franklin
 3 years ago
 Views:
Transcription
1 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 Chapter 7 Methods of Fidig Estimators Sectio 7.1 Itroductio Defiitio A poit estimator is ay fuctio W( X) W( X1, X,, X ) of a sample; that is, ay statistic is a poit estimator. Notes: estimator: fuctio of the sample ( X ( X1, X,, X )) estimate: realized value (a umber) of a estimator (( x ( x1, x,, x ))) Sectio 7. Methods of Fidig Estimators 7..1 Method of Momets (MME) Notes: oldest method datig back at least to Karl Pearso i the late 1800s idea is simple, however, oftetimes, the resultig estimators may still be improved 1
2 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 Let X,, 1 X be iid from pmf or pdf f( x 1,, k ), we have 1 1 st sample momet: m1 X i1 1 st ' ' populatio momet: EX (,, ) k th sample momet: m k k X i1 i ' k ' k th populatio momet: EX (,, ) i k k 1 k k To get MME: Equate the first k sample momets to the correspodig k populatio momets ad solve these equatios for ( 1,, k ) i terms of ( m 1,, m ) ( X 1 1, X k k,, X ) i i1 i i1 i Example 7..1 (Normal method of momets) Suppose X,, 1 X are iid from a ad 1. (, ). I this case, k ad Solutio: 1 X i 1 i X ad 1 X i 1 i, we ca get:
3 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, X ad ( X ) i 1 i X S. Example 7.. (Biomial method of momets) Suppose X,, 1 X are iid from a biomial( mp, ) where both m ad p are ukow. I this case, k ad 1 m ad p. Solutio: From X mp ad 1 i1 X mp(1 p) m p mp(1 pmp), we have: i X m ad X 1/ ( X X ) i1 i p X m. Note: Method of momets may give estimates that are outside the rage of the parameters. 7.. Maximum Likelihood (MLE) Let X,, 1 X be iid from pmf or pdf f( x 1,, k ). The likelihood fuctio is defied by L( θ x) L(,, x,, x ) f( x,, ). 1 k 1 i 1 i 1 k 3
4 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 Defiitio 7..4 For each sample poit x, let ˆ( x ) be a parameter value at which L( θ x) attais its maximum as a fuctio of θ, with x held fixed. A maximum likelihood estimator (MLE) of the parameter θ based o a sample X is ˆ( X ). Notes: 1. Fidig the MLE ca be difficult i some cases.. MLE may be obtaied through differetiatio but i some cases differetiatio will ot work. 3. Whe differetiatio will be used to fid the MLE, it will be easier to deal with the atural log of the likelihood. 4. Maximizatio should be oly over the rage of the parameter. 5. If MLE caot be obtaied aalytically, it ca be obtaied umerically. Example 7..5 (Normal likelihood) Let X 1,, X are iid from a (,1). Show that X is the MLE of usig derivatives. Solutio: d Step 1: fid the solutio from the equatio: L ( x ) 0, which gives the possible solutios. d d Step : verify the solutio achieves the global maximum ( L( x) 0 x i this case). d 4
5 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 Step 3: check the boudaries ( i this case; it is ot ecessary i this case). Example 7..6 Recall Theorem 5..4 (p. 1) part (a): If x, 1 x are ay umbers ad For ay real umbers, we have: with equality if ad oly if a,. ( x ) ( ) 1 i a x i i 1 i x x. This implies that for ay, 1 1 exp( ( ) ) exp( ( ) ) i 1 i i 1 i x x x with equality if ad oly if x. So X is MLE. x 1 x i1 i, the Example 7..7 (Beroulli MLE) Let X,, 1 X are iid Beroulli( p ). Fid the MLE of p where 0 p 1. Note that we iclude the possibility that p 0 or p 1. Solutio: Use the atural log of the likelihood fuctio. Example 7..8 (Restricted rage MLE) Let X,, 1 X are iid from a (,1), where 0. Solutio: Without ay restrictio, X is the MLE. So whe x 0, ˆ x. Whe x 0, L( x ) achieves its maximum at ˆ 0 for 0, so ˆ 0 i this situatio. I summary: 5
6 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 ˆ X, X 0; XI[0, ) ( X ) 0, X 0. Example 7..9 (Biomial MLE, ukow umber of trials) Let X 1,, X are iid Biomial( k, p). Fid the MLE of k where p is kow ad k is ukow. (Example where differetiatio will ot be used to obtai the MLE.) Solutio: The likelihood fuctio is: (, ) k x i i (1 ) Lk px p p x. i1 x i The cosider the ratio: L( k p, x) / L( k 1 p, x ) Ivariace Property of Maximum Likelihood Estimators Defiitio Cosider a fuctio ( ) which may ot ecessarily be oetooe fuctio so that for a give value, there may be more tha oe value such that ( ). The iduced likelihood fuctio, L *, of ( ) is give by: L*( x) sup L( x ). { : ( ) } The value ˆ that maximizes L *( x ) will be called the MLE of ( ). 6
7 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 Theorem (Ivariace Property of MLEs) If ˆ is the MLE of, the for ay fuctio ( ), the MLE of ( ) is ( ˆ ). Example Let X,, 1 X be iid (,1), the MLE of is X. Example Let X,, 1 X be iid biomial( k, p) where k is kow ad p is ukow. Fid the MLE of the variace ad stadard deviatio of X 1. Solutio: kp(1 p ), so ˆ kpˆ(1 pˆ) kx (1 X ). kp(1 p ), so ˆ kpˆ(1 pˆ) kx (1 X ). Example Let X,, 1 X be iid Poisso( ). Fid the MLE of PX ( 0). Solutio: The MLE of is: ˆ X. Because PX ( 0) exp( ), so the MLE of PX ( 0) is exp( X ). Note: Theorem icludes the multivariate case. If the MLE of ( 1,, k ) is ( ˆ ˆ 1,, k ), ad if ( 1,, k ) is ay fuctio of the parameter vector, the by the ivariace property of the MLE, the MLE of ( 1,, k ) is ( ˆ,, ˆ ). 1 k 7
8 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 Example (Normal MLEs, ad ukow) Let X,, 1 X are iid from a are ukow. The the MLE of is ˆ (, ) where both ad 1 1 X ad the MLE of is ˆ ( X ) i 1 i X S. Solutio: Verify these estimators usig (a) uivariate calculus (this Example, Example 7..11) ad (b) multivariate calculus (Example 7..1). Notes: 1. MLE is susceptible to problems associated with umerical istability if the MLEs do ot have explicitly expressio.. How sesitive is the MLE to measuremet error i the data? (see Example ) 7..3 Bayes Estimators Bayesia Approach to Statistics The parameter is a radom quatity described by a probability distributio kow as the prior distributio. A sample is the take from the populatio idexed by. The prior distributio is updated with this sample iformatio to get what is kow as the posterior distributio usig Bayes rule (Theorem p. 3). Let ( ) deote the prior distributio of ad let 8
9 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 f ( x ) be the samplig distributio of the sample. The posterior distributio of give the sample x is give by ( x) f ( x ) ( ), where m( x) is the margial distributio of x, i.e., m( x ) f( x ) ( ) d m( x). The posterior distributio is the used to make statemets about. For istace, the mea of the posterior distributio may be used as a poit estimate of. Example (Biomial Bayes estimatio) Let X 1,, X be iid Beroulli( p ), where p is ukow. The Y X is biomial(, p). We assume the prior distributio o p is beta(, ). The posterior distributio of i1 p give Y i y, f ( p y ), is beta( y, y ). Hece the Bayes estimate for p is the mea of the posterior distributio, i.e., Note that the mea of the prior distributio is ad pˆ B may be writte as pˆ B y. a y pˆ B. 9
10 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 Hece, the Bayes estimator is a liear combiatio of the sample mea ad the prior mea with weights determied by,, ad. Note: The prior ad the posterior distributios are both beta distributio. Defiitio Let deote the class of pdfs or pmfs f ( x ) (idexed by ). A class of prior distributios is a cojugate family for if the posterior distributio is the class of for all f, all priors i, ad all x. Example (Normal Bayes estimatio) Let X ~ (, ) where is kow. We assume the prior distributio o is (, ). The posterior distributio of give X x, is also ormal (Homework problem) with mea ad variace E( x) x Var( x). Notes: 10
11 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, The ormal family is its ow cojugate family.. If the prior iformatio is vague (i.e., is very large) the more weight is give to the sample data. 3. If the prior iformatio is good (i.e., ) the more weight is give to the prior mea. Sectio 7.3 Methods of Evaluatig Estimators Mea Squared Error Defiitio The mea squared error (MSE) of a estimator W of a parameter is the fuctio defied by where BiasW EW. MSE E ( W ) Var W ( Bias W ), Defiitio 7.3. The bias of a poit estimator W of a parameter is the differece betwee the expected value of W ad. A estimator whose bias is idetically (i ) equal to 0 is called ubiased ad satisfies E W. for all If W is ubiased the MSE E( W ) VarW. 11
12 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 Example (Normal MSE) Let X 1,, X be iid from a estimators of ad, respectively, (, ). We kow that X ad S are ubiased EX ad ES (which is true eve without ormality see Theorem 5..6), i.e., for all ad. Thus ad MSE( X ) E( X ) /, (Recall that ( 1) S / ~ 4 MSES ( ) ES ( ) VarS. 1 Chisquare with 1 degrees of freedom, which is gamma( ( 1) /, ) ad Var( Y ) if ~ (, ) Y gamma.) Example Let X,, 1 X be iid from a (, ). Recall that the MLE (ad MME) of is Note that 1 1 ˆ ( X ) i 1 i X S. 1
13 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 ad so that From these formulas, you ca verify that 1 1 E( ˆ ) E( S ). 1 1 ( 1) 4 Var ˆ Var( S ) Var( S ), ( 1) MSE( ˆ ) Var( ˆ ) [ Bias( ˆ )]. ˆ has the smaller MSE tha S. Example (MSE of biomial Bayes estimators) Suppose X,, 1 X are iid from a Beroulli( p ). (1) MLE: ˆp X is ubiased estimator for p ad () Bayes estimator: pˆ B The MSE of p ˆ B is Y p(1 p) MSE( pˆ) E ( ˆ p p p) Varp( X ). p ( ) p is a Biased estimator because E ( ˆ p pb) p. 13
14 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 MSE( pˆ ) Var ( pˆ ) [ E ( pˆ p)] B p B p B Y pp Varp ( ) ( ) p(1 p) p p ( ) ( ). If we choose /4, we have MSE( pˆ B) 4( ) as a costat ad pˆ B Y /4. I this situatio, we ca determie which of these two estimators is better i terms of the MSE. Skip equivariace example (Example 7.3.6) 7.3. Best Ubiased Estimator Cosider the class of estimators C { W : EW ( )}. For ay W1, W C, we have BiasW1 BiasW ( ), so MSE( W ) MSE( W ) E ( W ) E ( W ) Var ( W ) Var ( W )
15 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 Defiitio A estimator W * is a best ubiased estimator of ( ) if it satisfies EW * ( ) for all ad, for ay other estimator W with EW ( ), we have Var ( W*) Var ( W ) for all. W * is also called a uiform miimum variace ubiased estimator (UMVUE) of ( ). Note: UMVUE may ot ecessarily exist. If UMVUE exists, it is uique (Theorem ). Example (Poisso ubiased estimatio) Let X,, 1 X be iid from a Poisso( ). Note that E ( X) ad ES for all. Thus, both X ad Also, ote that the class of estimators give by is a class of ubiased estimators for 0 a 1. S are ubiased estimators of. W (, ) (1 ) a X S ax a S To determie which estimator has the smallest MSE, we eed to calculate Var ( X ) Var ax ( (1 a) S ). The calculatio ca be very legthy., Var S ( ), ad The questio here is, how ca we fid the best, i.e., smallest variace, of these ubiased estimators? 15
16 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 Theorem (CramerRao iequality) Let X,, 1 X be a sample with pdf f ( x ) ad let W W X1 X ( X) (,, ) be ay estimator satisfyig d E W ( X) [ W ( ) f ( )] d d x x x ad The Var ( W ( X )). where log is the atural logarithm. d ( EW ( X)) Var ( ( )) d W X. E (( log f( X )) ) Corollary (Cram errao iequality, iid case) If the assumptios of Theorem are satisfied ad, additioally, X,, 1 X are iid with pdf f ( x ), the d ( EW ( X)) Var ( ( )) d W X. E (( log f ( X )) ) Notes: 16
17 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, The quatity E (( log f( X )) ) is called iformatio umber, or Fisher iformatio, of the sample.. The iformatio umber gives a boud o the variace of the best ubiased estimator of. 3. As the iformatio umber icreases, we have more iformatio about, ad we have a smaller boud. The followig lemma helps i the computatio of the CRLB. Lemma If f ( x ) satisfies d E ( log f ( X )) [( log f ( x )) f ( x )] dx d (true for a expoetial family), the E f X E f X {[ log ( )] } ( log ( )). Example Recall the Poisso problem. We will show that X is the UMVUE of. Note: 17
18 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 Key assumptio of the Cram errao Theorem is that oe ca differetiate uder the itegral sig. Below is a example where this assumptio is ot satisfied. Example (Ubiased estimator for the scale uiform) Let X,, 1 X be iid with pdf f ( x ) 1/,0 x. Note: CramerRao Lower Boud (CRLB) is ot guarateed to be sharp, i.e., there is o guaratee that the CRLB ca be attaied. Example (Normal variace boud) Let X,, 1 X be iid (, ). We have: hece S has variace larger tha the CRLB. 4 4 CRLB but Var( S ), 1 Questio: How do we kow if there exists a ubiased estimator that achieves the CRLB? 18
19 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 Corollary (Attaimet) Let X,, 1 X be iid with pdf f ( x ), where f ( x ) satisfies the coditios of the CramerRao Theorem. Let i 1 L( x ) f( x ) deote the likelihood fuctio. If W( X) W( X1,, X ) is ay ubiased estimator of ( ), the W ( X ) attais the CRLB if ad oly if i for some fuctio a( ). a( )[ W( X) ( )] log L( x ) Example Recall the ormal problem. so that 1 1 L(, x ) exp{ ( ) } / x i 1 i, ( ) ( x ) 1 i i L 4 log (, x ) ( ). 1 If μ is kow, CRLB is achieved ad the UMVUE is W( X ) ( X ) i 1 i of will achieve the CRLB.. Otherwise, o ubiased estimator Questio: 19
20 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, What ca we do to fid the best estimator if f ( x ) does ot satisfy the assumptios of the CramerRao Theorem.. What if the CRLB is ot attaiable, how do we kow if our estimator is the best? Sufficiecy ad Ubiasedess Recall two importat results: E( X) E[ E( X Y)] ad Var( X ) Var[ E( X Y )] E[ Var( X Y )]. Theorem (RaoBlackwell) Let W be ay ubiased estimator of ( ), ad let T be a sufficiet statistic for. Defie ( T) E( W T). The E ( ( T)) ( ) ad Var( ( T )) Var( W ) for all ; i.e., ( T ) is a uiformly better ubiased estimator of ( ). Notes: 1. Coditioig ay ubiased estimator o a sufficiet statistic will result i a improved estimator.. To fid the UMVUE, oly eed to cosider fuctios of the sufficiet statistic. 3. Sufficiecy is eeded so that the resultig quatity (estimator) after coditioig o the sufficiet statistic will ot deped o. 0
21 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 Example (Coditioig o a isufficiet statistic) Let X 1 ad X be iid from (,1). The X is a ubiased estimator (ad a sufficiet statistic) of. Suppose we coditio X o X 1 which is ot a sufficiet statistic. Let ( X1) E ( X1) E( X X1). The ( X1) is ubiased for ad has a smaller variace tha X but is ot a valid estimator. Theorem If W is a best ubiased estimator of ( ), the W is uique. Let W be such that E ( W) ( ) ad let U be such that E ( U) 0 for all. The a W au, where a is a costat forms a class of ubiased estimators of with Var( a) VarW acov( W, U ) a VarU. Questio: Which is a better estimator, W or a? Theorem If E ( W) ( ), W is the best ubiased estimator of ( ) if ad oly if W is ucorrelated with all ubiased estimators of 0. 1
22 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 Example (Ubiased estimators of 0) Let X be a observatio from uiform(, 1) distributio. The Therefore, EX xdx ad Var X. 1 1 X is a ubiased estimator of. We will show that of 0, ad hece caot be a best ubiased estimator of. 1 X is correlated with a ubiased estimator Note: If a family of pdfs f ( x ) has the property that there are o ubiased estimators of 0 other tha 0 itself, the our search would be eded sice Cov( W,0) 0. What is this property called? Example 7.3. (cotiuatio of Example ) Let X 1,, X be iid uiform (0, ) The Y X is a ubiased estimator of. ( ) 1 Y where Solutio: 1. Coditios of CramerRao Theorem were ot satisfied.. By RaoBlackwell Theorem, we oly eed to cosider ubiased estimator of based o Y. 3. Y is a complete sufficiet statistic, therefore Y is ucorrelated with all ubiased estimators of 0 sice this would just be 0 itself.
23 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, Y is the best ubiased estimator of. Importat Note: What is critical is the completeess of the family of distributios of the sufficiet statistics ot the completeess of the origial family. Theorem Let T be a complete sufficiet statistic for a parameter, ad let ( T ) be ay estimator based oly o T. The ( T ) is the uique best ubiased estimator of its expected value. Result: If T is a complete sufficiet statistic for a parameter ad hx ( 1,, X ) is ay ubiased estimator of ( ), the ( T) E[ h( X1,, X) T] is the uique best ubiased estimator of ( ). Example (Biomial best ubiased estimatio) Let X,, 1 X be iid biomial( k, ). We wat to estimate ( ) ( 1) (1 ) k 1 P X k. Solutio: Recall that X i ~ biomial( k, ) is a complete sufficiet statistic for. i1 3
24 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 Questio: How about a ubiased estimator for ( )? Oce we fid a ubiased estimator, how do we get the best ubiased estimator? Loss Fuctio Optimality Decisio Theory: Settig: Observed data: X x where X~ f ( x ). Let = actio space, i.e., set of allowable decisios regardig. Defiitio: Loss fuctio is a oegative fuctio that geerally icreases as the distace betwee a actio, a, ad icreases. Note: L(, ) 0 (What does this mea? the loss is miimum if the actio is correct) If is realvalued, two commoly used loss fuctios are absolute error loss L(, a) a : more pealty o small discrepacies 4
25 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 squared error loss L(, a) ( a) : more pealty o large discrepacies Other examples: L(, a) which pealizes overestimatio more tha uderestimatio. ( a), a ; 10( a), a. L(, a) [( a) ]/( 1), pealizes errors i estimatio more if is ear 0 tha if is large Defiitio: I decisio theoretic aalysis, the quality of a estimator, ( X ), is quatified by its risk fuctio defied by R(, ) E L(, ( X )), i.e., at a give the risk fuctio is the average loss that will be icurred if the estimator ( X ) is used. Notes: MSE is a example of a risk fuctio with respect to the squared error loss. R(, ) E L(, ( X)) E ( ( X)) Var ( ( X)) ( Bias ( ( X ))). We wat to fid a estimator that has a small risk fuctio for all relative to aother estimator. However, most of the time the risk fuctios of two estimators cross. 5
26 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 Example (Biomial risk fuctios) Recall Example comparig the Bayes estimator ad the MLE of the Beroulli parameter p. pˆ B X /4 i 1 i ad p 1 ˆ X X i1 i. Example (Risk of ormal variace) Let X 1,, X be iid from (, ). We wat to estimate cosiderig estimators of the form ( X ) bs. Solutio: Recall that ES b 4 ad for ormal samples Var( S ). 1 The risk fuctio with respect to the squared error loss is R((, ), ) Var( bs ) ( E( bs ) ) b b Var( bs ) ( b ) b 1 4 [ ( b 1) ]. Notes: 1. The resultig risk fuctio does ot deped o. 6
27 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, b value that miimizes this risk fuctio is give by b. Thus, for every value of 1 estimator with the smallest risk amog all estimators of the form ( X ) bs is 1 1 ( ) (See Figure 7.3. p. 351 for =5). 1 1 S S X i 1 i X b (, ), the Example (Variace estimatio usig Stei s loss) Let X,, 1 X be iid from a populatio with positive fiite variace,. We wat to estimate. Solutio: Cosiderig estimators of the form ( X ) bs ad the loss fuctio I this case, the risk fuctio is give by Note that L b a a (attributed to Stei) (, a) 1 log bs bs S R E b b E (, b) ( 1log ) 1log (log ). S E(log ) does ot deped o b. To miimize this risk fuctio, we fid b that miimizes log( ) b b which is whe b 1. Hece, the estimator with the smallest risk for all values of 1 1( X ) S ( ) i 1 i 1 X X. is 7
28 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 Bayesia Approach to Loss Fuctio Defiitio: Give a prior distributio ( ), the Bayes risk x x x R(, ) ( ) d ( L(, ( )) f( ) d ) ( ) d ad the estimator that results i the smallest value of the Bayes risk is kow as the Bayes rule with respect to a prior ( ). Note that R(, ) ( ) d [ L(, ( x)) ( x) d] m( x) dx where the quatity i the square brackets is kow as the posterior expected loss. The actio ( X ) that miimizes the posterior expected loss will also miimize the Bayes risk. Example (Two Bayes rules) Suppose we wat to estimate. 1. For the squared error loss, the posterior expected loss is x X x, ( a) ( ) d E(( a) ) 8
29 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 where ~ ( x ). This is miimized by ( x) E( x ) so that the Bayes rule is the mea of the posterior distributio (Example..6).. For the absolute error loss, the posterior expected loss is a ( x) d E( a Xx ) miimized by ( x) E( x ) = media of the posterior distributio (Exercise.18). Example (Normal Bayes estimates) Let X,, 1 X be iid from (, ) ad let ( ) be (, ), where,, are kow. From Example ad your homework problem (Exercise 7.), the posterior distributio of give X x is ormal with mea ad / E( x) x ( / ) ( / ) / Var( x). / 1. For the squared error loss, ( x ) E( x). For the absolute error loss, 9
30 Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 ( x ) = media of the posterior distributio = E( x). 30
Properties of MLE: consistency, asymptotic normality. Fisher information.
Lecture 3 Properties of MLE: cosistecy, asymptotic ormality. Fisher iformatio. I this sectio we will try to uderstad why MLEs are good. Let us recall two facts from probability that we be used ofte throughout
More informationMethods of Evaluating Estimators
Math 541: Statistical Theory II Istructor: Sogfeg Zheg Methods of Evaluatig Estimators Let X 1, X 2,, X be i.i.d. radom variables, i.e., a radom sample from f(x θ), where θ is ukow. A estimator of θ is
More information7. Sample Covariance and Correlation
1 of 8 7/16/2009 6:06 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 7. Sample Covariace ad Correlatio The Bivariate Model Suppose agai that we have a basic radom experimet, ad that X ad Y
More informationChapter 7  Sampling Distributions. 1 Introduction. What is statistics? It consist of three major areas:
Chapter 7  Samplig Distributios 1 Itroductio What is statistics? It cosist of three major areas: Data Collectio: samplig plas ad experimetal desigs Descriptive Statistics: umerical ad graphical summaries
More informationMaximum Likelihood Estimators.
Lecture 2 Maximum Likelihood Estimators. Matlab example. As a motivatio, let us look at oe Matlab example. Let us geerate a radom sample of size 00 from beta distributio Beta(5, 2). We will lear the defiitio
More informationBASIC STATISTICS. f(x 1,x 2,..., x n )=f(x 1 )f(x 2 ) f(x n )= f(x i ) (1)
BASIC STATISTICS. SAMPLES, RANDOM SAMPLING AND SAMPLE STATISTICS.. Radom Sample. The radom variables X,X 2,..., X are called a radom sample of size from the populatio f(x if X,X 2,..., X are mutually idepedet
More informationUniversity of California, Los Angeles Department of Statistics. Distributions related to the normal distribution
Uiversity of Califoria, Los Ageles Departmet of Statistics Statistics 100B Istructor: Nicolas Christou Three importat distributios: Distributios related to the ormal distributio Chisquare (χ ) distributio.
More informationI. Chisquared Distributions
1 M 358K Supplemet to Chapter 23: CHISQUARED DISTRIBUTIONS, TDISTRIBUTIONS, AND DEGREES OF FREEDOM To uderstad tdistributios, we first eed to look at aother family of distributios, the chisquared distributios.
More information3. Covariance and Correlation
Virtual Laboratories > 3. Expected Value > 1 2 3 4 5 6 3. Covariace ad Correlatio Recall that by takig the expected value of various trasformatios of a radom variable, we ca measure may iterestig characteristics
More informationDefinition. Definition. 72 Estimating a Population Proportion. Definition. Definition
7 stimatig a Populatio Proportio I this sectio we preset methods for usig a sample proportio to estimate the value of a populatio proportio. The sample proportio is the best poit estimate of the populatio
More informationConfidence Intervals and Sample Size
8/7/015 C H A P T E R S E V E N Cofidece Itervals ad Copyright 015 The McGrawHill Compaies, Ic. Permissio required for reproductio or display. 1 Cofidece Itervals ad Outlie 71 Cofidece Itervals for the
More informationChapter 6: Variance, the law of large numbers and the MonteCarlo method
Chapter 6: Variace, the law of large umbers ad the MoteCarlo method Expected value, variace, ad Chebyshev iequality. If X is a radom variable recall that the expected value of X, E[X] is the average value
More informationNormal Distribution.
Normal Distributio www.icrf.l Normal distributio I probability theory, the ormal or Gaussia distributio, is a cotiuous probability distributio that is ofte used as a first approimatio to describe realvalued
More informationConfidence Intervals for One Mean with Tolerance Probability
Chapter 421 Cofidece Itervals for Oe Mea with Tolerace Probability Itroductio This procedure calculates the sample size ecessary to achieve a specified distace from the mea to the cofidece limit(s) with
More informationAsymptotic Growth of Functions
CMPS Itroductio to Aalysis of Algorithms Fall 3 Asymptotic Growth of Fuctios We itroduce several types of asymptotic otatio which are used to compare the performace ad efficiecy of algorithms As we ll
More informationKey Ideas Section 81: Overview hypothesis testing Hypothesis Hypothesis Test Section 82: Basics of Hypothesis Testing Null Hypothesis
Chapter 8 Key Ideas Hypothesis (Null ad Alterative), Hypothesis Test, Test Statistic, Pvalue Type I Error, Type II Error, Sigificace Level, Power Sectio 81: Overview Cofidece Itervals (Chapter 7) are
More informationConfidence Intervals for the Mean of Nonnormal Data Class 23, 18.05, Spring 2014 Jeremy Orloff and Jonathan Bloom
Cofidece Itervals for the Mea of Noormal Data Class 23, 8.05, Sprig 204 Jeremy Orloff ad Joatha Bloom Learig Goals. Be able to derive the formula for coservative ormal cofidece itervals for the proportio
More informationStatistical inference: example 1. Inferential Statistics
Statistical iferece: example 1 Iferetial Statistics POPULATION SAMPLE A clothig store chai regularly buys from a supplier large quatities of a certai piece of clothig. Each item ca be classified either
More informationSection 73 Estimating a Population. Requirements
Sectio 73 Estimatig a Populatio Mea: σ Kow Key Cocept This sectio presets methods for usig sample data to fid a poit estimate ad cofidece iterval estimate of a populatio mea. A key requiremet i this sectio
More informationOutput Analysis (2, Chapters 10 &11 Law)
B. Maddah ENMG 6 Simulatio 05/0/07 Output Aalysis (, Chapters 10 &11 Law) Comparig alterative system cofiguratio Sice the output of a simulatio is radom, the comparig differet systems via simulatio should
More informationSolutions to Selected Problems In: Pattern Classification by Duda, Hart, Stork
Solutios to Selected Problems I: Patter Classificatio by Duda, Hart, Stork Joh L. Weatherwax February 4, 008 Problem Solutios Chapter Bayesia Decisio Theory Problem radomized rules Part a: Let Rx be the
More informationTHE REGRESSION MODEL IN MATRIX FORM. For simple linear regression, meaning one predictor, the model is. for i = 1, 2, 3,, n
We will cosider the liear regressio model i matrix form. For simple liear regressio, meaig oe predictor, the model is i = + x i + ε i for i =,,,, This model icludes the assumptio that the ε i s are a sample
More informationConfidence Intervals for One Mean
Chapter 420 Cofidece Itervals for Oe Mea Itroductio This routie calculates the sample size ecessary to achieve a specified distace from the mea to the cofidece limit(s) at a stated cofidece level for a
More information1 Computing the Standard Deviation of Sample Means
Computig the Stadard Deviatio of Sample Meas Quality cotrol charts are based o sample meas ot o idividual values withi a sample. A sample is a group of items, which are cosidered all together for our aalysis.
More informationModule 4: Mathematical Induction
Module 4: Mathematical Iductio Theme 1: Priciple of Mathematical Iductio Mathematical iductio is used to prove statemets about atural umbers. As studets may remember, we ca write such a statemet as a predicate
More information3. Continuous Random Variables
Statistics ad probability: 31 3. Cotiuous Radom Variables A cotiuous radom variable is a radom variable which ca take values measured o a cotiuous scale e.g. weights, stregths, times or legths. For ay
More information1. C. The formula for the confidence interval for a population mean is: x t, which was
s 1. C. The formula for the cofidece iterval for a populatio mea is: x t, which was based o the sample Mea. So, x is guarateed to be i the iterval you form.. D. Use the rule : pvalue
More informationSAMPLE QUESTIONS FOR FINAL EXAM. (1) (2) (3) (4) Find the following using the definition of the Riemann integral: (2x + 1)dx
SAMPLE QUESTIONS FOR FINAL EXAM REAL ANALYSIS I FALL 006 3 4 Fid the followig usig the defiitio of the Riema itegral: a 0 x + dx 3 Cosider the partitio P x 0 3, x 3 +, x 3 +,......, x 3 3 + 3 of the iterval
More informationGregory Carey, 1998 Linear Transformations & Composites  1. Linear Transformations and Linear Composites
Gregory Carey, 1998 Liear Trasformatios & Composites  1 Liear Trasformatios ad Liear Composites I Liear Trasformatios of Variables Meas ad Stadard Deviatios of Liear Trasformatios A liear trasformatio
More information4.1 Sigma Notation and Riemann Sums
0 the itegral. Sigma Notatio ad Riema Sums Oe strategy for calculatig the area of a regio is to cut the regio ito simple shapes, calculate the area of each simple shape, ad the add these smaller areas
More information0.7 0.6 0.2 0 0 96 96.5 97 97.5 98 98.5 99 99.5 100 100.5 96.5 97 97.5 98 98.5 99 99.5 100 100.5
Sectio 13 KolmogorovSmirov test. Suppose that we have a i.i.d. sample X 1,..., X with some ukow distributio P ad we would like to test the hypothesis that P is equal to a particular distributio P 0, i.e.
More informationOverview of some probability distributions.
Lecture Overview of some probability distributios. I this lecture we will review several commo distributios that will be used ofte throughtout the class. Each distributio is usually described by its probability
More informationHypothesis testing. Null and alternative hypotheses
Hypothesis testig Aother importat use of samplig distributios is to test hypotheses about populatio parameters, e.g. mea, proportio, regressio coefficiets, etc. For example, it is possible to stipulate
More informationStat 104 Lecture 16. Statistics 104 Lecture 16 (IPS 6.1) Confidence intervals  the general concept
Statistics 104 Lecture 16 (IPS 6.1) Outlie for today Cofidece itervals Cofidece itervals for a mea, µ (kow σ) Cofidece itervals for a proportio, p Margi of error ad sample size Review of mai topics for
More informationSequences and Series
CHAPTER 9 Sequeces ad Series 9.. Covergece: Defiitio ad Examples Sequeces The purpose of this chapter is to itroduce a particular way of geeratig algorithms for fidig the values of fuctios defied by their
More information5: Introduction to Estimation
5: Itroductio to Estimatio Cotets Acroyms ad symbols... 1 Statistical iferece... Estimatig µ with cofidece... 3 Samplig distributio of the mea... 3 Cofidece Iterval for μ whe σ is kow before had... 4 Sample
More informationMeasures of Spread and Boxplots Discrete Math, Section 9.4
Measures of Spread ad Boxplots Discrete Math, Sectio 9.4 We start with a example: Example 1: Comparig Mea ad Media Compute the mea ad media of each data set: S 1 = {4, 6, 8, 10, 1, 14, 16} S = {4, 7, 9,
More informationReview for College Algebra Final Exam
Review for College Algebra Fial Exam (Please remember that half of the fial exam will cover chapters 14. This review sheet covers oly the ew material, from chapters 5 ad 7.) 5.1 Systems of equatios i
More informationORDERS OF GROWTH KEITH CONRAD
ORDERS OF GROWTH KEITH CONRAD Itroductio Gaiig a ituitive feel for the relative growth of fuctios is importat if you really wat to uderstad their behavior It also helps you better grasp topics i calculus
More informationSampling Distribution And Central Limit Theorem
() Samplig Distributio & Cetral Limit Samplig Distributio Ad Cetral Limit Samplig distributio of the sample mea If we sample a umber of samples (say k samples where k is very large umber) each of size,
More informationCHAPTER 7: Central Limit Theorem: CLT for Averages (Means)
CHAPTER 7: Cetral Limit Theorem: CLT for Averages (Meas) X = the umber obtaied whe rollig oe six sided die oce. If we roll a six sided die oce, the mea of the probability distributio is X P(X = x) Simulatio:
More information1 Hypothesis testing for a single mean
BST 140.65 Hypothesis Testig Review otes 1 Hypothesis testig for a sigle mea 1. The ull, or status quo, hypothesis is labeled H 0, the alterative H a or H 1 or H.... A type I error occurs whe we falsely
More informationUC Berkeley Department of Electrical Engineering and Computer Science. EE 126: Probablity and Random Processes. Solutions 9 Spring 2006
Exam format UC Bereley Departmet of Electrical Egieerig ad Computer Sciece EE 6: Probablity ad Radom Processes Solutios 9 Sprig 006 The secod midterm will be held o Wedesday May 7; CHECK the fial exam
More informationA probabilistic proof of a binomial identity
A probabilistic proof of a biomial idetity Joatho Peterso Abstract We give a elemetary probabilistic proof of a biomial idetity. The proof is obtaied by computig the probability of a certai evet i two
More informationConvexity, Inequalities, and Norms
Covexity, Iequalities, ad Norms Covex Fuctios You are probably familiar with the otio of cocavity of fuctios. Give a twicedifferetiable fuctio ϕ: R R, We say that ϕ is covex (or cocave up) if ϕ (x) 0 for
More information1 Correlation and Regression Analysis
1 Correlatio ad Regressio Aalysis I this sectio we will be ivestigatig the relatioship betwee two cotiuous variable, such as height ad weight, the cocetratio of a ijected drug ad heart rate, or the cosumptio
More informationCase Study. Normal and t Distributions. Density Plot. Normal Distributions
Case Study Normal ad t Distributios Bret Halo ad Bret Larget Departmet of Statistics Uiversity of Wiscosi Madiso October 11 13, 2011 Case Study Body temperature varies withi idividuals over time (it ca
More informationNPTEL STRUCTURAL RELIABILITY
NPTEL Course O STRUCTURAL RELIABILITY Module # 0 Lecture 1 Course Format: Web Istructor: Dr. Aruasis Chakraborty Departmet of Civil Egieerig Idia Istitute of Techology Guwahati 1. Lecture 01: Basic Statistics
More informationSoving Recurrence Relations
Sovig Recurrece Relatios Part 1. Homogeeous liear 2d degree relatios with costat coefficiets. Cosider the recurrece relatio ( ) T () + at ( 1) + bt ( 2) = 0 This is called a homogeeous liear 2d degree
More informationChapter 14 Nonparametric Statistics
Chapter 14 Noparametric Statistics A.K.A. distributiofree statistics! Does ot deped o the populatio fittig ay particular type of distributio (e.g, ormal). Sice these methods make fewer assumptios, they
More informationInstitute for the Advancement of University Learning & Department of Statistics
Istitute for the Advacemet of Uiversity Learig & Departmet of Statistics Descriptive Statistics for Research (Hilary Term, 00) Lecture 5: Cofidece Itervals (I.) Itroductio Cofidece itervals (or regios)
More informationAQA STATISTICS 1 REVISION NOTES
AQA STATISTICS 1 REVISION NOTES AVERAGES AND MEASURES OF SPREAD www.mathsbox.org.uk Mode : the most commo or most popular data value the oly average that ca be used for qualitative data ot suitable if
More informationLesson 12. Sequences and Series
Retur to List of Lessos Lesso. Sequeces ad Series A ifiite sequece { a, a, a,... a,...} ca be thought of as a list of umbers writte i defiite order ad certai patter. It is usually deoted by { a } =, or
More informationNotes on Hypothesis Testing
Probability & Statistics Grishpa Notes o Hypothesis Testig A radom sample X = X 1,..., X is observed, with joit pmf/pdf f θ x 1,..., x. The values x = x 1,..., x of X lie i some sample space X. The parameter
More informationLecture 10: Hypothesis testing and confidence intervals
Eco 514: Probability ad Statistics Lecture 10: Hypothesis testig ad cofidece itervals Types of reasoig Deductive reasoig: Start with statemets that are assumed to be true ad use rules of logic to esure
More informationIn nite Sequences. Dr. Philippe B. Laval Kennesaw State University. October 9, 2008
I ite Sequeces Dr. Philippe B. Laval Keesaw State Uiversity October 9, 2008 Abstract This had out is a itroductio to i ite sequeces. mai de itios ad presets some elemetary results. It gives the I ite Sequeces
More informationEconomics 140A Confidence Intervals and Hypothesis Testing
Ecoomics 140A Cofidece Itervals ad Hypothesis Testig Obtaiig a estimate of a parameter is ot the al purpose of statistical iferece because it is highly ulikely that the populatio value of a parameter is
More informationAn example of nonquenched convergence in the conditional central limit theorem for partial sums of a linear process
A example of oqueched covergece i the coditioal cetral limit theorem for partial sums of a liear process Dalibor Volý ad Michael Woodroofe Abstract A causal liear processes X,X 0,X is costructed for which
More information3. Greatest Common Divisor  Least Common Multiple
3 Greatest Commo Divisor  Least Commo Multiple Defiitio 31: The greatest commo divisor of two atural umbers a ad b is the largest atural umber c which divides both a ad b We deote the greatest commo gcd
More informationUsing Excel to Construct Confidence Intervals
OPIM 303 Statistics Ja Stallaert Usig Excel to Costruct Cofidece Itervals This hadout explais how to costruct cofidece itervals i Excel for the followig cases: 1. Cofidece Itervals for the mea of a populatio
More informationHypothesis Tests Applied to Means
The Samplig Distributio of the Mea Hypothesis Tests Applied to Meas Recall that the samplig distributio of the mea is the distributio of sample meas that would be obtaied from a particular populatio (with
More informationZTEST / ZSTATISTIC: used to test hypotheses about. µ when the population standard deviation is unknown
ZTEST / ZSTATISTIC: used to test hypotheses about µ whe the populatio stadard deviatio is kow ad populatio distributio is ormal or sample size is large TTEST / TSTATISTIC: used to test hypotheses about
More informationChapter 5: Inner Product Spaces
Chapter 5: Ier Product Spaces Chapter 5: Ier Product Spaces SECION A Itroductio to Ier Product Spaces By the ed of this sectio you will be able to uderstad what is meat by a ier product space give examples
More informationProblem Set 1 Oligopoly, market shares and concentration indexes
Advaced Idustrial Ecoomics Sprig 2016 Joha Steek 29 April 2016 Problem Set 1 Oligopoly, market shares ad cocetratio idexes 1 1 Price Competitio... 3 1.1 Courot Oligopoly with Homogeous Goods ad Differet
More informationSection IV.5: Recurrence Relations from Algorithms
Sectio IV.5: Recurrece Relatios from Algorithms Give a recursive algorithm with iput size, we wish to fid a Θ (best big O) estimate for its ru time T() either by obtaiig a explicit formula for T() or by
More informationDistributions of Order Statistics
Chapter 2 Distributios of Order Statistics We give some importat formulae for distributios of order statistics. For example, where F k: (x)=p{x k, x} = I F(x) (k, k + 1), I x (a,b)= 1 x t a 1 (1 t) b 1
More informationConfidence Intervals for the Population Mean
Cofidece Itervals Math 283 Cofidece Itervals for the Populatio Mea Recall that from the empirical rule that the iterval of the mea plus/mius 2 times the stadard deviatio will cotai about 95% of the observatios.
More informationSTATISTICAL METHODS FOR BUSINESS
STATISTICAL METHODS FOR BUSINESS UNIT 7: INFERENTIAL TOOLS. DISTRIBUTIONS ASSOCIATED WITH SAMPLING 7.1. Distributios associated with the samplig process. 7.2. Iferetial processes ad relevat distributios.
More informationJoint Probability Distributions and Random Samples
STAT5 Sprig 204 Lecture Notes Chapter 5 February, 204 Joit Probability Distributios ad Radom Samples 5. Joitly Distributed Radom Variables Chapter Overview Joitly distributed rv Joit mass fuctio, margial
More informationBASIC STATISTICS. Discrete. Mass Probability Function: P(X=x i ) Only one finite set of values is considered {x 1, x 2,...} Prob. t = 1.
BASIC STATISTICS 1.) Basic Cocepts: Statistics: is a sciece that aalyzes iformatio variables (for istace, populatio age, height of a basketball team, the temperatures of summer moths, etc.) ad attempts
More informationChapter Gaussian Elimination
Chapter 04.06 Gaussia Elimiatio After readig this chapter, you should be able to:. solve a set of simultaeous liear equatios usig Naïve Gauss elimiatio,. lear the pitfalls of the Naïve Gauss elimiatio
More informationLECTURE 13: Crossvalidation
LECTURE 3: Crossvalidatio Resampli methods Cross Validatio Bootstrap Bias ad variace estimatio with the Bootstrap Threeway data partitioi Itroductio to Patter Aalysis Ricardo GutierrezOsua Texas A&M
More informationSection 9.2 Series and Convergence
Sectio 9. Series ad Covergece Goals of Chapter 9 Approximate Pi Prove ifiite series are aother importat applicatio of limits, derivatives, approximatio, slope, ad cocavity of fuctios. Fid challegig atiderivatives
More informationSimulation and Monte Carlo integration
Chapter 3 Simulatio ad Mote Carlo itegratio I this chapter we itroduce the cocept of geeratig observatios from a specified distributio or sample, which is ofte called Mote Carlo geeratio. The ame of Mote
More informationMeasures of Central Tendency
Measures of Cetral Tedecy A studet s grade will be determied by exam grades ( each exam couts twice ad there are three exams, HW average (couts oce, fial exam ( couts three times. Fid the average if the
More informationOverview. Learning Objectives. Point Estimate. Estimation. Estimating the Value of a Parameter Using Confidence Intervals
Overview Estimatig the Value of a Parameter Usig Cofidece Itervals We apply the results about the sample mea the problem of estimatio Estimatio is the process of usig sample data estimate the value of
More informationHypothesis testing in a Nutshell
Hypothesis testig i a Nutshell Summary by Pamela Peterso Drake Itroductio The purpose of this readig is to discuss aother aspect of statistical iferece, testig. A is a statemet about the value of a populatio
More informationInfinite Sequences and Series
CHAPTER 4 Ifiite Sequeces ad Series 4.1. Sequeces A sequece is a ifiite ordered list of umbers, for example the sequece of odd positive itegers: 1, 3, 5, 7, 9, 11, 13, 15, 17, 19, 21, 23, 25, 27, 29...
More information= 1. n n 2 )= n n 2 σ2 = σ2
SAMLE STATISTICS A rado saple of size fro a distributio f(x is a set of rado variables x 1,x,,x which are idepedetly ad idetically distributed with x i f(x for all i Thus, the joit pdf of the rado saple
More informationDiscrete Random Variables and Probability Distributions. Random Variables. Chapter 3 3.1
UCLA STAT A Applied Probability & Statistics for Egieers Istructor: Ivo Diov, Asst. Prof. I Statistics ad Neurology Teachig Assistat: Neda Farziia, UCLA Statistics Uiversity of Califoria, Los Ageles, Sprig
More informationChapter 4 Multivariate distributions
Chapter 4 Multivariate distributios k Multivariate Distributios All the results derived for the bivariate case ca be geeralized to RV. The joit CDF of,,, k will have the form: P(x, x,, x k ) whe the RVs
More information1 The Binomial Theorem: Another Approach
The Biomial Theorem: Aother Approach Pascal s Triagle I class (ad i our text we saw that, for iteger, the biomial theorem ca be stated (a + b = c a + c a b + c a b + + c ab + c b, where the coefficiets
More informationThe second difference is the sequence of differences of the first difference sequence, 2
Differece Equatios I differetial equatios, you look for a fuctio that satisfies ad equatio ivolvig derivatives. I differece equatios, istead of a fuctio of a cotiuous variable (such as time), we look for
More informationOur aim is to show that under reasonable assumptions a given 2πperiodic function f can be represented as convergent series
8 Fourier Series Our aim is to show that uder reasoable assumptios a give periodic fuctio f ca be represeted as coverget series f(x) = a + (a cos x + b si x). (8.) By defiitio, the covergece of the series
More informationMath C067 Sampling Distributions
Math C067 Samplig Distributios Sample Mea ad Sample Proportio Richard Beigel Some time betwee April 16, 2007 ad April 16, 2007 Examples of Samplig A pollster may try to estimate the proportio of voters
More informationUnbiased Estimation. Topic 14. 14.1 Introduction
Topic 4 Ubiased Estimatio 4. Itroductio I creatig a parameter estimator, a fudametal questio is whether or ot the estimator differs from the parameter i a systematic maer. Let s examie this by lookig a
More informationPSYCHOLOGICAL STATISTICS
UNIVERSITY OF CALICUT SCHOOL OF DISTANCE EDUCATION B Sc. Cousellig Psychology (0 Adm.) IV SEMESTER COMPLEMENTARY COURSE PSYCHOLOGICAL STATISTICS QUESTION BANK. Iferetial statistics is the brach of statistics
More informationx : X bar Mean (i.e. Average) of a sample
A quick referece for symbols ad formulas covered i COGS14: MEAN OF SAMPLE: x = x i x : X bar Mea (i.e. Average) of a sample x i : X sub i This stads for each idividual value you have i your sample. For
More informationDetermining the sample size
Determiig the sample size Oe of the most commo questios ay statisticia gets asked is How large a sample size do I eed? Researchers are ofte surprised to fid out that the aswer depeds o a umber of factors
More information1 Introduction to reducing variance in Monte Carlo simulations
Copyright c 007 by Karl Sigma 1 Itroductio to reducig variace i Mote Carlo simulatios 11 Review of cofidece itervals for estimatig a mea I statistics, we estimate a uow mea µ = E(X) of a distributio by
More informationLesson 17 Pearson s Correlation Coefficient
Outlie Measures of Relatioships Pearso s Correlatio Coefficiet (r) types of data scatter plots measure of directio measure of stregth Computatio covariatio of X ad Y uique variatio i X ad Y measurig
More informationUnit 20 Hypotheses Testing
Uit 2 Hypotheses Testig Objectives: To uderstad how to formulate a ull hypothesis ad a alterative hypothesis about a populatio proportio, ad how to choose a sigificace level To uderstad how to collect
More informationThe shaded region above represents the region in which z lies.
GCE A Level H Maths Solutio Paper SECTION A (PURE MATHEMATICS) (i) Im 3 Note: Uless required i the questio, it would be sufficiet to just idicate the cetre ad radius of the circle i such a locus drawig.
More informationChapter 7: Confidence Interval and Sample Size
Chapter 7: Cofidece Iterval ad Sample Size Learig Objectives Upo successful completio of Chapter 7, you will be able to: Fid the cofidece iterval for the mea, proportio, ad variace. Determie the miimum
More informationStat 104 Lecture 2. Variables and their distributions. DJIA: monthly % change, 2000 to Finding the center of a distribution. Median.
Stat 04 Lecture Statistics 04 Lecture (IPS. &.) Outlie for today Variables ad their distributios Fidig the ceter Measurig the spread Effects of a liear trasformatio Variables ad their distributios Variable:
More informationarxiv:1506.03481v1 [stat.me] 10 Jun 2015
BEHAVIOUR OF ABC FOR BIG DATA By Wetao Li ad Paul Fearhead Lacaster Uiversity arxiv:1506.03481v1 [stat.me] 10 Ju 2015 May statistical applicatios ivolve models that it is difficult to evaluate the likelihood,
More informationSimple Linear Regression
Simple Liear Regressio We have bee itroduced to the otio that a categorical variable could deped o differet levels of aother variable whe we discussed cotigecy tables. We ll exted this idea to the case
More information4 n. n 1. You shold think of the Ratio Test as a generalization of the Geometric Series Test. For example, if a n ar n is a geometric sequence then
SECTION 2.6 THE RATIO TEST 79 2.6. THE RATIO TEST We ow kow how to hadle series which we ca itegrate (the Itegral Test), ad series which are similar to geometric or pseries (the Compariso Test), but of
More informationTaking DCOP to the Real World: Efficient Complete Solutions for Distributed MultiEvent Scheduling
Taig DCOP to the Real World: Efficiet Complete Solutios for Distributed MultiEvet Schedulig Rajiv T. Maheswara, Milid Tambe, Emma Bowrig, Joatha P. Pearce, ad Pradeep araatham Uiversity of Souther Califoria
More information