BASIC STATISTICS. f(x 1,x 2,..., x n )=f(x 1 )f(x 2 ) f(x n )= f(x i ) (1)


 Reynard Morgan
 3 years ago
 Views:
Transcription
1 BASIC STATISTICS. SAMPLES, RANDOM SAMPLING AND SAMPLE STATISTICS.. Radom Sample. The radom variables X,X 2,..., X are called a radom sample of size from the populatio f(x if X,X 2,..., X are mutually idepedet radom variables ad the margial probability desity fuctio of each X i is the same fuctio of f(x. Alteratively, X,X 2,..., X are called idepedet ad idetically distributed radom variables with pdf f(x. We abbreviate idepedet ad idetically distributed as iid. Most experimets ivolve > repeated observatios o a particular variable, the first observatio is X, the secod is X 2, ad so o. Each X i is a observatio o the same variable ad each X i has a margial distributio give by f(x. Give that the observatios are collected i such a way that the value of oe observatio has o effect or relatioship with ay of the other observatios, the X,X 2,..., X are mutually idepedet. Therefore we ca write the joit probability desity for the sample X,X 2,..., X as f(x,x 2,..., x f(x f(x 2 f(x f(x i ( If the uderlyig probability model is parameterized by θ, the we ca also write f(x,x 2,..., x θ f(x i θ (2 Note that the same θ is used i each term of the product, or i each margial desity. A differet value of θ would lead to a differet properties for the radom sample..2. Statistics. Let X,X 2,..., X be a radom sample of size from a populatio ad let T (x,x 2,..., x be a real valued or vector valued fuctio whose domai icludes the sample space of (X,X 2,..., X. The the radom variable or radom vector Y (X,X 2,..., X is called a statistic. A statistic is a map from the sample space of (X,X 2,..., X call it X, to some space of values, usually R or R. T is what we compute whe we observe the radom variable X take o some specific values i a sample. The probability distributio of a statistic Y T(X is called the samplig distributio of Y. Notice that T( is a fuctio of sample values oly, it does ot deped o ay uderlyig parameters, θ..3. Some Commoly Used Statistics..3.. Sample mea. The sample mea is the arithmetic average of the values i a radom sample. It is usually deoted X(X,X 2,,X X + X X X i (3 The observed value of X i ay sample is demoted by the lower case letter, i.e., x. Date: September 27, 2004.
2 2 BASIC STATISTICS.3.2. Sample variace. The sample variace is the statistic defied by S 2 (X,X 2,,X (X i X 2 (4 The observed value of S 2 i ay sample is demoted by the lower case letter, i.e., s Sample stadard deviatio. The sample stadard deviatio is the statistic defied by S S 2 ( Sample midrage. The sample midrage is the statistic defied by max(x,x 2,,X mi(x,x 2,,X ( Empirical distributio fuctio. The empirical distributio fuctio is defied by ˆF (X,X 2,,X (x I(X i <x (7 where ˆF(X,X 2,,X (x meas we are evaluatig the statistic ˆF (X,X 2,,X at the particular value x. The radom sample X,X 2,..., X is assumed to come from a probability defied o R ad I(A is the idicator of the evet A. This statistic takes values i the set of all distributio fuctios o R. It estimates the fuctio valued parameter F defied by its evaluatio at x R F (P (x P [X <x] (8 2. DISTRIBUTION OF SAMPLE STATISTICS 2.. Theorem o squared deviatios ad sample variaces. Theorem. Let x,x 2, x be ay umbers ad let x x+x2+...+x. The the followig two items hold. a: mi a (x i a 2 (x i x 2 b: ( s 2 (x i x 2 x2 i x2 Part a says that the sample mea is the value about which the sum of squared deviatios is miimized. Part b is a simple idetity that will prove immesely useful i dealig with statistical data. Proof. First cosider part a of theorem. Add ad subtract x from the expressio o the lefthad side i part a ad the expad as follows (x i x + x a 2 (x i x 2 +2 (x i x( x a+ ( x a 2 (9 Now write out the middle term i 9 ad simplify (x i x( x a x x i a x i x x + x a (0 x 2 a x x 2 + xa 0
3 BASIC STATISTICS 3 We ca the write 9 as (x i a 2 (x i x 2 + ( x a 2 ( Equatio is clearly miimized whe a x. Now cosider part b of theorem. Expad the secod expressio i part b ad simplify (x i x 2 x 2 i 2 x x i + x 2 (2 x 2 i 2 x 2 + x 2 x 2 i x Theorem 2 o expected values ad variaces of sums. Theorem 2. Let X,X 2, X be a radom sample from a populatio ad let g(x be a fuctio such that Eg(X ad Varg(X exist. The followig two items hold. a: E( g(x i (Eg(X b: Var( g(x i (Varg(X Proof. First cosider part a of theorem 2. Write the expected value of the sum as the sum of the expected values ad the ote that Eg(X Eg(X 2...Eg(X i...eg(x because the X i are all from the same distributio. ( E g(x i E(g(X i (Eg(X (3 First cosider part b of theorem 2. Write the defiitio of the variace for a variable z as E(z E(z 2 ad the combie terms i the summatio sig. ( [ ( 2 Var g(x i E g(x i E g(x i ] (4 Now write out the bottom expressio i equatio 4 as follows ( Var g(x i E [g(x E(g(X ] 2 + E [g(x E(g(X ] E [g(x 2 E(g(X 2 ] + E [g(x E(g(X ] E [g(x 3 E(g(X 3 ] + + E [g(x 2 E(g(X 2 ] E [g(x E(g(X ] + E [g(x 2 E(g(X 2 ] 2 (5 + E [g(x 2 E(g(X 2 ] E [g(x 3 E(g(X 3 ] E [g(x E(g(X ] E [g(x E(g(X ] + + E [g(x E(g(X ] 2 Each of the squared terms i the summatio is a variace, i.e., the variace of X i var(x. Specifically E [g(x i E(g(X i ] 2 Varg(X i Varg(X (6
4 4 BASIC STATISTICS The other terms i the summatio i 5 are covariaces of the form E [g(x i E(g(X i ] E [g(x j E(g(X j ] Cov [g(x i,g(x j ] (7 Now we ca use the fact that the X ad X j i the sample X,X 2,,X are idepedet to assert that each of the covariaces i the sum i 5 is zero. We ca the rewrite 5 as ( Var g(x i E [g(x E(g(X ] 2 + E [g(x 2 E(g(X 2 ] E [g(x E(g(X ] 2 Var(g(X + Var(g(X 2 + Var(g(X 3 + (8 Varg(X i Varg(X Varg(X 2.3. Theorem 3 o expected values of sample statistics. Theorem 3. Let X,X 2, X be a radom sample from a populatio with mea µ ad variace σ 2 <. The a: E X µ b: Var X σ2 c: ES 2 σ 2 Proof of part a. I theorem 2 let g(x g(x i Xi. This implies that Eg(X i µ The we ca write ( ( E X E X i E X i (EX µ (9 Proof of part b. I theorem 2 let g(x g(x i Xi. This implies that Varg(X i σ2 The we ca write ( ( Var X Var X i Var X 2 i (V arx σ2 (20 2 Proof of part c. As i part b of theorem, write S 2 as a fuctio of the sum of square of X i mius times the mea of X i squared ad the simplify ( [ ] ES 2 E Xi 2 X 2 ( EX 2 E X 2 ( ( σ (σ 2 + µ µ2 σ 2 The last lie follows from the defiitio of a radom variable, i.e., (2
5 BASIC STATISTICS 5 VarX σ 2 X EX 2 (EX 2 EX 2 µ 2 X (22 EX 2 σ 2 X µ 2 X 2.4. Ubiased Statistics. We say that a statistic T(Xis a ubiased statistic for the parameter θ of the uderlyig probability distributio if E T(X θ. Give this defiitio, X is a ubiased statistic for µ,ad S 2 is a ubiased statistic for σ 2 i a radom sample. 3. METHODS OF ESTIMATION Let Y,Y 2, Y deote a radom sample from a paret populatio characterized by the parameters θ,θ 2, θ k. It is assumed that the radom variable Y has a associated desity fuctio f( ; θ,θ 2, θ k. 3.. Method of Momets Defiitio of Momets. If Y is a radom variable, the rth momet of Y, usually deoted by µ r, is defied as µ r E(Y r y r f(y; θ,θ 2, θ k dy (23 if the expectatio exists. Note that µ E(Y µ Y, the mea of Y. Momets are sometimes writte as fuctios of θ. E(Y r µ r g r (θ,θ 2, θ k ( Defiitio of Cetral Momets. If Y is a radom variable, the rth cetral momet of Y about a is defied as E[(Y a r ].Ifaµ r, we have the rth cetral momet of Y about µ Y, deoted by µ r, which is µ r E[(Y µ Y r ] (y µ y r f(y; θ,θ 2, θ k dy (25 Note thatµ E[(Y µ Y ] 0 ad µ 2 E[(Y µ Y 2 ]Var[Y ]. Also ote that all odd umbered momets of Y aroud its mea are zero for symmetrical dsitributios, provided such momets exist Sample Momets about the Origi. The rth sample momet about the origi is defied as ˆµ r x r yi r (26
6 6 BASIC STATISTICS Estimatio Usig the Method of Momets. I geeral µ r will be a kow fuctio of the parameters θ,θ 2, θ k of the distributio of Y, that is µ r g r (θ,θ 2, θ k. Now let y,y 2,,y be a radom sample from the desity f( ; θ,θ 2, θ k. Form the K equatios µ g (θ,θ 2, θ k ˆµ µ 2 g 2 (θ,θ 2, θ k ˆµ 2. µ K g K (θ,θ 2, θ k ˆµ K y i yi 2 (27 The estimators of θ,θ 2, θ k, based o the method of momets, are obtaied by solvig the system of equatios for the K parameter estimates ˆθ, ˆθ 2, θ ˆ K. This priciple of estimatio is based upo the covetio of pickig the estimators of θı i such a maer that the correspodig populatio (theoretical momets are equal to the sample momets. These estimators are cosistet uder fairly geeral regularity coditios, but are ot geerally efficiet. Method of momets estimators may also ot be uique. y K i Example usig desity fuctio f(y (p +y p. Cosider a desity fuctio give by f(y (p +y p 0 y (28 0 otherwise Let Y,Y 2, Y deote a radom sample from the give populatio. Express the first momet of Y as a fuctio of the parameters. E(Y 0 0 yf(y dy y (p +y p dy y p+ (p +dy (29 yp+2 (p + (p +2 p + p +2 The set this expressio of the parameters equal to the first sample momet ad solve for p. 0
7 BASIC STATISTICS 7 µ E(Y p + p +2 p + p +2 y i ȳ (30 p +(p +2ȳ pȳ +2ȳ p pȳ 2ȳ p( ȳ 2ȳ ˆp 2ȳ ȳ Example usig the Normal Distributio. Let Y,Y 2, Y deote a radom sample from a ormal distributio with mea µ ad variace σ 2. Let (θ,θ 2 (µ, σ 2. Remember that µ µ ad σ 2 E[Y 2 ] E 2 [Y ]µ 2 (µ 2. µ E(Y µ (3 µ 2 E(Y 2 σ 2 + E 2 [Y ]σ 2 + µ 2 Now set the first populatio momet equal to its sample aalogue to obtai µ ˆµ ȳ Now set the secod populatio momet equal to its sample aalogue σ 2 + µ 2 y i ȳ (32 y 2 i σ 2 yi 2 µ 2 (33 σ yi 2 µ2 Now replace µ i equatio 33 with its estimator from equatio 32 to obtai ˆσ yi 2 ȳ2 (34 ˆσ (y i ȳ 2 This is, of course, from the sample stadard deviatio defied i equatios 4 ad 5.
8 8 BASIC STATISTICS Example usig the Gamma Distributio. Let X,X 2, X deote a radom sample from a gamma distributio with parameters θ ad α. The desity fuctio is give by f(x; θ, α θ α Γ(α xα e x θ 0 x< (35 0 otherwise Fid the first momet of the gamma distributio by itegratig as follows E(X 0 θ α Γ(α x θ α Γ(α xα e x θ dx (36 If we multiply equatio 36 by θ +α Γ( + α we obtai 0 x (+α e x θ dx E(X θ+α Γ( + α θ α Γ(α 0 θ +α Γ( + α x(+α e x θ dx (37 The itegrad of equatio 37 is a gamma desity with parameters θ ad α This itegrad will itegrate to oe so that we obtai the expressio i frot of the itegral sig as the E(X. E(X θ+α Γ( + α θ α Γ(α θ Γ( + α Γ(α (38 The gamma fuctio has the property that Γ(t (t Γ(t or Γ(v +vγ(v. Replacig Γ( + α with α Γ(α i equatio 38, we obtai θ Γ( + α E(X Γ(α θαγ(α Γ(α θα (39 We ca fid the secod momet by fidig E(X 2. To do this we multiply the gamma desity i equatio 36 by x 2 istead of x. Carryig out the computatio we obtai E(X 2 0 θ α Γ(α x 2 θ α Γ(α xα e x θ dx (40 0 x (2+α e x θ dx
9 BASIC STATISTICS 9 If we the multiply 40 by θ 2+α Γ(2 + α we obtai E(X 2 θ2+α Γ(2 + α θ α Γ(α 0 θ2+α Γ(2 + α θ α Γ(α θ2 (α + Γ( + α Γ(α θ2 α(α + Γ(α Γ(α θ 2 α(α + θ 2+α Γ(2 + α x(2+α e x θ dx Now set the first populatio momet equal to the sample aalogue to obtai θα x i x (42 ˆα x θ Now set the secod populatio momet equal to its sample aalogue (4 θ 2 α ( α + x 2 i θ 2 θ 2 x2 i α( α + x2 i ( x (( x θ θ + θ 2 ( x 2 θ 2 x2 i x 2 + x θ ( + x θ x 2 i x θ x 2 i x 2 θ x2 i x 2 x (x i x 2 x ( Method of least squares estimatio. Cosider the situatio i which the Y i from the radom sample ca be writte i the form Y i β + ɛ i ˆβ + e i (44 where E(ɛ i 0 ad Var(ɛ i σ 2 for all i. This is equivalet to statig that the populatio from which y i is draw has a mea of β ad a variace of σ 2.
10 0 BASIC STATISTICS The least squares estimator of β is obtaied by miimizig the sum of squares errors, SSE, defied by SSE e 2 i (y i ˆβ 2 (45 The idea is to pick the value of ˆβ to estimate β which miimizes SSE. Pictorially we select the value of ˆβ which miimizes the sum of squares of the vertical deviatios i figure. FIGURE. Least Squares Estimatio The solutio is obtaied by fidig the value of β that miimizes equatio 45. SSE β 2 (y i ˆβ( 0 ˆβ y i ȳ This method chooses values of the parameters of the uderlyig distributio, θ, such that the distace betwee the elemets of the radom sample ad predicted values are miimized. i (46
11 BASIC STATISTICS 3.3. Method of maximum likelihood estimatio (MLE. Least squares is idepedet of a specificatio of a desity fuctio for the paret populatio. Now assume that y i f ( ; θ (θ,..., θ K i. ( Motivatio for the MLE method. If a radom variable Y has a probability desity fuctio f( ; θ characterized by the parameters θ (θ,...,θ k, the the maximum likelihood estimators (MLE of θ,...,θ k are the values of these parameters which would have most likely geerated the give sample Theoretical developmet of the MLE method. The joit desity of a radom sample y,y 2,..., y is give by L g (y,,y ; θ f(y ; θ f (y 2 ; θ f(y 3 ; θ f(y ; θ. Give that we have a radom sample, the joit desity is just the product of the margial desity fuctios. This is referred to as the likelihood fuctio. The MLE of the θ i are the θ i which maximize the likelihood fuctio. The ecessary coditios for a optimum are: L 0i, 2,..., k (48 θ i This gives k equatios i k ukows to solve for the k parameters θ,..., θ k. I may istaces it will be coveiet to maximize l l L rather tha L give that the log of a product is the sum of the logs Example. Let the radom variable X i be distributed as a ormal N(µ,σ 2 so that its desity is give by f(x i ; µ, σ 2 Its likelihood fuctio is give by 2 πσ 2 e 2 ( x i µ σ 2 (49 L Π f(x i ; µ, σ 2 f(x f(x 2 f(x ( e 2 ( x i µ σ 2 e 2 ( x µ σ 2 2πσ 2 ( 2πσ 2 e 2 σ 2 (xi µ2 (50 l L l 2 l(2 πσ 2 2 σ 2 (x i µ 2 The MLE of µ ad σ 2 are obtaied by takig the partial derivatives of equatio 50
12 2 BASIC STATISTICS l µ ˆσ 2 l σ 2 2 (x i µ 0 ˆµ x i [ ] 2π 2πˆσ 2 2ˆσ 2 (2ˆσ 2 2 ( ( (ˆσ (x i ˆµ 2 x (x i ˆµ 2 0 ˆσ (x 2 i ˆµ 2 (5 ˆσ 2 (x i ˆµ 2 ˆσ 2 (x i x 2 ( s 2 The MLE of σ 2 is equal to the sample variace ad ot S 2 ; hece, the MLE is ot ubiased as ca be see from equatio 2. The MLE of µ is the sample mea Example 2  Poisso. The radom variable X i is distributed as a Poisso if the desity of X i is give by e λ λ x i x i x! i a o egative iteger f(x i ; λ 0 otherwise mea (X λ Var (X λ The likelihood fuctio is give by [ e λ ] [ λ x e λ ] λ x L x! x! (52 e λ λ Σ xi π x i! (53 l L l λ + x i l λ l ( π x i! To obtai a MLE of λ, differetiate l with respect to λ:
13 BASIC STATISTICS 3 l λ + x i λ 0 (54 ˆλ x i x Example 3. Cosider the desity fuctio f ( y (p +y p 0 y 0 otherwise (55 The likelihood fuctio is give by L Π (p + yp i l L l l [(p + y p i ] (56 (l (p + +p l y i To obtai the MLE estimator differetiate 56 with respect to p l p ( p + + l y i 0 ˆp + ( l y i ˆp + ( l y i (57 ˆp + l y i ˆp l y i Example 4. Cosider the desity fuctio The likelihood fuctio is give by f(y p yi ( p yi 0 p (58
14 4 BASIC STATISTICS L Π p yi ( p yi p i yi l L l ( p i yi ( y i l p + y i l ( p To obtai the MLE estimator differetiate 59 with respect to p where we assume that 0 < p <. i (59 l p y i p ( i y i p 0 y i p ( i y i p y i p y i p p y i (60 y i p y i ˆp 3.4. Priciple of Best Liear Ubiased Estimatio (BLUE Priciple of Best Liear Ubiased Estimatio. Start with some desired properties ad deduce a estimator satisfyig them. For example suppose that we wat the estimator to be liear i the observed radom variables. This meas that if the observatios are y,...,y, a estimator of θ must satisfy where the a i are to be determied. ˆθ a i y i ( Some required properties of the estimator (arbitrary. : E(ˆθ θ (ubiased 2: Var(ˆθ VAR( θ(miimum variace where θ is ay other liear combiatio of the y i that also produces a ubiased estimator Example. Let Y,Y 2,...,Y deote a radom sample draw from a populatio havig a mea µ ad variace σ 2. Now derive the best liear ubiased estimator (BLUE of µ. Let the proposed estimator be deoted by ˆθ. It is liear so we ca write it as follows. ˆθ a i y i (62 If the estimator is to be ubiased, there will be restrictios o the a i. Specifically
15 BASIC STATISTICS 5 Now cosider the variace of ˆθ. Ubiasedess [ ] Var( ˆθ Var a i y i E(ˆθ E µ > ( a i y i a i E(y i a i µ a i a i a 2 i Var(y i+σσ i j a i a j Cov(y i y j a 2 i σ2 because the covariace betwee y i ad y j (i j is equal to zero due to the fact that the y s are draw from a radom sample. (63 (64 subject to the co The problem of obtaiig a BLUE of µ becomes that of miimizig strait i a i. This is doe by settig up a Lagragia i a2 i The ecessary coditios for a optimum are L(a, λ a 2 i λ( a i (65 L 2a λ 0 a... L 2a λ 0 a L λ a i +0 The first equatios imply that a a 2 a 3...a so that the last equatio implies that (66
16 6 BASIC STATISTICS a i 0 a i 0 a i (67 a i ˆθ a i y i Note that equal weights are assiged to each observatio. y i ȳ 4. FINITE SAMPLE PROPERTIES OF ESTIMATORS 4.. Itroductio to sample properties of estimators. I sectio 3 we discussed alterative methods of estimatig the ukow parameters i a model. I order to compare the estimatig techiques we will discuss some criteria which are frequetly used i such a compariso. Let θ deote a ukow parameter ad let ˆθ ad θ be alterative estimators. Now defie the bias, variace ad mea squared error of ˆθ as Bias (ˆθ E (ˆθ θ Var(ˆθ E MSE (ˆθ E (ˆθ E (ˆθ 2 (ˆθ θ 2 Var(ˆθ + ( Bias The result o mea squared error ca be see as follows 2 MSE(θ E (ˆθ θ (ˆθ 2 E (ˆθ E (ˆθ + E θ ( ( 2 E ((ˆθ E (ˆθ + E ˆθ θ 2 [ (ˆθ E (ˆθ E (ˆθ +2 E θ (ˆθ 2 (ˆθ] E (ˆθ E + 2 ( 2 (ˆθ E (ˆθ + E (ˆθ θ sice E (ˆθ E (ˆθ E (ˆθ Var + ( 2 Bias(ˆθ ( 2 E (ˆθ θ 0 (68 ( Specific properties of estimators.
17 BASIC STATISTICS Ubiasedess. ˆθ is said to be a ubiased estimator of θ if E (ˆθ θ. I figure 2, ˆθ is a ubiased estimator of θ, while θ is a biased estimator. f Θ FIGURE 2. Ubiased Estimator f Θ f Θ Θ Θ Miimum variace. ˆθ is said to be a miimum variace estimator of θ if Var(ˆθ Var( θ (70 where θ is ay other estimator of θ. This criterio has its disadvatages as ca be see by otig that ˆθ costat has zero variace ad yet completely igores ay sample iformatio that we may have. I figure 3, θ has a lower variace tha ˆθ Mea squared error efficiet. ˆθ is said to be a MSE efficiet estimator of θ if MSE(ˆθ MSE( θ (7 where θ is ay other estimator of θ. This criterio takes ito accout both the variace ad bias of the estimator uder cosideratio. Figure 4 shows three alterative estimators of θ Best liear ubiased estimators. ˆθ is the best liear ubiased estimator (BLUE of θ if
18 8 BASIC STATISTICS FIGURE 3. Estimators with the Same Mea but Differet Variaces f Θ f Θ f Θ Θ ˆθ a i y i liear E(ˆθ θ ubiased (72 Var(ˆθ Var( θ where θ is ay other liear ubiased estimator of θ. For the class of ubiased estimators of ˆθ, the efficiet estimators will also be miimum variace estimators Example. Let X,X 2,...,X deote a radom sample draw from a populatio havig a populatio mea equal to µ ad a populatio variace equal to σ 2. The sample mea (estimator of µ is calculated by the formula X i X ad is a ubiased estimator of µ from theorem 3 ad equatio 9. (73 Two possible estimates of the populatio variace are ˆσ 2 S 2 (X i X 2 (X i X 2 We have show previously i theorem 3 ad equatio 2 that ˆσ 2 is a biased estimator of σ 2 ; whereas S 2 is a ubiased estimator of σ 2. Note also that
19 BASIC STATISTICS 9 FIGURE 4. Three Alterative Estimators f Θ f Θ f Θ f Θ Θ ( ˆσ 2 S 2 E (ˆσ ( 2 E ( S 2 ( σ 2 Also from theorem 3 ad equatio 20, we have that Var ( X σ2 (74 (75 Now cosider the mea square error of the two estimators X ad S 2 where X,X 2,...X are a radom sample from a ormal populatio with a mea of µ ad a variace of σ 2.
20 20 BASIC STATISTICS E ( 2 ( σ X µ Var X 2 E ( S 2 σ 2 2 ( Var S 2 2 (76 σ4 The variace of S 2 was derived i the lecture o sample momets. The variace of ˆσ 2 is easily computed give the variace of S 2. Specifically, (( Varˆσ 2 Var s 2 ( 2 Var ( S 2 ( ( σ 4 2( σ4 We ca compute the MSE of ˆσ 2 usig equatios 68, 74, ad 77 as follows 2 MSE ˆσ 2 E (ˆσ 2 σ 2 2( σ ( σ4 2 + σ 4 ( 2( 2 + [( ] 2 σ 2 σ 2 ( 2 ( σ 4 2 ( ( 2 σ 4 + σ ( 2 2+ σ ( 2 σ (78 Now compare the MSE s of S 2 ad ˆσ 2. ( ( 2 2 MSEˆσ 2 σ 4 < σ 4 2 MSE S 2 (79 So ˆσ 2 is a biased estimator of S 2 but has lower mea square error.
Chapter 7 Methods of Finding Estimators
Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 Chapter 7 Methods of Fidig Estimators Sectio 7.1 Itroductio Defiitio 7.1.1 A poit estimator is ay fuctio W( X) W( X1, X,, X ) of
More informationProperties of MLE: consistency, asymptotic normality. Fisher information.
Lecture 3 Properties of MLE: cosistecy, asymptotic ormality. Fisher iformatio. I this sectio we will try to uderstad why MLEs are good. Let us recall two facts from probability that we be used ofte throughout
More informationUniversity of California, Los Angeles Department of Statistics. Distributions related to the normal distribution
Uiversity of Califoria, Los Ageles Departmet of Statistics Statistics 100B Istructor: Nicolas Christou Three importat distributios: Distributios related to the ormal distributio Chisquare (χ ) distributio.
More informationStatistical inference: example 1. Inferential Statistics
Statistical iferece: example 1 Iferetial Statistics POPULATION SAMPLE A clothig store chai regularly buys from a supplier large quatities of a certai piece of clothig. Each item ca be classified either
More informationSampling Distribution And Central Limit Theorem
() Samplig Distributio & Cetral Limit Samplig Distributio Ad Cetral Limit Samplig distributio of the sample mea If we sample a umber of samples (say k samples where k is very large umber) each of size,
More informationMaximum Likelihood Estimators.
Lecture 2 Maximum Likelihood Estimators. Matlab example. As a motivatio, let us look at oe Matlab example. Let us geerate a radom sample of size 00 from beta distributio Beta(5, 2). We will lear the defiitio
More informationNormal Distribution.
Normal Distributio www.icrf.l Normal distributio I probability theory, the ormal or Gaussia distributio, is a cotiuous probability distributio that is ofte used as a first approimatio to describe realvalued
More informationI. Chisquared Distributions
1 M 358K Supplemet to Chapter 23: CHISQUARED DISTRIBUTIONS, TDISTRIBUTIONS, AND DEGREES OF FREEDOM To uderstad tdistributios, we first eed to look at aother family of distributios, the chisquared distributios.
More informationChapter 6: Variance, the law of large numbers and the MonteCarlo method
Chapter 6: Variace, the law of large umbers ad the MoteCarlo method Expected value, variace, ad Chebyshev iequality. If X is a radom variable recall that the expected value of X, E[X] is the average value
More informationChapter 7  Sampling Distributions. 1 Introduction. What is statistics? It consist of three major areas:
Chapter 7  Samplig Distributios 1 Itroductio What is statistics? It cosist of three major areas: Data Collectio: samplig plas ad experimetal desigs Descriptive Statistics: umerical ad graphical summaries
More information1 Computing the Standard Deviation of Sample Means
Computig the Stadard Deviatio of Sample Meas Quality cotrol charts are based o sample meas ot o idividual values withi a sample. A sample is a group of items, which are cosidered all together for our aalysis.
More informationOverview of some probability distributions.
Lecture Overview of some probability distributios. I this lecture we will review several commo distributios that will be used ofte throughtout the class. Each distributio is usually described by its probability
More informationTHE REGRESSION MODEL IN MATRIX FORM. For simple linear regression, meaning one predictor, the model is. for i = 1, 2, 3,, n
We will cosider the liear regressio model i matrix form. For simple liear regressio, meaig oe predictor, the model is i = + x i + ε i for i =,,,, This model icludes the assumptio that the ε i s are a sample
More informationParametric (theoretical) probability distributions. (Wilks, Ch. 4) Discrete distributions: (e.g., yes/no; above normal, normal, below normal)
6 Parametric (theoretical) probability distributios. (Wilks, Ch. 4) Note: parametric: assume a theoretical distributio (e.g., Gauss) Noparametric: o assumptio made about the distributio Advatages of assumig
More informationHypothesis testing. Null and alternative hypotheses
Hypothesis testig Aother importat use of samplig distributios is to test hypotheses about populatio parameters, e.g. mea, proportio, regressio coefficiets, etc. For example, it is possible to stipulate
More informationUC Berkeley Department of Electrical Engineering and Computer Science. EE 126: Probablity and Random Processes. Solutions 9 Spring 2006
Exam format UC Bereley Departmet of Electrical Egieerig ad Computer Sciece EE 6: Probablity ad Radom Processes Solutios 9 Sprig 006 The secod midterm will be held o Wedesday May 7; CHECK the fial exam
More informationCase Study. Normal and t Distributions. Density Plot. Normal Distributions
Case Study Normal ad t Distributios Bret Halo ad Bret Larget Departmet of Statistics Uiversity of Wiscosi Madiso October 11 13, 2011 Case Study Body temperature varies withi idividuals over time (it ca
More information0.7 0.6 0.2 0 0 96 96.5 97 97.5 98 98.5 99 99.5 100 100.5 96.5 97 97.5 98 98.5 99 99.5 100 100.5
Sectio 13 KolmogorovSmirov test. Suppose that we have a i.i.d. sample X 1,..., X with some ukow distributio P ad we would like to test the hypothesis that P is equal to a particular distributio P 0, i.e.
More informationUnbiased Estimation. Topic 14. 14.1 Introduction
Topic 4 Ubiased Estimatio 4. Itroductio I creatig a parameter estimator, a fudametal questio is whether or ot the estimator differs from the parameter i a systematic maer. Let s examie this by lookig a
More informationOur aim is to show that under reasonable assumptions a given 2πperiodic function f can be represented as convergent series
8 Fourier Series Our aim is to show that uder reasoable assumptios a give periodic fuctio f ca be represeted as coverget series f(x) = a + (a cos x + b si x). (8.) By defiitio, the covergece of the series
More informationConfidence Intervals for One Mean
Chapter 420 Cofidece Itervals for Oe Mea Itroductio This routie calculates the sample size ecessary to achieve a specified distace from the mea to the cofidece limit(s) at a stated cofidece level for a
More informationOutput Analysis (2, Chapters 10 &11 Law)
B. Maddah ENMG 6 Simulatio 05/0/07 Output Aalysis (, Chapters 10 &11 Law) Comparig alterative system cofiguratio Sice the output of a simulatio is radom, the comparig differet systems via simulatio should
More information5: Introduction to Estimation
5: Itroductio to Estimatio Cotets Acroyms ad symbols... 1 Statistical iferece... Estimatig µ with cofidece... 3 Samplig distributio of the mea... 3 Cofidece Iterval for μ whe σ is kow before had... 4 Sample
More informationSAMPLE QUESTIONS FOR FINAL EXAM. (1) (2) (3) (4) Find the following using the definition of the Riemann integral: (2x + 1)dx
SAMPLE QUESTIONS FOR FINAL EXAM REAL ANALYSIS I FALL 006 3 4 Fid the followig usig the defiitio of the Riema itegral: a 0 x + dx 3 Cosider the partitio P x 0 3, x 3 +, x 3 +,......, x 3 3 + 3 of the iterval
More informationCS103A Handout 23 Winter 2002 February 22, 2002 Solving Recurrence Relations
CS3A Hadout 3 Witer 00 February, 00 Solvig Recurrece Relatios Itroductio A wide variety of recurrece problems occur i models. Some of these recurrece relatios ca be solved usig iteratio or some other ad
More informationSoving Recurrence Relations
Sovig Recurrece Relatios Part 1. Homogeeous liear 2d degree relatios with costat coefficiets. Cosider the recurrece relatio ( ) T () + at ( 1) + bt ( 2) = 0 This is called a homogeeous liear 2d degree
More informationA probabilistic proof of a binomial identity
A probabilistic proof of a biomial idetity Joatho Peterso Abstract We give a elemetary probabilistic proof of a biomial idetity. The proof is obtaied by computig the probability of a certai evet i two
More information1. MATHEMATICAL INDUCTION
1. MATHEMATICAL INDUCTION EXAMPLE 1: Prove that for ay iteger 1. Proof: 1 + 2 + 3 +... + ( + 1 2 (1.1 STEP 1: For 1 (1.1 is true, sice 1 1(1 + 1. 2 STEP 2: Suppose (1.1 is true for some k 1, that is 1
More informationInfinite Sequences and Series
CHAPTER 4 Ifiite Sequeces ad Series 4.1. Sequeces A sequece is a ifiite ordered list of umbers, for example the sequece of odd positive itegers: 1, 3, 5, 7, 9, 11, 13, 15, 17, 19, 21, 23, 25, 27, 29...
More informationIn nite Sequences. Dr. Philippe B. Laval Kennesaw State University. October 9, 2008
I ite Sequeces Dr. Philippe B. Laval Keesaw State Uiversity October 9, 2008 Abstract This had out is a itroductio to i ite sequeces. mai de itios ad presets some elemetary results. It gives the I ite Sequeces
More informationSolutions to Selected Problems In: Pattern Classification by Duda, Hart, Stork
Solutios to Selected Problems I: Patter Classificatio by Duda, Hart, Stork Joh L. Weatherwax February 4, 008 Problem Solutios Chapter Bayesia Decisio Theory Problem radomized rules Part a: Let Rx be the
More informationIncremental calculation of weighted mean and variance
Icremetal calculatio of weighted mea ad variace Toy Fich faf@cam.ac.uk dot@dotat.at Uiversity of Cambridge Computig Service February 009 Abstract I these otes I eplai how to derive formulae for umerically
More informationChapter 5: Inner Product Spaces
Chapter 5: Ier Product Spaces Chapter 5: Ier Product Spaces SECION A Itroductio to Ier Product Spaces By the ed of this sectio you will be able to uderstad what is meat by a ier product space give examples
More information, a Wishart distribution with n 1 degrees of freedom and scale matrix.
UMEÅ UNIVERSITET Matematiskstatistiska istitutioe Multivariat dataaalys D MSTD79 PA TENTAMEN 00409 LÖSNINGSFÖRSLAG TILL TENTAMEN I MATEMATISK STATISTIK Multivariat dataaalys D, 5 poäg.. Assume that
More informationTrigonometric Form of a Complex Number. The Complex Plane. axis. ( 2, 1) or 2 i FIGURE 6.44. The absolute value of the complex number z a bi is
0_0605.qxd /5/05 0:45 AM Page 470 470 Chapter 6 Additioal Topics i Trigoometry 6.5 Trigoometric Form of a Complex Number What you should lear Plot complex umbers i the complex plae ad fid absolute values
More informationCS103X: Discrete Structures Homework 4 Solutions
CS103X: Discrete Structures Homewor 4 Solutios Due February 22, 2008 Exercise 1 10 poits. Silico Valley questios: a How may possible sixfigure salaries i whole dollar amouts are there that cotai at least
More informationMEI Structured Mathematics. Module Summary Sheets. Statistics 2 (Version B: reference to new book)
MEI Mathematics i Educatio ad Idustry MEI Structured Mathematics Module Summary Sheets Statistics (Versio B: referece to ew book) Topic : The Poisso Distributio Topic : The Normal Distributio Topic 3:
More informationMeasures of Spread and Boxplots Discrete Math, Section 9.4
Measures of Spread ad Boxplots Discrete Math, Sectio 9.4 We start with a example: Example 1: Comparig Mea ad Media Compute the mea ad media of each data set: S 1 = {4, 6, 8, 10, 1, 14, 16} S = {4, 7, 9,
More information1. C. The formula for the confidence interval for a population mean is: x t, which was
s 1. C. The formula for the cofidece iterval for a populatio mea is: x t, which was based o the sample Mea. So, x is guarateed to be i the iterval you form.. D. Use the rule : pvalue
More informationPSYCHOLOGICAL STATISTICS
UNIVERSITY OF CALICUT SCHOOL OF DISTANCE EDUCATION B Sc. Cousellig Psychology (0 Adm.) IV SEMESTER COMPLEMENTARY COURSE PSYCHOLOGICAL STATISTICS QUESTION BANK. Iferetial statistics is the brach of statistics
More informationPROCEEDINGS OF THE YEREVAN STATE UNIVERSITY AN ALTERNATIVE MODEL FOR BONUSMALUS SYSTEM
PROCEEDINGS OF THE YEREVAN STATE UNIVERSITY Physical ad Mathematical Scieces 2015, 1, p. 15 19 M a t h e m a t i c s AN ALTERNATIVE MODEL FOR BONUSMALUS SYSTEM A. G. GULYAN Chair of Actuarial Mathematics
More informationThe following example will help us understand The Sampling Distribution of the Mean. C1 C2 C3 C4 C5 50 miles 84 miles 38 miles 120 miles 48 miles
The followig eample will help us uderstad The Samplig Distributio of the Mea Review: The populatio is the etire collectio of all idividuals or objects of iterest The sample is the portio of the populatio
More informationhp calculators HP 12C Statistics  average and standard deviation Average and standard deviation concepts HP12C average and standard deviation
HP 1C Statistics  average ad stadard deviatio Average ad stadard deviatio cocepts HP1C average ad stadard deviatio Practice calculatig averages ad stadard deviatios with oe or two variables HP 1C Statistics
More informationZTEST / ZSTATISTIC: used to test hypotheses about. µ when the population standard deviation is unknown
ZTEST / ZSTATISTIC: used to test hypotheses about µ whe the populatio stadard deviatio is kow ad populatio distributio is ormal or sample size is large TTEST / TSTATISTIC: used to test hypotheses about
More informationA gentle introduction to Expectation Maximization
A getle itroductio to Expectatio Maximizatio Mark Johso Brow Uiversity November 2009 1 / 15 Outlie What is Expectatio Maximizatio? Mixture models ad clusterig EM for setece topic modelig 2 / 15 Why Expectatio
More informationSequences and Series
CHAPTER 9 Sequeces ad Series 9.. Covergece: Defiitio ad Examples Sequeces The purpose of this chapter is to itroduce a particular way of geeratig algorithms for fidig the values of fuctios defied by their
More informationCenter, Spread, and Shape in Inference: Claims, Caveats, and Insights
Ceter, Spread, ad Shape i Iferece: Claims, Caveats, ad Isights Dr. Nacy Pfeig (Uiversity of Pittsburgh) AMATYC November 2008 Prelimiary Activities 1. I would like to produce a iterval estimate for the
More informationApproximating Area under a curve with rectangles. To find the area under a curve we approximate the area using rectangles and then use limits to find
1.8 Approximatig Area uder a curve with rectagles 1.6 To fid the area uder a curve we approximate the area usig rectagles ad the use limits to fid 1.4 the area. Example 1 Suppose we wat to estimate 1.
More informationOverview. Learning Objectives. Point Estimate. Estimation. Estimating the Value of a Parameter Using Confidence Intervals
Overview Estimatig the Value of a Parameter Usig Cofidece Itervals We apply the results about the sample mea the problem of estimatio Estimatio is the process of usig sample data estimate the value of
More informationSection 11.3: The Integral Test
Sectio.3: The Itegral Test Most of the series we have looked at have either diverged or have coverged ad we have bee able to fid what they coverge to. I geeral however, the problem is much more difficult
More informationDetermining the sample size
Determiig the sample size Oe of the most commo questios ay statisticia gets asked is How large a sample size do I eed? Researchers are ofte surprised to fid out that the aswer depeds o a umber of factors
More informationModified Line Search Method for Global Optimization
Modified Lie Search Method for Global Optimizatio Cria Grosa ad Ajith Abraham Ceter of Excellece for Quatifiable Quality of Service Norwegia Uiversity of Sciece ad Techology Trodheim, Norway {cria, ajith}@q2s.tu.o
More informationConvexity, Inequalities, and Norms
Covexity, Iequalities, ad Norms Covex Fuctios You are probably familiar with the otio of cocavity of fuctios. Give a twicedifferetiable fuctio ϕ: R R, We say that ϕ is covex (or cocave up) if ϕ (x) 0 for
More information3. Greatest Common Divisor  Least Common Multiple
3 Greatest Commo Divisor  Least Commo Multiple Defiitio 31: The greatest commo divisor of two atural umbers a ad b is the largest atural umber c which divides both a ad b We deote the greatest commo gcd
More informationSection 8.3 : De Moivre s Theorem and Applications
The Sectio 8 : De Moivre s Theorem ad Applicatios Let z 1 ad z be complex umbers, where z 1 = r 1, z = r, arg(z 1 ) = θ 1, arg(z ) = θ z 1 = r 1 (cos θ 1 + i si θ 1 ) z = r (cos θ + i si θ ) ad z 1 z =
More informationSTATISTICAL METHODS FOR BUSINESS
STATISTICAL METHODS FOR BUSINESS UNIT 7: INFERENTIAL TOOLS. DISTRIBUTIONS ASSOCIATED WITH SAMPLING 7.1. Distributios associated with the samplig process. 7.2. Iferetial processes ad relevat distributios.
More informationAsymptotic Growth of Functions
CMPS Itroductio to Aalysis of Algorithms Fall 3 Asymptotic Growth of Fuctios We itroduce several types of asymptotic otatio which are used to compare the performace ad efficiecy of algorithms As we ll
More informationExample 2 Find the square root of 0. The only square root of 0 is 0 (since 0 is not positive or negative, so those choices don t exist here).
BEGINNING ALGEBRA Roots ad Radicals (revised summer, 00 Olso) Packet to Supplemet the Curret Textbook  Part Review of Square Roots & Irratioals (This portio ca be ay time before Part ad should mostly
More information1 Correlation and Regression Analysis
1 Correlatio ad Regressio Aalysis I this sectio we will be ivestigatig the relatioship betwee two cotiuous variable, such as height ad weight, the cocetratio of a ijected drug ad heart rate, or the cosumptio
More informationTHE TWOVARIABLE LINEAR REGRESSION MODEL
THE TWOVARIABLE LINEAR REGRESSION MODEL Herma J. Bieres Pesylvaia State Uiversity April 30, 202. Itroductio Suppose you are a ecoomics or busiess maor i a college close to the beach i the souther part
More informationMath C067 Sampling Distributions
Math C067 Samplig Distributios Sample Mea ad Sample Proportio Richard Beigel Some time betwee April 16, 2007 ad April 16, 2007 Examples of Samplig A pollster may try to estimate the proportio of voters
More informationLECTURE 13: Crossvalidation
LECTURE 3: Crossvalidatio Resampli methods Cross Validatio Bootstrap Bias ad variace estimatio with the Bootstrap Threeway data partitioi Itroductio to Patter Aalysis Ricardo GutierrezOsua Texas A&M
More informationLesson 15 ANOVA (analysis of variance)
Outlie Variability betwee group variability withi group variability total variability Fratio Computatio sums of squares (betwee/withi/total degrees of freedom (betwee/withi/total mea square (betwee/withi
More informationChapter 14 Nonparametric Statistics
Chapter 14 Noparametric Statistics A.K.A. distributiofree statistics! Does ot deped o the populatio fittig ay particular type of distributio (e.g, ormal). Sice these methods make fewer assumptios, they
More information5.3. Generalized Permutations and Combinations
53 GENERALIZED PERMUTATIONS AND COMBINATIONS 73 53 Geeralized Permutatios ad Combiatios 53 Permutatios with Repeated Elemets Assume that we have a alphabet with letters ad we wat to write all possible
More informationGCSE STATISTICS. 4) How to calculate the range: The difference between the biggest number and the smallest number.
GCSE STATISTICS You should kow: 1) How to draw a frequecy diagram: e.g. NUMBER TALLY FREQUENCY 1 3 5 ) How to draw a bar chart, a pictogram, ad a pie chart. 3) How to use averages: a) Mea  add up all
More informationMaximum Likelihood Estimation
Math 541: Statistical Theory II Lecturer: Songfeng Zheng Maximum Likelihood Estimation 1 Maximum Likelihood Estimation Maximum likelihood is a relatively simple method of constructing an estimator for
More informationFactoring x n 1: cyclotomic and Aurifeuillian polynomials Paul Garrett <garrett@math.umn.edu>
(March 16, 004) Factorig x 1: cyclotomic ad Aurifeuillia polyomials Paul Garrett Polyomials of the form x 1, x 3 1, x 4 1 have at least oe systematic factorizatio x 1 = (x 1)(x 1
More informationVladimir N. Burkov, Dmitri A. Novikov MODELS AND METHODS OF MULTIPROJECTS MANAGEMENT
Keywords: project maagemet, resource allocatio, etwork plaig Vladimir N Burkov, Dmitri A Novikov MODELS AND METHODS OF MULTIPROJECTS MANAGEMENT The paper deals with the problems of resource allocatio betwee
More informationA Mathematical Perspective on Gambling
A Mathematical Perspective o Gamblig Molly Maxwell Abstract. This paper presets some basic topics i probability ad statistics, icludig sample spaces, probabilistic evets, expectatios, the biomial ad ormal
More informationFIBONACCI NUMBERS: AN APPLICATION OF LINEAR ALGEBRA. 1. Powers of a matrix
FIBONACCI NUMBERS: AN APPLICATION OF LINEAR ALGEBRA. Powers of a matrix We begi with a propositio which illustrates the usefuless of the diagoalizatio. Recall that a square matrix A is diogaalizable if
More informationTheorems About Power Series
Physics 6A Witer 20 Theorems About Power Series Cosider a power series, f(x) = a x, () where the a are real coefficiets ad x is a real variable. There exists a real oegative umber R, called the radius
More informationBasic Elements of Arithmetic Sequences and Series
MA40S PRECALCULUS UNIT G GEOMETRIC SEQUENCES CLASS NOTES (COMPLETED NO NEED TO COPY NOTES FROM OVERHEAD) Basic Elemets of Arithmetic Sequeces ad Series Objective: To establish basic elemets of arithmetic
More informationOnesample test of proportions
Oesample test of proportios The Settig: Idividuals i some populatio ca be classified ito oe of two categories. You wat to make iferece about the proportio i each category, so you draw a sample. Examples:
More information4.3. The Integral and Comparison Tests
4.3. THE INTEGRAL AND COMPARISON TESTS 9 4.3. The Itegral ad Compariso Tests 4.3.. The Itegral Test. Suppose f is a cotiuous, positive, decreasig fuctio o [, ), ad let a = f(). The the covergece or divergece
More informationChapter 7: Confidence Interval and Sample Size
Chapter 7: Cofidece Iterval ad Sample Size Learig Objectives Upo successful completio of Chapter 7, you will be able to: Fid the cofidece iterval for the mea, proportio, ad variace. Determie the miimum
More informationLecture 5: Span, linear independence, bases, and dimension
Lecture 5: Spa, liear idepedece, bases, ad dimesio Travis Schedler Thurs, Sep 23, 2010 (versio: 9/21 9:55 PM) 1 Motivatio Motivatio To uderstad what it meas that R has dimesio oe, R 2 dimesio 2, etc.;
More informationLecture 13. Lecturer: Jonathan Kelner Scribe: Jonathan Pines (2009)
18.409 A Algorithmist s Toolkit October 27, 2009 Lecture 13 Lecturer: Joatha Keler Scribe: Joatha Pies (2009) 1 Outlie Last time, we proved the BruMikowski iequality for boxes. Today we ll go over the
More information1 The Gaussian channel
ECE 77 Lecture 0 The Gaussia chael Objective: I this lecture we will lear about commuicatio over a chael of practical iterest, i which the trasmitted sigal is subjected to additive white Gaussia oise.
More informationNonlife insurance mathematics. Nils F. Haavardsson, University of Oslo and DNB Skadeforsikring
Nolife isurace mathematics Nils F. Haavardsso, Uiversity of Oslo ad DNB Skadeforsikrig Mai issues so far Why does isurace work? How is risk premium defied ad why is it importat? How ca claim frequecy
More information7. Concepts in Probability, Statistics and Stochastic Modelling
7. Cocepts i Probability, Statistics ad Stochastic Modellig 1. Itroductio 169. Probability Cocepts ad Methods 170.1. Radom Variables ad Distributios 170.. Expectatio 173.3. Quatiles, Momets ad Their Estimators
More informationDescriptive Statistics
Descriptive Statistics We leared to describe data sets graphically. We ca also describe a data set umerically. Measures of Locatio Defiitio The sample mea is the arithmetic average of values. We deote
More informationCME 302: NUMERICAL LINEAR ALGEBRA FALL 2005/06 LECTURE 8
CME 30: NUMERICAL LINEAR ALGEBRA FALL 005/06 LECTURE 8 GENE H GOLUB 1 Positive Defiite Matrices A matrix A is positive defiite if x Ax > 0 for all ozero x A positive defiite matrix has real ad positive
More informationS. Tanny MAT 344 Spring 1999. be the minimum number of moves required.
S. Tay MAT 344 Sprig 999 Recurrece Relatios Tower of Haoi Let T be the miimum umber of moves required. T 0 = 0, T = 7 Iitial Coditios * T = T + $ T is a sequece (f. o itegers). Solve for T? * is a recurrece,
More informationParameter estimation for nonlinear models: Numerical approaches to solving the inverse problem. Lecture 11 04/01/2008. Sven Zenker
Parameter estimatio for oliear models: Numerical approaches to solvig the iverse problem Lecture 11 04/01/2008 Sve Zeker Review: Trasformatio of radom variables Cosider probability distributio of a radom
More informationThe Stable Marriage Problem
The Stable Marriage Problem William Hut Lae Departmet of Computer Sciece ad Electrical Egieerig, West Virgiia Uiversity, Morgatow, WV William.Hut@mail.wvu.edu 1 Itroductio Imagie you are a matchmaker,
More informationTaking DCOP to the Real World: Efficient Complete Solutions for Distributed MultiEvent Scheduling
Taig DCOP to the Real World: Efficiet Complete Solutios for Distributed MultiEvet Schedulig Rajiv T. Maheswara, Milid Tambe, Emma Bowrig, Joatha P. Pearce, ad Pradeep araatham Uiversity of Souther Califoria
More informationLecture 4: Cheeger s Inequality
Spectral Graph Theory ad Applicatios WS 0/0 Lecture 4: Cheeger s Iequality Lecturer: Thomas Sauerwald & He Su Statemet of Cheeger s Iequality I this lecture we assume for simplicity that G is a dregular
More informationDefinition. A variable X that takes on values X 1, X 2, X 3,...X k with respective frequencies f 1, f 2, f 3,...f k has mean
1 Social Studies 201 October 13, 2004 Note: The examples i these otes may be differet tha used i class. However, the examples are similar ad the methods used are idetical to what was preseted i class.
More informationwhere: T = number of years of cash flow in investment's life n = the year in which the cash flow X n i = IRR = the internal rate of return
EVALUATING ALTERNATIVE CAPITAL INVESTMENT PROGRAMS By Ke D. Duft, Extesio Ecoomist I the March 98 issue of this publicatio we reviewed the procedure by which a capital ivestmet project was assessed. The
More informationLecture 3. denote the orthogonal complement of S k. Then. 1 x S k. n. 2 x T Ax = ( ) λ x. with x = 1, we have. i = λ k x 2 = λ k.
18.409 A Algorithmist s Toolkit September 17, 009 Lecture 3 Lecturer: Joatha Keler Scribe: Adre Wibisoo 1 Outlie Today s lecture covers three mai parts: CouratFischer formula ad Rayleigh quotiets The
More informationWeek 3 Conditional probabilities, Bayes formula, WEEK 3 page 1 Expected value of a random variable
Week 3 Coditioal probabilities, Bayes formula, WEEK 3 page 1 Expected value of a radom variable We recall our discussio of 5 card poker hads. Example 13 : a) What is the probability of evet A that a 5
More informationSECTION 1.5 : SUMMATION NOTATION + WORK WITH SEQUENCES
SECTION 1.5 : SUMMATION NOTATION + WORK WITH SEQUENCES Read Sectio 1.5 (pages 5 9) Overview I Sectio 1.5 we lear to work with summatio otatio ad formulas. We will also itroduce a brief overview of sequeces,
More informationEkkehart Schlicht: Economic Surplus and Derived Demand
Ekkehart Schlicht: Ecoomic Surplus ad Derived Demad Muich Discussio Paper No. 200617 Departmet of Ecoomics Uiversity of Muich Volkswirtschaftliche Fakultät LudwigMaximiliasUiversität Müche Olie at http://epub.ub.uimueche.de/940/
More informationSubject CT5 Contingencies Core Technical Syllabus
Subject CT5 Cotigecies Core Techical Syllabus for the 2015 exams 1 Jue 2014 Aim The aim of the Cotigecies subject is to provide a groudig i the mathematical techiques which ca be used to model ad value
More informationAP Calculus AB 2006 Scoring Guidelines Form B
AP Calculus AB 6 Scorig Guidelies Form B The College Board: Coectig Studets to College Success The College Board is a otforprofit membership associatio whose missio is to coect studets to college success
More informationLecture 4: Cauchy sequences, BolzanoWeierstrass, and the Squeeze theorem
Lecture 4: Cauchy sequeces, BolzaoWeierstrass, ad the Squeeze theorem The purpose of this lecture is more modest tha the previous oes. It is to state certai coditios uder which we are guarateed that limits
More informationHypergeometric Distributions
7.4 Hypergeometric Distributios Whe choosig the startig lieup for a game, a coach obviously has to choose a differet player for each positio. Similarly, whe a uio elects delegates for a covetio or you
More informationTIGHT BOUNDS ON EXPECTED ORDER STATISTICS
Probability i the Egieerig ad Iformatioal Scieces, 20, 2006, 667 686+ Prited i the U+S+A+ TIGHT BOUNDS ON EXPECTED ORDER STATISTICS DIMITRIS BERTSIMAS Sloa School of Maagemet ad Operatios Research Ceter
More informationCOMPARISON OF THE EFFICIENCY OF SCONTROL CHART AND EWMAS 2 CONTROL CHART FOR THE CHANGES IN A PROCESS
COMPARISON OF THE EFFICIENCY OF SCONTROL CHART AND EWMAS CONTROL CHART FOR THE CHANGES IN A PROCESS Supraee Lisawadi Departmet of Mathematics ad Statistics, Faculty of Sciece ad Techoology, Thammasat
More information