BASIC STATISTICS. f(x 1,x 2,..., x n )=f(x 1 )f(x 2 ) f(x n )= f(x i ) (1)

Save this PDF as:
 WORD  PNG  TXT  JPG

Size: px
Start display at page:

Download "BASIC STATISTICS. f(x 1,x 2,..., x n )=f(x 1 )f(x 2 ) f(x n )= f(x i ) (1)"

Transcription

1 BASIC STATISTICS. SAMPLES, RANDOM SAMPLING AND SAMPLE STATISTICS.. Radom Sample. The radom variables X,X 2,..., X are called a radom sample of size from the populatio f(x if X,X 2,..., X are mutually idepedet radom variables ad the margial probability desity fuctio of each X i is the same fuctio of f(x. Alteratively, X,X 2,..., X are called idepedet ad idetically distributed radom variables with pdf f(x. We abbreviate idepedet ad idetically distributed as iid. Most experimets ivolve > repeated observatios o a particular variable, the first observatio is X, the secod is X 2, ad so o. Each X i is a observatio o the same variable ad each X i has a margial distributio give by f(x. Give that the observatios are collected i such a way that the value of oe observatio has o effect or relatioship with ay of the other observatios, the X,X 2,..., X are mutually idepedet. Therefore we ca write the joit probability desity for the sample X,X 2,..., X as f(x,x 2,..., x f(x f(x 2 f(x f(x i ( If the uderlyig probability model is parameterized by θ, the we ca also write f(x,x 2,..., x θ f(x i θ (2 Note that the same θ is used i each term of the product, or i each margial desity. A differet value of θ would lead to a differet properties for the radom sample..2. Statistics. Let X,X 2,..., X be a radom sample of size from a populatio ad let T (x,x 2,..., x be a real valued or vector valued fuctio whose domai icludes the sample space of (X,X 2,..., X. The the radom variable or radom vector Y (X,X 2,..., X is called a statistic. A statistic is a map from the sample space of (X,X 2,..., X call it X, to some space of values, usually R or R. T is what we compute whe we observe the radom variable X take o some specific values i a sample. The probability distributio of a statistic Y T(X is called the samplig distributio of Y. Notice that T( is a fuctio of sample values oly, it does ot deped o ay uderlyig parameters, θ..3. Some Commoly Used Statistics..3.. Sample mea. The sample mea is the arithmetic average of the values i a radom sample. It is usually deoted X(X,X 2,,X X + X X X i (3 The observed value of X i ay sample is demoted by the lower case letter, i.e., x. Date: September 27, 2004.

2 2 BASIC STATISTICS.3.2. Sample variace. The sample variace is the statistic defied by S 2 (X,X 2,,X (X i X 2 (4 The observed value of S 2 i ay sample is demoted by the lower case letter, i.e., s Sample stadard deviatio. The sample stadard deviatio is the statistic defied by S S 2 ( Sample midrage. The sample mid-rage is the statistic defied by max(x,x 2,,X mi(x,x 2,,X ( Empirical distributio fuctio. The empirical distributio fuctio is defied by ˆF (X,X 2,,X (x I(X i <x (7 where ˆF(X,X 2,,X (x meas we are evaluatig the statistic ˆF (X,X 2,,X at the particular value x. The radom sample X,X 2,..., X is assumed to come from a probability defied o R ad I(A is the idicator of the evet A. This statistic takes values i the set of all distributio fuctios o R. It estimates the fuctio valued parameter F defied by its evaluatio at x R F (P (x P [X <x] (8 2. DISTRIBUTION OF SAMPLE STATISTICS 2.. Theorem o squared deviatios ad sample variaces. Theorem. Let x,x 2, x be ay umbers ad let x x+x2+...+x. The the followig two items hold. a: mi a (x i a 2 (x i x 2 b: ( s 2 (x i x 2 x2 i x2 Part a says that the sample mea is the value about which the sum of squared deviatios is miimized. Part b is a simple idetity that will prove immesely useful i dealig with statistical data. Proof. First cosider part a of theorem. Add ad subtract x from the expressio o the lefthad side i part a ad the expad as follows (x i x + x a 2 (x i x 2 +2 (x i x( x a+ ( x a 2 (9 Now write out the middle term i 9 ad simplify (x i x( x a x x i a x i x x + x a (0 x 2 a x x 2 + xa 0

3 BASIC STATISTICS 3 We ca the write 9 as (x i a 2 (x i x 2 + ( x a 2 ( Equatio is clearly miimized whe a x. Now cosider part b of theorem. Expad the secod expressio i part b ad simplify (x i x 2 x 2 i 2 x x i + x 2 (2 x 2 i 2 x 2 + x 2 x 2 i x Theorem 2 o expected values ad variaces of sums. Theorem 2. Let X,X 2, X be a radom sample from a populatio ad let g(x be a fuctio such that Eg(X ad Varg(X exist. The followig two items hold. a: E( g(x i (Eg(X b: Var( g(x i (Varg(X Proof. First cosider part a of theorem 2. Write the expected value of the sum as the sum of the expected values ad the ote that Eg(X Eg(X 2...Eg(X i...eg(x because the X i are all from the same distributio. ( E g(x i E(g(X i (Eg(X (3 First cosider part b of theorem 2. Write the defiitio of the variace for a variable z as E(z E(z 2 ad the combie terms i the summatio sig. ( [ ( 2 Var g(x i E g(x i E g(x i ] (4 Now write out the bottom expressio i equatio 4 as follows ( Var g(x i E [g(x E(g(X ] 2 + E [g(x E(g(X ] E [g(x 2 E(g(X 2 ] + E [g(x E(g(X ] E [g(x 3 E(g(X 3 ] + + E [g(x 2 E(g(X 2 ] E [g(x E(g(X ] + E [g(x 2 E(g(X 2 ] 2 (5 + E [g(x 2 E(g(X 2 ] E [g(x 3 E(g(X 3 ] E [g(x E(g(X ] E [g(x E(g(X ] + + E [g(x E(g(X ] 2 Each of the squared terms i the summatio is a variace, i.e., the variace of X i var(x. Specifically E [g(x i E(g(X i ] 2 Varg(X i Varg(X (6

4 4 BASIC STATISTICS The other terms i the summatio i 5 are covariaces of the form E [g(x i E(g(X i ] E [g(x j E(g(X j ] Cov [g(x i,g(x j ] (7 Now we ca use the fact that the X ad X j i the sample X,X 2,,X are idepedet to assert that each of the covariaces i the sum i 5 is zero. We ca the rewrite 5 as ( Var g(x i E [g(x E(g(X ] 2 + E [g(x 2 E(g(X 2 ] E [g(x E(g(X ] 2 Var(g(X + Var(g(X 2 + Var(g(X 3 + (8 Varg(X i Varg(X Varg(X 2.3. Theorem 3 o expected values of sample statistics. Theorem 3. Let X,X 2, X be a radom sample from a populatio with mea µ ad variace σ 2 <. The a: E X µ b: Var X σ2 c: ES 2 σ 2 Proof of part a. I theorem 2 let g(x g(x i Xi. This implies that Eg(X i µ The we ca write ( ( E X E X i E X i (EX µ (9 Proof of part b. I theorem 2 let g(x g(x i Xi. This implies that Varg(X i σ2 The we ca write ( ( Var X Var X i Var X 2 i (V arx σ2 (20 2 Proof of part c. As i part b of theorem, write S 2 as a fuctio of the sum of square of X i mius times the mea of X i squared ad the simplify ( [ ] ES 2 E Xi 2 X 2 ( EX 2 E X 2 ( ( σ (σ 2 + µ µ2 σ 2 The last lie follows from the defiitio of a radom variable, i.e., (2

5 BASIC STATISTICS 5 VarX σ 2 X EX 2 (EX 2 EX 2 µ 2 X (22 EX 2 σ 2 X µ 2 X 2.4. Ubiased Statistics. We say that a statistic T(Xis a ubiased statistic for the parameter θ of the uderlyig probability distributio if E T(X θ. Give this defiitio, X is a ubiased statistic for µ,ad S 2 is a ubiased statistic for σ 2 i a radom sample. 3. METHODS OF ESTIMATION Let Y,Y 2, Y deote a radom sample from a paret populatio characterized by the parameters θ,θ 2, θ k. It is assumed that the radom variable Y has a associated desity fuctio f( ; θ,θ 2, θ k. 3.. Method of Momets Defiitio of Momets. If Y is a radom variable, the rth momet of Y, usually deoted by µ r, is defied as µ r E(Y r y r f(y; θ,θ 2, θ k dy (23 if the expectatio exists. Note that µ E(Y µ Y, the mea of Y. Momets are sometimes writte as fuctios of θ. E(Y r µ r g r (θ,θ 2, θ k ( Defiitio of Cetral Momets. If Y is a radom variable, the rth cetral momet of Y about a is defied as E[(Y a r ].Ifaµ r, we have the rth cetral momet of Y about µ Y, deoted by µ r, which is µ r E[(Y µ Y r ] (y µ y r f(y; θ,θ 2, θ k dy (25 Note thatµ E[(Y µ Y ] 0 ad µ 2 E[(Y µ Y 2 ]Var[Y ]. Also ote that all odd umbered momets of Y aroud its mea are zero for symmetrical dsitributios, provided such momets exist Sample Momets about the Origi. The rth sample momet about the origi is defied as ˆµ r x r yi r (26

6 6 BASIC STATISTICS Estimatio Usig the Method of Momets. I geeral µ r will be a kow fuctio of the parameters θ,θ 2, θ k of the distributio of Y, that is µ r g r (θ,θ 2, θ k. Now let y,y 2,,y be a radom sample from the desity f( ; θ,θ 2, θ k. Form the K equatios µ g (θ,θ 2, θ k ˆµ µ 2 g 2 (θ,θ 2, θ k ˆµ 2. µ K g K (θ,θ 2, θ k ˆµ K y i yi 2 (27 The estimators of θ,θ 2, θ k, based o the method of momets, are obtaied by solvig the system of equatios for the K parameter estimates ˆθ, ˆθ 2, θ ˆ K. This priciple of estimatio is based upo the covetio of pickig the estimators of θı i such a maer that the correspodig populatio (theoretical momets are equal to the sample momets. These estimators are cosistet uder fairly geeral regularity coditios, but are ot geerally efficiet. Method of momets estimators may also ot be uique. y K i Example usig desity fuctio f(y (p +y p. Cosider a desity fuctio give by f(y (p +y p 0 y (28 0 otherwise Let Y,Y 2, Y deote a radom sample from the give populatio. Express the first momet of Y as a fuctio of the parameters. E(Y 0 0 yf(y dy y (p +y p dy y p+ (p +dy (29 yp+2 (p + (p +2 p + p +2 The set this expressio of the parameters equal to the first sample momet ad solve for p. 0

7 BASIC STATISTICS 7 µ E(Y p + p +2 p + p +2 y i ȳ (30 p +(p +2ȳ pȳ +2ȳ p pȳ 2ȳ p( ȳ 2ȳ ˆp 2ȳ ȳ Example usig the Normal Distributio. Let Y,Y 2, Y deote a radom sample from a ormal distributio with mea µ ad variace σ 2. Let (θ,θ 2 (µ, σ 2. Remember that µ µ ad σ 2 E[Y 2 ] E 2 [Y ]µ 2 (µ 2. µ E(Y µ (3 µ 2 E(Y 2 σ 2 + E 2 [Y ]σ 2 + µ 2 Now set the first populatio momet equal to its sample aalogue to obtai µ ˆµ ȳ Now set the secod populatio momet equal to its sample aalogue σ 2 + µ 2 y i ȳ (32 y 2 i σ 2 yi 2 µ 2 (33 σ yi 2 µ2 Now replace µ i equatio 33 with its estimator from equatio 32 to obtai ˆσ yi 2 ȳ2 (34 ˆσ (y i ȳ 2 This is, of course, from the sample stadard deviatio defied i equatios 4 ad 5.

8 8 BASIC STATISTICS Example usig the Gamma Distributio. Let X,X 2, X deote a radom sample from a gamma distributio with parameters θ ad α. The desity fuctio is give by f(x; θ, α θ α Γ(α xα e x θ 0 x< (35 0 otherwise Fid the first momet of the gamma distributio by itegratig as follows E(X 0 θ α Γ(α x θ α Γ(α xα e x θ dx (36 If we multiply equatio 36 by θ +α Γ( + α we obtai 0 x (+α e x θ dx E(X θ+α Γ( + α θ α Γ(α 0 θ +α Γ( + α x(+α e x θ dx (37 The itegrad of equatio 37 is a gamma desity with parameters θ ad α This itegrad will itegrate to oe so that we obtai the expressio i frot of the itegral sig as the E(X. E(X θ+α Γ( + α θ α Γ(α θ Γ( + α Γ(α (38 The gamma fuctio has the property that Γ(t (t Γ(t or Γ(v +vγ(v. Replacig Γ( + α with α Γ(α i equatio 38, we obtai θ Γ( + α E(X Γ(α θαγ(α Γ(α θα (39 We ca fid the secod momet by fidig E(X 2. To do this we multiply the gamma desity i equatio 36 by x 2 istead of x. Carryig out the computatio we obtai E(X 2 0 θ α Γ(α x 2 θ α Γ(α xα e x θ dx (40 0 x (2+α e x θ dx

9 BASIC STATISTICS 9 If we the multiply 40 by θ 2+α Γ(2 + α we obtai E(X 2 θ2+α Γ(2 + α θ α Γ(α 0 θ2+α Γ(2 + α θ α Γ(α θ2 (α + Γ( + α Γ(α θ2 α(α + Γ(α Γ(α θ 2 α(α + θ 2+α Γ(2 + α x(2+α e x θ dx Now set the first populatio momet equal to the sample aalogue to obtai θα x i x (42 ˆα x θ Now set the secod populatio momet equal to its sample aalogue (4 θ 2 α ( α + x 2 i θ 2 θ 2 x2 i α( α + x2 i ( x (( x θ θ + θ 2 ( x 2 θ 2 x2 i x 2 + x θ ( + x θ x 2 i x θ x 2 i x 2 θ x2 i x 2 x (x i x 2 x ( Method of least squares estimatio. Cosider the situatio i which the Y i from the radom sample ca be writte i the form Y i β + ɛ i ˆβ + e i (44 where E(ɛ i 0 ad Var(ɛ i σ 2 for all i. This is equivalet to statig that the populatio from which y i is draw has a mea of β ad a variace of σ 2.

10 0 BASIC STATISTICS The least squares estimator of β is obtaied by miimizig the sum of squares errors, SSE, defied by SSE e 2 i (y i ˆβ 2 (45 The idea is to pick the value of ˆβ to estimate β which miimizes SSE. Pictorially we select the value of ˆβ which miimizes the sum of squares of the vertical deviatios i figure. FIGURE. Least Squares Estimatio The solutio is obtaied by fidig the value of β that miimizes equatio 45. SSE β 2 (y i ˆβ( 0 ˆβ y i ȳ This method chooses values of the parameters of the uderlyig distributio, θ, such that the distace betwee the elemets of the radom sample ad predicted values are miimized. i (46

11 BASIC STATISTICS 3.3. Method of maximum likelihood estimatio (MLE. Least squares is idepedet of a specificatio of a desity fuctio for the paret populatio. Now assume that y i f ( ; θ (θ,..., θ K i. ( Motivatio for the MLE method. If a radom variable Y has a probability desity fuctio f( ; θ characterized by the parameters θ (θ,...,θ k, the the maximum likelihood estimators (MLE of θ,...,θ k are the values of these parameters which would have most likely geerated the give sample Theoretical developmet of the MLE method. The joit desity of a radom sample y,y 2,..., y is give by L g (y,,y ; θ f(y ; θ f (y 2 ; θ f(y 3 ; θ f(y ; θ. Give that we have a radom sample, the joit desity is just the product of the margial desity fuctios. This is referred to as the likelihood fuctio. The MLE of the θ i are the θ i which maximize the likelihood fuctio. The ecessary coditios for a optimum are: L 0i, 2,..., k (48 θ i This gives k equatios i k ukows to solve for the k parameters θ,..., θ k. I may istaces it will be coveiet to maximize l l L rather tha L give that the log of a product is the sum of the logs Example. Let the radom variable X i be distributed as a ormal N(µ,σ 2 so that its desity is give by f(x i ; µ, σ 2 Its likelihood fuctio is give by 2 πσ 2 e 2 ( x i µ σ 2 (49 L Π f(x i ; µ, σ 2 f(x f(x 2 f(x ( e 2 ( x i µ σ 2 e 2 ( x µ σ 2 2πσ 2 ( 2πσ 2 e 2 σ 2 (xi µ2 (50 l L l 2 l(2 πσ 2 2 σ 2 (x i µ 2 The MLE of µ ad σ 2 are obtaied by takig the partial derivatives of equatio 50

12 2 BASIC STATISTICS l µ ˆσ 2 l σ 2 2 (x i µ 0 ˆµ x i [ ] 2π 2πˆσ 2 2ˆσ 2 (2ˆσ 2 2 ( ( (ˆσ (x i ˆµ 2 x (x i ˆµ 2 0 ˆσ (x 2 i ˆµ 2 (5 ˆσ 2 (x i ˆµ 2 ˆσ 2 (x i x 2 ( s 2 The MLE of σ 2 is equal to the sample variace ad ot S 2 ; hece, the MLE is ot ubiased as ca be see from equatio 2. The MLE of µ is the sample mea Example 2 - Poisso. The radom variable X i is distributed as a Poisso if the desity of X i is give by e λ λ x i x i x! i a o egative iteger f(x i ; λ 0 otherwise mea (X λ Var (X λ The likelihood fuctio is give by [ e λ ] [ λ x e λ ] λ x L x! x! (52 e λ λ Σ xi π x i! (53 l L l λ + x i l λ l ( π x i! To obtai a MLE of λ, differetiate l with respect to λ:

13 BASIC STATISTICS 3 l λ + x i λ 0 (54 ˆλ x i x Example 3. Cosider the desity fuctio f ( y (p +y p 0 y 0 otherwise (55 The likelihood fuctio is give by L Π (p + yp i l L l l [(p + y p i ] (56 (l (p + +p l y i To obtai the MLE estimator differetiate 56 with respect to p l p ( p + + l y i 0 ˆp + ( l y i ˆp + ( l y i (57 ˆp + l y i ˆp l y i Example 4. Cosider the desity fuctio The likelihood fuctio is give by f(y p yi ( p yi 0 p (58

14 4 BASIC STATISTICS L Π p yi ( p yi p i yi l L l ( p i yi ( y i l p + y i l ( p To obtai the MLE estimator differetiate 59 with respect to p where we assume that 0 < p <. i (59 l p y i p ( i y i p 0 y i p ( i y i p y i p y i p p y i (60 y i p y i ˆp 3.4. Priciple of Best Liear Ubiased Estimatio (BLUE Priciple of Best Liear Ubiased Estimatio. Start with some desired properties ad deduce a estimator satisfyig them. For example suppose that we wat the estimator to be liear i the observed radom variables. This meas that if the observatios are y,...,y, a estimator of θ must satisfy where the a i are to be determied. ˆθ a i y i ( Some required properties of the estimator (arbitrary. : E(ˆθ θ (ubiased 2: Var(ˆθ VAR( θ(miimum variace where θ is ay other liear combiatio of the y i that also produces a ubiased estimator Example. Let Y,Y 2,...,Y deote a radom sample draw from a populatio havig a mea µ ad variace σ 2. Now derive the best liear ubiased estimator (BLUE of µ. Let the proposed estimator be deoted by ˆθ. It is liear so we ca write it as follows. ˆθ a i y i (62 If the estimator is to be ubiased, there will be restrictios o the a i. Specifically

15 BASIC STATISTICS 5 Now cosider the variace of ˆθ. Ubiasedess [ ] Var( ˆθ Var a i y i E(ˆθ E µ > ( a i y i a i E(y i a i µ a i a i a 2 i Var(y i+σσ i j a i a j Cov(y i y j a 2 i σ2 because the covariace betwee y i ad y j (i j is equal to zero due to the fact that the y s are draw from a radom sample. (63 (64 subject to the co- The problem of obtaiig a BLUE of µ becomes that of miimizig strait i a i. This is doe by settig up a Lagragia i a2 i The ecessary coditios for a optimum are L(a, λ a 2 i λ( a i (65 L 2a λ 0 a... L 2a λ 0 a L λ a i +0 The first equatios imply that a a 2 a 3...a so that the last equatio implies that (66

16 6 BASIC STATISTICS a i 0 a i 0 a i (67 a i ˆθ a i y i Note that equal weights are assiged to each observatio. y i ȳ 4. FINITE SAMPLE PROPERTIES OF ESTIMATORS 4.. Itroductio to sample properties of estimators. I sectio 3 we discussed alterative methods of estimatig the ukow parameters i a model. I order to compare the estimatig techiques we will discuss some criteria which are frequetly used i such a compariso. Let θ deote a ukow parameter ad let ˆθ ad θ be alterative estimators. Now defie the bias, variace ad mea squared error of ˆθ as Bias (ˆθ E (ˆθ θ Var(ˆθ E MSE (ˆθ E (ˆθ E (ˆθ 2 (ˆθ θ 2 Var(ˆθ + ( Bias The result o mea squared error ca be see as follows 2 MSE(θ E (ˆθ θ (ˆθ 2 E (ˆθ E (ˆθ + E θ ( ( 2 E ((ˆθ E (ˆθ + E ˆθ θ 2 [ (ˆθ E (ˆθ E (ˆθ +2 E θ (ˆθ 2 (ˆθ] E (ˆθ E + 2 ( 2 (ˆθ E (ˆθ + E (ˆθ θ sice E (ˆθ E (ˆθ E (ˆθ Var + ( 2 Bias(ˆθ ( 2 E (ˆθ θ 0 (68 ( Specific properties of estimators.

17 BASIC STATISTICS Ubiasedess. ˆθ is said to be a ubiased estimator of θ if E (ˆθ θ. I figure 2, ˆθ is a ubiased estimator of θ, while θ is a biased estimator. f Θ FIGURE 2. Ubiased Estimator f Θ f Θ Θ Θ Miimum variace. ˆθ is said to be a miimum variace estimator of θ if Var(ˆθ Var( θ (70 where θ is ay other estimator of θ. This criterio has its disadvatages as ca be see by otig that ˆθ costat has zero variace ad yet completely igores ay sample iformatio that we may have. I figure 3, θ has a lower variace tha ˆθ Mea squared error efficiet. ˆθ is said to be a MSE efficiet estimator of θ if MSE(ˆθ MSE( θ (7 where θ is ay other estimator of θ. This criterio takes ito accout both the variace ad bias of the estimator uder cosideratio. Figure 4 shows three alterative estimators of θ Best liear ubiased estimators. ˆθ is the best liear ubiased estimator (BLUE of θ if

18 8 BASIC STATISTICS FIGURE 3. Estimators with the Same Mea but Differet Variaces f Θ f Θ f Θ Θ ˆθ a i y i liear E(ˆθ θ ubiased (72 Var(ˆθ Var( θ where θ is ay other liear ubiased estimator of θ. For the class of ubiased estimators of ˆθ, the efficiet estimators will also be miimum variace estimators Example. Let X,X 2,...,X deote a radom sample draw from a populatio havig a populatio mea equal to µ ad a populatio variace equal to σ 2. The sample mea (estimator of µ is calculated by the formula X i X ad is a ubiased estimator of µ from theorem 3 ad equatio 9. (73 Two possible estimates of the populatio variace are ˆσ 2 S 2 (X i X 2 (X i X 2 We have show previously i theorem 3 ad equatio 2 that ˆσ 2 is a biased estimator of σ 2 ; whereas S 2 is a ubiased estimator of σ 2. Note also that

19 BASIC STATISTICS 9 FIGURE 4. Three Alterative Estimators f Θ f Θ f Θ f Θ Θ ( ˆσ 2 S 2 E (ˆσ ( 2 E ( S 2 ( σ 2 Also from theorem 3 ad equatio 20, we have that Var ( X σ2 (74 (75 Now cosider the mea square error of the two estimators X ad S 2 where X,X 2,...X are a radom sample from a ormal populatio with a mea of µ ad a variace of σ 2.

20 20 BASIC STATISTICS E ( 2 ( σ X µ Var X 2 E ( S 2 σ 2 2 ( Var S 2 2 (76 σ4 The variace of S 2 was derived i the lecture o sample momets. The variace of ˆσ 2 is easily computed give the variace of S 2. Specifically, (( Varˆσ 2 Var s 2 ( 2 Var ( S 2 ( ( σ 4 2( σ4 We ca compute the MSE of ˆσ 2 usig equatios 68, 74, ad 77 as follows 2 MSE ˆσ 2 E (ˆσ 2 σ 2 2( σ ( σ4 2 + σ 4 ( 2( 2 + [( ] 2 σ 2 σ 2 ( 2 ( σ 4 2 ( ( 2 σ 4 + σ ( 2 2+ σ ( 2 σ (78 Now compare the MSE s of S 2 ad ˆσ 2. ( ( 2 2 MSEˆσ 2 σ 4 < σ 4 2 MSE S 2 (79 So ˆσ 2 is a biased estimator of S 2 but has lower mea square error.

Chapter 7 Methods of Finding Estimators

Chapter 7 Methods of Finding Estimators Chapter 7 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 011 Chapter 7 Methods of Fidig Estimators Sectio 7.1 Itroductio Defiitio 7.1.1 A poit estimator is ay fuctio W( X) W( X1, X,, X ) of

More information

Properties of MLE: consistency, asymptotic normality. Fisher information.

Properties of MLE: consistency, asymptotic normality. Fisher information. Lecture 3 Properties of MLE: cosistecy, asymptotic ormality. Fisher iformatio. I this sectio we will try to uderstad why MLEs are good. Let us recall two facts from probability that we be used ofte throughout

More information

University of California, Los Angeles Department of Statistics. Distributions related to the normal distribution

University of California, Los Angeles Department of Statistics. Distributions related to the normal distribution Uiversity of Califoria, Los Ageles Departmet of Statistics Statistics 100B Istructor: Nicolas Christou Three importat distributios: Distributios related to the ormal distributio Chi-square (χ ) distributio.

More information

Statistical inference: example 1. Inferential Statistics

Statistical inference: example 1. Inferential Statistics Statistical iferece: example 1 Iferetial Statistics POPULATION SAMPLE A clothig store chai regularly buys from a supplier large quatities of a certai piece of clothig. Each item ca be classified either

More information

Sampling Distribution And Central Limit Theorem

Sampling Distribution And Central Limit Theorem () Samplig Distributio & Cetral Limit Samplig Distributio Ad Cetral Limit Samplig distributio of the sample mea If we sample a umber of samples (say k samples where k is very large umber) each of size,

More information

Maximum Likelihood Estimators.

Maximum Likelihood Estimators. Lecture 2 Maximum Likelihood Estimators. Matlab example. As a motivatio, let us look at oe Matlab example. Let us geerate a radom sample of size 00 from beta distributio Beta(5, 2). We will lear the defiitio

More information

Normal Distribution.

Normal Distribution. Normal Distributio www.icrf.l Normal distributio I probability theory, the ormal or Gaussia distributio, is a cotiuous probability distributio that is ofte used as a first approimatio to describe realvalued

More information

I. Chi-squared Distributions

I. Chi-squared Distributions 1 M 358K Supplemet to Chapter 23: CHI-SQUARED DISTRIBUTIONS, T-DISTRIBUTIONS, AND DEGREES OF FREEDOM To uderstad t-distributios, we first eed to look at aother family of distributios, the chi-squared distributios.

More information

Chapter 6: Variance, the law of large numbers and the Monte-Carlo method

Chapter 6: Variance, the law of large numbers and the Monte-Carlo method Chapter 6: Variace, the law of large umbers ad the Mote-Carlo method Expected value, variace, ad Chebyshev iequality. If X is a radom variable recall that the expected value of X, E[X] is the average value

More information

Chapter 7 - Sampling Distributions. 1 Introduction. What is statistics? It consist of three major areas:

Chapter 7 - Sampling Distributions. 1 Introduction. What is statistics? It consist of three major areas: Chapter 7 - Samplig Distributios 1 Itroductio What is statistics? It cosist of three major areas: Data Collectio: samplig plas ad experimetal desigs Descriptive Statistics: umerical ad graphical summaries

More information

1 Computing the Standard Deviation of Sample Means

1 Computing the Standard Deviation of Sample Means Computig the Stadard Deviatio of Sample Meas Quality cotrol charts are based o sample meas ot o idividual values withi a sample. A sample is a group of items, which are cosidered all together for our aalysis.

More information

Overview of some probability distributions.

Overview of some probability distributions. Lecture Overview of some probability distributios. I this lecture we will review several commo distributios that will be used ofte throughtout the class. Each distributio is usually described by its probability

More information

THE REGRESSION MODEL IN MATRIX FORM. For simple linear regression, meaning one predictor, the model is. for i = 1, 2, 3,, n

THE REGRESSION MODEL IN MATRIX FORM. For simple linear regression, meaning one predictor, the model is. for i = 1, 2, 3,, n We will cosider the liear regressio model i matrix form. For simple liear regressio, meaig oe predictor, the model is i = + x i + ε i for i =,,,, This model icludes the assumptio that the ε i s are a sample

More information

Parametric (theoretical) probability distributions. (Wilks, Ch. 4) Discrete distributions: (e.g., yes/no; above normal, normal, below normal)

Parametric (theoretical) probability distributions. (Wilks, Ch. 4) Discrete distributions: (e.g., yes/no; above normal, normal, below normal) 6 Parametric (theoretical) probability distributios. (Wilks, Ch. 4) Note: parametric: assume a theoretical distributio (e.g., Gauss) No-parametric: o assumptio made about the distributio Advatages of assumig

More information

Hypothesis testing. Null and alternative hypotheses

Hypothesis testing. Null and alternative hypotheses Hypothesis testig Aother importat use of samplig distributios is to test hypotheses about populatio parameters, e.g. mea, proportio, regressio coefficiets, etc. For example, it is possible to stipulate

More information

UC Berkeley Department of Electrical Engineering and Computer Science. EE 126: Probablity and Random Processes. Solutions 9 Spring 2006

UC Berkeley Department of Electrical Engineering and Computer Science. EE 126: Probablity and Random Processes. Solutions 9 Spring 2006 Exam format UC Bereley Departmet of Electrical Egieerig ad Computer Sciece EE 6: Probablity ad Radom Processes Solutios 9 Sprig 006 The secod midterm will be held o Wedesday May 7; CHECK the fial exam

More information

Case Study. Normal and t Distributions. Density Plot. Normal Distributions

Case Study. Normal and t Distributions. Density Plot. Normal Distributions Case Study Normal ad t Distributios Bret Halo ad Bret Larget Departmet of Statistics Uiversity of Wiscosi Madiso October 11 13, 2011 Case Study Body temperature varies withi idividuals over time (it ca

More information

0.7 0.6 0.2 0 0 96 96.5 97 97.5 98 98.5 99 99.5 100 100.5 96.5 97 97.5 98 98.5 99 99.5 100 100.5

0.7 0.6 0.2 0 0 96 96.5 97 97.5 98 98.5 99 99.5 100 100.5 96.5 97 97.5 98 98.5 99 99.5 100 100.5 Sectio 13 Kolmogorov-Smirov test. Suppose that we have a i.i.d. sample X 1,..., X with some ukow distributio P ad we would like to test the hypothesis that P is equal to a particular distributio P 0, i.e.

More information

Unbiased Estimation. Topic 14. 14.1 Introduction

Unbiased Estimation. Topic 14. 14.1 Introduction Topic 4 Ubiased Estimatio 4. Itroductio I creatig a parameter estimator, a fudametal questio is whether or ot the estimator differs from the parameter i a systematic maer. Let s examie this by lookig a

More information

Our aim is to show that under reasonable assumptions a given 2π-periodic function f can be represented as convergent series

Our aim is to show that under reasonable assumptions a given 2π-periodic function f can be represented as convergent series 8 Fourier Series Our aim is to show that uder reasoable assumptios a give -periodic fuctio f ca be represeted as coverget series f(x) = a + (a cos x + b si x). (8.) By defiitio, the covergece of the series

More information

Confidence Intervals for One Mean

Confidence Intervals for One Mean Chapter 420 Cofidece Itervals for Oe Mea Itroductio This routie calculates the sample size ecessary to achieve a specified distace from the mea to the cofidece limit(s) at a stated cofidece level for a

More information

Output Analysis (2, Chapters 10 &11 Law)

Output Analysis (2, Chapters 10 &11 Law) B. Maddah ENMG 6 Simulatio 05/0/07 Output Aalysis (, Chapters 10 &11 Law) Comparig alterative system cofiguratio Sice the output of a simulatio is radom, the comparig differet systems via simulatio should

More information

5: Introduction to Estimation

5: Introduction to Estimation 5: Itroductio to Estimatio Cotets Acroyms ad symbols... 1 Statistical iferece... Estimatig µ with cofidece... 3 Samplig distributio of the mea... 3 Cofidece Iterval for μ whe σ is kow before had... 4 Sample

More information

SAMPLE QUESTIONS FOR FINAL EXAM. (1) (2) (3) (4) Find the following using the definition of the Riemann integral: (2x + 1)dx

SAMPLE QUESTIONS FOR FINAL EXAM. (1) (2) (3) (4) Find the following using the definition of the Riemann integral: (2x + 1)dx SAMPLE QUESTIONS FOR FINAL EXAM REAL ANALYSIS I FALL 006 3 4 Fid the followig usig the defiitio of the Riema itegral: a 0 x + dx 3 Cosider the partitio P x 0 3, x 3 +, x 3 +,......, x 3 3 + 3 of the iterval

More information

CS103A Handout 23 Winter 2002 February 22, 2002 Solving Recurrence Relations

CS103A Handout 23 Winter 2002 February 22, 2002 Solving Recurrence Relations CS3A Hadout 3 Witer 00 February, 00 Solvig Recurrece Relatios Itroductio A wide variety of recurrece problems occur i models. Some of these recurrece relatios ca be solved usig iteratio or some other ad

More information

Soving Recurrence Relations

Soving Recurrence Relations Sovig Recurrece Relatios Part 1. Homogeeous liear 2d degree relatios with costat coefficiets. Cosider the recurrece relatio ( ) T () + at ( 1) + bt ( 2) = 0 This is called a homogeeous liear 2d degree

More information

A probabilistic proof of a binomial identity

A probabilistic proof of a binomial identity A probabilistic proof of a biomial idetity Joatho Peterso Abstract We give a elemetary probabilistic proof of a biomial idetity. The proof is obtaied by computig the probability of a certai evet i two

More information

1. MATHEMATICAL INDUCTION

1. MATHEMATICAL INDUCTION 1. MATHEMATICAL INDUCTION EXAMPLE 1: Prove that for ay iteger 1. Proof: 1 + 2 + 3 +... + ( + 1 2 (1.1 STEP 1: For 1 (1.1 is true, sice 1 1(1 + 1. 2 STEP 2: Suppose (1.1 is true for some k 1, that is 1

More information

Infinite Sequences and Series

Infinite Sequences and Series CHAPTER 4 Ifiite Sequeces ad Series 4.1. Sequeces A sequece is a ifiite ordered list of umbers, for example the sequece of odd positive itegers: 1, 3, 5, 7, 9, 11, 13, 15, 17, 19, 21, 23, 25, 27, 29...

More information

In nite Sequences. Dr. Philippe B. Laval Kennesaw State University. October 9, 2008

In nite Sequences. Dr. Philippe B. Laval Kennesaw State University. October 9, 2008 I ite Sequeces Dr. Philippe B. Laval Keesaw State Uiversity October 9, 2008 Abstract This had out is a itroductio to i ite sequeces. mai de itios ad presets some elemetary results. It gives the I ite Sequeces

More information

Solutions to Selected Problems In: Pattern Classification by Duda, Hart, Stork

Solutions to Selected Problems In: Pattern Classification by Duda, Hart, Stork Solutios to Selected Problems I: Patter Classificatio by Duda, Hart, Stork Joh L. Weatherwax February 4, 008 Problem Solutios Chapter Bayesia Decisio Theory Problem radomized rules Part a: Let Rx be the

More information

Incremental calculation of weighted mean and variance

Incremental calculation of weighted mean and variance Icremetal calculatio of weighted mea ad variace Toy Fich faf@cam.ac.uk dot@dotat.at Uiversity of Cambridge Computig Service February 009 Abstract I these otes I eplai how to derive formulae for umerically

More information

Chapter 5: Inner Product Spaces

Chapter 5: Inner Product Spaces Chapter 5: Ier Product Spaces Chapter 5: Ier Product Spaces SECION A Itroductio to Ier Product Spaces By the ed of this sectio you will be able to uderstad what is meat by a ier product space give examples

More information

, a Wishart distribution with n -1 degrees of freedom and scale matrix.

, a Wishart distribution with n -1 degrees of freedom and scale matrix. UMEÅ UNIVERSITET Matematisk-statistiska istitutioe Multivariat dataaalys D MSTD79 PA TENTAMEN 004-0-9 LÖSNINGSFÖRSLAG TILL TENTAMEN I MATEMATISK STATISTIK Multivariat dataaalys D, 5 poäg.. Assume that

More information

Trigonometric Form of a Complex Number. The Complex Plane. axis. ( 2, 1) or 2 i FIGURE 6.44. The absolute value of the complex number z a bi is

Trigonometric Form of a Complex Number. The Complex Plane. axis. ( 2, 1) or 2 i FIGURE 6.44. The absolute value of the complex number z a bi is 0_0605.qxd /5/05 0:45 AM Page 470 470 Chapter 6 Additioal Topics i Trigoometry 6.5 Trigoometric Form of a Complex Number What you should lear Plot complex umbers i the complex plae ad fid absolute values

More information

CS103X: Discrete Structures Homework 4 Solutions

CS103X: Discrete Structures Homework 4 Solutions CS103X: Discrete Structures Homewor 4 Solutios Due February 22, 2008 Exercise 1 10 poits. Silico Valley questios: a How may possible six-figure salaries i whole dollar amouts are there that cotai at least

More information

MEI Structured Mathematics. Module Summary Sheets. Statistics 2 (Version B: reference to new book)

MEI Structured Mathematics. Module Summary Sheets. Statistics 2 (Version B: reference to new book) MEI Mathematics i Educatio ad Idustry MEI Structured Mathematics Module Summary Sheets Statistics (Versio B: referece to ew book) Topic : The Poisso Distributio Topic : The Normal Distributio Topic 3:

More information

Measures of Spread and Boxplots Discrete Math, Section 9.4

Measures of Spread and Boxplots Discrete Math, Section 9.4 Measures of Spread ad Boxplots Discrete Math, Sectio 9.4 We start with a example: Example 1: Comparig Mea ad Media Compute the mea ad media of each data set: S 1 = {4, 6, 8, 10, 1, 14, 16} S = {4, 7, 9,

More information

1. C. The formula for the confidence interval for a population mean is: x t, which was

1. C. The formula for the confidence interval for a population mean is: x t, which was s 1. C. The formula for the cofidece iterval for a populatio mea is: x t, which was based o the sample Mea. So, x is guarateed to be i the iterval you form.. D. Use the rule : p-value

More information

PSYCHOLOGICAL STATISTICS

PSYCHOLOGICAL STATISTICS UNIVERSITY OF CALICUT SCHOOL OF DISTANCE EDUCATION B Sc. Cousellig Psychology (0 Adm.) IV SEMESTER COMPLEMENTARY COURSE PSYCHOLOGICAL STATISTICS QUESTION BANK. Iferetial statistics is the brach of statistics

More information

PROCEEDINGS OF THE YEREVAN STATE UNIVERSITY AN ALTERNATIVE MODEL FOR BONUS-MALUS SYSTEM

PROCEEDINGS OF THE YEREVAN STATE UNIVERSITY AN ALTERNATIVE MODEL FOR BONUS-MALUS SYSTEM PROCEEDINGS OF THE YEREVAN STATE UNIVERSITY Physical ad Mathematical Scieces 2015, 1, p. 15 19 M a t h e m a t i c s AN ALTERNATIVE MODEL FOR BONUS-MALUS SYSTEM A. G. GULYAN Chair of Actuarial Mathematics

More information

The following example will help us understand The Sampling Distribution of the Mean. C1 C2 C3 C4 C5 50 miles 84 miles 38 miles 120 miles 48 miles

The following example will help us understand The Sampling Distribution of the Mean. C1 C2 C3 C4 C5 50 miles 84 miles 38 miles 120 miles 48 miles The followig eample will help us uderstad The Samplig Distributio of the Mea Review: The populatio is the etire collectio of all idividuals or objects of iterest The sample is the portio of the populatio

More information

hp calculators HP 12C Statistics - average and standard deviation Average and standard deviation concepts HP12C average and standard deviation

hp calculators HP 12C Statistics - average and standard deviation Average and standard deviation concepts HP12C average and standard deviation HP 1C Statistics - average ad stadard deviatio Average ad stadard deviatio cocepts HP1C average ad stadard deviatio Practice calculatig averages ad stadard deviatios with oe or two variables HP 1C Statistics

More information

Z-TEST / Z-STATISTIC: used to test hypotheses about. µ when the population standard deviation is unknown

Z-TEST / Z-STATISTIC: used to test hypotheses about. µ when the population standard deviation is unknown Z-TEST / Z-STATISTIC: used to test hypotheses about µ whe the populatio stadard deviatio is kow ad populatio distributio is ormal or sample size is large T-TEST / T-STATISTIC: used to test hypotheses about

More information

A gentle introduction to Expectation Maximization

A gentle introduction to Expectation Maximization A getle itroductio to Expectatio Maximizatio Mark Johso Brow Uiversity November 2009 1 / 15 Outlie What is Expectatio Maximizatio? Mixture models ad clusterig EM for setece topic modelig 2 / 15 Why Expectatio

More information

Sequences and Series

Sequences and Series CHAPTER 9 Sequeces ad Series 9.. Covergece: Defiitio ad Examples Sequeces The purpose of this chapter is to itroduce a particular way of geeratig algorithms for fidig the values of fuctios defied by their

More information

Center, Spread, and Shape in Inference: Claims, Caveats, and Insights

Center, Spread, and Shape in Inference: Claims, Caveats, and Insights Ceter, Spread, ad Shape i Iferece: Claims, Caveats, ad Isights Dr. Nacy Pfeig (Uiversity of Pittsburgh) AMATYC November 2008 Prelimiary Activities 1. I would like to produce a iterval estimate for the

More information

Approximating Area under a curve with rectangles. To find the area under a curve we approximate the area using rectangles and then use limits to find

Approximating Area under a curve with rectangles. To find the area under a curve we approximate the area using rectangles and then use limits to find 1.8 Approximatig Area uder a curve with rectagles 1.6 To fid the area uder a curve we approximate the area usig rectagles ad the use limits to fid 1.4 the area. Example 1 Suppose we wat to estimate 1.

More information

Overview. Learning Objectives. Point Estimate. Estimation. Estimating the Value of a Parameter Using Confidence Intervals

Overview. Learning Objectives. Point Estimate. Estimation. Estimating the Value of a Parameter Using Confidence Intervals Overview Estimatig the Value of a Parameter Usig Cofidece Itervals We apply the results about the sample mea the problem of estimatio Estimatio is the process of usig sample data estimate the value of

More information

Section 11.3: The Integral Test

Section 11.3: The Integral Test Sectio.3: The Itegral Test Most of the series we have looked at have either diverged or have coverged ad we have bee able to fid what they coverge to. I geeral however, the problem is much more difficult

More information

Determining the sample size

Determining the sample size Determiig the sample size Oe of the most commo questios ay statisticia gets asked is How large a sample size do I eed? Researchers are ofte surprised to fid out that the aswer depeds o a umber of factors

More information

Modified Line Search Method for Global Optimization

Modified Line Search Method for Global Optimization Modified Lie Search Method for Global Optimizatio Cria Grosa ad Ajith Abraham Ceter of Excellece for Quatifiable Quality of Service Norwegia Uiversity of Sciece ad Techology Trodheim, Norway {cria, ajith}@q2s.tu.o

More information

Convexity, Inequalities, and Norms

Convexity, Inequalities, and Norms Covexity, Iequalities, ad Norms Covex Fuctios You are probably familiar with the otio of cocavity of fuctios. Give a twicedifferetiable fuctio ϕ: R R, We say that ϕ is covex (or cocave up) if ϕ (x) 0 for

More information

3. Greatest Common Divisor - Least Common Multiple

3. Greatest Common Divisor - Least Common Multiple 3 Greatest Commo Divisor - Least Commo Multiple Defiitio 31: The greatest commo divisor of two atural umbers a ad b is the largest atural umber c which divides both a ad b We deote the greatest commo gcd

More information

Section 8.3 : De Moivre s Theorem and Applications

Section 8.3 : De Moivre s Theorem and Applications The Sectio 8 : De Moivre s Theorem ad Applicatios Let z 1 ad z be complex umbers, where z 1 = r 1, z = r, arg(z 1 ) = θ 1, arg(z ) = θ z 1 = r 1 (cos θ 1 + i si θ 1 ) z = r (cos θ + i si θ ) ad z 1 z =

More information

STATISTICAL METHODS FOR BUSINESS

STATISTICAL METHODS FOR BUSINESS STATISTICAL METHODS FOR BUSINESS UNIT 7: INFERENTIAL TOOLS. DISTRIBUTIONS ASSOCIATED WITH SAMPLING 7.1.- Distributios associated with the samplig process. 7.2.- Iferetial processes ad relevat distributios.

More information

Asymptotic Growth of Functions

Asymptotic Growth of Functions CMPS Itroductio to Aalysis of Algorithms Fall 3 Asymptotic Growth of Fuctios We itroduce several types of asymptotic otatio which are used to compare the performace ad efficiecy of algorithms As we ll

More information

Example 2 Find the square root of 0. The only square root of 0 is 0 (since 0 is not positive or negative, so those choices don t exist here).

Example 2 Find the square root of 0. The only square root of 0 is 0 (since 0 is not positive or negative, so those choices don t exist here). BEGINNING ALGEBRA Roots ad Radicals (revised summer, 00 Olso) Packet to Supplemet the Curret Textbook - Part Review of Square Roots & Irratioals (This portio ca be ay time before Part ad should mostly

More information

1 Correlation and Regression Analysis

1 Correlation and Regression Analysis 1 Correlatio ad Regressio Aalysis I this sectio we will be ivestigatig the relatioship betwee two cotiuous variable, such as height ad weight, the cocetratio of a ijected drug ad heart rate, or the cosumptio

More information

THE TWO-VARIABLE LINEAR REGRESSION MODEL

THE TWO-VARIABLE LINEAR REGRESSION MODEL THE TWO-VARIABLE LINEAR REGRESSION MODEL Herma J. Bieres Pesylvaia State Uiversity April 30, 202. Itroductio Suppose you are a ecoomics or busiess maor i a college close to the beach i the souther part

More information

Math C067 Sampling Distributions

Math C067 Sampling Distributions Math C067 Samplig Distributios Sample Mea ad Sample Proportio Richard Beigel Some time betwee April 16, 2007 ad April 16, 2007 Examples of Samplig A pollster may try to estimate the proportio of voters

More information

LECTURE 13: Cross-validation

LECTURE 13: Cross-validation LECTURE 3: Cross-validatio Resampli methods Cross Validatio Bootstrap Bias ad variace estimatio with the Bootstrap Three-way data partitioi Itroductio to Patter Aalysis Ricardo Gutierrez-Osua Texas A&M

More information

Lesson 15 ANOVA (analysis of variance)

Lesson 15 ANOVA (analysis of variance) Outlie Variability -betwee group variability -withi group variability -total variability -F-ratio Computatio -sums of squares (betwee/withi/total -degrees of freedom (betwee/withi/total -mea square (betwee/withi

More information

Chapter 14 Nonparametric Statistics

Chapter 14 Nonparametric Statistics Chapter 14 Noparametric Statistics A.K.A. distributio-free statistics! Does ot deped o the populatio fittig ay particular type of distributio (e.g, ormal). Sice these methods make fewer assumptios, they

More information

5.3. Generalized Permutations and Combinations

5.3. Generalized Permutations and Combinations 53 GENERALIZED PERMUTATIONS AND COMBINATIONS 73 53 Geeralized Permutatios ad Combiatios 53 Permutatios with Repeated Elemets Assume that we have a alphabet with letters ad we wat to write all possible

More information

GCSE STATISTICS. 4) How to calculate the range: The difference between the biggest number and the smallest number.

GCSE STATISTICS. 4) How to calculate the range: The difference between the biggest number and the smallest number. GCSE STATISTICS You should kow: 1) How to draw a frequecy diagram: e.g. NUMBER TALLY FREQUENCY 1 3 5 ) How to draw a bar chart, a pictogram, ad a pie chart. 3) How to use averages: a) Mea - add up all

More information

Maximum Likelihood Estimation

Maximum Likelihood Estimation Math 541: Statistical Theory II Lecturer: Songfeng Zheng Maximum Likelihood Estimation 1 Maximum Likelihood Estimation Maximum likelihood is a relatively simple method of constructing an estimator for

More information

Factoring x n 1: cyclotomic and Aurifeuillian polynomials Paul Garrett <garrett@math.umn.edu>

Factoring x n 1: cyclotomic and Aurifeuillian polynomials Paul Garrett <garrett@math.umn.edu> (March 16, 004) Factorig x 1: cyclotomic ad Aurifeuillia polyomials Paul Garrett Polyomials of the form x 1, x 3 1, x 4 1 have at least oe systematic factorizatio x 1 = (x 1)(x 1

More information

Vladimir N. Burkov, Dmitri A. Novikov MODELS AND METHODS OF MULTIPROJECTS MANAGEMENT

Vladimir N. Burkov, Dmitri A. Novikov MODELS AND METHODS OF MULTIPROJECTS MANAGEMENT Keywords: project maagemet, resource allocatio, etwork plaig Vladimir N Burkov, Dmitri A Novikov MODELS AND METHODS OF MULTIPROJECTS MANAGEMENT The paper deals with the problems of resource allocatio betwee

More information

A Mathematical Perspective on Gambling

A Mathematical Perspective on Gambling A Mathematical Perspective o Gamblig Molly Maxwell Abstract. This paper presets some basic topics i probability ad statistics, icludig sample spaces, probabilistic evets, expectatios, the biomial ad ormal

More information

FIBONACCI NUMBERS: AN APPLICATION OF LINEAR ALGEBRA. 1. Powers of a matrix

FIBONACCI NUMBERS: AN APPLICATION OF LINEAR ALGEBRA. 1. Powers of a matrix FIBONACCI NUMBERS: AN APPLICATION OF LINEAR ALGEBRA. Powers of a matrix We begi with a propositio which illustrates the usefuless of the diagoalizatio. Recall that a square matrix A is diogaalizable if

More information

Theorems About Power Series

Theorems About Power Series Physics 6A Witer 20 Theorems About Power Series Cosider a power series, f(x) = a x, () where the a are real coefficiets ad x is a real variable. There exists a real o-egative umber R, called the radius

More information

Basic Elements of Arithmetic Sequences and Series

Basic Elements of Arithmetic Sequences and Series MA40S PRE-CALCULUS UNIT G GEOMETRIC SEQUENCES CLASS NOTES (COMPLETED NO NEED TO COPY NOTES FROM OVERHEAD) Basic Elemets of Arithmetic Sequeces ad Series Objective: To establish basic elemets of arithmetic

More information

One-sample test of proportions

One-sample test of proportions Oe-sample test of proportios The Settig: Idividuals i some populatio ca be classified ito oe of two categories. You wat to make iferece about the proportio i each category, so you draw a sample. Examples:

More information

4.3. The Integral and Comparison Tests

4.3. The Integral and Comparison Tests 4.3. THE INTEGRAL AND COMPARISON TESTS 9 4.3. The Itegral ad Compariso Tests 4.3.. The Itegral Test. Suppose f is a cotiuous, positive, decreasig fuctio o [, ), ad let a = f(). The the covergece or divergece

More information

Chapter 7: Confidence Interval and Sample Size

Chapter 7: Confidence Interval and Sample Size Chapter 7: Cofidece Iterval ad Sample Size Learig Objectives Upo successful completio of Chapter 7, you will be able to: Fid the cofidece iterval for the mea, proportio, ad variace. Determie the miimum

More information

Lecture 5: Span, linear independence, bases, and dimension

Lecture 5: Span, linear independence, bases, and dimension Lecture 5: Spa, liear idepedece, bases, ad dimesio Travis Schedler Thurs, Sep 23, 2010 (versio: 9/21 9:55 PM) 1 Motivatio Motivatio To uderstad what it meas that R has dimesio oe, R 2 dimesio 2, etc.;

More information

Lecture 13. Lecturer: Jonathan Kelner Scribe: Jonathan Pines (2009)

Lecture 13. Lecturer: Jonathan Kelner Scribe: Jonathan Pines (2009) 18.409 A Algorithmist s Toolkit October 27, 2009 Lecture 13 Lecturer: Joatha Keler Scribe: Joatha Pies (2009) 1 Outlie Last time, we proved the Bru-Mikowski iequality for boxes. Today we ll go over the

More information

1 The Gaussian channel

1 The Gaussian channel ECE 77 Lecture 0 The Gaussia chael Objective: I this lecture we will lear about commuicatio over a chael of practical iterest, i which the trasmitted sigal is subjected to additive white Gaussia oise.

More information

Non-life insurance mathematics. Nils F. Haavardsson, University of Oslo and DNB Skadeforsikring

Non-life insurance mathematics. Nils F. Haavardsson, University of Oslo and DNB Skadeforsikring No-life isurace mathematics Nils F. Haavardsso, Uiversity of Oslo ad DNB Skadeforsikrig Mai issues so far Why does isurace work? How is risk premium defied ad why is it importat? How ca claim frequecy

More information

7. Concepts in Probability, Statistics and Stochastic Modelling

7. Concepts in Probability, Statistics and Stochastic Modelling 7. Cocepts i Probability, Statistics ad Stochastic Modellig 1. Itroductio 169. Probability Cocepts ad Methods 170.1. Radom Variables ad Distributios 170.. Expectatio 173.3. Quatiles, Momets ad Their Estimators

More information

Descriptive Statistics

Descriptive Statistics Descriptive Statistics We leared to describe data sets graphically. We ca also describe a data set umerically. Measures of Locatio Defiitio The sample mea is the arithmetic average of values. We deote

More information

CME 302: NUMERICAL LINEAR ALGEBRA FALL 2005/06 LECTURE 8

CME 302: NUMERICAL LINEAR ALGEBRA FALL 2005/06 LECTURE 8 CME 30: NUMERICAL LINEAR ALGEBRA FALL 005/06 LECTURE 8 GENE H GOLUB 1 Positive Defiite Matrices A matrix A is positive defiite if x Ax > 0 for all ozero x A positive defiite matrix has real ad positive

More information

S. Tanny MAT 344 Spring 1999. be the minimum number of moves required.

S. Tanny MAT 344 Spring 1999. be the minimum number of moves required. S. Tay MAT 344 Sprig 999 Recurrece Relatios Tower of Haoi Let T be the miimum umber of moves required. T 0 = 0, T = 7 Iitial Coditios * T = T + $ T is a sequece (f. o itegers). Solve for T? * is a recurrece,

More information

Parameter estimation for nonlinear models: Numerical approaches to solving the inverse problem. Lecture 11 04/01/2008. Sven Zenker

Parameter estimation for nonlinear models: Numerical approaches to solving the inverse problem. Lecture 11 04/01/2008. Sven Zenker Parameter estimatio for oliear models: Numerical approaches to solvig the iverse problem Lecture 11 04/01/2008 Sve Zeker Review: Trasformatio of radom variables Cosider probability distributio of a radom

More information

The Stable Marriage Problem

The Stable Marriage Problem The Stable Marriage Problem William Hut Lae Departmet of Computer Sciece ad Electrical Egieerig, West Virgiia Uiversity, Morgatow, WV William.Hut@mail.wvu.edu 1 Itroductio Imagie you are a matchmaker,

More information

Taking DCOP to the Real World: Efficient Complete Solutions for Distributed Multi-Event Scheduling

Taking DCOP to the Real World: Efficient Complete Solutions for Distributed Multi-Event Scheduling Taig DCOP to the Real World: Efficiet Complete Solutios for Distributed Multi-Evet Schedulig Rajiv T. Maheswara, Milid Tambe, Emma Bowrig, Joatha P. Pearce, ad Pradeep araatham Uiversity of Souther Califoria

More information

Lecture 4: Cheeger s Inequality

Lecture 4: Cheeger s Inequality Spectral Graph Theory ad Applicatios WS 0/0 Lecture 4: Cheeger s Iequality Lecturer: Thomas Sauerwald & He Su Statemet of Cheeger s Iequality I this lecture we assume for simplicity that G is a d-regular

More information

Definition. A variable X that takes on values X 1, X 2, X 3,...X k with respective frequencies f 1, f 2, f 3,...f k has mean

Definition. A variable X that takes on values X 1, X 2, X 3,...X k with respective frequencies f 1, f 2, f 3,...f k has mean 1 Social Studies 201 October 13, 2004 Note: The examples i these otes may be differet tha used i class. However, the examples are similar ad the methods used are idetical to what was preseted i class.

More information

where: T = number of years of cash flow in investment's life n = the year in which the cash flow X n i = IRR = the internal rate of return

where: T = number of years of cash flow in investment's life n = the year in which the cash flow X n i = IRR = the internal rate of return EVALUATING ALTERNATIVE CAPITAL INVESTMENT PROGRAMS By Ke D. Duft, Extesio Ecoomist I the March 98 issue of this publicatio we reviewed the procedure by which a capital ivestmet project was assessed. The

More information

Lecture 3. denote the orthogonal complement of S k. Then. 1 x S k. n. 2 x T Ax = ( ) λ x. with x = 1, we have. i = λ k x 2 = λ k.

Lecture 3. denote the orthogonal complement of S k. Then. 1 x S k. n. 2 x T Ax = ( ) λ x. with x = 1, we have. i = λ k x 2 = λ k. 18.409 A Algorithmist s Toolkit September 17, 009 Lecture 3 Lecturer: Joatha Keler Scribe: Adre Wibisoo 1 Outlie Today s lecture covers three mai parts: Courat-Fischer formula ad Rayleigh quotiets The

More information

Week 3 Conditional probabilities, Bayes formula, WEEK 3 page 1 Expected value of a random variable

Week 3 Conditional probabilities, Bayes formula, WEEK 3 page 1 Expected value of a random variable Week 3 Coditioal probabilities, Bayes formula, WEEK 3 page 1 Expected value of a radom variable We recall our discussio of 5 card poker hads. Example 13 : a) What is the probability of evet A that a 5

More information

SECTION 1.5 : SUMMATION NOTATION + WORK WITH SEQUENCES

SECTION 1.5 : SUMMATION NOTATION + WORK WITH SEQUENCES SECTION 1.5 : SUMMATION NOTATION + WORK WITH SEQUENCES Read Sectio 1.5 (pages 5 9) Overview I Sectio 1.5 we lear to work with summatio otatio ad formulas. We will also itroduce a brief overview of sequeces,

More information

Ekkehart Schlicht: Economic Surplus and Derived Demand

Ekkehart Schlicht: Economic Surplus and Derived Demand Ekkehart Schlicht: Ecoomic Surplus ad Derived Demad Muich Discussio Paper No. 2006-17 Departmet of Ecoomics Uiversity of Muich Volkswirtschaftliche Fakultät Ludwig-Maximilias-Uiversität Müche Olie at http://epub.ub.ui-mueche.de/940/

More information

Subject CT5 Contingencies Core Technical Syllabus

Subject CT5 Contingencies Core Technical Syllabus Subject CT5 Cotigecies Core Techical Syllabus for the 2015 exams 1 Jue 2014 Aim The aim of the Cotigecies subject is to provide a groudig i the mathematical techiques which ca be used to model ad value

More information

AP Calculus AB 2006 Scoring Guidelines Form B

AP Calculus AB 2006 Scoring Guidelines Form B AP Calculus AB 6 Scorig Guidelies Form B The College Board: Coectig Studets to College Success The College Board is a ot-for-profit membership associatio whose missio is to coect studets to college success

More information

Lecture 4: Cauchy sequences, Bolzano-Weierstrass, and the Squeeze theorem

Lecture 4: Cauchy sequences, Bolzano-Weierstrass, and the Squeeze theorem Lecture 4: Cauchy sequeces, Bolzao-Weierstrass, ad the Squeeze theorem The purpose of this lecture is more modest tha the previous oes. It is to state certai coditios uder which we are guarateed that limits

More information

Hypergeometric Distributions

Hypergeometric Distributions 7.4 Hypergeometric Distributios Whe choosig the startig lie-up for a game, a coach obviously has to choose a differet player for each positio. Similarly, whe a uio elects delegates for a covetio or you

More information

TIGHT BOUNDS ON EXPECTED ORDER STATISTICS

TIGHT BOUNDS ON EXPECTED ORDER STATISTICS Probability i the Egieerig ad Iformatioal Scieces, 20, 2006, 667 686+ Prited i the U+S+A+ TIGHT BOUNDS ON EXPECTED ORDER STATISTICS DIMITRIS BERTSIMAS Sloa School of Maagemet ad Operatios Research Ceter

More information

COMPARISON OF THE EFFICIENCY OF S-CONTROL CHART AND EWMA-S 2 CONTROL CHART FOR THE CHANGES IN A PROCESS

COMPARISON OF THE EFFICIENCY OF S-CONTROL CHART AND EWMA-S 2 CONTROL CHART FOR THE CHANGES IN A PROCESS COMPARISON OF THE EFFICIENCY OF S-CONTROL CHART AND EWMA-S CONTROL CHART FOR THE CHANGES IN A PROCESS Supraee Lisawadi Departmet of Mathematics ad Statistics, Faculty of Sciece ad Techoology, Thammasat

More information