Test of Hypotheses. Since the NeymanPearson approach involves two statistical hypotheses, one has to decide which one


 Derick Todd
 2 years ago
 Views:
Transcription
1 Test of Hypotheses Hypothesis, Test Statistic, and Rejection Region Imagine that you play a repeated Bernoulli game: you win $1 if head and lose $1 if tail. After 10 plays, you lost $2 in net (4 heads and 6 tails). Would you complain that the coin is not a fair coin? What if you lost $3? $4? $10? If you think the coin is not fair, how would you present your case? A statistical test uses a random sample from an unknown distribution to determine the validity of an assertion (or a theory) about the distribution. In parametric tests, it is known that the sample is from a known family of distribution function f(x;2). That is, the distribution function is known (e.g., Bernoulli), but its parameter(s) 2 is unknown 1. And we wish test an assertion such as 2=1/2. The assertion about the distribution function we wish to test is called a null hypothesis or a maintained hypothesis, and it is typically denoted by H 0. The distribution specified by the null hypothesis is called the null distribution. A null hypothesis may completely specify the distribution as in H 0 : 2=1/2 for a Bernoulli distribution, or may specify a set of distributions as in H 0 : 2<1/2. The former is called a simple null hypothesis, and the latter a composite null hypothesis. When a distribution involves multiple parameters, a null hypothesis may involve multiple statements such as H 0 : :=1, F 2 =2 for a normal distribution. This is called the joint null hypotheses. There are two approaches to the test of a null hypothesis. The test of significance advocated by R. A. Fisher will reject a hypothesis, but never accept one. A significance tester s objective is to disprove a null hypothesis on the basis of data. The hypothesis may be that a rise in the minimum wage rate has no effect on the entry level employment; the welfare reform of 1996 has no effect on the number of welfare recipients; the US aggregate production function has a constant returns to scale; there is no change in the monetary policy rule between before and after 1987, etc. When the test rejects the null hypothesis we say that the test is significant, or that the effect of the minimum wage is significantly different from zero for the null hypothesis described above. When the test does not reject the null hypothesis, no conclusion would be drawn, or we say that there is not enough sample information to reject the null hypothesis. The approach developed by J. Neyman and E. S. Pearson tests a null hypothesis against another statistical hypothesis, which is called an alternative hypothesis. An alternative hypothesis can be either simple or composite, and it is typically denoted by either H 1 or H a. Examples of the null and alternative hypotheses are... a simple null against a simple alternative... a simple null against a twosided composite alternative... a onesided composite null against a onesided composite alternative More generally, let 1 be the parameter space, and 1 0 and 1 1 be mutually exclusive subsets of 1. Then, we can express the null and alternative hypotheses in a general form as Since the NeymanPearson approach involves two statistical hypotheses, one has to decide which one 1 In many application problems, the distribution function of the population is unknown. In such cases, we either assume a certain family of distribution and conduct parametric tests, or apply nonparametric tests. We will not discuss the latter in this class.
2 should be called the null hypothesis. One may call 2>2 0 the null hypothesis, and 2#2 0 the alternative hypothesis in the last example. If both statements are treated symmetrically in the construction of the test, it should not matter which one is selected as the null hypothesis. In the NeymanPearson approach, the two hypotheses are treated asymmetrically in their importance, and the choice of the null hypothesis makes a difference in the final conclusion of a test. Once the null and alternative hypotheses are specified in the NeymanPearson test, we need to choose 2 (i) a test statistic (ii) a decision rule that tells us to either reject or accept H 0. The choice of the test statistic determines how we use the sample information for the test. This choice can be arbitrary, but a function of the estimator of parameter under consideration is commonly used as a test statistic. For example, we may use the sample mean as a test statistic in testing the Bernoulli parameter 2, since is an unbiased estimator of 2. 1 Given the test statistic, the decision rule specifies when to reject and when to accept H 0. For example, we may decide to reject H 0 if the test statistic for some constant c, and accept H 0 if. These decision rules partition the potential sample observations {x 1,þ,x n } into two subsets. The set of sample observations for which H 0 will be rejected is called a rejection region, or a critical region, of the test. The rejection region usually takes the form of a onesided or a twosided rejection region: Onesided rejection region: Twosided rejection region:, or, where the boundary values c, c R and c u are called the critical values. Tests based on these types of critical regions are called the onesided test and the twosided test, respectively 2. It should be emphasized that an acceptance of a hypothesis does not mean that the hypothesis is proved in any rigorous sense. It simply means that the data is compatible with the hypothesis, and one is willing to act as if the hypothesis were true. A rejection of the null hypothesis implies that the data and the hypothesis are not compatible. Example. Let X 1,...,X n be a random sample from a Bernoulli distribution wish to test, x=0 or 1. We (A) H 0 : 2=1/2, H 1 : 2=1/4 1 Alternatively, we may derive a test statistic from one of the three classical methods: the Lkielihhod Ratio Test, the Lagrange Multiplier Test, and the Wald (type) Test. These tests will be discussed below in detail. Properties of a test may vary with the choice of the test statistic, rendering some tests better than other tests. 2 Some authors use the term onetailed and twotailed test. We will use these terms interchangeably.
3 3 (B) H 0 : 2=1/2, H 1 : 2 1/2 Test (A) is a test of a simple null against a simple alternative hypothesis. Since the sample mean is an unbiased estimator of 2, it seems reasonable to reject H 0 if is closer to the alternative value 1/4 than to the null value 1/2. That is, we may choose as a test statistic, and the onesided rejection region } where the midpoint between the two hypothesized values are chosen as the critical value. We reject H 0 if is less than or equal to 3/8, and accept H 0 if is greater than 3/8. As noted earlier, acceptance of the null hypothesis does not mean that we have proved 2=1/2. Consider a sample of size 2 (i.e., toss a coin twice). The sample mean is greater than 3/8 when the outcomes of the two tosses are either {HT}, or {TH}, or {HH}. Realization of one of these outcomes clearly does not prove 2=1/2, because all three outcomes are possible outcomes for all 2,(0,1). Test (B) is a test of a simple null against a composite alternative hypothesis. It is intuitively reasonable to reject H 0 if the sample mean is sufficiently far from the null value 1/2 in either direction. This suggests a twosided rejection region of the form and we reject H 0 if either #1/8 or $7/8. Though our choices of the test statistic and the rejection region in these examples seem to be reasonable, there is no a priori reason why they are better than some other choices. For example, is the critical value 3/8 in Test (A) better than 5/16 or 7/16? What if we use median as the test statistic? To address these issues, we need to consider the consequences of alternative choices. Properties of Test Correct decisions in a test of hypothesis is to reject the null hypothesis when it is wrong and accept it when it is correct. However, one bounds to make one of the two types of errors in a typical test: Type I error  reject a true null hypothesis Type II error  not reject (or accept) a false null hypothesis The probability of rejecting a true null hypothesis (Type I error) is called the size of the test, or the level of significance (significance level), and typically denoted by ". The probability of rejecting a false null hypothesis (correct decision) is called the power of the test, and it is usually denoted by B. The probability of accepting a false null hypothesis (Type II error) is usually denoted by $=1B. Size of test (significance level): " = P(reject a true H 0 ) = P(type I error)
4 4 Power of test: B = P(reject a false H 0 ) = 1  P(accept a false H 0 ) = 1  P(type II error) = 1  $ When the null hypothesis is composite, the probability of rejecting a true H 0 varies in general with the value of 2 in the null parameter set 1 0. The significance level of a test is then defined as the maximum (or supremum) of the probability of rejecting a true H 0. Similarly, when the alternative hypothesis is composite, the probability of type II error and the power of the test also vary with the value of 2 in the alternative parameter set 1 1. To make this functional relationship explicit, the probability of Type II error is denoted by $(2), and the power of the test by B(2), for The function B(2), 201 1, is called the power function of the test 1. Significance Level : Power Function: When we construct a test, it is desirable to minimize the probabilities of the two types of errors. An ideal test 2 is the one that has "=0 and $(2)=0. An ideal test seldom exists except in trivial cases. In general, there is a tradeoff between these two probabilities when the sample size is fixed. If we try to make the significance level small, the probability of type II error increases, and vice versa. The Neyman Pearson approach resolves this conflict by treating the null and alternative hypotheses asymmetrically. The significance level " is first selected, and then a rejection region is chosen that has the highest power among all rejection regions of same level of significance. A test of a simple null against a simple alternative hypothesis is called the most powerful test of significance level " if it has more power than any other test of same significance level ". When the alternative hypothesis is composite, a test of significance level " is called the uniformly most powerful test of significance level " if it has more power than any other test of same significance level " for all The term uniformly refers to all alternative parameter values. A test is called an unbiased test if the probability of rejecting wrong H 0 is always higher than the probability of rejecting correct H 0, that is, the power of the test is always higher than its significance level. These concepts are illustrated in the following examples. Example. Consider the previous example of testing the parameter 2. Suppose we have a sample of size 2. The rejection regions are for test A and for Test B. Following table summarizes the sample points and their probabilities. 1 Some authors define the power function as B(2)=P(reject H 0 ) for all 201. A graph of the probability of accepting H 0, 1B(2), is called the OCcurve (Operating Characteristic curve). 2 When the power function is defined as B(2) for all 201, an ideal power function is defined as a function B(2)=0 for all and B(2)=1 for all
5 5 Sample Point P(T i ) P(T i H 0 ) P(T i H 1A ) T 1 ={0,0} 0 (12) 2 1/4 9/16 T 2 ={0,1} 1/2 2(12) 1/4 3/16 T 3 ={1,0} 1/2 2(12) 1/4 3/16 T 4 ={1,1} /4 1/16 For Test A, the rejection region is. Hence, For Test B, the rejection region is. The significance level of this test is The probability of Type II error (accepting a false H 0 ) is, and the power function of this test is, where 2 is any value admissible under H 1 : 2 ½. This is illustrated below. Now consider a composite hypothesis Test C: and suppose we use the rejection region The probability of type I error then becomes The supremum of this probability is 1/2, and hence the significance level of this test is "=1/2. The power function is In these examples we determined the rejection region and then calculated the significance level of the test. The Neyman Pearson approach selects the significance level of the test first, and then determines the
6 rejection region. When the distribution is discrete, we may not be able to achieve the given significance level. Therefore, we will consider a continuous distribution to determine the rejection region. 6 Example. Onesided Test. Let variance is known. We wish to test be a random sample from a normal distribution N(:, F 2 ), where the where : 0 and : 1 are known constants and. We will use the unbiased estimator of : as a test statistic, and choose a onesided rejection region. That is, we reject H 0 if the sample mean is far away from the null value : 0 toward the alternative value : 1. The critical value c will be chosen such that where " is the significance level. The conventional choice of " is either 0.01, or 0.05, or 0.1. We have shown earlier that. Hence, is distributed as under the null hypothesis, and where M is the cdf of a standard normal random variable, and is distributed as a standard normal under H 0. The standard normal table gives that c for "=0.05, and c for "=0.1, and the critical value is computed by. We reject H 0 if, and accept H 0 otherwise. Note that the critical value c is a decreasing function of the significance level " and sample size n, and an increasing function of variance F 2. For a numerical example, consider : 0 =0, F 2 =4 and n=25. The null hypothesis is rejected at the 5% significance level if the observed sample mean is greater than or equal to 0.656, and rejected at the 10% significance level if it is greater than or equal to If the observed sample mean were 0.59, the null hypothesis is rejected at 10% significance level, but accepted at 5% significance level. At what level of significance would the null hypothesis have been rejected if the observed sample mean were 0.59? The minimum significance level at which H 0 would have been rejected, given the observed value of the test statistic, is called the pvalue of the test. The pvalue of the test under consideration can be found by computing the probability
7 7 where is the observed sample mean. For : 0 =0, F 2 =4 and n=25, the pvalue of =0.59 is equal to Thus, the null hypothesis will be rejected at 7% significance level if the observed sample mean were When the test result is reported as rejection of H 0 at a given significance level, it does not indicate how strongly H 0 is rejected, because H 0 is rejected regardless of whether the sample mean is slightly or substantially greater than : 0 +c. The pvalue captures the variations in the strength of the test result, and hence provide more information about the test result than just saying that H 0 is rejected or not. Now we find the probability of type II error and the power of the test. The probability of type II error (accepting a false H 0 ) is given by Since is distributed as N(: 1, F 2 /n) under the alternative hypothesis, we can rewrite $ as where Since Z 1 is a standard normal under H 1, one can easily compute the probability of type II error, the cumulative cdf M(c 1 ), by using a standard computer software like GAUSS. This probability clearly depends on the alternative value : 1. The power of the test is then computed by 1$. For example, let : 0 =0, : 1 =1, F 2 =4 and n=25. For the 5% significance level, c 0 =1.64 and c 1 = Therefore,, The pdf s of under the null and alternative hypotheses are depicted in the figure below. The size of the test " is the area under the pdf for, the probability $ of type II error is the area under the pdf for, and the power B of the test is the area under the pdf for.
8 8 It is obvious from the figure that, if we reduce the significance level ", then the critical value c increases and consequently, the probability of type II error $ increases and the power of the test decreases. This illustrates the tradeoff between the two types of errors. It is also clear that the power of this test is always greater than the significance level for any choice of ". Therefore, this test is an unbiased test. This test is also the most powerful test, i.e., any other rejection region of significance level " will have a lower power than the current test. This result is due to the NeymanPearson Lemma, which is presented below. Intuitively, one can convince oneself about this result by trying to move some of the probability mass " to somewhere else, and then checking the power of the new test. Example. Twosided test. Let X 1,þ,X n be a random sample from a normal distribution N(:, F 2 ), where the variance is known. We wish to test This is a test of a simple null against a composite alternative hypothesis. We will use the unbiased estimator of : as a test statistic, and choose a twosided rejection region. That is, we reject H 0 if the sample mean is far away from the null value : 0 in either direction. The critical value c will be chosen such that for a given size of the test ". From the discussion in the previous example, we can write Since Z 0 is distributed as a standard normal under H 0, we can find the value of c 0 from the standard normal table: c for "=0.05, and c for "=0.1. The critical value of the rejection region is then computed from c=fc 0 /. The rejection region is illustrated in the figure below as the areas under the pdf for the range of and, where each tail has probability "/2. The probability of type II error is the area under the pdf for the interval, and the power B of the test is the area under the pdf
9 9 for the range of and. Since the alternative hypothesis is composite in this case, the probability of type II error and the power of the test vary with the alternative value : 1. For any given : 1, the probability of type II error is found from is a standard normal under H 1 and hence one can easily compute $(: 1 ) for each : 1.The power of the test is then computed by 1$(: 1 ) for each : 1. Though we will not prove it here, this test is the UMPU (uniformly most powerful unbiased) test 1. Three examples of the power function are illustrated below where : 0 =0 and F 2 =4. These examples show that the power of the test decreases uniformly as " becomes smaller and it increases uniformly with the size of the sample. 1 See chapter 13 in Roussas s A First Course in Mathematical Statistics.
10 10 Example. Twosided test with unknown F. The critical values in the previous examples involve the standard deviation F. When F is unknown, we can not calculate the critical values. As in the construction of the confidence interval, we need to replace F or F 2 with an estimate. where S 2 is the sample variance. Since Z 0 is distributed as a central t(n1) under H 0, we can find the value of c 0 from the table of central tdistribution. For example, "=5% "=10% n= n= The critical value of the rejection region is then computed from c=sc 0 /. Therefore, we reject H 0 if the sample mean deviates in either direction from the null value : 0 by more than 2.262S/ for n=10 at the 5% significance level. This is a UMPU test. Example. Test of Difference in Means with Known Variances. Consider two independent normal populations and, where variances are known. Let where a and b are known constants. We wish to test where * 0 is a known constant. If a=1, b=1 and * 0 =0, we are testing the equality of the two means. Let and be the sample means of sample size n and m, respectively, from the two populations. An unbiased estimator of * is. We will use this estimator as a test statistic, and choose a twosided rejection region. The critical value c will be chosen such that. Since and are independent, is distributed as a normal with mean * and variance. From the discussion in the previous example, we can write Since Z 0 is distributed as a standard normal under H 0, we can find the value of c 0 from the standard normal table as in the previous example. This is a UMPU test Example. Difference in Means with Unknown Common Variance. Suppose in the previous example that the two populations have the same variance,, but F 2 is unknown. We have shown earlier in the construction of the confidence interval that is the pooled estimator of
11 11 F 2, and has a central P 2 (n+m2) distribution which is independent of. Therefore, The critical value of the rejection region is then found from where T 0 has a t(n+m2) distribution under H 0. This is a UMPU test Methods of Construction of Test Tests in these examples are constructed by selecting rejection regions that are intuitively reasonable, and they turn out to be uniformly most powerful unbiased tests. We now consider a systematic method of finding a most powerful test of a simple null against a simple alternative hypothesis. A test chooses a subset of the sample space as a rejection region. Suppose that each potential observation of the sample has a positive probability under the null as well as under the alternative hypothesis. Every time a potential observation is put into the rejection region, it increases the probability of type I error as well as the power. We may interpret the probability of type I error as a cost and the power as a benefit of selecting a potential observation as an element of the rejection region. Since we wish to make the probability of type I error small and power of the test large, we need to select the sets of potential observations which have the lowest cost/benefit ratio. This idea of constructing a most powerful rejection region by selecting observations of low cost/benefit ratio is due to Neyman and Pearson as stated in the following lemma. NeymanPearson Lemma. Let X 1,þ,X n be a random sample from a population f(x;2). The most powerful test of size " of a simple null hypothesis H 0 :2=2 0 versus a simple alternative hypothesis H 1 :2=2 1 is given by the rejection region R where is the likelihood function under H i, and k is a positive constant that satisfies the condition for a given significance level ". The NeymanPearson lemma measures the cost/benefit ratio by the likelihood ratio of the null to the alternative hypothesis. Recall that the likelihood function is the joint pdf of random sample. Thus, we are comparing the probability of an observation (x 1, x 2, þ, x n ) under the null to that under the alternative hypothesis. How many potential sample points should be selected? That is, what value of k should be chosen? We need to pick just enough number of them to meet the requirement that the joint probability of selected
12 observations under the null hypothesis is equal to the given significance level. This will determine the value of k. There may not exist a constant k that gives the size of test exactly equal to ", particularly in the case of discrete distribution. We consider an example of a continuous distribution below. 12 Example. Let X 1,þ,X n be a random sample from a normal distribution N(:, F 2 ), where the variance is known. We wish to test H 0 ::=: 0 versus H 1 ::=: 1 at the level of significance ". The ratio of the normal likelihood functions is The rejection region is the subset of the sample space that satisfies 8#k, which can be rewritten as where Thus, when : 0 <: 1, we only need find a value of k * such that, which can also be expressed as, where c=k * : 0. This example shows that the test we used in an earlier example is the most powerful test of H 0 against H 1. The rejection region in this example does not depend on the parameter value under H 1, and thus provides for the most powerful test of against any alternative value : 1 as long as : 1 >: 0. In other words, the rejection region gives the most powerful test of a simple null hypothesis against all values of : in a composite alternative hypothesis. Such a test is called a uniformly most powerful (UMP) test, where the term uniformly refers to all alternative parameter values. Therefore, the onesided UMP test of against is the rejection region and the onesided UMP test of the same null hypothesis against is the rejection region. This implies that no single rejection region for the twosided test of the same simple null hypothesis against can dominate other rejection regions in power for all parameter values under the alternative hypothesis. That is, a UMP test does not exist for such a twosided test. When the null hypothesis is a composite hypothesis,, the significance level is defined by the supremum of the probability of Type I error over the parameter set under H 0. For a given rejection region, it is easy to see that the probability of Type I error increases as : increases, because increases
13 for any given as the mean value under the null increases 1. Hence, the significance level of this test is determined at. Given this significance level, the UMP test shown above for testing against alternative hypothesis is also the UMP test of against the alternative hypothesis. 13 Construction of Classical Tests of Nested Hypotheses One of the major drawback of the NeymanPearson Lemma is that it cannot be applied if there are other parameters in the likelihood function whose values are not specified by the hypotheses. When the likelihood function involves some unknown parameters, the ratio of likelihood cannot be computed and the Lemma becomes useless. Furthermore, the test we encounter most often in practice is a twosided test for which the UMP test does not exist in general, though we can find the UMP test among all unbiased test (UMPU). There are three classical methods of constructing a test: Likelihood Ratio (LR) test, Lagrange Multiplier (LM) test, and Wald test. All three methods are widely used in econometrics, and they produce identical test in many cases. Let be the likelihood function where 2 is a vector of parameters in the unrestricted parameter space. The unknown parameters can be estimated by using the MLE method. The null hypothesis imposes some restrictions on the parameters so that the parameter space under the null hypothesis is a nested subset 1 0 of 1. When the null hypothesis does not specify specific values for all parameters, we can estimate the remaining parameters by the MLE method. The test statistics and rejection regions of the three methods are based on the restricted and unrestricted MLE. The LR test requires both restricted and unrestricted estimators. The LM test requires only the restricted estimators while the Wald test requires only the unrestricted estimators. In general, the finite sample distribution of these test statistics are either unknown or difficult to derive. Hence, we use their asymptotic distributions, and all three test statistics have the same asymptotic null distributions. The unrestricted estimators of the parameters are the usual MLE that are the solutions to the first order conditions where denotes the unrestricted estimator. Substituting into the likelihood function, we derive the value of likelihood function or. The restricted estimators subject a set of restrictions, where r is a known constants, are derived by maximizing the Lagrange equation where 8 is a vector of Lagrange multipliers. Taking the derivatives with respect to 2 and 8, we have the first order conditions 1 Move the pdf curve to the right as : 0 increases. For any given critical value, it is easy to see that the area of right tail of the null pdf increases.
14 14 where and denote the restricted parameter estimator and the estimator of the Lagrange multipliers. The value of the likelihood function at the restricted estimator is denoted by or. Likelihood Ratio Test The idea of the likelihood ratio test is that, if the restrictions under the null are true, then and must be close each other. In fact, in a certainty case, they must be identical. In the case of random events, however, the restricted and unrestricted estimators will be different with probability one even if the restriction is correct. For example, in the case of tossing a truly fair coin, the outcome may be {H,H,H,T}, which will yield the unrestricted MLE of 2 higher than 0.5. On the average, however, the two estimators should yield the likelihood values quite close each other if the restrictions are correct. The likelihood ratio test is based on the comparison of the two likelihood values: reject the null hypothesis if the difference between them is sufficiently large. The rejection region is thus constructed by or where k is a constant. Note that the unrestricted likelihood will always greater than the restricted likelihood. Therefore, the ratio is greater than one, and the log difference will be positive. The choice of k depends on the level of significance and the distribution function of the ratio of the likelihood values or the distribution function of the difference in loglikelihood. The finite sample distribution function is in general either unknown or difficult to derive. In such a case, we use the asymptotic distribution function where J is the number of restrictions under the null hypothesis. In many cases, however, we can find a finite sample distribution of a transformation of the likelihood ratio and can construct a rejection region that is equivalent to a likelihood ratio test. The following example illustrates such a case. Example. Let X 1,þ,X n be a random sample from a normal distribution N(:, F 2 ), where both parameters are unknown. We wish to test
15 15 Th likelihood and the loglikelihood functions are The unconstrained MLE are derived from the gradients The constrained MLE subject to :=: 0 are Therefore, the likelihood values are The rejection region for the likelihood ratio test is thus The rejection region can be rewritten as which leads to Note that the statistic has a central t distribution with (n1) degrees of freedom under the null hypothesis. Therefore, we can find the critical value for a given level of significance from
16 16 by using the distribution. This is the test we examined before. Exercise: Find the LR test for against. Lagrange Multiplier Test The Lagrange multiplier in the constrained optimization represents the shadow price of the constraint. In the case of certainty, the value of Lagrange multiplier will be zero if the constraints are not binding. In the context of testing hypothesis, nonbinding constraints imply that the parameter space specified by the null hypothesis is acceptable. Based on this, the LM test reject the null hypothesis if the estimator is sufficiently different from zero. The finite sample distribution of is in general unknown or difficult to derive. Therefore, we often use its asymptotic distribution to construct the rejection region. Here, we will consider only the previous example. The Lagrange equation for the example is where 8 is the Lagrange multiplier for the restriction :=: 0. The derivative of with respect to parameters are Solutions of these first order conditions for :, F 2 and 8 are the constrained estimators:,, Note that the right hand side of is, the first derivative of the likelihood function evaluated at the constrained estimators of : and F 2. Thus, testing on is equivalent to testing on the first derivative of the loglikelihood function, which is called the efficient scores. When the LM test is formed based on the efficient scores, the test is called the score test. Since we are testing whether is close to zero or not, we may construct a rejection region on the basis of some constant times. That is, is equivalent to for some constant value a. Thus, consider Testing a sufficient deviation of from zero is equivalent to testing a sufficient deviation of the right hand
17 side standard normal statistic. If F is known, we may use a two sided normal test, rejecting the null hypothesis if the right hand side statistic is at the tail outside of the critical values. Since F is unknown, we need to replace it with its estimate. Consider then a statistic 17 where is the sample variance, which is based on the unconstrained estimator. This gives a twosided ttest. For the LM test, we usually use the constrained estimator. However, the distribution of is complicated. Hence, the LM test is usually based on the asymptotic variable Wald Test This test uses only the unrestricted estimators. If the restrictions imposed by the null hypothesis are correct, the unrestricted (consistent) estimators must satisfy the restrictions very closely. If the unrestricted estimators are sufficiently different from the restrictions, then we reject the null hypothesis. Since the unrestricted MLE of : is the sample mean, the Wald test asks whether is close to zero or not. Thus, the rejection region of the Wald test takes a form of The choice of k depends on the distribution of, which is Since this distribution involves the unknown parameter F 2, we need to replace it with its unrestricted estimator. We have seen before that this procedure leads to where is the sample variance. Hence, we can use the twosided ttest.
[Chapter 10. Hypothesis Testing]
[Chapter 10. Hypothesis Testing] 10.1 Introduction 10.2 Elements of a Statistical Test 10.3 Common LargeSample Tests 10.4 Calculating Type II Error Probabilities and Finding the Sample Size for Z Tests
More informationSECOND PART, LECTURE 3: HYPOTHESIS TESTING
Massimo Guidolin Massimo.Guidolin@unibocconi.it Dept. of Finance STATISTICS/ECONOMETRICS PREP COURSE PROF. MASSIMO GUIDOLIN SECOND PART, LECTURE 3: HYPOTHESIS TESTING Lecture 3: Hypothesis Testing Prof.
More informationChapter 4: Statistical Hypothesis Testing
Chapter 4: Statistical Hypothesis Testing Christophe Hurlin November 20, 2015 Christophe Hurlin () Advanced Econometrics  Master ESA November 20, 2015 1 / 225 Section 1 Introduction Christophe Hurlin
More informationChapter 7 Part 2. Hypothesis testing Power
Chapter 7 Part 2 Hypothesis testing Power November 6, 2008 All of the normal curves in this handout are sampling distributions Goal: To understand the process of hypothesis testing and the relationship
More informationHypothesis Testing Level I Quantitative Methods. IFT Notes for the CFA exam
Hypothesis Testing 2014 Level I Quantitative Methods IFT Notes for the CFA exam Contents 1. Introduction... 3 2. Hypothesis Testing... 3 3. Hypothesis Tests Concerning the Mean... 10 4. Hypothesis Tests
More information93.4 Likelihood ratio test. NeymanPearson lemma
93.4 Likelihood ratio test NeymanPearson lemma 91 Hypothesis Testing 91.1 Statistical Hypotheses Statistical hypothesis testing and confidence interval estimation of parameters are the fundamental
More informationPrep Course in Statistics Prof. Massimo Guidolin
MSc. Finance & CLEFIN A.A. 3/ ep Course in Statistics of. Massimo Guidolin A Few Review Questions and oblems concerning, Hypothesis Testing and Confidence Intervals SUGGESTION: try to approach the questions
More informationInferential Statistics
Inferential Statistics Sampling and the normal distribution Zscores Confidence levels and intervals Hypothesis testing Commonly used statistical methods Inferential Statistics Descriptive statistics are
More informationHow to Conduct a Hypothesis Test
How to Conduct a Hypothesis Test The idea of hypothesis testing is relatively straightforward. In various studies we observe certain events. We must ask, is the event due to chance alone, or is there some
More informationWooldridge, Introductory Econometrics, 4th ed. Multiple regression analysis:
Wooldridge, Introductory Econometrics, 4th ed. Chapter 4: Inference Multiple regression analysis: We have discussed the conditions under which OLS estimators are unbiased, and derived the variances of
More informationTESTING OF HYPOTHESIS
TESTING OF HYPOTHESIS Rajender Parsad I.A.S.R.I., Library Avenue, New Delhi 11 12 rajender@iasri.res.in In applied investigations or in experimental research, one may wish to estimate the yield of a new
More informationClassical Hypothesis Testing and GWAS
Department of Computer Science Brown University, Providence sorin@cs.brown.edu September 15, 2014 Outline General Principles Classical statistical hypothesis testing involves the test of a null hypothesis
More informationReview of Likelihood Theory
Appendix A Review of Likelihood Theory This is a brief summary of some of the key results we need from likelihood theory. A.1 Maximum Likelihood Estimation Let Y 1,..., Y n be n independent random variables
More informationFundamental Probability and Statistics
Fundamental Probability and Statistics "There are known knowns. These are things we know that we know. There are known unknowns. That is to say, there are things that we know we don't know. But there are
More informationProbability, Binomial Distributions and Hypothesis Testing Vartanian, SW 540
Probability, Binomial Distributions and Hypothesis Testing Vartanian, SW 540 1. Assume you are tossing a coin 11 times. The following distribution gives the likelihoods of getting a particular number of
More informationTesting: is my coin fair?
Testing: is my coin fair? Formally: we want to make some inference about P(head) Try it: toss coin several times (say 7 times) Assume that it is fair ( P(head)= ), and see if this assumption is compatible
More informationHypothesis Testing. 1 Introduction. 2 Hypotheses. 2.1 Null and Alternative Hypotheses. 2.2 Simple vs. Composite. 2.3 OneSided and TwoSided Tests
Hypothesis Testing 1 Introduction This document is a simple tutorial on hypothesis testing. It presents the basic concepts and definitions as well as some frequently asked questions associated with hypothesis
More informationIntroduction to Hypothesis Testing
I. Terms, Concepts. Introduction to Hypothesis Testing A. In general, we do not know the true value of population parameters  they must be estimated. However, we do have hypotheses about what the true
More informationModule 5 Hypotheses Tests: Comparing Two Groups
Module 5 Hypotheses Tests: Comparing Two Groups Objective: In medical research, we often compare the outcomes between two groups of patients, namely exposed and unexposed groups. At the completion of this
More informationStat 5102 Notes: Nonparametric Tests and. confidence interval
Stat 510 Notes: Nonparametric Tests and Confidence Intervals Charles J. Geyer April 13, 003 This handout gives a brief introduction to nonparametrics, which is what you do when you don t believe the assumptions
More informationNull Hypothesis Significance Testing Signifcance Level, Power, ttests Spring 2014 Jeremy Orloff and Jonathan Bloom
Null Hypothesis Significance Testing Signifcance Level, Power, ttests 18.05 Spring 2014 Jeremy Orloff and Jonathan Bloom Simple and composite hypotheses Simple hypothesis: the sampling distribution is
More informationHypothesis Testing  II
3σ 2σ +σ +2σ +3σ Hypothesis Testing  II Lecture 9 0909.400.01 / 0909.400.02 Dr. P. s Clinic Consultant Module in Probability & Statistics in Engineering Today in P&S 3σ 2σ +σ +2σ +3σ Review: Hypothesis
More informationHYPOTHESIS TESTING: POWER OF THE TEST
HYPOTHESIS TESTING: POWER OF THE TEST The first 6 steps of the 9step test of hypothesis are called "the test". These steps are not dependent on the observed data values. When planning a research project,
More informationChapter Five. Hypothesis Testing: Concepts
Chapter Five The Purpose of Hypothesis Testing... 110 An Initial Look at Hypothesis Testing... 112 Formal Hypothesis Testing... 114 Introduction... 114 Null and Alternate Hypotheses... 114 Procedure for
More informationExact Nonparametric Tests for Comparing Means  A Personal Summary
Exact Nonparametric Tests for Comparing Means  A Personal Summary Karl H. Schlag European University Institute 1 December 14, 2006 1 Economics Department, European University Institute. Via della Piazzuola
More information3.6: General Hypothesis Tests
3.6: General Hypothesis Tests The χ 2 goodness of fit tests which we introduced in the previous section were an example of a hypothesis test. In this section we now consider hypothesis tests more generally.
More information9Tests of Hypotheses. for a Single Sample CHAPTER OUTLINE
9Tests of Hypotheses for a Single Sample CHAPTER OUTLINE 91 HYPOTHESIS TESTING 91.1 Statistical Hypotheses 91.2 Tests of Statistical Hypotheses 91.3 OneSided and TwoSided Hypotheses 91.4 General
More informationChapter 4: Constrained estimators and tests in the multiple linear regression model (Part II)
Chapter 4: Constrained estimators and tests in the multiple linear regression model (Part II) Florian Pelgrin HEC SeptemberDecember 2010 Florian Pelgrin (HEC) Constrained estimators SeptemberDecember
More informationTutorial 5: Hypothesis Testing
Tutorial 5: Hypothesis Testing Rob Nicholls nicholls@mrclmb.cam.ac.uk MRC LMB Statistics Course 2014 Contents 1 Introduction................................ 1 2 Testing distributional assumptions....................
More informationNull Hypothesis Significance Testing Signifcance Level, Power, ttests. 18.05 Spring 2014 Jeremy Orloff and Jonathan Bloom
Null Hypothesis Significance Testing Signifcance Level, Power, ttests 18.05 Spring 2014 Jeremy Orloff and Jonathan Bloom Simple and composite hypotheses Simple hypothesis: the sampling distribution is
More informationSampling and Hypothesis Testing
Population and sample Sampling and Hypothesis Testing Allin Cottrell Population : an entire set of objects or units of observation of one sort or another. Sample : subset of a population. Parameter versus
More information4. Introduction to Statistics
Statistics for Engineers 41 4. Introduction to Statistics Descriptive Statistics Types of data A variate or random variable is a quantity or attribute whose value may vary from one unit of investigation
More informationHomework #3 is due Friday by 5pm. Homework #4 will be posted to the class website later this week. It will be due Friday, March 7 th, at 5pm.
Homework #3 is due Friday by 5pm. Homework #4 will be posted to the class website later this week. It will be due Friday, March 7 th, at 5pm. Political Science 15 Lecture 12: Hypothesis Testing Sampling
More informationIntroduction to Hypothesis Testing. Point estimation and confidence intervals are useful statistical inference procedures.
Introduction to Hypothesis Testing Point estimation and confidence intervals are useful statistical inference procedures. Another type of inference is used frequently used concerns tests of hypotheses.
More information1 Confidence intervals
Math 143 Inference for Means 1 Statistical inference is inferring information about the distribution of a population from information about a sample. We re generally talking about one of two things: 1.
More informationPermutation Tests for Comparing Two Populations
Permutation Tests for Comparing Two Populations Ferry Butar Butar, Ph.D. JaeWan Park Abstract Permutation tests for comparing two populations could be widely used in practice because of flexibility of
More informationMINITAB ASSISTANT WHITE PAPER
MINITAB ASSISTANT WHITE PAPER This paper explains the research conducted by Minitab statisticians to develop the methods and data checks used in the Assistant in Minitab 17 Statistical Software. 2Sample
More informationMATH4427 Notebook 3 Spring MATH4427 Notebook Hypotheses: Definitions and Examples... 3
MATH4427 Notebook 3 Spring 2016 prepared by Professor Jenny Baglivo c Copyright 20092016 by Jenny A. Baglivo. All Rights Reserved. Contents 3 MATH4427 Notebook 3 3 3.1 Hypotheses: Definitions and Examples............................
More informationHypothesis Testing. Hypothesis Testing CS 700
Hypothesis Testing CS 700 1 Hypothesis Testing! Purpose: make inferences about a population parameter by analyzing differences between observed sample statistics and the results one expects to obtain if
More information1 Logit & Probit Models for Binary Response
ECON 370: Limited Dependent Variable 1 Limited Dependent Variable Econometric Methods, ECON 370 We had previously discussed the possibility of running regressions even when the dependent variable is dichotomous
More informationThe alternative hypothesis,, is the statement that the parameter value somehow differs from that claimed by the null hypothesis. : 0.5 :>0.5 :<0.
Section 8.28.5 Null and Alternative Hypotheses... The null hypothesis,, is a statement that the value of a population parameter is equal to some claimed value. :=0.5 The alternative hypothesis,, is the
More informationHypothesis Testing COMP 245 STATISTICS. Dr N A Heard. 1 Hypothesis Testing 2 1.1 Introduction... 2 1.2 Error Rates and Power of a Test...
Hypothesis Testing COMP 45 STATISTICS Dr N A Heard Contents 1 Hypothesis Testing 1.1 Introduction........................................ 1. Error Rates and Power of a Test.............................
More informationUsing Excel for inferential statistics
FACT SHEET Using Excel for inferential statistics Introduction When you collect data, you expect a certain amount of variation, just caused by chance. A wide variety of statistical tests can be applied
More informationCONTENTS OF DAY 2. II. Why Random Sampling is Important 9 A myth, an urban legend, and the real reason NOTES FOR SUMMER STATISTICS INSTITUTE COURSE
1 2 CONTENTS OF DAY 2 I. More Precise Definition of Simple Random Sample 3 Connection with independent random variables 3 Problems with small populations 8 II. Why Random Sampling is Important 9 A myth,
More informationLAB 4 INSTRUCTIONS CONFIDENCE INTERVALS AND HYPOTHESIS TESTING
LAB 4 INSTRUCTIONS CONFIDENCE INTERVALS AND HYPOTHESIS TESTING In this lab you will explore the concept of a confidence interval and hypothesis testing through a simulation problem in engineering setting.
More information7 Hypothesis testing  one sample tests
7 Hypothesis testing  one sample tests 7.1 Introduction Definition 7.1 A hypothesis is a statement about a population parameter. Example A hypothesis might be that the mean age of students taking MAS113X
More informationInterpreting KullbackLeibler Divergence with the NeymanPearson Lemma
Interpreting KullbackLeibler Divergence with the NeymanPearson Lemma Shinto Eguchi a, and John Copas b a Institute of Statistical Mathematics and Graduate University of Advanced Studies, Minamiazabu
More informationSenior Secondary Australian Curriculum
Senior Secondary Australian Curriculum Mathematical Methods Glossary Unit 1 Functions and graphs Asymptote A line is an asymptote to a curve if the distance between the line and the curve approaches zero
More informationMONT 107N Understanding Randomness Solutions For Final Examination May 11, 2010
MONT 07N Understanding Randomness Solutions For Final Examination May, 00 Short Answer (a) (0) How are the EV and SE for the sum of n draws with replacement from a box computed? Solution: The EV is n times
More informationMaximum Likelihood Estimation
Math 541: Statistical Theory II Lecturer: Songfeng Zheng Maximum Likelihood Estimation 1 Maximum Likelihood Estimation Maximum likelihood is a relatively simple method of constructing an estimator for
More informationThe Philosophy of Hypothesis Testing, Questions and Answers 2006 Samuel L. Baker
HYPOTHESIS TESTING PHILOSOPHY 1 The Philosophy of Hypothesis Testing, Questions and Answers 2006 Samuel L. Baker Question: So I'm hypothesis testing. What's the hypothesis I'm testing? Answer: When you're
More informationLecture Topic 6: Chapter 9 Hypothesis Testing
Lecture Topic 6: Chapter 9 Hypothesis Testing 9.1 Developing Null and Alternative Hypotheses Hypothesis testing can be used to determine whether a statement about the value of a population parameter should
More informationThe Binomial Distribution
The Binomial Distribution James H. Steiger November 10, 00 1 Topics for this Module 1. The Binomial Process. The Binomial Random Variable. The Binomial Distribution (a) Computing the Binomial pdf (b) Computing
More informationChapter 9 Testing Hypothesis and Assesing Goodness of Fit
Chapter 9 Testing Hypothesis and Assesing Goodness of Fit 9.19.3 The NeymanPearson Paradigm and Neyman Pearson Lemma We begin by reviewing some basic terms in hypothesis testing. Let H 0 denote the null
More informationQUANTITATIVE METHODS BIOLOGY FINAL HONOUR SCHOOL NONPARAMETRIC TESTS
QUANTITATIVE METHODS BIOLOGY FINAL HONOUR SCHOOL NONPARAMETRIC TESTS This booklet contains lecture notes for the nonparametric work in the QM course. This booklet may be online at http://users.ox.ac.uk/~grafen/qmnotes/index.html.
More informationInferential Statistics. Probability. From Samples to Populations. Katie RommelEsham Education 504
Inferential Statistics Katie RommelEsham Education 504 Probability Probability is the scientific way of stating the degree of confidence we have in predicting something Tossing coins and rolling dice
More informationtstatistics for Weighted Means with Application to Risk Factor Models
tstatistics for Weighted Means with Application to Risk Factor Models Lisa R. Goldberg Barra, Inc. 00 Milvia St. Berkeley, CA 94704 Alec N. Kercheval Dept. of Mathematics Florida State University Tallahassee,
More informationI. Basics of Hypothesis Testing
Introduction to Hypothesis Testing This deals with an issue highly similar to what we did in the previous chapter. In that chapter we used sample information to make inferences about the range of possibilities
More informationDiscrete Mathematics and Probability Theory Fall 2009 Satish Rao,David Tse Note 11
CS 70 Discrete Mathematics and Probability Theory Fall 2009 Satish Rao,David Tse Note Conditional Probability A pharmaceutical company is marketing a new test for a certain medical condition. According
More informationHypoTesting. Name: Class: Date: Multiple Choice Identify the choice that best completes the statement or answers the question.
Name: Class: Date: HypoTesting Multiple Choice Identify the choice that best completes the statement or answers the question. 1. A Type II error is committed if we make: a. a correct decision when the
More informationGeneral Procedure for Hypothesis Test. Five types of statistical analysis. 1. Formulate H 1 and H 0. General Procedure for Hypothesis Test
Five types of statistical analysis General Procedure for Hypothesis Test Descriptive Inferential Differences Associative Predictive What are the characteristics of the respondents? What are the characteristics
More informationMedian of the pvalue Under the Alternative Hypothesis
Median of the pvalue Under the Alternative Hypothesis Bhaskar Bhattacharya Department of Mathematics, Southern Illinois University, Carbondale, IL, USA Desale Habtzghi Department of Statistics, University
More informationStudy Guide for the Final Exam
Study Guide for the Final Exam When studying, remember that the computational portion of the exam will only involve new material (covered after the second midterm), that material from Exam 1 will make
More informationT adult = 96 T child = 114.
Homework Solutions Do all tests at the 5% level and quote pvalues when possible. When answering each question uses sentences and include the relevant JMP output and plots (do not include the data in your
More informationChapter 8: Interval Estimates and Hypothesis Testing
Chapter 8: Interval Estimates and Hypothesis Testing Chapter 8 Outline Clint s Assignment: Taking Stock Estimate Reliability: Interval Estimate Question o Normal Distribution versus the Student tdistribution:
More informationMCQ TESTING OF HYPOTHESIS
MCQ TESTING OF HYPOTHESIS MCQ 13.1 A statement about a population developed for the purpose of testing is called: (a) Hypothesis (b) Hypothesis testing (c) Level of significance (d) Teststatistic MCQ
More informationTwoSample TTests Assuming Equal Variance (Enter Means)
Chapter 4 TwoSample TTests Assuming Equal Variance (Enter Means) Introduction This procedure provides sample size and power calculations for one or twosided twosample ttests when the variances of
More informationMeasuring the Power of a Test
Textbook Reference: Chapter 9.5 Measuring the Power of a Test An economic problem motivates the statement of a null and alternative hypothesis. For a numeric data set, a decision rule can lead to the rejection
More informationVariance of OLS Estimators and Hypothesis Testing. Randomness in the model. GM assumptions. Notes. Notes. Notes. Charlie Gibbons ARE 212.
Variance of OLS Estimators and Hypothesis Testing Charlie Gibbons ARE 212 Spring 2011 Randomness in the model Considering the model what is random? Y = X β + ɛ, β is a parameter and not random, X may be
More informationModèles stochastiques II
Modèles stochastiques II INFO 15 ianluca Bontempi Département d Informatique Boulevard de Triomphe  CP 212 http://wwwulbacbe/di Modéles stochastiques II p1/5 Testing hypothesis Hypothesis testing is the
More informationLecture 8 Hypothesis Testing
Lecture 8 Hypothesis Testing Fall 2013 Prof. Yao Xie, yao.xie@isye.gatech.edu H. Milton Stewart School of Industrial Systems & Engineering Georgia Tech Midterm 1 Score 46 students Highest score: 98 Lowest
More informationHypothesis Testing or How to Decide to Decide Edpsy 580
Hypothesis Testing or How to Decide to Decide Edpsy 580 Carolyn J. Anderson Department of Educational Psychology University of Illinois at UrbanaChampaign Hypothesis Testing or How to Decide to Decide
More informationIntroduction to Hypothesis Testing OPRE 6301
Introduction to Hypothesis Testing OPRE 6301 Motivation... The purpose of hypothesis testing is to determine whether there is enough statistical evidence in favor of a certain belief, or hypothesis, about
More informationLecture 02: Statistical Inference for Binomial Parameters
Lecture 02: Statistical Inference for Binomial Parameters Dipankar Bandyopadhyay, Ph.D. BMTRY 711: Analysis of Categorical Data Spring 2011 Division of Biostatistics and Epidemiology Medical University
More informationMAT X Hypothesis Testing  Part I
MAT 2379 3X Hypothesis Testing  Part I Definition : A hypothesis is a conjecture concerning a value of a population parameter (or the shape of the population). The hypothesis will be tested by evaluating
More informationSECOND PART, LECTURE 4: CONFIDENCE INTERVALS
Massimo Guidolin Massimo.Guidolin@unibocconi.it Dept. of Finance STATISTICS/ECONOMETRICS PREP COURSE PROF. MASSIMO GUIDOLIN SECOND PART, LECTURE 4: CONFIDENCE INTERVALS Lecture 4: Confidence Intervals
More informationTest of proportion = 0.5 N Sample prop 95% CI z value p value (0.400, 0.466)
STATISTICS FOR THE SOCIAL AND BEHAVIORAL SCIENCES Recitation #10 Answer Key PROBABILITY, HYPOTHESIS TESTING, CONFIDENCE INTERVALS Hypothesis tests 2 When a recent GSS asked, would you be willing to pay
More information2. The mean birthweights from this hospital is lower than 120 oz.
Probability February 13, 2013 Debdeep Pati Hypothesis testing Two sample inference Obstetrics: Mothers with low socioeconomic status (SES) deliver babies with lower than normal birthweights. The mean birthweights
More informationInference in Regression Analysis
Yang Feng Inference in the Normal Error Regression Model Y i = β 0 + β 1 X i + ɛ i Y i value of the response variable in the i th trial β 0 and β 1 are parameters X i is a known constant, the value of
More informationSociology 6Z03 Topic 15: Statistical Inference for Means
Sociology 6Z03 Topic 15: Statistical Inference for Means John Fox McMaster University Fall 2016 John Fox (McMaster University) Soc 6Z03: Statistical Inference for Means Fall 2016 1 / 41 Outline: Statistical
More informationINTRODUCTORY STATISTICS
INTRODUCTORY STATISTICS Questions 290 Field Statistics Target Audience Science Students Outline Target Level First or Secondyear Undergraduate Topics Introduction to Statistics Descriptive Statistics
More informationToss a coin twice. Let Y denote the number of heads.
! Let S be a discrete sample space with the set of elementary events denoted by E = {e i, i = 1, 2, 3 }. A random variable is a function Y(e i ) that assigns a real value to each elementary event, e i.
More informationMachine Learning. Topic: Evaluating Hypotheses
Machine Learning Topic: Evaluating Hypotheses Bryan Pardo, Machine Learning: EECS 349 Fall 2011 How do you tell something is better? Assume we have an error measure. How do we tell if it measures something
More informationII. DISTRIBUTIONS distribution normal distribution. standard scores
Appendix D Basic Measurement And Statistics The following information was developed by Steven Rothke, PhD, Department of Psychology, Rehabilitation Institute of Chicago (RIC) and expanded by Mary F. Schmidt,
More informationNull Hypothesis Significance Testing: a short tutorial
Null Hypothesis Significance Testing: a short tutorial Although thoroughly criticized, null hypothesis significance testing is the statistical method of choice in biological, biomedical and social sciences
More informationModule 7: Hypothesis Testing I Statistics (OA3102)
Module 7: Hypothesis Testing I Statistics (OA3102) Professor Ron Fricker Naval Postgraduate School Monterey, California Reading assignment: WM&S chapter 10.110.5 Revision: 212 1 Goals for this Module
More informationHypothesis testing S2
Basic medical statistics for clinical and experimental research Hypothesis testing S2 Katarzyna Jóźwiak k.jozwiak@nki.nl 2nd November 2015 1/43 Introduction Point estimation: use a sample statistic to
More informationSampling Distributions and the Central Limit Theorem
135 Part 2 / Basic Tools of Research: Sampling, Measurement, Distributions, and Descriptive Statistics Chapter 10 Sampling Distributions and the Central Limit Theorem In the previous chapter we explained
More informationOverview of Violations of the Basic Assumptions in the Classical Normal Linear Regression Model
Overview of Violations of the Basic Assumptions in the Classical Normal Linear Regression Model 1 September 004 A. Introduction and assumptions The classical normal linear regression model can be written
More informationHypothesis tests, confidence intervals, and bootstrapping
Hypothesis tests, confidence intervals, and bootstrapping Business Statistics 41000 Fall 2015 1 Topics 1. Hypothesis tests Testing a mean: H0 : µ = µ 0 Testing a proportion: H0 : p = p 0 Testing a difference
More informationTests for Two Proportions
Chapter 200 Tests for Two Proportions Introduction This module computes power and sample size for hypothesis tests of the difference, ratio, or odds ratio of two independent proportions. The test statistics
More informationMultivariate Normal Distribution
Multivariate Normal Distribution Lecture 4 July 21, 2011 Advanced Multivariate Statistical Methods ICPSR Summer Session #2 Lecture #47/21/2011 Slide 1 of 41 Last Time Matrices and vectors Eigenvalues
More informationProbability and Statistics
CHAPTER 2: RANDOM VARIABLES AND ASSOCIATED FUNCTIONS 2b  0 Probability and Statistics Kristel Van Steen, PhD 2 Montefiore Institute  Systems and Modeling GIGA  Bioinformatics ULg kristel.vansteen@ulg.ac.be
More informationHypothesis Testing: General Framework 1 1
Hypothesis Testing: General Framework Lecture 2 K. Zuev February 22, 26 In previous lectures we learned how to estimate parameters in parametric and nonparametric settings. Quite often, however, researchers
More informationLecture 8. Confidence intervals and the central limit theorem
Lecture 8. Confidence intervals and the central limit theorem Mathematical Statistics and Discrete Mathematics November 25th, 2015 1 / 15 Central limit theorem Let X 1, X 2,... X n be a random sample of
More informationWater Quality Problem. Hypothesis Testing of Means. Water Quality Example. Water Quality Example. Water quality example. Water Quality Example
Water Quality Problem Hypothesis Testing of Means Dr. Tom Ilvento FREC 408 Suppose I am concerned about the quality of drinking water for people who use wells in a particular geographic area I will test
More informationProbability & Statistics
Probability & Statistics BITS Pilani K K Birla Goa Campus Dr. Jajati Keshari Sahoo Department of Mathematics TEST OF HYPOTHESIS There are many problems in which, rather then estimating the value of a parameter,
More informationSTATISTICA Formula Guide: Logistic Regression. Table of Contents
: Table of Contents... 1 Overview of Model... 1 Dispersion... 2 Parameterization... 3 SigmaRestricted Model... 3 Overparameterized Model... 4 Reference Coding... 4 Model Summary (Summary Tab)... 5 Summary
More informationTesting a claim about a population mean
Introductory Statistics Lectures Testing a claim about a population mean One sample hypothesis test of the mean Department of Mathematics Pima Community College Redistribution of this material is prohibited
More informationA POPULATION MEAN, CONFIDENCE INTERVALS AND HYPOTHESIS TESTING
CHAPTER 5. A POPULATION MEAN, CONFIDENCE INTERVALS AND HYPOTHESIS TESTING 5.1 Concepts When a number of animals or plots are exposed to a certain treatment, we usually estimate the effect of the treatment
More information