# QUANTITATIVE METHODS BIOLOGY FINAL HONOUR SCHOOL NON-PARAMETRIC TESTS

Size: px
Start display at page:

Transcription

1 QUANTITATIVE METHODS BIOLOGY FINAL HONOUR SCHOOL NON-PARAMETRIC TESTS This booklet contains lecture notes for the nonparametric work in the QM course. This booklet may be online at Alan Grafen Version 2004a ALAN GRAFEN Nonparametric Tests I (Watt discusses the Mann-Whitney test in section 9.2) Nonparametric tests form an important topic in statistics for biologists, for two quite different reasons. The first is that they are frequently used in the literature. They form a parallel set of tests, so that with many simple datasets the question will arise whether to use a parametric (i.e. GLM or GLM-like test) or a nonparametric test. You need to know what the commonest nonparametric tests are, and when they are applicable. Then you will recognise those datasets where the choice arises. You also need to know how to choose between the two types of test. The second reason nonparametric tests are useful for biologists is that although based on the same fundamental statistical logic as parametric tests, they are much simpler and their workings are more transparent. Learning nonparametric tests is therefore a chance to refresh your understanding of the basic logic of statistical inference. This week we look at what nonparametric tests Minitab will do, and their GLM counterparts, and we discuss when nonparametric tests are preferable. Next week we will look carefully at the logic of some specific tests. You are recommended to read the section from Watt given above, so that when you read the rest of this handout you have a specific nonparametric test well established in your mind. What is a nonparametric test? When you were introduced to any parametric test, there came a stage when you were asked to assume that some distribution was Normal. Normality of some distribution is an assumption of parametric tests. You might reasonably rebel, and decide you want to do a test that does not depend on Normality. In some tests, there is also a further assumption, for example linear regression assumes that x and y are related linearly and the test is invalid if

2 they are not. Again you might rebel and demand a test that worked whether or not x and y are linearly related. The set of tests loosely called nonparametric are tests based on minimal assumptions, and so do their best to be valid in as wide a range of circumstances as possible. There is a threefold cost for saving on assumptions. First, only simple kinds of tests can be performed without making assumptions about shapes of distributions and the nature of relationships (Normality and linearity in simple cases). In the table of equivalences below, notice that all the GLM equivalents have one or two x-variables, never three. You can have one continuous x-variable, or one or two categorical variables, but no more. Mixing continuous and categorical variables is not possible, at least within the tests Minitab will perform. So nonparametric tests are available only for a restricted types of dataset, though this does include the most common ones. The nonparametric tests Minitab provides are the common ones, and they are quite restricted in the types of dataset they will handle. Statisticians do suggest nonparametric tests that will apply to wider types of dataset. However, these tests are of interest to biologists only once they become accepted as sensible by statisticians generally, and available in statistical packages. You probably could find a nonparametric test that would analyse a four-way analysis of variance with covariate, but unless and until it is accepted and available it is probably better not to find it! Second, GLM always provides hypothesis tests (p-values) and estimation (confidence intervals, for example). Nonparametric tests always provide hypothesis tests, but only sometimes estimation. A table of nonparametric tests available using Minitab, and their parametric equivalents, with the associated Minitab commands. Nonparametric test(s) Sign Test (STEST, SINTERVAL), Wilcoxon Signed Ranks Test (WTEST, WINTERVAL) Mann-Whitney Test (MANN-WHITNEY) Spearman Rank Correlation (RANK each variable and use CORRELATE on the ranks for the value of the coefficient. Use a GLM between the ranks to get the p-value.) Kruskal-Wallis Test (KRUSKAL-WALLIS) Friedman Test (FRIEDMAN) Equivalent parametric tests One-sample t-test (TTEST, TINT or GLM) Two-sample t-test (TWOS, TWOT or GLM) Pearson Product-Moment Correlation, Bivariate Regression (CORRELATE or GLM with one continuous x-variable) One-way Analysis of Variance (ANOVA or GLM) One-way Blocked Analysis of Variance (ANOVA or GLM) Third, GLM tests are efficient. This is a technical term meaning they make the best possible use of the information. So, provided the assumptions of the GLM are true, the GLM is more efficient than any other test, including the corresponding nonparametric test. This loss of efficiency can be measured in the loss of power. That is, suppose the null hypothesis is false. The GLM will reject the null hypothesis more frequently than the nonparametric test, which therefore wastes information. Of course if the assumptions of the GLM are not upheld, then the GLM may well be quite wrong, while the nonparametric test remains valid. One further contrast is that the GLM framework combines a large group of parametric tests into a single scheme, while nonparametric tests are disparate with no grand scheme to unite them.

3 Essential point. Nonparametric tests rely on fewer assumptions than GLM, but this does not mean they make no assumptions at all. Specifically, the assumption of independence is just as important for nonparametric as for parametric tests. Nonparametrics are not cure-alls for failures of assumptions. Rank tests, distribution free tests and nonparametric tests These are three names for three slightly different but largely overlapping sets of statistical tests. Rank tests are so called because they involve first ranking the data. Distribution free tests are so called because they make no assumptions about the distribution of the population from which the samples are drawn. Nonparametric tests are so called because the hypotheses tested do not involve the parameters of the population distributions (for example that the mean of population one equals the mean of population two). Instead the null hypothesis is simply that the two population distributions are the same. Notice that this implies that the means are the same, the median is the same, the variance is the same and so on. So the point of being nonparametric is not to test a weaker hypothesis, it is to avoid assuming anything more than necessary. Parameters are always part of a model that restricts the range of applicability of the test, by specifying the shape of a relationship or the shape of a distribution. A further property that tests can have is scale-invariance. A test is scale-invariant if it gives exactly the same answer when you transform the variables, for example take logarithms. When we have an arbitrary scale (say of subjective preferences), scale-invariance can be an advantage. Of the tests shown in the table, the Mann-Whitney test is a rank test, and is distribution free and scale invariant. The sign test is distribution free, and scale invariant - but it is not a rank test because the data are never ranked. The Wilcoxon signed ranks test is not a rank test because the original data are not ranked, they are subtracted from each other. It is not scale invariant because logging the original data will affect the result (try it!). It is distribution free, because it is valid whatever the shape of the original distribution. Which type of test to use Whenever we apply a test, we should check the assumptions on which it is based, and these checks (called model criticism ) were discussed in Chapter 9 of Grafen and Hails. Given a dataset and a hypothesis that can be tested with both a parametric and a nonparametric method, an obvious question is: are the assumptions of the parametric test upheld? If we are sure the assumptions are upheld, then we should use the more efficient parametric test. Because the assumptions refer to the population and not to the sample, it is hard to be sure the assumptions are upheld unless the data are created artificially. The paradox of Normality testing is that checking Normality of data is often unsatisfactory. With small datasets, we have too little data to decide whether a distribution is Normal or not. With large datasets, the Central Limit Theorem assures us that Normality is not very important! (You encountered the Central Limit Theorem in Mods - it says that the sampling distribution of the mean attains Normality as the sample size increases.) Added to which, making a formal statistical test for Normality of data is not simple even in principle. So the decision between the methods is not as clearcut as might be thought. An extra complication is that if the assumptions of a parametric test do fail, then nonparametric testing is not the only option. Specifically, transforming the data (logging y and x; or square-rooting y) is another important possibility that was discussed in Chapter 9 of Grafen and Hails. The following guidelines represent a sensible approach.

5 Background: Nonparametric tests as randomisation tests The sign test The sign test applies to a set of values whose median, according to the null hypothesis, is zero. Usually, each value will be the difference between two observations (for example, a measure of illness before and after treatment; a measure of size for the female and male in a pair of starlings). If the median really is zero, then the number of positive differences should on average be half the total number of differences. Indeed, the number of positive differences should have a binomial distribution, with n=total number of differences and p=0.5. To find whether the observed number of positive differences is different from what would be expected just by chance, we could simulate the tossing of coins, and use a large number of such observations to estimate how likely the actual value is to arise by chance. If there are ten differences, we would toss a set of ten coins repeatedly, recording each time how many out of ten were heads. But in this case, we know the exact distribution, and so we can appeal to the binomial distribution directly. The Wilcoxon signed ranks test The sign test discussed above may seem rather wasteful. A difference that is just negative counts the same as a really large negative difference. Is there any way to give greater weight to larger differences, without going so far as parametric methods? There is. The procedure is to work out the rank of each difference irrespective of sign. So the smallest difference (positive or negative) is given rank 1. The next smallest (positive or negative) is given rank 2, and so on. Instead of just counting how many negative differences there are, we weight each difference by its rank. We therefore add up all the ranks of the negative differences. This is to be the test statistic. But how can we work out how unusual our observed value of the test statistic is? We turn to a randomisation procedure, based on the supposition that the distribution of each difference is symmetrical. On the null hypothesis, each difference, no matter what its rank, is therefore equally likely to be positive or negative. If there are ten differences, a suitable randomisation procedure is to mark ten coins 1 to 10, and toss each of them. We add up the scores of all the coins that fall tails. This parallels the adding of ranks used to get the test statistic. The distribution of the test statistic obtained from repetition of the randomisation procedure can then be compared with the actual value. If the observed value falls in the top 2.5%, or the bottom 2.5%, then we reject the null hypothesis at the 5% level on a two-tailed test. The Mann-Whitney test The Mann-Whitney test tests for a difference between two groups of observations, and looks specifically for a difference in location, that is whether one group tends to be have larger values than the other. If the groups are two samples from the same underlying distribution, then any differences between the samples is due to chance. We could think of drawing each observation from the one underlying distribution, and then afterwards allocating them at random to the two groups. This would be a way of working out, for a given set of observations, how likely differences of any magnitude between two samples are to arise by chance.

6 The randomisation test then involves taking as fixed the set of values observed, and how many belong to each group; but randomising which values belong to which group. The test statistic used to assess the location of a group is the sum of the ranks. If there are 5 in each group, then a complete separation of the two groups gives a summed rank of 15 for the higher group and a summed rank of 40 for the lower. If there is no systematic difference between the groups, then on average the summed rank of a group is In the randomisation test, we create random divisions of the datapoints into two groups, and record the mean rank of group A. We do this lots of times, and build up a distribution that shows how often the mean rank would take different values if there were in fact no real differences between the groups. The single observed mean rank of group A is then compared to this null distribution. If it is in the top 2.5% or the bottom 2.5% of the null distribution, then we reject the null hypothesis at the 5% level on a two-tailed test. General remarks on randomisation tests The general idea of randomisation tests is a very powerful one, and it can be invoked to cope with difficult statistical situations in which the assumptions of standard methods are not met. There are two elements: the test statistic and the randomisation procedure. The validity of the test is guaranteed by the randomisation procedure alone, and so there is wide flexibility in choosing a test statistic. The randomisation procedure divides the information in the dataset into two sets: the fixed and the unfixed. The table lists what is considered fixed and unfixed in each of the three tests described above. In statistical terms, we condition on the fixed information and conduct the test on the unfixed information. Any information that we do not want to use should be included in the fixed information. Conversely, any information we do want to use must be included in the unfixed information. Test Fixed Information Unfixed Information Test Statistic Sign Test The absolute values of the differences Whether each difference is + or - Number of + Wilcoxon signed ranks The absolute values of the differences Whether each difference is + or - Sum of ranks of negative differences Mann- Whitney, or Rank Sum The set of all values; the number in each group. Which precise values are in which group Sum of the ranks in the first group

### Statistical tests for SPSS

Statistical tests for SPSS Paolo Coletti A.Y. 2010/11 Free University of Bolzano Bozen Premise This book is a very quick, rough and fast description of statistical tests and their usage. It is explicitly

### NONPARAMETRIC STATISTICS 1. depend on assumptions about the underlying distribution of the data (or on the Central Limit Theorem)

NONPARAMETRIC STATISTICS 1 PREVIOUSLY parametric statistics in estimation and hypothesis testing... construction of confidence intervals computing of p-values classical significance testing depend on assumptions

### SPSS Explore procedure

SPSS Explore procedure One useful function in SPSS is the Explore procedure, which will produce histograms, boxplots, stem-and-leaf plots and extensive descriptive statistics. To run the Explore procedure,

### Rank-Based Non-Parametric Tests

Rank-Based Non-Parametric Tests Reminder: Student Instructional Rating Surveys You have until May 8 th to fill out the student instructional rating surveys at https://sakai.rutgers.edu/portal/site/sirs

### Study Guide for the Final Exam

Study Guide for the Final Exam When studying, remember that the computational portion of the exam will only involve new material (covered after the second midterm), that material from Exam 1 will make

### Come scegliere un test statistico

Come scegliere un test statistico Estratto dal Capitolo 37 of Intuitive Biostatistics (ISBN 0-19-508607-4) by Harvey Motulsky. Copyright 1995 by Oxfd University Press Inc. (disponibile in Iinternet) Table

### CHAPTER 14 NONPARAMETRIC TESTS

CHAPTER 14 NONPARAMETRIC TESTS Everything that we have done up until now in statistics has relied heavily on one major fact: that our data is normally distributed. We have been able to make inferences

### Difference tests (2): nonparametric

NST 1B Experimental Psychology Statistics practical 3 Difference tests (): nonparametric Rudolf Cardinal & Mike Aitken 10 / 11 February 005; Department of Experimental Psychology University of Cambridge

### SCHOOL OF HEALTH AND HUMAN SCIENCES DON T FORGET TO RECODE YOUR MISSING VALUES

SCHOOL OF HEALTH AND HUMAN SCIENCES Using SPSS Topics addressed today: 1. Differences between groups 2. Graphing Use the s4data.sav file for the first part of this session. DON T FORGET TO RECODE YOUR

### Parametric and Nonparametric: Demystifying the Terms

Parametric and Nonparametric: Demystifying the Terms By Tanya Hoskin, a statistician in the Mayo Clinic Department of Health Sciences Research who provides consultations through the Mayo Clinic CTSA BERD

### Tutorial 5: Hypothesis Testing

Tutorial 5: Hypothesis Testing Rob Nicholls nicholls@mrc-lmb.cam.ac.uk MRC LMB Statistics Course 2014 Contents 1 Introduction................................ 1 2 Testing distributional assumptions....................

### Using Excel for inferential statistics

FACT SHEET Using Excel for inferential statistics Introduction When you collect data, you expect a certain amount of variation, just caused by chance. A wide variety of statistical tests can be applied

### Descriptive Statistics

Descriptive Statistics Primer Descriptive statistics Central tendency Variation Relative position Relationships Calculating descriptive statistics Descriptive Statistics Purpose to describe or summarize

### Projects Involving Statistics (& SPSS)

Projects Involving Statistics (& SPSS) Academic Skills Advice Starting a project which involves using statistics can feel confusing as there seems to be many different things you can do (charts, graphs,

### Sample Size and Power in Clinical Trials

Sample Size and Power in Clinical Trials Version 1.0 May 011 1. Power of a Test. Factors affecting Power 3. Required Sample Size RELATED ISSUES 1. Effect Size. Test Statistics 3. Variation 4. Significance

### HYPOTHESIS TESTING: CONFIDENCE INTERVALS, T-TESTS, ANOVAS, AND REGRESSION

HYPOTHESIS TESTING: CONFIDENCE INTERVALS, T-TESTS, ANOVAS, AND REGRESSION HOD 2990 10 November 2010 Lecture Background This is a lightning speed summary of introductory statistical methods for senior undergraduate

### Comparing Means in Two Populations

Comparing Means in Two Populations Overview The previous section discussed hypothesis testing when sampling from a single population (either a single mean or two means from the same population). Now we

### II. DISTRIBUTIONS distribution normal distribution. standard scores

Appendix D Basic Measurement And Statistics The following information was developed by Steven Rothke, PhD, Department of Psychology, Rehabilitation Institute of Chicago (RIC) and expanded by Mary F. Schmidt,

### StatCrunch and Nonparametric Statistics

StatCrunch and Nonparametric Statistics You can use StatCrunch to calculate the values of nonparametric statistics. It may not be obvious how to enter the data in StatCrunch for various data sets that

### Chapter G08 Nonparametric Statistics

G08 Nonparametric Statistics Chapter G08 Nonparametric Statistics Contents 1 Scope of the Chapter 2 2 Background to the Problems 2 2.1 Parametric and Nonparametric Hypothesis Testing......................

### NAG C Library Chapter Introduction. g08 Nonparametric Statistics

g08 Nonparametric Statistics Introduction g08 NAG C Library Chapter Introduction g08 Nonparametric Statistics Contents 1 Scope of the Chapter... 2 2 Background to the Problems... 2 2.1 Parametric and Nonparametric

### SPSS Tests for Versions 9 to 13

SPSS Tests for Versions 9 to 13 Chapter 2 Descriptive Statistic (including median) Choose Analyze Descriptive statistics Frequencies... Click on variable(s) then press to move to into Variable(s): list

### Statistics courses often teach the two-sample t-test, linear regression, and analysis of variance

2 Making Connections: The Two-Sample t-test, Regression, and ANOVA In theory, there s no difference between theory and practice. In practice, there is. Yogi Berra 1 Statistics courses often teach the two-sample

### Fairfield Public Schools

Mathematics Fairfield Public Schools AP Statistics AP Statistics BOE Approved 04/08/2014 1 AP STATISTICS Critical Areas of Focus AP Statistics is a rigorous course that offers advanced students an opportunity

### HYPOTHESIS TESTING WITH SPSS:

HYPOTHESIS TESTING WITH SPSS: A NON-STATISTICIAN S GUIDE & TUTORIAL by Dr. Jim Mirabella SPSS 14.0 screenshots reprinted with permission from SPSS Inc. Published June 2006 Copyright Dr. Jim Mirabella CHAPTER

### UNIVERSITY OF NAIROBI

UNIVERSITY OF NAIROBI MASTERS IN PROJECT PLANNING AND MANAGEMENT NAME: SARU CAROLYNN ELIZABETH REGISTRATION NO: L50/61646/2013 COURSE CODE: LDP 603 COURSE TITLE: RESEARCH METHODS LECTURER: GAKUU CHRISTOPHER

### Nonparametric statistics and model selection

Chapter 5 Nonparametric statistics and model selection In Chapter, we learned about the t-test and its variations. These were designed to compare sample means, and relied heavily on assumptions of normality.

### Non-Parametric Tests (I)

Lecture 5: Non-Parametric Tests (I) KimHuat LIM lim@stats.ox.ac.uk http://www.stats.ox.ac.uk/~lim/teaching.html Slide 1 5.1 Outline (i) Overview of Distribution-Free Tests (ii) Median Test for Two Independent

### Introduction to Quantitative Methods

Introduction to Quantitative Methods October 15, 2009 Contents 1 Definition of Key Terms 2 2 Descriptive Statistics 3 2.1 Frequency Tables......................... 4 2.2 Measures of Central Tendencies.................

### Overview of Non-Parametric Statistics PRESENTER: ELAINE EISENBEISZ OWNER AND PRINCIPAL, OMEGA STATISTICS

Overview of Non-Parametric Statistics PRESENTER: ELAINE EISENBEISZ OWNER AND PRINCIPAL, OMEGA STATISTICS About Omega Statistics Private practice consultancy based in Southern California, Medical and Clinical

### Parametric and non-parametric statistical methods for the life sciences - Session I

Why nonparametric methods What test to use? Rank Tests Parametric and non-parametric statistical methods for the life sciences - Session I Liesbeth Bruckers Geert Molenberghs Interuniversity Institute

### Nonparametric Two-Sample Tests. Nonparametric Tests. Sign Test

Nonparametric Two-Sample Tests Sign test Mann-Whitney U-test (a.k.a. Wilcoxon two-sample test) Kolmogorov-Smirnov Test Wilcoxon Signed-Rank Test Tukey-Duckworth Test 1 Nonparametric Tests Recall, nonparametric

### Stat 5102 Notes: Nonparametric Tests and. confidence interval

Stat 510 Notes: Nonparametric Tests and Confidence Intervals Charles J. Geyer April 13, 003 This handout gives a brief introduction to nonparametrics, which is what you do when you don t believe the assumptions

### Normal distribution. ) 2 /2σ. 2π σ

Normal distribution The normal distribution is the most widely known and used of all distributions. Because the normal distribution approximates many natural phenomena so well, it has developed into a

### LAB 4 INSTRUCTIONS CONFIDENCE INTERVALS AND HYPOTHESIS TESTING

LAB 4 INSTRUCTIONS CONFIDENCE INTERVALS AND HYPOTHESIS TESTING In this lab you will explore the concept of a confidence interval and hypothesis testing through a simulation problem in engineering setting.

### How To Test For Significance On A Data Set

Non-Parametric Univariate Tests: 1 Sample Sign Test 1 1 SAMPLE SIGN TEST A non-parametric equivalent of the 1 SAMPLE T-TEST. ASSUMPTIONS: Data is non-normally distributed, even after log transforming.

### Simple Regression Theory II 2010 Samuel L. Baker

SIMPLE REGRESSION THEORY II 1 Simple Regression Theory II 2010 Samuel L. Baker Assessing how good the regression equation is likely to be Assignment 1A gets into drawing inferences about how close the

Chapter 12 Nonparametric Tests Chapter Table of Contents OVERVIEW...171 Testing for Normality...... 171 Comparing Distributions....171 ONE-SAMPLE TESTS...172 TWO-SAMPLE TESTS...172 ComparingTwoIndependentSamples...172

### Unit 31 A Hypothesis Test about Correlation and Slope in a Simple Linear Regression

Unit 31 A Hypothesis Test about Correlation and Slope in a Simple Linear Regression Objectives: To perform a hypothesis test concerning the slope of a least squares line To recognize that testing for a

### Statistics for Sports Medicine

Statistics for Sports Medicine Suzanne Hecht, MD University of Minnesota (suzanne.hecht@gmail.com) Fellow s Research Conference July 2012: Philadelphia GOALS Try not to bore you to death!! Try to teach

### Introduction to Minitab and basic commands. Manipulating data in Minitab Describing data; calculating statistics; transformation.

Computer Workshop 1 Part I Introduction to Minitab and basic commands. Manipulating data in Minitab Describing data; calculating statistics; transformation. Outlier testing Problem: 1. Five months of nickel

### Nonparametric Statistics

Nonparametric Statistics J. Lozano University of Goettingen Department of Genetic Epidemiology Interdisciplinary PhD Program in Applied Statistics & Empirical Methods Graduate Seminar in Applied Statistics

### Analysing Questionnaires using Minitab (for SPSS queries contact -) Graham.Currell@uwe.ac.uk

Analysing Questionnaires using Minitab (for SPSS queries contact -) Graham.Currell@uwe.ac.uk Structure As a starting point it is useful to consider a basic questionnaire as containing three main sections:

### Research Methods & Experimental Design

Research Methods & Experimental Design 16.422 Human Supervisory Control April 2004 Research Methods Qualitative vs. quantitative Understanding the relationship between objectives (research question) and

### Introduction to Hypothesis Testing

I. Terms, Concepts. Introduction to Hypothesis Testing A. In general, we do not know the true value of population parameters - they must be estimated. However, we do have hypotheses about what the true

### The Dummy s Guide to Data Analysis Using SPSS

The Dummy s Guide to Data Analysis Using SPSS Mathematics 57 Scripps College Amy Gamble April, 2001 Amy Gamble 4/30/01 All Rights Rerserved TABLE OF CONTENTS PAGE Helpful Hints for All Tests...1 Tests

### SAS/STAT. 9.2 User s Guide. Introduction to. Nonparametric Analysis. (Book Excerpt) SAS Documentation

SAS/STAT Introduction to 9.2 User s Guide Nonparametric Analysis (Book Excerpt) SAS Documentation This document is an individual chapter from SAS/STAT 9.2 User s Guide. The correct bibliographic citation

### Hypothesis testing - Steps

Hypothesis testing - Steps Steps to do a two-tailed test of the hypothesis that β 1 0: 1. Set up the hypotheses: H 0 : β 1 = 0 H a : β 1 0. 2. Compute the test statistic: t = b 1 0 Std. error of b 1 =

### Permutation Tests for Comparing Two Populations

Permutation Tests for Comparing Two Populations Ferry Butar Butar, Ph.D. Jae-Wan Park Abstract Permutation tests for comparing two populations could be widely used in practice because of flexibility of

### Good luck! BUSINESS STATISTICS FINAL EXAM INSTRUCTIONS. Name:

Glo bal Leadership M BA BUSINESS STATISTICS FINAL EXAM Name: INSTRUCTIONS 1. Do not open this exam until instructed to do so. 2. Be sure to fill in your name before starting the exam. 3. You have two hours

### SPSS ADVANCED ANALYSIS WENDIANN SETHI SPRING 2011

SPSS ADVANCED ANALYSIS WENDIANN SETHI SPRING 2011 Statistical techniques to be covered Explore relationships among variables Correlation Regression/Multiple regression Logistic regression Factor analysis

### Recall this chart that showed how most of our course would be organized:

Chapter 4 One-Way ANOVA Recall this chart that showed how most of our course would be organized: Explanatory Variable(s) Response Variable Methods Categorical Categorical Contingency Tables Categorical

### Introduction to Statistics and Quantitative Research Methods

Introduction to Statistics and Quantitative Research Methods Purpose of Presentation To aid in the understanding of basic statistics, including terminology, common terms, and common statistical methods.

### CALCULATIONS & STATISTICS

CALCULATIONS & STATISTICS CALCULATION OF SCORES Conversion of 1-5 scale to 0-100 scores When you look at your report, you will notice that the scores are reported on a 0-100 scale, even though respondents

### Analysis of Variance ANOVA

Analysis of Variance ANOVA Overview We ve used the t -test to compare the means from two independent groups. Now we ve come to the final topic of the course: how to compare means from more than two populations.

### Statistics. One-two sided test, Parametric and non-parametric test statistics: one group, two groups, and more than two groups samples

Statistics One-two sided test, Parametric and non-parametric test statistics: one group, two groups, and more than two groups samples February 3, 00 Jobayer Hossain, Ph.D. & Tim Bunnell, Ph.D. Nemours

### 1 Nonparametric Statistics

1 Nonparametric Statistics When finding confidence intervals or conducting tests so far, we always described the population with a model, which includes a set of parameters. Then we could make decisions

### The Wilcoxon Rank-Sum Test

1 The Wilcoxon Rank-Sum Test The Wilcoxon rank-sum test is a nonparametric alternative to the twosample t-test which is based solely on the order in which the observations from the two samples fall. We

### Nonparametric tests these test hypotheses that are not statements about population parameters (e.g.,

CHAPTER 13 Nonparametric and Distribution-Free Statistics Nonparametric tests these test hypotheses that are not statements about population parameters (e.g., 2 tests for goodness of fit and independence).

### An introduction to IBM SPSS Statistics

An introduction to IBM SPSS Statistics Contents 1 Introduction... 1 2 Entering your data... 2 3 Preparing your data for analysis... 10 4 Exploring your data: univariate analysis... 14 5 Generating descriptive

### Linear Models in STATA and ANOVA

Session 4 Linear Models in STATA and ANOVA Page Strengths of Linear Relationships 4-2 A Note on Non-Linear Relationships 4-4 Multiple Linear Regression 4-5 Removal of Variables 4-8 Independent Samples

### Nonparametric Statistics

Nonparametric Statistics References Some good references for the topics in this course are 1. Higgins, James (2004), Introduction to Nonparametric Statistics 2. Hollander and Wolfe, (1999), Nonparametric

### Testing Group Differences using T-tests, ANOVA, and Nonparametric Measures

Testing Group Differences using T-tests, ANOVA, and Nonparametric Measures Jamie DeCoster Department of Psychology University of Alabama 348 Gordon Palmer Hall Box 870348 Tuscaloosa, AL 35487-0348 Phone:

### Post-hoc comparisons & two-way analysis of variance. Two-way ANOVA, II. Post-hoc testing for main effects. Post-hoc testing 9.

Two-way ANOVA, II Post-hoc comparisons & two-way analysis of variance 9.7 4/9/4 Post-hoc testing As before, you can perform post-hoc tests whenever there s a significant F But don t bother if it s a main

### CORRELATIONAL ANALYSIS: PEARSON S r Purpose of correlational analysis The purpose of performing a correlational analysis: To discover whether there

CORRELATIONAL ANALYSIS: PEARSON S r Purpose of correlational analysis The purpose of performing a correlational analysis: To discover whether there is a relationship between variables, To find out the

### E3: PROBABILITY AND STATISTICS lecture notes

E3: PROBABILITY AND STATISTICS lecture notes 2 Contents 1 PROBABILITY THEORY 7 1.1 Experiments and random events............................ 7 1.2 Certain event. Impossible event............................

### Introduction to Analysis of Variance (ANOVA) Limitations of the t-test

Introduction to Analysis of Variance (ANOVA) The Structural Model, The Summary Table, and the One- Way ANOVA Limitations of the t-test Although the t-test is commonly used, it has limitations Can only

### MONT 107N Understanding Randomness Solutions For Final Examination May 11, 2010

MONT 07N Understanding Randomness Solutions For Final Examination May, 00 Short Answer (a) (0) How are the EV and SE for the sum of n draws with replacement from a box computed? Solution: The EV is n times

### The correlation coefficient

The correlation coefficient Clinical Biostatistics The correlation coefficient Martin Bland Correlation coefficients are used to measure the of the relationship or association between two quantitative

### NCSS Statistical Software

Chapter 06 Introduction This procedure provides several reports for the comparison of two distributions, including confidence intervals for the difference in means, two-sample t-tests, the z-test, the

### Intro to Parametric & Nonparametric Statistics

Intro to Parametric & Nonparametric Statistics Kinds & definitions of nonparametric statistics Where parametric stats come from Consequences of parametric assumptions Organizing the models we will cover

### Independent samples t-test. Dr. Tom Pierce Radford University

Independent samples t-test Dr. Tom Pierce Radford University The logic behind drawing causal conclusions from experiments The sampling distribution of the difference between means The standard error of

### Chapter Four. Data Analyses and Presentation of the Findings

Chapter Four Data Analyses and Presentation of the Findings The fourth chapter represents the focal point of the research report. Previous chapters of the report have laid the groundwork for the project.

### Comparison of frequentist and Bayesian inference. Class 20, 18.05, Spring 2014 Jeremy Orloff and Jonathan Bloom

Comparison of frequentist and Bayesian inference. Class 20, 18.05, Spring 2014 Jeremy Orloff and Jonathan Bloom 1 Learning Goals 1. Be able to explain the difference between the p-value and a posterior

### We are often interested in the relationship between two variables. Do people with more years of full-time education earn higher salaries?

Statistics: Correlation Richard Buxton. 2008. 1 Introduction We are often interested in the relationship between two variables. Do people with more years of full-time education earn higher salaries? Do

### Introduction to Hypothesis Testing. Hypothesis Testing. Step 1: State the Hypotheses

Introduction to Hypothesis Testing 1 Hypothesis Testing A hypothesis test is a statistical procedure that uses sample data to evaluate a hypothesis about a population Hypothesis is stated in terms of the

### MEASURES OF LOCATION AND SPREAD

Paper TU04 An Overview of Non-parametric Tests in SAS : When, Why, and How Paul A. Pappas and Venita DePuy Durham, North Carolina, USA ABSTRACT Most commonly used statistical procedures are based on the

### THE KRUSKAL WALLLIS TEST

THE KRUSKAL WALLLIS TEST TEODORA H. MEHOTCHEVA Wednesday, 23 rd April 08 THE KRUSKAL-WALLIS TEST: The non-parametric alternative to ANOVA: testing for difference between several independent groups 2 NON

### Once saved, if the file was zipped you will need to unzip it. For the files that I will be posting you need to change the preferences.

1 Commands in JMP and Statcrunch Below are a set of commands in JMP and Statcrunch which facilitate a basic statistical analysis. The first part concerns commands in JMP, the second part is for analysis

### General Method: Difference of Means. 3. Calculate df: either Welch-Satterthwaite formula or simpler df = min(n 1, n 2 ) 1.

General Method: Difference of Means 1. Calculate x 1, x 2, SE 1, SE 2. 2. Combined SE = SE1 2 + SE2 2. ASSUMES INDEPENDENT SAMPLES. 3. Calculate df: either Welch-Satterthwaite formula or simpler df = min(n

### Module 5: Multiple Regression Analysis

Using Statistical Data Using to Make Statistical Decisions: Data Multiple to Make Regression Decisions Analysis Page 1 Module 5: Multiple Regression Analysis Tom Ilvento, University of Delaware, College

### Experimental Designs (revisited)

Introduction to ANOVA Copyright 2000, 2011, J. Toby Mordkoff Probably, the best way to start thinking about ANOVA is in terms of factors with levels. (I say this because this is how they are described

### Levels of measurement in psychological research:

Research Skills: Levels of Measurement. Graham Hole, February 2011 Page 1 Levels of measurement in psychological research: Psychology is a science. As such it generally involves objective measurement of

### Skewed Data and Non-parametric Methods

0 2 4 6 8 10 12 14 Skewed Data and Non-parametric Methods Comparing two groups: t-test assumes data are: 1. Normally distributed, and 2. both samples have the same SD (i.e. one sample is simply shifted

### Introduction to Regression and Data Analysis

Statlab Workshop Introduction to Regression and Data Analysis with Dan Campbell and Sherlock Campbell October 28, 2008 I. The basics A. Types of variables Your variables may take several forms, and it

### Descriptive Statistics and Measurement Scales

Descriptive Statistics 1 Descriptive Statistics and Measurement Scales Descriptive statistics are used to describe the basic features of the data in a study. They provide simple summaries about the sample

### DATA ANALYSIS. QEM Network HBCU-UP Fundamentals of Education Research Workshop Gerunda B. Hughes, Ph.D. Howard University

DATA ANALYSIS QEM Network HBCU-UP Fundamentals of Education Research Workshop Gerunda B. Hughes, Ph.D. Howard University Quantitative Research What is Statistics? Statistics (as a subject) is the science

### Permutation & Non-Parametric Tests

Permutation & Non-Parametric Tests Statistical tests Gather data to assess some hypothesis (e.g., does this treatment have an effect on this outcome?) Form a test statistic for which large values indicate

### Statistics 2014 Scoring Guidelines

AP Statistics 2014 Scoring Guidelines College Board, Advanced Placement Program, AP, AP Central, and the acorn logo are registered trademarks of the College Board. AP Central is the official online home

### Association Between Variables

Contents 11 Association Between Variables 767 11.1 Introduction............................ 767 11.1.1 Measure of Association................. 768 11.1.2 Chapter Summary.................... 769 11.2 Chi

### " Y. Notation and Equations for Regression Lecture 11/4. Notation:

Notation: Notation and Equations for Regression Lecture 11/4 m: The number of predictor variables in a regression Xi: One of multiple predictor variables. The subscript i represents any number from 1 through

### Chapter 7 Section 7.1: Inference for the Mean of a Population

Chapter 7 Section 7.1: Inference for the Mean of a Population Now let s look at a similar situation Take an SRS of size n Normal Population : N(, ). Both and are unknown parameters. Unlike what we used

### Data Analysis Tools. Tools for Summarizing Data

Data Analysis Tools This section of the notes is meant to introduce you to many of the tools that are provided by Excel under the Tools/Data Analysis menu item. If your computer does not have that tool

### Statistics Review PSY379

Statistics Review PSY379 Basic concepts Measurement scales Populations vs. samples Continuous vs. discrete variable Independent vs. dependent variable Descriptive vs. inferential stats Common analyses

### t Tests in Excel The Excel Statistical Master By Mark Harmon Copyright 2011 Mark Harmon

t-tests in Excel By Mark Harmon Copyright 2011 Mark Harmon No part of this publication may be reproduced or distributed without the express permission of the author. mark@excelmasterseries.com www.excelmasterseries.com

### Name: Date: Use the following to answer questions 3-4:

Name: Date: 1. Determine whether each of the following statements is true or false. A) The margin of error for a 95% confidence interval for the mean increases as the sample size increases. B) The margin

### X X X a) perfect linear correlation b) no correlation c) positive correlation (r = 1) (r = 0) (0 < r < 1)

CORRELATION AND REGRESSION / 47 CHAPTER EIGHT CORRELATION AND REGRESSION Correlation and regression are statistical methods that are commonly used in the medical literature to compare two or more variables.

Lecture 16: Generalized Additive Models Regression III: Advanced Methods Bill Jacoby Michigan State University http://polisci.msu.edu/jacoby/icpsr/regress3 Goals of the Lecture Introduce Additive Models