Rank-Based Non-Parametric Tests

Save this PDF as:
 WORD  PNG  TXT  JPG

Size: px
Start display at page:

Download "Rank-Based Non-Parametric Tests"

Transcription

1 Rank-Based Non-Parametric Tests

2 Reminder: Student Instructional Rating Surveys You have until May 8 th to fill out the student instructional rating surveys at https://sakai.rutgers.edu/portal/site/sirs The survey should be available on any device with a full-featured web browser. Please take the time to fill it out. Your answers: Will be anonymous Will help me to improve my teaching strategies and the structure of the course Will help the department in planning and designing future courses Will be used by the university in promotion, tenure, and reappointment decisions

3 Parametric and Nonparametric Tests Non-Parametric Tests Most of the statistical tests that we have used throughout the semester have relied on certain specific assumptions about the distribution of the involved variables and/or their means, and have been set up to test hypotheses about specific population parameters Such tests (z-tests, t-tests, ANOVAs, Pearson s correlation) are called parametric tests

4 Parametric and Nonparametric Tests Non-Parametric Tests Though these parametric tests are robust to minor violations of their assumptions, they can lead to gross systematic errors when the data are strongly violate the underlying assumptions and can even be undefined for certain types of data (e.g., nominal or non-numerical data). Certain tests do not rely on specific distributional assumptions or test hypotheses about particular population parameters. These tests are generally called nonparametric tests The chi-square tests introduced in the last lecture and Spearman s rank correlation coefficient test were examples of nonparametric tests.

5 Parametric versus Nonparametric Tests The advantages of parametric tests are that Non-Parametric Tests They are more powerful (i.e., you can detect smaller effect sizes with smaller samples) than comparable non-parametric tests when the parametric assumptions are correct (or approximately correct). The hypothesis tests are more specific and easier to interpret. The advantage of nonparametric tests are that They can be used when the distribution of the population is completely unknown They tend to be more robust to ill-behaved (e.g., non-normal, heteroscedastic, & multi-modal) data They are less sensitive to outliers They can be used with nominal and ordinal data

6 Nonparametric tests In the last 70 years or so, statisticians have developed many different nonparametric tests. Those most widely used in the behavioral sciences tend to be rank randomization tests Rank randomization (or rank-permutation) tests are hypothesis tests based on the theoretical distribution of randomly assigned ranks. As a first step, they all require the conversion of raw scores to ordinal ranks This makes them obvious candidates for ordinal data, though these data usually still need to be modified

7 Rank Randomization Tests Advantages of rank-based tests: 1. Ranks are simpler, and rank-based tests are easier to compute 2. They are largely insensitive to the particular form of the population distributions and differences between the distributions underlying the scores in different samples 3. They tend to minimize the effects of large sample variances 4. They are insensitive to outlier scores and make it easier to deal with undetermined scores (e.g., time to task completion) 5. The distribution of randomly assigned ranks can be computed exactly

8 720 permutations Sample 1 Ranks Sample 2 Ranks

9 720 permutations Sample 1 Ranks R 1 = Σr Sample 2 Ranks R 2 = Σr W s = min(r 1,R 2 )

10 Non-Parametric Tests

11 Non-Parametric Tests

12 Rank Randomization Tests Popular rank-based tests: 1. The Mann-Whitney U (or Wilcoxon rank-sum) test Nonparametric analogue to the independent-samples t-test 2. The Wilcoxon signed-rank test Nonparametric analogue to the matched-samples t-test 3. The Kruskal-Wallis test Nonparametric analogue to the one-way ANOVA (independent meas.) 4. The Friedman test Nonparametric analogue to the repeated-measures ANOVA

13 A Note about Computing Ranks All of the rank-based tests will require that you compute ranks based on the total number of scores and from lowest to highest I.e., if you have 3 samples with 5 scores each, the lowest overall score should be assigned the rank 1 and the highest overall score should be assigned the rank 15 In case of ties, each tied score should be assigned the mean of the tied ranks I.e., if the 3 rd and 4 th lowest scores have the same value then you should assign them each a rank of 3.5, with the next highest value receiving a rank of 5. If the 7 th, 8 th, and 9 th scores are all tied, then you should assign them each a rank of 8, with the next highest value receiving a rank of 10.

14 Rank Randomization Tests Aside from converting the raw scores to ranks, the logical steps are similar to those for the parametric hypothesis tests: 1. State the null and alternative hypotheses about the population. 2. Use the null hypotheses to predict the characteristics that the sample ranks should have. 3. Use the samples to compute the test statistic 4. Compare the test statistic with the hypothesis prediction

15 The Mann-Whitney Test This is a test for independent-measures (between subjects) research designs with two groups and is thus an alternative to the independent-measures t-test The basic intuition behind the test is that: A real difference between the two treatments should cause the scores in one sample to be generally larger than the scores in the other sample If all the scores are ranked, the larger ranks should be concentrated in one sample and the smaller ranks should be concentrated in the other sample.

16 The Mann-Whitney Test The null and alternative hypotheses are a bit more vague than for the t-test, but still test for some sort of difference in central tendency H 0 : There is no difference between treatments. Therefore, there is no tendency for ranks in one sample to be systematically higher or lower than in the other sample H 1 : There is a difference between treatments. Therefore, the ranks in one sample should be systematically higher or lower than in the other sample

17 The Mann-Whitney Test When comparing two samples, the Mann-Whitney U statistic for sample 1 represents the sum of the number of scores in sample 2 outranked by scores in sample 1 Treatment A Raw Scores Ranks Treatment B Raw Scores Ranks The smaller of the U values is looked up in the table

18 Example Treatment A Raw Scores Ranks Points Treatment B Raw Scores Ranks Points

19 The Mann-Whitney Test: Steps In practice, the steps for computing the test statistic (U) are: 1. Rank all the observations from smallest to largest 2. Compute the sum of the ranks in each sample, using the following formulas to compute U statistics from the ranks R: U n ( n 1 ), R1 U n ( n R ) 3. U is the smaller of the sums of these counts

20 Example Treatment A Raw Scores Ranks ΣR 1 27 Treatment B Raw Scores Ranks ΣR 2 51 U n1( n1 1) R 2 6(7)

21 U 6 n 6 n In this case, U crit = 5, so we retain the null hypothesis Note: Most tables for rank permutation statistics are set up so that you reject the null hypothesis if the value is smaller than the tabled value.

22 The Mann-Whitney Test: Normal Approximation When n 1 and n 2 are sufficiently large (e.g., n 1,n 2 10) the distribution of rank sums becomes roughly normal and you can use a normal approximation, evaluated against a critical z value, to test for significance. U U nn n n N U U zu U

23 Wilcoxon s Signed Ranks Test This is a test for repeated-measures (within-subjects) research designs with two treatment conditions and is thus an alternative to the repeated-measures t-test The basic intuition behind the test is that: A real difference between the two treatments should cause the difference scores to be generally positive or negative If all the difference scores are ranked and signed (according to whether they represent increases + or decreases -), the ranks should be concentrated in either the positive or negative set.

24 Wilcoxon s Signed Ranks Test Again, the null and alternative hypotheses are a bit more vague than for the repeated measures t-test, but test for some sort of difference in central tendency H 0 : There is no difference between treatments. Therefore, there is no tendency for the ranks of difference scores to be generally positive or negative H 1 : There is a difference between treatments. Therefore, the ranks of the difference scores should be systematically positive or negative

25 Wilcoxon s Signed Rank Test: Steps The steps for computing the test statistic (T) are: 1. Compute the difference scores Non-Parametric Tests 2. Rank all the difference scores from smallest to largest absolute value and assign them positive or negative signs based on whether they represent an increment or decrement 3. Compute separate sums for the positively and negatively signed sets 4. T is the smaller of the resulting signed-rank-sums

26 Example (Suddath et al., 1990)

27 Example T = 9 N = 15 T crit is 25, which is greater than our test statistic, so we would reject the null hypothesis

28 Wilcoxon s Signed Ranks Test: Normal Approximation Again, when n is sufficiently large (e.g., n 20) the distribution of T becomes roughly normal and you can use a normal approximation, evaluated against a critical z value, to test for significance. T T n n1 4 n( n 1)(2n 2) 24 zt T T T n n1 T 4 n( n 1)(2n 1) 24

29 The Kruskal-Wallis One Way ANOVA Non-Parametric Tests This is a test for independent-measures research designs with more than two groups. As its name suggests, it is a nonparametric alternative to the parametric one-way ANOVA The basic intuition behind the test is analogous to that for the parametric one-way ANOVA: A real difference among treatments should cause the variability of scores between groups to be greater than the variability of scores within groups If all the scores are ranked the variability of rank-sums between groups should be greater than the variability of rank-sums within groups

30 The Kruskal-Wallis One Way ANOVA Non-Parametric Tests The null and alternative hypotheses are very similar to those in the parametric one-way ANOVA. H 0 : There is no difference between treatments. There is no tendency for ranks in any sample to be systematically higher or lower than in any other condition. H 1 : There are differences between treatments. The ranks in at least one condition are systematically higher or lower than in another treatment condition

31 Non-Parametric Tests k i k n i j i i T ij i n M M F C x M k T i k n T i i i j j i r r r n r H C Parametric ANOVA: Kruskal-Wallis: 1 1 within between df N k C df k 2 1 C N Comparison of Conceptual Formulas for the Parametric one-way ANOVA and Kruskal-Wallis Test:

32 The Kruskal-Wallis Test: Steps The steps for computing the test statistic (H) are: 1. Rank all scores from lowest to highest across all samples 2. Compute R, the sum of ranks in each sample 3. Plug into the following formula to solve for H: H 2 12 R i 3 N 1 N N n 1 i i

33 The Kruskal-Wallis Test: Normal Approximation As in the other rank-randomization tests, when N is sufficiently large, the distribution of rank-sums becomes approximately normal H is a linear combination (a weighted sum) of squared-rank sums, which means that it can be approximated by the distribution of a sum of squared normal variables For this reason, the significance of H is usually evaluated using a chi-squared distribution with k-1 degrees of freedom.

34 Friedman s Rank Test This is a test for repeated-measures research designs with more than two groups. It is the non-parametric analogue to a one-way repeated-measures ANOVA Just as the repeated measures ANOVA tests for consistent changes between individuals across treatment groups, Friedman s test looks for consistent rankings between individuals across treatment groups It can be used with any repeated-measures data, but is especially useful for measuring inter-rater agreement for rankings

35 The Friedman Test The null and alternative hypotheses are identical to those for the Kruskal-Wallis Test. H 0 : There is no difference between treatments. There is no tendency for ranks in any sample to be systematically higher or lower than in any other condition. H 1 : There are differences between treatments. The ranks in at least one condition are systematically higher or lower than in another treatment condition

36 The Friedman Test: Steps 2 The steps for computing the test statistic ( R ) are: 1. Rank scores across each treatment group for each individual 2. Compute R, the sum of ranks for each group 3. Plug into the following formula to compute the test statistic: 12 ( k 1) R 3 n( k 1) 2 k 2 R i nk( k 1) i

37 Friedman Test Example Sommelier Wine 1 Wine 2 Wine 3 A B C D E F G R (2) 3 n( k 1) k 2 2 R Ri nk( k 1) i 12 7(3)(4) (7)(4)

38 χ 2 Distribution Upper Tail Probability df

39 Friedman Test Example Sommelier Wine 1 Wine 2 Wine 3 A B C D E F G R (2) 3 n( k 1) k 2 2 R Ri nk( k 1) i 12 7(3)(4) (7)(4) crit 5.99, retain H 0 In this case, we would conclude that there is no significant difference in quality between the 3 wines or that the sommeliers are unable to discern any differences.

3. Nonparametric methods

3. Nonparametric methods 3. Nonparametric methods If the probability distributions of the statistical variables are unknown or are not as required (e.g. normality assumption violated), then we may still apply nonparametric tests

More information

Module 9: Nonparametric Tests. The Applied Research Center

Module 9: Nonparametric Tests. The Applied Research Center Module 9: Nonparametric Tests The Applied Research Center Module 9 Overview } Nonparametric Tests } Parametric vs. Nonparametric Tests } Restrictions of Nonparametric Tests } One-Sample Chi-Square Test

More information

Research Methods 1 Handouts, Graham Hole,COGS - version 1.0, September 2000: Page 1:

Research Methods 1 Handouts, Graham Hole,COGS - version 1.0, September 2000: Page 1: Research Methods 1 Handouts, Graham Hole,COGS - version 1.0, September 000: Page 1: NON-PARAMETRIC TESTS: What are non-parametric tests? Statistical tests fall into two kinds: parametric tests assume that

More information

Chapter 3: Nonparametric Tests

Chapter 3: Nonparametric Tests B. Weaver (15-Feb-00) Nonparametric Tests... 1 Chapter 3: Nonparametric Tests 3.1 Introduction Nonparametric, or distribution free tests are so-called because the assumptions underlying their use are fewer

More information

Study Guide for the Final Exam

Study Guide for the Final Exam Study Guide for the Final Exam When studying, remember that the computational portion of the exam will only involve new material (covered after the second midterm), that material from Exam 1 will make

More information

Nonparametric Statistics

Nonparametric Statistics 1 14.1 Using the Binomial Table Nonparametric Statistics In this chapter, we will survey several methods of inference from Nonparametric Statistics. These methods will introduce us to several new tables

More information

UNIVERSITY OF NAIROBI

UNIVERSITY OF NAIROBI UNIVERSITY OF NAIROBI MASTERS IN PROJECT PLANNING AND MANAGEMENT NAME: SARU CAROLYNN ELIZABETH REGISTRATION NO: L50/61646/2013 COURSE CODE: LDP 603 COURSE TITLE: RESEARCH METHODS LECTURER: GAKUU CHRISTOPHER

More information

Supplement on the Kruskal-Wallis test. So what do you do if you don t meet the assumptions of an ANOVA?

Supplement on the Kruskal-Wallis test. So what do you do if you don t meet the assumptions of an ANOVA? Supplement on the Kruskal-Wallis test So what do you do if you don t meet the assumptions of an ANOVA? {There are other ways of dealing with things like unequal variances and non-normal data, but we won

More information

Non-Parametric Tests (I)

Non-Parametric Tests (I) Lecture 5: Non-Parametric Tests (I) KimHuat LIM lim@stats.ox.ac.uk http://www.stats.ox.ac.uk/~lim/teaching.html Slide 1 5.1 Outline (i) Overview of Distribution-Free Tests (ii) Median Test for Two Independent

More information

Overview of Non-Parametric Statistics PRESENTER: ELAINE EISENBEISZ OWNER AND PRINCIPAL, OMEGA STATISTICS

Overview of Non-Parametric Statistics PRESENTER: ELAINE EISENBEISZ OWNER AND PRINCIPAL, OMEGA STATISTICS Overview of Non-Parametric Statistics PRESENTER: ELAINE EISENBEISZ OWNER AND PRINCIPAL, OMEGA STATISTICS About Omega Statistics Private practice consultancy based in Southern California, Medical and Clinical

More information

Analysis of numerical data S4

Analysis of numerical data S4 Basic medical statistics for clinical and experimental research Analysis of numerical data S4 Katarzyna Jóźwiak k.jozwiak@nki.nl 3rd November 2015 1/42 Hypothesis tests: numerical and ordinal data 1 group:

More information

NONPARAMETRIC STATISTICS 1. depend on assumptions about the underlying distribution of the data (or on the Central Limit Theorem)

NONPARAMETRIC STATISTICS 1. depend on assumptions about the underlying distribution of the data (or on the Central Limit Theorem) NONPARAMETRIC STATISTICS 1 PREVIOUSLY parametric statistics in estimation and hypothesis testing... construction of confidence intervals computing of p-values classical significance testing depend on assumptions

More information

QUANTITATIVE METHODS BIOLOGY FINAL HONOUR SCHOOL NON-PARAMETRIC TESTS

QUANTITATIVE METHODS BIOLOGY FINAL HONOUR SCHOOL NON-PARAMETRIC TESTS QUANTITATIVE METHODS BIOLOGY FINAL HONOUR SCHOOL NON-PARAMETRIC TESTS This booklet contains lecture notes for the nonparametric work in the QM course. This booklet may be online at http://users.ox.ac.uk/~grafen/qmnotes/index.html.

More information

Variables and Data A variable contains data about anything we measure. For example; age or gender of the participants or their score on a test.

Variables and Data A variable contains data about anything we measure. For example; age or gender of the participants or their score on a test. The Analysis of Research Data The design of any project will determine what sort of statistical tests you should perform on your data and how successful the data analysis will be. For example if you decide

More information

EPS 625 INTERMEDIATE STATISTICS FRIEDMAN TEST

EPS 625 INTERMEDIATE STATISTICS FRIEDMAN TEST EPS 625 INTERMEDIATE STATISTICS The Friedman test is an extension of the Wilcoxon test. The Wilcoxon test can be applied to repeated-measures data if participants are assessed on two occasions or conditions

More information

Research Methodology: Tools

Research Methodology: Tools MSc Business Administration Research Methodology: Tools Applied Data Analysis (with SPSS) Lecture 11: Nonparametric Methods May 2014 Prof. Dr. Jürg Schwarz Lic. phil. Heidi Bruderer Enzler Contents Slide

More information

SPSS Tests for Versions 9 to 13

SPSS Tests for Versions 9 to 13 SPSS Tests for Versions 9 to 13 Chapter 2 Descriptive Statistic (including median) Choose Analyze Descriptive statistics Frequencies... Click on variable(s) then press to move to into Variable(s): list

More information

1 Nonparametric Statistics

1 Nonparametric Statistics 1 Nonparametric Statistics When finding confidence intervals or conducting tests so far, we always described the population with a model, which includes a set of parameters. Then we could make decisions

More information

THE KRUSKAL WALLLIS TEST

THE KRUSKAL WALLLIS TEST THE KRUSKAL WALLLIS TEST TEODORA H. MEHOTCHEVA Wednesday, 23 rd April 08 THE KRUSKAL-WALLIS TEST: The non-parametric alternative to ANOVA: testing for difference between several independent groups 2 NON

More information

Non-parametric tests I

Non-parametric tests I Non-parametric tests I Objectives Mann-Whitney Wilcoxon Signed Rank Relation of Parametric to Non-parametric tests 1 the problem Our testing procedures thus far have relied on assumptions of independence,

More information

Chapter 21 Section D

Chapter 21 Section D Chapter 21 Section D Statistical Tests for Ordinal Data The rank-sum test. You can perform the rank-sum test in SPSS by selecting 2 Independent Samples from the Analyze/ Nonparametric Tests menu. The first

More information

SPSS Explore procedure

SPSS Explore procedure SPSS Explore procedure One useful function in SPSS is the Explore procedure, which will produce histograms, boxplots, stem-and-leaf plots and extensive descriptive statistics. To run the Explore procedure,

More information

SCHOOL OF HEALTH AND HUMAN SCIENCES DON T FORGET TO RECODE YOUR MISSING VALUES

SCHOOL OF HEALTH AND HUMAN SCIENCES DON T FORGET TO RECODE YOUR MISSING VALUES SCHOOL OF HEALTH AND HUMAN SCIENCES Using SPSS Topics addressed today: 1. Differences between groups 2. Graphing Use the s4data.sav file for the first part of this session. DON T FORGET TO RECODE YOUR

More information

Some Critical Information about SOME Statistical Tests and Measures of Correlation/Association

Some Critical Information about SOME Statistical Tests and Measures of Correlation/Association Some Critical Information about SOME Statistical Tests and Measures of Correlation/Association This information is adapted from and draws heavily on: Sheskin, David J. 2000. Handbook of Parametric and

More information

Intro to Parametric & Nonparametric Statistics

Intro to Parametric & Nonparametric Statistics Intro to Parametric & Nonparametric Statistics Kinds & definitions of nonparametric statistics Where parametric stats come from Consequences of parametric assumptions Organizing the models we will cover

More information

Inferential Statistics

Inferential Statistics Inferential Statistics Sampling and the normal distribution Z-scores Confidence levels and intervals Hypothesis testing Commonly used statistical methods Inferential Statistics Descriptive statistics are

More information

ANSWERS TO EXERCISES AND REVIEW QUESTIONS

ANSWERS TO EXERCISES AND REVIEW QUESTIONS ANSWERS TO EXERCISES AND REVIEW QUESTIONS PART FIVE: STATISTICAL TECHNIQUES TO COMPARE GROUPS Before attempting these questions read through the introduction to Part Five and Chapters 16-21 of the SPSS

More information

CHAPTER 12 TESTING DIFFERENCES WITH ORDINAL DATA: MANN WHITNEY U

CHAPTER 12 TESTING DIFFERENCES WITH ORDINAL DATA: MANN WHITNEY U CHAPTER 12 TESTING DIFFERENCES WITH ORDINAL DATA: MANN WHITNEY U Previous chapters of this text have explained the procedures used to test hypotheses using interval data (t-tests and ANOVA s) and nominal

More information

Nonparametric Statistics

Nonparametric Statistics Nonparametric Statistics References Some good references for the topics in this course are 1. Higgins, James (2004), Introduction to Nonparametric Statistics 2. Hollander and Wolfe, (1999), Nonparametric

More information

Nonparametric and Distribution- Free Statistical Tests

Nonparametric and Distribution- Free Statistical Tests 20 Nonparametric and Distribution- Free Statistical Tests Concepts that you will need to remember from previous chapters SS total, SS group, SS error : Sums of squares of all scores, of group means, and

More information

Nonparametric tests these test hypotheses that are not statements about population parameters (e.g.,

Nonparametric tests these test hypotheses that are not statements about population parameters (e.g., CHAPTER 13 Nonparametric and Distribution-Free Statistics Nonparametric tests these test hypotheses that are not statements about population parameters (e.g., 2 tests for goodness of fit and independence).

More information

Research Methods & Experimental Design

Research Methods & Experimental Design Research Methods & Experimental Design 16.422 Human Supervisory Control April 2004 Research Methods Qualitative vs. quantitative Understanding the relationship between objectives (research question) and

More information

Nonparametric Test Procedures

Nonparametric Test Procedures Nonparametric Test Procedures 1 Introduction to Nonparametrics Nonparametric tests do not require that samples come from populations with normal distributions or any other specific distribution. Hence

More information

Applications of Intermediate/Advanced Statistics in Institutional Research

Applications of Intermediate/Advanced Statistics in Institutional Research Applications of Intermediate/Advanced Statistics in Institutional Research Edited by Mary Ann Coughlin THE ASSOCIATION FOR INSTITUTIONAL RESEARCH Number Sixteen Resources in Institional Research 2005 Association

More information

CHAPTER 11 CHI-SQUARE: NON-PARAMETRIC COMPARISONS OF FREQUENCY

CHAPTER 11 CHI-SQUARE: NON-PARAMETRIC COMPARISONS OF FREQUENCY CHAPTER 11 CHI-SQUARE: NON-PARAMETRIC COMPARISONS OF FREQUENCY The hypothesis testing statistics detailed thus far in this text have all been designed to allow comparison of the means of two or more samples

More information

The Statistics Tutor s

The Statistics Tutor s statstutor community project encouraging academics to share statistics support resources All stcp resources are released under a Creative Commons licence Stcp-marshallowen-7 The Statistics Tutor s www.statstutor.ac.uk

More information

Data Analysis. Lecture Empirical Model Building and Methods (Empirische Modellbildung und Methoden) SS Analysis of Experiments - Introduction

Data Analysis. Lecture Empirical Model Building and Methods (Empirische Modellbildung und Methoden) SS Analysis of Experiments - Introduction Data Analysis Lecture Empirical Model Building and Methods (Empirische Modellbildung und Methoden) Prof. Dr. Dr. h.c. Dieter Rombach Dr. Andreas Jedlitschka SS 2014 Analysis of Experiments - Introduction

More information

Come scegliere un test statistico

Come scegliere un test statistico Come scegliere un test statistico Estratto dal Capitolo 37 of Intuitive Biostatistics (ISBN 0-19-508607-4) by Harvey Motulsky. Copyright 1995 by Oxfd University Press Inc. (disponibile in Iinternet) Table

More information

Statistics. One-two sided test, Parametric and non-parametric test statistics: one group, two groups, and more than two groups samples

Statistics. One-two sided test, Parametric and non-parametric test statistics: one group, two groups, and more than two groups samples Statistics One-two sided test, Parametric and non-parametric test statistics: one group, two groups, and more than two groups samples February 3, 00 Jobayer Hossain, Ph.D. & Tim Bunnell, Ph.D. Nemours

More information

Post-hoc comparisons & two-way analysis of variance. Two-way ANOVA, II. Post-hoc testing for main effects. Post-hoc testing 9.

Post-hoc comparisons & two-way analysis of variance. Two-way ANOVA, II. Post-hoc testing for main effects. Post-hoc testing 9. Two-way ANOVA, II Post-hoc comparisons & two-way analysis of variance 9.7 4/9/4 Post-hoc testing As before, you can perform post-hoc tests whenever there s a significant F But don t bother if it s a main

More information

CHAPTER 14 NONPARAMETRIC TESTS

CHAPTER 14 NONPARAMETRIC TESTS CHAPTER 14 NONPARAMETRIC TESTS Everything that we have done up until now in statistics has relied heavily on one major fact: that our data is normally distributed. We have been able to make inferences

More information

Nonparametric Statistics

Nonparametric Statistics Nonparametric Statistics J. Lozano University of Goettingen Department of Genetic Epidemiology Interdisciplinary PhD Program in Applied Statistics & Empirical Methods Graduate Seminar in Applied Statistics

More information

1.5 Oneway Analysis of Variance

1.5 Oneway Analysis of Variance Statistics: Rosie Cornish. 200. 1.5 Oneway Analysis of Variance 1 Introduction Oneway analysis of variance (ANOVA) is used to compare several means. This method is often used in scientific or medical experiments

More information

Descriptive Statistics

Descriptive Statistics Descriptive Statistics Primer Descriptive statistics Central tendency Variation Relative position Relationships Calculating descriptive statistics Descriptive Statistics Purpose to describe or summarize

More information

Non-Parametric Two-Sample Analysis: The Mann-Whitney U Test

Non-Parametric Two-Sample Analysis: The Mann-Whitney U Test Non-Parametric Two-Sample Analysis: The Mann-Whitney U Test When samples do not meet the assumption of normality parametric tests should not be used. To overcome this problem, non-parametric tests can

More information

Analysis of Data. Organizing Data Files in SPSS. Descriptive Statistics

Analysis of Data. Organizing Data Files in SPSS. Descriptive Statistics Analysis of Data Claudia J. Stanny PSY 67 Research Design Organizing Data Files in SPSS All data for one subject entered on the same line Identification data Between-subjects manipulations: variable to

More information

MASTER COURSE SYLLABUS-PROTOTYPE PSYCHOLOGY 2317 STATISTICAL METHODS FOR THE BEHAVIORAL SCIENCES

MASTER COURSE SYLLABUS-PROTOTYPE PSYCHOLOGY 2317 STATISTICAL METHODS FOR THE BEHAVIORAL SCIENCES MASTER COURSE SYLLABUS-PROTOTYPE THE PSYCHOLOGY DEPARTMENT VALUES ACADEMIC FREEDOM AND THUS OFFERS THIS MASTER SYLLABUS-PROTOTYPE ONLY AS A GUIDE. THE INSTRUCTORS ARE FREE TO ADAPT THEIR COURSE SYLLABI

More information

Statistiek I. Nonparametric Tests. John Nerbonne. CLCG, Rijksuniversiteit Groningen.

Statistiek I. Nonparametric Tests. John Nerbonne. CLCG, Rijksuniversiteit Groningen. Statistiek I Nonparametric Tests John Nerbonne CLCG, Rijksuniversiteit Groningen http://www.let.rug.nl/nerbonne/teach/statistiek-i/ John Nerbonne 1/36 Overview 1 Mann-Whitney U-Test 2 Wilcoxon s Signed

More information

Chapter 16 Appendix. Nonparametric Tests with Excel, JMP, Minitab, SPSS, CrunchIt!, R, and TI-83-/84 Calculators

Chapter 16 Appendix. Nonparametric Tests with Excel, JMP, Minitab, SPSS, CrunchIt!, R, and TI-83-/84 Calculators The Wilcoxon Rank Sum Test Chapter 16 Appendix Nonparametric Tests with Excel, JMP, Minitab, SPSS, CrunchIt!, R, and TI-83-/84 Calculators These nonparametric tests make no assumption about Normality.

More information

UNDERSTANDING THE ONE-WAY ANOVA

UNDERSTANDING THE ONE-WAY ANOVA UNDERSTANDING The One-way Analysis of Variance (ANOVA) is a procedure for testing the hypothesis that K population means are equal, where K >. The One-way ANOVA compares the means of the samples or groups

More information

SPSS ADVANCED ANALYSIS WENDIANN SETHI SPRING 2011

SPSS ADVANCED ANALYSIS WENDIANN SETHI SPRING 2011 SPSS ADVANCED ANALYSIS WENDIANN SETHI SPRING 2011 Statistical techniques to be covered Explore relationships among variables Correlation Regression/Multiple regression Logistic regression Factor analysis

More information

Hypothesis Testing Level I Quantitative Methods. IFT Notes for the CFA exam

Hypothesis Testing Level I Quantitative Methods. IFT Notes for the CFA exam Hypothesis Testing 2014 Level I Quantitative Methods IFT Notes for the CFA exam Contents 1. Introduction... 3 2. Hypothesis Testing... 3 3. Hypothesis Tests Concerning the Mean... 10 4. Hypothesis Tests

More information

Lecture 7: Binomial Test, Chisquare

Lecture 7: Binomial Test, Chisquare Lecture 7: Binomial Test, Chisquare Test, and ANOVA May, 01 GENOME 560, Spring 01 Goals ANOVA Binomial test Chi square test Fisher s exact test Su In Lee, CSE & GS suinlee@uw.edu 1 Whirlwind Tour of One/Two

More information

Contents 1. Contents

Contents 1. Contents Contents 1 Contents 3 K-sample Methods 2 3.1 Setup............................ 2 3.2 Classic Method Based on Normality Assumption..... 3 3.3 Permutation F -test.................... 5 3.4 Kruskal-Wallis

More information

Parametric and non-parametric statistical methods for the life sciences - Session I

Parametric and non-parametric statistical methods for the life sciences - Session I Why nonparametric methods What test to use? Rank Tests Parametric and non-parametric statistical methods for the life sciences - Session I Liesbeth Bruckers Geert Molenberghs Interuniversity Institute

More information

Nonparametric Two-Sample Tests. Nonparametric Tests. Sign Test

Nonparametric Two-Sample Tests. Nonparametric Tests. Sign Test Nonparametric Two-Sample Tests Sign test Mann-Whitney U-test (a.k.a. Wilcoxon two-sample test) Kolmogorov-Smirnov Test Wilcoxon Signed-Rank Test Tukey-Duckworth Test 1 Nonparametric Tests Recall, nonparametric

More information

Quantitative Data Analysis: Choosing a statistical test Prepared by the Office of Planning, Assessment, Research and Quality

Quantitative Data Analysis: Choosing a statistical test Prepared by the Office of Planning, Assessment, Research and Quality Quantitative Data Analysis: Choosing a statistical test Prepared by the Office of Planning, Assessment, Research and Quality 1 To help choose which type of quantitative data analysis to use either before

More information

PRESIDENTIAL SURNAMES: A NONRANDOM SEQUENCE?

PRESIDENTIAL SURNAMES: A NONRANDOM SEQUENCE? CHAPTER 14 Nonparametric Methods PRESIDENTIAL SURNAMES: A NONRANDOM SEQUENCE? Girl Ray/Getty Images In a series of numbers, names, or other data, is it possible that the series might exhibit some nonrandom

More information

Comparing Means in Two Populations

Comparing Means in Two Populations Comparing Means in Two Populations Overview The previous section discussed hypothesis testing when sampling from a single population (either a single mean or two means from the same population). Now we

More information

Testing Group Differences using T-tests, ANOVA, and Nonparametric Measures

Testing Group Differences using T-tests, ANOVA, and Nonparametric Measures Testing Group Differences using T-tests, ANOVA, and Nonparametric Measures Jamie DeCoster Department of Psychology University of Alabama 348 Gordon Palmer Hall Box 870348 Tuscaloosa, AL 35487-0348 Phone:

More information

INTERPRETING THE ONE-WAY ANALYSIS OF VARIANCE (ANOVA)

INTERPRETING THE ONE-WAY ANALYSIS OF VARIANCE (ANOVA) INTERPRETING THE ONE-WAY ANALYSIS OF VARIANCE (ANOVA) As with other parametric statistics, we begin the one-way ANOVA with a test of the underlying assumptions. Our first assumption is the assumption of

More information

Tests of relationships between variables Chi-square Test Binomial Test Run Test for Randomness One-Sample Kolmogorov-Smirnov Test.

Tests of relationships between variables Chi-square Test Binomial Test Run Test for Randomness One-Sample Kolmogorov-Smirnov Test. N. Uttam Singh, Aniruddha Roy & A. K. Tripathi ICAR Research Complex for NEH Region, Umiam, Meghalaya uttamba@gmail.com, aniruddhaubkv@gmail.com, aktripathi2020@yahoo.co.in Non Parametric Tests: Hands

More information

T-test & factor analysis

T-test & factor analysis Parametric tests T-test & factor analysis Better than non parametric tests Stringent assumptions More strings attached Assumes population distribution of sample is normal Major problem Alternatives Continue

More information

Difference tests (2): nonparametric

Difference tests (2): nonparametric NST 1B Experimental Psychology Statistics practical 3 Difference tests (): nonparametric Rudolf Cardinal & Mike Aitken 10 / 11 February 005; Department of Experimental Psychology University of Cambridge

More information

Deciding which statistical test to use:

Deciding which statistical test to use: Deciding which statistical test to use: (b) Parametric tests: z-scores (one score compared against the distribution of scores to which it belongs) Relationship between two IV s - Pearson s r (correlation

More information

Non-parametric Tests and some data from aphasic speakers

Non-parametric Tests and some data from aphasic speakers Non-parametric Tests and some data from aphasic speakers Vasiliki Koukoulioti Seminar Methodology and Statistics 19th March 2008 Some facts about non-parametric tests When to use non-parametric tests?

More information

Outline of Topics. Statistical Methods I. Types of Data. Descriptive Statistics

Outline of Topics. Statistical Methods I. Types of Data. Descriptive Statistics Statistical Methods I Tamekia L. Jones, Ph.D. (tjones@cog.ufl.edu) Research Assistant Professor Children s Oncology Group Statistics & Data Center Department of Biostatistics Colleges of Medicine and Public

More information

Biodiversity Data Analysis: Testing Statistical Hypotheses By Joanna Weremijewicz, Simeon Yurek, Steven Green, Ph. D. and Dana Krempels, Ph. D.

Biodiversity Data Analysis: Testing Statistical Hypotheses By Joanna Weremijewicz, Simeon Yurek, Steven Green, Ph. D. and Dana Krempels, Ph. D. Biodiversity Data Analysis: Testing Statistical Hypotheses By Joanna Weremijewicz, Simeon Yurek, Steven Green, Ph. D. and Dana Krempels, Ph. D. In biological science, investigators often collect biological

More information

The Dummy s Guide to Data Analysis Using SPSS

The Dummy s Guide to Data Analysis Using SPSS The Dummy s Guide to Data Analysis Using SPSS Mathematics 57 Scripps College Amy Gamble April, 2001 Amy Gamble 4/30/01 All Rights Rerserved TABLE OF CONTENTS PAGE Helpful Hints for All Tests...1 Tests

More information

Analysis of Questionnaires and Qualitative Data Non-parametric Tests

Analysis of Questionnaires and Qualitative Data Non-parametric Tests Analysis of Questionnaires and Qualitative Data Non-parametric Tests JERZY STEFANOWSKI Instytut Informatyki Politechnika Poznańska Lecture SE 2013, Poznań Recalling Basics Measurment Scales Four scales

More information

THE UNIVERSITY OF TEXAS AT TYLER COLLEGE OF NURSING COURSE SYLLABUS NURS 5317 STATISTICS FOR HEALTH PROVIDERS. Fall 2013

THE UNIVERSITY OF TEXAS AT TYLER COLLEGE OF NURSING COURSE SYLLABUS NURS 5317 STATISTICS FOR HEALTH PROVIDERS. Fall 2013 THE UNIVERSITY OF TEXAS AT TYLER COLLEGE OF NURSING 1 COURSE SYLLABUS NURS 5317 STATISTICS FOR HEALTH PROVIDERS Fall 2013 & Danice B. Greer, Ph.D., RN, BC dgreer@uttyler.edu Office BRB 1115 (903) 565-5766

More information

13: Additional ANOVA Topics. Post hoc Comparisons

13: Additional ANOVA Topics. Post hoc Comparisons 13: Additional ANOVA Topics Post hoc Comparisons ANOVA Assumptions Assessing Group Variances When Distributional Assumptions are Severely Violated Kruskal-Wallis Test Post hoc Comparisons In the prior

More information

How to choose a statistical test. Francisco J. Candido dos Reis DGO-FMRP University of São Paulo

How to choose a statistical test. Francisco J. Candido dos Reis DGO-FMRP University of São Paulo How to choose a statistical test Francisco J. Candido dos Reis DGO-FMRP University of São Paulo Choosing the right test One of the most common queries in stats support is Which analysis should I use There

More information

Statistics: revision

Statistics: revision NST 1B Experimental Psychology Statistics practical 5 Statistics: revision Rudolf Cardinal & Mike Aitken 3 / 4 May 2005 Department of Experimental Psychology University of Cambridge Slides at pobox.com/~rudolf/psychology

More information

Using Excel for inferential statistics

Using Excel for inferential statistics FACT SHEET Using Excel for inferential statistics Introduction When you collect data, you expect a certain amount of variation, just caused by chance. A wide variety of statistical tests can be applied

More information

Nonparametric tests, Bootstrapping

Nonparametric tests, Bootstrapping Nonparametric tests, Bootstrapping http://www.isrec.isb-sib.ch/~darlene/embnet/ Hypothesis testing review 2 competing theories regarding a population parameter: NULL hypothesis H ( straw man ) ALTERNATIVEhypothesis

More information

CREIGHTON UNIVERSITY GRADUATE COLLEGE Fall Semester 2014. Biostatistics & Analysis of Clinical Data for Evidence-based Practice

CREIGHTON UNIVERSITY GRADUATE COLLEGE Fall Semester 2014. Biostatistics & Analysis of Clinical Data for Evidence-based Practice CREIGHTON UNIVERSITY GRADUATE COLLEGE Fall Semester 2014 Course Number: Course Title: Credit Allocation: Placement: CTS 601 Biostatistics & Analysis of Clinical Data for Evidence-based Practice 3 semester

More information

Statistical tests for SPSS

Statistical tests for SPSS Statistical tests for SPSS Paolo Coletti A.Y. 2010/11 Free University of Bolzano Bozen Premise This book is a very quick, rough and fast description of statistical tests and their usage. It is explicitly

More information

ANOVA MULTIPLE CHOICE QUESTIONS. In the following multiple-choice questions, select the best answer.

ANOVA MULTIPLE CHOICE QUESTIONS. In the following multiple-choice questions, select the best answer. ANOVA MULTIPLE CHOICE QUESTIONS In the following multiple-choice questions, select the best answer. 1. Analysis of variance is a statistical method of comparing the of several populations. a. standard

More information

Permutation Tests for Comparing Two Populations

Permutation Tests for Comparing Two Populations Permutation Tests for Comparing Two Populations Ferry Butar Butar, Ph.D. Jae-Wan Park Abstract Permutation tests for comparing two populations could be widely used in practice because of flexibility of

More information

Types of Data, Descriptive Statistics, and Statistical Tests for Nominal Data. Patrick F. Smith, Pharm.D. University at Buffalo Buffalo, New York

Types of Data, Descriptive Statistics, and Statistical Tests for Nominal Data. Patrick F. Smith, Pharm.D. University at Buffalo Buffalo, New York Types of Data, Descriptive Statistics, and Statistical Tests for Nominal Data Patrick F. Smith, Pharm.D. University at Buffalo Buffalo, New York . NONPARAMETRIC STATISTICS I. DEFINITIONS A. Parametric

More information

Describe what is meant by a placebo Contrast the double-blind procedure with the single-blind procedure Review the structure for organizing a memo

Describe what is meant by a placebo Contrast the double-blind procedure with the single-blind procedure Review the structure for organizing a memo Readings: Ha and Ha Textbook - Chapters 1 8 Appendix D & E (online) Plous - Chapters 10, 11, 12 and 14 Chapter 10: The Representativeness Heuristic Chapter 11: The Availability Heuristic Chapter 12: Probability

More information

Statistics for Sports Medicine

Statistics for Sports Medicine Statistics for Sports Medicine Suzanne Hecht, MD University of Minnesota (suzanne.hecht@gmail.com) Fellow s Research Conference July 2012: Philadelphia GOALS Try not to bore you to death!! Try to teach

More information

Chi-Square P216; 269

Chi-Square P216; 269 Chi-Square P16; 69 Confidence intervals CI: % confident that interval contains population mean (µ) % is determined by researcher (e.g. 85, 90, 95%) Formula for z-test and t-test: CI = M +/- z*(σ M ) CI

More information

SPSS 3: COMPARING MEANS

SPSS 3: COMPARING MEANS SPSS 3: COMPARING MEANS UNIVERSITY OF GUELPH LUCIA COSTANZO lcostanz@uoguelph.ca REVISED SEPTEMBER 2012 CONTENTS SPSS availability... 2 Goals of the workshop... 2 Data for SPSS Sessions... 3 Statistical

More information

Develop hypothesis and then research to find out if it is true. Derived from theory or primary question/research questions

Develop hypothesis and then research to find out if it is true. Derived from theory or primary question/research questions Chapter 12 Hypothesis Testing Learning Objectives Examine the process of hypothesis testing Evaluate research and null hypothesis Determine one- or two-tailed tests Understand obtained values, significance,

More information

DEPARTMENT OF HEALTH AND HUMAN SCIENCES HS900 RESEARCH METHODS

DEPARTMENT OF HEALTH AND HUMAN SCIENCES HS900 RESEARCH METHODS DEPARTMENT OF HEALTH AND HUMAN SCIENCES HS900 RESEARCH METHODS Using SPSS Session 2 Topics addressed today: 1. Recoding data missing values, collapsing categories 2. Making a simple scale 3. Standardisation

More information

The Wilcoxon Rank-Sum Test

The Wilcoxon Rank-Sum Test 1 The Wilcoxon Rank-Sum Test The Wilcoxon rank-sum test is a nonparametric alternative to the twosample t-test which is based solely on the order in which the observations from the two samples fall. We

More information

Comparing two groups (t tests...)

Comparing two groups (t tests...) Page 1 of 33 Comparing two groups (t tests...) You've measured a variable in two groups, and the means (and medians) are distinct. Is that due to chance? Or does it tell you the two groups are really different?

More information

Applied Statistics Handbook

Applied Statistics Handbook Applied Statistics Handbook Phil Crewson Version 1. Applied Statistics Handbook Copyright 006, AcaStat Software. All rights Reserved. http://www.acastat.com Protected under U.S. Copyright and international

More information

NCSS Statistical Software. One-Sample T-Test

NCSS Statistical Software. One-Sample T-Test Chapter 205 Introduction This procedure provides several reports for making inference about a population mean based on a single sample. These reports include confidence intervals of the mean or median,

More information

Permutation & Non-Parametric Tests

Permutation & Non-Parametric Tests Permutation & Non-Parametric Tests Statistical tests Gather data to assess some hypothesis (e.g., does this treatment have an effect on this outcome?) Form a test statistic for which large values indicate

More information

Choosing the correct statistical test made easy

Choosing the correct statistical test made easy Classroom Choosing the correct statistical test made easy N Gunawardana Senior Lecturer in Community Medicine, Faculty of Medicine, University of Colombo Gone are the days where researchers had to perform

More information

CHAPTER 14 ORDINAL MEASURES OF CORRELATION: SPEARMAN'S RHO AND GAMMA

CHAPTER 14 ORDINAL MEASURES OF CORRELATION: SPEARMAN'S RHO AND GAMMA CHAPTER 14 ORDINAL MEASURES OF CORRELATION: SPEARMAN'S RHO AND GAMMA Chapter 13 introduced the concept of correlation statistics and explained the use of Pearson's Correlation Coefficient when working

More information

Introduction to Statistics and Quantitative Research Methods

Introduction to Statistics and Quantitative Research Methods Introduction to Statistics and Quantitative Research Methods Purpose of Presentation To aid in the understanding of basic statistics, including terminology, common terms, and common statistical methods.

More information

Correcting Two-Sample z and t Tests for Correlation: An Alternative to One-Sample Tests on Difference Scores

Correcting Two-Sample z and t Tests for Correlation: An Alternative to One-Sample Tests on Difference Scores Psicológica (),, 9-48. Correcting Two-Sample z and t Tests for Correlation: An Alternative to One-Sample Tests on Difference Scores Donald W. Zimmerman * Carleton University, Canada In order to circumvent

More information

Statistical Significance and Bivariate Tests

Statistical Significance and Bivariate Tests Statistical Significance and Bivariate Tests BUS 735: Business Decision Making and Research 1 1.1 Goals Goals Specific goals: Re-familiarize ourselves with basic statistics ideas: sampling distributions,

More information

1/22/2016. What are paired data? Tests of Differences: two related samples. What are paired data? Paired Example. Paired Data.

1/22/2016. What are paired data? Tests of Differences: two related samples. What are paired data? Paired Example. Paired Data. Tests of Differences: two related samples What are paired data? Frequently data from ecological work take the form of paired (matched, related) samples Before and after samples at a specific site (or individual)

More information

Chi Square Analysis. When do we use chi square?

Chi Square Analysis. When do we use chi square? Chi Square Analysis When do we use chi square? More often than not in psychological research, we find ourselves collecting scores from participants. These data are usually continuous measures, and might

More information

Normality Testing in Excel

Normality Testing in Excel Normality Testing in Excel By Mark Harmon Copyright 2011 Mark Harmon No part of this publication may be reproduced or distributed without the express permission of the author. mark@excelmasterseries.com

More information