Rank-Based Non-Parametric Tests

Size: px
Start display at page:

Download "Rank-Based Non-Parametric Tests"

Transcription

1 Rank-Based Non-Parametric Tests

2 Reminder: Student Instructional Rating Surveys You have until May 8 th to fill out the student instructional rating surveys at https://sakai.rutgers.edu/portal/site/sirs The survey should be available on any device with a full-featured web browser. Please take the time to fill it out. Your answers: Will be anonymous Will help me to improve my teaching strategies and the structure of the course Will help the department in planning and designing future courses Will be used by the university in promotion, tenure, and reappointment decisions

3 Parametric and Nonparametric Tests Non-Parametric Tests Most of the statistical tests that we have used throughout the semester have relied on certain specific assumptions about the distribution of the involved variables and/or their means, and have been set up to test hypotheses about specific population parameters Such tests (z-tests, t-tests, ANOVAs, Pearson s correlation) are called parametric tests

4 Parametric and Nonparametric Tests Non-Parametric Tests Though these parametric tests are robust to minor violations of their assumptions, they can lead to gross systematic errors when the data are strongly violate the underlying assumptions and can even be undefined for certain types of data (e.g., nominal or non-numerical data). Certain tests do not rely on specific distributional assumptions or test hypotheses about particular population parameters. These tests are generally called nonparametric tests The chi-square tests introduced in the last lecture and Spearman s rank correlation coefficient test were examples of nonparametric tests.

5 Parametric versus Nonparametric Tests The advantages of parametric tests are that Non-Parametric Tests They are more powerful (i.e., you can detect smaller effect sizes with smaller samples) than comparable non-parametric tests when the parametric assumptions are correct (or approximately correct). The hypothesis tests are more specific and easier to interpret. The advantage of nonparametric tests are that They can be used when the distribution of the population is completely unknown They tend to be more robust to ill-behaved (e.g., non-normal, heteroscedastic, & multi-modal) data They are less sensitive to outliers They can be used with nominal and ordinal data

6 Nonparametric tests In the last 70 years or so, statisticians have developed many different nonparametric tests. Those most widely used in the behavioral sciences tend to be rank randomization tests Rank randomization (or rank-permutation) tests are hypothesis tests based on the theoretical distribution of randomly assigned ranks. As a first step, they all require the conversion of raw scores to ordinal ranks This makes them obvious candidates for ordinal data, though these data usually still need to be modified

7 Rank Randomization Tests Advantages of rank-based tests: 1. Ranks are simpler, and rank-based tests are easier to compute 2. They are largely insensitive to the particular form of the population distributions and differences between the distributions underlying the scores in different samples 3. They tend to minimize the effects of large sample variances 4. They are insensitive to outlier scores and make it easier to deal with undetermined scores (e.g., time to task completion) 5. The distribution of randomly assigned ranks can be computed exactly

8 720 permutations Sample 1 Ranks Sample 2 Ranks

9 720 permutations Sample 1 Ranks R 1 = Σr Sample 2 Ranks R 2 = Σr W s = min(r 1,R 2 )

10 Non-Parametric Tests

11 Non-Parametric Tests

12 Rank Randomization Tests Popular rank-based tests: 1. The Mann-Whitney U (or Wilcoxon rank-sum) test Nonparametric analogue to the independent-samples t-test 2. The Wilcoxon signed-rank test Nonparametric analogue to the matched-samples t-test 3. The Kruskal-Wallis test Nonparametric analogue to the one-way ANOVA (independent meas.) 4. The Friedman test Nonparametric analogue to the repeated-measures ANOVA

13 A Note about Computing Ranks All of the rank-based tests will require that you compute ranks based on the total number of scores and from lowest to highest I.e., if you have 3 samples with 5 scores each, the lowest overall score should be assigned the rank 1 and the highest overall score should be assigned the rank 15 In case of ties, each tied score should be assigned the mean of the tied ranks I.e., if the 3 rd and 4 th lowest scores have the same value then you should assign them each a rank of 3.5, with the next highest value receiving a rank of 5. If the 7 th, 8 th, and 9 th scores are all tied, then you should assign them each a rank of 8, with the next highest value receiving a rank of 10.

14 Rank Randomization Tests Aside from converting the raw scores to ranks, the logical steps are similar to those for the parametric hypothesis tests: 1. State the null and alternative hypotheses about the population. 2. Use the null hypotheses to predict the characteristics that the sample ranks should have. 3. Use the samples to compute the test statistic 4. Compare the test statistic with the hypothesis prediction

15 The Mann-Whitney Test This is a test for independent-measures (between subjects) research designs with two groups and is thus an alternative to the independent-measures t-test The basic intuition behind the test is that: A real difference between the two treatments should cause the scores in one sample to be generally larger than the scores in the other sample If all the scores are ranked, the larger ranks should be concentrated in one sample and the smaller ranks should be concentrated in the other sample.

16 The Mann-Whitney Test The null and alternative hypotheses are a bit more vague than for the t-test, but still test for some sort of difference in central tendency H 0 : There is no difference between treatments. Therefore, there is no tendency for ranks in one sample to be systematically higher or lower than in the other sample H 1 : There is a difference between treatments. Therefore, the ranks in one sample should be systematically higher or lower than in the other sample

17 The Mann-Whitney Test When comparing two samples, the Mann-Whitney U statistic for sample 1 represents the sum of the number of scores in sample 2 outranked by scores in sample 1 Treatment A Raw Scores Ranks Treatment B Raw Scores Ranks The smaller of the U values is looked up in the table

18 Example Treatment A Raw Scores Ranks Points Treatment B Raw Scores Ranks Points

19 The Mann-Whitney Test: Steps In practice, the steps for computing the test statistic (U) are: 1. Rank all the observations from smallest to largest 2. Compute the sum of the ranks in each sample, using the following formulas to compute U statistics from the ranks R: U n ( n 1 ), R1 U n ( n R ) 3. U is the smaller of the sums of these counts

20 Example Treatment A Raw Scores Ranks ΣR 1 27 Treatment B Raw Scores Ranks ΣR 2 51 U n1( n1 1) R 2 6(7)

21 U 6 n 6 n In this case, U crit = 5, so we retain the null hypothesis Note: Most tables for rank permutation statistics are set up so that you reject the null hypothesis if the value is smaller than the tabled value.

22 The Mann-Whitney Test: Normal Approximation When n 1 and n 2 are sufficiently large (e.g., n 1,n 2 10) the distribution of rank sums becomes roughly normal and you can use a normal approximation, evaluated against a critical z value, to test for significance. U U nn n n N U U zu U

23 Wilcoxon s Signed Ranks Test This is a test for repeated-measures (within-subjects) research designs with two treatment conditions and is thus an alternative to the repeated-measures t-test The basic intuition behind the test is that: A real difference between the two treatments should cause the difference scores to be generally positive or negative If all the difference scores are ranked and signed (according to whether they represent increases + or decreases -), the ranks should be concentrated in either the positive or negative set.

24 Wilcoxon s Signed Ranks Test Again, the null and alternative hypotheses are a bit more vague than for the repeated measures t-test, but test for some sort of difference in central tendency H 0 : There is no difference between treatments. Therefore, there is no tendency for the ranks of difference scores to be generally positive or negative H 1 : There is a difference between treatments. Therefore, the ranks of the difference scores should be systematically positive or negative

25 Wilcoxon s Signed Rank Test: Steps The steps for computing the test statistic (T) are: 1. Compute the difference scores Non-Parametric Tests 2. Rank all the difference scores from smallest to largest absolute value and assign them positive or negative signs based on whether they represent an increment or decrement 3. Compute separate sums for the positively and negatively signed sets 4. T is the smaller of the resulting signed-rank-sums

26 Example (Suddath et al., 1990)

27 Example T = 9 N = 15 T crit is 25, which is greater than our test statistic, so we would reject the null hypothesis

28 Wilcoxon s Signed Ranks Test: Normal Approximation Again, when n is sufficiently large (e.g., n 20) the distribution of T becomes roughly normal and you can use a normal approximation, evaluated against a critical z value, to test for significance. T T n n1 4 n( n 1)(2n 2) 24 zt T T T n n1 T 4 n( n 1)(2n 1) 24

29 The Kruskal-Wallis One Way ANOVA Non-Parametric Tests This is a test for independent-measures research designs with more than two groups. As its name suggests, it is a nonparametric alternative to the parametric one-way ANOVA The basic intuition behind the test is analogous to that for the parametric one-way ANOVA: A real difference among treatments should cause the variability of scores between groups to be greater than the variability of scores within groups If all the scores are ranked the variability of rank-sums between groups should be greater than the variability of rank-sums within groups

30 The Kruskal-Wallis One Way ANOVA Non-Parametric Tests The null and alternative hypotheses are very similar to those in the parametric one-way ANOVA. H 0 : There is no difference between treatments. There is no tendency for ranks in any sample to be systematically higher or lower than in any other condition. H 1 : There are differences between treatments. The ranks in at least one condition are systematically higher or lower than in another treatment condition

31 Non-Parametric Tests k i k n i j i i T ij i n M M F C x M k T i k n T i i i j j i r r r n r H C Parametric ANOVA: Kruskal-Wallis: 1 1 within between df N k C df k 2 1 C N Comparison of Conceptual Formulas for the Parametric one-way ANOVA and Kruskal-Wallis Test:

32 The Kruskal-Wallis Test: Steps The steps for computing the test statistic (H) are: 1. Rank all scores from lowest to highest across all samples 2. Compute R, the sum of ranks in each sample 3. Plug into the following formula to solve for H: H 2 12 R i 3 N 1 N N n 1 i i

33 The Kruskal-Wallis Test: Normal Approximation As in the other rank-randomization tests, when N is sufficiently large, the distribution of rank-sums becomes approximately normal H is a linear combination (a weighted sum) of squared-rank sums, which means that it can be approximated by the distribution of a sum of squared normal variables For this reason, the significance of H is usually evaluated using a chi-squared distribution with k-1 degrees of freedom.

34 Friedman s Rank Test This is a test for repeated-measures research designs with more than two groups. It is the non-parametric analogue to a one-way repeated-measures ANOVA Just as the repeated measures ANOVA tests for consistent changes between individuals across treatment groups, Friedman s test looks for consistent rankings between individuals across treatment groups It can be used with any repeated-measures data, but is especially useful for measuring inter-rater agreement for rankings

35 The Friedman Test The null and alternative hypotheses are identical to those for the Kruskal-Wallis Test. H 0 : There is no difference between treatments. There is no tendency for ranks in any sample to be systematically higher or lower than in any other condition. H 1 : There are differences between treatments. The ranks in at least one condition are systematically higher or lower than in another treatment condition

36 The Friedman Test: Steps 2 The steps for computing the test statistic ( R ) are: 1. Rank scores across each treatment group for each individual 2. Compute R, the sum of ranks for each group 3. Plug into the following formula to compute the test statistic: 12 ( k 1) R 3 n( k 1) 2 k 2 R i nk( k 1) i

37 Friedman Test Example Sommelier Wine 1 Wine 2 Wine 3 A B C D E F G R (2) 3 n( k 1) k 2 2 R Ri nk( k 1) i 12 7(3)(4) (7)(4)

38 χ 2 Distribution Upper Tail Probability df

39 Friedman Test Example Sommelier Wine 1 Wine 2 Wine 3 A B C D E F G R (2) 3 n( k 1) k 2 2 R Ri nk( k 1) i 12 7(3)(4) (7)(4) crit 5.99, retain H 0 In this case, we would conclude that there is no significant difference in quality between the 3 wines or that the sommeliers are unable to discern any differences.

Module 9: Nonparametric Tests. The Applied Research Center

Module 9: Nonparametric Tests. The Applied Research Center Module 9: Nonparametric Tests The Applied Research Center Module 9 Overview } Nonparametric Tests } Parametric vs. Nonparametric Tests } Restrictions of Nonparametric Tests } One-Sample Chi-Square Test

More information

Study Guide for the Final Exam

Study Guide for the Final Exam Study Guide for the Final Exam When studying, remember that the computational portion of the exam will only involve new material (covered after the second midterm), that material from Exam 1 will make

More information

UNIVERSITY OF NAIROBI

UNIVERSITY OF NAIROBI UNIVERSITY OF NAIROBI MASTERS IN PROJECT PLANNING AND MANAGEMENT NAME: SARU CAROLYNN ELIZABETH REGISTRATION NO: L50/61646/2013 COURSE CODE: LDP 603 COURSE TITLE: RESEARCH METHODS LECTURER: GAKUU CHRISTOPHER

More information

Chapter 3: Nonparametric Tests

Chapter 3: Nonparametric Tests B. Weaver (15-Feb-00) Nonparametric Tests... 1 Chapter 3: Nonparametric Tests 3.1 Introduction Nonparametric, or distribution free tests are so-called because the assumptions underlying their use are fewer

More information

3. Nonparametric methods

3. Nonparametric methods 3. Nonparametric methods If the probability distributions of the statistical variables are unknown or are not as required (e.g. normality assumption violated), then we may still apply nonparametric tests

More information

Research Methods 1 Handouts, Graham Hole,COGS - version 1.0, September 2000: Page 1:

Research Methods 1 Handouts, Graham Hole,COGS - version 1.0, September 2000: Page 1: Research Methods 1 Handouts, Graham Hole,COGS - version 1.0, September 000: Page 1: NON-PARAMETRIC TESTS: What are non-parametric tests? Statistical tests fall into two kinds: parametric tests assume that

More information

Nonparametric Statistics

Nonparametric Statistics 1 14.1 Using the Binomial Table Nonparametric Statistics In this chapter, we will survey several methods of inference from Nonparametric Statistics. These methods will introduce us to several new tables

More information

Supplement on the Kruskal-Wallis test. So what do you do if you don t meet the assumptions of an ANOVA?

Supplement on the Kruskal-Wallis test. So what do you do if you don t meet the assumptions of an ANOVA? Supplement on the Kruskal-Wallis test So what do you do if you don t meet the assumptions of an ANOVA? {There are other ways of dealing with things like unequal variances and non-normal data, but we won

More information

Non-Parametric Tests (I)

Non-Parametric Tests (I) Lecture 5: Non-Parametric Tests (I) KimHuat LIM lim@stats.ox.ac.uk http://www.stats.ox.ac.uk/~lim/teaching.html Slide 1 5.1 Outline (i) Overview of Distribution-Free Tests (ii) Median Test for Two Independent

More information

Overview of Non-Parametric Statistics PRESENTER: ELAINE EISENBEISZ OWNER AND PRINCIPAL, OMEGA STATISTICS

Overview of Non-Parametric Statistics PRESENTER: ELAINE EISENBEISZ OWNER AND PRINCIPAL, OMEGA STATISTICS Overview of Non-Parametric Statistics PRESENTER: ELAINE EISENBEISZ OWNER AND PRINCIPAL, OMEGA STATISTICS About Omega Statistics Private practice consultancy based in Southern California, Medical and Clinical

More information

QUANTITATIVE METHODS BIOLOGY FINAL HONOUR SCHOOL NON-PARAMETRIC TESTS

QUANTITATIVE METHODS BIOLOGY FINAL HONOUR SCHOOL NON-PARAMETRIC TESTS QUANTITATIVE METHODS BIOLOGY FINAL HONOUR SCHOOL NON-PARAMETRIC TESTS This booklet contains lecture notes for the nonparametric work in the QM course. This booklet may be online at http://users.ox.ac.uk/~grafen/qmnotes/index.html.

More information

Variables and Data A variable contains data about anything we measure. For example; age or gender of the participants or their score on a test.

Variables and Data A variable contains data about anything we measure. For example; age or gender of the participants or their score on a test. The Analysis of Research Data The design of any project will determine what sort of statistical tests you should perform on your data and how successful the data analysis will be. For example if you decide

More information

EPS 625 INTERMEDIATE STATISTICS FRIEDMAN TEST

EPS 625 INTERMEDIATE STATISTICS FRIEDMAN TEST EPS 625 INTERMEDIATE STATISTICS The Friedman test is an extension of the Wilcoxon test. The Wilcoxon test can be applied to repeated-measures data if participants are assessed on two occasions or conditions

More information

SPSS Tests for Versions 9 to 13

SPSS Tests for Versions 9 to 13 SPSS Tests for Versions 9 to 13 Chapter 2 Descriptive Statistic (including median) Choose Analyze Descriptive statistics Frequencies... Click on variable(s) then press to move to into Variable(s): list

More information

Analysis of numerical data S4

Analysis of numerical data S4 Basic medical statistics for clinical and experimental research Analysis of numerical data S4 Katarzyna Jóźwiak k.jozwiak@nki.nl 3rd November 2015 1/42 Hypothesis tests: numerical and ordinal data 1 group:

More information

SCHOOL OF HEALTH AND HUMAN SCIENCES DON T FORGET TO RECODE YOUR MISSING VALUES

SCHOOL OF HEALTH AND HUMAN SCIENCES DON T FORGET TO RECODE YOUR MISSING VALUES SCHOOL OF HEALTH AND HUMAN SCIENCES Using SPSS Topics addressed today: 1. Differences between groups 2. Graphing Use the s4data.sav file for the first part of this session. DON T FORGET TO RECODE YOUR

More information

NONPARAMETRIC STATISTICS 1. depend on assumptions about the underlying distribution of the data (or on the Central Limit Theorem)

NONPARAMETRIC STATISTICS 1. depend on assumptions about the underlying distribution of the data (or on the Central Limit Theorem) NONPARAMETRIC STATISTICS 1 PREVIOUSLY parametric statistics in estimation and hypothesis testing... construction of confidence intervals computing of p-values classical significance testing depend on assumptions

More information

SPSS Explore procedure

SPSS Explore procedure SPSS Explore procedure One useful function in SPSS is the Explore procedure, which will produce histograms, boxplots, stem-and-leaf plots and extensive descriptive statistics. To run the Explore procedure,

More information

THE KRUSKAL WALLLIS TEST

THE KRUSKAL WALLLIS TEST THE KRUSKAL WALLLIS TEST TEODORA H. MEHOTCHEVA Wednesday, 23 rd April 08 THE KRUSKAL-WALLIS TEST: The non-parametric alternative to ANOVA: testing for difference between several independent groups 2 NON

More information

Chapter 21 Statistical Tests for Ordinal Data. Table 21.1

Chapter 21 Statistical Tests for Ordinal Data. Table 21.1 Chapter 21 Statistical Tests for Ordinal Data The Mann-Whitney (Rank-Sum) Test In this example, we deal with a dependent variable that is measured on a ratio scale (time in seconds), but its distribution

More information

CHAPTER 3 COMMONLY USED STATISTICAL TERMS

CHAPTER 3 COMMONLY USED STATISTICAL TERMS CHAPTER 3 COMMONLY USED STATISTICAL TERMS There are many statistics used in social science research and evaluation. The two main areas of statistics are descriptive and inferential. The third class of

More information

Research Methodology: Tools

Research Methodology: Tools MSc Business Administration Research Methodology: Tools Applied Data Analysis (with SPSS) Lecture 11: Nonparametric Methods May 2014 Prof. Dr. Jürg Schwarz Lic. phil. Heidi Bruderer Enzler Contents Slide

More information

Learning objectives. Non-parametric tests. Inhomogeneity of variance. Why non-parametric test? Non-parametric tests. NOT normally distributed

Learning objectives. Non-parametric tests. Inhomogeneity of variance. Why non-parametric test? Non-parametric tests. NOT normally distributed Learning objectives Criteria for choosing a non-parametric test Part Why non-parametric test? Inhomogeneity of variance Violation of the assumption of normally distributed data Group Group Group Inhomogeneity

More information

Chapter 13 Statistical Foundations: Ordinal Data Analysis 406. Chapter 13 Statistical Foundations: Ordinal Data Analysis

Chapter 13 Statistical Foundations: Ordinal Data Analysis 406. Chapter 13 Statistical Foundations: Ordinal Data Analysis Chapter 13 Statistical Foundations: Ordinal Data Analysis 406 Chapter 13 Statistical Foundations: Ordinal Data Analysis I. Introduction A. The Nature of Ordinal Data 1. Ordinal data are ordered categories,

More information

1. The Direction of the Relationship. The sign of the correlation, positive or negative, describes the direction of the relationship.

1. The Direction of the Relationship. The sign of the correlation, positive or negative, describes the direction of the relationship. Correlation Correlation is a statistical technique that is used to measure and describe the relationship between two variables. Usually the two variables are simply observed as they exist naturally in

More information

Intro to Parametric & Nonparametric Statistics

Intro to Parametric & Nonparametric Statistics Intro to Parametric & Nonparametric Statistics Kinds & definitions of nonparametric statistics Where parametric stats come from Consequences of parametric assumptions Organizing the models we will cover

More information

1 Nonparametric Statistics

1 Nonparametric Statistics 1 Nonparametric Statistics When finding confidence intervals or conducting tests so far, we always described the population with a model, which includes a set of parameters. Then we could make decisions

More information

Chapter 16: Nonparametric Tests

Chapter 16: Nonparametric Tests Chapter 16: Nonparametric Tests In Chapter 1-13 we discussed tests of hypotheses in a parametric statistics framework: which assumes that the functional form of the (population) probability distribution

More information

Chapter 21 Section D

Chapter 21 Section D Chapter 21 Section D Statistical Tests for Ordinal Data The rank-sum test. You can perform the rank-sum test in SPSS by selecting 2 Independent Samples from the Analyze/ Nonparametric Tests menu. The first

More information

CHAPTER 12 TESTING DIFFERENCES WITH ORDINAL DATA: MANN WHITNEY U

CHAPTER 12 TESTING DIFFERENCES WITH ORDINAL DATA: MANN WHITNEY U CHAPTER 12 TESTING DIFFERENCES WITH ORDINAL DATA: MANN WHITNEY U Previous chapters of this text have explained the procedures used to test hypotheses using interval data (t-tests and ANOVA s) and nominal

More information

Some Critical Information about SOME Statistical Tests and Measures of Correlation/Association

Some Critical Information about SOME Statistical Tests and Measures of Correlation/Association Some Critical Information about SOME Statistical Tests and Measures of Correlation/Association This information is adapted from and draws heavily on: Sheskin, David J. 2000. Handbook of Parametric and

More information

Research Methods & Experimental Design

Research Methods & Experimental Design Research Methods & Experimental Design 16.422 Human Supervisory Control April 2004 Research Methods Qualitative vs. quantitative Understanding the relationship between objectives (research question) and

More information

Inferential Statistics

Inferential Statistics Inferential Statistics Sampling and the normal distribution Z-scores Confidence levels and intervals Hypothesis testing Commonly used statistical methods Inferential Statistics Descriptive statistics are

More information

The One-Way Repeated-Measures ANOVA. (For Within-Subjects Designs)

The One-Way Repeated-Measures ANOVA. (For Within-Subjects Designs) The One-Way Repeated-Measures ANOVA (For Within-Subjects Designs) Logic of the Repeated-Measures ANOVA The repeated-measures ANOVA extends the analysis of variance to research situations using repeated-measures

More information

Non-parametric tests I

Non-parametric tests I Non-parametric tests I Objectives Mann-Whitney Wilcoxon Signed Rank Relation of Parametric to Non-parametric tests 1 the problem Our testing procedures thus far have relied on assumptions of independence,

More information

Nonparametric tests. Nonparametric tests and ANOVAs: What you need to know. Quick Reference Summary: Sign Test. ( ) n(x P = 2 * Pr[x!

Nonparametric tests. Nonparametric tests and ANOVAs: What you need to know. Quick Reference Summary: Sign Test. ( ) n(x P = 2 * Pr[x! Nonparametric tests and ANOVAs: What you need to know Nonparametric tests Nonparametric tests are usually based on ranks There are nonparametric versions of most parametric tests arametric One-sample and

More information

Experimental & Behavioral Economics Lecture 6: Non-parametric tests and selection of sample size

Experimental & Behavioral Economics Lecture 6: Non-parametric tests and selection of sample size Experimental & Behavioral Economics Lecture 6: Non-parametric tests and selection of sample size Based on Siegel, Sidney, and N. J. Castellan (1988) Nonparametric statistics for the behavioral sciences,

More information

CHAPTER 11 CHI-SQUARE: NON-PARAMETRIC COMPARISONS OF FREQUENCY

CHAPTER 11 CHI-SQUARE: NON-PARAMETRIC COMPARISONS OF FREQUENCY CHAPTER 11 CHI-SQUARE: NON-PARAMETRIC COMPARISONS OF FREQUENCY The hypothesis testing statistics detailed thus far in this text have all been designed to allow comparison of the means of two or more samples

More information

Post-hoc comparisons & two-way analysis of variance. Two-way ANOVA, II. Post-hoc testing for main effects. Post-hoc testing 9.

Post-hoc comparisons & two-way analysis of variance. Two-way ANOVA, II. Post-hoc testing for main effects. Post-hoc testing 9. Two-way ANOVA, II Post-hoc comparisons & two-way analysis of variance 9.7 4/9/4 Post-hoc testing As before, you can perform post-hoc tests whenever there s a significant F But don t bother if it s a main

More information

ANSWERS TO EXERCISES AND REVIEW QUESTIONS

ANSWERS TO EXERCISES AND REVIEW QUESTIONS ANSWERS TO EXERCISES AND REVIEW QUESTIONS PART FIVE: STATISTICAL TECHNIQUES TO COMPARE GROUPS Before attempting these questions read through the introduction to Part Five and Chapters 16-21 of the SPSS

More information

Parametric test: (b) the data show inhomogeneity of variance; or. (c) the data are not measurements on an interval or ratio scale.

Parametric test: (b) the data show inhomogeneity of variance; or. (c) the data are not measurements on an interval or ratio scale. Non-parametric tests: Non-parametric tests make no assumptions about the characteristics or "parameters" of your data. Use them if (a) the data are not normally distributed; (b) the data show inhomogeneity

More information

CHI SQUARE ANALYSIS 8/18/2011 HYPOTHESIS TESTS SO FAR PARAMETRIC VS. NON-PARAMETRIC

CHI SQUARE ANALYSIS 8/18/2011 HYPOTHESIS TESTS SO FAR PARAMETRIC VS. NON-PARAMETRIC CHI SQUARE ANALYSIS I NTRODUCTION TO NON- PARAMETRI C ANALYSES HYPOTHESIS TESTS SO FAR We ve discussed One-sample t-test Dependent Sample t-tests Independent Samples t-tests One-Way Between Groups ANOVA

More information

Applications of Intermediate/Advanced Statistics in Institutional Research

Applications of Intermediate/Advanced Statistics in Institutional Research Applications of Intermediate/Advanced Statistics in Institutional Research Edited by Mary Ann Coughlin THE ASSOCIATION FOR INSTITUTIONAL RESEARCH Number Sixteen Resources in Institional Research 2005 Association

More information

UNDERSTANDING THE ONE-WAY ANOVA

UNDERSTANDING THE ONE-WAY ANOVA UNDERSTANDING The One-way Analysis of Variance (ANOVA) is a procedure for testing the hypothesis that K population means are equal, where K >. The One-way ANOVA compares the means of the samples or groups

More information

One tailed vs two tailed tests: a normal distribution filled with a rainbow of colours. = height (14) = height (10) = D

One tailed vs two tailed tests: a normal distribution filled with a rainbow of colours. = height (14) = height (10) = D One tailed t-test using SPSS: Divide the probability that a two-tailed SPSS test produces. SPSS always produces two-tailed significance level. One tailed vs two tailed tests: a normal distribution filled

More information

Nonparametric Statistics

Nonparametric Statistics Nonparametric Statistics References Some good references for the topics in this course are 1. Higgins, James (2004), Introduction to Nonparametric Statistics 2. Hollander and Wolfe, (1999), Nonparametric

More information

Nonparametric and Distribution- Free Statistical Tests

Nonparametric and Distribution- Free Statistical Tests 20 Nonparametric and Distribution- Free Statistical Tests Concepts that you will need to remember from previous chapters SS total, SS group, SS error : Sums of squares of all scores, of group means, and

More information

Unit 14: Nonparametric Statistical Methods

Unit 14: Nonparametric Statistical Methods Unit 14: Nonparametric Statistical Methods Statistics 571: Statistical Methods Ramón V. León 7/26/2004 Unit 14 - Stat 571 - Ramón V. León 1 Introductory Remarks Most methods studied so far have been based

More information

Nonparametric tests these test hypotheses that are not statements about population parameters (e.g.,

Nonparametric tests these test hypotheses that are not statements about population parameters (e.g., CHAPTER 13 Nonparametric and Distribution-Free Statistics Nonparametric tests these test hypotheses that are not statements about population parameters (e.g., 2 tests for goodness of fit and independence).

More information

Nonparametric Statistics

Nonparametric Statistics Nonparametric Statistics J. Lozano University of Goettingen Department of Genetic Epidemiology Interdisciplinary PhD Program in Applied Statistics & Empirical Methods Graduate Seminar in Applied Statistics

More information

Nonparametric test One sample tests Two sample tests Testing for three or more samples

Nonparametric test One sample tests Two sample tests Testing for three or more samples Nonparametric test One sample tests Two sample tests Testing for three or more samples 1 Background So far we have stressed that in order to carry out hypothesis tests we need to make certain assumptions

More information

Come scegliere un test statistico

Come scegliere un test statistico Come scegliere un test statistico Estratto dal Capitolo 37 of Intuitive Biostatistics (ISBN 0-19-508607-4) by Harvey Motulsky. Copyright 1995 by Oxfd University Press Inc. (disponibile in Iinternet) Table

More information

STA-3123: Statistics for Behavioral and Social Sciences II. Text Book: McClave and Sincich, 12 th edition. Contents and Objectives

STA-3123: Statistics for Behavioral and Social Sciences II. Text Book: McClave and Sincich, 12 th edition. Contents and Objectives STA-3123: Statistics for Behavioral and Social Sciences II Text Book: McClave and Sincich, 12 th edition Contents and Objectives Initial Review and Chapters 8 14 (Revised: Aug. 2014) Initial Review on

More information

Analysis of Data. Organizing Data Files in SPSS. Descriptive Statistics

Analysis of Data. Organizing Data Files in SPSS. Descriptive Statistics Analysis of Data Claudia J. Stanny PSY 67 Research Design Organizing Data Files in SPSS All data for one subject entered on the same line Identification data Between-subjects manipulations: variable to

More information

SPSS ADVANCED ANALYSIS WENDIANN SETHI SPRING 2011

SPSS ADVANCED ANALYSIS WENDIANN SETHI SPRING 2011 SPSS ADVANCED ANALYSIS WENDIANN SETHI SPRING 2011 Statistical techniques to be covered Explore relationships among variables Correlation Regression/Multiple regression Logistic regression Factor analysis

More information

Non-parametric Statistics. What We Will Cover in This Section. What Is/Are It?

Non-parametric Statistics. What We Will Cover in This Section. What Is/Are It? Non-parametric Statistics /9/ P766 Non-parametric statistics What We Will Cover in This Section Introduction Correlational Techniques Spearman Point Biserial Phi Coefficient Chi Square /9/ P766 Non-parametric

More information

Nonparametric Test Procedures

Nonparametric Test Procedures Nonparametric Test Procedures 1 Introduction to Nonparametrics Nonparametric tests do not require that samples come from populations with normal distributions or any other specific distribution. Hence

More information

Non-parametric Statistics. What We Will Cover in This Section. What Is/Are It?

Non-parametric Statistics. What We Will Cover in This Section. What Is/Are It? Non-parametric Statistics /3/6 P33 Non-parametric statistics What We Will Cover in This Section Introduction Correlational Techniques Spearman Point Biserial Chi Square /3/6 P33 Non-parametric statistics

More information

MASTER COURSE SYLLABUS-PROTOTYPE PSYCHOLOGY 2317 STATISTICAL METHODS FOR THE BEHAVIORAL SCIENCES

MASTER COURSE SYLLABUS-PROTOTYPE PSYCHOLOGY 2317 STATISTICAL METHODS FOR THE BEHAVIORAL SCIENCES MASTER COURSE SYLLABUS-PROTOTYPE THE PSYCHOLOGY DEPARTMENT VALUES ACADEMIC FREEDOM AND THUS OFFERS THIS MASTER SYLLABUS-PROTOTYPE ONLY AS A GUIDE. THE INSTRUCTORS ARE FREE TO ADAPT THEIR COURSE SYLLABI

More information

ALTERNATIVES TO t AND F

ALTERNATIVES TO t AND F CHAPTER 15 ALTERNATIVES TO t AND F OBJECTIVES After completing this chapter, you should be able to compute and use nonparametric alternatives to parametric tests, such as the t test for independent samples

More information

Formulas and Tables by Mario F. Triola

Formulas and Tables by Mario F. Triola Formulas and Tables by Mario F. Triola Copyright 010 Pearson Education, Inc. Ch. 3: Descriptive Statistics x Mean f # x x f Mean (frequency table) 1x - x s B n - 1 Standard deviation n 1 x - 1 x Standard

More information

Descriptive Statistics

Descriptive Statistics Descriptive Statistics Primer Descriptive statistics Central tendency Variation Relative position Relationships Calculating descriptive statistics Descriptive Statistics Purpose to describe or summarize

More information

Statistics. One-two sided test, Parametric and non-parametric test statistics: one group, two groups, and more than two groups samples

Statistics. One-two sided test, Parametric and non-parametric test statistics: one group, two groups, and more than two groups samples Statistics One-two sided test, Parametric and non-parametric test statistics: one group, two groups, and more than two groups samples February 3, 00 Jobayer Hossain, Ph.D. & Tim Bunnell, Ph.D. Nemours

More information

Week 7 Lecture: Two-way Analysis of Variance (Chapter 12) Two-way ANOVA with Equal Replication (see Zar s section 12.1)

Week 7 Lecture: Two-way Analysis of Variance (Chapter 12) Two-way ANOVA with Equal Replication (see Zar s section 12.1) Week 7 Lecture: Two-way Analysis of Variance (Chapter ) We can extend the idea of a one-way ANOVA, which tests the effects of one factor on a response variable, to a two-way ANOVA which tests the effects

More information

INTERPRETING THE ONE-WAY ANALYSIS OF VARIANCE (ANOVA)

INTERPRETING THE ONE-WAY ANALYSIS OF VARIANCE (ANOVA) INTERPRETING THE ONE-WAY ANALYSIS OF VARIANCE (ANOVA) As with other parametric statistics, we begin the one-way ANOVA with a test of the underlying assumptions. Our first assumption is the assumption of

More information

Comparing Means in Two Populations

Comparing Means in Two Populations Comparing Means in Two Populations Overview The previous section discussed hypothesis testing when sampling from a single population (either a single mean or two means from the same population). Now we

More information

CHI-SQUARE (Χ 2 ) TESTS FOR FREQUENCIES Notes from: Hinkle, et al., (2003)

CHI-SQUARE (Χ 2 ) TESTS FOR FREQUENCIES Notes from: Hinkle, et al., (2003) KEY CONCEPTS: ( ) TESTS FOR FREQUENCIES Notes from: Hinkle, et al., (003) Nonparametric Tests: Statistical tests of significance that require fewer assumptions than parametric tests. Chi-Square ( ) Distribution:

More information

Lecture 7: Binomial Test, Chisquare

Lecture 7: Binomial Test, Chisquare Lecture 7: Binomial Test, Chisquare Test, and ANOVA May, 01 GENOME 560, Spring 01 Goals ANOVA Binomial test Chi square test Fisher s exact test Su In Lee, CSE & GS suinlee@uw.edu 1 Whirlwind Tour of One/Two

More information

Data Analysis. Lecture Empirical Model Building and Methods (Empirische Modellbildung und Methoden) SS Analysis of Experiments - Introduction

Data Analysis. Lecture Empirical Model Building and Methods (Empirische Modellbildung und Methoden) SS Analysis of Experiments - Introduction Data Analysis Lecture Empirical Model Building and Methods (Empirische Modellbildung und Methoden) Prof. Dr. Dr. h.c. Dieter Rombach Dr. Andreas Jedlitschka SS 2014 Analysis of Experiments - Introduction

More information

T-test & factor analysis

T-test & factor analysis Parametric tests T-test & factor analysis Better than non parametric tests Stringent assumptions More strings attached Assumes population distribution of sample is normal Major problem Alternatives Continue

More information

Nonparametric Two-Sample Tests. Nonparametric Tests. Sign Test

Nonparametric Two-Sample Tests. Nonparametric Tests. Sign Test Nonparametric Two-Sample Tests Sign test Mann-Whitney U-test (a.k.a. Wilcoxon two-sample test) Kolmogorov-Smirnov Test Wilcoxon Signed-Rank Test Tukey-Duckworth Test 1 Nonparametric Tests Recall, nonparametric

More information

Quantitative Data Analysis: Choosing a statistical test Prepared by the Office of Planning, Assessment, Research and Quality

Quantitative Data Analysis: Choosing a statistical test Prepared by the Office of Planning, Assessment, Research and Quality Quantitative Data Analysis: Choosing a statistical test Prepared by the Office of Planning, Assessment, Research and Quality 1 To help choose which type of quantitative data analysis to use either before

More information

The Statistics Tutor s

The Statistics Tutor s statstutor community project encouraging academics to share statistics support resources All stcp resources are released under a Creative Commons licence Stcp-marshallowen-7 The Statistics Tutor s www.statstutor.ac.uk

More information

13: Additional ANOVA Topics. Post hoc Comparisons

13: Additional ANOVA Topics. Post hoc Comparisons 13: Additional ANOVA Topics Post hoc Comparisons ANOVA Assumptions Assessing Group Variances When Distributional Assumptions are Severely Violated Kruskal-Wallis Test Post hoc Comparisons In the prior

More information

Statistiek I. Nonparametric Tests. John Nerbonne. CLCG, Rijksuniversiteit Groningen.

Statistiek I. Nonparametric Tests. John Nerbonne. CLCG, Rijksuniversiteit Groningen. Statistiek I Nonparametric Tests John Nerbonne CLCG, Rijksuniversiteit Groningen http://www.let.rug.nl/nerbonne/teach/statistiek-i/ John Nerbonne 1/36 Overview 1 Mann-Whitney U-Test 2 Wilcoxon s Signed

More information

= n. The sample variance. Version Revision Date: July 2009

= n. The sample variance. Version Revision Date: July 2009 s = n i= 1 ( ) X X i n 1 = SS DF The sample variance Version 1.0 Revision Date: July 009 David J. Moriarty Biological Sciences Department California State Polytechnic University BIO 11 Test Pac Version

More information

The Gaussian distribution (normal distribution)

The Gaussian distribution (normal distribution) The Gaussian distribution (normal distribution) When the distribution of the observations is normal, then 95% of all observation are located in the interval: mean-1.96 SD to mean+1.96 SD represents a descriptive

More information

Hypothesis Testing Level I Quantitative Methods. IFT Notes for the CFA exam

Hypothesis Testing Level I Quantitative Methods. IFT Notes for the CFA exam Hypothesis Testing 2014 Level I Quantitative Methods IFT Notes for the CFA exam Contents 1. Introduction... 3 2. Hypothesis Testing... 3 3. Hypothesis Tests Concerning the Mean... 10 4. Hypothesis Tests

More information

CHAPTER 14 NONPARAMETRIC TESTS

CHAPTER 14 NONPARAMETRIC TESTS CHAPTER 14 NONPARAMETRIC TESTS Everything that we have done up until now in statistics has relied heavily on one major fact: that our data is normally distributed. We have been able to make inferences

More information

Tests of relationships between variables Chi-square Test Binomial Test Run Test for Randomness One-Sample Kolmogorov-Smirnov Test.

Tests of relationships between variables Chi-square Test Binomial Test Run Test for Randomness One-Sample Kolmogorov-Smirnov Test. N. Uttam Singh, Aniruddha Roy & A. K. Tripathi ICAR Research Complex for NEH Region, Umiam, Meghalaya uttamba@gmail.com, aniruddhaubkv@gmail.com, aktripathi2020@yahoo.co.in Non Parametric Tests: Hands

More information

Paired t-test & Friedman test

Paired t-test & Friedman test Paired t-test & Friedman test Journal Club: Statistical Methodology in Nutrition Education and Behavior Research Barbara Lohse, PhD, RD, LDN April 20, 2015 lohseb@psu.edu www.needscenter.org t-test for

More information

Non-Parametric Two-Sample Analysis: The Mann-Whitney U Test

Non-Parametric Two-Sample Analysis: The Mann-Whitney U Test Non-Parametric Two-Sample Analysis: The Mann-Whitney U Test When samples do not meet the assumption of normality parametric tests should not be used. To overcome this problem, non-parametric tests can

More information

Parametric and non-parametric statistical methods for the life sciences - Session I

Parametric and non-parametric statistical methods for the life sciences - Session I Why nonparametric methods What test to use? Rank Tests Parametric and non-parametric statistical methods for the life sciences - Session I Liesbeth Bruckers Geert Molenberghs Interuniversity Institute

More information

Lecture Notes H: More Hypothesis Testing - ANOVA, the Chi Square Test and the Kolmogorov-Smirnov Test for Normality

Lecture Notes H: More Hypothesis Testing - ANOVA, the Chi Square Test and the Kolmogorov-Smirnov Test for Normality ECON 497 Lecture H Page 1 of 1 Metropolitan State University ECON 497: Research and Forecasting Lecture Notes H: More Hypothesis Testing - ANOVA, the Chi Square Test and the Kolmogorov-Smirnov Test for

More information

Review of the Topics for Midterm II

Review of the Topics for Midterm II Review of the Topics for Midterm II STA 100 Lecture 18 I. Confidence Interval 1. Point Estimation a. A point estimator of a parameter is a statistic used to estimate that parameter. b. Properties of a

More information

Intrinsically Ties Adjusted Non-Parametric Method for the Analysis of Two Sampled Data

Intrinsically Ties Adjusted Non-Parametric Method for the Analysis of Two Sampled Data Journal of Modern Applied Statistical Methods Volume Issue Article 8 --03 Intrinsically Ties Adjusted Non-Parametric Method for the Analysis of Two Sampled Data G. U. Ebuh Nnamdi Azikiwe University, Awka,

More information

Parametric Statistics 1 Nonparametric Statistics

Parametric Statistics 1 Nonparametric Statistics Parametric Statistics 1 Nonparametric Statistics Timothy C. Bates tim.bates@ed.ac.uk Assume data are drawn from samples with a certain distribution (usually normal) Compute the likelihood that groups are

More information

Contents 1. Contents

Contents 1. Contents Contents 1 Contents 3 K-sample Methods 2 3.1 Setup............................ 2 3.2 Classic Method Based on Normality Assumption..... 3 3.3 Permutation F -test.................... 5 3.4 Kruskal-Wallis

More information

Testing Group Differences using T-tests, ANOVA, and Nonparametric Measures

Testing Group Differences using T-tests, ANOVA, and Nonparametric Measures Testing Group Differences using T-tests, ANOVA, and Nonparametric Measures Jamie DeCoster Department of Psychology University of Alabama 348 Gordon Palmer Hall Box 870348 Tuscaloosa, AL 35487-0348 Phone:

More information

Chapter 16 Appendix. Nonparametric Tests with Excel, JMP, Minitab, SPSS, CrunchIt!, R, and TI-83-/84 Calculators

Chapter 16 Appendix. Nonparametric Tests with Excel, JMP, Minitab, SPSS, CrunchIt!, R, and TI-83-/84 Calculators The Wilcoxon Rank Sum Test Chapter 16 Appendix Nonparametric Tests with Excel, JMP, Minitab, SPSS, CrunchIt!, R, and TI-83-/84 Calculators These nonparametric tests make no assumption about Normality.

More information

Difference tests (2): nonparametric

Difference tests (2): nonparametric NST 1B Experimental Psychology Statistics practical 3 Difference tests (): nonparametric Rudolf Cardinal & Mike Aitken 10 / 11 February 005; Department of Experimental Psychology University of Cambridge

More information

Deciding which statistical test to use:

Deciding which statistical test to use: Deciding which statistical test to use: (b) Parametric tests: z-scores (one score compared against the distribution of scores to which it belongs) Relationship between two IV s - Pearson s r (correlation

More information

Permutation Tests for Comparing Two Populations

Permutation Tests for Comparing Two Populations Permutation Tests for Comparing Two Populations Ferry Butar Butar, Ph.D. Jae-Wan Park Abstract Permutation tests for comparing two populations could be widely used in practice because of flexibility of

More information

Comparing Two Means. Aims

Comparing Two Means. Aims Comparing Two Means Dr. Andy Field Aims T tests Dependent (aka paired, matched) Independent Rationale for the tests Assumptions Interpretation Reporting results Calculating an Effect Size T tests as a

More information

Non-Parametric Analysis

Non-Parametric Analysis Non-Parametric Analysis 27 Nov 2009 CPSY501 Dr. Sean Ho Trinity Western University Please download: relationships.sav Field-Looks_Charis.sav Outline for today Non-Parametric Between-subjects Tests: 2 groups:

More information

How to choose a statistical test. Francisco J. Candido dos Reis DGO-FMRP University of São Paulo

How to choose a statistical test. Francisco J. Candido dos Reis DGO-FMRP University of São Paulo How to choose a statistical test Francisco J. Candido dos Reis DGO-FMRP University of São Paulo Choosing the right test One of the most common queries in stats support is Which analysis should I use There

More information

CHAPTER 5 NON-PARAMETRIC TESTS

CHAPTER 5 NON-PARAMETRIC TESTS CHAPTER 5 NON-PARAMETRIC TESTS The methods described in chapter 4 are all based on the following assumptions: 1. Simple random sample. 2. The data is numeric. 3. The data is normally distributed. 4. For

More information

Analysis of Variance: Part 2

Analysis of Variance: Part 2 Analysis of Variance: Part 2 Oneway Repeated Measures ANOVA Threats to Internal Validity History Maturation Testing Instrumentation Statistical Regression Experimental Mortality Selection-maturation interaction

More information

1.5 Oneway Analysis of Variance

1.5 Oneway Analysis of Variance Statistics: Rosie Cornish. 200. 1.5 Oneway Analysis of Variance 1 Introduction Oneway analysis of variance (ANOVA) is used to compare several means. This method is often used in scientific or medical experiments

More information

Analysis of numerical data S4

Analysis of numerical data S4 Basic medical statistics for clinical and experimental research Analysis of numerical data S4 Katarzyna Jóźwiak k.jozwiak@nki.nl 22nd November 2016 1/44 Hypothesis tests: numerical and ordinal data 1 group:

More information