Viewing Ecological data using R graphics



Similar documents
Graphics in R. Biostatistics 615/815

Linear Discriminant Analysis

Each function call carries out a single task associated with drawing the graph.

Data Visualization in R

Tutorial 3: Graphics and Exploratory Data Analysis in R Jason Pienaar and Tom Miller

Visualizing Data. Contents. 1 Visualizing Data. Anthony Tanbakuchi Department of Mathematics Pima Community College. Introductory Statistics Lectures

R Graphics II: Graphics for Exploratory Data Analysis

Time Series Analysis AMS 316

Getting started with qplot

Variable: characteristic that varies from one individual to another in the population

Getting Started with R and RStudio 1

Iris Sample Data Set. Basic Visualization Techniques: Charts, Graphs and Maps. Summary Statistics. Frequency and Mode

Prof. Nicolai Meinshausen Regression FS R Exercises

Table of Useful R commands

Data Exploration Data Visualization

Exploratory Data Analysis

Data Mining: Exploring Data. Lecture Notes for Chapter 3. Slides by Tan, Steinbach, Kumar adapted by Michael Hahsler

Diagrams and Graphs of Statistical Data

Introduction to R and Exploratory data analysis

sample median Sample quartiles sample deciles sample quantiles sample percentiles Exercise 1 five number summary # Create and view a sorted

Statistical Models in R

Data Mining: Exploring Data. Lecture Notes for Chapter 3. Introduction to Data Mining

Descriptive statistics Statistical inference statistical inference, statistical induction and inferential statistics

Tutorial 2: Descriptive Statistics and Exploratory Data Analysis

Exploratory data analysis (Chapter 2) Fall 2011

Intro to Statistics 8 Curriculum

Big Data and Scripting. Plotting in R

Getting started in Excel

R Graphics Cookbook. Chang O'REILLY. Winston. Tokyo. Beijing Cambridge. Farnham Koln Sebastopol

AMS 7L LAB #2 Spring, Exploratory Data Analysis

GeoGebra Statistics and Probability

Computational Assignment 4: Discriminant Analysis

COM CO P 5318 Da t Da a t Explora Explor t a ion and Analysis y Chapte Chapt r e 3

Data Mining: Exploring Data. Lecture Notes for Chapter 3. Introduction to Data Mining

Graphical Representation of Multivariate Data

SPSS Manual for Introductory Applied Statistics: A Variable Approach

Demographics of Atlanta, Georgia:

Describing, Exploring, and Comparing Data

A Handbook of Statistical Analyses Using R. Brian S. Everitt and Torsten Hothorn

Statistics Revision Sheet Question 6 of Paper 2

# load in the files containing the methyaltion data and the source # code containing the SSRPMM functions

5 Correlation and Data Exploration

STATS8: Introduction to Biostatistics. Data Exploration. Babak Shahbaba Department of Statistics, UCI

Appendix 2.1 Tabular and Graphical Methods Using Excel

STATISTICAL LABORATORY, USING R FOR BASIC STATISTICAL ANALYSIS

Introduction Course in SPSS - Evening 1

Variables. Exploratory Data Analysis

Lecture 2: Exploratory Data Analysis with R

Lecture 2: Descriptive Statistics and Exploratory Data Analysis

Chapter 1: Looking at Data Section 1.1: Displaying Distributions with Graphs

Analysis of System Performance IN2072 Chapter M Matlab Tutorial

Lecture 5 : The Poisson Distribution

Public Health Activities and Services Tracking (PHAST) Interactive Data Visualization Tool User Manual

Data Mining and Visualization

Data Visualization Handbook

Summary of R software commands used to generate bootstrap and permutation test output and figures in Chapter 16

Dongfeng Li. Autumn 2010

An introduction to using Microsoft Excel for quantitative data analysis

Data representation and analysis in Excel

Exploratory Spatial Data Analysis

Descriptive statistics parameters: Measures of centrality

Visualization of missing values using the R-package VIM

Regression and Programming in R. Anja Bråthen Kristoffersen Biomedical Research Group

4 Other useful features on the course web page. 5 Accessing SAS

DATA INTERPRETATION AND STATISTICS

Lab 13: Logistic Regression

How To Test For Significance On A Data Set

Pie Charts. proportion of ice-cream flavors sold annually by a given brand. AMS-5: Statistics. Cherry. Cherry. Blueberry. Blueberry. Apple.

Evaluating the results of a car crash study using Statistical Analysis System. Kennesaw State University

Package survpresmooth

Visualization Quick Guide

ISyE 2028 Basic Statistical Methods - Fall 2015 Bonus Project: Big Data Analytics Final Report: Time spent on social media

IBM SPSS Statistics for Beginners for Windows

MTH 140 Statistics Videos

Using Excel for descriptive statistics

Data Mining with R. Decision Trees and Random Forests. Hugh Murrell

How To Understand The Scientific Theory Of Evolution

Understanding, Identifying & Analyzing Box & Whisker Plots

GeoGebra. 10 lessons. Gerrit Stols

Chapter 2 Exploratory Data Analysis

Basic Statistics and Data Analysis for Health Researchers from Foreign Countries

Graphs. Exploratory data analysis. Graphs. Standard forms. A graph is a suitable way of representing data if:

Exploratory Data Analysis

Data Visualization with R Language

Part 2: Data Visualization How to communicate complex ideas with simple, efficient and accurate data graphics

430 Statistics and Financial Mathematics for Business

Package smoothhr. November 9, 2015

A short course in Longitudinal Data Analysis ESRC Research Methods and Short Course Material for Practicals with the joiner package.

Summarizing and Displaying Categorical Data

Descriptive Statistics

Systat: Statistical Visualization Software

Introduction to Statistics for Psychology. Quantitative Methods for Human Sciences

Why Taking This Course? Course Introduction, Descriptive Statistics and Data Visualization. Learning Goals. GENOME 560, Spring 2012

Opgaven Onderzoeksmethoden, Onderdeel Statistiek

Scatter Plots with Error Bars

Data exploration with Microsoft Excel: univariate analysis

Can SAS Enterprise Guide do all of that, with no programming required? Yes, it can.

Transcription:

Biostatistics Illustrations in Viewing Ecological data using R graphics A.B. Dufour & N. Pettorelli April 9, 2009 Presentation of the principal graphics dealing with discrete or continuous variables. Course proposed at the Institut of Zoology, London, May 2009 Contents 1 Introduction 2 2 Principal graphics for one variable 2 2.1 Discrete variable........................... 2 2.1.1 Already summarized information............. 2 2.1.2 Global data.......................... 3 2.2 Continuous variable......................... 4 3 Relationships between two variables 7 3.1 Two discrete variables........................ 7 3.2 Two continuous variables...................... 11 3.3 One discrete and one continuous variables............. 14 4 Adding an information: two continuous variables and a factor 15 5 Conclusion 17 6 Appendice: Types of point and line 18 6.1 Point Types.............................. 18 6.2 Line Types.............................. 18 1

1 Introduction A.B. Dufour & N. Pettorelli Data viewing is an important first step to data modelling - think for example about detecting outliers and the possible influence of these values on your analysis. Many R packages contain graphic options but we will here focus on two libraries. The first one MASS is included as a bunddle in the bases; the second one (ade4) allows us introducing graphics which are specific to multivariate analysis. library(mass) library(ade4) 2 Principal graphics for one variable 2.1 Discrete variable We will here differentiate two situations, according to the type of data - either you are trying to represent data which have been already summarized (e.g., into frequencies); or the data you are considering are organised in a vector (e.g., vector of binomial values). 2.1.1 Already summarized information This represents the most common situation. Example. The dataset Titanic contains the information on the fate of the passengers. We are interested in representing the number of passengers belonging to the different classes who survived the incident. library(mass) data(titanic) titanclas <- apply(titanic, 1, sum) Based on this information, we can compute two main graphics: the pie chart (pie) and the bar plot (barplot). par(mfrow = c(1, 2)) pie(titanclas) pie(titanclas, main = "Passengers of Titanic", col = rainbow(4)) Passengers of Titanic 2nd 2nd 3rd 1st 3rd 1st Crew Crew Logiciel R version 2.8.1 (2008-12-22) course1.rnw Page 2/19 Compilé le 2009-04-09

par(mfrow = c(1, 2)) barplot(titanclas) barplot(titanclas, main = "Passengers of Titanic", col = rainbow(4)) Passengers of Titanic 0 200 400 600 800 0 200 400 600 800 1st 2nd 3rd Crew 1st 2nd 3rd Crew The most adapted graph is the barplot below since (1) the levels are ordered and (2) the colors follow the class gradient. par(mfrow = c(1, 1)) barplot(titanclas, main = "Passengers of Titanic", col = c("white", "yellow", "orange", "darkred")) Passengers of Titanic 0 200 400 600 800 1st 2nd 3rd Crew Exercise. Create a graph to represent, using the same data set, the age distribution of the survivors. 2.1.2 Global data The data are presented as a vector (one column, n individuals). Each element of the vector contains the modality for the considered individual. Example. The dataset crabs contains information on morphological measurements of 200 crabs belonging to two species (orange and blue). Information has been collected on both sex. Logiciel R version 2.8.1 (2008-12-22) course1.rnw Page 3/19 Compilé le 2009-04-09

data(crabs) varspecies <- summary(crabs$sp) pie(varspecies, col = c("blue", "orange")) B O Exercise. Create a graph to represent, using the same data set, the distribution of the measurements according to gender. 2.2 Continuous variable We will here focus on: 1. the histogram hist 2. the boxplot boxplot 3. the Cleveland dot plot dotchart 4. a minor one: the one dimension scatter plot stripchart Example. The aim of the following example is to represent the distribution of the carapace length (CL) of the orange crabs. caleor <- crabs$cl[crabs$sp == "O"] par(mfrow = c(2, 2)) hist(caleor, main = "Histogram") boxplot(caleor, main = "Boxplot") dotchart(caleor, main = "Cleveland dot plot") stripchart(caleor, main = "Stripchart") Logiciel R version 2.8.1 (2008-12-22) course1.rnw Page 4/19 Compilé le 2009-04-09

Histogram Boxplot Frequency 0 5 10 20 20 30 40 15 25 35 45 caleor Cleveland dot plot Stripchart The histogram can be improved using probability distribution (i.e. the superimposition of a theoretical distribution). We can also modified the breaks (see hist.default for all the histogram information). par(mfrow = c(1, 2)) hist(caleor, freq = FALSE, main = "") brex <- seq(10, 50, by = 10) brex [1] 10 20 30 40 50 hist(caleor, breaks = brex, freq = FALSE, main = "", col = grey(0.8)) Logiciel R version 2.8.1 (2008-12-22) course1.rnw Page 5/19 Compilé le 2009-04-09

Density 0.00 0.02 0.04 Density 0.00 0.02 0.04 15 25 35 45 caleor 10 20 30 40 50 caleor The boxplot is based on the quartiles of the distribution. allows to see each point of the distribution. The function rug par(mfrow = c(1, 1)) boxplot(caleor, col = grey(0.8), main = "carapace lengths", las = 1) rug(caleor, side = 2) carapace lengths 45 40 35 30 25 20 It s also possible to add the median confidence interval on the graph (see boxplot.stats for more information). boxplot(caleor, notch = TRUE, col = grey(0.8), main = "carapace lengths", las = 1) rug(caleor, side = 2) Logiciel R version 2.8.1 (2008-12-22) course1.rnw Page 6/19 Compilé le 2009-04-09

carapace lengths 45 40 35 30 25 20 3 Relationships between two variables 3.1 Two discrete variables The graphics used to represent the relationships between two discrete variables are: mosaicplot() table.cont() Example 1. In Caithness (Scotland), hair and eye colours were determined for 5387 inhabitants. data(caith) caith fair red medium dark black blue 326 38 241 110 3 light 688 116 584 188 4 medium 343 84 909 412 26 dark 98 48 403 681 85 mosaicplot(caith, main = "Colours of Hair and Eye for 5387 inhabitants of Caithness") Logiciel R version 2.8.1 (2008-12-22) course1.rnw Page 7/19 Compilé le 2009-04-09

Colours of Hair and Eye for 5387 inhabitants of Caithness blue light medium dark black dark medium red fair mosaicplot(caith, main = "Colours of Hair and Eye for 5387 inhabitants of Caithness", shade = T) Colours of Hair and Eye for 5387 inhabitants of Caithness blue light medium dark black dark Standardized Residuals: medium red fair < 4 4: 2 2:0 0:2 2:4 >4 table.cont(caith, csize = 2) Logiciel R version 2.8.1 (2008-12-22) course1.rnw Page 8/19 Compilé le 2009-04-09

dark medium light blue black dark medium red fair Some variables can however have a lot of modalities and the graphics don t help to understand the data structure. In such cases, multivariate data analysis, such as correspondence analysis, is the best way to view the data. Example 2. The numbers of waders were counted for 19 species at 15 sites in South Africa. data(waders) waders S1 S2 S3 S4 S5 S6 S7 S8 S9 S10 S11 S12 S13 S14 S15 S16 S17 A 12 2027 0 0 2070 39 219 153 0 15 51 8336 2031 14941 19 3566 0 B 99 2112 9 87 3481 470 2063 28 17 145 31 1515 1917 17321 3378 20164 177 C 197 160 0 4 126 17 1 32 0 2 9 477 1 548 13 273 0 D 0 17 0 3 50 6 4 7 0 1 2 16 0 0 3 69 1 E 77 1948 0 19 310 1 1 64 0 22 81 2792 221 7422 10 4519 12 F 19 203 48 45 20 433 0 0 11 167 12 1 0 26 1790 2916 473 G 1023 2655 0 18 320 49 8 121 9 82 48 3411 14 9101 43 3230 587 H 87 745 1447 125 4330 789 228 529 289 904 34 1710 7869 2247 4558 40880 7166 I 788 2174 0 19 224 178 1 423 0 195 162 2161 25 1784 3 1254 0 J 82 350 760 197 858 962 10 511 251 987 191 34 87 417 4496 15835 5327 K 474 930 0 10 316 161 0 90 0 39 48 1183 166 4626 65 127 4 L 77 249 160 136 999 645 15 851 101 723 266 495 83 1253 1864 4107 1939 M 22 144 0 4 1 1 0 10 0 2 9 125 5 411 0 3 0 N 0 791 0 0 4 38 1 56 1 30 54 95 0 1726 0 0 0 O 0 360 128 43 364 1628 63 287 328 641 850 83 67 48 6499 9094 5647 S18 S19 A 5 0 B 1759 53 C 0 0 D 0 0 E 0 0 F 658 55 G 10 5 H 1632 498 I 0 0 J 1312 1020 K 0 0 L 623 527 M 0 0 N 0 0 O 1333 582 Understanding the structure of such a data set by just looking at the contingency table is clearly impossible. If we try to graphically represent such data set, we obtain: Logiciel R version 2.8.1 (2008-12-22) course1.rnw Page 9/19 Compilé le 2009-04-09

mosaicplot(waders, main = "Wader Species", shade = T) Wader Species A B CD E F G H I J K L MN O S17 S16 S15 S18 S19 Standardized Residuals: S14 S13 S12 S9 S10 S11 S7 S8 S3 S2 S1 S6 S5S4 < 4 4: 2 2:0 0:2 2:4 >4 Alternatively, one can try table.cont. table.cont(waders) O N M L K J I H G F E D C B A S19 S18 S17 S16 S15 S14 S13 S12 S11 S10 S9 S8 S7 S6 S5 S4 S3 S2 S1 Logiciel R version 2.8.1 (2008-12-22) course1.rnw Page 10/19 Compilé le 2009-04-09

3.2 Two continuous variables A typical way of representing the relationship between two continuous variables is the scatter plot. Example 1. Let s study, for instance, the relationship between the length (in mm) and the width (in mm) of the carapaces, focusing here on the orange crab species. cawior <- crabs$cw[crabs$sp == "O"] par(mfrow = c(1, 3)) plot(caleor, cawior) plot(cawior ~ caleor, main = "Length and Width of carapaces") plot(cawior ~ caleor, pch = 20) Length and Width of carapaces cawior 50 cawior 50 cawior 50 caleor caleor caleor Notice that if we want to add some information on the graph, we first need to compute a plot(). par(mfrow = c(1, 1)) plot(cawior ~ caleor, main = "Length and Width of the 100 carapaces", pch = 20, xlab = "length (in mm)", ylab = "width (in mm)") abline(h = mean(cawior), lty = 2, col = grey(0.6)) abline(v = mean(caleor), lty = 2, col = grey(0.6)) points(mean(caleor), mean(cawior), col = "red", pch = 20, cex = 2) Logiciel R version 2.8.1 (2008-12-22) course1.rnw Page 11/19 Compilé le 2009-04-09

Length and Width of the 100 carapaces width (in mm) 50 length (in mm) Exercise. Choose two other continuous variables in this data set and draw the best graph. Sometimes, however, several individuals can get the same values (especially in the case of fixed values). In the classical plot, these individuals will only be represented by one single point. So if we want to see the superimposition of points, we need to use specific arguments in the previous graph or built a new one such as the sunflowerplot. Example 2. Let s examine here the famous data set used by W.S. Gosset (aka Student) to develop the t-test: the body heights and the mid-finger lengths of 3000 criminals. data(crimtab) table.cont(crimtab) 13.5 13.4 13.3 13.2 13.1 12.9 13 12.8 12.7 12.6 12.5 12.4 12.3 12.2 12.1 11.9 12 11.8 11.7 11.6 11.5 11.4 11.3 11.2 11.1 10.9 11 10.8 10.7 10.6 10.5 10.4 10.3 10.2 10.1 9.9 10 9.8 9.7 9.6 9.5 9.4 Logiciel R version 2.8.1 (2008-12-22) course1.rnw Page 12/19 Compilé le 2009-04-09

crimtab.dft <- as.data.frame(crimtab) expand.dft <- function(x, na.strings = "NA", as.is = FALSE, dec = ".") { DF <- sapply(1:nrow(x), function(i) x[rep(i, each = x$freq[i]), ], simplify = FALSE) DF <- subset(do.call("rbind", DF), select = -Freq) for (i in 1:ncol(DF)) { DF[[i]] <- type.convert(as.character(df[[i]]), na.strings = na.strings, as.is = as.is, dec = dec) } DF } crimtab.raw <- expand.dft(crimtab.dft) x <- crimtab.raw[, 1] y <- crimtab.raw[, 2] plot(x, y, las = 1, main = "3000 criminals", ylab = "Body height [cm]", xlab = "Left mid finger [cm]") 3000 criminals Body height [cm] 190 180 170 160 150 10 11 12 13 Left mid finger [cm] If we want to see all the points, one possible solution is to jitter the data. plot(jitter(x), jitter(y), las = 1, main = "3000 criminals", ylab = "Body height [cm]", xlab = "Left mid finger [cm]") Logiciel R version 2.8.1 (2008-12-22) course1.rnw Page 13/19 Compilé le 2009-04-09

3000 criminals 190 Body height [cm] 180 170 160 150 140 10 11 12 13 Left mid finger [cm] Another option is the sunflowerplot. The number of repetitions is represented by the number of petals around a point. sunflowerplot(x, y, las = 1, main = "3000 criminals", ylab = "Body height [cm]", xlab = "Left mid finger [cm]") 3000 criminals 190 Body height [cm] 180 170 160 150 10 11 12 13 Left mid finger [cm] Exercise. Is there any visible repetition when exploring the relationship between length and width of carapaces (focusing again on orange crabs)? 3.3 One discrete and one continuous variables The main displays to link discrete and continuous variables are the boxplot or the dotchart graphics. Logiciel R version 2.8.1 (2008-12-22) course1.rnw Page 14/19 Compilé le 2009-04-09

Example. Let s explore the relationship between carapace length and sex in orange crabs. crabsex <- crabs$sex[crabs$sp == "O"] par(mfrow = c(2, 2)) par(mar = c(3, 2, 2, 2)) boxplot(caleor ~ crabsex) boxplot(caleor ~ crabsex, col = c("pink", "lightblue"), notch = TRUE) dotchart(caleor, groups = crabsex) dotchart(caleor, groups = crabsex, gdata = tapply(caleor, crabsex, mean), pch = 20, gpch = 20, gcol = "red") par(mfrow = c(1, 1)) F M F M F M F M Exercise. The data contains 4 other continuous variables. Produce a representation, in the same graphical device, of the relationship between each variable and sex. 4 Adding an information: two continuous variables and a factor We are here interested in computing three variables together (e.g., relationship between sepal length and width of the famous Iris dataset, for the three species Logiciel R version 2.8.1 (2008-12-22) course1.rnw Page 15/19 Compilé le 2009-04-09

- Iris setosa, Iris versicolor and Iris virginica). Two main representations can be used: coplot and s.class of the ade4 package. data(iris) names(iris) [1] "Sepal.Length" "Sepal.Width" "Petal.Length" "Petal.Width" "Species" coplot(iris$sepal.width ~ iris$petal.length iris$species) Given : iris$species virginica versicolor setosa 1 2 3 4 5 6 7 iris$sepal.width 2.0 2.5 3.0 3.5 4.0 2.0 2.5 3.0 3.5 4.0 1 2 3 4 5 6 7 iris$petal.length par(mfrow = c(2, 2)) s.class(iris[, 1:2], iris$species) s.class(scale(iris[, 1:2], center = T, scale = F), iris$species) s.class(scale(iris[, 1:2], center = T, scale = F), iris$species, cstar = 0, cpoint = 0) s.class(scale(iris[, 1:2], center = T, scale = F), iris$species, cellipse = 0) Logiciel R version 2.8.1 (2008-12-22) course1.rnw Page 16/19 Compilé le 2009-04-09

d = 2 setosa versicolor virginica d = 1 setosa versicolor virginica d = 1 setosa versicolor virginica d = 1 setosa versicolor virginica Exercise. The data set contains 3 species and 4 measurements. Produce a representation of the relationship between two measurements and species. 5 Conclusion Data viewing is a crucial first step to data modelling. Remembering functions can be challenging. provides some help such as: 1. help.start() opens a window with an interface for HTML help. 2. RSiteSearch("hist") looks for information on the website (manuals, documentation, archives,... ) 3. help.search("hist") opens a page to inform where to find good explanations 4. help("hist") opens a page giving all the information about the research object. Logiciel R version 2.8.1 (2008-12-22) course1.rnw Page 17/19 Compilé le 2009-04-09

6 Appendice: Types of point and line 6.1 Point Types 1 7 13 19 25 + + 2 8 14 20 * * 3 9 15 21. : : 4 10 16 22 o o 5 11 17 23 OO %% 6 12 18 24 0 0 # # 1. The point type is given by the pch argument. For instance, empty circles (by default) is pch = 1 (see more information on the appendix of the document). 2. The colour of a point is given by the col argument. For instance, we used the red to compute the previous graphic using col = "red". 3. The inside colour of a point is given by the bg argument. For instance, we used the yellow to compute the previous graphic using bg = "yellow". 4. For more details, look at the points() function. 6.2 Line Types n <- 7 plot(0:n, 0:n, type = "n", xlim = c(0, n + 1), ylim = c(0, n + 1)) for (i in 1:n) { lines(1:n, rep(i, n), lwd = 3, lty = i) } Logiciel R version 2.8.1 (2008-12-22) course1.rnw Page 18/19 Compilé le 2009-04-09

0:n 0 2 4 6 8 0 2 4 6 8 0:n Line types are given by the lty argument. For instance, the continuous line type (by default) is lty = 1 (see more information on the appendix of the document). You may find useful to read the Graphical procedures chapter from An Introduction to R (following the menu Help, Manuals). Logiciel R version 2.8.1 (2008-12-22) course1.rnw Page 19/19 Compilé le 2009-04-09