# Types of Error in Surveys

Save this PDF as:

Size: px
Start display at page:

## Transcription

1 2 Types of Error in Surveys Surveys are designed to produce statistics about a target population. The process by which this is done rests on inferring the characteristics of the target population from the answers provided by a sample of respondents. This chapter outlines the two kinds of inferences that are required. It also describes the two types of error, bias and variability, that can limit the accuracy of those inferences. Two of the main goals of survey methodology are to minimize error in data collected by surveys and to measure the error that necessarily is part of any survey. Chapters 3 through 9 describe in detail strategies for minimizing and measuring error. In order to appreciate those chapters, and to understand survey methodology, it is first necessary to understand what we mean by error. As we have said, the purpose of a survey is to provide statistical estimates of the characteristics of a target population, some set of people. To do that we designate a subset of that population, a sample, from whom we try to collect information. One fundamental premise of the survey process is that by describing the sample of people who actually respond, one can describe the target population. The hope is that the characteristics the survey is designed to describe are present to the same degree, and are distributed in the same way, in the sample responding as in the target population as a whole. The other defining characteristic of a survey is that respondents answer questions. The answers to the questions are used to describe the experiences, opinions, and other characteristics of those answering the questions. A second fundamental premise of the survey research process is that the answers people give can be used to accurately describe characteristics of the respondents. The extent to which those answers are not accurate measures is the second fundamental source of error in surveys. Figure 2.1 shows in graphic form the way analysis of survey data works and the inferences on which it is based. The goal is to learn the characteristics of the target population. The material we have to work with consists of the answers the respondents gave in the survey. We tabulate the answers and would like to make the assumption that the answers are accurate measures of the characteristics of the respondents we are trying to measure. We then would 11

2 12 SURVEY RESEARCH METHODS Characteristics of Population Sample of population members who answer questions Issue How closely sample responding mirrors population Issue How well answers measure characteristics to be described Answers respondents give Figure 2.1 Inference in Survey Research like to be able to further assume that by describing the sample of respondents, we are accurately describing the entire target population. Some aspects of survey methodology are designed to address how closely a sample of respondents mirrors the population. Some aspects of survey methodology are designed to address how well the answers to the questions collected in the survey serve as measures of what they are intended to measure. The design of the survey and the way data collection is carried out can affect one or both of these potential sources of error. ERROR ASSOCIATED WITH WHO ANSWERS Any time a sample is drawn from a larger population, there is some chance that by chance alone that sample will differ from the total population from which it was drawn. A simple example that statisticians like to use is flipping a coin, which is heads on one side and tails on the other. Even if the coin is

3 TYPES OF ERROR IN SURVEYS 13 perfectly fair, a sample of 10 flips will not always produce 5 heads and 5 tails. While 5 heads and 5 tails will be most common, a certain number of samples of 10 flips will produce 6 heads or 4 heads; 3 and 7 heads will be less common; 8 or 2 heads will be even less common; even more extreme distributions will be increasingly less common, but even those will occur if enough samples of 10 flips of a coin are actually tried. In the same way, if a population consists of 50% males and 50% females, any particular sample may by chance have more or fewer females than one would expect from the population as a whole. In a sample survey, we usually only have a single sample from which to generalize. By chance, that sample can and will differ slightly from what it would look like if it perfectly mirrored the distribution of characteristics in the population. One goal of survey methodology is to minimize the random differences between the sample and the population. The way the sample is designed and selected can affect how closely the sample is likely to mirror the characteristics of the population from which it is drawn. One kind of error of concern to survey methodologists is this random variation from the true characteristics of the population. This variation, the possible error that stems solely from the fact that data are collected from a sample rather than from every single member of the population, is called sampling error. It is one kind of error survey methodologists try to minimize. A second kind of error that affects the relationship between a sample of respondents and of the population is bias. Bias means that in some systematic way the people responding to a survey are different from the target population as a whole. There are three steps in the process of collecting data from a sample, each of which could, potentially, introduce bias into a sample: 1. The first step involves choosing the sample frame, those who actually have a chance to be selected. If there are some people in the target population who do not have any chance at all to be selected for the sample, and if they are somehow consistently different from those who do have a chance to be selected, the resulting sample will be biased in those ways. As an example, most surveys in the United States leave out people who live in group homes, such as prisons, convents, and nursing homes, and they leave out people who have no home address at all. Most telephone surveys not only leave out those without any telephone service at all but also those households that only have cell phones. For variables on which those people who are included are different from those who are systematically left out, the samples from whom data are collected will be biased as well.

4 14 SURVEY RESEARCH METHODS 2. If somehow the process of selecting who is in the sample is not random, the result could be a sample of respondents who are different from the target population as a whole. For example, if a sample consists of people who volunteer to be in a survey, they are likely to have a different profile of interests than those who do not volunteer. 3. Finally, failure to collect answers from everyone selected to be in the sample is a third potential source of bias. Some people are not available to answer questions; some people are unable to answer questions, due to their health or their language skills; some people refuse to answer the questions. To the extent that those who are unavailable, unable, or unwilling to answer questions are different from the rest of the population in ways that affect the survey answers, the results of the survey may be biased. It is important to understand the distinction between the two kinds of errors in data. Sampling error, the first kind of error that was discussed, is random error. By chance, sometimes there will be too many females in the sample, sometimes too few, but on average, a series of properly drawn samples will have very close to the same percentage of females as the population as a whole. A challenge for methodologists is to minimize the variability from sample to sample to increase the likelihood that any given sample is very close to the population as a whole. In contrast, features of the design or execution of a survey that bias samples will, on average, produce estimates that are consistently different from the target population as whole. So, when samples are drawn only from those who live in households, excluding those who are homeless and live in group quarters, the average income is likely to be higher in those who respond than among those who had no chance to respond. Those in households also are more likely to be married and to have jobs than those without homes. Estimates from those responding to surveys based on households will systematically overestimate the percentage of the whole population that have those characteristics. One final point to note is that the random variability of sample estimates, the sampling error, and the bias associated with a sample, are not necessarily related at all. If a survey plan systematically leaves out, or underrepresents, some people who are distinctive in ways relevant to the survey s goals, it is quite possible to have a very consistent and stable estimate, with very little sampling error, that is consistently biased and under- or overestimates some characteristics of the population. ERROR ASSOCIATED WITH ANSWERS In order to understand error associated with answers to survey questions, one first needs to understand what is being measured. In theory, one could divide

7 TYPES OF ERROR IN SURVEYS 17 TABLE 2.1 Examples of Error by Types of Error and Type of Inference Inference From sample to population From answers to true characteristics Random Sampling error Invalidity Types of Error Biased Example: Those who are over 65 are consistently less likely to respond to telephone surveys, and hence are underrepresented in telephone survey data Example: Number of cigarettes smoked is consistently underreported in surveys the population, or is there some kind of systematic (biasing) error in our data, stemming either from having some elements of the population underrepresented in our sample of respondents or from some systematic distortion of answers to the questions that we posed? Table 2.1 graphically displays four kinds of error that affect our survey estimates. When trying to evaluate the confidence one can have in estimates based on surveys, it is important to keep in mind all four of these kinds of error. They are different, they usually result from different aspects of the way a survey is executed, and they have different impacts on the ability of a survey to address the questions it is designed to answer. Given this orientation to the various meanings of error, we now proceed to discuss the significance of the way a survey is designed and executed for the confidence one can have in the survey results. Further Readings Groves, R. M. (1989). Survey errors and survey costs. New York: John Wiley. Groves, R. M., Fowler, F. J., Couper, M. P., Lepkowski, J. M., Singer, E., & Tourangeau, R. (2004). Survey methodology (Chap. 2). New York: John Wiley. Lessler, J. T., & Kalsbeek, W. D. (1992). Nonsampling error in surveys. New York: John Wiley.

8

### Statistics Notes Revision in Maths Week

Statistics Notes Revision in Maths Week 1 Section - Producing Data 1.1 Introduction Statistics is the science that studies the collection and interpretation of numerical data. Statistics divides the study

### CALCULATIONS & STATISTICS

CALCULATIONS & STATISTICS CALCULATION OF SCORES Conversion of 1-5 scale to 0-100 scores When you look at your report, you will notice that the scores are reported on a 0-100 scale, even though respondents

### Chapter 8: Quantitative Sampling

Chapter 8: Quantitative Sampling I. Introduction to Sampling a. The primary goal of sampling is to get a representative sample, or a small collection of units or cases from a much larger collection or

### DETERMINING SURVEY SAMPLE SIZE A SIMPLE PLAN

DETERMINING SURVEY SAMPLE SIZE A SIMPLE PLAN Prepared by Market Directions Market Directions B O S T O N 617-323-1862 800-475-9808 www.marketdirectionsmr.com info@marketdirectionsmr.com DETERMING SAMPLE

### Survey Research. Classifying surveys on the basis of their scope and their focus gives four categories:

Survey Research Types of Surveys Surveys are classified according to their focus and scope (census and sample surveys) or according to the time frame for data collection (longitudinal and cross-sectional

### A GUIDE TO SAMPLING & STATISTICAL RELIABILITY

July 2009 Technical Note 5 A GUIDE TO SAMPLING & STATISTICAL RELIABILITY The word survey is used most often to describe a method of gathering information from a sample of individuals. This sample is usually

### Research Design Concepts. Independent and dependent variables Data types Sampling Validity and reliability

Research Design Concepts Independent and dependent variables Data types Sampling Validity and reliability Research Design Action plan for carrying out research How the research will be conducted to investigate

### Fairfield Public Schools

Mathematics Fairfield Public Schools AP Statistics AP Statistics BOE Approved 04/08/2014 1 AP STATISTICS Critical Areas of Focus AP Statistics is a rigorous course that offers advanced students an opportunity

### CONFIDENCE INTERVALS I

CONFIDENCE INTERVALS I ESTIMATION: the sample mean Gx is an estimate of the population mean µ point of sampling is to obtain estimates of population values Example: for 55 students in Section 105, 45 of

### Methods: Simple Random Sampling Topics: Introduction to Simple Random Sampling

Methods: Simple Random Sampling Topics: Introduction to Simple Random Sampling - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - The Rwanda 2010 Demographic and Health Survey

Telephone and Mail Surveys: Advantages and Disadvantages of Each Dan Zahs and Reg Baker Market Strategies, Inc. May 29, 2007 Selecting the mode of administration for a survey requires that one evaluate

Chapter 11 Testing Hypotheses About Proportions Hypothesis testing method: uses data from a sample to judge whether or not a statement about a population may be true. Steps in Any Hypothesis Test 1. Determine

### Missing Data. A Typology Of Missing Data. Missing At Random Or Not Missing At Random

[Leeuw, Edith D. de, and Joop Hox. (2008). Missing Data. Encyclopedia of Survey Research Methods. Retrieved from http://sage-ereference.com/survey/article_n298.html] Missing Data An important indicator

### Mode and Patient-mix Adjustment of the CAHPS Hospital Survey (HCAHPS)

Mode and Patient-mix Adjustment of the CAHPS Hospital Survey (HCAHPS) April 30, 2008 Abstract A randomized Mode Experiment of 27,229 discharges from 45 hospitals was used to develop adjustments for the

### SAMPLING SIZE DETERMINATION IN FARMER SURVEYS. ICRAF Research Support Unit. Technical Note 4. Ric Coe Version January 1996

ICRAF Research Support Unit Technical Note 4 SAMPLING SIZE DETERMINATION IN FARMER SURVEYS Ric Coe Version January 1996 ICRAF World Agroforestry Centre PO Box 30677, Nairobi, Kenya Telephone : +54 54 000

### Basic Probability Theory I

A Probability puzzler!! Basic Probability Theory I Dr. Tom Ilvento FREC 408 Our Strategy with Probability Generally, we want to get to an inference from a sample to a population. In this case the population

### Table of Random Digits

Table of Random Digits A table can be given that represents a list of completely random digits it is essentially like picking from a hat Each entry is equally likely to be any digit The entries are independent

### Survey Sampling. Know How No 9 guidance for research and evaluation in Fife. What this is about? Who is it for? What do you need to know?

guidance for research and evaluation in Fife What this is about? Sampling allows you to draw conclusions about a particular population by examining a part of it. When carrying out a survey, it is not usually

### An Introduction to Sampling

An Introduction to Sampling Sampling is the process of selecting a subset of units from the population. We use sampling formulas to determine how many to select because it is based on the characteristics

### Non-response bias in a lifestyle survey

Journal of Public Health Medicine Vol. 19, No. 2, pp. 203-207 Printed in Great Britain Non-response bias in a lifestyle survey Anthony Hill, Julian Roberts, Paul Ewings and David Gunnell Summary Background

### Research Variables. Measurement. Scales of Measurement. Chapter 4: Data & the Nature of Measurement

Chapter 4: Data & the Nature of Graziano, Raulin. Research Methods, a Process of Inquiry Presented by Dustin Adams Research Variables Variable Any characteristic that can take more than one form or value.

### Carolyn Anderson & Youngshil Paek (Slides created by Shuai Sam Wang) Department of Educational Psychology University of Illinois at Urbana-Champaign

Carolyn Anderson & Youngshil Paek (Slides created by Shuai Sam Wang) Department of Educational Psychology University of Illinois at Urbana-Champaign Key Points 1. Data 2. Variable 3. Types of data 4. Define

### Inferential Statistics

Inferential Statistics Sampling and the normal distribution Z-scores Confidence levels and intervals Hypothesis testing Commonly used statistical methods Inferential Statistics Descriptive statistics are

### CHOOSING AMONG THE VARIOUS TYPES OF INTERNET SURVEYS

Chapter Four CHOOSING AMONG THE VARIOUS TYPES OF INTERNET SURVEYS Here, we examine the various types of Internet surveys and the differences among them that factor into deciding what sort of survey is

### Market research is a key component in the process of developing

T OOL 10 A Guide to Designing Surveys José Linares Fontela Market research is a key component in the process of developing and marketing savings products. Among the most useful market research tools is

### STATISTICS 8 CHAPTERS 1 TO 6, SAMPLE MULTIPLE CHOICE QUESTIONS

STATISTICS 8 CHAPTERS 1 TO 6, SAMPLE MULTIPLE CHOICE QUESTIONS Correct answers are in bold italics.. This scenario applies to Questions 1 and 2: A study was done to compare the lung capacity of coal miners

### 5. {Boat show narrative} Specify who/what the units are in this study. ANSWER: THE UNITS ARE THE BOAT SHOW PARTICIPANTS.

Quiz CHAPTER 4 Name: 1. What is the most important advantage of using a randomized experiment vs. an observational study, in terms of the statistical results? ANSWER: RANDOMIZED EXPERIMENTS, UNLIKE OBSERVATIONAL

### 2015 Michigan Department of Health and Human Services Adult Medicaid Health Plan CAHPS Report

2015 State of Michigan Department of Health and Human Services 2015 Michigan Department of Health and Human Services Adult Medicaid Health Plan CAHPS Report September 2015 Draft Draft 3133 East Camelback

### A Comparison of Level of Effort and Benchmarking Approaches for Nonresponse Bias Analysis of an RDD Survey

A Comparison of Level of Effort and Benchmarking Approaches for Nonresponse Bias Analysis of an RDD Survey Daifeng Han and David Cantor Westat, 1650 Research Blvd., Rockville, MD 20850 Abstract One method

### This chapter discusses some of the basic concepts in inferential statistics.

Research Skills for Psychology Majors: Everything You Need to Know to Get Started Inferential Statistics: Basic Concepts This chapter discusses some of the basic concepts in inferential statistics. Details

### EXPERIMENT 6: HERITABILITY AND REGRESSION

BIO 184 Laboratory Manual Page 74 EXPERIMENT 6: HERITABILITY AND REGRESSION DAY ONE: INTRODUCTION TO HERITABILITY AND REGRESSION OBJECTIVES: Today you will be learning about some of the basic ideas and

### Sample Size Determination

Sample Size Determination Population A: 10,000 Population B: 5,000 Sample 10% Sample 15% Sample size 1000 Sample size 750 The process of obtaining information from a subset (sample) of a larger group (population)

About Sampling TABLE OF CONTENTS About Sampling... 1 Why is SAMPLING important?... 1 Common Language... 1 Probability & Nonprobability Sampling... 1 Sampling Methods... 2 Simple Random Sample (SRS)...

### Hypothesis Testing with z Tests

CHAPTER SEVEN Hypothesis Testing with z Tests NOTE TO INSTRUCTOR This chapter is critical to an understanding of hypothesis testing, which students will use frequently in the coming chapters. Some of the

### EAA492/6: FINAL YEAR PROJECT DEVELOPING QUESTIONNAIRES PART 2 A H M A D S H U K R I Y A H A Y A E N G I N E E R I N G C A M P U S U S M

EAA492/6: FINAL YEAR PROJECT DEVELOPING QUESTIONNAIRES PART 2 1 A H M A D S H U K R I Y A H A Y A E N G I N E E R I N G C A M P U S U S M CONTENTS Reliability And Validity Sample Size Determination Sampling

### Attitudes and Beliefs about Social Determinants of Health. Halton Region Health Department

Attitudes and Beliefs about Social Determinants of Health Halton Region Health Department May 2014 Contents Background... 3 A Comparison of 10 Social Determinants of Health... 4 Key Demographic Findings...

### The Philosophy of Hypothesis Testing, Questions and Answers 2006 Samuel L. Baker

HYPOTHESIS TESTING PHILOSOPHY 1 The Philosophy of Hypothesis Testing, Questions and Answers 2006 Samuel L. Baker Question: So I'm hypothesis testing. What's the hypothesis I'm testing? Answer: When you're

### Independent samples t-test. Dr. Tom Pierce Radford University

Independent samples t-test Dr. Tom Pierce Radford University The logic behind drawing causal conclusions from experiments The sampling distribution of the difference between means The standard error of

### Population and sample. Sampling techniques

MaMaEuSch Management Mathematics for European Schools http://www.mathematik.unikl.de/ mamaeusch Population and sample. Sampling techniques Paula Lagares Barreiro Justo Puerto Albandoz MaMaEuSch Management

### AARP MEMBER OPINIONS ON SUPPORTIVE SERVICES IN GEORGIA

INTRODUCTION: In response to the recent economic downturn, the State of Georgia is looking at cuts to programs and services as a way to balance the state budget. At the same time, the sandwich generation,

### Testing Scientific Explanations (In words slides page 7)

Testing Scientific Explanations (In words slides page 7) Most people are curious about the causes for certain things. For example, people wonder whether exercise improves memory and, if so, why? Or, we

### Internet, broadband, and cell phone statistics

Internet, broadband, and cell phone statistics As of December 2009, 74% of American adults (ages 18 and older) use the internet. January 2010 Lee Rainie Director View Report Online: http://www.pewinternet.org/reports/2010/internet-broadband-and-cell-phone-statistics.aspx

### These days, surveys are used everywhere and for many reasons. For example, surveys are commonly used to track the following:

The previous handout provided an overview of study designs. The two broad classifications discussed were randomized experiments and observational studies. In this handout, we will briefly introduce a specific

### Sampling Distributions and the Central Limit Theorem

135 Part 2 / Basic Tools of Research: Sampling, Measurement, Distributions, and Descriptive Statistics Chapter 10 Sampling Distributions and the Central Limit Theorem In the previous chapter we explained

### POLI 300 Handout #2 N. R. Miller RANDOM SAMPLING. Key Definitions Pertaining to Sampling

POLI 300 Handout #2 N. R. Miller Key Definitions Pertaining to Sampling RANDOM SAMPLING 1. Population: the set of units (in survey research, usually individuals or households), N in number, that are to

### Sampling Distribution of the Mean & Hypothesis Testing

Sampling Distribution of the Mean & Hypothesis Testing Let s first review what we know about sampling distributions of the mean (Central Limit Theorem): 1. The mean of the sampling distribution will be

### Sample Size Issues for Conjoint Analysis

Chapter 7 Sample Size Issues for Conjoint Analysis I m about to conduct a conjoint analysis study. How large a sample size do I need? What will be the margin of error of my estimates if I use a sample

### Sampling & Sample Size Estimation

Sampling & Sample Size Estimation Moazzam Ali MD, PhD, MPH Department of Reproductive Health and Research World Health Organization Geneva, Switzerland Presented at: GFMER September 16, 2014 Topics to

### Binomial Probability Distribution

Binomial Probability Distribution In a binomial setting, we can compute probabilities of certain outcomes. This used to be done with tables, but with graphing calculator technology, these problems are

### Need for Sampling. Very large populations Destructive testing Continuous production process

Chapter 4 Sampling and Estimation Need for Sampling Very large populations Destructive testing Continuous production process The objective of sampling is to draw a valid inference about a population. 4-

### Understanding. Probability and Long-Term Expectations. Chapter 16. Copyright 2005 Brooks/Cole, a division of Thomson Learning, Inc.

Understanding Chapter 16 Probability and Long-Term Expectations Copyright 2005 Brooks/Cole, a division of Thomson Learning, Inc. Thought Question 1: Two very different queries about probability: a. If

### MATHEMATICS FOR ENGINEERS STATISTICS TUTORIAL 4 PROBABILITY DISTRIBUTIONS

MATHEMATICS FOR ENGINEERS STATISTICS TUTORIAL 4 PROBABILITY DISTRIBUTIONS CONTENTS Sample Space Accumulative Probability Probability Distributions Binomial Distribution Normal Distribution Poisson Distribution

### An Explanation of the 8 and 30 File Sampling Procedure Used by NCQA During Accreditation Survey Visits. May 1, 2001 Prepared by Ernest Valente, Ph.D.

An Explanation of the 8 and 30 File Sampling Procedure Used by NCQA During Accreditation Survey Visits May 1, 2001 Prepared by Ernest Valente, Ph.D. The National Committee for Quality Assurance (NCQA)

### A Basic Introduction to Missing Data

John Fox Sociology 740 Winter 2014 Outline Why Missing Data Arise Why Missing Data Arise Global or unit non-response. In a survey, certain respondents may be unreachable or may refuse to participate. Item

### 4. Introduction to Statistics

Statistics for Engineers 4-1 4. Introduction to Statistics Descriptive Statistics Types of data A variate or random variable is a quantity or attribute whose value may vary from one unit of investigation

### NUMBERS, FACTS AND TRENDS SHAPING THE WORLD FOR RELEASE DECEMBER 30, 2013

NUMBERS, FACTS AND TRENDS SHAPING THE WORLD FOR RELEASE DECEMBER 30, 2013 Maeve Duggan, Research Assistant Aaron Smith, Senior Researcher 202.419.4500 RECOMMENDED CITATION: Maeve Duggan and Aaron Smith,

### Selecting Research Participants

C H A P T E R 6 Selecting Research Participants OBJECTIVES After studying this chapter, students should be able to Define the term sampling frame Describe the difference between random sampling and random

### SAMPLING DISTRIBUTIONS

0009T_c07_308-352.qd 06/03/03 20:44 Page 308 7Chapter SAMPLING DISTRIBUTIONS 7.1 Population and Sampling Distributions 7.2 Sampling and Nonsampling Errors 7.3 Mean and Standard Deviation of 7.4 Shape of

### Chapter Five. Hypothesis Testing: Concepts

Chapter Five The Purpose of Hypothesis Testing... 110 An Initial Look at Hypothesis Testing... 112 Formal Hypothesis Testing... 114 Introduction... 114 Null and Alternate Hypotheses... 114 Procedure for

### Probability, Binomial Distributions and Hypothesis Testing Vartanian, SW 540

Probability, Binomial Distributions and Hypothesis Testing Vartanian, SW 540 1. Assume you are tossing a coin 11 times. The following distribution gives the likelihoods of getting a particular number of

### Preliminaries to Sampling

Preliminaries to Sampling In social science research involving Statistical analysis, we make all our choices as explicitly as possible. When we come to choose elements in a piece of research, one of the

### Workplace Pension Reform: Multiple Jobholders

Workplace Pension Reform: Multiple Jobholders July 2013 1 Introduction The analysis presented in this paper is intended to support the passage of the 2013-14 Pensions Bill through Parliament. It provides

### CHAPTER 3. Research methodology

CHAPTER 3 Research methodology 3.1 INTRODUCTION This chapter deals with the research methodology of the study, including the research design, setting, population, sample and data-collection instrument.

### INTERNATIONAL STANDARD ON AUDITING (UK AND IRELAND) 530 AUDIT SAMPLING AND OTHER MEANS OF TESTING CONTENTS

INTERNATIONAL STANDARD ON AUDITING (UK AND IRELAND) 530 AUDIT SAMPLING AND OTHER MEANS OF TESTING CONTENTS Paragraph Introduction... 1-2 Definitions... 3-12 Audit Evidence... 13-17 Risk Considerations

### 8. Inductive Arguments

8. Inductive Arguments 1 Inductive Reasoning In general, inductive reasoning is reasoning in which we extrapolate from observed experience (e.g., past experience) to some conclusion (e.g., about present

### NUMBERS, FACTS AND TRENDS SHAPING THE WORLD FOR RELEASE NOVEMBER 3, 2014 FOR FURTHER INFORMATION ON THIS REPORT: Aaron Smith, Senior Researcher

NUMBERS, FACTS AND TRENDS SHAPING THE WORLD FOR RELEASE NOVEMBER 3, 2014 FOR FURTHER INFORMATION ON THIS REPORT: Aaron Smith, Senior Researcher 202.419.4372 RECOMMENDED CITATION: Pew Research Center, November,

### Randomization in Clinical Trials

in Clinical Trials Versio.0 May 2011 1. Simple 2. Block randomization 3. Minimization method Stratification RELATED ISSUES 1. Accidental Bias 2. Selection Bias 3. Prognostic Factors 4. Random selection

### Simple Random Sampling

Source: Frerichs, R.R. Rapid Surveys (unpublished), 2008. NOT FOR COMMERCIAL DISTRIBUTION 3 Simple Random Sampling 3.1 INTRODUCTION Everyone mentions simple random sampling, but few use this method for

### Chapter 7 Introduction to Sampling

Chapter 7 Introduction to Sampling Introduction In this chapter you will learn about: The important terms and definitions that are used in sampling. The use of the two main types of sampling methods random

QUALITY ALERT: HOW TO ENSURE YOUR SOCIAL AND MARKET RESEARCH IS SIGNIFICANT, MEANINGFUL AND CREDIBLE. DUNCAN STUART FMRSNZ Policy makers in Government and social service agencies are being warned to stick

### Sample: n=2,252 national adults, age 18 and older, including 1,127 cell phone interviews Interviewing dates:

Survey Questions Spring 2013 Tracking Survey Final Topline 5/21/2013 Data for April 17-May 19, 2013 Princeton Survey Research Associates International for the Pew Research Center s Internet & American

### Sample: n=2,252 national adults, age 18 and older, including 1,127 cell phone interviews Interviewing dates: 04.17.2013 05.19.2013

Survey Questions Spring 2013 Tracking Survey Final Topline 5/21/2013 Data for April 17-May 19, 2013 Princeton Survey Research Associates International for the Pew Research Center s Internet & American

### Determining Sample Size 1

Fact Sheet PEOD-6 November 1992 Determining Sample Size 1 Glenn D. Israel 2 Perhaps the most frequently asked question concerning sampling is, "What size sample do I need?" The answer to this question

### Introduction... 3. Qualitative Data Collection Methods... 7 In depth interviews... 7 Observation methods... 8 Document review... 8 Focus groups...

1 Table of Contents Introduction... 3 Quantitative Data Collection Methods... 4 Interviews... 4 Telephone interviews... 5 Face to face interviews... 5 Computer Assisted Personal Interviewing (CAPI)...

### AP Stats- Mrs. Daniel Chapter 4 MC Practice

AP Stats- Mrs. Daniel Chapter 4 MC Practice Name: 1. Archaeologists plan to examine a sample of 2-meter-square plots near an ancient Greek city for artifacts visible in the ground. They choose separate

### USES OF CONSUMER PRICE INDICES

USES OF CONSUMER PRICE INDICES 2 2.1 The consumer price index (CPI) is treated as a key indicator of economic performance in most countries. The purpose of this chapter is to explain why CPIs are compiled

### The Margin of Error for Differences in Polls

The Margin of Error for Differences in Polls Charles H. Franklin University of Wisconsin, Madison October 27, 2002 (Revised, February 9, 2007) The margin of error for a poll is routinely reported. 1 But

### Literature Review of Sample Design and Methods

Literature Review of Sample Design and Methods Generally, a researcher employs sampling strategies in order to generate statistics and generalize findings to a larger population. Sampling refers to the

### AP: LAB 8: THE CHI-SQUARE TEST. Probability, Random Chance, and Genetics

Ms. Foglia Date AP: LAB 8: THE CHI-SQUARE TEST Probability, Random Chance, and Genetics Why do we study random chance and probability at the beginning of a unit on genetics? Genetics is the study of inheritance,

### Testing: is my coin fair?

Testing: is my coin fair? Formally: we want to make some inference about P(head) Try it: toss coin several times (say 7 times) Assume that it is fair ( P(head)= ), and see if this assumption is compatible

### Confidence Intervals (Review)

Intro to Hypothesis Tests Solutions STAT-UB.0103 Statistics for Business Control and Regression Models Confidence Intervals (Review) 1. Each year, construction contractors and equipment distributors from

### GAS TAX REFERENDUM 51 GAINS GROUND; INITIATIVE 776 REJECTED

GAS TAX REFERENDUM 51 GAINS GROUND; INITIATIVE 776 REJECTED * EXCLUSIVE SURVEYUSA RESEARCH RESULTS * YOU MUST CREDIT SURVEYUSA IF YOU AIR, CITE OR REPRINT THESE RESULTS IN WHOLE OR PART HERE ARE SOME OF

### Combinatorics: The Fine Art of Counting

Combinatorics: The Fine Art of Counting Week 7 Lecture Notes Discrete Probability Continued Note Binomial coefficients are written horizontally. The symbol ~ is used to mean approximately equal. The Bernoulli

### Chapter Seven. Multiple regression An introduction to multiple regression Performing a multiple regression on SPSS

Chapter Seven Multiple regression An introduction to multiple regression Performing a multiple regression on SPSS Section : An introduction to multiple regression WHAT IS MULTIPLE REGRESSION? Multiple

### Statistics courses often teach the two-sample t-test, linear regression, and analysis of variance

2 Making Connections: The Two-Sample t-test, Regression, and ANOVA In theory, there s no difference between theory and practice. In practice, there is. Yogi Berra 1 Statistics courses often teach the two-sample

### Descriptive Methods Ch. 6 and 7

Descriptive Methods Ch. 6 and 7 Purpose of Descriptive Research Purely descriptive research describes the characteristics or behaviors of a given population in a systematic and accurate fashion. Correlational

### Chapter Four. Data Analyses and Presentation of the Findings

Chapter Four Data Analyses and Presentation of the Findings The fourth chapter represents the focal point of the research report. Previous chapters of the report have laid the groundwork for the project.

### 1) Overview 2) Sample or Census 3) The Sampling Design Process i. Define the Target Population ii. Determine the Sampling Frame iii.

1) Overview 2) Sample or Census 3) The Sampling Design Process i. Define the Target Population ii. Determine the Sampling Frame iii. Select a Sampling Technique iv. Determine the Sample Size v. Execute

### Sociology 6Z03 Topic 9: Statistical Issues in Research Design

Sociology 6Z03 Topic 9: Statistical Issues in Research Design John Fox McMaster University Fall 2016 John Fox (McMaster University) Soc 6Z03: Research Design Fall 2016 1 / 44 Outline: Research Design Introduction

### Introduction to Statistics

1 1.1 Introduction Introduction to Statistics Statistics is a collection of methods for planning experiments, obtaining data, and then organizing, summarizing, presenting, analyzing, interpreting and drawing

### A Trial Analogy for Statistical. Hypothesis Testing. Legal Trial Begin with claim: Statistical Significance Test Hypotheses (statements)

A Trial Analogy for Statistical Slide 1 Hypothesis Testing Legal Trial Begin with claim: Smith is not guilty If this is rejected, we accept Smith is guilty reasonable doubt Present evidence (facts) Evaluate

### Module 10: Data Analysis and Interpretation

IPDET Module 10: Data Analysis and Interpretation Intervention or Policy Subevaluations Qualitative vs. Quantitative Qualitative Quantitative Introduction Data Analysis Strategy Analyzing Qualitative Data

### INTERNATIONAL STANDARD ON AUDITING 530 AUDIT SAMPLING AND OTHER MEANS OF TESTING CONTENTS

INTERNATIONAL STANDARD ON AUDITING 530 AUDIT SAMPLING AND OTHER MEANS OF TESTING (Effective for audits of financial statements for periods beginning on or after December 15, 2004) CONTENTS Paragraph Introduction...

### The work by Campbell and others on validity and threats to validity within

Chapter 5 Use a mixed-methods approach: The logic of the comparative advantages of methods The work by Campbell and others on validity and threats to validity within experiments and other types of evaluations

### Reconciliation of Public Employment Data Published by the Labour Statistics Division and the Public Institutions Division Alain Paquet, Public

Reconciliation of Public Employment Data Published by the Labour Statistics Division and the Public Institutions Division Alain Paquet, Public Institutions Division Reconciliation of Public Employment

### Principles of Survey Methodology

Labor & Workplace Studies 188-3 and Chicano Studies 191-5 Applied Research Methods in the LA Labor Community Winter Quarter 2014 Principles of Survey Methodology WINTER 2014, UCLA Outline What is a survey?

### The Normal Distribution

Chapter 6 The Normal Distribution 6.1 The Normal Distribution 1 6.1.1 Student Learning Objectives By the end of this chapter, the student should be able to: Recognize the normal probability distribution

### SOME NOTES ON STATISTICAL INTERPRETATION. Below I provide some basic notes on statistical interpretation for some selected procedures.

1 SOME NOTES ON STATISTICAL INTERPRETATION Below I provide some basic notes on statistical interpretation for some selected procedures. The information provided here is not exhaustive. There is more to