# Selecting Research Participants

Save this PDF as:

Size: px
Start display at page:

## Transcription

1 C H A P T E R 6 Selecting Research Participants OBJECTIVES After studying this chapter, students should be able to Define the term sampling frame Describe the difference between random sampling and random assignment Define the term probability sampling Describe the difference between random, systematic, stratified, cluster, and multistage sampling Define the term nonprobability sampling Describe the difference between convenience, quota, and referral sampling Determine the best sampling method for a given research problem Describe the relationship between sample size and effect size Describe the relationship between statistical power and sample size Have you ever received a phone call from someone who works for some research institute and wants a few minutes of your time? Have you received a questionnaire in the mail or online? Anyone come to your door wanting to know what kinds of products you prefer? We certainly have. How come they picked you, you might have wondered? In this chapter, we discuss methods researchers use to select the people they want to study. 125

2 126 METHODS IN PSYCHOLOGICAL RESEARCH Whether you are surveying people on the street or gathering participants for an experiment, you are selecting a sample from a population of potential participants. Probably the only research that is conducted on whole populations is carried out by government agencies when they conduct a census. We all know that only the government can afford to measure the entire population. The rest of us conduct our research on some sample from a population. We then use inferential statistics to make statements about the population based on the findings from our sample. One of the assumptions of inferential statistics is that the samples were randomly selected from the population. In the real world, this is almost never practiced. Indeed, most psychological research is based on first-year university students enrolled in introductory psychology courses. We knowingly violate this assumption because we are usually not interested in describing a population. Instead, our research goal is to test a theory. We do this by generating a testable research hypothesis, selecting participants, and conducting the study. Unless our theory somehow does not apply to the participants we have selected, we should be safe in using samples that are not randomly selected. On the other hand, if our research goal is to describe an entire population based on our sample (e.g., by surveying), then how we select our sample is critical. And if this is our goal, then the first step is to obtain a list of the population a sampling frame. The sampling frame is the list that is used to select from a population. For example, if you wanted to select students from a population of all the students at a university, your best sampling frame would be a list of all registered students. If you were interested in sampling from schools, then a list of all the schools in a certain district would be your sampling frame. Keep in mind that a sampling frame may not be complete. For example, a telephone directory will not include households with unlisted numbers or people without phones. Also, when a sampling frame exists, its use may be restricted. For example, it may be that the registrar s office will not allow access to student information. Finally, there are many populations for which a sampling frame simply does not exist. SAMPLING METHODS The various approaches to sampling can be broken down into two groups namely, (1) probability and (2) nonprobability sampling. Probability Sampling These techniques are termed probability sampling techniques because you can specify the probability that a participant will be selected from a population. By obtaining your sample with probability techniques, you can be reasonably confident that your sample is representative of the population. At the very least, your selection procedure could be replicated by others to obtain similar samples. Random Sampling Random sampling is a procedure whereby a sample is drawn such that each member of the population has an equal probability of being included in that sample. The probability

3 CHAPTER 6 Selecting Research Participants 127 that any one individual will be included in the sample is 1 divided by the size of the 1 population i.e., population size. If we had a small population, we could put each member s name in a hat, shake it up, and draw out the number of names we need for our sample. Clearly, if our population is large, this is not going to work. Many statistics texts have a table of random numbers in the appendix. This table can be used to select the members of a sample from the population. Although few researchers use this procedure, many statistical techniques are based on the assumption that sampling has been random. As we discussed previously, this is not really a huge problem for social science researchers who are typically testing theories, not generalizing to entire populations. Our students often have difficulty distinguishing between random sampling or random selection of participants and random assignment of participants to groups. As we just said, random sampling rarely happens in psychological research, and this is not a huge problem, but random assignment of participants to groups is a very common procedure and is an important assumption of several statistical procedures. Random assignment means that participants have been independently assigned to groups. Imagine that we have selected 40 participants for a twogroup experiment. We could use a table of random numbers to assign 20 participants to the experimental group and 20 to a control group. This would be an example of random assignment of participants to conditions. In Chapter 7, we will discuss experimental designs where random assignment will be used to create the groups in a study. Figure 6.1 illustrates the difference between random selection and random assignment. Systematic Sampling Suppose we have a list of all the social workers employed by our city, 600 in all. We could obtain a sample of 100 by selecting every sixth person on the list (i.e., 600 divided by 100 = 6) (see Figure 6.2). The probability that any person will be included in this sample is 1 in 6. When using systematic sampling, be sure that the organization of your list cannot bias your sample. Imagine if you were to select every second person from a list of married couples that were organized man, woman, man, woman! CONCEPTUAL EXERCISE 6A A researcher randomly selects and telephones 250 homes listed in a city phone book and conducts a survey. What is the sampling frame? Stratified Sampling Consider the example above where we selected every sixth social worker on our list. Imagine we were gathering opinions about government support for social workers. We might think that social workers with different amounts of experience in the field might have different opinions about this issue. One way to get a fairer assessment of the workers

4 128 METHODS IN PSYCHOLOGICAL RESEARCH FIGURE 6.1 Random Selection and Random Assignment Random Selection Random Assignment

6 130 METHODS IN PSYCHOLOGICAL RESEARCH FIGURE 6.3 Stratified Sampling FIGURE 6.4 Cluster Sampling

7 CHAPTER 6 Selecting Research Participants 131 select a number of those clusters. Then, within each borough/ward cluster you have chosen, you would randomly select a number of smaller clusters, or agencies, to include in your sample. Cluster sampling is a great way of obtaining a random sample when you do not have access to a list of all members of the population. The above probability sampling methods are preferred by researchers but are not always practical. Nonprobability sampling methods are easier to use and often cheaper to carry out. No effort is made to ensure that the sample reflects the characteristics of the population. CONCEPTUAL EXERCISE 6B A researcher is interested in maximum-security inmates. What sampling procedure is she using in each of the following? 1. She obtains a list of all inmates in maximum-security prisons in the United States and selects every 50th name. 2. She groups inmates by type of crime, determines the percentage of the total in each crime category, and uses that to randomly select a representative proportion from each group. 3. She groups maximum-security prisons by state, randomly selects 10 states, and, from those 10, randomly selects three prisons. She includes all the inmates in those three prisons in her sample. Nonprobability Sampling These techniques are called nonprobability sampling techniques because it is impossible to specify the probability of selecting any one individual. You cannot say that everyone in the population has an equal chance of being selected because you do not know the probability of selection. This is important because it means that your sample may or may not be representative of the population, and this can influence the external validity of your study. This is not usually considered a problem in hypothesis testing, where our primary goal is not to describe a population but to test the prediction of a theory. Convenience Sampling Have you ever been approached by someone at the mall with a survey? We have. This approach of grabbing whoever is available is called convenience sampling (see Figure 6.5). You might be surprised to learn that convenience sampling is the most commonly used procedure in psychology research. Psychology researchers typically obtain their samples from introductory psychology classes. Why? Because it is convenient. The sample frame then is introductory psychology students. When students do research projects, they usually just walk around campus and ask people to participate because that too is convenient. The sample frame here is people on

8 132 METHODS IN PSYCHOLOGICAL RESEARCH FIGURE 6.5 Convenience Sampling campus. Although you might find this a bit peculiar, it is very common. The notion is that university students are fairly representative of young people at large. Of course, in some respects this is not true. University students may differ from the population in a number of ways; they may be more intelligent, have a higher socioeconomic status, and perhaps come from more supportive families. But remember, most psychological research is about investigating the relationships between manipulated variables and behavior, not about describing the characteristics of the population. As long as the variables in your study are not influenced by these biases, the research is probably valid. Even so, we need to be cautious in generalizing the results to populations that may differ from our sampled population. Convenience sampling is not appropriate for all research, of course. If you want to describe the attitudes of Americans about free trade, you should not just sample introductory psychology students. In descriptive research, it is critical that your sample is representative of the population, and you ll probably want to use a probability sampling technique. Quota Sampling Quota sampling is like convenience sampling, but the goal is to select participants with particular characteristics until you have enough. This would be used, for example, if you want an equal number of Black, White, and Asian participants in your sample. Or perhaps you have identified the population in terms of socioeconomic status, and you want to make sure that you have equal numbers of each socioeconomic status category in your sample (see Figure 6.6). This is a nonprobability analog to stratified random sampling.

9 CHAPTER 6 Selecting Research Participants 133 FIGURE 6.6 Quota Sampling Referral Sampling If the population you are interested in is difficult to locate, then once you have found one individual, you could ask him or her to refer others to you. This procedure is sometimes called snowball sampling because one participant tells his or her friends, and they tell their friends, and so on, and so on (see Figure 6.7). Let s say that you are interested in studying factors that prevent sex-trade workers from leaving the street. Obviously, you are not going to obtain a sampling frame, but a referral sampling method makes perfect sense. CONCEPTUAL EXERCISE 6C A few years ago, we conducted a study trying to determine if technology enhanced learning outcomes in the teaching of psychology. 1. Had we identified all psychology classes and randomly selected four classes to use, what type of sampling would we have used? 2. We did not do that, however. We used the classes we were assigned to teach. What sampling method did we use?

10 134 METHODS IN PSYCHOLOGICAL RESEARCH FIGURE 6.7 Referral Sampling SAMPLE AND EFFECT SIZE Students always ask, How many participants do I need? This depends on the power of their statistic. Parametric statistics such as the t test and analysis of variance (ANOVA) have a great deal of power, but chi-square, a nonparametric procedure, has relatively low power. Consequently, you will need a much larger sample if you are using chi-square. Your sample size will also depend on your research design. If you want to perform a number of statistical comparisons, you will need a larger sample. For example, if your study has two independent variables, each with three levels, and you also want to compare women and men, you may have = 18 groups (three levels of the first independent variable three levels of the second independent variable two sexes); with only 10 participants in each group, you can do the math! Similarly, if your chi-square test has many categories, you will need a larger sample. Students often report that a significant finding might have been more significant if the samples were larger. This is not necessarily the case. We need to consider the size of the

12 136 METHODS IN PSYCHOLOGICAL RESEARCH selecting samples from populations. The sampling frame is a list of the population from which the sample is drawn. Probability sampling techniques are methods where the probability that a participant will be selected for inclusion in the sample is known. Random sampling is a procedure for selecting participants whereby each participant has an equal probability of being included in the sample. Random assignment of participants requires that the participants be independently assigned to groups. In systematic sampling, the population size is divided by your sample size to provide you with a number, k, for example; then, from a random starting point, you select every kth individual. For example, if your population size was 2,000 and you wanted a sample of 100, you would select every 20th individual. In stratified sampling, the population is divided into strata based on some population characteristic, and participants are randomly selected from each stratum. This ensures that each stratum is proportionally represented in the sample. Cluster sampling can be used when a population list is not available and researchers simply identify a number of clusters or groups and include all participants in the cluster in the sample. Multistage sampling is a cluster technique where smaller clusters are randomly selected from larger clusters previously randomly selected. Nonprobability sampling methods are easier to use than probability sampling methods but do not provide any way of estimating the probability that an individual in the population will be included in the sample. Convenience sampling is the term used when we select any participant who is readily available. When we choose easily available participants who fit a particular criterion, we are using quota sampling. Referral sampling involves including participants in the sample who have been referred by other participants. Determining how many participants are needed in a sample depends on several variables, including the power of the statistic, the research design, the size of the effect, and the variability of the data. CHAPTER RESOURCES ANSWERS TO CONCEPTUAL EXERCISES Conceptual Exercise 6A The sampling frame is the numbers listed in the phone book. Conceptual Exercise 6B 1. Systematic 2. Stratified 3. Multistage

15 CHAPTER 6 Selecting Research Participants 139 ANCILLARIES Visit the companion website at for these additional learning resources: Self-quizzes SAGE Journal Articles Video and Audio Links Additional Web Resources

### SAMPLING METHODS. Chapter 5

SAMPLING METHODS Chapter 5 1 LEARNING OBJECTIVES Reasons for sampling Different sampling methods Probability & non probability sampling Advantages & disadvantages of each sampling method 2 SAMPLING A sample

### Sampling & Sample Size Estimation

Sampling & Sample Size Estimation Moazzam Ali MD, PhD, MPH Department of Reproductive Health and Research World Health Organization Geneva, Switzerland Presented at: GFMER September 16, 2014 Topics to

### Why Sample? Why not study everyone? Debate about Census vs. sampling

Sampling Why Sample? Why not study everyone? Debate about Census vs. sampling Problems in Sampling? What problems do you know about? What issues are you aware of? What questions do you have? Key Sampling

### TYPES OF SAMPLING. 2. Types of Non-probability Sample: There are the following four types of nonprobability PROBABILITY SAMPLING

TYPES OF SAMPLING 1. Types or Techniques Probability Sampling: There are a number of techniques of taking Probability sample. But here only six important techniques have been discussed as follows: 1. Simple

### SAMPLING & INFERENTIAL STATISTICS. Sampling is necessary to make inferences about a population.

SAMPLING & INFERENTIAL STATISTICS Sampling is necessary to make inferences about a population. SAMPLING The group that you observe or collect data from is the sample. The group that you make generalizations

### Section 2: Ten Tools for Applying Sociology

Section 2: Ten Tools for Applying Sociology CHAPTER 2.6: DATA COLLECTION METHODS QUICK START: In this chapter, you will learn The basics of data collection methods. To know when to use quantitative and/or

### Introduction to. Hypothesis Testing CHAPTER LEARNING OBJECTIVES. 1 Identify the four steps of hypothesis testing.

Introduction to Hypothesis Testing CHAPTER 8 LEARNING OBJECTIVES After reading this chapter, you should be able to: 1 Identify the four steps of hypothesis testing. 2 Define null hypothesis, alternative

### Types of Probability Samples

Types of Probability Samples Simple Random Systematic Random Stratified Random Random Cluster Stratified Cluster Complex Multi-stage Random (various kinds) Simple Random Sampling Each element in the population

### 1) Overview 2) Sample or Census 3) The Sampling Design Process i. Define the Target Population ii. Determine the Sampling Frame iii.

1) Overview 2) Sample or Census 3) The Sampling Design Process i. Define the Target Population ii. Determine the Sampling Frame iii. Select a Sampling Technique iv. Determine the Sample Size v. Execute

### Sampling Exercise. ESP178 Research Methods Professor Susan Handy 2/4/16

Sampling Exercise ESP178 Research Methods Professor Susan Handy 2/4/16 Types of Sampling Type Probability sampling i.e. random Non-probability sampling i.e. non-random Definition Every element in the population

### Sampling Procedures Y520. Strategies for Educational Inquiry. Robert S Michael

Sampling Procedures Y520 Strategies for Educational Inquiry Robert S Michael RSMichael 2-1 Terms Population (or universe) The group to which inferences are made based on a sample drawn from the population.

### Descriptive Methods Ch. 6 and 7

Descriptive Methods Ch. 6 and 7 Purpose of Descriptive Research Purely descriptive research describes the characteristics or behaviors of a given population in a systematic and accurate fashion. Correlational

### Chapter 8: Quantitative Sampling

Chapter 8: Quantitative Sampling I. Introduction to Sampling a. The primary goal of sampling is to get a representative sample, or a small collection of units or cases from a much larger collection or

### primary data (collect the data yourself) secondary data (use data collected by others)

Slide 3.1 Chapter 9: Data collection and sampling methods Data collection primary data (collect the data yourself) secondary data (use data collected by others) Examine secondary sources first paper sources

### Survey Sampling. Know How No 9 guidance for research and evaluation in Fife. What this is about? Who is it for? What do you need to know?

guidance for research and evaluation in Fife What this is about? Sampling allows you to draw conclusions about a particular population by examining a part of it. When carrying out a survey, it is not usually

### EAA492/6: FINAL YEAR PROJECT DEVELOPING QUESTIONNAIRES PART 2 A H M A D S H U K R I Y A H A Y A E N G I N E E R I N G C A M P U S U S M

EAA492/6: FINAL YEAR PROJECT DEVELOPING QUESTIONNAIRES PART 2 1 A H M A D S H U K R I Y A H A Y A E N G I N E E R I N G C A M P U S U S M CONTENTS Reliability And Validity Sample Size Determination Sampling

### Chapter 19: Sampling

Chapter 19: Sampling Context................................................................... 2 Terminology................................................................ 3 Some basics 4 Population

### Experimental data and survey data

Experimental data and survey data An experiment involves the collection of measurements or observations about populations that are treated or controlled by the experimenter. A survey is an examination

### Introduction to Sampling. Dr. Safaa R. Amer. Overview. for Non-Statisticians. Part II. Part I. Sample Size. Introduction.

Introduction to Sampling for Non-Statisticians Dr. Safaa R. Amer Overview Part I Part II Introduction Census or Sample Sampling Frame Probability or non-probability sample Sampling with or without replacement

### Do all the exercises by writing (unless otherwise specified).

EXERCISES: Do all the exercises by writing (unless otherwise specified). If an exercise asks you to state something, write it precisely and concisely with one sentence (unless otherwise specified, of course).

### Basic Research Progress

Mgt 540 Research Methods Sampling Issues 1 Basic Research Progress Explorative - Descriptive (Qualitative) 1. Framework / Domain extant knowledge for reference 2. Research Design 3. Data collection / presentation

### Inclusion and Exclusion Criteria

Inclusion and Exclusion Criteria Inclusion criteria = attributes of subjects that are essential for their selection to participate. Inclusion criteria function remove the influence of specific confounding

### Survey Process White Paper Series Five Steps in Creating a Survey Sampling Plan

Survey Process White Paper Series Five Steps in Creating a Survey Sampling Plan POLARIS MARKETING RESEARCH, INC. 1455 LINCOLN PARKWAY, SUITE 320 ATLANTA, GEORGIA 30346 404.816.0353 www.polarismr.com ii

### Answer keys for Assignment 10: Measurement of study variables

Answer keys for Assignment 10: Measurement of study variables (The correct answer is underlined in bold text) 1. In a study, participants are asked to indicate the type of pet they have at home (ex: dog,

### Sampling Designs. 1. Simple random sampling (SRS) Steps: The method is not very different from winning a lottery.

Sampling Designs 1. Simple random sampling (SRS) Steps: (1) Assign a single number to each element in the sampling frame. (2) Use random numbers to select elements into the sample until the desired number

### Prof. Kate Calder. It may be impossible to collect information about every member of the population. Time Cost Convenience

Sampling Design The idea of sampling: We want to say something about a population - the entire group of individuals that we want information about. To get at this we take a sample - a part of the population

### NON-PROBABILITY SAMPLING TECHNIQUES

NON-PROBABILITY SAMPLING TECHNIQUES PRESENTED BY Name: WINNIE MUGERA Reg No: L50/62004/2013 RESEARCH METHODS LDP 603 UNIVERSITY OF NAIROBI Date: APRIL 2013 SAMPLING Sampling is the use of a subset of the

### Sample Size and Power in Clinical Trials

Sample Size and Power in Clinical Trials Version 1.0 May 011 1. Power of a Test. Factors affecting Power 3. Required Sample Size RELATED ISSUES 1. Effect Size. Test Statistics 3. Variation 4. Significance

### Statistical & Technical Team

Statistical & Technical Team A Practical Guide to Sampling This guide is brought to you by the Statistical and Technical Team, who form part of the VFM Development Team. They are responsible for advice

### Reflections on Probability vs Nonprobability Sampling

Official Statistics in Honour of Daniel Thorburn, pp. 29 35 Reflections on Probability vs Nonprobability Sampling Jan Wretman 1 A few fundamental things are briefly discussed. First: What is called probability

### How to do a Survey (A 9-Step Process) Mack C. Shelley, II Fall 2001 LC Assessment Workshop

How to do a Survey (A 9-Step Process) Mack C. Shelley, II Fall 2001 LC Assessment Workshop 1. Formulate the survey keeping in mind your overall substantive and analytical needs. Define the problem you

### Sampling: What is it? Quantitative Research Methods ENGL 5377 Spring 2007

Sampling: What is it? Quantitative Research Methods ENGL 5377 Spring 2007 Bobbie Latham March 8, 2007 Introduction In any research conducted, people, places, and things are studied. The opportunity to

### Data network for better European organic market information SAMPLING. and its relevance for sound data collection

Data network for better European organic market information SAMPLING and its relevance for sound data collection OrganicDataNetwork Workshop, Bari, July 10 & 11, 2014 Corinna Feldmann, University of Kassel

### INTRODUCTION to PSYCHOLOGY INTRODUCTORY STATISTICS A Presidential Scholars Interdisciplinary Seminar

INTRODUCTION to PSYCHOLOGY INTRODUCTORY STATISTICS A Presidential Scholars Interdisciplinary Seminar & PSYC 2301.22 - MATH 1342.22 Course Syllabus Dr. Shirley Clay, Professor of Psychology Dr. Paula A.

### Description and comparison of the methods of cluster sampling and lot quality assurance sampling to assess immunization coverage

WHO/V&B/01.26 ENGLISH ONLY DISTR.: GENERAL Description and comparison of the methods of cluster sampling and lot quality assurance sampling to assess immunization coverage Written by Stacy Hoshaw-Woodard,

About Sampling TABLE OF CONTENTS About Sampling... 1 Why is SAMPLING important?... 1 Common Language... 1 Probability & Nonprobability Sampling... 1 Sampling Methods... 2 Simple Random Sample (SRS)...

### Appendix Methodology and Statistics

Appendix Methodology and Statistics Introduction Science and Engineering Indicators (SEI) contains data compiled from a variety of sources. This appendix explains the methodological and statistical criteria

### These days, surveys are used everywhere and for many reasons. For example, surveys are commonly used to track the following:

The previous handout provided an overview of study designs. The two broad classifications discussed were randomized experiments and observational studies. In this handout, we will briefly introduce a specific

### Non-random/non-probability sampling designs in quantitative research

206 RESEARCH MET HODOLOGY Non-random/non-probability sampling designs in quantitative research N on-probability sampling designs do not follow the theory of probability in the choice of elements from the

### SCHOOL OF HEALTH AND HUMAN SCIENCES DON T FORGET TO RECODE YOUR MISSING VALUES

SCHOOL OF HEALTH AND HUMAN SCIENCES Using SPSS Topics addressed today: 1. Differences between groups 2. Graphing Use the s4data.sav file for the first part of this session. DON T FORGET TO RECODE YOUR

### Data Collection and Sampling OPRE 6301

Data Collection and Sampling OPRE 6301 Recall... Statistics is a tool for converting data into information: Statistics Data Information But where then does data come from? How is it gathered? How do we

### Sampling in Marketing Research

Sampling in Marketing Research 1 Basics of sampling I A sample is a part of a whole to show what the rest is like. Sampling helps to determine the corresponding value of the population and plays a vital

### 24% of internet users have made phone calls online

24% of internet users have made phone calls online Lee Rainie, Director May 30, 2011 http://pewinternet.org/reports/2011/13--internet-phone-calls--skype.aspx Pew Research Center s Internet & American Life

### Sampling: Design and Procedures

MBACATÃ“LICA JAN/APRIL 2006 Marketing Research Fernando S. Machado Week 6 Sampling: Design and Procedures Sampling: Sample Size Determination Data Preparation 1 Sampling: Design and Procedures The Sampling

### Chapter 8 Hypothesis Testing Chapter 8 Hypothesis Testing 8-1 Overview 8-2 Basics of Hypothesis Testing

Chapter 8 Hypothesis Testing 1 Chapter 8 Hypothesis Testing 8-1 Overview 8-2 Basics of Hypothesis Testing 8-3 Testing a Claim About a Proportion 8-5 Testing a Claim About a Mean: s Not Known 8-6 Testing

### Sampling Techniques Surveys and samples Source: http://www.deakin.edu.au/~agoodman/sci101/chap7.html

Sampling Techniques Surveys and samples Source: http://www.deakin.edu.au/~agoodman/sci101/chap7.html In this section you'll learn how sample surveys can be organised, and how samples can be chosen in such

### The Assumption(s) of Normality

The Assumption(s) of Normality Copyright 2000, 2011, J. Toby Mordkoff This is very complicated, so I ll provide two versions. At a minimum, you should know the short one. It would be great if you knew

### Sample size determination

Sample size determination Review Articles Influencing factors and calculation strategies for survey research Ali A. Al-Subaihi, PhD. ABSTRACT The paper reviews both the influencing factors and calculation

### 1.1 What is statistics? Data Collection. Important Definitions. What is data? Descriptive Statistics. Inferential Statistics

1.1 What is statistics? Data Collection Chapter 1 A science (bet you thought it was a math) of Collecting of data (Chap. 1) Organizing data (Chap. 2) Summarizing data (Chap. 2, 3) Analyzing data (Chap.

### the law of inertia of large numbers, which states that large groups are more stable than small ones. Applied to research, the first law means that a g

T O P I C 7 Data gathering 2 Preview Introduction This topic is a continuation of topic 6 and is concerned with the theory and methodology of sampling. Sampling forms a foundation to methods of data gathering

### A GUIDE TO SAMPLING & STATISTICAL RELIABILITY

July 2009 Technical Note 5 A GUIDE TO SAMPLING & STATISTICAL RELIABILITY The word survey is used most often to describe a method of gathering information from a sample of individuals. This sample is usually

### How to Conduct a Hypothesis Test

How to Conduct a Hypothesis Test The idea of hypothesis testing is relatively straightforward. In various studies we observe certain events. We must ask, is the event due to chance alone, or is there some

### Sampling Frames: Peter M. Lance, PhD, UNC CPC Baltimore, Thursday September 17

Sampling Frames: Peter M. Lance, PhD, UNC CPC Baltimore, Thursday September 17 Plan of this discussion Introduce the basics of sampling Describe sampling frames and how to sample from them (as well as

### CONTENTS OF DAY 2. II. Why Random Sampling is Important 9 A myth, an urban legend, and the real reason NOTES FOR SUMMER STATISTICS INSTITUTE COURSE

1 2 CONTENTS OF DAY 2 I. More Precise Definition of Simple Random Sample 3 Connection with independent random variables 3 Problems with small populations 8 II. Why Random Sampling is Important 9 A myth,

### As we saw in the previous chapter, statistical generalization requires a representative sample. Chapter 6. Sampling. Population or Universe

62 Part 2 / Basic Tools of Research: Sampling, Measurement, Distributions, and Descriptive Statistics Chapter 6 Sampling As we saw in the previous chapter, statistical generalization requires a representative

### Sampling. General 2 Population vs sample... 3 Key ideas... 4 Population parameter... 5 Sample and statistic... 6

Sampling General 2 Population vs sample........................................................ 3 Key ideas................................................................ 4 Population parameter........................................................

### CHAPTER 11 CHI-SQUARE: NON-PARAMETRIC COMPARISONS OF FREQUENCY

CHAPTER 11 CHI-SQUARE: NON-PARAMETRIC COMPARISONS OF FREQUENCY The hypothesis testing statistics detailed thus far in this text have all been designed to allow comparison of the means of two or more samples

### Methods: Simple Random Sampling Topics: Introduction to Simple Random Sampling

Methods: Simple Random Sampling Topics: Introduction to Simple Random Sampling - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - The Rwanda 2010 Demographic and Health Survey

### Inferential Statistics. Probability. From Samples to Populations. Katie Rommel-Esham Education 504

Inferential Statistics Katie Rommel-Esham Education 504 Probability Probability is the scientific way of stating the degree of confidence we have in predicting something Tossing coins and rolling dice

### UNDERSTANDING THE TWO-WAY ANOVA

UNDERSTANDING THE e have seen how the one-way ANOVA can be used to compare two or more sample means in studies involving a single independent variable. This can be extended to two independent variables

### A Primer in Internet Audience Measurement

A Primer in Internet Audience Measurement By Bruce Jeffries-Fox Introduction There is a growing trend toward people using the Internet to get their news and to investigate particular issues and organizations.

### Other Sampling Methods

Other Sampling Methods Taking a simple random sample may not always be the best approach to sampling. The following are a few other sampling methods, all of which are good substitutes for simple random

### MAT 155. Chapter 1 Introduction to Statistics. Key Concept. Basics of Collecting Data. 155S1.5_3 Collecting Sample Data.

MAT 155 Dr. Claude Moore Cape Fear Community College Chapter 1 Introduction to Statistics 1 1 Review and Preview 1 2 Statistical Thinking 1 3 Types of Data 1 4 Critical Thinking 1 5 Collecting Sample Data

### TRAINING NEEDS ANALYSIS

TRAINING NEEDS ANALYSIS WHAT IS A NEEDS ANALYSIS? It is a systematic means of determining what training programs are needed. Specifically, when you conduct a needs analysis, you Gather facts about training

### Techniques for data collection

Techniques for data collection Technical workshop on survey methodology: Enabling environment for sustainable enterprises in Indonesia Hotel Ibis Tamarin, Jakarta 4-6 May 2011 Presentation by Mohammed

### MARKETING RESEARCH AND MARKET INTELLIGENCE

MARKETING RESEARCH AND MARKET INTELLIGENCE Course Objectives Upon completion of this unit you will be able to: Evaluate the applicability of the marketing research process to any marketing and market related

### Principles of Measuring Advertising Effectiveness

Print article Close window Principles of Measuring Advertising Effectiveness By David Olson Testing the effectiveness of advertising is a big business. With the cost of producing a commercial at \$500,000

### Guided Reading 9 th Edition. informed consent, protection from harm, deception, confidentiality, and anonymity.

Guided Reading Educational Research: Competencies for Analysis and Applications 9th Edition EDFS 635: Educational Research Chapter 1: Introduction to Educational Research 1. List and briefly describe the

### AP Exam Review: Sampling NAME

AP Exam Review: Sampling NAME 1. At a certain university, students who live in the dormitories eat at a common dining hall. Recently, some students have been complaining about the quality of the food served

### Practical Nursing Frequently Asked Questions (FAQs)

Practical Nursing Frequently Asked Questions (FAQs) There are always a lot of questions about how to apply for the Practical Nursing program. Many people rely on what they hear from others because they

### STUDENT THESIS PROPOSAL GUIDELINES

STUDENT THESIS PROPOSAL GUIDELINES Thesis Proposal Students must work closely with their advisor to develop the proposal. Proposal Form The research proposal is expected to be completed during the normal

### TRANSCRIPT: In this lecture, we will talk about both theoretical and applied concepts related to hypothesis testing.

This is Dr. Chumney. The focus of this lecture is hypothesis testing both what it is, how hypothesis tests are used, and how to conduct hypothesis tests. 1 In this lecture, we will talk about both theoretical

### Chapter 2: Research Methodology

Chapter 2: Research Methodology 1. Type of Research 2. Sources of Data 3. Instruments for Data Collection 4. Research Methods 5. Sampling 6. Limitations of the Study 6 Chapter 2: Research Methodology Research

QUALITY ALERT: HOW TO ENSURE YOUR SOCIAL AND MARKET RESEARCH IS SIGNIFICANT, MEANINGFUL AND CREDIBLE. DUNCAN STUART FMRSNZ Policy makers in Government and social service agencies are being warned to stick

### the general concept down to the practical steps of the process.

Article Critique Affordances of mobile technologies for experiential learning: the interplay of technology and pedagogical practices C.- H. Lai, J.- C. Yang, F.- C. Chen, C.- W. Ho & T.- W. Chan Theoretical

### Example Hypotheses. Chapter 8-2: Basics of Hypothesis Testing. A newspaper headline makes the claim: Most workers get their jobs through networking

Chapter 8-2: Basics of Hypothesis Testing Two main activities in statistical inference are using sample data to: 1. estimate a population parameter forming confidence intervals 2. test a hypothesis or

### Notes and Comments I INTRODUCTION

Economic and Social Review, Vol. 10, No. 2, January, 1979, pp. 169-174. Notes and Comments RANSAM: A Random Sample Design for Ireland BRENDAN J. WHELAN The Economic and Social Research Institute, Dublin

### STATISTICA. Clustering Techniques. Case Study: Defining Clusters of Shopping Center Patrons. and

Clustering Techniques and STATISTICA Case Study: Defining Clusters of Shopping Center Patrons STATISTICA Solutions for Business Intelligence, Data Mining, Quality Control, and Web-based Analytics Table

### Develop hypothesis and then research to find out if it is true. Derived from theory or primary question/research questions

Chapter 12 Hypothesis Testing Learning Objectives Examine the process of hypothesis testing Evaluate research and null hypothesis Determine one- or two-tailed tests Understand obtained values, significance,

### Sample Size Matters What type of cook (researcher) are you?

Sample Size Matters What type of cook (researcher) are you? Excerpted from: Dissertation and Scholarly Research: Recipes for Success, 2012 Edition (Simon & Goes, 2012) Find this and many other dissertation

### Cold Calling in the 21 st Century: The New Rules

Cold Calling in the 21 st Century: The New Rules By Wendy Weiss, The Queen of Cold Calling Is Cold Calling Dead? That s what you hear. No one likes making cold calls. No one likes receiving cold calls.

### Sample Surveys. The two most typical sources of bias are selection bias and non-response bias.

Sample Surveys In this class we will consider the problem of sampling from a finite population. This is usually referred to as a survey. The goal of the survey is to learn about some parameters of a population,

### HOW TO WRITE A LABORATORY REPORT

HOW TO WRITE A LABORATORY REPORT Pete Bibby Dept of Psychology 1 About Laboratory Reports The writing of laboratory reports is an essential part of the practical course One function of this course is to

### Developing and implementing surveys

Developing and implementing surveys This fact sheet points to some key considerations in developing and implementing surveys to ensure you get interesting and useful information and data. What are surveys?

There are three kinds of people in the world those who are good at math and those who are not. PSY 511: Advanced Statistics for Psychological and Behavioral Research 1 Positive Views The record of a month

The Effect of Questionnaire Cover Design in Mail Surveys Philip Gendall It has been suggested that the response rate for a self administered questionnaire will be enhanced if the cover of the questionnaire

### Levels of measurement in psychological research:

Research Skills: Levels of Measurement. Graham Hole, February 2011 Page 1 Levels of measurement in psychological research: Psychology is a science. As such it generally involves objective measurement of

### Chapter 7 Sampling (Reminder: Don t forget to utilize the concept maps and study questions as you study this and the other chapters.

Chapter 7 Sampling (Reminder: Don t forget to utilize the concept maps and study questions as you study this and the other chapters.) The purpose of Chapter 7 it to help you to learn about sampling in

### 1.1 Research in Geography [Meaning & Importance]

Department of Geography GEO 271 Everything is related to everything else, but near things are more related than distant things. - Waldo Tobler s First Law of Geography 1.1 Research in Geography [Meaning

### Household Trends in U.S. Life Insurance Ownership

Household Trends in U.S. Life Insurance Ownership Full Report Cheryl D. Retzloff, LLIF, ACS Markets Research 860-285-7738 cretzloff@limra.com Maximize the Value of LIMRA Research The value of LIMRA research

### Sampling, questionnaire and interview design

Capacity building for research: promoting inclusive development of agricultural value-chains, 1-3 September 2014 Sampling, questionnaire and interview design adelaide.edu.au Risti Permani, Global Food

### Welcome back to EDFR 6700. I m Jeff Oescher, and I ll be discussing quantitative research design with you for the next several lessons.

Welcome back to EDFR 6700. I m Jeff Oescher, and I ll be discussing quantitative research design with you for the next several lessons. I ll follow the text somewhat loosely, discussing some chapters out

### Sampling. COUN 695 Experimental Design

Sampling COUN 695 Experimental Design Principles of Sampling Procedures are different for quantitative and qualitative research Sampling in quantitative research focuses on representativeness Sampling

### Practical Advice for Selecting Sample Sizes

Practical Advice for Selecting Sample Sizes William Fairbairn and Adam Kessler. Sample Size Calculator by Richard Tanburn. May 2015 Links updated Sept. 16 1 Introduction Many project managers today have

### Things to take into consideration when choosing a Market Research company

white paper Things to take into consideration when choosing a Market Research company Market Research; What is it? 1-2 What s it for? 3 What do you do with it and how do you do it? 4-6 Which agency should