# James E. Bartlett, II is Assistant Professor, Department of Business Education and Office Administration, Ball State University, Muncie, Indiana.

Save this PDF as:

Size: px
Start display at page:

## Transcription

2 44 Bartlett, Kotrlik, & Higgins they learn to their research design. A simple survey of published manuscripts reveals numerous errors and questionable approaches to sample size selection, and serves as proof that improvement is needed. Many researchers could benefit from a real-life primer on the tools needed to properly conduct research, including, but not limited to, sample size selection. This manuscript will describe common procedures for determining sample size for simple random and systematic random samples. It will also discuss alternatives to these formulas for special situations. This manuscript is not intended to be a totally inclusive treatment of other sample size issues and techniques. Rather, this manuscript will address sample size issues that have been selected as a result of observing problems in published manuscripts. As a part of this discussion, considerations for the appropriate use of Cochran s (1977) sample size formula for both continuous and categorical data will be presented. Krejcie and Morgan s (1970) formula for determining sample size for categorical data will be briefly discussed because it provides identical sample sizes in all cases where the researcher adjusts the t value used based on population size, which is required when the population size is 120 or less. Likewise, researchers should use caution when using any of the widely circulated sample size tables based on Krejcie and Morgan s (1970) formula, as they assume an alpha of.05 and a degree of accuracy of.05 (discussed later). Other formulas are available; however, these two formulas are used more than any others. Foundations for Sample Size Determination Primary Variables of Measurement The researcher must make decisions as to which variables will be incorporated into formula calculations. For example, if the researcher plans to use a seven-point scale to measure a continuous variable, e.g., job satisfaction, and also plans to determine if the respondents differ by certain categorical variables, e.g., gender, tenured, educational level, etc., which variable(s) should be used as the basis for sample size? This is important because the use of gender as the primary variable will result in a substantially larger sample size than if one used the seven-point scale as the primary variable of measure. Cochran (1977) addressed this issue by stating that One method of determining sample size is to specify margins of error for the items that are regarded as most vital to the survey. An estimation of the sample size needed is first made separately for each of these important items (p. 81). When these calculations are completed, researchers will have a range of n s, usually ranging from smaller n s for scaled, continuous variables, to larger n s for dichotomous or categorical variables. The researcher should make sampling decisions based on these data. If the n s for the variables of interest are relatively close, the researcher can simply use the largest n as the sample size and be confident that the sample size will provide the desired results. More commonly, there is a sufficient variation among the n s so that we are reluctant to choose the largest, either from budgetary considerations or because this will give an over-all standard of precision substantially higher than originally contemplated. In this event, the desired standard of precision may be relaxed for certain of the items, in order to permit the use of a smaller value of n (Cochran, 1977, p. 81). The researcher may also decide to use this information in deciding whether to keep all of the variables identified in the study. In some cases, the n s are so discordant that certain of them must be dropped from the inquiry;... (Cochran, 1977, p. 81). Error Estimation Cochran s (1977) formula uses two key factors: (1) the risk the researcher is willing to accept in the study, commonly called the margin of error, or the error the researcher is willing to accept, and (2) the alpha level, the level of acceptable risk the researcher is willing to accept that the true margin

3 Organizational Research: Determining Appropriate Sample Size in Survey Research 45 of error exceeds the acceptable margin of error; i.e., the probability that differences revealed by statistical analyses really do not exist; also known as Type I error. Another type of error will not be addressed further here, namely, Type II error, also known as beta error. Type II error occurs when statistical procedures result in a judgment of no significant differences when these differences do indeed exist. Alpha Level. The alpha level used in determining sample size in most educational research studies is either.05 or.01 (Ary, Jacobs, & Razavieh, 1996). In Cochran s formula, the alpha level is incorporated into the formula by utilizing the t-value for the alpha level selected (e.g., t-value for alpha level of.05 is 1.96 for sample sizes above 120). Researchers should ensure they use the correct t- value when their research involves smaller populations, e.g., t-value for alpha of.05 and a population of 60 is In general, an alpha level of.05 is acceptable for most research. An alpha level of.10 or lower may be used if the researcher is more interested in identifying marginal relationships, differences or other statistical phenomena as a precursor to further studies. An alpha level of.01 may be used in those cases where decisions based on the research are critical and errors may cause substantial financial or personal harm, e.g., major programmatic changes. Acceptable Margin of Error. The general rule relative to acceptable margins of error in educational and social research is as follows: For categorical data, 5% margin of error is acceptable, and, for continuous data, 3% margin of error is acceptable (Krejcie & Morgan, 1970). For example, a 3% margin of error would result in the researcher being confident that the true mean of a seven point scale is within ±.21 (.03 times seven points on the scale) of the mean calculated from the research sample. For a dichotomous variable, a 5% margin of error would result in the researcher being confident that the proportion of respondents who were male was within ±5% of the proportion calculated from the research sample. Researchers may increase these values when a higher margin of error is acceptable or may decrease these values when a higher degree of precision is needed. Variance Estimation A critical component of sample size formulas is the estimation of variance in the primary variables of interest in the study. The researcher does not have direct control over variance and must incorporate variance estimates into research design. Cochran (1977) listed four ways of estimating population variances for sample size determinations: (1) take the sample in two steps, and use the results of the first step to determine how many additional responses are needed to attain an appropriate sample size based on the variance observed in the first step data; (2) use pilot study results; (3) use data from previous studies of the same or a similar population; or (4) estimate or guess the structure of the population assisted by some logical mathematical results. The first three ways are logical and produce valid estimates of variance; therefore, they do not need to be discussed further. However, in many educational and social research studies, it is not feasible to use any of the first three ways and the researcher must estimate variance using the fourth method. A researcher typically needs to estimate the variance of scaled and categorical variables. To estimate the variance of a scaled variable, one must determine the inclusive range of the scale, and then divide by the number of standard deviations that would include all possible values in the range, and then square this number. For example, if a researcher used a seven-point scale and given that six standard deviations (three to each side of the mean) would capture 98% of all responses, the calculations would be as follows: 7 (number of points on the scale) S = (number of standard deviations) When estimating the variance of a dichotomous (proportional) variable such as gender, Krejcie and Morgan (1970) recommended that researchers should use.50 as an estimate of the population proportion. This proportion will result in the maximization of variance, which will also produce the maximum sample size. This proportion can be used to estimate variance in the population. For example, squaring.50 will result in a population

4 46 Bartlett, Kotrlik, & Higgins variance estimate of.25 for a dichotomous variable. Basic Sample Size Determination Continuous Data Before proceeding with sample size calculations, assuming continuous data, the researcher should determine if a categorical variable will play a primary role in data analysis. If so, the categorical sample size formulas should be used. If this is not the case, the sample size formulas for continuous data described in this section are appropriate. Assume that a researcher has set the alpha level a priori at.05, plans to use a seven point scale, has set the level of acceptable error at 3%, and has estimated the standard deviation of the scale as Cochran s sample size formula for continuous data and an example of its use is presented here along with the explanations as to how these decisions were made. (t) 2 * (s) 2 (1.96) 2 (1.167) 2 no= = = 118 (d) 2 (7*.03) 2 Where t = value for selected alpha level of.025 in each tail = 1.96 (the alpha level of.05 indicates the level of risk the researcher is willing to take that true margin of error may exceed the acceptable margin of error.) Where s = estimate of standard deviation in the population = (estimate of variance deviation for 7 point scale calculated by using 7 [inclusive range of scale] divided by 6 [number of standard deviations that include almost all (approximately 98%) of the possible values in the range]). Where d = acceptable margin of error for mean being estimated =.21. (number of points on primary scale * acceptable margin of error; points on primary scale = 7; acceptable margin of error =.03 [error researcher is willing to except]). Therefore, for a population of 1,679, the required sample size is 118. However, since this sample size exceeds 5% of the population (1,679*.05=84), Cochran s (1977) correction formula should be used to calculate the final sample size. These calculations are as follows: no (118) n = = = 111 (1 + no / Population) ( /1679) Where population size = 1,679. Where n0 = required return sample size according to Cochran s formula= 118. Where n1 = required return sample size because sample > 5% of population. These procedures result in the minimum returned sample size. If a researcher has a captive audience, this sample size may be attained easily. However, since many educational and social research studies often use data collection methods such as surveys and other voluntary participation methods, the response rates are typically well below 100%. Salkind (1997) recommended oversampling when he stated that If you are mailing out surveys or questionnaires,.... count on increasing your sample size by 40%-50% to account for lost mail and uncooperative subjects (p. 107). Fink (1995) stated that Oversampling can add costs to the survey but is often necessary (p. 36). Cochran (1977) stated that A second consequence is, of course, that the variances of estimates are increased because the sample actually obtained is smaller than the target sample. This factor can be allowed for, at least approximately, in selecting the size of the sample (p. 396). However, many researchers criticize the use of over-sampling to ensure that this minimum sample size is achieved and suggestions on how to secure the minimal sample size are scarce. If the researcher decides to use oversampling, four methods may be used to determine the anticipated response rate: (1) take the sample in two steps, and use the results of the first step to estimate how many additional responses may be expected from the second step; (2) use pilot study results; (3) use responses rates from previous studies of the same or a similar population; or (4) estimate the response rate. The first three ways are logical and will produce valid estimates of response

5 Organizational Research: Determining Appropriate Sample Size in Survey Research 47 rates; therefore, they do not need to be discussed further. Estimating response rates is not an exact science. A researcher may be able to consult other researchers or review the research literature in similar fields to determine the response rates that have been achieved with similar and, if necessary, dissimilar populations. Therefore, in this example, it was anticipated that a response rate of 65% would be achieved based on prior research experience. Given a required minimum sample size (corrected) of 111, the following calculations were used to determine the drawn sample size required to produce the minimum sample size: Where anticipated return rate = 65%. Where n2 = sample size adjusted for response rate. Where minimum sample size (corrected) = 111. Therefore, n2 = 111/.65 = 171. Categorical Data The sample size formulas and procedures used for categorical data are very similar, but some variations do exist. Assume a researcher has set the alpha level a priori at.05, plans to use a proportional variable, has set the level of acceptable error at 5%, and has estimated the standard deviation of the scale as.5. Cochran s sample size formula for categorical data and an example of its use is presented here along with explanations as to how these decisions were made. (t) 2 * (p)(q) no= (d) 2 (1.96) 2 (.5)(.5) no= = 384 (.05) 2 Where t = value for selected alpha level of.025 in each tail = (the alpha level of.05 indicates the level of risk the researcher is willing to take that true margin of error may exceed the acceptable margin of error). Where (p)(q) = estimate of variance =.25. (maximum possible proportion (.5) * 1- maximum possible proportion (.5) produces maximum possible sample size). Where d = acceptable margin of error for proportion being estimated =.05 (error researcher is willing to except). Therefore, for a population of 1,679, the required sample size is 384. However, since this sample size exceeds 5% of the population (1,679*.05=84), Cochran s (1977) correction formula should be used to calculate the final sample size. These calculations are as follows: no n1= (1 + no / Population) (384) n1= = 313 ( /1679) Where population size = 1,679 Where n0 = required return sample size according to Cochran s formula= 384 Where n1 = required return sample size because sample > 5% of population These procedures result in a minimum returned sample size of 313. Using the same oversampling procedures as cited in the continuous data example, and again assuming a response rate of 65%, a minimum drawn sample size of 482 should be used. These calculations were based on the following: Where anticipated return rate = 65%. Where n2 = sample size adjusted for response rate. Where minimum sample size (corrected) = 313. Therefore, n2 = 313/.65 = 482. Sample Size Determination Table Table 1 presents sample size values that will be appropriate for many common sampling problems. The table includes sample sizes for both continuous and categorical data assuming alpha levels of.10,.05, or.01. The margins of error used in the table were.03 for continuous data and.05 for

6 48 Bartlett, Kotrlik, & Higgins categorical data. Researchers may use this table if the margin of error shown is appropriate for their study; however, the appropriate sample size must be calculated if these error rates are not appropriate. Other Sample Size Determination Considerations data illustration, a population of 1,679 was utilized and it was determined that a minimum returned sample size of 111 was required. The sample size for a population of 1,679 in the categorical data example was 313. Table 2, developed based on the recommendations cited in the previous paragraph, uses both the five to one and ten to one ratios. Regression Analysis. Situations exist where the procedures described in the previous paragraphs will not satisfy the needs of a study and two examples will be addressed here. One situation is when the researcher wishes to use multiple regression analysis in a study. To use multiple regression analysis, the ratio of observations to independent variables should not fall below five. If this minimum is not followed, there is a risk for overfitting,... making the results too specific to the sample, thus lacking generalizability (Hair, Anderson, Tatham, & Black, 1995, p. 105). A more conservative ratio, of ten observations for each independent variable was reported optimal by Miller and Kunce (1973) and Halinski and Feldt (1970). These ratios are especially critical in using regression analyses with continuous data because sample sizes for continuous data are typically much smaller than sample sizes for categorical data. Therefore, there is a possibility that the random sample will not be sufficient if multiple variables are used in the regression analysis. For example, in the continuous Table 1: Table for Determining Minimum Returned Sample Size for a Given Population Size for Continuous and Categorical Data Population size Sample size Continuous data (margin of error=.03) alpha=.10 t=1.65 alpha=.05 t=1.96 alpha=.01 t=2.58 Categorical data (margin of error=.05) p=.50 t=1.65 p=.50 t= p=.50 t= , , , , , , , NOTE: The margins of error used in the table were.03 for continuous data and.05 for categorical data. Researchers may use this table if the margin of error shown is appropriate for their study; however, the appropriate sample size must be calculated if these error rates are not appropriate. Table developed by Bartlett, Kotrlik, & Higgins.

8 50 Bartlett, Kotrlik, & Higgins sample along with high quality data collection efforts will result in more reliable, valid, and generalizable results; it could also result in other resource savings. The bottom line is simple: research studies take substantial time and effort on the part of researchers. This paper was designed as a tool that a researcher could use in planning and conducting quality research. When selecting an appropriate sample size for a study is relatively easy, why wouldn t a researcher want to do it right? References Ary, D., Jacobs, L. C., & Razavieh, A. (1996). Introduction to research in education. Fort Worth, TX: Harcourt Brace College Publishers. Cochran, W. G. (1977). Sampling techniques (3 rd ed.). New York: John Wiley & Sons. Donald, M. N. (1967). Implications of non-response for the interpretation of mail questionnaire data. Public Opinion Quarterly, 24(1), Fink, A. (1995). The survey handbook. Thousand Oaks, CA: Sage Publications. Hagbert, E. C. (1968). Validity of questionnaire data: Reported and observed attendance in an adult education program. Public Opinion Quarterly, 25, Hair, J., Anderson, R., Tatham, R., & Black, W. (1995). Multivariate data analysis (4 th ed.). Upper Saddle River, NJ: Prentice Hall. Halinski, R. S. & Feldt, L. S. (1970). The selection of variables in multiple regression analyses. Journal of Educational Measurement, 7(3), Holton, E. H., & Burnett, M. B. (1997). Qualitative research methods. In R. A. Swanson, & E. F. Holton (Eds.), Human resource development research handbook: Linking research and practice. San Francisco: Berrett-Koehler Publishers. Johnson, P. O. (1959). Development of the sample survey as a scientific methodology. Journal of Experiential Education, 27, Krejcie, R. V., & Morgan, D. W. (1970). Determining sample size for research activities. Educational and Psychological Measurement, 30, Miller, D. E., & Kunce, J. T. (1973). Prediction and statistical overkill revisited. Measurement and Evaluation in Guidance, 6(3), Miller, L. E., & Smith, K. L. (1983). Handling nonresponse issues. Journal of Extension, 21, Peers, I. (1996). Statistical analysis for education and psychology researchers. Bristol, PA: Falmer Press. Salkind, N. J. (1997). Exploring research (3 rd ed.). Upper Saddle River, NJ: Prentice Hall. Wunsch, D. (1986). Survey research: Determining sample size and representative response. Business Education Forum, 40(5), Material published as part of this journal, either on-line or in print, is copyrighted by the Organizational Systems Research Association. Permission to make digital or paper copy of part or all of these works for personal or classroom use is granted without fee provided that the copies are not made or distributed for profit or commercial advantage AND that copies 1) bear this notice in full and 2) give the full citation. It is permissible to abstract these works so long as credit is given. To copy in all other cases or to republish or to post on a server or to redistribute to lists requires specific permission and payment of a fee. Contact Donna Everett, to request redistribution permission.

### What is Effect Size? effect size in Information Technology, Learning, and Performance Journal manuscripts.

The Incorporation of Effect Size in Information Technology, Learning, and Performance Research Joe W. Kotrlik Heather A. Williams Research manuscripts published in the Information Technology, Learning,

### Calculating, Interpreting, and Reporting Estimates of Effect Size (Magnitude of an Effect or the Strength of a Relationship)

1 Calculating, Interpreting, and Reporting Estimates of Effect Size (Magnitude of an Effect or the Strength of a Relationship) I. Authors should report effect sizes in the manuscript and tables when reporting

### UNDERSTANDING THE INDEPENDENT-SAMPLES t TEST

UNDERSTANDING The independent-samples t test evaluates the difference between the means of two independent or unrelated groups. That is, we evaluate whether the means for two independent groups are significantly

### ROCHESTER INSTITUTE OF TECHNOLOGY COURSE OUTLINE FORM COLLEGE OF SCIENCE. School of Mathematical Sciences

! ROCHESTER INSTITUTE OF TECHNOLOGY COURSE OUTLINE FORM COLLEGE OF SCIENCE School of Mathematical Sciences New Revised COURSE: COS-MATH-252 Probability and Statistics II 1.0 Course designations and approvals:

### Multinomial Logistic Regression

Multinomial Logistic Regression Dr. Jon Starkweather and Dr. Amanda Kay Moske Multinomial logistic regression is used to predict categorical placement in or the probability of category membership on a

### THE VALUE AND USEFULNESS OF INFORMATION TECHNOLOGY IN FAMILY AND CONSUMER SCIENCES EDUCATION AS PERCEIVED BY SECONDARY FACS TEACHERS

Journal of Family and Consumer Sciences Education, Vol. 18, No. 1, Spring/Summer 2000 THE VALUE AND USEFULNESS OF INFORMATION TECHNOLOGY IN FAMILY AND CONSUMER SCIENCES EDUCATION AS PERCEIVED BY SECONDARY

### NCBRT Diffusion of Innovation Project

NCBRT Diffusion of Innovation Project Issue: Training impact is often simply measured by the number of participants in a class. As the National Center for Biomedical Research and Training (NCBRT) continues

### Introduction to. Hypothesis Testing CHAPTER LEARNING OBJECTIVES. 1 Identify the four steps of hypothesis testing.

Introduction to Hypothesis Testing CHAPTER 8 LEARNING OBJECTIVES After reading this chapter, you should be able to: 1 Identify the four steps of hypothesis testing. 2 Define null hypothesis, alternative

### The Usability of Electronic Stores based on the Organization of Information and Features

The Usability of Electronic Stores based on the Organization of Information and Features CHAN KAH-SING Singapore Polytechnic This paper describes an investigation on how the perceived usability of electronic

### PROBABILITY AND STATISTICS. Ma 527. 1. To teach a knowledge of combinatorial reasoning.

PROBABILITY AND STATISTICS Ma 527 Course Description Prefaced by a study of the foundations of probability and statistics, this course is an extension of the elements of probability and statistics introduced

### DBA Courses and Sequence (2015-)

DBA Courses and Sequence (2015-) Term Courses (Credits) Year 1 / Summer Research Foundations (3) Applied Statistics & Regression (3) Year 1 / Fall Multivariate Analysis (3) Organizational Behavior (3)

### UNDERSTANDING THE DEPENDENT-SAMPLES t TEST

UNDERSTANDING THE DEPENDENT-SAMPLES t TEST A dependent-samples t test (a.k.a. matched or paired-samples, matched-pairs, samples, or subjects, simple repeated-measures or within-groups, or correlated groups)

### MED 600.970 RESEARCH IN MATHEMATICS EDUCATION SPRING, 2006

MED 600.970 RESEARCH IN MATHEMATICS EDUCATION SPRING, 2006 Instructor Required Text Bibliography Course Objectives Course Requirements Weekly Schedule Outline of Course Course Evaluation Instructor: Bill

### Fairfield Public Schools

Mathematics Fairfield Public Schools AP Statistics AP Statistics BOE Approved 04/08/2014 1 AP STATISTICS Critical Areas of Focus AP Statistics is a rigorous course that offers advanced students an opportunity

### Mathematics. Probability and Statistics Curriculum Guide. Revised 2010

Mathematics Probability and Statistics Curriculum Guide Revised 2010 This page is intentionally left blank. Introduction The Mathematics Curriculum Guide serves as a guide for teachers when planning instruction

### A Hands-On Exercise Improves Understanding of the Standard Error. of the Mean. Robert S. Ryan. Kutztown University

A Hands-On Exercise 1 Running head: UNDERSTANDING THE STANDARD ERROR A Hands-On Exercise Improves Understanding of the Standard Error of the Mean Robert S. Ryan Kutztown University A Hands-On Exercise

### Data Mining Techniques Chapter 5: The Lure of Statistics: Data Mining Using Familiar Tools

Data Mining Techniques Chapter 5: The Lure of Statistics: Data Mining Using Familiar Tools Occam s razor.......................................................... 2 A look at data I.........................................................

### Statistics in Medicine Research Lecture Series CSMC Fall 2014

Catherine Bresee, MS Senior Biostatistician Biostatistics & Bioinformatics Research Institute Statistics in Medicine Research Lecture Series CSMC Fall 2014 Overview Review concept of statistical power

### Antoine J. Alston North Carolina A&T State University. W. Wade Miller Iowa State University. Introduction/ Rationale

Analyzing the Barriers and Benefits Toward Instructional Technology Instruction in North Carolina and Virginia Secondary Agricultural Education Curricula Antoine J. Alston North Carolina A&T State University

### FINANCE AND ACCOUNTING OUTSOURCING AN EXPLORATORY STUDY OF SERVICE PROVIDERS AND THEIR CLIENTS IN AUSTRALIA AND NEW ZEALAND.

FINANCE AND ACCOUNTING OUTSOURCING AN EXPLORATORY STUDY OF SERVICE PROVIDERS AND THEIR CLIENTS IN AUSTRALIA AND NEW ZEALAND. Graham Ray, Accounting Lecturer, School of Commerce and Management, Southern

### Analyzing the Texas High School Agricultural Communications Curriculum. Michelle Montgomery-White Jacqui Lockaby Cindy Akers Texas Tech University

Analyzing the Texas High School Agricultural Communications Curriculum Michelle Montgomery-White Jacqui Lockaby Cindy Akers Texas Tech University Abstract The major purpose of this study was to evaluate

### The Impact of Management Information Systems on the Performance of Governmental Organizations- Study at Jordanian Ministry of Planning

The Impact of Management Information Systems on the Performance of Governmental Organizations- Study at Jordanian Ministry of Planning Dr. Shehadeh M.A.AL-Gharaibeh Assistant prof. Business Administration

### Organizing Your Approach to a Data Analysis

Biost/Stat 578 B: Data Analysis Emerson, September 29, 2003 Handout #1 Organizing Your Approach to a Data Analysis The general theme should be to maximize thinking about the data analysis and to minimize

### Assessment of Online Learning Environments: Using the OCLES(20) with Graduate Level Online Classes

www.ncolr.org/jiol Volume 7, Number 3, Winter 2008 ISSN: 15414914 Assessment of Online Learning Environments: Using the OCLES(20) with Graduate Level Online Classes Thomas A. DeVaney Nan B. Adams Cynthia

### Stages of Instructional Design V. Professional Development

Stages of Instructional Design V. Professional Development Derived from Gagné, R. M., Briggs, L. J., & Wager, W. W. (1992). Principles of Instructional Design (4th ed.). Fort Worth, TX: Harcourt Brace

### Pepperdine University Graduate School of Education and Psychology Dissertation Format Requirements Manual. APA 6 th edition format

Pepperdine University Graduate School of Education and Psychology Dissertation Format Requirements Manual APA 6 th edition format Version 10/29/2010 Table of Contents A. PEPPERDINE UNIVERSITY FORMAT...

### MBA 6001, Organizational Research and Theory Course Syllabus. Course Description. Prerequisites. Course Textbook. Course Learning Objectives.

MBA 6001, Organizational Research and Theory Course Syllabus Course Description Examination of organizational theory and managerial concepts of human behavior in organizations. Topics include theoretical

### GMAC. Predicting Success in Graduate Management Doctoral Programs

GMAC Predicting Success in Graduate Management Doctoral Programs Kara O. Siegert GMAC Research Reports RR-07-10 July 12, 2007 Abstract An integral part of the test evaluation and improvement process involves

### Influence of Tactical Factors on ERP Projects Success

2011 3rd International Conference on Advanced Management Science IPEDR vol.19 (2011) (2011) IACSIT Press, Singapore Influence of Tactical Factors on ERP Projects Success Shahin Dezdar + Institute for International

### DPLS 722 Quantitative Data Analysis

DPLS 722 Quantitative Data Analysis Spring 2011 3 Credits Catalog Description Quantitative data analyses require the use of statistics (descriptive and inferential) to summarize data collected, to make

### Promoting Rigorous Career and Technical Education Programs of Study

Promoting Rigorous Career and Technical Education Programs of Study Quantitative Outcomes Study: Baseline Data Collection Report Prepared under contract to Division of Academic and Technical Education

### City University of Hong Kong Course Syllabus. offered by Department of Applied Social Sciences with effect from SemesterA 2016 /17

City University of Hong Kong offered by Department of Applied Social Sciences with effect from SemesterA 2016 /17 Part I Course Overview Course Title: Complex Organizations Course Code: SS3419 Course Duration:

### KNOWLEDGE AND PERCEPTIONS OF VIRGINIA SECONDARY AGRICULTURE EDUCATORS TOWARD THE AGRICULTURAL TECHNOLOGY PROGRAM AT VIRGINIA TECH

KNOWLEDGE AND PERCEPTIONS OF VIRGINIA SECONDARY AGRICULTURE EDUCATORS TOWARD THE AGRICULTURAL TECHNOLOGY PROGRAM AT VIRGINIA TECH Dennis W. Duncan, Assistant Professor Virginia Tech Abstract Identifying

### CALCULATIONS & STATISTICS

CALCULATIONS & STATISTICS CALCULATION OF SCORES Conversion of 1-5 scale to 0-100 scores When you look at your report, you will notice that the scores are reported on a 0-100 scale, even though respondents

### Confidence Intervals for Cp

Chapter 296 Confidence Intervals for Cp Introduction This routine calculates the sample size needed to obtain a specified width of a Cp confidence interval at a stated confidence level. Cp is a process

### Consider a study in which. How many subjects? The importance of sample size calculations. An insignificant effect: two possibilities.

Consider a study in which How many subjects? The importance of sample size calculations Office of Research Protections Brown Bag Series KB Boomer, Ph.D. Director, boomer@stat.psu.edu A researcher conducts

### Chris Slaughter, DrPH. GI Research Conference June 19, 2008

Chris Slaughter, DrPH Assistant Professor, Department of Biostatistics Vanderbilt University School of Medicine GI Research Conference June 19, 2008 Outline 1 2 3 Factors that Impact Power 4 5 6 Conclusions

### School Psychology Doctoral Program Dissertation Outline 1 Final Version 6/2/2006

School Psychology Doctoral Program Dissertation Outline 1 Final Version 6/2/2006 Instructions: Double Underline means the item should be a title or heading in your dissertation. Do not deviate from the

### RESEARCH METHODS IN PSYCHOLOGY PSYC 381 FALL 2011 T & TH 12:10 p.m. to 1:25 p.m. (GRPS 1) SATURDAY 9/10 & 10/8 (8:00 a.m. to 12:00 noon Scott 123)

RESEARCH METHODS IN PSYCHOLOGY PSYC 381 FALL 2011 T & TH 12:10 p.m. to 1:25 p.m. (GRPS 1) SATURDAY 9/10 & 10/8 (8:00 a.m. to 12:00 noon Scott 123) E-Mail Address: crenold@vanguard.edu Phone: 714.556.3610

### Fixed-Effect Versus Random-Effects Models

CHAPTER 13 Fixed-Effect Versus Random-Effects Models Introduction Definition of a summary effect Estimating the summary effect Extreme effect size in a large study or a small study Confidence interval

### Simple Random Sampling

Source: Frerichs, R.R. Rapid Surveys (unpublished), 2008. NOT FOR COMMERCIAL DISTRIBUTION 3 Simple Random Sampling 3.1 INTRODUCTION Everyone mentions simple random sampling, but few use this method for

### Confidence Intervals for the Difference Between Two Means

Chapter 47 Confidence Intervals for the Difference Between Two Means Introduction This procedure calculates the sample size necessary to achieve a specified distance from the difference in sample means

### Exploratory Factor Analysis Brian Habing - University of South Carolina - October 15, 2003

Exploratory Factor Analysis Brian Habing - University of South Carolina - October 15, 2003 FA is not worth the time necessary to understand it and carry it out. -Hills, 1977 Factor analysis should not

### Assessing a theoretical model on EFL college students

ABSTRACT Assessing a theoretical model on EFL college students Yu-Ping Chang Yu Da University, Taiwan This study aimed to (1) integrate relevant language learning models and theories, (2) construct a theoretical

### Non-random/non-probability sampling designs in quantitative research

206 RESEARCH MET HODOLOGY Non-random/non-probability sampling designs in quantitative research N on-probability sampling designs do not follow the theory of probability in the choice of elements from the

### The Development of One Dimensional Scales for Assessing Stakeholder Perceptions of Academic Ethical Codes

Michael A. Yahr Lois D. Bryan Kurt Schimmel Robert Morris University 6001 University Blvd. Moon Township, PA 15108 yahr@rmu.edu bryan@rmu.edu schimmel@rmu.edu Michael A. Yahr Lois D. Bryan Kurt Schimmel

### Class 19: Two Way Tables, Conditional Distributions, Chi-Square (Text: Sections 2.5; 9.1)

Spring 204 Class 9: Two Way Tables, Conditional Distributions, Chi-Square (Text: Sections 2.5; 9.) Big Picture: More than Two Samples In Chapter 7: We looked at quantitative variables and compared the

### RESEARCH METHODS IN PSYCHOLOGY PSYC 381 FALL 2013 T & TH 12:10 p.m. to 1:25 p.m. (GRPS 1) SATURDAY 9/14 & 10/19 (8:00 a.m. to 12:00 noon Tech 101)

RESEARCH METHODS IN PSYCHOLOGY PSYC 381 FALL 2013 T & TH 12:10 p.m. to 1:25 p.m. (GRPS 1) SATURDAY 9/14 & 10/19 (8:00 a.m. to 12:00 noon Tech 101) E-Mail Address: crenold@vanguard.edu Phone: 714.556.3610

### Instructional Design Tips for Virtually Teaching Practical SkillsPeter Fenrich British Columbia Institute of Technology, Burnaby, Canada

Proceedings of the 2004 Informing Science and IT Education Joint Conference Instructional Design Tips for Virtually Teaching Practical SkillsPeter Fenrich British Columbia Institute of Technology, Burnaby,

### Data Quality Assessment

Data Quality Assessment Leo L. Pipino, Yang W. Lee, and Richard Y. Wang How good is a company s data quality? Answering this question requires usable data quality metrics. Currently, most data quality

### 5.1 Identifying the Target Parameter

University of California, Davis Department of Statistics Summer Session II Statistics 13 August 20, 2012 Date of latest update: August 20 Lecture 5: Estimation with Confidence intervals 5.1 Identifying

### DOI: 10.6007/IJARBSS/v3-i12/421 URL: http://dx.doi.org/10.6007/ijarbss/v3-i12/421

Capturing the Factors of Perverse Perception of Employees for Performance Appraisal System: A Case of Broadband Internet Service Providing Companies In Pakistan Wasim Abbas Awan Faculty of Management Sciences,

### An Introduction to Statistics Course (ECOE 1302) Spring Semester 2011 Chapter 10- TWO-SAMPLE TESTS

The Islamic University of Gaza Faculty of Commerce Department of Economics and Political Sciences An Introduction to Statistics Course (ECOE 130) Spring Semester 011 Chapter 10- TWO-SAMPLE TESTS Practice

### HYPOTHESIS TESTING (ONE SAMPLE) - CHAPTER 7 1. used confidence intervals to answer questions such as...

HYPOTHESIS TESTING (ONE SAMPLE) - CHAPTER 7 1 PREVIOUSLY used confidence intervals to answer questions such as... You know that 0.25% of women have red/green color blindness. You conduct a study of men

### How to Assign a Monetary Value to Volunteer Contributions

How to Assign a Monetary Value to Volunteer Contributions A MANUAL Laurie Mook Jack Quarter Ontario Institute for Studies in Education University of Toronto 2003 Canadian Centre for Philanthropy Copyright

### WAITING FOR TREATMENT: A SURVEY

WAITING FOR TREATMENT: A SURVEY OF STATE-FUNDED TREATMENT FACILITIES IN ILLINOIS, 2008 FINAL REPORT Timothy P. Johnson Ingrid Graf Young Ik Cho April 2008 412 South Peoria Street, 6th Floor Chicago, Illinois

### Auxiliary Variables in Mixture Modeling: 3-Step Approaches Using Mplus

Auxiliary Variables in Mixture Modeling: 3-Step Approaches Using Mplus Tihomir Asparouhov and Bengt Muthén Mplus Web Notes: No. 15 Version 8, August 5, 2014 1 Abstract This paper discusses alternatives

### A Comparison of Training & Scoring in Distributed & Regional Contexts Writing

A Comparison of Training & Scoring in Distributed & Regional Contexts Writing Edward W. Wolfe Staci Matthews Daisy Vickers Pearson July 2009 Abstract This study examined the influence of rater training

### Measurement Information Model

mcgarry02.qxd 9/7/01 1:27 PM Page 13 2 Information Model This chapter describes one of the fundamental measurement concepts of Practical Software, the Information Model. The Information Model provides

### Portfolio Assessment as an Alternate Appraisal Method: A Faculty Perspective

828 Portfolio Assessment as an Alternate Appraisal Method: A Faculty Perspective Kimberly D. Clements School District of Lee County Geri McArdle Barry University Ann F. Cole School District of Lee County

### Understanding Power and Rules of Thumb for Determining Sample Sizes

Tutorials in Quantitative Methods for Psychology 2007, vol. 3 (2), p. 43 50. Understanding Power and Rules of Thumb for Determining Sample Sizes Carmen R. Wilson VanVoorhis and Betsy L. Morgan University

### Malhotra, N. K. (2010). Marketing research: An applied orientation (6th ed.). Upper Saddle River, NJ: Prentice Hall.

Course Syllabus Course Description Introduction to the marketing research process. Exploration of the many ways that marketing researchers gather information and utilize technology and the Internet in

### 2014 Washington State Health Care Authority Adult Medicaid Health Plan CAHPS Report

State of Washington Health Care Authority 2014 Washington State Health Care Authority Adult Medicaid Health Plan CAHPS Report December 2014 3133 East Camelback Road, Suite 300 Phoenix, AZ 85016 Phone 602.264.6382

Business Valuation Review Regression Analysis in Valuation Engagements By: George B. Hawkins, ASA, CFA Introduction Business valuation is as much as art as it is science. Sage advice, however, quantitative

### Analyzing Research Articles: A Guide for Readers and Writers 1. Sam Mathews, Ph.D. Department of Psychology The University of West Florida

Analyzing Research Articles: A Guide for Readers and Writers 1 Sam Mathews, Ph.D. Department of Psychology The University of West Florida The critical reader of a research report expects the writer to

### MARKETING RESEARCH AND MARKET INTELLIGENCE

MARKETING RESEARCH AND MARKET INTELLIGENCE Course Objectives Upon completion of this unit you will be able to: Evaluate the applicability of the marketing research process to any marketing and market related

### What are the Effects of Comprehensive Developmental Guidance Programs on Early Elementary Students Academic Achievement?

School Counseling Research Brief 2.2, February 15, 2004 Center for School Counseling Outcome Research What are the Effects of Comprehensive Developmental Guidance Programs on Early Elementary Students

### Gender Effects in the Alaska Juvenile Justice System

Gender Effects in the Alaska Juvenile Justice System Report to the Justice and Statistics Research Association by André Rosay Justice Center University of Alaska Anchorage JC 0306.05 October 2003 Gender

### Learner Self-efficacy Beliefs in a Computer-intensive Asynchronous College Algebra Course

Learner Self-efficacy Beliefs in a Computer-intensive Asynchronous College Algebra Course Charles B. Hodges Georgia Southern University Department of Leadership, Technology, & Human Development P.O. Box

### Calculating, Interpreting, and Reporting Cronbach s Alpha Reliability Coefficient for Likert-Type Scales

2003 Midwest Research to Practice Conference in Adult, Continuing, and Community Education Calculating, Interpreting, and Reporting Cronbach s Alpha Reliability Coefficient for Likert-Type Scales Joseph

### Confidence Intervals for Coefficient Alpha

Chapter 818 Confidence Intervals for Coefficient Alpha Introduction Coefficient alpha, or Cronbach s alpha, is a measure of the reliability of a test consisting of k parts. The k parts usually represent

### Confidence Intervals for Spearman s Rank Correlation

Chapter 808 Confidence Intervals for Spearman s Rank Correlation Introduction This routine calculates the sample size needed to obtain a specified width of Spearman s rank correlation coefficient confidence

### Schools Value-added Information System Technical Manual

Schools Value-added Information System Technical Manual Quality Assurance & School-based Support Division Education Bureau 2015 Contents Unit 1 Overview... 1 Unit 2 The Concept of VA... 2 Unit 3 Control

### Validity Study of Non-MBA Programs

Validity Study of Non-MBA Programs Eileen Talento-Miller GMAC Research Reports RR-09-12 November 24, 2009 Although the validity of Graduate Management Admission Test (GMAT ) scores for predicting performance

### 2003 National Survey of College Graduates Nonresponse Bias Analysis 1

2003 National Survey of College Graduates Nonresponse Bias Analysis 1 Michael White U.S. Census Bureau, Washington, DC 20233 Abstract The National Survey of College Graduates (NSCG) is a longitudinal survey

### Final Exam Practice Problem Answers

Final Exam Practice Problem Answers The following data set consists of data gathered from 77 popular breakfast cereals. The variables in the data set are as follows: Brand: The brand name of the cereal

### Running head: SAMPLE FOR STUDENTS 1. Sample APA Paper for Students Interested in Learning APA Style 6th Edition. Jeffrey H. Kahn

Running head: SAMPLE FOR STUDENTS 1 Sample APA Paper for Students Interested in Learning APA Style 6th Edition Jeffrey H. Kahn Illinois State University Author Note Jeffrey H. Kahn, Department of Psychology,

### Shiken: JLT Testing & Evlution SIG Newsletter. 5 (3) October 2001 (pp. 13-17)

Statistics Corner: Questions and answers about language testing statistics: Point- biserial correlation coefficients James Dean Brown (University of Hawai'i at Manoa) QUESTION: Recently on the email forum

### SAMPLING FOR EFFECTIVE INTERNAL AUDITING. By Mwenya P. Chitalu CIA

SAMPLING FOR EFFECTIVE INTERNAL AUDITING By Mwenya P. Chitalu CIA EXPECTED PRESENTATION OUTCOMES Why Do Auditors Sample? Sampling Policy Statistical & Non-statistical Sampling Statistical Terminologies

### Using Theoretical Foundations for a Community Health Nursing or a Population Health Course

Ellermann, Critical Thinking and Clinical Reasoning in the Health Sciences, Facione and Facione (eds.), California Academic Press. 1 Measuring Thinking Worldwide This document is a best practices essay

### PERCEPTIONS OF IOWA SECONDARY SCHOOL PRINCIPALS TOWARD AGRICULTURAL EDUCATION. Neasa Kalme, Instructor Hamilton, Indiana

PERCEPTIONS OF IOWA SECONDARY SCHOOL PRINCIPALS TOWARD AGRICULTURAL EDUCATION Neasa Kalme, Instructor Hamilton, Indiana James E. Dyer, Assistant Professor University of Missouri Abstract The primary purpose

### Confidence Intervals for Cpk

Chapter 297 Confidence Intervals for Cpk Introduction This routine calculates the sample size needed to obtain a specified width of a Cpk confidence interval at a stated confidence level. Cpk is a process

### PROC LOGISTIC: Traps for the unwary Peter L. Flom, Independent statistical consultant, New York, NY

PROC LOGISTIC: Traps for the unwary Peter L. Flom, Independent statistical consultant, New York, NY ABSTRACT Keywords: Logistic. INTRODUCTION This paper covers some gotchas in SAS R PROC LOGISTIC. A gotcha

### Sample Size Planning, Calculation, and Justification

Sample Size Planning, Calculation, and Justification Theresa A Scott, MS Vanderbilt University Department of Biostatistics theresa.scott@vanderbilt.edu http://biostat.mc.vanderbilt.edu/theresascott Theresa

### AIE: 85-86, 193, 217-218, 294, 339-340, 341-343, 412, 437-439, 531-533, 682, 686-687 SE: : 339, 434, 437-438, 48-454, 455-458, 680, 686

Knowledge and skills. (1) The student conducts laboratory investigations and fieldwork using safe, environmentally appropriate, and ethical practices. The student is expected to: (A) demonstrate safe practices

### 11. Analysis of Case-control Studies Logistic Regression

Research methods II 113 11. Analysis of Case-control Studies Logistic Regression This chapter builds upon and further develops the concepts and strategies described in Ch.6 of Mother and Child Health:

### Instructional coaching at selected middle schools in south Texas and effects on student achievement

Instructional coaching at selected middle schools in south Texas and effects on student achievement ABSTRACT SantaPaula Gama Garcia Texas A&M University Kingsville Don Jones Texas A&M University Kingsville

### EXCHANGE. J. Luke Wood. Administration, Rehabilitation & Postsecondary Education, San Diego State University, San Diego, California, USA

Community College Journal of Research and Practice, 37: 333 338, 2013 Copyright# Taylor & Francis Group, LLC ISSN: 1066-8926 print=1521-0413 online DOI: 10.1080/10668926.2012.754733 EXCHANGE The Community

### CHAPTER 2 Estimating Probabilities

CHAPTER 2 Estimating Probabilities Machine Learning Copyright c 2016. Tom M. Mitchell. All rights reserved. *DRAFT OF January 24, 2016* *PLEASE DO NOT DISTRIBUTE WITHOUT AUTHOR S PERMISSION* This is a

### Inter-Rater Agreement in Analysis of Open-Ended Responses: Lessons from a Mixed Methods Study of Principals 1

Inter-Rater Agreement in Analysis of Open-Ended Responses: Lessons from a Mixed Methods Study of Principals 1 Will J. Jordan and Stephanie R. Miller Temple University Objectives The use of open-ended survey

### EVALUATION OF THE EFFECTIVENESS OF ACCOUNTING INFORMATION SYSTEMS

49 International Journal of Information Science and Technology EVALUATION OF THE EFFECTIVENESS OF ACCOUNTING INFORMATION SYSTEMS H. Sajady, Ph.D. M. Dastgir, Ph.D. Department of Economics and Social Sciences

### Introduction to Survey Methodology. Professor Ron Fricker Naval Postgraduate School Monterey, California

Introduction to Survey Methodology Professor Ron Fricker Naval Postgraduate School Monterey, California 1 Goals for this Lecture Introduce professor and course Define what we mean by the term survey Characteristics

### RMTD 404 Introduction to Linear Models

RMTD 404 Introduction to Linear Models Instructor: Ken A., Assistant Professor E-mail: kfujimoto@luc.edu Phone: (312) 915-6852 Office: Lewis Towers, Room 1037 Office hour: By appointment Course Content

### Chapter 5: Analysis of The National Education Longitudinal Study (NELS:88)

Chapter 5: Analysis of The National Education Longitudinal Study (NELS:88) Introduction The National Educational Longitudinal Survey (NELS:88) followed students from 8 th grade in 1988 to 10 th grade in

### e = random error, assumed to be normally distributed with mean 0 and standard deviation σ

1 Linear Regression 1.1 Simple Linear Regression Model The linear regression model is applied if we want to model a numeric response variable and its dependency on at least one numeric factor variable.

### 2 Precision-based sample size calculations

Statistics: An introduction to sample size calculations Rosie Cornish. 2006. 1 Introduction One crucial aspect of study design is deciding how big your sample should be. If you increase your sample size