Hoke Wilson, PhD Director, Center for Workforce Development and Social Policy Research Optimal Solutions Group
|
|
- Albert Daniel
- 8 years ago
- Views:
Transcription
1 Hoke Wilson, PhD Director, Center for Workforce Development and Social Policy Research Optimal Solutions Group
2 Session Objec,ves To motivate practitioners to embrace evaluation as a standard practice To describe four general categories of evaluation To use the first and second categories those we are most familiar with to inform our thoughts about the third and fourth To visualize the issues we will have to confront if we are to successfully conduct an impact, or even outcome, evaluation
3 Why Evaluate? Because we care about what we re doing and want to get it right Because, like it or not, the evaluation tsunami is coming.
4 Why Evaluate? This just in! Americans don t trust their government! Only 20% of Americans express confidence in their government (Pew, Oct. 2013) Almost half of all Americans do not trust Federal Agencies to carry out their missions (Gallop, Sept. 2013) Americans aren t thrilled about paying taxes/funding government ( s Totally Unsubstantiated Opinion.org)
5 Why Evaluate? The Government has something to sell: Itself! Endeavoring to be smarter, more innovative, and more accountable by applying existing evidence about what works, generating new knowledge, and using experimentation and innovation to test new approaches to program delivery 1 Spending decisions [will be] based not only on good intentions, but also on strong evidence that yield the highest social returns on carefully targeted investments pdf PER/pdf/BUDGET PER.pdf
6 Why Evaluate? Currently, some agencies (not FNS) are having trouble with adoption, but they re getting there Four basic types of evaluation Process Formative Outcome Impact
7 Process Evalua,on ( Bean Coun,ng ) Tracking the actual implementation, e.g. its delivery, who it reached, what resources were used? Used to determine if intervention was delivered as designed. Helps identify barriers to administration and strategies to overcome these barriers in the future. If you re a SNAP- Ed er, you already do this.
8 Educa,on and Administra,ve Repor,ng System (EARS) Provides data and information about the activities of all States participating in SNAP- Ed Data collected include: Counts of SNAP- Ed participants; their ages, gender, race and ethnicity The number and length of sessions attended Expenditures by source of funding Administrative $$ vs. Program Delivery $$ Educational content
9 GeFng Started Forma,ve Evalua,on Often used at the nascent stages of intervention planning. What s going on here? Often used when developing a questionnaire. Do my people understand what I m trying to ask them? Data collection may comprise the use of focus groups, literature reviews, ethnographic interviews, or even anecdotal evidence. Results are informative not definitive!
10 Evidence- Based Prac,ce 1 A 5- step program widely used in the health care professions for assessing evidence in a systematic way and choosing a course of action. A structured approach to formative evaluation!. 1 Evidence- Based Practice: An Interprofessional Tutorial, University of Minnesota Bio- Medical Library, learn/ebp/index.html
11 Evidence- Based Prac,ce (Step 1: Ques,on Formula,on) Problem What seems to be the matter? (Needs Assessment) Intervention How do you propose to set things right? Comparison What approaches have others taken? Outcome(s) What would you like to see happen?
12 Evidence- Based Prac,ce (Step 2: Literature Review)
13 Evidence- Based Prac,ce (Step 3: Cri,cal Appraisal) A. Was the population under study appropriate (sample frame!) B. Assignment to treatments/conditions randomized? Intention- to- treat: No disappearing subjects. Why is this important? Were the treatment groups similar at the beginning of the trial?
14 C. Evidence- Based Prac,ce (Step 3: Cri,cal Appraisal) Were the outcomes measured identically for all groups. Treatments too, if more than one dosage level! Were treatment and comparison groups, at the end of the trial, similar in all ways except the outcome of interest? Was the follow- up accurate?
15 Evidence- Based Prac,ce (Step 4: Applying the Evidence) Steps 1 through 3 address internal validity. Are the studies you ve reviewed valid for the populations and situations the authors had to deal with? Here we need to ask if the studies have external validity from your perspective! Can they be pulled out of their specifics and applied to other, similar situations without a complete overhaul?
16 Evidence- Based Prac,ce (Step 5: Re- evalua,on!) After a careful critique of all the work that has come before you After the careful and methodical application of your chosen strategy to resolving the problem confronting you Did it work?? There is only ONE way to find out!!!
17 Evidence- Based Prac,ce We have used the best possible evidence to formulate our approach, but precisely what is evidence? Evidence Proof!
18 Outcome Evalua,on Addresses whether changes in your outcome variable occurred in conjunction with your intervention Indicates the degree of change but cannot ascribe the source of the change Something did or did not happen. Why it happened we cannot tell.
19 Outcome Evalua,on (How high is up?) Outcome Comparison Intervention Pre Test Post Test
20 Outcome Evalua,on (How low is down?) Outcome Intervention Comparison Pre Test Post Test
21 Outcome Evalua,on (PiTalls clustered samples) Pre/Post Outcome Difference Class 1 Class 2 Class 3 Dosage Level
22 Outcome Evalua,on (PiTalls not considering varia,on in response) # of Units Pre Post Outcome
23 Outcome Evalua,on (How do I know how big the varia,on might be?) You won t know until you re done, but Let experience be your guide. What are the highest and lowest values of the outcome variable that you have somewhat commonly seen? Will the change you expect to bring about fall within this range/interval? Let your evidence- based formative evaluation be your guide. Most research papers will provide a standard deviation (sd) or standard error (se) somewhere, in some form. Take your expected baseline value and add two sds. Does your expected final value fall within this range?
24 Outcome Evalua,on (So what does this mean?) All other things being equal, the bigger the change you expect to bring about, the fewer people/surveys you will need to demonstrate an effect! All other things being equal, the wider the variation in potential outcomes, the more people/surveys you will need to demonstrate an effect! In all events, with an outcome evaluation we will only be able to tell if there was a change. We will never be able to be certain of what motivated it.
25 Outcome Evalua,on (PiTalls Spurious correla,on) My favorite example is to do the following:* 1. Get data on all the fires in San Francisco for the last ten years. 2. Correlate the number of fire engines at each fire and the damages in dollars at each fire. Conclusion: The more fire engines you have the greater will be the likely dollar value of the damage. Therefore, get rid of the fire engines and you ll have less damage. * From William C. Burns, Spurious Correlations (
26 Outcome Evalua,on (PiTalls Spurious correla,on
27 Impact Evalua,on When properly conducted an impact evaluation can deal with a number of issues ignored with outcome evaluation. Maturation effects and seasonality. Potential influence of confounds/population attributes through randomization Reasonably minor differences in treatment groups through differencing.
28 Impact Evalua,on (Seasonality/matura,on and group differences) F&V Consumption Comparison No real difference Intervention Winter Summer
29 Impact Evalua,on (Confounds not to be confused with stra,fica,on) Treatment Comparison Row Total Second Grade Eight Grade Column Total How can we distinguish the effects of the treatment from the effects of being an adolescent?
30 Impact Evalua,on (Confounding confounds through random assignment) Treatment Comparison Row Total Second Grade Eight Grade Column Total Groups are not perfectly comparable by grade, but this is a situation we can deal with!
31 Impact Evalua,on (Randomiza,on within matched pairs) Height Town 1 Town 2 Town 3 Do you see a couple of Tylenol moments on the horizon? Age
32 Impact Evalua,on (Quasi- experimental Design) As we saw in the last slide, sometimes random assignment is just not practical (or even ethical!). In such cases we must make do with naturally occurring experiments. In the case of the last slide, what should we do? Should we drop one town, or go find some more? Adding more, what will happen to the number of students? Up or down? Sorry. We ve simply traded one set of problems for another. No easy way out.
33 Universal Considera,ons Appropriate Sample Frame Our sample frame places a border around everything we do. We sample properly so that we can make valid inferences from our sample to the population. But the population is defined by the sample frame!!! A good sample frame must Be realistically obtainable and accurate ( Are these telephone numbers still likely to be valid? What s the issue if some sizable percentage is not?) Fully describe your population of interest without leaving anyone (or very few) out
34 Universal Considera,ons Appropriate Sample Frame
35 Universal Considera,ons Appropriate Sample Frame* *The only population of women about whom I can make reasonably valid inferences
36 Universal Considera,ons Response rates and comple,on rates High response rates needed to avoid undermining your carefully crafted sampling frame by introducing response bias Requires persistence and will not make you popular. Get used to it! 80% is the OMB standard The survey data collector as the 21 st century s Fuller Brush Man/Woman
37 Universal Considera,ons Response rates and comple,on rates A completion often means obtaining responses to a minimum number of key questionnaire item Here we take it to mean the completion of both pre- and post- intervention surveys for a given respondent. From your experience, might there be a systematic difference between individuals who choose to stick with a program and those who do not? Which group is likely to exhibit the best outcomes? Which group is likely to have the most favorable view of your intervention?
38 Universal Considera,ons Response rates and comple,on rates Intention- to- treat: Now this is a tough, tough data collection. Why is it tough? Why must we bother? How do we incorporate this partial data with our completed (pre/post) records? Hint: think dosage.
39 Jus,fying your existence with Four types of evaluation Process Formative (Evidenced- based? Don t forget step five!) Outcome Impact Each type of evaluation progressively brings greater Rigor Inconvenience Expense So why do it?
40 Survey Research Because it pays! Nothing looks better on a grant application than evidence. Pay for Success The Administration is continuing to invest in Pay for Success to support evidence- based innovation at the State and local levels. In the Pay for Success model, philanthropic and other private investors provide up- front funding for preventive services and the government does not pay unless and until there are results PER/pdf/BUDGET PER.pdf p.68
IPDET Module 6: Descriptive, Normative, and Impact Evaluation Designs
IPDET Module 6: Descriptive, Normative, and Impact Evaluation Designs Intervention or Policy Evaluation Questions Design Questions Elements Types Key Points Introduction What Is Evaluation Design? Connecting
More informationWelcome back to EDFR 6700. I m Jeff Oescher, and I ll be discussing quantitative research design with you for the next several lessons.
Welcome back to EDFR 6700. I m Jeff Oescher, and I ll be discussing quantitative research design with you for the next several lessons. I ll follow the text somewhat loosely, discussing some chapters out
More informationInternational IPTV Consumer Readiness Study
International IPTV Consumer Readiness Study Methodology The Accenture International IPTV Study is based on structured telephone interviews using a standard questionnaire and quantitative analysis methods
More informationChapter 2. Sociological Investigation
Chapter 2 Sociological Investigation I. The Basics of Sociological Investigation. A. Sociological investigation begins with two key requirements: 1. Apply the sociological perspective. 2. Be curious and
More informationCALCULATIONS & STATISTICS
CALCULATIONS & STATISTICS CALCULATION OF SCORES Conversion of 1-5 scale to 0-100 scores When you look at your report, you will notice that the scores are reported on a 0-100 scale, even though respondents
More informationWriting a Literature Review Paper
Writing a Literature Review Paper 1. Your first question when assigned a literature review paper may be what is it? 2. First, let s look at what a literature review is not. a. It s not an annotated bibliography.
More information50 Tough Interview Questions
You and Your Accomplishments 1. Tell me a little about yourself. 50 Tough Interview Questions Because this is often the opening question, be careful that you don t run off at the mouth. Keep your answer
More informationEvaluation: Designs and Approaches
Evaluation: Designs and Approaches Publication Year: 2004 The choice of a design for an outcome evaluation is often influenced by the need to compromise between cost and certainty. Generally, the more
More informationStudy Guide for the Library Media Specialist Test Revised 2009
Study Guide for the Library Media Specialist Test Revised 2009 A PUBLICATION OF ETS Table of Contents Study Guide for the Library Media Specialist Test TABLE OF CONTENTS Chapter 1 Introduction to the Library
More information2013 Copyright ComFit Learning Prep
1 2 We at ComFit share with you a common objec=ve: to help your students be more successful in their academic lives and their personal lives. We seek to accomplish this objec=ve by helping you address
More informationFairfield Public Schools
Mathematics Fairfield Public Schools AP Statistics AP Statistics BOE Approved 04/08/2014 1 AP STATISTICS Critical Areas of Focus AP Statistics is a rigorous course that offers advanced students an opportunity
More informationChapter 10. Key Ideas Correlation, Correlation Coefficient (r),
Chapter 0 Key Ideas Correlation, Correlation Coefficient (r), Section 0-: Overview We have already explored the basics of describing single variable data sets. However, when two quantitative variables
More informationThe Future of Sales Training
A Sales Performance International White Paper The Future of Sales Training Part I of a III part series: Why Sales Training Often Fails Article at a glance: Companies are spending billions on sales training
More informationHow to Make the Most of Excel Spreadsheets
How to Make the Most of Excel Spreadsheets Analyzing data is often easier when it s in an Excel spreadsheet rather than a PDF for example, you can filter to view just a particular grade, sort to view which
More informationOutcomes Assessment for School and Program Effectiveness: Linking Planning and Evaluation to Mission, Goals and Objectives
Outcomes Assessment for School and Program Effectiveness: Linking Planning and Evaluation to Mission, Goals and Objectives The Council on Education for Public Health (CEPH) views the planning and evaluation
More informationWhy Sample? Why not study everyone? Debate about Census vs. sampling
Sampling Why Sample? Why not study everyone? Debate about Census vs. sampling Problems in Sampling? What problems do you know about? What issues are you aware of? What questions do you have? Key Sampling
More informationVision for Education. Academic Preparation. Technical. Skills Cognitive. Interpersonal Qualities. Basic. Critical Thinking. Skills.
Vision for Education as s n Ka ge & y le ead l o C er R e Car Academic Basic Cognitive Critical Thinking Technical Interpersonal Qualities Career Interest Development January, 2013 March 2013 If you have
More informationSP500 September 2011 Outlook
SP500 September 2011 Outlook This document is designed to provide the trader and investor of the Standard and Poor s 500 with an overview of the seasonal tendency as well as the current cyclic pattern
More informationDATA COLLECTION AND ANALYSIS
DATA COLLECTION AND ANALYSIS Quality Education for Minorities (QEM) Network HBCU-UP Fundamentals of Education Research Workshop Gerunda B. Hughes, Ph.D. August 23, 2013 Objectives of the Discussion 2 Discuss
More informationNON-PROBABILITY SAMPLING TECHNIQUES
NON-PROBABILITY SAMPLING TECHNIQUES PRESENTED BY Name: WINNIE MUGERA Reg No: L50/62004/2013 RESEARCH METHODS LDP 603 UNIVERSITY OF NAIROBI Date: APRIL 2013 SAMPLING Sampling is the use of a subset of the
More informationTitle ID Number Sequence and Duration Age Level Essential Question Learning Objectives. Lead In
Title ID Number Sequence and Duration Age Level Essential Question Learning Objectives Lesson Activity Barbie Bungee (75-80 minutes) MS-M-A1 Lead In (15-20 minutes) Activity (45-50 minutes) Closure (10
More informationEXAMINATIONS OF THE HONG KONG STATISTICAL SOCIETY
EXAMINATIONS OF THE HONG KONG STATISTICAL SOCIETY HIGHER CERTIFICATE IN STATISTICS, 2015 MODULE 1 : Data collection and interpretation Time allowed: One and a half hours Candidates should answer THREE
More information$360M. Who Raised. 200 Startups. What We Learned. Why do some startups get funded? What makes for the best pitch? How does the process work?
Why do some startups get funded? What makes for the best pitch? How does the process work? What We Learned from 200 Startups DocSend recently teamed up with Professor Tom Eisenmann from Harvard Business
More informationHow to tackle exams: a marker s perspective
RELEVANT TO ACCA QUALIFICATION PAPERS P1, P3, P4, P5, P6 AND P7 How to tackle exams: a marker s perspective I have been lecturing students for more than 15 years (usually over 400 at every sitting) preparing
More informationChapter 7 Sampling (Reminder: Don t forget to utilize the concept maps and study questions as you study this and the other chapters.
Chapter 7 Sampling (Reminder: Don t forget to utilize the concept maps and study questions as you study this and the other chapters.) The purpose of Chapter 7 it to help you to learn about sampling in
More informationMaths Mastery in Primary Schools
Maths Mastery in Primary Schools Institute of Education, University of London John Jerrim Evaluation Summary Age range Year 7 Number of pupils c. 10,000 Number of schools 50 Design Primary Outcome Randomised
More informationWriting Student Learning Outcomes for an Academic Program
Writing Student Learning Outcomes for an Academic Program Student learning outcomes (SLOs) are statements of the knowledge, skills, competencies, or attitudes that students are expected to gain through
More informationInclusion and Exclusion Criteria
Inclusion and Exclusion Criteria Inclusion criteria = attributes of subjects that are essential for their selection to participate. Inclusion criteria function remove the influence of specific confounding
More information7 Steps for a Successful Salesforce Implementation
7 Steps for a Successful Salesforce Implementation Salesforce can integrate all of your nonprofit s business processes into one system. You might be interested in a case management system, a better way
More informationChapter 8: Quantitative Sampling
Chapter 8: Quantitative Sampling I. Introduction to Sampling a. The primary goal of sampling is to get a representative sample, or a small collection of units or cases from a much larger collection or
More informationBystander Intervention
Bystander Intervention T Y P E S 1 Common Components 2 What is Bystander Intervention 3 Techniques to Try 4 Steps to Action 5 Who you can contact for more information regarding bystander intervention and
More informationComparison of Research Designs Template
Comparison of Comparison of The following seven tables provide an annotated template to guide you through the comparison of research designs assignment in this course. These tables help you organize your
More informationAvatar: Appearance Changing Your Shape. 1-1.2 Introduction. 1-1.2.1 Instruction. 1-1.2.2 Practice LEVEL: 1 MODULE: AVATAR: APPEARANCE MISSION 2
Avatar: Appearance Changing Your Shape LEVEL: 1 MODULE: AVATAR: APPEARANCE MISSION 2 1-1.2 Introduction Now that you have a default avatar, it s time to start customizing it to your liking! Fortunately,
More informationTest your talent How does your approach to talent strategy measure up?
1 Test your talent How does your approach to talent strategy measure up? Talent strategy or struggle? Each year at Head Heart + Brain we carry out research projects to help understand best practice in
More informationBrain-in-a-bag: creating an artificial brain
Activity 2 Brain-in-a-bag: creating an artificial brain Age group successfully used with: Abilities assumed: Time: Size of group: 8 adult answering general questions, 20-30 minutes as lecture format, 1
More informationMarch 12, 2007 Survey Results on Education Among California Business Leaders
March 12, 2007 Survey Results on Education Among California Business Leaders To: From: Interested Parties Ben Tulchin and Katie Muehlenkamp, Greenberg Quinlan Rosner Introduction Greenberg Quinlan Rosner
More informationTerminology and Scripts: what you say will make a difference in your success
Terminology and Scripts: what you say will make a difference in your success Terminology Matters! Here are just three simple terminology suggestions which can help you enhance your ability to make your
More informationSAMPLE INTERVIEW QUESTIONS
SAMPLE INTERVIEW QUESTIONS Interviews and interview styles vary greatly, so the best way to prepare is to practice answering a broad range of questions. For other great interview strategies, see our Successful
More informationHOW TO SUCCEED WITH NEWSPAPER ADVERTISING
HOW TO SUCCEED WITH NEWSPAPER ADVERTISING With newspaper advertising, Consistent Advertising = Familiarity = Trust = Customers. People won t buy from you until they trust you! That trust and confidence
More informationThe Fast Marathoner 2001 Joe Friel. Maybe you ve been thinking about running a marathon later this season.
The Fast Marathoner 2001 Joe Friel Maybe you ve been thinking about running a marathon later this season. If your only goal is to finish, which is a good idea if this will be your first time at this distance,
More informationExpanding Assessment of Analy3cal Skills among Biology Majors: From Introductory labs to Upper Division Elec3ves
Expanding Assessment of Analy3cal Skills among Biology Majors: From Introductory labs to Upper Division Elec3ves Presented by Kathleen McAuley PI: Serena Moseman- Val3erra, Ph.D. Department of Biological
More informationSECTION 1: Example Exercise Outcomes. Instructions and Questions Booklet. AssessmentDay. Practice Assessments
SECTION 1: Example Exercise Outcomes SECTION 2: Competencies Competency and Behavioural Indicators Based Interview Instructions and Questions Booklet Practice Assessments Instructions These competency
More informationResearch Methods & Experimental Design
Research Methods & Experimental Design 16.422 Human Supervisory Control April 2004 Research Methods Qualitative vs. quantitative Understanding the relationship between objectives (research question) and
More informationNewspaper Activities for Students
Newspaper Activities for Students Newspaper Activities for Students Page 2 Higher Learning By the year 2010, millions of the jobs available in the United States will require more than a high school diploma.
More informationDESIGNING A QUALITATIVE RESEARCH CONCEPTUAL FRAMEWORK AND RESEARCH QUESTIONS. Nicholas J. Sitko PROJECT: INDABA AGRICULTURAL POLICY RESEARCH INSTITUTE
DESIGNING A QUALITATIVE RESEARCH PROJECT: CONCEPTUAL FRAMEWORK AND RESEARCH QUESTIONS Nicholas J. Sitko June 7 th, 2013 INDABA AGRICULTURAL POLICY RESEARCH INSTITUTE 1 Interactive Model of Research Design
More informationIntroduction to PhD Research Proposal Writing. Dr. Solomon Derese Department of Chemistry University of Nairobi, Kenya sderese@uonbai.ac.
Introduction to PhD Research Proposal Writing Dr. Solomon Derese Department of Chemistry University of Nairobi, Kenya sderese@uonbai.ac.ke 1 Your PhD research proposal should answer three questions; What
More informationThe Mozart effect Methods of Scientific Research
The Mozart effect Methods of Scientific Research Chapter 2 Experimental Research: p42 49 http://www.mozarteffect.com/ http://www.amazon.com/mozart-sonata-pianos-schubert-fantasia/dp/b0000cf330 http://www.youtube.com/watch?v=hhqn2qjhlcm
More information12/30/2012. Research Design. Quantitative Research: Types (Campbell & Stanley, 1963; Crowl, 1993)
Quantitative Prepared by: Amanda J. Rockinson-Szapkiw Liberty University A research design is a plan that guides the decision as to: when and how often to collect data what data to gather and from whom
More informationCOACHING GUIDE. Preparing Athletes for Competition
COACHING GUIDE Preparing Athletes for Competition Table of Contents Table of Contents Psychological Considerations Anxiety and Stress Management Winning and Losing Handling Grief Taking Athletes to Competition
More informationThe Value of Financial Planning
The Value of Financial Planning FPSB s Global Consumer Survey Danel Kuhlmann Financial Planning Standards Board Marketing & Communications Director 1 Copyright 2015 Financial Planning Standards Board Who
More informationOverview. Triplett (1898) Social Influence - 1. PSYCHOLOGY 305 / 305G Social Psychology. Research in Social Psychology 2005
PSYCHOLOGY 305 / 305G Social Psychology Research in Social Psychology 2005 Overview Triplett s study of social influence (1897-1898) Scientific Method Experimental Advantages & Disadvantages Non-experimental
More informationThe BYU- Idaho social Work program is Accredited by the Council on Social Work Education (CSWE).
The BYU- Idaho social Work program is Accredited by the Council on Social Work Education (CSWE). The data presented below and the format are largely due to CSWE s requirements for accreditation. Program
More informationEverything you wanted to know about using Hexadecimal and Octal Numbers in Visual Basic 6
Everything you wanted to know about using Hexadecimal and Octal Numbers in Visual Basic 6 Number Systems No course on programming would be complete without a discussion of the Hexadecimal (Hex) number
More information(Refer Slide Time: 2:03)
Control Engineering Prof. Madan Gopal Department of Electrical Engineering Indian Institute of Technology, Delhi Lecture - 11 Models of Industrial Control Devices and Systems (Contd.) Last time we were
More informationSocial Return on Investment
Social Return on Investment Valuing what you do Guidance on understanding and completing the Social Return on Investment toolkit for your organisation 60838 SROI v2.indd 1 07/03/2013 16:50 60838 SROI v2.indd
More informationTips for Avoiding Bad Financial Advice
Tips for Avoiding Bad Financial Advice This guide is a free public service from Paladin Registry. It contains information that will increase your awareness about issues that concern advisors and help you
More informationMy Favorite Futures Setups. By John F. Carter www.tradethemarkets.com
My Favorite Futures Setups By John F. Carter www.tradethemarkets.com Recognizing Momentum Incredibly easy to do in hindsight. Get in Before the Move? I m a big believer in not chasing markets. By the time
More informationThe Development of the Clinical Healthcare Support Worker Role: A Review of the Evidence. Executive Summary
The Development of the Clinical Healthcare Support Worker Role: A Review of the Evidence Executive Summary The Development of the Clinical Healthcare Support Worker Role: A Review of the Evidence Executive
More informationGUIDELINES FOR REVIEWING QUANTITATIVE DESCRIPTIVE STUDIES
GUIDELINES FOR REVIEWING QUANTITATIVE DESCRIPTIVE STUDIES These guidelines are intended to promote quality and consistency in CLEAR reviews of selected studies that use statistical techniques and other
More informationNon-random/non-probability sampling designs in quantitative research
206 RESEARCH MET HODOLOGY Non-random/non-probability sampling designs in quantitative research N on-probability sampling designs do not follow the theory of probability in the choice of elements from the
More informationCampus Academic Resource Program
This handout will: Discuss how to interpret teaching credential application essay prompts. Provide an example of a prompt. Provide an example of a sample response with critique. Discuss how to establish
More informationGetting the best from your 360 degree feedback
1 Contents Getting the best from your 360 degree feedback... 3 What it is.... 3 And isn t.... 4 Using the system... 5 Choosing your respondents... 5 Choosing your competencies... 5 Compiling your questionnaire...
More informationSession 7 Fractions and Decimals
Key Terms in This Session Session 7 Fractions and Decimals Previously Introduced prime number rational numbers New in This Session period repeating decimal terminating decimal Introduction In this session,
More informationMarket Research Methodology
Market Research Methodology JANUARY 12, 2008 MARKET RESEARCH ANALYST Market Research Basics Market research is the process of systematic gathering, recording and analyzing of data about customers, competitors
More informationIan Shuman, CPA Trevor Williams, CPA. Center for Nonprofit Advancement
Preparing for Your Audit Ian Shuman, CPA Trevor Williams, CPA Center for Nonprofit Advancement Final Products & Reports Audit Report The end product of the audit is the expression of an opinion as to the
More informationSales people who are trying to switch your phone service or put you on VoIP. Sales people who work for companies who fix billing errors.
Introduction Truth about Managing Telecom Costs. Many people hear all the time from sales people promising to reduce telecom costs. Yet often these promises are never delivered on. There are typically
More informationCompleting the competency based application form
Completing the competency based application form For the HEO/SEO cohort, you will be required to provide evidence of how you meet the following competencies: This involves completing and submitting a competency
More informationWhy A/ B Testing is Critical to Email Campaign Success
Why A/ B Testing is Critical to Email Campaign Success A / B Testing By systematically running controlled campaigns, A/B testing helps you determine which message or offer will resonate best with your
More informationDECISION-MAKING 6-1 DECISION-MAKING
DECISION-MAKING 6-1 DECISION-MAKING OBJECTIVES To successfully complete this assignment, you must study the text and master the following objectives: Describe the six strategies used to make decisions.
More informationSession 7 Bivariate Data and Analysis
Session 7 Bivariate Data and Analysis Key Terms for This Session Previously Introduced mean standard deviation New in This Session association bivariate analysis contingency table co-variation least squares
More informationADD/ADHD in the Classroom
ADD/ADHD in the Classroom TIPS FOR TEACHERS AND PARENTS At any given time, a teacher can expect to have at least one student with ADHD. The impulsive and hyperactive behavior of such students can be distracting
More informationCase Statements. The questions below will help you create these sections and a case statement for your program.
Case Statements What they are: Case statements start as descriptions of the basic components most grant funders request. They are living documents where you can add additional information about a program
More informationScientific Method. 2. Design Study. 1. Ask Question. Questionnaire. Descriptive Research Study. 6: Share Findings. 1: Ask Question.
Descriptive Research Study Investigation of Positive and Negative Affect of UniJos PhD Students toward their PhD Research Project : Ask Question : Design Study Scientific Method 6: Share Findings. Reach
More informationDeveloping an implementation research proposal. Session 2: Research design
Developing an implementation research proposal Session 2: Research design Learning objectives After completing this session, you will be able to: Develop a research design outlining your data collection
More informationStudy Guide for the Music: Content Knowledge Test
Study Guide for the Music: Content Knowledge Test A PUBLICATION OF ETS Acknowledgements Educational Testing Service and The Praxis Series wish to extend special thanks to the following for helping with
More informationWomen, Wages and Work A report prepared by the UNC Charlotte Urban Institute for the Women s Summit April 11, 2011
A report prepared by the UNC Charlotte Urban Institute for the Women s Summit April 11, 2011 A report prepared for the Women s Summit by the UNC Charlotte Urban Institute 1 Table of Contents Table of Contents...
More informationConducting Formative Research
Conducting Formative Research 1 The foundation of any sound sanitation marketing program is formative research. Formative research follows a process and includes a set of tools that can be used to help
More informationHOW TO EVALUATE TRAINING PROGRAMS
3 HOW TO EVALUATE TRAINING PROGRAMS Warren Bobrow Warren Bobrow, Ph.D., specializes in employee selection, manager assessment, program evaluation, and opinion surveys. He has worked in a diverse range
More informationUNDERSTANDING MILLENNIAL EATING BEHAVIOR MARCIA GREENBLUM MS, RD SENIOR DIRECTOR, HEALTH AND WELLNESS
UNDERSTANDING MILLENNIAL EATING BEHAVIOR MARCIA GREENBLUM MS, RD SENIOR DIRECTOR, HEALTH AND WELLNESS WHY ADDRESS EATING BEHAVIOR IN THE FIRST PLACE? Rise of obesity: The Millennial generation has poor
More informationYou and your friends head out to a favorite restaurant
19 Cost-Volume-Profit Analysis Learning Objectives 1 Identify how changes in volume affect costs 2 Use CVP analysis to compute breakeven points 3 Use CVP analysis for profit planning, and graph the CVP
More informationStudy Guide for the Elementary Education: Content Knowledge Test
Study Guide for the Elementary Education: Content Knowledge Test A PUBLICATION OF ETS Copyright 2011 by Educational Testing Service. All rights reserved. ETS, the ETS logo, GRE, and LISTENING. LEARNING.
More informationThe Margin of Error for Differences in Polls
The Margin of Error for Differences in Polls Charles H. Franklin University of Wisconsin, Madison October 27, 2002 (Revised, February 9, 2007) The margin of error for a poll is routinely reported. 1 But
More informationLiving well with dementia: A National Dementia Strategy. Accessible Summary. National Dementia Strategy. Putting People First
Living well with dementia: A National Dementia Strategy Accessible Summary National Dementia Strategy Putting People First National Dementia Strategy Accessible Summary This booklet is an accessible version
More informationMarket Research: 8 Sure-Fire Ways to Make Sure Your Business, Product or Service Idea is Successful from the Start!
Market Research: 8 Sure-Fire Ways to Make Sure Your Business, Product or Service Idea is Do you have a business, product, or service idea that you want to put to the test? Inside you ll learn how to: Figure
More informationCourse Description Course Textbook Course Learning Outcomes Credits Course Structure Unit Learning Outcomes: Unit Lesson: Reading Assignments:
BSL 4000, Managing Diversity in Organizations Course Syllabus Course Description Presentation of the personal and organizational implications of increasing workforce diversity. Exploration of the complex
More informationPlanning and conducting a dissertation research project
Student Learning Development Planning and conducting a dissertation research project This guide addresses the task of planning and conducting a small research project, such as an undergraduate or masters
More informationThe Beginner s Guide to. Investing in Precious Metals
The Beginner s Guide to Investing in Precious Metals Since the beginning of time, gold and silver have been recognized as valuable and a sign of wealth. Even today, precious metals hold a strong place
More informationBefore and After Studies in Injury Research
Before and After Studies in Injury Research Thomas Songer, PhD University of Pittsburgh tjs@pitt.edu Before and After study designs are used very frequently in injury research. This lecture introduces
More informationJHSPH HUMAN SUBJECTS RESEARCH ETHICS FIELD TRAINING GUIDE
JHSPH HUMAN SUBJECTS RESEARCH ETHICS FIELD TRAINING GUIDE This guide is intended to be used as a tool for training individuals who will be engaged in some aspect of a human subject research interaction
More informationPosi%ve Psychology Goes to School: Theory, Prac%ces, and Cri%cal Issues. Tyler L. Renshaw, Ph.D., NCSP Louisiana State University
Posi%ve Psychology Goes to School: Theory, Prac%ces, and Cri%cal Issues Tyler L. Renshaw, Ph.D., NCSP Louisiana State University grit HOPE subjective well-being GROWTH MINDSET gratitude flow Home About
More informationBiotech Foods Community Snapshot
Biotech Foods Community Snapshot Introduction Lesson Introduction Biotechnology is becoming a commonly used term in today s society. Recent surveys conducted on consumer attitudes toward biotech foods,
More informationSurvey Research. Classifying surveys on the basis of their scope and their focus gives four categories:
Survey Research Types of Surveys Surveys are classified according to their focus and scope (census and sample surveys) or according to the time frame for data collection (longitudinal and cross-sectional
More informationCOMP6053 lecture: Relationship between two variables: correlation, covariance and r-squared. jn2@ecs.soton.ac.uk
COMP6053 lecture: Relationship between two variables: correlation, covariance and r-squared jn2@ecs.soton.ac.uk Relationships between variables So far we have looked at ways of characterizing the distribution
More informationWhat qualities are employers looking for in teen workers? How can you prove your own skills?
Sell Yourself 4 Finding a job The BIG Idea What qualities are employers looking for in teen workers? How can you prove your own skills? AGENDA Approx. 45 minutes I. Warm Up: Employer Survey Review (15
More informationReflections on Probability vs Nonprobability Sampling
Official Statistics in Honour of Daniel Thorburn, pp. 29 35 Reflections on Probability vs Nonprobability Sampling Jan Wretman 1 A few fundamental things are briefly discussed. First: What is called probability
More informationMath: Study Skills, Note Taking Skills, And Test Taking Strategies
Math: Study Skills, Note Taking Skills, And Test Taking Strategies Math Study Skill Active Study vs. Passive Study Be actively involved in managing the learning process, the mathematics and your study
More informationThe Relationship between the Fundamental Attribution Bias, Relationship Quality, and Performance Appraisal
The Relationship between the Fundamental Attribution Bias, Relationship Quality, and Performance Appraisal Executive Summary Abstract The ability to make quality decisions that influence people to exemplary
More informationBMJcareers. Informing Choices
: The Need for Career Advice in Medical Training How should the support provided to doctors and medical students to help them make career decisions during their training be improved? Experience elsewhere
More informationRecall this chart that showed how most of our course would be organized:
Chapter 4 One-Way ANOVA Recall this chart that showed how most of our course would be organized: Explanatory Variable(s) Response Variable Methods Categorical Categorical Contingency Tables Categorical
More informationSpecial Reports. Finding Actionable Insights through AdWords Reporting
Special Reports Finding Actionable Insights through AdWords Reporting Introduction We re closer than we ve ever been to understanding which aspects of our marketing work. Impressions, clicks, conversions
More information