CES Ottawa 22 October 2012 John Mayne, Ph D

Size: px
Start display at page:

Download "CES Ottawa 22 October 2012 John Mayne, Ph D"

Transcription

1 Making Causal Claims CES Ottawa 22 October 2012 John Mayne, Ph D Advisor on Public Sector Performance Adjunct Professor, University of Victoria john.mayne@rogers.com

2 Outline A new perspective on causality for evaluation Demonstrating contributory causality Current issue in contribution analysis

3 The Context Interventions are aimed at bringing about outcomes Interventions are not acting on their own. There may be: other events and conditions at play other interventions at work other relevant contextual factors Many if not most interesting outcomes result from such a mix of actions and context

4 The Issue In this context, what can we say about the relationship between the intervention and observed results? The intervention caused the results? The intervention made a difference? The intervention contributed to the results? The intervention can be attributed to a specific net result? What makes sense?

5 Improving educa:on outcomes for girls Intervention operates through raising the knowledge, skills and awareness of teachers. Other relevant factors here might be: the willingness of teachers to support the education of girls the support of parents for their daughters to attend schools and study at home the ability of girls to get to the schools the adequacy of the schools to accommodate girls

6 Conceptualizing Causality What kind of causal relation exists then between an intervention (X) and an impact (Y)? Can we say X causes Y? No Is X necessary for Y? No Is X sufficient for Y? No But we clearly want to make some causal link between the intervention and the impact

7 Conceptualizing Causality As might be imagined, these conundrums have been well addressed in the vast literature on causality. There is an answer! An intervention works as part of a broader causal package. And if it works, then this causal package is indeed sufficient to bring about the impact. Further, if the intervention is working, then it is an essential part of this causal package.

8 INUS Causality This is the very useful concept of INUS causality and INUS conditions. An Insufficient but Necessary part of a condition that is itself Unnecessary but Sufficient for the occurrence of the effect (Mackie 1974). Mackie argued that much of the time, when we are talking about causality we are in fact talking about INUS causality.

9 Interven:on Causality Thus, an intervention made a difference when: The intervention causal package was sufficient to bring about the impact, and The intervention was a necessary component of the causal package The intervention in this case is a contributory cause. On its own it is neither necessary nor sufficient.

10 The Interven:on as Trigger So the intervention is one among several causes. But is that all? We probably expect more, that the intervention: acts as a trigger to start the causal chain (the spark that lights the fire) and may act as sustaining support for change along the way (gasoline to keep the fire going) A principal contributory cause

11 Meaningful Causal Ques:ons 1. Has the intervention made a difference? o Is the intervention a contributory cause? o What role has the intervention played? 2. Why has the outcome occurred? o How did the causal factors bring about the result? o What was the context and the mechanisms? o Were there unintended outcomes? 11

12 Making a difference Contributory cause The intervention was a necessary element of the causal package which was sufficient to produce an observed result This is a useful and operational definition of 'making a difference

13 Demonstra:ng Contributory Cause How then to show that the intervention made a difference? Connecting to theory-based approaches Sufficiency through generative (process) causality approaches One approach: contribution analysis

14 Theories of change A results chain with embedded assumptions, risks and other explanatory factors identified An explanation of what has to happen for the results chain to work Reduction in smoking Anti-smoking campaign Assumptions: target is reached, message is heard, message is convincing, no other major influences at work Risks: target not reached, poor message, peer pressure to smoke very strong Other Explanatory Factors: reduction due to trend pressure or price increases 14

15 A Generic Theory of Change End Results Theory of Change Unintended effects Behaviour changes Assumptions: How are behavioural changes in the target population expected to influence the desired end result? What has to happen? What factors influence these processes? Risks: Risks to the link not occurring. Other Explanatory Factors: Socioeconomic factors 15 External Influences Assumptions: How do external factors influence the realization of the intervention s ToC? Risks: Risks to the links in the ToC not occurring as expected. Other Explanatory Factors: Socio-economic factors; other interventions Unintended effects Changes in knowledge, attitudes skills, opportunities and incentives Unintended effects Reach & Reaction Unintended effects Activities and Outputs Assumptions: How are changes in knowledge, attitudes, skills, opportunities and/or incentives expected to change behaviour? What has to happen? What factors influence these processes? Risks: Risks to the link not occurring. Other Explanatory Factors: Peer or trend pressure; other interventions Assumptions: How does the intervention expect to enhance knowledge, attitudes skills, opportunities and/or incentives? What has to happen? What factors influence these processes? Risks: Risks to the link not occurring. Other Explanatory Factors: Other interventions; self-learning Assumptions: How and to what extent does the intervention output expect to reach people? What has to happen? What contextual factors influence these processes? Risks: Risks to the link not occurring.

16 Theories of Change and Causal Packages Theories of change are causal packages, models of causal sufficiency and more: ToC identify supporting factors (assumptions) and confounding factors (risks) ToC set out the relationship between the supporting factors and the intervention ToC is a model of the intervention as a contributing cause

17 Approaches to demonstra:ng causality Regularity frameworks that depend on the frequency of association between cause and effect - basis for statistical approaches Counterfactual frameworks that depend on the difference between two otherwise identical cases basis for experimental and quasi experimental approaches Comparative frameworks that depend on combinations of causes that lead to an effect - basis for configurational approaches, such as QCA Generative frameworks that depend on identifying the causal links and mechanisms that explain effects basis for theory based and realist approaches.

18 Genera:ve Causa:on Process or mechanistic causality Tracing the links in between causal events Everyday causality: auto mechanic, air crashes, forensic work, doctors The basis for theory-based evaluation approaches

19 Contribu:on analysis: the prac:ce 1. Set out the causal question 2. Critically develop the expected theory of change 3. Gather the existing evidence verifying (or not) the theory of change 4. Assess the resulting contribution story 5. Seek out additional evidence 6. Revise & strengthen the contribution story 19

20 Contribu:on Analysis CA shows that an intervention is a contributory cause: The expected results occurred The causal package is sufficient supporting factors (assumptions) occurred and any other supporting factors have been included in the ToC plausible rival explanations have been accounted for The intervention is necessary for the package to be sufficient

21 Issues in CA Telling the contribution story (in relation to the counterfactual approach) CGIAR s new gold standard for causality? What is rigorous CA? Needs attention Patton s rigorous thinking idea Using CA in planning & designing interventions

22 A strong causal claim The intervention causal package was sufficient to bring about a result and the intervention was a necessary part of the package. Further, the intervention was the trigger. The comprehensive intervention was sufficient to cause the collective results and the intervention actions were the trigger that made it all happen.

23 Rigor in CA Needs some work and attention Patton suggest that: Rigorous thinking supersedes rigorous methods Discusses criteria for rigorous thinking

24 Ex- ante use of ToC/CA Identifying supporting factors as conditions in need of addressing Assessing the likelihood the intervention will work Identifying what needs to be monitored As a basis for adaptive management, using evolving ToC

25 Main Messages We expect most interventions are principal contributory causes The intervention causal package is sufficient & the intervention is essential to the package Want to also know why the result occurred; to be able to explain ToC are models of the intervention as a contributory cause models of causal sufficiency Contribution analysis and other T-B approaches can be used to demonstrate causality

26 AMribu:on- Contribu:on Evaluations that do not address the causal issue in a systematic manner are generally weak Need to go beyond gathering opinions on causality There are lots of aspects of the causal issue that can be usefully and credibly explored, using a variety of tools.

27 Some References DFID (2012). Broadening the Range of Designs and Methods for Impact Evaluation, London. Available at Default.aspx Mayne, J. (ed) (2012). Contribution Analysis. Evaluation, Special Issue, 18(3). Mayne, J. (2012). Making Causal Claims. ILAC Brief 26. Available at Mayne, J. (2008). Contribution Analysis: An Approach to Exploring Cause and Effect, ILAC Brief 16. Available at ILAC_Brief16_Contribution_Analysis.pdf Funnell, S. and P. Rogers (2011). Purposeful Program Theory. Jossey-Bass. 27

OUTLINE OF PRINCIPLES OF IMPACT EVALUATION

OUTLINE OF PRINCIPLES OF IMPACT EVALUATION OUTLINE OF PRINCIPLES OF IMPACT EVALUATION PART I KEY CONCEPTS Definition Impact evaluation is an assessment of how the intervention being evaluated affects outcomes, whether these effects are intended

More information

WHY THEORY MATTERS FOR EFFECTIVE HEALTH PROMOTION:

WHY THEORY MATTERS FOR EFFECTIVE HEALTH PROMOTION: WHY THEORY MATTERS FOR EFFECTIVE HEALTH PROMOTION: A BRIEFING I could not do my job without talking about theory. (Health promotion practitioner) There is nothing so practical as a good theory (Kurt Lewin).

More information

Correlation between competency profile and course learning objectives for Full-time MBA

Correlation between competency profile and course learning objectives for Full-time MBA Correlation between competency and course for Full-time MBA Competency management in the Organizational Behavior and Leadership Managing Sustainable Corporations Accounting Marketing Economics Human Resource

More information

Evaluating Public Information and Advocacy Campaigns

Evaluating Public Information and Advocacy Campaigns Evaluating Public Information and Advocacy Campaigns Glenn O Neil Evaluation consultant - Owl RE, Switzerland Lecturer - International University in Geneva, Switzerland PhD candidate - Methodology Institute,

More information

FOREIGN AFFAIRS PROGRAM EVALUATION GLOSSARY CORE TERMS

FOREIGN AFFAIRS PROGRAM EVALUATION GLOSSARY CORE TERMS Activity: A specific action or process undertaken over a specific period of time by an organization to convert resources to products or services to achieve results. Related term: Project. Appraisal: An

More information

Intervention Logic and Theories of Change: What are they, how to build them, how to use them

Intervention Logic and Theories of Change: What are they, how to build them, how to use them Presented by Heléne Clark, Director, ActKnowledge Community of Practice on Results Based Management 2014 and beyond: how to ensure delivery of better and more results by the European Social Fund? EU conference

More information

Contribution Analysis: The promising new approach to causal claims. Sebastian Lemire. Ramboll Management Consulting, Denmark.

Contribution Analysis: The promising new approach to causal claims. Sebastian Lemire. Ramboll Management Consulting, Denmark. Contribution Analysis: The promising new approach to causal claims Sebastian Lemire Ramboll Management Consulting, Denmark Authors note Please direct correspondence at Sebastian Lemire, setl@r-m.com, telephone+45

More information

Evaluation Theory: Who Needs It? Jean A. King

Evaluation Theory: Who Needs It? Jean A. King Evaluation Theory: Who Needs It? Jean A. King An important question If evaluation is a field of practice, then what is an appropriate role for theory in evaluation? Theory? Practice?... there is nothing

More information

Executive summary. Today s researchers require skills beyond their core competencies

Executive summary. Today s researchers require skills beyond their core competencies EXECUTIVE SUMMARY 9 Executive summary Today s researchers require skills beyond their core competencies The formation and careers of researchers are important policy issues and training for transferable

More information

Logic Modeling: A Tool to Guide Program Design and Performance Measurement and Evaluation: Telling your Performance Story

Logic Modeling: A Tool to Guide Program Design and Performance Measurement and Evaluation: Telling your Performance Story Logic Modeling: A Tool to Guide Program Design and Performance Measurement and Evaluation: Telling your Performance Story John A. McLaughlin MACGROUPX@AOL.COM My Aim Today Change the way you think about

More information

EVALUATION REPORT TITLE: Independent evaluation of the Demand-Driven Impact Evaluations for Decisions (3DE) Pilot

EVALUATION REPORT TITLE: Independent evaluation of the Demand-Driven Impact Evaluations for Decisions (3DE) Pilot EVALUATION REPORT TITLE: Independent evaluation of the Demand-Driven Impact Evaluations for Decisions (3DE) Pilot RESPONSE TO EVALUATION REPORT (overarching narrative) Overall we are pleased with the findings

More information

Randomized Field Trials and Internal Validity: Not So Fast My Friend

Randomized Field Trials and Internal Validity: Not So Fast My Friend A peer-reviewed electronic journal. Copyright is retained by the first or sole author, who grants right of first publication to the Practical Assessment, Research & Evaluation. Permission is granted to

More information

FACULTY UNDERGRADUATE PORTFOLIO GUIDELINES AND FAQ

FACULTY UNDERGRADUATE PORTFOLIO GUIDELINES AND FAQ FACULTY UNDERGRADUATE PORTFOLIO GUIDELINES AND FAQ INTRODUCTION The construction of an academic portfolio is not simply an account of prior learning. Rather it is, in and of itself, a learning process.

More information

Queensland Treasury. Queensland Government. Program Evaluation Guidelines

Queensland Treasury. Queensland Government. Program Evaluation Guidelines Queensland Treasury Queensland Government Program Evaluation Guidelines November 2014 Document details Security Classification Date of Review of Security Classification Authority Author PUBLIC November

More information

Research Design and Research Methods

Research Design and Research Methods CHAPTER 3 Research Design and Research Methods Overview This chapter uses an emphasis on research design to discuss qualitative, quantitative, and mixed methods research as three major approaches to research

More information

accel team jobs depend on it

accel team jobs depend on it Advancing employee productivity accel team jobs depend on it Supervisory guides to performance improvement PLANNING EMPLOYEE TRAINING AND DEVELOPMENT Developing a process that will meet the goals of the

More information

Designing a School Improvement Plan (Using a framework for effective school improvement)

Designing a School Improvement Plan (Using a framework for effective school improvement) Designing a School Improvement Plan (Using a framework for effective school improvement) May 21, 2015 Robert Marshall: Senior Project Director, School Improvement robert.marshall@acer.edu.au Australian

More information

Policy for Monitoring and Evaluation of Compacts and Threshold Programs

Policy for Monitoring and Evaluation of Compacts and Threshold Programs Policy for Monitoring and Evaluation of Compacts and Threshold Programs May 1, 2012 Version: Final Submitted by: Department of Policy and Evaluation Millennium Challenge Corporation 875 15th Street N.W.

More information

Comparison of Research Designs Template

Comparison of Research Designs Template Comparison of Comparison of The following seven tables provide an annotated template to guide you through the comparison of research designs assignment in this course. These tables help you organize your

More information

Meta-analysis of Reviews and Evaluation of Ecoregional Programs

Meta-analysis of Reviews and Evaluation of Ecoregional Programs Meta-analysis of Reviews and Evaluation of Ecoregional Programs Julio A. Berdegué and Germán Escobar 1. Aim, method and organization of the analysis The aim of this report is to summarize the main lessons

More information

A Guide. to Assessment of Learning Outcomes. for ACEJMC Accreditation

A Guide. to Assessment of Learning Outcomes. for ACEJMC Accreditation A Guide to Assessment of Learning Outcomes for ACEJMC Accreditation Accrediting Council on Education in Journalism and Mass Communications, 2012 This guide explains ACEJMC s expectations of an assessment

More information

GLOSSARY OF EVALUATION TERMS

GLOSSARY OF EVALUATION TERMS Planning and Performance Management Unit Office of the Director of U.S. Foreign Assistance Final Version: March 25, 2009 INTRODUCTION This Glossary of Evaluation and Related Terms was jointly prepared

More information

Program theory and logic models for systemic evaluation

Program theory and logic models for systemic evaluation Program theory and logic models for systemic evaluation International Conference on Systemic Approaches in Evaluation Deutsche Gesellschaft für Internationale Zusammenarbeit (GIZ) Eschborn, Germany 25-26

More information

6 Essential Characteristics of a PLC (adapted from Learning by Doing)

6 Essential Characteristics of a PLC (adapted from Learning by Doing) 6 Essential Characteristics of a PLC (adapted from Learning by Doing) 1. Shared mission, vision, values, goals Educators in a PLC benefit from clarity regarding their shared purpose, a common understanding

More information

An introduction to impact measurement

An introduction to impact measurement An introduction to impact measurement Contents 1 Introduction 2 Some definitions 3 Impact measurement at BIG 4 Setting impact measures for programmes APPENDICES A External Resources (separate document)

More information

IMPLEMENTATION NOTE. Validating Risk Rating Systems at IRB Institutions

IMPLEMENTATION NOTE. Validating Risk Rating Systems at IRB Institutions IMPLEMENTATION NOTE Subject: Category: Capital No: A-1 Date: January 2006 I. Introduction The term rating system comprises all of the methods, processes, controls, data collection and IT systems that support

More information

Developing an implementation research proposal. Session 2: Research design

Developing an implementation research proposal. Session 2: Research design Developing an implementation research proposal Session 2: Research design Learning objectives After completing this session, you will be able to: Develop a research design outlining your data collection

More information

Case Formulation in Cognitive-Behavioral Therapy. What is Case Formulation? Rationale 12/2/2009

Case Formulation in Cognitive-Behavioral Therapy. What is Case Formulation? Rationale 12/2/2009 Case Formulation in Cognitive-Behavioral Therapy What is Case Formulation? A set of hypotheses regarding what variables serve as causes, triggers, or maintaining factors for a person s problems Description

More information

Guideline. Operational Risk Management. Category: Sound Business and Financial Practices. No: E-21 Date: June 2016

Guideline. Operational Risk Management. Category: Sound Business and Financial Practices. No: E-21 Date: June 2016 Guideline Subject: Category: Sound Business and Financial Practices No: E-21 Date: June 2016 1. Purpose and Scope of the Guideline This Guideline sets out OSFI s expectations for the management of operational

More information

EVALUATION OF IMPORTANCE FOR RESEARCH IN EDUCATION

EVALUATION OF IMPORTANCE FOR RESEARCH IN EDUCATION 1 EVALUATION OF IMPORTANCE FOR RESEARCH IN EDUCATION ABSTRACT PRAMODINI D V*; K. ANU SOPHIA** *Assistant Professor, Department of Information Science and Engineering, PESSE, Bangalore - 100. **Assistant

More information

Health Promotion, Prevention, Medical care, Rehabilitation under the CBR Matrix heading of "Health

Health Promotion, Prevention, Medical care, Rehabilitation under the CBR Matrix heading of Health Health Promotion, Prevention, Medical care, Rehabilitation under the CBR Matrix heading of "Health Dr Deepthi N Shanbhag Assistant Professor Department of Community Health St. John s Medical College Bangalore

More information

Section 2: Ten Tools for Applying Sociology

Section 2: Ten Tools for Applying Sociology Section 2: Ten Tools for Applying Sociology CHAPTER 2.3: APPLYING THEORIES QUICK START: In this chapter, you will learn Why theory is an important, practical tool. The theories of functionalism, conflict

More information

MONITORING AND EVALUATION WORKSHEETS SUPPLEMENTAL INFORMATION

MONITORING AND EVALUATION WORKSHEETS SUPPLEMENTAL INFORMATION MONITORING AND EVALUATION WORKSHEETS SUPPLEMENTAL INFORMATION I. Introduction to Results Based Monitoring HED will use its results-based monitoring and evaluation system to effectively manage partnership

More information

Addressing Attribution Through Contribution Analysis: Using Performance Measures Sensibly

Addressing Attribution Through Contribution Analysis: Using Performance Measures Sensibly DISCUSSION PAPER Addressing Attribution Through Contribution Analysis: Using Performance Measures Sensibly John Mayne Office of the Auditor General of Canada June 1999 Contents Page Introduction. 1 Accountability

More information

METHODOLOGICAL APPROACHES TO EVALUATE SUPPORT TO CAPACITY DEVELOPMENT. Synthesis Report. April 2014 Stein-Erik Kruse Kim Forss

METHODOLOGICAL APPROACHES TO EVALUATE SUPPORT TO CAPACITY DEVELOPMENT. Synthesis Report. April 2014 Stein-Erik Kruse Kim Forss METHODOLOGICAL APPROACHES TO EVALUATE SUPPORT TO CAPACITY DEVELOPMENT Synthesis Report April 2014 Stein-Erik Kruse Kim Forss Table of content 1. INTRODUCTION... 1 1.1. Background... 1 1.2. Purpose and

More information

LEVEL 1 LICENSURE PORTFOLIO

LEVEL 1 LICENSURE PORTFOLIO LEVEL 1 LICENSURE PORTFOLIO Part I Purpose Principles to Be Addressed Required Documentation Directions Entry 1: Analyzing the School Counseling Environment Candidates analyze the school counseling environment

More information

Evaluation: Designs and Approaches

Evaluation: Designs and Approaches Evaluation: Designs and Approaches Publication Year: 2004 The choice of a design for an outcome evaluation is often influenced by the need to compromise between cost and certainty. Generally, the more

More information

QUALITATIVE RESEARCH

QUALITATIVE RESEARCH QUALITATIVE RESEARCH Qualitative is a diverse field. Not a unified set of methods/philosophy like surveys and experiments. Grew out of many disciplines: sociology, anthropology, education, linguistics,

More information

SESS BEHAVIOUR RESOURCE BANK

SESS BEHAVIOUR RESOURCE BANK SESS BEHAVIOUR RESOURCE BANK Advice Sheet 30 RECORDING AND ANALYSING DISRUPTIVE BEHAVIOUR If a pupil is being particularly disruptive in class, it s important to record the incidents and the pattern of

More information

The Action Learning Toolkit

The Action Learning Toolkit 1. Introduction This document has been produced to act as a background resource both for those participating in action learning and for the facilitators of the action learning process. Read in conjunction

More information

INDEPENDENT VERIFICATION AND VALIDATION OF EMBEDDED SOFTWARE

INDEPENDENT VERIFICATION AND VALIDATION OF EMBEDDED SOFTWARE PREFERRED RELIABILITY PRACTICES PRACTICE NO. PD-ED-1228 PAGE 1 OF 6 INDEPENDENT VERIFICATION AND VALIDATION OF EMBEDDED SOFTWARE Practice: To produce high quality, reliable software, use Independent Verification

More information

PROJECT MANAGEMENT TRAINING MODULES

PROJECT MANAGEMENT TRAINING MODULES PROJECT MANAGEMENT TRAINING MODULES KENYA PROJECTS ORGANIZATION < Projects Solutions Provider > Macjo Arcade, 4 th Flr., Suite 15E P.O Box, 3029 00200, Nairobi - Kenya Tel: 254 (0)202319748 Mob: 0725 788

More information

Monitoring and Evaluation of. Interventions

Monitoring and Evaluation of. Interventions Monitoring and Evaluation of Sports in Development (SiD) Interventions presented by: Pamela K. Mbabazi, Ph.D. Faculty of Development Studies, Department of Development Studies Mbarara University of Science

More information

Module 2: Introduction to M&E frameworks and Describing the program

Module 2: Introduction to M&E frameworks and Describing the program Module 2: Introduction to M&E frameworks and Describing the program Learning Objectives Understand the 4 basic steps required to develop M & E plans Learn to develop goals and objectives Learn to develop

More information

INTERAGENCY GUIDANCE ON THE ADVANCED MEASUREMENT APPROACHES FOR OPERATIONAL RISK. Date: June 3, 2011

INTERAGENCY GUIDANCE ON THE ADVANCED MEASUREMENT APPROACHES FOR OPERATIONAL RISK. Date: June 3, 2011 Board of Governors of the Federal Reserve System Federal Deposit Insurance Corporation Office of the Comptroller of the Currency Office of Thrift Supervision INTERAGENCY GUIDANCE ON THE ADVANCED MEASUREMENT

More information

Glossary Monitoring and Evaluation Terms

Glossary Monitoring and Evaluation Terms Glossary Monitoring and Evaluation Terms This glossary includes terms typically used in the area of monitoring and evaluation (M&E) and provides the basis for facilitating a common understanding of M&E.

More information

Attribute 1: COMMUNICATION

Attribute 1: COMMUNICATION The positive are intended for use as a guide only and are not exhaustive. Not ALL will be applicable to ALL roles within a grade and in some cases may be appropriate to a Attribute 1: COMMUNICATION Level

More information

Research Critique of Caught in the middle: Experiences of tobacco-dependent nurse practitioners

Research Critique of Caught in the middle: Experiences of tobacco-dependent nurse practitioners Unit 4 Research Critique 1 Research Critique of Caught in the middle: Experiences of tobacco-dependent nurse practitioners Jackie Van Etten Nursing Research Professor Meedzan and Professor Fichera May

More information

Class on Hedley Bull. 1. Some general points about Bull s view

Class on Hedley Bull. 1. Some general points about Bull s view Class on Hedley Bull 1. Some general points about Bull s view A central claim in Bull s argument is that anarchy understood as interaction between and among agents, whether individuals or states, in the

More information

Biological kinds and the causal theory of reference

Biological kinds and the causal theory of reference Biological kinds and the causal theory of reference Ingo Brigandt Department of History and Philosophy of Science 1017 Cathedral of Learning University of Pittsburgh Pittsburgh, PA 15260 E-mail: inb1@pitt.edu

More information

Instructional Technology Capstone Project Standards and Guidelines

Instructional Technology Capstone Project Standards and Guidelines Instructional Technology Capstone Project Standards and Guidelines The Committee recognizes the fact that each EdD program is likely to articulate some requirements that are unique. What follows are a

More information

Components of a Reading Workshop Mini-Lesson

Components of a Reading Workshop Mini-Lesson Components of a Reading Workshop Mini-Lesson Mini-Lesson: The Connection How will you begin the Reading Workshop mini-lesson with a connection in which you tell students what you ll be teaching them &

More information

Reaching Out in College: Mental Health Information and Support for Third-Level Students

Reaching Out in College: Mental Health Information and Support for Third-Level Students Reaching Out in College: Mental Health Information and Support for Third-Level Students Gillian Karwig, Research Officer, ReachOut Ireland Katie Hendrick, Reg Psychol PsSI, IAUCC Executive Member & IADT

More information

STUDENT THESIS PROPOSAL GUIDELINES

STUDENT THESIS PROPOSAL GUIDELINES STUDENT THESIS PROPOSAL GUIDELINES Thesis Proposal Students must work closely with their advisor to develop the proposal. Proposal Form The research proposal is expected to be completed during the normal

More information

Chapter 2 - IEP Preparation

Chapter 2 - IEP Preparation Chapter 2 - IEP Preparation Preparation before the IEP Meeting Several steps must be taken before a student can be considered for receiving special education and, if appropriate, related services (e.g.

More information

Organisational Performance Measurement and Reporting Guide

Organisational Performance Measurement and Reporting Guide Organisational Performance Measurement and Reporting Guide Australian Capital Territory, Canberra, April 2013 This work is copyright. Apart from any use permitted under the Copyright Act 1968, no part

More information

COLLEGE READINESS AND STUDENT WITH DISABILITIES. Gina McGranahan, M Ed Assistant Director Disability Services YSU Center for Student Progress

COLLEGE READINESS AND STUDENT WITH DISABILITIES. Gina McGranahan, M Ed Assistant Director Disability Services YSU Center for Student Progress COLLEGE READINESS AND STUDENT WITH DISABILITIES Gina McGranahan, M Ed Assistant Director Disability Services YSU Center for Student Progress How do you know if a student with a disability is ready for

More information

USAID PROGRAM CYCLE OVERVIEW

USAID PROGRAM CYCLE OVERVIEW USAID PROGRAM CYCLE OVERVIEW USAID AUGUST 2012 CONTENTS Background... 3 Overview Summary... 3 Program Cycle Components:... 3 Agency Policies and Strategies:... 4 Country Development Cooperation Strategies:...

More information

Quantitative Research: Reliability and Validity

Quantitative Research: Reliability and Validity Quantitative Research: Reliability and Validity Reliability Definition: Reliability is the consistency of your measurement, or the degree to which an instrument measures the same way each time it is used

More information

International Trade and Corporate Social Responsibility

International Trade and Corporate Social Responsibility International Trade and Corporate Social Responsibility Professor Kevin Kolben Rutgers Business School, Newark and New Brunswick, New Jersey, USA Testimony Before the Committee on International Trade European

More information

Guide for the Development of Results-based Management and Accountability Frameworks

Guide for the Development of Results-based Management and Accountability Frameworks Guide for the Development of Results-based Management and Accountability Frameworks August, 2001 Treasury Board Secretariat TABLE OF CONTENTS Section 1. Introduction to the Results-based Management and

More information

Checklist for Reviewing Scopes of Work for Performance Evaluations

Checklist for Reviewing Scopes of Work for Performance Evaluations Checklist for Reviewing Scopes of Work for Performance Evaluations Use the Evaluation Scope of Work (SOW) Checklist to review and strengthen SOW during the evaluation planning stage. In most cases you

More information

12/30/2012. Research Design. Quantitative Research: Types (Campbell & Stanley, 1963; Crowl, 1993)

12/30/2012. Research Design. Quantitative Research: Types (Campbell & Stanley, 1963; Crowl, 1993) Quantitative Prepared by: Amanda J. Rockinson-Szapkiw Liberty University A research design is a plan that guides the decision as to: when and how often to collect data what data to gather and from whom

More information

3. From Student Learning Assessment: Options and Resources, (Philadelphia, PA: Middle States Commission on Higher Education, 2003: p.

3. From Student Learning Assessment: Options and Resources, (Philadelphia, PA: Middle States Commission on Higher Education, 2003: p. Assessment 1. Definition of assessment of student learning from Assessment Clear and Simple: A Practical Guide for Institutions, Departments and General Education by Barbara E. Walvoord (John Wiley & Sons,

More information

Fairfield Public Schools

Fairfield Public Schools Mathematics Fairfield Public Schools AP Statistics AP Statistics BOE Approved 04/08/2014 1 AP STATISTICS Critical Areas of Focus AP Statistics is a rigorous course that offers advanced students an opportunity

More information

Exploring Strategic Change

Exploring Strategic Change Julia Balogun, Veronica Hope Hailey, Gerry Johnson, Kevan Scholes FT Prentice Hall 2003 ISBN: 0273683276, 280 pages Theme of the Book The book links into (and develops further) the ideas on strategic change

More information

The percentage of people with food allergy in the community

The percentage of people with food allergy in the community The percentage of people with food allergy in the community By Pia Nørhede Why is it important to know the percentage of people with food allergy in the community? Individuals with food allergy develop

More information

Investment Project Financing Economic Analysis Guidance Note

Investment Project Financing Economic Analysis Guidance Note 2013 Investment Project Financing Economic Analysis Guidance Note OPSPQ This guidance notes are intended for internal use by Bank staff. The notes will be updated and complemented from time to time. April

More information

Evaluation Plan Workbook Page 0 of 23

Evaluation Plan Workbook Page 0 of 23 Page 0 of 23 Page 1 of 23 Table of Contents Evaluation Plan Workbook Introduction How to Use this Workbook...2 What is Evaluation?...3 Proving vs. Improving: A Brief History of Evaluation...3 Our Approach...3

More information

Capital Adequacy: Advanced Measurement Approaches to Operational Risk

Capital Adequacy: Advanced Measurement Approaches to Operational Risk Prudential Standard APS 115 Capital Adequacy: Advanced Measurement Approaches to Operational Risk Objective and key requirements of this Prudential Standard This Prudential Standard sets out the requirements

More information

Methodology in Social Psychology. Logics of inquiry

Methodology in Social Psychology. Logics of inquiry Methodology in Social Psychology Logics of inquiry How to carry out scientific research given our understanding of the nature of knowledge. Philosophy of Science clarifies why experimental, scientific

More information

Clinical Decision Making

Clinical Decision Making Clinical Decision Making Welcome to this short overview of Clinical Decision Making for Nurses, Midwives and Allied Healthcare Professionals. We've split this overview into a number of elements that will

More information

Business @ the Speed of Thought

Business @ the Speed of Thought Bill Gates About the author Bill Gates wrote his first software program when he was thirteen years old. Two points about the experience seem clear. First, the ability to control something huge at a time

More information

To reduce drink driving re-offending. Target group: Recidivist drink drivers

To reduce drink driving re-offending. Target group: Recidivist drink drivers To reduce drink driving re-offending Target group: Recidivist drink drivers Provide a community based combined education and therapy group. That encourages clients to engage in meaningful discussion that

More information

The Impact of Digital Technology on Learning: A Summary for the Education Endowment Foundation

The Impact of Digital Technology on Learning: A Summary for the Education Endowment Foundation The Impact of Digital Technology on Learning: A Summary for the Education Endowment Foundation Executive Summary Professor Steven Higgins, ZhiMin Xiao and Maria Katsipataki School of Education, Durham

More information

MKG350: Promotions, Advertising and Public Relations

MKG350: Promotions, Advertising and Public Relations MKG350: Promotions, Advertising and Public Relations Credit Hours: 3 Contact Hours: This is a 3-credit course, offered in accelerated format. This means that 16 weeks of material is covered in 8 weeks.

More information

Putting Critical Thinking Into Practice

Putting Critical Thinking Into Practice Putting Critical Thinking Into Practice Stephen Brookfield www.stephenbrookfield.com John Ireland Endowed Chair University of St. Thomas, Minneapolis St. Paul CT = Hunting Assumptions Assumptions constantly

More information

OVERVIEW OF RESEARCH METHODS

OVERVIEW OF RESEARCH METHODS OVERVIEW OF RESEARCH METHODS Research Methods= the ways we collect data to answer a research question data collection techniques including how we get respondents, how we ask questions, role of researcher

More information

Towards Reflective Teaching

Towards Reflective Teaching The Teacher Trainer Back Articles Saved from: http://www.tttjournal.co.uk Towards Reflective Teaching by Jack C. Richards Department of English, City Polytechnic of Hong Kong Most teachers develop their

More information

Problem of the Month: Fair Games

Problem of the Month: Fair Games Problem of the Month: The Problems of the Month (POM) are used in a variety of ways to promote problem solving and to foster the first standard of mathematical practice from the Common Core State Standards:

More information

2 Business, Performance, and Gap Analysis

2 Business, Performance, and Gap Analysis 2 Business, Performance, and Gap Analysis The performance consulting process generally includes identifying business needs, performance needs, and work environment and capability needs. All strategic performance

More information

University of Paderborn Software Engineering Group II-25. Dr. Holger Giese. University of Paderborn Software Engineering Group. External facilities

University of Paderborn Software Engineering Group II-25. Dr. Holger Giese. University of Paderborn Software Engineering Group. External facilities II.2 Life Cycle and Safety Safety Life Cycle: The necessary activities involving safety-related systems, occurring during a period of time that starts at the concept phase of a project and finishes when

More information

Module 1: Using Quantitative Data in Research: Concepts and Definitions

Module 1: Using Quantitative Data in Research: Concepts and Definitions Module 1: Using Quantitative Data in Research: Concepts and Definitions Antony Fielding 1 University of Birmingham & Centre for Multilevel Modelling Contents Rebecca Pillinger Centre for Multilevel Modelling

More information

Home Economics Education

Home Economics Education Subject Area Syllabus and Guidelines Home Economics Education (Part 2 of 4) Level 4 to Beyond Level 6 Note: The PDF version of this document has been split into sections for easier download. This file

More information

Standards and progression point examples

Standards and progression point examples Personal Learning In Personal Learning, standards for assessing and reporting on student achievement are introduced at Level 3. The learning focus statements for Levels Foundation, 1 and 2 provide advice

More information

How To Understand The Importance Of Internal Control

How To Understand The Importance Of Internal Control FINANCIAL REPORTING COUNCIL INTERNAL CONTROL REVISED GUIDANCE FOR DIRECTORS ON THE COMBINED CODE OCTOBER 2005 FINANCIAL REPORTING COUNCIL INTERNAL CONTROL REVISED GUIDANCE FOR DIRECTORS ON THE COMBINED

More information

Assessment of learning outcomes

Assessment of learning outcomes TOOL 7 Assessment of learning outcomes Life skills education is difficult to assess Assessing the impact of life skills education is difficult, to say the least. Very often, even when education programmes

More information

AS9100 B to C Revision

AS9100 B to C Revision AS9100 B to C Revision Key: Additions Deletions Clarifications 1.2 Application AS9100C Key Additions This standard is intended for use by organizations that design, develop and/or produce aviation, space

More information

SESS BEHAVIOUR RESOURCE BANK

SESS BEHAVIOUR RESOURCE BANK SESS BEHAVIOUR RESOURCE BANK Advice Sheet 22 INDIVIDUAL BEHAVIOUR SUPPORT PLAN A small minority of pupils may not be willing or able to comply with school / class rules to the same extent as other pupils.

More information

Consumer Behavior, MKT 3230 (A03): Winter 2014 Department of Marketing University of Manitoba

Consumer Behavior, MKT 3230 (A03): Winter 2014 Department of Marketing University of Manitoba Consumer Behavior, MKT 3230 (A03): Winter 2014 Department of Marketing University of Manitoba Instructor: Olya Bullard Office: 371 C, Drake Centre Telephone: (204) 474-7036 Email: umbryksi@cc.umanitoba.ca

More information

North Carolina TEACHER. evaluation process. Public Schools of North Carolina State Board of Education Department of Public Instruction

North Carolina TEACHER. evaluation process. Public Schools of North Carolina State Board of Education Department of Public Instruction North Carolina TEACHER evaluation process Public Schools of North Carolina State Board of Education Department of Public Instruction Rubric for Evaluating North Carolina Teachers ( This form should be

More information

Georgia Performance Standards. Health Education

Georgia Performance Standards. Health Education FIRST GRADE Students in first grade learn about their body s systems and various health topics. They begin to understand how their decisions can impact their health and well-being now and in the future.

More information

A brief critique of Hart, B. & Risley, T. (1995). Meaningful differences in the everyday experience of young American children.

A brief critique of Hart, B. & Risley, T. (1995). Meaningful differences in the everyday experience of young American children. A brief critique of Hart, B. & Risley, T. (1995). Meaningful differences in the everyday experience of young American children. Baltimore: Paul H. Brookes Publishing. I.S.P. Nation LALS, Victoria University

More information

Interview studies. 1 Introduction... 1. 2 Applications of interview study designs... 2. 3 Outline of the design... 3

Interview studies. 1 Introduction... 1. 2 Applications of interview study designs... 2. 3 Outline of the design... 3 Interview studies Contents 1 Introduction... 1 2 Applications of interview study designs... 2 3 Outline of the design... 3 4 Strengths and weaknesses of interview study designs... 6 5 References... 7 1

More information

RIGHTS RESPECTING SCHOOLS STUDENT COUNCILS IN ELEMENTARY SCHOOLS

RIGHTS RESPECTING SCHOOLS STUDENT COUNCILS IN ELEMENTARY SCHOOLS RIGHTS RESPECTING SCHOOLS STUDENT COUNCILS IN ELEMENTARY SCHOOLS CONTENTS INTRODUCTION...3 Student Councils and Building Block Two: Student Participation...3 Consideration of Children s Age...3 SETTING

More information

SHOULD DRUG COMPANIES BE ALLOWED TO ADVERTISE PRESCRIPTION DRUGS ON TV?

SHOULD DRUG COMPANIES BE ALLOWED TO ADVERTISE PRESCRIPTION DRUGS ON TV? Focus Words disclaimer prescribe potential assume rely!! Join the national conversation! SHOULD DRUG COMPANIES BE ALLOWED TO ADVERTISE Word Generation - Unit 2.18 PRESCRIPTION DRUGS ON TV? Weekly Passage

More information

On screen. Global Peace visionofhumanity.org or. Humanity/Global Peace

On screen. Global Peace visionofhumanity.org or. Humanity/Global Peace WHAT ARE WAR AND CONFLICT? WHAT ARE WAR AND CONFLICT? Think about what conflict, peace and war mean and what an absence of peace means OBJECTIVES 2 Examine the notion that conflict inside and between countries

More information

Games and Activities that Build Academic Vocabulary

Games and Activities that Build Academic Vocabulary Games and Activities that Build Academic Vocabulary 21 st CCLC Summer Institute July 10-12, 2006 San Diego, CA Danette Parsley, McREL dparsley@mcrel.org 303.632.5560 Heather Martindill, McREL hmartindill@mcrel.org

More information

Stories and the teaching of ethics in healthcare - conceptual and experiential approach Professor LC Chan and Dr Ada Lee, Medical Ethics and

Stories and the teaching of ethics in healthcare - conceptual and experiential approach Professor LC Chan and Dr Ada Lee, Medical Ethics and Stories and the teaching of ethics in healthcare - conceptual and experiential approach Professor LC Chan and Dr Ada Lee, Medical Ethics and Humanities Unit, the LKS Faculty of Medicine Outline of seminar

More information

Safety Analysis for Nuclear Power Plants

Safety Analysis for Nuclear Power Plants Regulatory Document Safety Analysis for Nuclear Power Plants February 2008 CNSC REGULATORY DOCUMENTS The Canadian Nuclear Safety Commission (CNSC) develops regulatory documents under the authority of paragraphs

More information