Designing an impact evaluation for a mobile phone application for nutrition service delivery in Indonesia

Size: px
Start display at page:

Download "Designing an impact evaluation for a mobile phone application for nutrition service delivery in Indonesia"

Transcription

1 Designing an impact evaluation for a mobile phone application for nutrition service delivery in Indonesia Inka Barnett, PhD Barbara Befani, PhD Dr Sigit Sulistyo 15 th October CDI Development Seminar, UEA

2 Overview Review of evidence on mobile phones for nutrition and aims of the evaluation Overview of child nutrition in Indonesia Brief introduction to the mobile phone application Objectives and challenges for the evaluation design Evaluation design for two different components of the nutrition service delivery

3 Mobile phone for nutrition Mobile phones may offer new opportunities to tackle under-& overnutrition Support nutrition service delivery including child growth monitoring & nutrition counselling Large number of descriptive studies & small-scale pilot studies, no integration in national nutrition strategies and low sustainability NO impact evaluation studies!

4 Partnership between WV and IDS Aims to address this evidence gap on the impact of mobile phone technology for nutrition by evaluating the use of a mobile phone application for monthly child growth monitoring and homebased nutrition counselling.

5 Why Indonesia (I)? Child undernutrition remains high in Indonesia, despite steady decline since million children are stunted (too short-for-their-age) and 2.8 million are wasted (too thin-for-their-height), which is globally ranked on place 5 and 4. UNICEF 2013

6 Why Indonesia (II)? In parallel child overweight and obesity increase steadily with 3 million children being overweight UNICEF 2013

7 The Mobile Phone application Developed by WV together with M&B Gates Foundation, Grameen Foundation & Dimagi Smart phones with an Android platform Growth monitoring (registration, collection of anthropometric data, calculation of z-scores, nutritional status and growth velocities, transfer data to database, aggregates data) Nutrition counselling (aids assessment & analysis of underlying reasons for child undernutrition, provides tailored messages)

8 Objectives of the evaluation 1. Examine the impact of the mobile phone application on growth monitoring: Assess the impact on data accuracy and timeliness of data submission (Explore the impact on real-time responsiveness to nutrition data during the monthly sessions Explore the effect on responsiveness by the government & stakeholders) 2. Assess the impact of the mobile phone application on the quality of home-based nutrition counselling

9 Context of the evaluation 14 study sites in Indonesia (10 rural and 4 urban) Facility-based pilot (each facility (posyandu) receives 1 mobile phone to be used for monthly growth monitoring & nutrition counselling) In all sites paper-based and mobile phone-based nutrition service delivery 12 months pilot

10 Development of the evaluation design February 2014 initial scoping visits to urban and rural sites in Indonesia to get to know: The context Challenges in growth monitoring and nutrition counselling that the mobile application would address (important to identify indicators and outcomes) Current procedures in 14 monthly health posts (posyandu) in which the mobile application will be tested

11 Challenges to the choice of evaluation design 1. Sites selection: Study sites had been selected already by WV (14 posyandus = no random selection possible, not representative) 2. Growth monitoring: It was impossible to replace the current paperbased growth monitoring with mobile phone-based monitoring due to government regulations (= mobile phone application has to be introduced in parallel to the paper-based data collection) 3. Nutrition counselling: Only mothers with undernourished children received counselling (2-6 per months, often repeated) Impossible to use common causal inference model for the impact evaluation (RCT, experimental designs) Need to choose alternative designs!

12 Other challenges Data collection by WV staff (huge risk of bias) High turn over of cadres (nutrition volunteers) New ethical approval procedures in Indonesia

13 Evaluation design Formative evaluation phase (first 2-3 months, ongoing) : - Technology acceptability assessment - Context assessment - Functionality of the mobile application Summative phase (10-12 months, November): 1. Growth monitoring component Accuracy and timelines of submission: Mill s Method of Difference (Responsiveness during posyandu (i.e. immediate feedback): Mill s Method of Difference & realist approach Responsiveness to the data by stakeholders: political economy analysis & stakeholder interviews) 2. Nutrition counselling component Improvement of quality of nutrition counselling: Process tracing

14 Theory of change

15 Evaluation of the mobile phone for growth monitoring

16 Procedures for growth monitoring

17 Threats to data accuracy Doubts about the accuracy of the growth monitoring data is a major reason for why data is not used by local, regional & national policymakers Three areas of threats to data accuracy: Data entry (repeated manual transfer) (desk 2, 3, 4) Plotting and interpretation (desk 3) Aggregation for summary reports (desk 3, 4, 5) Evaluation question: How much does the mobile phone application improve data accuracy of growth monitoring during (1) data entry, (2) data plotting and (3) data aggregation for reports?

18 Plotting and interpretation

19 Summary report

20 Threats to timeliness Data submission using traditional paper-based records is often time-consuming & data is frequently out-ofdate & not useful any longer Mobile phone can submit individual level data in and summary reports in real-time Evaluation question: How much does the mobile phone improve timeliness of data submission compared to the traditional paperbased system?

21 Challenges for the assessment of accuracy & timeliness No comparison of growth monitoring with and without mobile phone possible due to government regulations! Both types of data collection have to be conducted in parallel

22 Mill s Method of Difference

23 In practices that means (I) The mobile phone application and the traditional paper-based data collection are conducted simultaneously for the same child The resulting records are then compared with regards to data accuracy and timeliness

24 With the mobile phone

25 Evaluation of the mobile phone for nutrition counselling

26 Procedure for nutrition counselling Home-based nutrition counselling is conducted by cadres only for children that are identified as undernourished (approximately 2 to 6 per posyandu) Counselling follows UNICEF instructions for homebased counselling (with some adaptations for Indonesian MOH) 3-step approach: 1. Assess (behavioral patterns and hh-specific barriers to child nutrition) 2. Analyze information given by mother 3. Act (provide tailored specific messages)

27 Mobile phones for nutrition counselling Mobile phone application can potentially strengthen each step: 1. Ensuring a comprehensive initial assessment (via a brief interactive survey and prompts) 2. Analysis information provided in assessment 3. Act: Provision of specific information Evaluation questions: How does the mobile phone improve the quality of nutrition counselling with regards to: 1. Initial assessment 2. Analysis of information provided 3. Provision of information

28 Challenges for the evaluation of mobile phones for nutrition counselling Small group of children/mother pairs who receive counselling in each posyandu/month (i.e. randomisation, comparison meaningless as very small sample size, no matching possible) Counselling is very specific and focuses on household-level barriers to child nutrition (i.e. comparison of knowledge of mothers who received counselling with and without mobile phone meaningless)

29 Process tracing Process tracing to unwrap whether, why and how the mobile phone may improve the different steps of the counselling 3 Hypotheses were developed based on initial observations of the counselling process with and without mobile phone and interviews of several cadres about their practices and challenges during the counselling process

30 Hypotheses for the process tracing The mobile phone will. 1. Improve 2. Not change 3. Worsen the (1) the initial assessment; (2) analysis and (3) provision of tailored behaviour change messages during the home-based counselling.

31 Process tracing Each hypothesis will be systematically tested using two guiding questions for the collection of diagnostic evidence 1. What would we expect to observe if the hypothesis is true (improvement, no relevant change, worsening)? 2. What / which observation(s) would be very unlikely UNLESS the hypothesis is true (what observations would practically prove the hypothesis because they're extremely unlikely under any other circumstance)?

32 Process tracing tools Direct observations of counselling sessions with a checklist (cadres behaviour, attitude and interaction with the mother, includes baseline of counselling sessions without mobile phone to identify outcome indicators) Interviews with cadres Interviews with mothers Technical checklist for the features of the mobile phone application

33 Thank you For further questions Inka Barnett

34 How mobile phone may improve initial assessment during counselling. Mobile gives structure and avoids missed steps Gives confidence to the cadres in assessment Accuracy of assessment improved Quicker as less time needed for initial assessment (cadres are less likely to talk about other unrelated things with mother) More participatory and mothers engage more (want to see what is on screen) Mothers perceive it as more important and serious and pay attention Makes sure that mothers are regularly praised and rewarded for good practices (phone includes reminders) Skills of cadres are improved as the see assessment questions over and over in the application

35 How mobile phone may worsen initial assessment during counselling. List of questions takes very long to administer and mother gets angry and attention drops Cadre s attention during the initial assessment is on phone only (does not build good report with mother) Closed questions, cadres don t believe mothers yes/no answers (cadres know mothers better and expect social desirability bias in their answers (especially as mothers fear that cadre will send their answers to the MoH) Informal conversation during the initial assessment gets lost and cadres don t build trust in cadre with mothers No preparation for individual child before home visit necessary (own initiative of cadres reduced)

36 Mill s Method of Difference The cause for the illness must be the consumption of the salad as all other items taken were the same. Similar the cause for the difference between the records must be the phone as all other characteristics are the same)

37

38 Work plan for EACH posyandu

EVIDENCE REPORT No 79

EVIDENCE REPORT No 79 DS EVIDENCE REPORT No 79 Reducing Hunger and Undernutrition Designing a Mixed-Method Impact Evaluation for a Mobile Phone Application for Nutrition Service Delivery in Indonesia Inka Barnett and Barbara

More information

IPDET Module 6: Descriptive, Normative, and Impact Evaluation Designs

IPDET Module 6: Descriptive, Normative, and Impact Evaluation Designs IPDET Module 6: Descriptive, Normative, and Impact Evaluation Designs Intervention or Policy Evaluation Questions Design Questions Elements Types Key Points Introduction What Is Evaluation Design? Connecting

More information

TOOL D14 Monitoring and evaluation: a framework

TOOL D14 Monitoring and evaluation: a framework TOOL D14 Monitoring and evaluation: a framework 159 TOOL D14 Monitoring and evaluation: a framework TOOL D14 For: About: Purpose: Use: Resource: Commissioners in primary care trusts (PCTs) and local authorities

More information

Objectives. What is undernutrition? What is undernutrition? What does undernutrition look like?

Objectives. What is undernutrition? What is undernutrition? What does undernutrition look like? Objectives Basics Jean-Pierre Habicht, MD, PhD Professor Division of Nutritional Sciences Cornell University Types and causes Determinants Consequences Global occurrence and progress Way forward What is

More information

Performance Monitoring Tools

Performance Monitoring Tools Performance Monitoring Tools M&E training for MoHSW & Business Coalition on HIV/AIDS Material adapted from USDOL/ILO HIV/AIDS Workplace Education programme Session Objectives Participants will be able

More information

PROJECT MANAGEMENT TRAINING MODULES

PROJECT MANAGEMENT TRAINING MODULES PROJECT MANAGEMENT TRAINING MODULES KENYA PROJECTS ORGANIZATION < Projects Solutions Provider > Macjo Arcade, 4 th Flr., Suite 15E P.O Box, 3029 00200, Nairobi - Kenya Tel: 254 (0)202319748 Mob: 0725 788

More information

How Are We Doing? A Hospital Self Assessment Survey on Patient Transitions and Family Caregivers

How Are We Doing? A Hospital Self Assessment Survey on Patient Transitions and Family Caregivers How Are We Doing? A Hospital Self Assessment Survey on Patient Transitions and Family Caregivers Well-planned and managed transitions are essential for high quality care and patient safety. Transitions

More information

Using Evaluation to Improve Programs. Strategic Planning. www.cdc.gov/healthyyouth/evaluation

Using Evaluation to Improve Programs. Strategic Planning. www.cdc.gov/healthyyouth/evaluation Using Evaluation to Improve Programs Strategic Planning www.cdc.gov/healthyyouth/evaluation PROGRAM STRATEGIC PLANNING KIT Table of Contents Introduction Part 1: What is strategic planning? Part 2: What

More information

Information & Communications Technology for Maternal, Newborn and Child Health in Malawi: Evaluation Methodology

Information & Communications Technology for Maternal, Newborn and Child Health in Malawi: Evaluation Methodology Evaluation Brief 2013 Information & Communications Technology for Maternal, Newborn and Child Health in Malawi: Evaluation Methodology This brief presents an overview of the methods used to evaluate outcomes

More information

Derbyshire County Council

Derbyshire County Council Derbyshire County Council Derbyshire County Council is situated in the East Midlands and is bordered by the cities of Nottingham, Sheffield and Manchester. Its role it to provide local government services

More information

Which Design Is Best?

Which Design Is Best? Which Design Is Best? Which Design Is Best? In Investigation 2-8: Which Design Is Best? students will become more familiar with the four basic epidemiologic study designs, learn to identify several strengths

More information

WHAT WORKS IN INNOVATION AND EDUCATION IMPROVING TEACHING AND LEARNING FOR ADULTS WITH BASIC SKILL NEEDS THROUGH FORMATIVE ASSESSMENT STUDY OUTLINE

WHAT WORKS IN INNOVATION AND EDUCATION IMPROVING TEACHING AND LEARNING FOR ADULTS WITH BASIC SKILL NEEDS THROUGH FORMATIVE ASSESSMENT STUDY OUTLINE WHAT WORKS IN INNOVATION AND EDUCATION IMPROVING TEACHING AND LEARNING FOR ADULTS WITH BASIC SKILL NEEDS THROUGH FORMATIVE ASSESSMENT STUDY OUTLINE The OECD s Centre for Educational Research and Innovation

More information

TERMS OF REFERENCE Health and Hygiene Promotion Approaches for Namibia Technical Assistance

TERMS OF REFERENCE Health and Hygiene Promotion Approaches for Namibia Technical Assistance 1. Summary Title Purpose TERMS OF REFERENCE Health and Hygiene Promotion Approaches for Namibia Technical Assistance Health and Hygiene Promotion (HHP) Approaches for Namibia To develop a common approach

More information

Healthy Lifestyles Campaign Development Tool

Healthy Lifestyles Campaign Development Tool Healthy Lifestyles Campaign Development Tool This publication arises from the project European Youth Tackling Obesity (EYTO) which has received funding from the European Union in the framework of the Health

More information

Strategy for data collection

Strategy for data collection 2007/21 Plans and reports Strategy for data collection Strategy for data collection The demand for statistics and public administrative information is increasing, as are the demands on quality in statistics

More information

The Family-Friendly Workplace Model

The Family-Friendly Workplace Model FOCUS ON INDIA The Family-Friendly Workplace Model Helping Companies Analyze the Benefits of Family-Friendly Policies Today, women make up 40 percent of the global workforce, and they are becoming an increasingly

More information

Examples of Quality Improvement Projects in Adult Immunization

Examples of Quality Improvement Projects in Adult Immunization Examples of Quality Improvement Projects in Adult Immunization The following activities are provided to prompt your thinking about what works best for your practice. When designing a project, consider

More information

Developing an implementation research proposal. Session 2: Research design

Developing an implementation research proposal. Session 2: Research design Developing an implementation research proposal Session 2: Research design Learning objectives After completing this session, you will be able to: Develop a research design outlining your data collection

More information

Guidelines for AJO-DO submissions: Randomized Clinical Trials June 2015

Guidelines for AJO-DO submissions: Randomized Clinical Trials June 2015 Guidelines for AJO-DO submissions: Randomized Clinical Trials June 2015 Complete and transparent reporting allows for accurate assessment of the quality of trial and correct interpretation of the trial

More information

Capacity Assessment Indicator. Means of Measurement. Instructions. Score As an As a training. As a research institution organisation (0-5) (0-5) (0-5)

Capacity Assessment Indicator. Means of Measurement. Instructions. Score As an As a training. As a research institution organisation (0-5) (0-5) (0-5) Assessing an Organization s in Health Communication: A Six Cs Approach [11/12 Version] Name & location of organization: Date: Scoring: 0 = no capacity, 5 = full capacity Category Assessment Indicator As

More information

CenteringParenting, a unique group post-partum care and social-support model, is ready for

CenteringParenting, a unique group post-partum care and social-support model, is ready for Overall Summary CenteringParenting, a unique group post-partum care and social-support model, is ready for implementation in Calgary. Thanks to the funding provided by the Alberta Center for Child, Family,

More information

Koninklijke FrieslandCampina

Koninklijke FrieslandCampina BMS NUTRITION GENERAL 5 4.0 UNDERNUTRITION 6 2.3 BMS 3 24% RANK 8 19 (2013) SCORE 2.8 A Governance (12.5%) 4.6 B Products (25%) 5.8 C Accessibility (20%) 2.5 D Marketing (20%) 2.9 E Lifestyles (2.5%) 3.8

More information

Engage Government & Community 2 PLAN REFLECT ACT

Engage Government & Community 2 PLAN REFLECT ACT Step 6: Monitor and Evaluate 7 Improve & Revise Services 1 Engage Government & Community 2 Establish Leadership & Management Structure REFLECT PLAN 6 Monitor & Evaluate ACT 3 Adapt the Community-Based

More information

Beyond Meaningful Use -- Multi- disciplinary Team Integration of Customized Smoking Cessation Patient Education Into EMR Clinical Decision Support

Beyond Meaningful Use -- Multi- disciplinary Team Integration of Customized Smoking Cessation Patient Education Into EMR Clinical Decision Support Beyond Meaningful Use -- Multi- disciplinary Team Integration of Customized Smoking Cessation Patient Education Into EMR Clinical Decision Support Wendy Angelo, MD Capital Region Healthcare Learning Objectives

More information

1. FORMULATING A RESEARCH QUESTION

1. FORMULATING A RESEARCH QUESTION W R I T I N G A R E S E A R C H G R A N T P R O P O S A L 1. FORMULATING A RESEARCH QUESTION 1.1. Identify a broad area of interest through literature searches, discussions with colleagues, policy makers

More information

Technical guidance note for Global Fund HIV proposals in Round 11

Technical guidance note for Global Fund HIV proposals in Round 11 Technical guidance note for Global Fund HIV proposals in Round 11 UNAIDS I World Health Organization I August 2011 Rationale for including the development of a system in the proposal With the global momentum

More information

msakhi: An Interactive Mobile Phone-Based Job Aid for Accredited Social Health Activists (ASHAs)

msakhi: An Interactive Mobile Phone-Based Job Aid for Accredited Social Health Activists (ASHAs) msakhi: An Interactive Mobile Phone-Based Job Aid for Accredited Social Health Activists (ASHAs) September 2013 Background End of project brief 1 2 With 56,000 maternal and 876,000 newborn deaths each

More information

Observing and describing the behavior of a subject without influencing it in any way.

Observing and describing the behavior of a subject without influencing it in any way. HOW TO CHOOSE FROM THE DIFFERENT RESEARCH METHODS* The design is the structure of any scientific work. It gives direction and systematizes the research. The method you choose will affect your results and

More information

The End Point: Example of a Good Survey Report

The End Point: Example of a Good Survey Report CHAPTER The End Point: Example of a Good Survey Report This chapter serves to conclude with how important and crucial is to undertake an accurate assessment and present the findings in a comprehensive

More information

Ch. 4: Four-Step Problem Solving Model

Ch. 4: Four-Step Problem Solving Model Ch. 4: Four-Step Problem Solving Model MDCPS Office of Academics, Accountability & School Improvement 2013-2014 The Problem-Solving Team Each school is expected to create and support an RtI/MTSS leadership

More information

Action Against Hunger s Tool to Determine Where and When Nutritional Interventions are Needed in Times of Crises

Action Against Hunger s Tool to Determine Where and When Nutritional Interventions are Needed in Times of Crises ACF Canada. Action Against Hunger s Tool to Determine Where and When Nutritional Interventions are Needed in Times of Crises Tracy McDonough, M.Sc. Human Nutrition & Nadia Browne, M.Sc. Human Nutrition

More information

What are research, evaluation and audit?

What are research, evaluation and audit? 1 What are research, evaluation and audit? Barbara Sen, Maria J. Grant and Hannah Spring I don t do research. I don t have the time. I am too busy with the day to day running of the library. I do evaluations

More information

Mental Health Smartphone Application A New Initiative for Mental Health Care Providers

Mental Health Smartphone Application A New Initiative for Mental Health Care Providers Mental Health Smartphone Application A New Initiative for Mental Health Care Providers Dr. Melvyn Zhang MBBS (S pore), DCP(Ireland), MRCPsych(UK) Psychiatry Resident in Training Department of Psychological

More information

Social Survey Methods and Data Collection

Social Survey Methods and Data Collection Social Survey Social Survey Methods and Data Collection Zarina Ali June 2007 Concept of Survey & Social Survey A "survey" can be anything from a short paper- and-pencil feedback form to an intensive one-on

More information

X = T + E. Reliability. Reliability. Classical Test Theory 7/18/2012. Refers to the consistency or stability of scores

X = T + E. Reliability. Reliability. Classical Test Theory 7/18/2012. Refers to the consistency or stability of scores Reliability It is the user who must take responsibility for determining whether or not scores are sufficiently trustworthy to justify anticipated uses and interpretations. (AERA et al., 1999) Reliability

More information

Audit of the Test of Design of Entity-Level Controls

Audit of the Test of Design of Entity-Level Controls Audit of the Test of Design of Entity-Level Controls Canadian Grain Commission Audit & Evaluation Services Final Report March 2012 Canadian Grain Commission 0 Entity Level Controls 2011 Table of Contents

More information

How to Communicate With Health Professionals in Review of Obesity

How to Communicate With Health Professionals in Review of Obesity Process Mapping Tool for Evaluation SW UK Partnership There are three areas of Recommendation developed by the work of the SW UK partnership. These are set out in the SW UK published Policy Analysis. They

More information

Quality Management System for Providers of Health Services to People with Disabilities

Quality Management System for Providers of Health Services to People with Disabilities Quality Management System for Providers of Health Services to People with Disabilities Quality State the objectives of the organization required to achieve a desired level of quality Identify the policies

More information

Quantitative Research: Reliability and Validity

Quantitative Research: Reliability and Validity Quantitative Research: Reliability and Validity Reliability Definition: Reliability is the consistency of your measurement, or the degree to which an instrument measures the same way each time it is used

More information

Research Priority Area 3 Food Intake and Healthy Dietary Practices Across the Lifespan

Research Priority Area 3 Food Intake and Healthy Dietary Practices Across the Lifespan Research Priority Area 3 Food Intake and Healthy Dietary Practices Across the Lifespan 37 38 4 FOOD INTAKE AND HEALTHY DIETARY PRACTICES Research Priority Area 3 39 Research Priority Area 3 FOOD INTAKE

More information

Biostat Methods STAT 5820/6910 Handout #6: Intro. to Clinical Trials (Matthews text)

Biostat Methods STAT 5820/6910 Handout #6: Intro. to Clinical Trials (Matthews text) Biostat Methods STAT 5820/6910 Handout #6: Intro. to Clinical Trials (Matthews text) Key features of RCT (randomized controlled trial) One group (treatment) receives its treatment at the same time another

More information

Addiction and Obesity Independent Review Team Department for Work and Pensions Ground Floor Caxton House Tothill Street London SW1H 9NA

Addiction and Obesity Independent Review Team Department for Work and Pensions Ground Floor Caxton House Tothill Street London SW1H 9NA Addiction and Obesity Independent Review Team Department for Work and Pensions Ground Floor Caxton House Tothill Street London SW1H 9NA 11 September 2015 Dear Sir or Madam, YMCA England response to the

More information

SAMPLING & INFERENTIAL STATISTICS. Sampling is necessary to make inferences about a population.

SAMPLING & INFERENTIAL STATISTICS. Sampling is necessary to make inferences about a population. SAMPLING & INFERENTIAL STATISTICS Sampling is necessary to make inferences about a population. SAMPLING The group that you observe or collect data from is the sample. The group that you make generalizations

More information

D 1. Working with people Develop productive working relationships with colleagues. Unit Summary. effective performance.

D 1. Working with people Develop productive working relationships with colleagues. Unit Summary. effective performance. 1 Develop productive working relationships with colleagues Unit Summary What is the unit about? This unit is about developing working relationships with colleagues, within your own organisation and within

More information

Chapter 2: Research Methodology

Chapter 2: Research Methodology Chapter 2: Research Methodology 1. Type of Research 2. Sources of Data 3. Instruments for Data Collection 4. Research Methods 5. Sampling 6. Limitations of the Study 6 Chapter 2: Research Methodology Research

More information

Using the PRECEDE- PROCEED Planning Model PRECEDE-PROCEED P R E C E D E. Model for health promotion programming Best known among health scientists

Using the PRECEDE- PROCEED Planning Model PRECEDE-PROCEED P R E C E D E. Model for health promotion programming Best known among health scientists Using the PRECEDE- PROCEED Planning Model Dr. McKinley Thomas Associate Professor Department of Community Medicine Mercer University PRECEDE-PROCEED Model for health promotion programming Best known among

More information

Maternal and Neonatal Health in Bangladesh

Maternal and Neonatal Health in Bangladesh Maternal and Neonatal Health in Bangladesh KEY STATISTICS Basic data Maternal mortality ratio (deaths per 100,000 births) 320* Neonatal mortality rate (deaths per 1,000 births) 37 Births for women aged

More information

Chapter 14: Usability testing and field studies. The aims: Usability testing

Chapter 14: Usability testing and field studies. The aims: Usability testing Chapter 14: Usability testing and field studies The aims: Explain how to do usability testing through examples Outline the basics of experimental design Discuss the methods used in usability testing Discuss

More information

Unconditional Basic Income: Two pilots in Madhya Pradesh

Unconditional Basic Income: Two pilots in Madhya Pradesh Background Unconditional Basic Income: Two pilots in Madhya Pradesh A Background Note prepared for the Delhi Conference, May 30-31, 2013. 1 The public debate on cash transfers in India has been highly

More information

Examining Motivation Theory in Higher Education: An Expectancy Theory Analysis of Tenured Faculty Productivity

Examining Motivation Theory in Higher Education: An Expectancy Theory Analysis of Tenured Faculty Productivity VOLUME 15, NUMBER 1, 2012 Examining Motivation Theory in Higher Education: An Expectancy Theory Analysis of Tenured Faculty Productivity Brent Estes, PhD Assistant Professor Department of Health & Kinesiology

More information

General Guidance for Developing, Documenting, Implementing, Maintaining, and Auditing an SQF System. Module 2: System Elements. SQF Code, Edition 7.

General Guidance for Developing, Documenting, Implementing, Maintaining, and Auditing an SQF System. Module 2: System Elements. SQF Code, Edition 7. General Guidance for Developing, Documenting, Implementing, Maintaining, and Auditing an SQF System Module 2: System Elements SQF Code, Edition 7.1 M A Y 2 0 1 3 2013 Safe Quality Food Institute 2345 Crystal

More information

STRATEGIC IMPACT EVALUATION FUND (SIEF)

STRATEGIC IMPACT EVALUATION FUND (SIEF) IMPACT EVALUATION CLUSTER NOTE: EARLY CHILDHOOD NUTRITION, HEALTH AND DEVELOPMENT I. Background. The early childhood period is a time of rapid growth and development across four domains: physical, cognitive,

More information

Prepared by the Policy, Performance and Quality Assurance Unit (Adults) Tamsin White

Prepared by the Policy, Performance and Quality Assurance Unit (Adults) Tamsin White Principles of Good Research & Research Proposal Guidee Prepared by the Policy, Performance and Quality Assurance Unit (Adults) Tamsin White March 2006 Principles of Good Research All research is different

More information

The State of Health Equity in Ontario Dennis Raphael, PhD

The State of Health Equity in Ontario Dennis Raphael, PhD The State of Health Equity in Ontario Dennis Raphael, PhD Introduction Working towards health equity is about creating the circumstances where avoidable differences or inequalities in health that is health

More information

MBA ASSESSMENT PLAN 2011-2013 San Diego State University College of Business Administration

MBA ASSESSMENT PLAN 2011-2013 San Diego State University College of Business Administration MBA ASSESSMENT PLAN 2011-2013 San Diego State University College of Business Administration Mission Statement The mission of the MBA degree program at SDSU is to provide innovative programs for graduate

More information

Youth and children Understanding the needs of our youth and children today, for a brighter tomorrow

Youth and children Understanding the needs of our youth and children today, for a brighter tomorrow HSRC ANNUAL REPORT 2009/2010 / Social science that makes a difference Youth and children Understanding the needs of our youth and children today, for a brighter tomorrow HSRC studies on children focus

More information

Virginia Defense Force

Virginia Defense Force Virginia Defense Force Instructor Development Course By Lt. Col. (VA) Stewart W. Bentley, PhD 1 Course Objectives At the end of this course, you will be able to identify: Principles of Adult Learners.

More information

Checklist for Reviewing Scopes of Work for Performance Evaluations

Checklist for Reviewing Scopes of Work for Performance Evaluations Checklist for Reviewing Scopes of Work for Performance Evaluations Use the Evaluation Scope of Work (SOW) Checklist to review and strengthen SOW during the evaluation planning stage. In most cases you

More information

Botswana s Integration of Data Quality Assurance Into Standard Operating Procedures

Botswana s Integration of Data Quality Assurance Into Standard Operating Procedures Botswana s Integration of Data Quality Assurance Into Standard Operating Procedures ADAPTATION OF THE ROUTINE DATA QUALITY ASSESSMENT TOOL MEASURE Evaluation SPECIAL REPORT Botswana s Integration of Data

More information

Building Smallholder Resilience by Improving Value-Add in Supply Chains:! The Community Knowledge Worker!!

Building Smallholder Resilience by Improving Value-Add in Supply Chains:! The Community Knowledge Worker!! Building Smallholder Resilience by Improving Value-Add in Supply Chains:! The Community Knowledge Worker!! Mobile Agriculture! March 2014 Grameen Foundation: Our Work Access to Information (Ag, Health,

More information

Master of Science. Public Health Nutrition

Master of Science. Public Health Nutrition Department of Clinical Sciences and Nutrition Master of Science in Public Health Nutrition Full-Time and Part-Time Taught Modular Masters Programme Module Descriptor Outlines 1 Short Module Descriptors

More information

Empirical Software Engineering Introduction & Basic Concepts

Empirical Software Engineering Introduction & Basic Concepts Empirical Software Engineering Introduction & Basic Concepts Dietmar Winkler Vienna University of Technology Institute of Software Technology and Interactive Systems dietmar.winkler@qse.ifs.tuwien.ac.at

More information

UNICEF in South Africa

UNICEF in South Africa UNICEF in South Africa A message from the Representative 47,900,000 people live in South Africa 20,200,000 are children 294,000 children are HIV-positive 1 in 17 children die before their fifth birthday

More information

Economic impact of privacy on online behavioral advertising

Economic impact of privacy on online behavioral advertising Benchmark study of Internet marketers and advertisers Independently Conducted by Ponemon Institute LLC April 30, 2010 Ponemon Institute Research Report Economic impact of privacy on online behavioral advertising

More information

Guided Reading 9 th Edition. informed consent, protection from harm, deception, confidentiality, and anonymity.

Guided Reading 9 th Edition. informed consent, protection from harm, deception, confidentiality, and anonymity. Guided Reading Educational Research: Competencies for Analysis and Applications 9th Edition EDFS 635: Educational Research Chapter 1: Introduction to Educational Research 1. List and briefly describe the

More information

EVOLUTION OF NATIONAL STATISTICAL SYSTEM OF CAMBODIA

EVOLUTION OF NATIONAL STATISTICAL SYSTEM OF CAMBODIA COUNTRY PAPER - CAMBODIA for the A Seminar commemorating the 60th Anniversary of the United Nations Statistical Commission United Nations, New York, 23 February 2007 EVOLUTION OF NATIONAL STATISTICAL SYSTEM

More information

Rapid Assessment of Sexual and Reproductive Health

Rapid Assessment of Sexual and Reproductive Health BURKINA FASO Rapid Assessment of Sexual and Reproductive Health and HIV Linkages This summary highlights the experiences, results and actions from the implementation of the Rapid Assessment Tool for Sexual

More information

Assessment Policy. 1 Introduction. 2 Background

Assessment Policy. 1 Introduction. 2 Background Assessment Policy 1 Introduction This document has been written by the National Foundation for Educational Research (NFER) to provide policy makers, researchers, teacher educators and practitioners with

More information

Determinants of Health

Determinants of Health Determinants of Health CNA Position The Canadian Nurses Association (CNA) endorses a broad approach to supporting health that addresses factors both within and outside the health sector. CNA challenges

More information

INNOVATIVE APPROACHES TO IMPROVE EARLY CHILDHOOD DEVELOPMENT (0-3 YEARS)

INNOVATIVE APPROACHES TO IMPROVE EARLY CHILDHOOD DEVELOPMENT (0-3 YEARS) INNOVATIVE APPROACHES TO IMPROVE EARLY CHILDHOOD DEVELOPMENT (0-3 YEARS) Robert Scherpbier & Margo O'Sullivan Chief of Health, Nutrition & WASH Chief of Education & Child Development UNICEF China Office

More information

World Health Organization

World Health Organization March 1, 2005 Proposed Networks to Support Health Decision-Making and Health Policy Formulation in Low and Lower Middle Income Countries & Considerations for Implementation World Health Organization A

More information

The Situation of Children and Women in Iraq

The Situation of Children and Women in Iraq The Situation of Children and Women in Iraq Highlights from the Multiple Indicator Cluster Survey 4 (MICS 4) 2011 Demographics - Population of Iraq: 33.4 million - Children and Adolescents (0-18): 16.6

More information

Human Resources Training. Performance Management Training Module 2: Managing Employee Performance

Human Resources Training. Performance Management Training Module 2: Managing Employee Performance Human Resources Training Performance Management Training Module 2: Managing Employee Performance Table of Contents Learning Objectives...1 Expectations Of You As A Leader...3 Setting and Communicating

More information

Organization Effectiveness Based on Performance Measurement and Organizational Competencies Getting to Perfect!

Organization Effectiveness Based on Performance Measurement and Organizational Competencies Getting to Perfect! Organization Effectiveness Based on Performance Measurement and Organizational Competencies Getting to Perfect! John McLaughlin, Human Capital Management Consultant Abstract This article describes a model

More information

NON-PROBABILITY SAMPLING TECHNIQUES

NON-PROBABILITY SAMPLING TECHNIQUES NON-PROBABILITY SAMPLING TECHNIQUES PRESENTED BY Name: WINNIE MUGERA Reg No: L50/62004/2013 RESEARCH METHODS LDP 603 UNIVERSITY OF NAIROBI Date: APRIL 2013 SAMPLING Sampling is the use of a subset of the

More information

Dr. Ryan McLawhon Texas A&M University

Dr. Ryan McLawhon Texas A&M University Dr. Ryan McLawhon Texas A&M University Introduction to Assessment Components of an Assessment Plan Mission Outcomes Measures Achievement Targets Question and Answer Session NCAAA Standard 4 (&5, etc.)

More information

Chapter Eight: Quantitative Methods

Chapter Eight: Quantitative Methods Chapter Eight: Quantitative Methods RESEARCH DESIGN Qualitative, Quantitative, and Mixed Methods Approaches Third Edition John W. Creswell Chapter Outline Defining Surveys and Experiments Components of

More information

Outcomes of milk based Interventions: Improvements on health and nutritional status of under-fives in rural households, Tanzania?

Outcomes of milk based Interventions: Improvements on health and nutritional status of under-fives in rural households, Tanzania? Outcomes of milk based Interventions: Improvements on health and nutritional status of under-fives in rural households, Tanzania? Devota Mwaseba Presentation Outline Background Research problem Objectives

More information

Measuring the strength of implementation. of community case management of childhood illness. within the Catalytic Initiative to Save a Million Lives

Measuring the strength of implementation. of community case management of childhood illness. within the Catalytic Initiative to Save a Million Lives Measuring the strength of implementation of community case management of childhood illness within the Catalytic Initiative to Save a Million Lives Working Paper Version 27 August 2011 This is a working

More information

Terms of Reference Concurrent Monitoring of Mid Day Meal (MDM) in Odisha

Terms of Reference Concurrent Monitoring of Mid Day Meal (MDM) in Odisha Terms of Reference Concurrent Monitoring of Mid Day Meal (MDM) in Odisha 1. Background The Government of India has initiated a number of social welfare flagship schemes to enable improving status of human

More information

A joint Collaboration of Rwanda Ministry of Health, UNICEF, and Emory University 1

A joint Collaboration of Rwanda Ministry of Health, UNICEF, and Emory University 1 A joint Collaboration of Rwanda Ministry of Health, UNICEF, and Emory University 1 2 Clubs in Schools: Environmental clubs and hygiene clubs In the ESSP, issues related to hygiene, sanitation and availability

More information

Planning for monitoring and evaluation activities during the programme's lifetime

Planning for monitoring and evaluation activities during the programme's lifetime Developing a Monitoring and Evaluation Plan for Food Security and Agriculture Programmes Planning for monitoring and evaluation activities during the programme's lifetime Text-only version In this lesson

More information

Final Award. (exit route if applicable for Postgraduate Taught Programmes) D991 JACS Code

Final Award. (exit route if applicable for Postgraduate Taught Programmes) D991 JACS Code Programme Specification (2014-15) A programme specification is required for any programme on which a student may be registered. All programmes of the University are subject to the University s Quality

More information

World s largest food companies urged to step up efforts on global nutrition crisis

World s largest food companies urged to step up efforts on global nutrition crisis Contact: ATNI@webershandwick.com Helen Palmer +44 (0)7912 242394 Gillian Gallanagh +44 (0)7790 588295 World s largest food companies urged to step up efforts on global nutrition crisis Global Access to

More information

Colorado WIC Program- FY16 LA Nutrition Education Plan

Colorado WIC Program- FY16 LA Nutrition Education Plan Introduction Federal WIC regulations require each local WIC agency to develop an annual local agency nutrition education plan (NEP) that is consistent with the nutrition education component of the State

More information

Specific Measurable Achievable. Relevant Timely. PERFORMANCE MANAGEMENT CREATING SMART OBJECTIVES: Participant Guide PROGRAM OVERVIEW

Specific Measurable Achievable. Relevant Timely. PERFORMANCE MANAGEMENT CREATING SMART OBJECTIVES: Participant Guide PROGRAM OVERVIEW Specific Measurable Achievable PERFORMANCE MANAGEMENT CREATING SMART OBJECTIVES: Participant Guide Relevant Timely PROGRAM OVERVIEW About the Training Program This session is designed to enable participants

More information

I n t r o d u c t i o n

I n t r o d u c t i o n Preventing Alcohol and Drug Misuse in Young People: Adaptation and Testing of the Strengthening Families Programme 10-14 (SFP10-14) for use in the United Kingdom In 2006 Coombes et al produced a report

More information

SUPPORTIVE SUPERVISION PROTOCOL AND CHECKLIST FOR MTBT SOCIAL FRANCHISES

SUPPORTIVE SUPERVISION PROTOCOL AND CHECKLIST FOR MTBT SOCIAL FRANCHISES SUPPORTIVE SUPERVISION PROTOCOL AND CHECKLIST FOR MTBT SOCIAL FRANCHISES Supportive supervision Purpose: Supportive supervision is an important aspect of performance management and an essential feature

More information

Social and behavior change communication (SBCC) Quality Assessment Tool

Social and behavior change communication (SBCC) Quality Assessment Tool Social and behavior change communication (SB) Quality Tool Organizational Profile ate of : / / Y MONTH YER. Name of Organization:. ontact etails:. Technical Focus of the : ll reas Only one technical area:.

More information

State Program Title: Public Health Dental Program. State Program Strategy:

State Program Title: Public Health Dental Program. State Program Strategy: State Program Title: Public Health Dental Program State Program Strategy: The Public Health Dental Program provides policy direction for oral health issues to promote the development of cost-effective

More information

GUIDELINES FOR PILOT INTERVENTIONS. www.ewaproject.eu ewa@gencat.cat

GUIDELINES FOR PILOT INTERVENTIONS. www.ewaproject.eu ewa@gencat.cat GUIDELINES FOR PILOT INTERVENTIONS www.ewaproject.eu ewa@gencat.cat Project Lead: GENCAT CONTENTS A Introduction 2 1 Purpose of the Document 2 2 Background and Context 2 3 Overview of the Pilot Interventions

More information

HLPE report on Nutrition and Food Systems

HLPE report on Nutrition and Food Systems HLPE report on Nutrition and Food Systems e-consultation on an Issues Note proposed by the HLPE Steering Committee From 9 December 2015 to 15 February 2016 Short Summary by the HLPE Secretariat 1 There

More information

Working with the Call Center

Working with the Call Center Quick Reference: Call Center Working with the Call Center Contents Roadmap: Working with web-based patients... 2 Roadmap: Working with phone-based patients... 4 Roadmap: Working with paper-based patients...

More information

Poverty Indicators and Monitoring in Kyrgyzstan Case Study

Poverty Indicators and Monitoring in Kyrgyzstan Case Study Poverty Indicators and Monitoring in Kyrgyzstan Case Study Prepared by R. Mogilevskiy (Center on Economic and Social Research) Kyrgyzstan Both the government and society in Kyrgyzstan have admitted that

More information

TST Issues Brief: Food Security and Nutrition 1

TST Issues Brief: Food Security and Nutrition 1 TST Issues Brief: Food Security and Nutrition 1 I. Stocktaking Food security and nutrition are essential dimensions of sustainable development. Inadequate food security and nutrition take an enormous toll

More information

Mary B Codd. MD, MPH, PhD, FFPHMI UCD School of Public Health, Physiotherapy & Pop. Sciences

Mary B Codd. MD, MPH, PhD, FFPHMI UCD School of Public Health, Physiotherapy & Pop. Sciences HRB / CSTAR Grant Applications Training Day Convention Centre Dublin, 9 th September 2010 Key Elements of a Research Protocol Mary B Codd. MD, MPH, PhD, FFPHMI UCD School of Public Health, Physiotherapy

More information

Introduction to Marketing

Introduction to Marketing Introduction to Marketing Theocharis Katranis Spring Semester 2013 1 Today s Lecture 1. We will explain the importance of information in gaining insights about the marketplace and customers. 2. We will

More information

IT S TIME! PRIMARIS EHR SOLUTION. Benefits of Operational Efficiency. Why Primaris?

IT S TIME! PRIMARIS EHR SOLUTION. Benefits of Operational Efficiency. Why Primaris? IT S TIME! PRIMARIS EHR SOLUTION For years, Primaris has advocated the use of health information technology to improve patient care. We help providers take full advantage of their electronic health records

More information

Financing Smallholder Farmers. to Increase Incomes and Transform Lives in Rural Communities

Financing Smallholder Farmers. to Increase Incomes and Transform Lives in Rural Communities Financing Smallholder Farmers to Increase Incomes and Transform Lives in Rural Communities EXECUTIVE SUMMARY Africa is home to a quarter of the world s farmland, yet it generates only 10 percent of all

More information

Report: An Analysis of US Government Proposed Cyber Incentives. Author: Joe Stuntz, MBA EP 14, McDonough School of Business

Report: An Analysis of US Government Proposed Cyber Incentives. Author: Joe Stuntz, MBA EP 14, McDonough School of Business S 2 ERC Project: Cyber Threat Intelligence Exchange Ecosystem: Economic Analysis Report: An Analysis of US Government Proposed Cyber Incentives Author: Joe Stuntz, MBA EP 14, McDonough School of Business

More information