Performance Monitoring Tools

Transcription

1 Performance Monitoring Tools M&E training for MoHSW & Business Coalition on HIV/AIDS Material adapted from USDOL/ILO HIV/AIDS Workplace Education programme

2 Session Objectives Participants will be able to 1. Explain relationship between the strategic framework and tools for data collection 2. Develop a performance monitoring plan (PMP) 3. Identify tools for data collection 4. Develop tools for data collection

3 Session Overview Performance measurement Tools and Data Analysis The Performance Measurement Plan Sector specific measurement tools? How is Data Collected, Analyzed and Reported?

4 Monitoring Tools Selecting the right mix of monitoring mechanisms Reporting/analysis - entails obtaining and analyzing documentation from the project that provides information on progress; Validation - entails checking or verifying whether or not the reported progress is accurate; Participation - entails obtaining feedback from partners and beneficiaries on progress and proposed actions.

5 Recap Selecting the right mix of monitoring mechanisms Reporting & Analysis Validation Participation Annual Project Report Progress and/or quarterly reports Work plans Project delivery reports Substantive project documentation Field Visits Spot-checks Client surveys Research External assessments Stakeholder meetings Annual Review Steering Committees Learning takes place through all monitoring tools or mechanisms

6 Key Tools of National M&E for the WorkPlace Tool National Draft M&E Framework Function Provides guidance in developing strategic framework for M&E and selection of performance indicators. Strategic Framework Develop/capture project strategy (hypothesis) Performance Monitoring Plan Defines roles and responsibilities for data collection, sources and tools to use

7 Key Tools of NERCHA M&E for the Workplace Tool Data Collection Tools Data Tracking Table Participatory Mechanisms Function Periodic collection of data Track actual data against baselines and across time Facilitate analysis and reporting Communicate project progress and problems to stakeholders Encourage and inform management reviews

8 National Draft M&E Framework Features 1. General principles of the national monitoring and evaluation framework 2. National Indicators by Programme Area 3. The National Monitoring and Evaluation Framework

9 General Principles of M&E Definition of monitoring and evaluation Programme functions that can be monitored and evaluated Monitoring and evaluation components Levels of monitoring and evaluation

10 National Indicators by Programme Area Overall goals and programme areas of the national HIV/AIDS programme Indicators by categoy Impact Outcome, output and process

11 The National Monitoring and Evaluation Framework Data Collection Strategy National surveys Design checklists Interview schedules

12 The National Monitoring and Evaluation Framework Data Flow Channels Data collected by MOH Data collected by NERCHA Data collected by projects/programmes, business coalition, etc.

13 The National Monitoring and Evaluation Framework Data Management and Dissemination Annual national review meeting Periodic newsletter Press releases Website

14 The National Monitoring and Evaluation Framework Stakeholders and Partnerships NERCHA National M&E Committee Regional HIV/AIDS Offices MoHSW/ Other Govt. ministries NGOs Donors

15 Strategic Framework Strategic frameworks are diagrams that identify steps or levels of results and illustrate the causal relationships linking all levels of a program s objectives.

16 Strategic Framework Purposes: Provides a clarified focus on the causal relationships that connect incremental achievement of results to the comprehensive program impact Clarifies project/program mechanics and factors relationships that suggest ways and means of objectively measuring the achievement of desired ends

17 Strategic Framework Reduced level of Employment-related Discrimination against persons living with or affected by HIV/AIDS Population Level Increased knowledge of HIV/AIDS workplace policy or guidelines Reduced Stigma against people living with HIV/AIDS Improved HIV/AIDS workplace policy or guidelines Increased capacity of workplace to offer comprehensive HIV/AIDS policy and programmes on a sustainable basis Programme Level

18 Performance Monitoring Plan Functions of the PMP: Facilitate the collection over time of comparable data Support the management process for data collection and analysis Inform the analysis and review of data

19 Performance Monitoring Plan In order to compare our plans to performance we need data. And if we are to have data, we need a plan for acquiring them.

20 Performance Monitoring Plan In what units will we collect the data? Who has the data what source? How will we actually gather the data? How frequently? Who will do it? What will it cost?

21 Performance Monitoring Plan Immediate Objective 1 PERFORMANCE INDICATOR INDICATOR DEFINITION AND UNIT OF MEASUREMENT DATA SOURCE METHOD/ APPROACH OF DATA COLLECTION OR CALCULATION DATA ACQUISITION SCHEDULE/ FREQUENCY RESPONSIBLE PERSON(S) & TEAM ANALYSIS, USE & REPORTING SCHEDULE BY MANAGEMENT EVENT RESPONSIBLE PERSON(S) & TEAM Immediate Objective 1: Increased business sector activity in target areas Areas may include regions, communities, groups, administrative units, associations, organizations, enterprises, countries, or special populations. 1. Number and percent of existing firms that expandbusiness es over the past year Definition: Firms included are those receiving training and/or seed funds directly under LED or QS programs and those vendors/suppliers who are indirectly involved in LED, LMAC/RR or EC. Business expansion is self reported using a survey that asks Y/N if expansion has occurred. Disaggregated by LED, LMAC/RR and EC, based on direct and indirect involvement. Unit: # of assisted firms that report business expansion; among firms assisted, # that report expansion as a % of total firms assisted. Project survey Data will be collected for each firm 1 year after seed funds are received. One year is counted after the last disbursement of funds. Data will be collected from all qualifying firms (i.e., not a sample survey). Survey will include questions about net revenues. This data may be used ultimately in this indicator in lieu of expansion question. Quarterly, to capture all results from firms whose on year postservice delivery period terminates in that period. Local specialists to administer survey to be reviewed by Regional Coordinators. Periodic management reviews (semiannual) Technical Reports (semiannual) Regional Coordinator in conjunction with Project Director COMMENTS/NOTES:

22 Performance Monitoring Plan Immediate Objective 1

23 Performance Monitoring Plan Immediate Objective 1

24 Performance Monitoring Plan PMP Process involve the full project team Improved quality of final indicators and related data Greater practicality Increased project level ownership

25 Sample Data Collection Tools Worker Survey Checklist Attributes for Quality Workplace HIV/AIDS Services Workplace Monitoring Form

26 Worker Survey This is a questionnaire for collecting data on behavioural, attitude and knowledge indicators at the population level. The questions on the survey questionnaire are reflected on the PMP under the data source column.

27 Worker Survey (extract) Q Q205 Q206 Can a person become infected by having unprotected sex with a person who is infected with HIV? Can a person become infected from a transfusion of blood and its products? Can a person become infected by sharing needles with a person infected with HIV? Yes 1 No 2 Don t Know 88 No Response 99 Yes 1 No 2 Don t Know 88 No Response 99 Yes 1 No 2 Don t Know 88 No Response 99 Q207 Can HIV positive mother infect her unborn child? Yes 1 No 2 Don t Know 88 No Response 99

28 Checklist of Quality Attributes This tool helps define quality attributes for HIV/AIDS Workplace programme components such as Workplace Condom Supply Workplace VCT Provision of Information on HIV/AIDS Services Workplace HIV/AIDS policy Etc.

29 Workplace Monitoring Form This tool is used to collect data for indicators on programme level objectives. The questions on the form are reflected on the PMP under the data source column.

30 Workplace Monitoring Form HIV/AIDS WORKPLACE EDUCATION PROJECT GENERIC WORKPLACE MONITORING FORM WORKPLACE: FOCAL POINT: Form to be filled in every three months by workplace HIV/AIDS focal point. For further detail regarding the definition of indicators below, refer to the HIV/AIDS workplace Education Project Performance Monitoring Plan (PMP) Indicator Baseline 1Qtr 2Qtr Comments Programme Level Objective: HIV/AIDS workplace policy or guidelines Q101 Does your workplace have a written HIV/AIDS policy or guidelines (Yes/No)? Q102 If so, is your workplace policy or guidelines communicated to workers through sessions organised that explain the policy or guidelines to workers? (Yes/No)?

31 Participatory Mechanisms Participatory mechanisms include Networks, Consortia, Partnerships Stakeholder meetings Steering committees Focus group interviews

32 Collecting Information Selecting instruments for data collection The types of instruments required will depend on the information you need to collect All data collection instruments should be thought of as a package of inter-related tools that help you to obtain the information needed to make good management decisions

33 Collecting Information Instructions for data collection It is advisable to prepare a short manual on how to use each instrument for data collection Your programme indicators will help guide you in developing your instruments

34 Collecting Information Instructions for data collection The manual should describe: Who should fill out the forms How often and under what circumstances How the forms should be filled out Reporting format, frequency of reports Who to report to Examples of how information is used