Overview of monitoring and evaluation

Transcription

1 540 Toolkt to Combat Traffckng n Persons Tool 10.1 Overvew of montorng and evaluaton Overvew Ths tool brefly descrbes both montorng and evaluaton, and the dstncton between the two. What s montorng? Montorng s a contnung functon that uses systematc collecton of data on specfc ndcators to provde the management and the man stakeholders of an ongong nterventon wth ndcatons of the extent of achevement of objectves and progress n the use of allocated funds. Indcators An ndcator s a quanttatve or qualtatve varable that allows changes produced by an nterventon relatve to what was planned to be measured. It provdes a reasonably smple and relable bass for assessng achevement, change or performance. An ndcator s preferably numercal and can be measured over tme to show changes. Indcators, whch are determned durng the plannng phase of a project, usually have the followng components: 1. What s to be measured? (What s gong to change? E.g., partcpants reportng hgher school attendance of grls n a vllage) 2. Unt of measurement to be used (to descrbe the change, e.g., percentage) 3. Pre-programme status (sometmes called the baselne, e.g., 40 per cent n 2007) 4. Sze, magntude or dmenson of ntended change (e.g., 75 per cent n 2008) 5. Qualty or standard of the change to be acheved (e.g., mprovement such that grls obtan hgher grades) 6. Target populatons(s) (e.g., grls vulnerable to traffckng from vllages n southern dstrct) 7. Tme frame (e.g., January 2008 to January 2009)

2 chapter 10 Montorng and evaluaton 541 What s evaluaton? Evaluaton s the systematc and objectve assessment of ongong and/or completed projects, programmes or polces, n respect of ther: Desgn Implementaton Results The crtera appled n the evaluaton are: Objectves Effcency Effectveness Impact Sustanablty Evaluaton emphaszes the assessment of outcomes and mpact rather than the delvery of outputs. See the Evaluaton Qualty Standards avalable at: 1_1,00.html Norms for evaluaton Unted Natons Evaluaton Group In Aprl 2005, the Unted Natons Evaluaton Group ssued norms and standards wth a vew to the harmonzaton of evaluaton n the Unted Natons system. The Unted Natons Evaluaton Group norms seek to facltate system-wde collaboraton on evaluaton, by ensurng that evaluaton wthn the Unted Natons system abdes by agreed-upon basc prncples: Intentonalty (ntent to use evaluaton fndngs) Impartalty Independence Evaluablty Qualty Competence

3 542 Toolkt to Combat Traffckng n Persons Transparency and consultaton Evaluaton ethcs Follow-up Contrbuton to knowledge buldng The Unted Natons Evaluaton Group norms and standards are avalable n Chnese, Englsh, French, Russan and Spansh at: Dstngushng between montorng and evaluaton Montorng Evaluaton Tmng Montorng s a contnung Evaluaton assesses the functon that takes place entre project cycle. throughout the mplementaton of a project/programme. Depth and Montorng s a regular part Evaluaton revews the purpose of project or programme achevements of the project/ management. It focuses on programme and consders the mplementaton of the whether the plan was the project, comparng what s best one to acheve the delvered wth what was outcomes. planned. Evaluaton measures achevements, as well as postve/ negatve and ntended/ unntended effects. Evaluaton looks for lessons to be learned from both success and lack of success, and also looks for best practces whch can be appled elsewhere. Who conducts t Montorng s usually done Evaluaton s best conducted by people drectly nvolved by an ndependent outsder n mplementng the project/ who can be mpartal n programme. consultng wth project/ programme staff. Relatonshp between montorng and evaluaton Data collected and nsghts ganed n the course of montorng are then fed nto and used by the evaluaton process.

4 chapter 10 Montorng and evaluaton 543 Recommended resources There are varous organzatons and resources dedcated to the harmonzaton and mprovement of montorng and evaluaton. Many of these may offer lessons wth respect to the montorng and evaluaton of ant-traffckng programmes. The followng s just a small selecton of the resources avalable. How to Buld M&E Systems to Support Better Government Keth Mackay, World Bank Independent Evaluaton Group, 2007 A resource desgned partcularly for Governments n developng countres seekng to strengthen ther montorng and evaluaton systems, ths publcaton ncludes promsng montorng and evaluaton system practce, as well as dagnostc gudes, examples of evaluatons and other tools for strengthenng the montorng and evaluaton systems of Governments. The efforts to buld montorng and evaluaton systems of Chle, Colomba and Australa, n partcular, are consdered, and Afrca s gven attenton as a specal case. The report can be downloaded n Englsh at: Montorng and Evaluaton: Some Tools, Methods and Approaches World Bank Independent Evaluaton Group, 2004 Ths booklet provdes an overvew of montorng and evaluaton tools, methods and approaches, ncludng data collecton methods, analytcal frameworks and types of evaluaton and revew. The purpose, use, advantages and dsadvantages, costs, skll requrements, tme requrements and key references are provded for: Performance ndcators The logcal framework approach Theory-based evaluaton Formal surveys Rapd apprasal methods Partcpatory methods Publc expendture trackng surveys Impact evaluaton Cost-beneft and cost-effectveness analyss The booklet s avalable n Arabc, Englsh, French, Portuguese, Russan and Spansh, at:

5 544 Toolkt to Combat Traffckng n Persons Network on Development Evaluaton of the Development Assstance Commttee The Network on Development Evaluaton s a subsdary body of the Development Assstance Commttee supported by the secretarat of the Organzaton for Economc Cooperaton and Development. Its purpose s to ncrease the effectveness of nternatonal development programmes by supportng ther ndependent evaluaton. The network offers a range of publcatons and documents (ncludng best practce, gudance documents and manuals to facltate montorng and evaluaton), as well as a glossary of key terms n evaluaton, n Chnese, Englsh, French, Italan, Japanese, Portuguese, Russan and Spansh. The glossary of terms s avalable at: 1,00.html Publcatons and documents of the Network on Development Evaluaton are avalable at: Evaluaton Cooperaton Group The Evaluaton Cooperaton Group was founded by heads of evaluaton n multlateral development banks to strengthen evaluaton, share lessons, dssemnate nformaton, harmonze performance ndcators and evaluaton methodologes, enhance collaboraton between multlateral development banks and blateral and multlateral development organzatons, and facltate the nvolvement of borrowng member States n evaluaton and buld ther evaluaton capacty. The members of the Evaluaton Cooperaton Group are the evaluaton enttes of the Afrcan Development Bank, the Asan Development Bank, the European Bank for Reconstructon and Development, the European Investment Bank, the Inter-Amercan Development Bank, the Internatonal Monetary Fund and the World Bank. The Unted Natons Evaluaton Group and the Evaluaton Network of the Development Assstance Commttee of the Organzaton for Economc Cooperaton and Development are observer members. More nformaton about the Evaluaton Cooperaton Group, as well as lnks to members and resources can be found at: f43a6

6 chapter 10 Montorng and evaluaton 545 Unted Natons Evaluaton Group The Unted Natons Evaluaton Group has ssued Norms and Standards (see above) that provde a reference for strengthenng, professonalzng and mprovng the qualty of evaluaton n the Unted Natons system. These norms reflect respect for rghts, nternatonal values and prncples, unversalty and neutralty, and nternatonal cooperaton. The Unted Natons Evaluaton Group Norms and Standards are avalable n Chnese, Englsh, French, Russan and Spansh at: Other recommended resources Government of Australa, Australan Agency for Internatonal Develop ment, AusGudelne 3.3 The Logcal Framework Approach (2005), European Commsson Humantaran Ad Department, Ad Delvery Methods, vol. 1, Project Cycle Management Gudelnes (2004), manuals-tools/t101_en.htm Search for Common Ground, Desgnng for Results: Integratng Montorng and Evaluaton n Conflct Transformaton Programs (2006), Swedsh Internatonal Development Cooperaton Agency (Sda): USAID: