Effective Monitoring for CDD Programs Global Lessons and Examples using ICT Janmejay Singh, SDV June 5 th, 2013
Why Monitor Results? n Measure progress in achieving goals and objectives against work plans n Provides feedback for real time decision-making n Helps us take corrective actions during implementation and improve and learn from mistakes in future n Promotes efficiency and accountability n Makes development effective builds case for more aid What gets measured gets done!
Why Monitoring for CDD is Challenging n Dispersed and Large Scale (can cover 1000s of communities): n Dispersed implementation means M&E for CDD extremely important n Flow of information into MIS system more difficult to manage n Diversity of CDD Programs: n Open menu for sub-projects means investments not predetermined and multi-sectoral - can cover combination of infrastructure, human, social and economic activities n Participant communities may be unknown beforehand n Lack of In-country Capacity to Conduct Monitoring Work: n Especially in fragile/emergency/poor situations n Government: concept, design and analytical capacity is relatively weak n Research Institutions: small number of institutions are rarely strong in full service (design, analysis and report writing) capability 3
Monitoring = Unpopular?? Source: Mansuri and Rao, 2013. Localizing Development: Does Participation Matter?
Elements of the M&E System for CDD Making the puzzle fit together!!
Elements of a Good Monitoring System Reporting and Management Information System (MIS) Including Sub-project data HR data Financial data Training data etc. Third Party Monitoring Participatory Monitoring/Social Accountability Tools Beneficiary Feedback/ Grievance Redress Mechanisms Financial reviews, audits, procurement post reviews Most projects don t have all of them and even when they do, they aren t linked to each other
ICT for Monitoring CDD programs ICT SMS, Open Cloud, Mobile tablets, Geo-tagging, Emails, Social Media Key advantages and Potential: n Collect real-time data/feedback from a large number of dispersed and remote subprojects n Decrease communication time and costs in a long run than paper-base n Mitigate errors or inaccuracy of data n Facilitate transparency of governments and service providers However n Political buy-in and behavioral change are essential providing technologies only cannot solve problems! n It may also increase inequality and exacerbate relative poverty
n Overly complex Ø Common Problem Faced & Ways to avoid them Start simple, field test first n No clarity on what forms/info needed in MIS Ø Review reporting needs carefully, consult stakeholders, start simple n Different parts of MIS don t match. Ø Undertake regular meetings to tally information and fix anomalies n Lack of proper analysis of data and reporting - garbage in, garbage out Ø need skilled project staff to be responsible for aggregating and analyzing data, providing feedback and revising reporting system over time. n No sanctions for non-reporting Ø usually sanctions are needed, e.g., withholding of disbursements
Emerging examples on Monitoring CDD projects using ICT tools Social Development
Philippines Mindanao Rural Development Program II n Subprojects are widely dispersed and limited access to remote or conflict-affected project sites n To better validate/monitor activities without having to visit the sites n As an anti-corruption tool that enables bidders, administrators and citizens to better monitor the project procurement process n Using a free platform to geo-tag, and the only equipment needed is a GPS-enabled android phone. n Before/after pictures of subproject implementation Source: World Bank Website
Social Development Western Kenya CDD Project mapping subprojects by sectors/targets Mapping Sub-projects by Sectors Bringing maps back to the communities
Sierra Leone Youth Employment Support Project n Project technical monitoring using an open source tool for collecting data using Android smartphones. n The main challenges: less on the technical side but more on the organizational and logistical side (Source: PPT, Report from the project task team)
Social Development Afghanistan Reconstruction Trust Fund Source: PPT Improving Aid Accountability, Transparency and Visibility: Third Party Monitoring of Donor funded Infrastructure Assets in Afghanistan by James K. Weeks
Social Development Integrated MIS CommunityCollect Data from Field to Cloud to Open Data collected in the field can be aggregated on a web based MIS platform The information is available and displayed immediately. Forms collected digitally through mobile devices Users can instantly generate and customize reports Allows citizens and partner CSOs to provide suggestions, feedback, address grievances
Social Development
PNPM, Indonesia - Grievance Redress Social Development
Social Development Handling Complaints Stop Corruption in this Country
Social Development Nepal Poverty Alleviation Fund - OnTrack n The website which shows the project information with a visual map, which can be downloaded and shared. n Incorporates use of local radio, phone and web platforms to solicit community input and to respond. n The website allows citizen s direct feedback by utilizing the crowd sourcing Source: PPT Innovation in Governance: Taking the Results Agenda to the Next Level by Mapping for Results Team, Innovation Labs, WBI
Integrated MIS Using Open Source Taarifa Africa Region Urban n Using Smartphone, input/record data (using Questionnaire), Photo(s) + GPS automatically captured and sent. n Once verified, Reports become immediately viewable to all on a Website Source: PPT by Gaurav Relhan (AFTUS)
Social Development Asia Knowledge and Innovation Laboratory An open collective of development oriented individuals interested in promoting and supporting existing ICT initiatives and accelerate new innovations for development. n Officially launched in July 2013 n Incubated from the PNPM Project Support Facility, AusAid and WB n Strengthen Gov. of Indonesia efforts to reduce poverty and vulnerability by promoting and supporting existing and new ICT initiatives for development and poverty reduction Source & Photo: PNPM Project Task Team
More Lessons, Examples and How-to Third Party Monitoring Participatory and Third Party Monitoring in World Bank Financed Projects: What Can Non-state Actors (NSAs) Do? Beneficiary Feedback/ GRM Feedback Matters: Designing Effective Grievance Redress Mechanisms for Bank-Financed Projects -Part 1: The Theory, Part 2: The Practice Participatory Monitoring/ SAcc Tools Social Accountability E-guide Rapid Feedback: The Role of Community Scorecards in Improving Service Delivery Procurement/ Fiduciary/ Governance A new paradigm for fiduciary support of CDD Projects (OPCS)
Thank you! Questions/Comments?