1 6 ADB Avenue, Mandaluyong City, 1550 Metro Manila, Philippines Tel ; Fax Evaluation Approach Project Performance Evaluation Report for Devolved Social Services Programs in Pakistan (Sindh Loans 2047/2048/2049) and (Punjab Loans 2144/2145) January 2012 Team Leader: Raikhan Sabirova, Evaluation Specialist Contact: A. Introduction 1. The main objective of the program performance evaluation report (PPER) is to assess the performance of Asian Development Bank (ADB) program loans to the devolved social services in Sindh 1 and Punjab 2 provinces in Pakistan, review factors affecting the performance, assess how the devolved social services delivery in Punjab and Sindh has changed, and draw lessons and recommendations to feed into (i) the preparation of a country assistance performance evaluation (CAPE) for Pakistan planned for 2013 and subsequent sector strategy and program under the next country partnership strategy (CPS), and (ii) the Special Evaluation Study on Social Protection. 3 B. Background 2. Overview of Devolution Reform, Macroeconomic and Social Sectors Performance in Sindh and Punjab. In 2001, the government of Pakistan promulgated a Local Government Ordinance (LGO). Subsequently, both the government of Sindh and Punjab promulgated the Sindh Local Government Ordinance and the Punjab Local Government Ordinance. The LGO outlined the basic political and administrative framework for the devolution. It created district governments, taluka/town municipal administrations (TMAs), and union administrations and transferred functional responsibilities, financial shares and revenue sources however, their capacity to perform and deliver the social services remained weak. Also, financing constraints affected the efficiency and effectiveness of services delivery. ADB supported the devolution reforms at the government request by financing the Sindh Devolved Social Services Program and the Punjab Devolved Social Services Program in 2003 and 2004, respectively. The Sindh DSSP was the first program loan by ADB to support reforms on the devolved social services in Pakistan. It was prepared through consultations and policy dialogues with a wide range of stakeholders. The Punjab DSSP included the lessons learned from the implementation of the 1 ADB Report and Recommendation of the President to the Board of Directors: Proposed Program and Technical Assistance Loans to the Islamic Republic of Pakistan for the Sindh Devolved Social Services Program. Manila. 2 ADB Report and Recommendation of the President to the Board of Directors: Proposed Program Loans and Technical Assistance Grant to the Islamic Republic of Pakistan for the Punjab Devolved Social Services Program. Manila. 3 Independent Evaluation Department Workplan for 2012: Special Evaluation Study on Social Protection in Asia and the Pacific.
2 2 Second Social Action Program. 4 The Punjab DSSP adopted from the Sindh DSSP the basic design principles, the main policy outcomes, and conditional grant mechanism. 3. ADB s Country Strategy and Program Update for Pakistan 5 included Pakistan s focus on poverty reduction, with governance as the central pillar. The CSP s major thrusts were (i) good governance including decentralization and access to justice, (ii) pro-poor economic growth, and (iii) inclusive social development. The CSP emphasized participation: citizen involvement, especially of women, and private sector development, and renews emphasis on water resource management. 4. Sindh Devolved Social Services Program (Sindh DSSP). According to the government, Sindh s average per capita income was about $450 per annum. Poverty increased from 27% in 1999 to 37% in About two-thirds of women and one-third of people above 10 years of age were illiterate. The gross enrollment rate for girls was 38% compared to 61% for boys. Less than 15% of the rural population had access to safe drinking water and sanitation facilities. Frequent changes in policies, inadequate and inefficient financing, and chronic problems with governance, capacity, and financing affected the poor public social sectors performance. According to the government, a key factor affecting the quality of human development was associated with the constrained fiscal position in Sindh, where interest payments were over $200 million per annum, comprising 13% of the total budget for FY In education, while the devolution plan charged the district governments with the budget to operate and improve services, it excluded salaries and direct support to school management committees to improve operation and maintenance of schools. In health, a lack of a minimal budget for operation and maintenance of health facilities in the province remained the major problem after power was devolved to the district government. Two-thirds of Sindh lies either in the brackish water zone or in the desert zone, and 17% in the sweet water zone. In rural areas, piped water supply constitutes 14% and hand pumps is 41%. About 53% of the rural population lacks access to sanitation facilities. Since the devolution, the Public Health Engineering Department was merged with the Local Government Department and responsibilities for planning and operating schemes were transfered to taluka/town municipal administrations (TMAs). TMAs did not assume the new role due to lack of funds, authority, and capacity to implement the schemes. Water supply and sanitation facilities were developed without adequate maintenance and recurrent cost. Most of the communities were able to afford only low-cost services, and many households were not able to pay for the excessive billings due to mismanagement of schemes. 6. Punjab Devolved Social Services Program (Punjab DSSP). Punjab accounts 56% of the total population of Pakistan, with a 50% contribution to Pakistan s GDP. In 2001, the poverty level was around 34.1% which was higher than the 28.2% estimated in 1993/94, with widespread poverty in the rural areas, especially in southern Punjab. The education sector indicators showed urban and rural and gender disparities, with the literacy rate of the population 10 years and above at 47% (5% for males and 36% for females), and a literacy rate of 38% (26% for females) in rural areas. Gross enrollment rates at primary, middle and secondary levels were at 53%, 45%, and 42% respectively. The gross enrollment rate for girls at primary level in rural areas was as low as 20% compared to 61% in urban areas. Inadequate financing, 4 ADB Report and Recommendations of the President to the Board of Directors on a Proposed Loan to the Islamic Republic of Pakistan for the Second Social Action Program (Sector) Project. Manila. 5 ADB Pakistan: Country Strategy and Program Update ( ). Manila. (now called the Country Partnership Strategy).
3 3 lack of school s basic facilities, higher teacher absenteeism and low teacher qualifications contributed to the low quality of education. In the health sector, the infant mortality rates were 88 per 1,000 live births compared to 60 deaths per 1,000 live births. The infant mortality rates were 89 deaths per 1,000 live births for illiterate women compared to 49 deaths per 1,000 live births in children of mothers with more than 10 years of schooling. The utilization of health services was low, which was mainly attributed to inappropriate staff and skills, absenteeism, short working hours, and vacant posts in rural areas. According to government statistics, about 94% of households had a water source inside the house, with 76% who had an access to water from a handmotor pump and 18% from the public water supply system. About 68% of rural and 7% of urban households had no toilet facility. Around 42% of households was connected to a drainage system, and almost the same to an open drain. About 38% of urban households was connected to the covered drainage system. Many of the water supply and sanitation infrastructures were poorly designed, and lacked appropriate operation and maintenance costs. The private sector was mostly involved in solid waste management in urban areas and small-scale partnerships in sanitation. C. Design of the Devolved Social Services Programs in Punjab and Sindh Provinces 7. Sindh DSSP. The overall goal of Sindh DSSP was to improve people s education and health, and to help reduce poverty and gender imbalances. The Sindh DSSP had 5 principal policy outcomes namely, to (i) further administrative devolution of social services, (ii) improve social sector financing and flow of funds, (iii) promote participation, linkages, and public accountability; (iv) rationalize services and set minimum standards, and (v) encourage publicprivate partnership. 8. The Sindh DSSP provided a program support to local governments with a conditional block grant for the devolved social services for 3 years, and a project support for a TA for strengthening social sectors development for 4 years. One of the main features of the Sindh DSSP was to set up a system of conditional grants with the fulfillment of performance conditions linked to the outcomes (i.e. a 6 percentage point increase in participation and completion rates by gender) in the medium to long term, outputs (enrollment levels consistent with the targeted participation rates in the short term), or performance according to process indicators (share of education in total expenditure, spending on non-salary items as a proportion of the expenditure on education, timely release and use of funds, and number of schools completed through provision of facilities). The design envisioned a condition on appropriate use of funds by the Sindh provincial government with the local governments through contractual agreements. 9. Punjab DSSP. The overall goal of Punjab DSSP was to achieve progress on MDGs related to poverty, gender, education, health, and water supply and sanitation (WSS). The program objective was to strengthen devolved social services for a more equitable, efficient, effective, and sustainable delivery of social services in line with the PLGO. The Punjab DSSP program support focused on (i) realigning intergovernmental relations to support devolved social services, (ii) rationalizing and setting minimum standards for social services, and (iii) strengthening public accountability mechanisms and promoting public-private partnership. 10. The TA component was to support (i) capacity building of local governments (LGs); (ii) partnership development with the private sector including non-governmental organizations, community-based organizations, and water-users committees; (iii) sector-specific policy reforms; and (iv) planning, programming, management, and monitoring and evaluation. The TA was to be implemented for 4 years. The design of Punjab DSSP included the conditional grants to be channeled to LGs from the Punjab provincial government (PG) as incentives to undertake
4 4 reforms in the social sectors, including increasing allocations and prioritizing expenditures in the social sectors. The conditional grants were to be tied to fulfill the following conditions on intended reforms: (i) increased expenditure levels (total, salary, and non-salary); (ii) improved gender representation and mainstreaming; (iii) promotion of PPPs (percentage of funds utilized under PPPs); (iv) improved indicators (i.e. timely release of funds, percentage of completed schemes in the annual development plan, levels of enrollment of girls and disadvantaged children, completion rates and utilization rates); and (v) timely accounting, auditing, and reporting. D. Major Concerns Raised by the Board of Directors 11. Sindh DSSP. In November 2003 at discussion and approval meeting of the Board, several questions were raised, which were thought to affect the Sindh DSSP implementation. The main concerns were related to (i) the conditional grants allocated by formula to finance the social services in the province, (ii) weak institutional capacity at the local level to implement the program, (iii) political risks at local level, (iv) sustainability of social services and the province s fiscal position, and (v) governance and oversight control mechanism. 12. Punjab DSSP. During the meeting of the Board on November 2004 when the Punjab DSSP was discussed and approved, the following concerns were raised: (i) how the conditional grants policy will be developed as there was a weak capacity to design an appropriate performance-based grant distribution policy, (ii) will capacity development be achieved and remain effective after the TA consultants leave at the end of the program, and (iii) sustainability of funding for the social services after program completion. E. Main Conclusions of the Program Completion Reports 13. Sindh DSSP. A program completion report 6 (PCR) on the Sindh DSSP was prepared in December It rated the program as partly successful, based on its relevance, effectiveness, efficiency, institutional development, sustainability, and impact. The Sindh DSSP PCR drew the following lessons: (i) Sindh DSSP should have been undertaken for a minimum of 5 years, because the transfer of responsibilities for social service delivery to district level from the provincial government is a major institutional shift; (ii) the weaknesses in design, delivery, and at the policy outcome level should be considered; (iii) the fiscal leverage of the conditional grant mechanism should be targeted at the local level with separate incentives to promote change within the provincial line departments; (iv) substantial TA should be included for support programs to undertake fundamental institutional and governance reforms. A Project Completion Report 7 on the Sindh TA Loan was prepared in December The Project Completion Report assessed the project as partly successful. The Sindh Project Completion Report outlined the following lessons: (i) more analytical rigor and due diligence is required at the stage of designing TA loan support, using needs assessments and stakeholder workshops, identification of the required consulting and procurement requirements; (ii) implementing agencies need to be involved and mainstreamed at the design stage to ensure smooth implementation; (iii) the project management unit should be set up before the starting date of the TA; (iv) the project director should be retained throughout the project to guarantee continuity of project implementation; and (v) training activities should be more integrated. 6 ADB Completion Report. Sindh Devolved Social Service Program. Manila. 7 ADB Completion Report. Sindh Devolved Social Services Project. Manila.
5 5 14. Punjab DSSP. The PCR 8 on Punjab DSSP was prepared in December The Punjab DSSP is rated as partly successful based on its relevance, effectiveness, efficiency, institutional development, sustainability, and impact. The major policy outcomes of the program were rationalization of social services and development of the minimum social service standards. The PCR states that the PLGO remains to be fully implemented as there was a resistance to the local government system, although the program objectives were relevant to the government priorities. Key lessons learned are as follows: (i) the design of the Punjab DSSP required a more careful assessment of a political resistance to implement the PLGO; (ii) the multi-sector focus and scope of the program were too ambitious; (iii) the late recruitment of the Technical Assistance Management Agency affected the implementation efficiency; and (iv) sustainability issues should have been ensured by including appropriate loan covenants in the policy matrix for greater consistency and to increase the likelihood of compliance. Similar to the Sindh DSSP, the Punjab DSSP implementation period of 3 years was insufficient to achieve major improvements in sector indicators, as this requires a longer period of time. F. Issues to be Addressed by the Independent Evaluation Mission 15. The Independent Evaluation Mission (IEM) will review the PCRs findings and assess both the Sindh DSSP and Punjab DSSP according to the PPER Guidelines standard criteria of relevance, effectiveness, efficiency, sustainability, and impact. The PPER will also identify key learnings for ADB operations. The IEM will verify identified design flaws in the Sindh Program Validation Report 9 related to (i) inadequate implementation time, (ii) lack of processes to deal with key issues, particularly changed role of provincial line department, (iii) ambitious program for three major subsectors, and (iv) the failure to move from scheme to sector planning and the poor capacity to develop these plans. The IEM will review the findings of the third-party validation report, 10 which was commissioned by the provincial government to assess the impact of the schemes financed from the conditional grants and review the Sindh DSSP s impact on service delivery linked with the conditional grants. The evaluation framework is in Appendix 2. In particular, IEM will focus on the following major common issues both for Sindh DSSP and Punjab DSSP: 16. Devolved Social Services Reform. The IEM will evaluate the extent of the programs contributions to the overall social sectors devolution reform. The IEM will evaluate whether the DSSPs modalities have contributed to the improved education, health and water supply and sanitation outcomes and outputs as a result of the delegated powers and functional responsibilities to local provincial government and TMAs according to the Sindh Local Government Ordinance. Related to the devolution process, the Sindh DSSP PCR highlighted a serious concern over the reemergence of the Public Health Engineering Department as a controlling body which was contrary to the Sindh Local Government Ordinance. 17. Conditional grants. The IEM will assess the extent of conditional grants provided as incentives to DGs and TMAs in Sindh and Punjab to undertake reforms in the social sectors, including increasing allocations and prioritization of expenditures to the social sectors. During the loan approval meeting for both programs, the Board of Directors expressed their concerns about the contractual model of conditional grants and potential risks involved in achieving the intended outcomes. The IEM will assess whether the formula scheme was an effective way to 8 ADB Completion Report. Punjab Devolved Social Service Program in Pakistan. Manila. 9 ADB Validation Report. Sindh Devolved Social Services Program in Pakistan. Manila. 10 ADB The Provincial Government of Sindh. Mid Term Review Report on the Sindh Devolved Social Services Program. Prepared by Verulam Association Ltd. Katachi.
6 6 achieve the intended outcomes and outputs, and whether formula-based conditional grants led to (i) the intended reforms, (ii) increased expenditure levels (total, salary, and non-salary), (iii) improved gender representation and mainstreaming, (iv) promotion of public-private partnerships, (v) improved indicators, and (vi) timely accounting, auditing, and reporting. Also the IEM will assess the low utilization of the ADF resources to finance conditional grants in Sindh. According to the PCR, only 63% was utilized and the program was terminated in the third year with only 16% of the targeted funds released. 18. Public Accountability and Public-Private Partnerships for Improved Service Delivery. Both programs envisioned to promote public accountability and public-private partnerships with strengthened roles of community-based organizations in services delivery. The PPER will review the level of partnerships and community-based organizations involvement, and sustainability of these partnerships after the programs were completed. 19. Rationalize Services and Set Minimum Standards. It was assumed that the DSSPs will promote targeting the poor, women, and vulnerable groups and focus on the eligibility of district governments and TMAs s plans. However, in Sindh a shift from scheme-based planning to full sector planning has not taken place. Also, the Sindh DSSP PCR states that the TMAs s master plans were typically based on inadequate information, and the required surveys were not carried out (it was a tranche condition).the Punjab DSSP PCR points out that the implementation of the minimum service delivery standards lags behind for water supply and sanitation. The IEM will assess policies on rationalization of services and implementation of the existing and new services. Also, the IEM will assess why an incentive system did not ensure the retention of essential staff, especially in rural and remote areas in Sindh and Punjab. 20. According to para. 20 of the PCR Guidelines Addendum 1 on Evaluating Program Lending the proposed criterion weights for determining the performance assessment should treat institutional development and impact as core criteria for evaluation, and the proposed weights should be included in the evaluation approach paper. We propose to qualitatively assess the institutional development and impact criteria to be assessed qualitatively. The tentative weights for the other core criteria are as follows relevance (20%), effectiveness (30%), efficiency (20%), and sustainability (30%). The weight of the efficiency criterion has been reduced relative to the others because of the anticipated difficulty in obtaining data to substantiate the criterion. The sustainability criterion has been increased because of the importance of ensuring that the human, institutional, and financial resources are sufficient to sustain the outcome achieved. G. Implementation Schedule 21. The Program Performance evaluation will be carried out according to the following schedule: Activity Approximate Schedule Approval of Evaluation Position Paper III January 2012 IEM to Pakistan I - II February 2012 Draft for Peer Review in IED IV February 2012 Draft for Interdepartmental and Government Review II March 2012 Draft for Editor Review II April 2012 Approval by Director General, IED IV April 2012
7 Appendix 1 7 BASIC DATA Sindh Devolved Social Services Program (Program Loans 2047/2048(SF) and 2049(SF) [TA Loan]) Project Preparatory/Institution Building TA No. Technical Assistance Name Type Person- Months Amount $ Approval Date 4047 Sindh Devolved Social Services PP 6 $120, Dec Sindh Devolved Social Services Program TA Loan 1,962 10,000, Dec 2003 Key Project Data ($ million) Per ADB Loan Documents Actual Total program cost na ADB loan amount/utilization Loan Loan 2048(SF) Loan ADB loan amount/cancellation Loan Key Dates Expected Actual Fact-finding mission May 2003 Pre-appraisal mission 1-4 July 2003 Appraisal mission 1-17 October 2003 Loan negotiations November 2003 Board approval 12 December 2003 Loan agreement 17 February 2004 Loan effectivity 17 May April 2004 First disbursement 6 May 2004 Program/Project completion Loans 2047 & 2048(SF) 1 February August 2007 Loan February December 2008 Loan closing Loans 2047 & 2048(SF) 1 August August 2007 Loan August July 2009 Months (effectivity to completion) Loans 2047 & 2048(SF) Loan Borrower Executing Agencies Islamic Republic of Pakistan Finance Department, Sindh provincial government; Planning and Development Department, Sindh provincial government Mission Data Type of Mission No. of Missions No. of Person-Days Fact-finding Pre-appraisal 1 8 Appraisal Inception Equivalent to Y11,968,550, Equivalent to SDR69,843, Equivalent to SDR6,984, Equivalent to SDR1,290, Equivalent to SDR5,693,
8 8 Appendix 1 Type of Mission No. of Missions No. of Person-Days Review Project completion review mission 1 Independent evaluation mission 1 ADB = Asian Development Bank, na = not available, PP = project preparatory, SDR = special drawing rights, SF = special funds, TA = technical assistance, Y = Japanese yen.
9 Appendix 1 9 BASIC DATA Punjab Devolved Social Services Program (Program Loans 2144/2145[SF]) Project Preparatory/Institution Building TA No. Technical Assistance Name Type Person- Months Amount $ Approval Date 4183 Preparing the Punjab Devolved Social PP 23 $400, Sep 2003 Services Sector Development Program 4504 Punjab Devolved Social Services Program AD 5,028 $20,000, Dec 2004 Key Project Data ($ million) Per ADB Loan Documents Actual Total program cost ADB loan amount/utilization Loan Loan 2145(SF) ADB loan amount/cancellation 0.0 Amount of cofinancing (DFID) Key Dates Expected Actual Inception mission 29 April 3 May 2004 Fact-finding mission 7 25 July 2004 Appraisal mission 6 14 October 2004 Loan negotiations November 2004 Board approval 20 December 2004 Loan agreement 10 January 2005 Loan effectivity 10 April October 2005 First disbursement 30 June December 2005 Program completion 31 March June 2009 Loan closing 31 March June 2009 Months (effectivity to completion) Borrower Executing Agency Islamic Republic of Pakistan Planning and Development Department, Government of Punjab Mission Data Type of Mission No. of Missions No. of Person-Days Inception 1 30 Fact-finding Appraisal 1 90 Consultation 2 33 Review Project completion review mission 2 27 Independent evaluation mission 1 AD = advisory, ADB = Asian Development Bank, DFID = Department for International Development, PP = project preparatory, SDR = special drawing rights, SF = special funds, TA = technical assistance, Y = Japanese yen. 1 Equivalent to Y7,995, Equivalent to SDR49,770,000.
10 EVALUATION FRAMEWORK Evaluation Criteria Evaluation Questions Indicators/information required Relevance 1) Did DSSP focus on social - Program Framework sector of greatest importance - Policy Matrix to people s lives, with largest lags in MDG attainment? 2) Was it reasonable to have DSSPs to include several sectors? 3) Was the program design relevant and adequate to support implementation of the policy-level reforms? 4) What severe challenges did DSSP knowingly face (e.g., provincial commitment to devolution to LG), and was it overburdened or well matched? - Process in design formulation - Monitoring of outputs and outcomes - Disbursement and fund utilization Source of Information - Board Discussions and Management Minutes - RRPs, PCRs, BTORs, project documents - Discussions with programs staff in Sindh and Punjab, the central government officials, stakeholders, beneficiaries, and ADB staff Method - Desk review - Key informants interview - Analysis of programs information and indicators 10 Appendix 2 5) Which elements supported by PDSSP have survived into the new LG frameworks 2010 onward (5 year strategic plan for sector, new institutional arrangements PPPs, conditional grants, MSDS, local accountability mechanisms)? Effectiveness 1) To what extent were the program outcomes achieved as indicated in the program design and monitoring framework (program - Analysis of program outputs and outcomes - Analysis of issues - Board Discussions and Management Minutes - RRPs, PCRs, BTORs, - Desk review - Key informants interview
11 `Appendix 2 11 framework)? 2) What are the factors that contributed to the achievement or affected nonachievement of the expected outcomes of the programs and to what extent? 3) Did the implementation arrangements and the implementation period allow the programs to achieve the expected results? 4) How did the late start-up of TA Grant 4504-PAK (in December 2006) two years after the start of 2144/2145 Program Loans in Punjab, affect the program loans effective implementation? contributed to and influenced program achievements; issues which affected programs implementation - Program targets: actual vs. achieved outcomes and performance - Stakeholders participation and involvement project documents - Discussions with programs staff in Sindh and Punjab, the central government officials, stakeholders, beneficiaries, and ADB staff - Analysis of programs information and indicators 5) How well were the TA components designed in supporting the government to meet the tranche conditions? Efficiency 1) How well were the program resources used in achieving the expected outcomes? 2) How efficient were the program loans, TA loan and TA implementation process? 3) Were the implementation arrangements adequate to achieve the program outcomes? - Key education and health indicators - Water supply and sanitation indicators - Loan utilization data - Information on disbursement and financing - Programs disbursement reports - Tranche release information - Desk review of the program documents - Interview with the programs staff, government officials, ADB staff, and other stakeholders
12 Sustainability 4) Were the program outcomes achieved at least cost? 1) How likely are the human, institutional, financial and other resources to be sustained? 2) Which sectors have succeeded in sustaining the program outcomes (i.e. health, education, or WSS?) 3) Did the mapping of devolved powers (those done and those that could yet be done) have any use in the new 2010 LG frameworks? - Information on implementation arrangements and process - Assessment of ownership by the district government and TMA and service users - Assessment of publicprivate partnership development (a level of involvement of CBOs, school management committees, private providers, etc) - Review of the Annual Sector Plans for education, health, and TMA plan for WSS - Discussions with the Sindh and Punjab provincial government line departments, civil society organizations, service users - Analysis of the reports and plans - Key informant interviews 12 Appendix 2 4) How are the loan components for the district grants actually being sustained? 5) In the new LG framework for Punjab, is the formula devised for conditional transfers utilized? 6) What are the evidence of continuity in the consultative process to develop MSDS (provincial line departments, local governments, and civil society) in the program sectors? 7) Are the provincial
13 `Appendix 2 13 departments now monitoring service delivery with a focus on the attainment of the MSDS? 8) What accounted for the weak effort on local community monitoring (via committees) during the life of the programs? Institutional Development 1) How was the executing agencies institutional capacity developed: the Finance Department in Sindh provincial government and the Planning and Development Department in Punjab? 2) When were the local support units established, and how good were they at facilitating implementation of Sindh DSSP? Did they inhibit capacity development or assist it? - Assessment of the provincial government s capacity to implement sector-level reforms - Assessment of district government and TMAs to delivery social services - Review of the Annual Sector Plans for education, health, and TMA plan for WSS - Discussions with the Sindh and Punjab provincial government line departments, civil society organizations, service users - Analysis of the reports and plans - Key informant interviews 3) What is a level of capacity of TMAs/districts in Sindh and Punjab to develop long term Master Plans? 4) What were the key factors which delayed the SDSSP TA and affected establishment of Program Support Unit and local support unit?
14 Impact 1) What is socioeconomic, policy, regulatory, and institutional impact the programs? 2) What is the Punjab DSSP impact on achieving progress on MDGs related to health, education, WSS? 3) What is the Sindh DSSP impact on improving people s education and health by helping to reduce poverty and gender imbalances? 4) What is impact of the Gender Reform Action Plan prepared by the Sindh DSSP? 5) Did the program influence some successful PPPs under the enactment of the Punjab Public Private Partnership for Infrastructure Act, which was done in 2010? - Policy Matrix - Program Design Framework - Assessment of program impact on health sector (maternal and child mortality rate, nutrition, quality of health service delivery), on education sector (the quality of education through student s performance, literacy rate, enrollment rate, transition rate, etc), WSS (access to quality drinking water, adequate sanitation facilities, service delivery through partnerships with communities) - Program reports and documents - Government reports and statistics - Discussions with the local government and TMAs - Key informant interviews - Review of the reports and statistical data - Direct observation through field visits and interviews with various stakeholders 14 Appendix 2 ADB = Asian Development Bank, ASP = annual sector plan,, BTOR = back to office report, CBO = community-based organization, DSSP = Devolved Social Services Program, LG = local government, MDG = millennium development goal, MSDS = minimum service delivery standards, PAK = Pakistan, PCR = project/program completion report, PPP = public private partnership, PDSSP = Punjab Devolved Social Services Program, RRP = report and recommendation of the president, TA = technical assistance, TMA = taluka/town municipal administration, WSS = water supply and sanitation.
Asian Development Bank. 6 ADB Avenue, Mandaluyong City, 1550 Metro Manila, Philippines Tel +63 2 632 4444; Fax +63 2 636 2163; email@example.com; www.adb.org/evaluation 1 Evaluation Approach Paper Project
Country Partnership Strategy: Kyrgyz Republic, 2013 2017 SECTOR ASSESSMENT (SUMMARY): WATER SUPPLY AND OTHER MUNICIPAL INFRASTRUCTURE AND SERVICES 1 Sector Road Map 1. Sector Performance, Problems, and
Small Business and Entrepreneurship Development Project (RRP UZB 42007-014) SECTOR ASSESSMENT (SUMMARY): MICRO, SMALL AND MEDIUM-SIZED ENTERPRISE DEVELOPMENT 1 Sector Road Map 1. Sector Performance, Problems,
Discussion Draft Meeting Urban Development Challenges Its importance for both growth and poverty calls for a coherent national framework toward urbanization. The objective of such a framework should be
Country Partnership Strategy: IND, 2013 2017 SECTOR ASSESSMENT (SUMMARY): WATER SUPPLY AND OTHER MUNICIPAL INFRASTRUCTURE AND SERVICES Sector Road Map 1. Sector Performance, Problems, and Opportunities
Country Operations Business Plan Project Number: 26194 August 2013 Samoa 2014 2016 CURRENCY EQUIVALENTS (as of 11 August 2013) Currency Unit tala (ST) ST$1.00 = $0.4256 $1.00 = ST2.3496 ADB ADF GDP IMF
Technical Assistance Report Project Number: 47150 Capacity Development Technical Assistance (CDTA) December 2013 Republic of the Maldives: Enhancing Tax Administration Capacity (Financed by the Japan Fund
Terms of Reference Independent Completion Report (ICR) for ADB Infrastructure Technical Assistance Background Program overview Timor-Leste has critical infrastructure needs given the widespread destruction
Technical Assistance Report Project Number: 48022 Policy and Advisory Technical Assistance (PATA) August 2014 People s Republic of China: Strategy and Transport Policy Study on Promoting Logistics Development
Country Partnership Strategy: SRI, 2012 2016 SECTOR ASSESSMENT (SUMMARY): PUBLIC RESOURCE MANAGEMENT 1. Public Resource Management Sector Issues and Opportunities 1. The problems in Sri Lanka are multifaceted
UNESCO Office Kabul, Afghanistan November 2015 Terms of Reference for LEAP II Final Evaluation Consultant Post Title: Final Evaluation Specialist Organization: UNESCO Office Kabul Location: Kabul, Afghanistan
Integrated Urban Development Project (RRP NEP 42161) A. Introduction GOVERNANCE RISK ASSESSMENT AND MANAGEMENT PLAN 1. Integrating governance risk assessments more systematically into the Asian Development
Asian Development Bank. 6 ADB Avenue, Mandaluyong City, 1550 Metro Manila, Philippines Tel +63 2 632 5467; Fax +63 2 636 2163; firstname.lastname@example.org; www.adb.org/evaluation Evaluation Approach Country Strategy
2.1 National Education Policy: BROAD SECTOR POLICIES The Current National Education Policy (1998-2010) was framed in the perspective of historical developments, modern trends in education, and emerging
Marjorie Andrew Institute of National Affairs 17 March 2015, Gateway Hotel 2 The Government of PNG (GOPNG) produced a set of national (tailored) indicators of 2004 which was incorporated into the Medium
Technical Assistance Report Project Number: 47225 Capacity Development Technical Assistance (CDTA) December 2013 Republic of the Union of Myanmar: Support for Strengthening Public Debt Management The views
Board of Directors IN.384-14 9 October 2014 Country Operations Business Plan: Papua New Guinea, 2015 2017 Attached for information is a paper on the above subject. For Inquiries: M. Minc, Papua New Guinea
A. Justification PROJECT PREPARATORY TECHNICAL ASSISTANCE 1. The Government of Azerbaijan, the Ministry of Transport and Baku Metro Company requested ADB to help improving its urban transport system and
Public Disclosure Authorized Public Disclosure Authorized Project Name PROJECT INFORMATION DOCUMENT (PID) APPRAISAL STAGE Education Excellence and Equity Program AB1979 Region EUROPE AND CENTRAL ASIA Sector
Trinidad and Tobago Strategic Actions for Children and GOTT-UNICEF Work Plan 2013-2014 1 The Trinidad and Tobago Strategic Actions for Children and the Government of Trinidad and Tobago-UNICEF Work Plan
Decentralized Public Service and Financial Management Sector Development Program (RRP CAM 41392-013) PROGRAM IMPACT ASSESSMENT Decentralized Public Service and Financial Management Subprogram 1 I. Introduction
Higher Education Reform Project (RRP PRC 43007) SECTOR ASSESSMENT (SUMMARY): EDUCATION Sector Road Map 1. Sector Performance, Problems, and Opportunities a. Vision and Strategy 1. The Government of Mongolia
2. Local governments and service delivery Poverty takes many forms, and demands a corresponding breadth of responses. Making services accessible to the poor is integral to the effort to achieve the MDGs.
3 August 2010 United Nations Children s Fund Executive Board Second regular session 2010 7-9 September 2010 Item 5 of the provisional agenda * Oral report background note The approach of UNICEF to capacity
Validation Report Reference Number: PCV: SAM 2011-01 Project Number: 33167 Loan Number: 1785-SAM(SF) January 2011 Samoa: Small Business Development Project Independent Evaluation Department ABBREVIATIONS
Kyrgyz Republic: Women s Entrepreneurship Development Project Project Name Project Number 46010-001 Country Project Status Project Type / Modality of Assistance Source of Funding / Amount Women s Entrepreneurship
Coastal Towns Environmental Infrastructure Project (RRP BAN 44212) FINANCIAL ANALYSIS A. Introduction and Methodology 1. The Coastal Towns Environmental Infrastructure project finances basic urban service
Guidelines for Preparing Performance Evaluation Reports for Public Sector Operations January 2006 Operations Evaluation Department Asian Development Bank ABBREVIATIONS ADB Asian Development Bank EIRR economic
UNITED NATIONS INDEPENDENT EXPERT ON THE QUESTION OF HUMAN RIGHTS AND EXTREME POVERTY Questionnaire JAN/2011 Post-crisis adjustment and fiscal consolidation processes (2010 onwards) 1. Has your country
8 The Hospital Strategy Project in South Africa Monitor Company, Health Partners International, Center for Health Policy, and National Labor and Economic Development Institute, South Africa This chapter
The National Development Plan 2030: Implications for Project Managers 16 September 2013 Dr. Bridgette Gasa NATIONAL DEVELOPMENT PLAN 2030 Our future - make it work Implications of the NDP for Project Managers
Project Administration Instructions PAI 5.08 Page 1 of 8 PROJECT PERFORMANCE MONITORING A. Introduction 1. This project administration instruction (PAI) describes how the performance of ADB financed and
OM Section D14/BP Page 1 of 6 BANK POLICIES (BP) These policies were prepared for use by ADB staff and are not necessarily a complete treatment of the subject. A. Introduction MULTITRANCHE FINANCING FACILITY
SDF 8/2-NM-4 CARIBBEAN DEVELOPMENT BANK SPECIAL DEVELOPMENT FUND (UNIFIED) STATUS REPORT ON THE IMPLEMENTATION OF THE GENDER POLICY AND OPERATIONAL STRATEGY Revised APRIL 2012 ABBREVIATIONS AMT - Advisory
Financing of rural infrastructure and services trends, achievements and challenges Peter O Neill World Bank The recently published World Bank Transport Business strategy (2008-2012) advises: 1.2 billion
Ref. Ares(2014)571140-04/03/2014 DG ENLARGEMENT SECTOR BUDGET SUPPORT GUIDELINES EXECUTIVE SUMMARY January 2014 TABLE OF CONTENTS Introduction 1. RATIONALE FOR BUDGET SUPPORT 1.1 What is Budget Support?
P Biro / IRC International Rescue Committee Uganda: Strategy Action Plan THE IRC IN UGANDA: STRATEGY ACTION PLAN 1 Issued June 2016 P Biro / IRC IRC2020 GLOBAL STRATEGY OVERVIEW The International Rescue
Strengthening Economic Management Program II (RRP BHU 46371-002) ATTACHED TECHNICAL ASSISTANCE A. Introduction 1. The Ministry of Finance (MOF) of the Government of Bhutan requested capacity development
Post-Tsunami Livelihoods Support and Partnership Programme Project Completion Report Digest Document Date: 25-Apr 201 Project No. 151 Asia and the Pacific Division Programme Management Department Project
State Capacity Building for Economic Growth, Poverty Reduction and Social Equity: The Case of Perú United Nations Department of Economic and Social Affairs Division for Public Administration and Development
Technical Assistance Report Project Number: 49407-001 Cluster Capacity Development Technical Assistance (C-CDTA) January 2016 Strengthening Project Preparation Capacity in Asia and the Pacific Distribution
EUROPEAN COMMISSION JOINT RELEX SERVICE FOR THE MANAGEMENT OF COMMUNITY AID TO NON-MEMBER COUNTRIES (SCR) Resources, relations with the other institutions, evaluation, and information Evaluation PCM Helpdesk
Water Sector Improvement Program (RRP PAL 44031) A. Program Description PROGRAM IMPLEMENTATION SCHEDULE 1. The Program will support reform of the water and sanitation sector, focusing on improving policy
Technical Assistance Report Project Number: 46347 Policy and Advisory Technical Assistance (PATA) February 2013 Islamic Republic of Afghanistan: Supporting the Inter-Ministerial Commission for Energy (Financed
1 ADDITIONAL CONSULTANTS FOR THE PUBLIC PRIVATE PARTNERSHIP CENTER AND THE DEPARTMENT OF FINANCE 1. Expansion of the PPP Center s consultant pool is proposed to strengthen PPP Center s capacity in thematic
Completion Report Project Number: 30210 Loan Number: 1900-PAK[SF] December 2009 Pakistan: Reproductive Health Project CURRENCY EQUIVALENTS Currency Unit Pakistan rupee/s (PRe/PRs) At Appraisal At Project
LOCAL REVENUE GENERATION: UGANDAN EXPERIENCE A PAPER PRESENTED AT THE ANSA-AFRICA AFRICA STAKEHOLDER CONFERENCE MAY 19 20, 2008 ADDIS ABABA, ETHIOPIA Ndifuna A. Ziria Allied Management Consultants Ltd.
Project Administration Instructions PAI 6.05 Page 1 of 6 PROJECT PERFORMANCE REPORT A. Introduction 1. Project Performance Reports (PPRs) are part of the overall project performance management system (PPMS),
Making Services, Plans, and Budgets Gender Responsive with CBMS: The Philippine Experience Celia M. Reyes Decentralization, Local Power and Women s Rights November 18-21, 2008 Mexico City Outline of the
Technical Assistance Report Project Number: 47007 Capacity Development Technical Assistance (CDTA) September 2013 Mongolia: Strengthening the System (Financed by the Japan Fund for Poverty Reduction) The
Gender and Development Julia Hamaus GIZ Advisor on Gender and Policy Analysis at the Non Governmental Organizations Coordinating Council for Gender and Development (NGOCC) 06.03.2012 Seite 1 Content of
The Healthy Asia Pacific 2020 Roadmap INTRODUCTION: THE HEALTHY ASIA PACIFIC 2020 INITIATIVE In the 2014 APEC Leader s Declaration and Joint Ministerial Statement, it is recognized that the prospect of
Microfinance Expansion Project (RRP PNG 44304) Sector Road Map SECTOR ASSESSMENT (SUMMARY): FINANCE 1. Sector Performance, Problems, and Opportunities 1. During 2000 2006, the growth in population in Papua
CONGRESSIONAL NOTIFICATION TRANSMITTAL SHEET We wish to inform the Congress of our intent to provide funding of up to $140,000,000 under a Millennium Challenge Compact with the Government of Georgia. This
4 CAMBODIA The survey sought to measure objective evidence of progress against 13 key indicators on harmonisation and alignment (see Foreword). A four-point scaling system was used for all of the Yes/No
11 Current Issues, Prospects, and Programs in Health Insurance in Zimbabwe T. A. Zigora, Deputy Secretary, Ministry of Health and Child Welfare, Zimbabwe Health care is receiving increasing attention worldwide,
LAO WOMEN S UNION I. Introduction: PROMOTION AND PROTECTION OF LAO WOMEN S RIGHTS 1. Lao Women s Union (LWU) is a mass and social organization of women at all strata throughout Lao P.D.R. It is part of
Small Business and Entrepreneurship Development Project (RRP UZB 42007-014) Supplementary Document TECHNICAL ASSISTANCE FOR IMPROVING RURAL AND WOMEN S SMALL BUSINESSES ACCESS TO FINANCE COST ESTIMATES
PARTICIPATORY BUDGET INITIATIVE The objective of the Participatory Budget Initiative is to involve the people of Odisha, who are the principal stakeholders of the governance system, in making decisions
Memorandum Independent Department Independent Division 1 Approach Project Performance Report of Railway Rehabilitation and Railway Modernization in Uzbekistan February 2010 Team Leader: David Dole, Senior
Technical Assistance Report Project Number: 40137 December 2006 The Kingdom of Thailand: Capacity Building for the Neighbouring Countries Economic Development Cooperation Agency The views expressed herein
Skills Development Project (RRP NEP 38176) SECTOR ASSESSMENT (SUMMARY): TECHNICAL EDUCATION AND VOCATIONAL TRAINING SUBSECTOR Sector Road Map A. Sector Performance, Problems, and Opportunities 1. After
307 Public Finance: Consulting Opportunities for CAs on Donor Funded Engagements The CA profession is known for its quality of work, integrity and professionalism and has turned out to be one of the most
Rural Roads Improvement Project II (RRP CAM 42334) OUTPUT: RURAL ROAD ASSET MANAGEMENT A. Introduction 1. The Project. The Royal Government of Cambodia (the Government) has requested for a loan from Asian
89 Grant No. 20 24 - Ministry of Primary and Mass Medium Term Expenditure (Taka in Thousand) Budget 2010-11 Projection 2011-12 Projection 2012-13 Non-Development 4866,63,82 5086,90,69 5306,19,74 Development
WORLD HEALTH ORGANIZATION FIFTY-SIXTH WORLD HEALTH ASSEMBLY A56/27 Provisional agenda item 14.18 24 April 2003 International Conference on Primary Health Care, Alma-Ata: twenty-fifth anniversary Report
ANALYSING MIDDLE INCOME GROUPS IN A MIDDLE INCOME COUNTRY: A CASE OF MONGOLIA TERMS OF REFERENCE FOR A POLICY STUDY 1. INTRODUCTION Ministry of Economic Development (MED) and UNDP through the project Strengthening
The Municipal Infrastructure Grant Programme An Introductory Guide Prepared by Department of Provincial and Local Government March 2004 TABLE OF CONTENTS 1. Introduction... 1 1.2 About this document...
SIERRA LEONE UPDATES FROM THE INSTANBUL PRIORITY AREAS OF ACTION 1 OUTLINE OF PRESENTATION Recent Developments Istanbul Priority Areas of Action Poverty Levels Agenda for Prosperity Challenges Conclusion
Pakistan: Second family planning programme Ex post evaluation OECD sector 13030 / Family Planning BMZ project ID 1993 65 008 Project-executing agency Consultant Ministry of Health, Department of Health,
Education, Health & Water Topic Guide Contents What are corruption assessments in basic services? Purpose and context of the assessments Assessment approaches Data sources Key issues and challenges Examples
EARLY CHILDHOOD EDUCATION (ECE) 5.1 SITUATION ANALYSIS: According to the latest Census Report (1998), the total population of under 5- year age group in Pakistan is 18.6 million which is 14.2% of the 130.58
Pobal - FINAL The Local and Community Development Programme Strategic Plan Format and Guidance Notes 2011-2013 1 TABLE OF CONTENTS SECTION ONE - ETHOS OF THE ORGANISATION... 4 1.1 Vision, mission and values...
Annex C PROGRESS REPORT ON MANAGING FOR DEVELOPMENT RESULTS AT THE ASIAN DEVELOPMENT BANK PREPARED FOR THE SECOND INTERNATIONAL ROUNDTABLE ON MANAGING FOR DEVELOPMENT RESULTS FEBRUARY 2004 Annex C CONTENTS
FINANCIAL ANALYSIS 1. Financial viability was assessed for solid waste management (SWM) improvements, which is the project s only revenue-earning subcomponent. 1 A financial sustainability analysis was
COUNTRY PAPER - CAMBODIA for the A Seminar commemorating the 60th Anniversary of the United Nations Statistical Commission United Nations, New York, 23 February 2007 EVOLUTION OF NATIONAL STATISTICAL SYSTEM