2010年-世界发展银行全球_Results_Monitoring_in_Health_Nutrition_and_Population___The_Experience_of_the_Africa_Region_20092010_58页_2mb

报告摘要

Summary of "Results Monitoring in Health, Nutrition and Population: The Experience of the Africa Region 2009/2010"

Core Content

This document is a Health, Nutrition and Population (HNP) Discussion Paper by the World Bank, focusing on the experience of results monitoring in the Africa Region during the 2009/2010 period. It was prepared by Gayle H. Martin, Benjamin Loevinsohn, and Eriko Saito, and published by the Africa Region Health Unit (AFTHE).

The report is part of the World Bank's broader Results Agenda, which emphasizes accountability for results and progress toward the Millennium Development Goals (MDGs). It aims to assess the current state of results monitoring and provide insights into how it can be improved in the context of HNP projects in Africa.

Main Objectives

To assess the challenges of results monitoring in the Africa HNP portfolio.
To provide a baseline rating of the quality of results monitoring.
To suggest improvements for results monitoring in the short to medium term.

The study combined quantitative and qualitative methods:

Quantitative: Analysis of the design, implementation, and use of results frameworks across 52 active HNP projects.
Qualitative: Surveys of task team leaders (TTLs) to understand their experiences and identify incentives and strategic actions to enhance results monitoring.

Key Findings

Design of Results Frameworks

The design of results frameworks has improved in terms of:
- Consistency of indicators with project development objectives (PDOs).
- Availability of baseline data.
- Endline targets.
However, PDOs are still highly subjective, with low agreement among reviewers.
The number of project outcome indicators has decreased over time, indicating a shift toward more focused and realistic indicators.
Intermediate outcome indicators also show a decline, but the level of consistency between PAD and ISR indicators remains moderate.

Implementation and Use

Only 17% of data collection plans were "mostly" implemented.
The number of indicators in the design is positively correlated with the implementation of data collection plans.
Implementation Status and Results (ISR) reports rarely include intermediate outcome indicators, despite their importance.
Baseline data for project outcomes has improved, with 63% of indicators having baseline values in FY2008–10, compared to 42% in FY2005–07.
Equity considerations in indicators remain underrepresented, with only 14% of projects including them.

Capacity and Resources

Only 25% of projects conducted assessments of results monitoring and evaluation (M&E) capacity.
80% of projects planned to support capacity building, with 66% showing partial implementation.
TTLs reported insufficient resources for M&E during supervision and implementation, and high transaction costs for trust fund-based monitoring.
Operational experience and M&E skills among staff were identified as key to improving results monitoring.

Main Recommendations

Establish a results monitoring focal point within the Africa HNP unit. This should be a part-time role assigned to a staff member with operational experience and an interest in results.
Improve the design of results frameworks by focusing on realistic, measurable indicators and baseline data.
Streamline the review process to reduce transaction costs and improve efficiency.
Introduce peer-reviewed mid-term reviews to complement the existing preparation and completion reviews.
Enhance training for TTLs, emphasizing management of M&E processes rather than technical expertise.
Promote the use of workaids, checklists, and cheat sheets to support better M&E practices.
Increase resource allocation for M&E, especially in the form of trust funds and technical support.
Improve collaboration with AFTRL and other units to ensure better support and alignment in M&E activities.

Conclusion

The study highlights that while there has been progress in results framework design, implementation and use of these frameworks remain inconsistent and inadequate. Accountability for results is still a challenge, especially in tracking outcomes among the poor. The report calls for a strategic and systematic approach to improve results monitoring, including better resource allocation, streamlined processes, and enhanced training and support.

Key Themes

Results monitoring is critical for accountability and impact measurement.
Data collection and indicator design are key components of effective results monitoring.
TTLs play a central role in designing and managing results monitoring, but face resource and capacity constraints.
Improving the quality and consistency of results monitoring requires both institutional and operational changes.