世界发展银行-Results-and-Performance-of-the-World-Bank-Group-2020---An-Independent-Evaluation_80页_12mb

Summary of "Results and Performance of the World Bank Group 2020"

Core Content

This report, prepared by the Independent Evaluation Group (IEG), evaluates the performance of the World Bank Group (WBG) in 2020, focusing on the achievement of project and program objectives through ratings and the classification of project outcomes according to their levels.

Main Points

World Bank Projects and Country Programs

• Project Outcome Ratings: In FY19, 79% of World Bank lending operations were rated MS+ (moderately satisfactory or above), a slight decrease from 81% in FY18. Over the past decade, the share of projects rated MS+ increased from 71% in FY09 to 81% in FY18, and remained stable at 79% in FY19.
• Regional Trends: The Middle East and North Africa (MENA) Region saw the largest increase in outcome ratings, reaching 93% MS+ in FY17-19. Western and Central Africa increased from 52% MS+ in FY12-14 to 71% MS+ in FY17-19.
• FCV Countries: Projects in countries affected by fragility, conflict, and violence (FCV) showed improvement, with MS+ ratings increasing from 69% in FY12-14 to 77% in FY17-19, still lagging behind non-FCV countries (81%).
• Bank Performance Ratings: The share of projects rated MS+ for Bank performance improved from 69% in FY13 to 84% in FY18 and 82% in FY19, driven by better quality at entry and quality of supervision.
• M&E Quality: The percentage of projects with substantial or above M&E quality ratings increased from 31% in FY09 to 51% in FY19.

IFC Investment and Advisory Projects

• Investment Project Ratings: In CY18, 43% of IFC investment projects were rated MS+, down from a peak of 75% in CY08, but up from 40% in CY17.
• Development Effectiveness: Development effectiveness ratings for IFC advisory services improved in FY17-19, with 50% of projects rated MS+, after declining from 65% in FY12-14 to 38% in FY15-17.
• Performance Drivers: IFC's performance was affected by internal quality issues, external risks, and broader market trends. Projects with strong sponsors and better preparedness for risks had higher ratings.

MIGA Projects

• Development Outcome Ratings: MIGA project ratings improved over time, increasing from 64% S+ (satisfactory or better) in FY07-12 to 69% S+ in FY13-18 based on the number of projects, and from 61% to 75% S+ based on gross issuance amounts.
• IDA Countries: MIGA projects in IDA countries had higher ratings (77% S+) compared to non-IDA countries (63% S+) in FY13-18. MIGA's role in promoting private sector investment through risk mitigation was noted.

Key Information

Outcome Levels Classification

The report introduces a classification framework for outcome levels based on a theory of change:

1. Level 1 - Outputs: Activities and delivered outputs, such as knowledge products, goods, equipment, and services.
2. Level 2 - Early or Immediate Outcomes: New capacities and better access to public, private, or environmental services.
3. Level 3 - Intermediate Outcomes: Meaningful change in policy outcomes or beneficiaries' lives.
4. Level 4 - Long-Term Outcomes: Sustained long-term outcomes that arise from sustained changes in delivery, governance, or citizens' well-being.

Performance and Outcome Relationships

• The relationship between outcome levels and performance ratings is only modest and becomes insignificant when controlling for other factors.
• Projects with higher-level objectives (Level 3 and 4) often achieve good IEG ratings, but not all projects should aim for these levels.
• The report suggests that there is no systematic trade-off between outcome levels and ratings, and that a balance between realism and ambition is necessary.

Implications and Recommendations

• The Bank Group needs to improve how its incentives and results measurement systems support outcome orientation.
• There is a need to rethink the approach to collecting outcome evidence beyond ratings, focusing more on contribution than attribution.
• The report highlights the importance of strengthening results frameworks and monitoring systems to better capture the impact of the Bank Group's interventions.

Conclusion

The report concludes that while the World Bank Group has shown improvement in project and program performance, there is still limited evidence of higher-level outcomes. It recommends a shift in focus from ratings-based accountability to a more comprehensive understanding of how different projects and engagements contribute to country-level outcomes over time. This shift is essential for enhancing the Bank Group's outcome orientation and adapting to challenges such as the impact of the coronavirus pandemic.