2016年-世界发展银行全球_Behind_the_Mirror___A_Report_on_the_Self-Evaluation_Systems_of_the_World_Bank_Group_212页_4mb

Summary of Behind the Mirror: A Report on the Self-Evaluation Systems of the World Bank Group

Core Content

This report evaluates the self-evaluation systems of the World Bank Group (WBG), including the World Bank, IFC, and MIGA. It explores how these systems contribute to performance management, accountability, and organizational learning, while identifying areas for improvement.

The WBG has developed a range of self-evaluation tools over the past 40 years, such as:

• ICR (Implementation Completion and Results Report) for Bank lending at closing
• ISR (Implementation Status and Results Report) for Bank lending in implementation
• Country Partnership Framework Completion and Learning Reviews for country programs
• XPSR (Expanded Project Supervision Report) for IFC investments
• PCRs (Project Completion Reports) for IFC advisory projects
• PERs (Project Evaluation Reports) for MIGA guarantee projects

These systems are intended to support performance management, internal and external accountability, and learning to improve operational quality. However, the report finds that while these systems have expanded and are largely compliant, they fall short of their full potential in driving learning and innovation.

Main Findings

• Self-evaluation systems are comprehensive but limited in their learning contribution. They focus on results reporting and accountability, but do not fully support the WBG's goal of becoming a "Solutions Bank" or enhancing performance through learning.
• Knowledge from self-evaluations is underutilized. While the systems generate data, this information is not regularly mined for learning, and staff often rely on tacit knowledge rather than the written reports.
• Weak monitoring and optimistic reporting undermine accuracy. ISR and ICR ratings are not always precise due to limited project monitoring and biased reporting.
• Incentives and behaviors are key barriers. The current system prioritizes compliance and volume over quality, innovation, and learning. Staff do not view self-evaluation as a source of credible, comprehensive, and timely information.
• Impact evaluations are more valued. These are seen as technically credible, useful for learning, and contribute to development effectiveness, but are not yet fully integrated into the WBG's broader systems.
• Accountability and learning are in tension. The systems are designed to promote accountability, which limits their effectiveness in supporting learning and continuous improvement.

Key Issues and Recommendations

1. Excessive Focus on Ratings

• Issue: The current ICR rating and validation process is perceived as rigid and not supportive of innovation.
• Recommendation: Reform the ICR system and its validation to make it more flexible and aligned with innovation and course corrections. The system should better account for unintended outcomes and beneficiaries' perspectives.

2. Attention to Volume Overshadows Results

• Issue: Managerial signals prioritize business volume over results and performance, leading to a lack of strategic use of self-evaluation for learning.
• Recommendation: Strengthen rewards and leadership signals to emphasize the value of self-evaluation. Promote the use of monitoring and evaluation data for more deliberate decision-making.

3. Low Perceived Value of Knowledge from Self-Evaluation

• Issue: Self-evaluation systems are not used strategically to address knowledge gaps, and their content and format are not always aligned with learning needs.
• Recommendation: Expand voluntary evaluations that respond to learning needs, including impact and process evaluations, retrospectives, and beneficiary surveys. Improve the uptake of findings and ensure IT systems capture and make accessible this knowledge.

Main Viewpoints

• The WBG's self-evaluation systems are well-established but not fully aligned with the organization's strategic goals of learning and innovation.
• There is a need for more adaptive project management and a shift in incentives to reward quality M&E and problem-solving rather than compliance and volume.
• The role of the Independent Evaluation Group (IEG) is critical in validating and reviewing these systems, but the systems' design and use do not fully support IEG's functions.
• Impact evaluations are a promising tool for learning but require more strategic integration and support.

Key Information

• The report was prepared by the IEG, with contributions from numerous Bank Group staff, partner agencies, and external experts.
• It draws on a wide range of data, including interviews, focus groups, game-enabled workshops, and background studies.
• The evaluation team included Caroline Heider, Nicholas D. York, Marie Gaarder, Rasmus Heltberg, and others.
• The report highlights the importance of aligning self-evaluation systems with the WBG's 2013 strategy, which emphasized learning and effectiveness.
• The findings are supported by the IEG's validation process and reflect on both internal and external accountability mechanisms.

Conclusion

The report concludes that while the WBG's self-evaluation systems are robust in terms of coverage and compliance, they need to be reformed to better support learning, innovation, and performance improvement. The recommendations focus on aligning incentives, improving M&E quality, and enhancing the use of self-evaluation findings to drive organizational learning.