2010年-世界发展银行全球_Monitoring_and_Evaluation_in_Disaster_Risk_Management_8页_665kb

EAP DRM KnowledgeNotes Summary

Core Content

This document provides an overview of the role and importance of monitoring and evaluation (M&E) in Disaster Risk Management (DRM) in the East Asia and the Pacific region. It emphasizes the need for integrating M&E into the project cycle and outlines best practices for constructing a logical framework for evaluating DRM projects. The paper also highlights the use of both ex ante and ex post M&E approaches and provides examples from recent World Bank projects to illustrate these concepts.

Main Views

• Monitoring and Evaluation (M&E) are essential for assessing the progress and impact of DRM projects.
• Ex ante M&E focuses on reducing risk before a disaster occurs, while ex post M&E evaluates the impact after a disaster has occurred.
• M&E should be integrated into the project cycle for better adaptability and effectiveness.
• A testable hypothesis is critical for designing a robust M&E system that focuses on outcomes rather than just outputs.
• Counterfactual analysis is important for establishing causality in impact evaluations, even though it can be challenging and costly in DRM contexts.

Key Information

Ex Ante DRM M&E

• Ex ante actions aim to reduce disaster risk before it occurs.
• Indicators should reflect actions taken to reduce vulnerability, such as training disaster responders or implementing mitigation plans.
• Proxy indicators are useful when direct measurement is not feasible.
• Example: Second Northern Mountains Poverty Reduction Project (NMPRP-2) in Vietnam uses a combination of quantitative and qualitative indicators to measure disaster preparedness.
• A Management Information System (MIS) is used to track progress and ensure timely reporting.
• Randomized baseline sampling and control groups are used to assess the impact of interventions.

Ex Post DRM M&E

• Ex post M&E is used to evaluate the effectiveness of recovery efforts after a disaster.
• Post Disaster Needs Assessment (PDNA) is a key tool used by governments to assess damage and determine recovery priorities.
• Example: Community-Based Settlement Rehabilitation and Reconstruction Project (CBSRRP) in Yogyakarta, Indonesia, used a mix of key outcome indicators, output indicators, and intermediate indicators to measure the success of reconstruction efforts.
• Participatory monitoring and qualitative assessments are used to understand the social impacts of disasters and recovery efforts.
• In the case of the 2004 tsunami, low-tech data collection was more effective than high-tech systems for monitoring recovery progress.

Best Practices for M&E

• Ten Steps to Build a Results-Based M&E System:

  1. Conduct a readiness assessment of participants
  2. Agree on performance outcomes
  3. Select key indicators
  4. Gather baseline data
  5. Set realistic interim targets
  6. Build a monitoring system
  7. Use evaluation information
  8. Report findings
  9. Use findings
  10. Sustain the M&E system within the organization

• Involving all stakeholders (governments, donors, beneficiaries, and implementing agencies) improves the quality and relevance of M&E.

• Sharing lessons learned is crucial for enhancing global knowledge and capacity in DRM.

• Independent Evaluation Group (IEG) and Project Appraisal Documents (PADs) are key tools used by the World Bank to assess DRM projects.

Additional Resources

• ALNAP provides tools for improving accountability and performance in humanitarian action.
• Good Enough Guide offers practical guidelines for measuring program impact in emergencies.
• XCeval is a listserv for exchanging ideas on international evaluation.
• Fritz Institute sponsors studies on humanitarian impact, helping to understand how communities become safer over time.

Conclusion

Effective M&E is vital for DRM projects to ensure they are aligned with their objectives, adaptable to changing circumstances, and able to demonstrate impact. By using a combination of quantitative and qualitative indicators, involving all stakeholders, and sharing lessons learned, DRM initiatives can be more responsive, efficient, and beneficial to the communities they serve.