2014年-世界发展银行全球_Verification_of_Performance_in_Results-Based_Financing___The_Case_of_Community_and_Demand-Side_RBF_in_Rwanda_48页_1mb

Summary of "Verification of Performance in Results-Based Financing (RBF): The Case of Community and Demand-Side RBF in Rwanda"

Core Content

This discussion paper examines the verification mechanisms used in Rwanda's community and demand-side Results-Based Financing (RBF) interventions, focusing on the Maternal and Child Health (MCH) sector. The study is part of a broader analysis of RBF programs across multiple countries and aims to enhance understanding of verification practices and the challenges involved in their implementation.

Rwanda, a low-income country in the African Great Lakes region, was the first African nation to implement Performance-Based Financing (PBF) nationwide. The country further piloted community-level RBF schemes in 2010, which included both supply-side and demand-side interventions. The supply-side scheme involved rewarding Community Health Workers (CHWs) through cooperatives for providing selected MCH services, maintaining quality reporting, and managing their activities effectively. The demand-side scheme provided in-kind incentives to women who utilized specific MCH services at health centers.

Main Points

1. Verification Mechanisms

The verification system in Rwanda's community RBF interventions includes four types:

• Verification of service quantity: Conducted monthly by the affiliated health center and validated quarterly by a local steering committee.
• Assessment of report quality: Evaluated monthly by the health center and validated quarterly by the steering committee. It includes timeliness, completeness, and accuracy of reports.
• Assessment of cooperative management: Evaluated quarterly by the district hospital and validated by the district steering committee.
• Counter-verification: Performed by health centers, sector, or district steering committees, either systematically or purposively.

2. Key Findings

• Service quantity verification: In 2010–2012, 48% of the indicators were accurately assessed, while 24% were overestimated (average overestimation 23%) and 28% were underestimated (average underestimation 8%). Despite no significant reduction in error rates, the level of errors decreased dramatically.
• Report quality: CHW cooperatives scored between 85–94% for report timeliness and completeness, 68–79% for accuracy, and 81–89% for management quality.
• In-kind incentives: The quantity of distributed incentives could not be analyzed due to lack of recording.
• Counter-verification: 97% of patients reported by CHW cooperatives were found in the community, and a similar proportion of women receiving in-kind incentives confirmed their receipt.

3. Causes of Errors

• Recording errors: CHWs may misinterpret indicators and report patients who do not meet the criteria.
• Compilation errors: Mistakes can occur when compiling reports between different levels of the scheme.

4. Integration with Health System

The verification system is tightly integrated with the health system, as verification is conducted by the same actors who supervise the CHWs. This integration helped in maintaining a satisfactory level of fraud detection, kept costs low, and enhanced the Health Management Information System (HMIS).

5. Challenges Identified

• Decentralization and variability: The high level of decentralization led to inconsistent implementation and variable standards across districts and health centers.
• Lack of standardization: The study recommends the development of more standardized tools and procedures for documentation and evaluation.
• Incentive and sanction issues: CHWs have no real incentive to report accurately, and no sanctions for inaccurate reporting.
• Documentation gaps: The level of documentation for the demand-side scheme is low, which hindered data analysis. The authors emphasize the need for better data collection and management.

Key Information

• RBF in Rwanda: Implemented nationwide, with the health sector being a model for other countries.
• Community RBF schemes: Implemented in 2010, including supply-side and demand-side components.
• CHW cooperatives: Organized in groups of three per village, with contracts signed with the local government.
• Incentives: Financial and in-kind, with payments tied to service delivery and reporting quality.
• Verification data sources: Paper reports, national database, and counter-verification reports from the Ministry of Health.
• Study methodology: Combined qualitative interviews with key stakeholders and quantitative data analysis from selected districts.

Lessons Learned

• Integration is beneficial: Verification by the same actors who supervise the CHWs enhances accountability and reduces fraud.
• Standardization is needed: To ensure consistency and reduce variability in implementation.
• Documentation must improve: Especially for the demand-side scheme, where data recording is lacking.
• Incentives and sanctions: More structured incentives and penalties for accurate reporting are required.
• Slow progress is expected: Given the challenges in a low-income setting, improvements to the RBF schemes will need to be gradual.

Conclusion

The verification systems in Rwanda's community and demand-side RBF interventions have demonstrated effectiveness in a difficult environment. However, they face challenges such as variability in implementation, lack of standardization, and poor documentation. The study highlights the need for better data collection, more rigorous counter-verification, and improved incentive structures to ensure the success and sustainability of RBF programs in the future.