2017年-世界发展银行全球_Learning_the_Impact_of_Financial_Education_When_Take-Up_is_Low_ADMIN_Jun-25-203216-2018_Conflict_2页_326kb

Finance & PSD Impact: Summary of DECFP Impact Evaluations

Core Content

This document presents the findings of a study conducted by Gabriel Lara Ibarra, David McKenzie, and Claudia Ruiz Ortega, focusing on the impact of financial education programs when participation (take-up) is low. The study was implemented in collaboration with BBVA Bancomer, a Mexican bank, to evaluate the effectiveness of their financial education workshop, Adelante con tu futuro, which has been offered since 2008 and reached 1.2 million participants by 2016.

Main Findings

• Low Take-Up Rates: In the experiment, only 0.8% of the 73,654 clients assigned to the treatment group attended the workshop. Similarly, only 6.8% of the clients in the second experiment (personalized financial coaching) received the sessions.
• Impact Detection Challenges: Due to the extremely low take-up rates, the traditional experimental approach (Intent-to-Treat, ITT) failed to detect any significant impact. The LATE estimates (Local Average Treatment Effect) were not statistically significant, indicating a lack of statistical power.
• Big Data as a Solution: The researchers used a large administrative data set (660 MB) to analyze the financial behavior of clients before and after the intervention. This data allowed them to combine experimental and non-experimental methods to estimate the program's impact more accurately.
• Propensity Score Matching: To address the issue of low take-up, they applied propensity score matching to find a control group that closely resembled the treatment group in terms of financial behavior before the intervention.
• Robustness Check: Five different approaches were used to construct the non-experimental counterfactual, varying the variables used in matching and the selection of matches (e.g., common support vs. nearest neighbor). These methods confirmed the robustness of the findings.
• Positive Outcomes: The financial education interventions were found to increase the likelihood of paying more than the minimum credit card payment by 11 percentage points and reduce the likelihood of delaying payment by 3.4 percentage points. Monthly credit card spending increased by 63.7%, and the probability of owning a deposit account with BBVA Bancomer rose by 2.7 percentage points. Both interventions also increased the likelihood of clients being profitable for the bank.

Key Information

• Program: Adelante con tu futuro (financial education workshop)
• Participants: Over 100,000 credit card clients
• Data Sources: Administrative data set (660 MB) tracking monthly financial indicators for 18 months before and 6 months after the intervention
• Methods Used:
  • Experimental Method: Random assignment to treatment and control groups
  • Non-Experimental Methods:
    • Propensity score matching
    • Difference-in-differences (DiD) analysis
    • Multiple counterfactual constructions
• Take-Up Rates:
  • Workshop: 0.8%
  • Coaching: 6.8%
• Impact Estimates:
  • Workshop participants are more likely to pay more than the minimum credit card payment
  • Workshop participants are less likely to delay payment
  • Workshop participants show increased credit card spending and likelihood of owning a deposit account
  • Both interventions improve the profitability of the bank

Policy Implications

1. Benefit for Participants: Financial education programs can still provide significant benefits to those who participate, even if participation rates are low.
2. Profitability for Financial Institutions: These programs can be profitable for banks, as they lead to improved financial behaviors among participants.
3. Use of Big Data: The use of big data in impact evaluations can help overcome the limitations of low take-up rates by providing a more accurate and robust estimation of program effects.

Conclusion

The study highlights the importance of leveraging big data to assess the impact of financial education programs when participation is low. Despite the challenges posed by low take-up, the combination of experimental and non-experimental methods can yield meaningful insights into the effectiveness of such interventions. The results suggest that financial education can lead to positive behavioral changes and increased profitability for financial institutions.