兰德-The-Welcome-Baby-Program_-An-Implementation-and-Outcomes-Evaluation_110页_1mb

Welcome Baby Program: Implementation and Outcomes Evaluation Summary

Core Content

The Welcome Baby Program is a universal home visitation initiative offered to families at birth in participating hospitals across Los Angeles County. It is designed for low- or moderate-risk families, providing a "light touch" approach with a hospital visit and up to five postpartum visits. The program is supported by First 5 LA (F5LA), which has implemented it in 14 "Best Start" communities. The evaluation conducted by the RAND Corporation in 2015 aimed to address seven key research questions about the fidelity of the program and its outcomes across different sites.

The evaluation focused on the implementation fidelity and participant outcomes, using multiple data sources including staff and client surveys, focus groups, referral documentation, and administrative data. The study period was from January 2016 to December 2017, and the findings are intended to inform ongoing monitoring and program improvement.

Main Evaluation Questions

1. To what extent are sites implementing Welcome Baby to fidelity?

   • Sites showed great variability in achieving fidelity standards.
   • 11 out of 14 fidelity domains were assessed, and no site achieved fidelity in all domains.
   • Supervisory requirements and participant perceptions were consistently met across all sites.
   • On average, sites achieved 48% of the fidelity domains.

2. Is there variability in sites' ability to reach fidelity? What factors account for this?

   • There were large differences in fidelity achievement across domains.
   • Two domains (supervisory requirements and participant perceptions) were met by all sites.
   • Three domains (staff qualifications, reflective supervision, and hospital enrollment) were met by only one site.
   • Five to eight sites met fidelity thresholds for the remaining domains.
   • Variability was also observed across specific elements within domains (e.g., by staff position and visit type).

3. How are sites maintaining community resource and referral networks? What gaps exist?

   • Referral directories varied in completeness.
   • Few sites had developed organizational infrastructure for referrals (e.g., memoranda of understanding, referral forms).
   • The program provides protocols for five referral types: domestic violence, early intervention for developmental delay, postpartum care, maternal depression, and suicide prevention.
   • Staff referred to a wide range of resources, but infrastructure for successful referrals was lacking.

4. What are participant perceptions of and experiences with the program and service providers?

   • Participants had generally positive perceptions of the program.
   • They appreciated the breastfeeding support and the flexibility of the service providers.
   • Some areas for improvement were identified, such as increasing the number of visits and providing non-paper materials.

5. What factors contribute to participants leaving the program early?

   • Family risk characteristics (e.g., high risk score, being young) were associated with higher likelihood of transitioning to RN visits and lower retention.
   • Adherence to fidelity standards (e.g., covering the curriculum) was linked to lower attrition rates.

6. To what extent do participants achieve short- and intermediate-term outcomes?

   • Welcome Baby participants had better outcomes than benchmarks in more than half of the 12 outcome areas, including positive parenting practices, higher breastfeeding rates, and safer sleep environments.
   • However, lower rates of family planning and exclusive breastfeeding were observed compared to benchmarks.

7. What are the relationships between program fidelity outcomes and participant outcomes?

   • There was little evidence of a strong relationship between fidelity and outcomes.
   • Staff qualifications, training, reflective supervision, workload, and curriculum content coverage were most likely to be associated with improved outcomes.

Key Findings

• Fidelity Domains: The program includes 14 fidelity domains, such as staff qualifications, training, supervision, and referral processes.
• Data Sources: Used a mix of qualitative (interviews, focus groups) and quantitative (surveys, administrative data) methods.
• Program Outcomes: Participants showed positive results in several areas, including breastfeeding, immunizations, and home safety.
• Program Attrition: Most attrition occurred between the hospital and RN visit, not between postpartum visits.
• Staff Performance: Staff qualifications and training were underperforming in many sites, affecting program fidelity and outcomes.
• Referral Network: Despite the availability of referral protocols, infrastructure for referrals was underdeveloped in most sites.

Recommendations

• Improve Staff Qualifications and Training: F5LA should review and refine the qualification and training requirements for staff.
• Enhance Reflective Supervision: Further examination of the frequency and quality of reflective supervision is needed, especially for hospital liaisons and RNs.
• Address Hospital Enrollment Challenges: Ensure 24/7 staff availability and consider sitespecific enrollment targets.
• Increase Service Dosage: Use continuous quality improvement to increase retention between hospital and first in-home visit.
• Develop Detailed Referral Protocols: Create standardized referral directories and memoranda of understanding with service providers to improve referral effectiveness.
• Improve Participant Retention: Focus on early engagement and support during the hospital-to-RN transition.

Limitations

• Observational Assessments: Not included due to delays in tool implementation.
• Referral Domain: Limited analysis due to data constraints in the Stronger Families Database.
• Outcome Analysis: Some outcomes were not fully captured due to data availability.

Conclusion

The Welcome Baby Program has shown positive outcomes in several key areas and is generally well-implemented across most sites. However, fidelity gaps exist, particularly in staff qualifications, training, and referral processes. The evaluation provides valuable insights for improving the program and offers recommendations for ongoing monitoring and quality improvement. The findings also contribute to the broader home visiting field, highlighting the importance of universal, lower-intensity programs in promoting family well-being.