兰德-Development-of-metrics-to-measure-the-impact-of-Tommys-work_52页_3mb

报告摘要

Summary of the Development of Metrics to Measure the Impact of Tommy's Work

Core Content

This report, authored by Advait Deshpande, Susan Guthrie, Carla Cox, and Adam Bertscher, outlines the development of metrics to assess the impact of Tommy's charitable work. The goal is to support Tommy's in creating a new strategy for their charitable spending over the next four years, with a focus on measuring the effectiveness of their research, implementation, pregnancy information service, and clinics in reducing stillbirth, preterm birth, and miscarriage rates.

Tommy's is a UK-based charity established in the early 1990s, with a mission to halve the number of babies who die during pregnancy or birth by 2030. The report emphasizes the importance of updating their impact measurement framework to align with their evolving research strategy and to better engage with funders, beneficiaries, and the research community.

Main Views

The study was conducted using a mixed-methods approach, including:

A workshop with Tommy's leadership
A focused review of existing frameworks and Tommy's strategy documentation
Interviews with key stakeholders
An internal workshop

These activities were aimed at:

Developing a logic model to represent Tommy's work and its intended contributions
Creating a longlist of metrics based on international best practices
Prioritizing and mapping these metrics to Tommy's work streams
Consulting stakeholders to ensure the metrics are feasible, acceptable, and representative of Tommy's contributions
Finalizing the set of metrics and preparing a detailed report for dissemination

The report also highlights the importance of stakeholder engagement in shaping the framework and metrics, as well as the challenges in measuring impact, particularly in the context of data availability and the interrelation of outcomes such as stillbirth, preterm birth, and miscarriage.

Key Information

Tommy's Work Components

Tommy's work is divided into four main components:

Research Centres: Funded in four locations (St Thomas' Hospital, St Mary's Hospital, Edinburgh Royal Infirmary, and the National Centre for Miscarriage Research), these centres receive infrastructure and fellowship funding. They also operate associated clinics that provide treatment and serve as recruitment sources for studies.
Implementation Centre: Aims to promote the systematic uptake of research findings into routine NHS and home practices.
Pregnancy Information Service: Includes a website, a midwife-led helpline, and social media engagement. It plays a key role in disseminating findings and influencing research priorities.
Clinics: Linked to the research centres, these clinics are part of the NHS and provide care informed by the research.

Metrics Development

The report proposes a set of metrics for each of Tommy's work streams:

Research Centres and Fellowship Scheme: Metrics include research outputs, publications, collaborations, and the number of studies initiated or completed.
Implementation Centre: Metrics focus on the adoption of evidence-based practices, training provided, and the number of healthcare professionals engaged.
Pregnancy Information Service: Metrics cover reach (e.g., website visitors), change in parental behavior, and the effectiveness of information dissemination.
Clinics: Metrics include patient engagement, referrals, and clinical outcomes linked to the research.

Challenges in Impact Measurement

Data Availability: There is no unified data source across England, Wales, and Scotland for measuring ultimate outcomes like stillbirth, preterm birth, and miscarriage.
Interrelation of Outcomes: Reductions in one outcome (e.g., miscarriage) may influence others (e.g., preterm birth or stillbirth).
Underreporting of Miscarriages: Many early miscarriages are not reported to health services, making accurate measurement difficult.
Variability in Data Granularity: Data varies in detail and completeness across regions, complicating the assessment of changes in outcomes.

Data Sources

The following data sources were reviewed for impact measurement:

NHS England Maternity Statistics: Provides data on preterm birth and miscarriage.
Office of National Statistics (ONS): Offers stillbirth data for England and Wales.
NHS Scotland's Information Services Division (ISD): Provides data on preterm birth, stillbirth, and miscarriage for Scotland.
National Maternity and Perinatal Audit (NMPA): Offers insights into maternity care and outcomes.
UK-wide Obstetric Surveillance Survey (UKOSS): Tracks maternal and perinatal health outcomes.
Scottish Stillbirth and Infant Death Survey (SSBIDS): Includes causes of death and is available in non-identifiable form.

Conclusion

The report provides a comprehensive set of metrics and a logic model to help Tommy's evaluate the impact of its work. These metrics are designed to reflect both the outputs and outcomes of Tommy's various initiatives. The framework is intended to support Tommy's in demonstrating impact to funders, improving their performance reporting, and guiding future strategic decisions. However, the report also acknowledges the challenges in data collection and the need for further investigation to ensure the accuracy and reliability of impact assessments.

Structure of the Report

Chapter 1: Background and context of Tommy's mission, current strategy, and the study's objectives and design.
Chapter 2: Results, including the development of the logic model, prioritization of metrics, stakeholder consultation, and data review.
Annexes: Include additional information on logic models, challenges in impact measurement, a longlist of metrics, and details on stakeholder participants.

Final Output

The final output includes:

A detailed logic model that maps inputs, processes, outputs, and outcomes.
A set of impact indicators for each of Tommy's work streams.
A lay version of the framework for wider communication and stakeholder engagement.
A slide set/report for dissemination and use in internal and external reporting.

展开完整摘要