生产力研究所方案的评价（英）-57页_1mb

Summary of the Productivity Institute Programme Evaluation

Core Content

The Productivity Institute Programme (PIP), launched in 2019 by the Economic and Social Research Council (ESRC), is a £40m initiative aimed at addressing the UK's productivity challenges. Funded through the Strategic Priorities Fund (SPF), it consists of three main components: The Productivity Institute (TPI), Programme on Innovation and Diffusion (POID), and seven thematic investments. This report is the second phase of a formative evaluation, commissioned by the ESRC, and focuses on the process evaluation of the PIP, particularly TPI and POID, as the thematic investments were not yet funded at the time of the evaluation.

The evaluation is intended to inform the ESRC's governance, management, and future research priorities related to productivity. It is part of a multi-phase evaluation, with Phase 3 focusing on process and early impact evaluation, and Phase 4 on economic and final impact evaluation.

Main Findings

1. Complementarity of the Investments

• The PIP investments share a common goal but lack formal coordination.
• Research agendas overlap at the outcome level (e.g., "new knowledge on productivity"), but there is no clear evidence of them working together.
• The next evaluation phase will explore the impact of this lack of complementarity on the coherence of results.

2. Stakeholder Engagement

• Strong mechanisms for stakeholder engagement are in place, especially with policymakers and businesses.
• Regional Productivity Forums (RPFs) and the Productivity Commission are used to engage stakeholders, though these are still developing.
• Stakeholder input has influenced research agendas and policy development, but further efforts are needed to ensure sustained and meaningful engagement.

3. Flexibility and Adaptability

• PIP has shown good flexibility in adapting to external shocks such as Covid-19, Brexit, and the Levelling-Up agenda.
• The investments have adjusted management processes, timelines, and reallocated funds as needed.
• This flexibility reflects broader trends in the UK research system.

4. Governance of the Programme

• The governance structure is complex due to the multi-layered approval process (SPF, UKRI, and BEIS).
• Despite this complexity, the governance has been effective in supporting the timely delivery of PIP's objectives.
• ESRC and the investments have demonstrated reflexivity in refining governance structures over time.

5. Monitoring, Evaluation and Learning (MEL)

• MEL is used to drive improvements, but its contribution to investment-level learning is limited.
• TPI and POID submit quarterly reports to ESRC, which has improved from monthly reporting.
• There is potential for MEL to support more learning and strategic adaptation in the future.

6. Environmental, Social and Governance (ESG) Considerations

• There is a commendable commitment to equality, diversity and inclusion (EDI) and environmental sustainability.
• Research outputs reflect this commitment, but there is a lack of evidence on how these are addressed in the operational level of the PIP.
• Data on EDI performance are not available, and the current approach aligns with institutional policies rather than specific investment-level actions.

Key Recommendations

1. Regular Coordination Meetings: ESRC should arrange quarterly meetings between TPI and POID to improve knowledge sharing and coordination.
2. Sustained Stakeholder Engagement: Strengthen ongoing relationships with stakeholders to ensure research remains aligned with their needs.
3. Improve Stakeholder Management Coordination: Ensure consistency in engaging shared stakeholders, such as central government, to avoid duplication.
4. Enhance Use of MEL: Utilize MEL data for learning and improvement beyond accountability, and continue to refine reporting processes.
5. Capture EDI Information: Implement mechanisms to collect and track EDI data throughout the programme lifecycle.
6. Plan for Programmatic Sustainability: Begin planning for the future of the PIP, including strategies for sustainability beyond current funding.

Next Steps

• Phase 3 (April 2023 – March 2024): Process and early impact evaluation of PIP.
• Phase 4 (April 2024 – March 2026): Economic and final impact evaluation.
• The thematic investments will be integrated into the evaluation from Phase 3 onwards.

Evaluation Methods

• Document and Data Review: Analysis of monthly, quarterly, and annual reports, minutes, audit reports, and stakeholder feedback.
• Process Mapping: Visual representation of governance and operational processes.
• Key Informant Interviews: Conducted with 15 stakeholders, including researchers, regional forum representatives, and UKRI officials.
• Workshop: Facilitated discussions with key PIP stakeholders to validate findings and explore recommendations.

Limitations

• Limited Data: There is insufficient data on ESG considerations, particularly environmental sustainability and people management.
• No EDI Data: Quantitative assessment of EDI within the PIP is not possible due to lack of available data.
• Focus on Internal Stakeholders: Interviews were primarily with internal personnel, limiting the scope of stakeholder diversity in the evaluation.

Conclusion

The formative evaluation of the PIP highlights the strengths of the programme in terms of stakeholder engagement, flexibility, and governance. However, it also identifies areas for improvement, including better coordination between investments, enhanced use of MEL for learning, and more direct tracking of ESG and EDI efforts. These insights will inform future phases of the evaluation and guide the ESRC in refining its approach to productivity research and policy.