20220508-世界经济论坛-Unpacking_AI_Procurement_in_a_Box_Insights_from_Implementation_34页_16mb

Brazil has implemented the AI Procurement in a Box toolkit through two pilots with Metró de São Paulo and Hospital das ClÃnicas, highlighting both opportunities and challenges for its widespread adoption, especially in the Global South. Key findings include:

1. Brazil's Context: The country faces challenges like lower institutional maturity, technical capacity, and regulatory gaps compared to high-income nations, limiting AI governance's effectiveness in public procurement.

2. Customization of the Tool: Brazil adapted the toolkit to its legal framework, creating a national procurement guide and fostering a multistakeholder community to co-develop context-specific AI governance practices.

3. Pilot Insights:

   • Metró de São Paulo: Successfully used an Algorithmic Impact Assessment (AIA) in its pre-commercial procurement for predictive maintenance, addressing algorithmic bias and ethical oversight.
   • Hospital das ClÃnicas: Integrated IT systems, anonymized health data, and emphasized multidisciplinary teams to manage AI implementation in healthcare.

4. Human-in-the-Loop Challenges: Mixed human-AI oversight introduces risks of bias amplification and compensation distortion. Contestability and ongoing monitoring are recommended for mitigation.

5. Market and Governance Gap: Public procurement excels in fostering ethical AI deployment, but many public tools (e.g., in the U.S. and Brazil) are developed internally or through non-procurement channels, bypassing accountability mechanisms.

6. Way Forward: Brazil emphasizes stronger policies (like AIAs, certifications, and adaptability in RFPs) and training programs to promote widespread, unbiased AI adoption. Global South countries must invest in capacity building, open data, and infrastructure to level the playing field.

This case underscores the need for flexible procurement guidelines that balance ethical considerations with technical feasibility, ensuring transformative AI governance for equitable and responsible public sector deployment.