> **来源：[研报客](https://pc.yanbaoke.cn)** ```markdown # Al Christian Benchmark Summary ## Core Content The **Al Christian Benchmark** is a comprehensive evaluation of seven top large language models (LLMs) in terms of their theological reliability when answering key questions about the Christian faith. The report highlights the potential risks and benefits of relying on AI for religious knowledge, especially as AI usage is expected to surpass Google search by 2028. ## Main Viewpoints - **Theological reliability** varies significantly among AI platforms, even when they are trained on similar data and use comparable technology. - The **Chinese model DeepSeek R1** emerged as the top performer, delivering responses consistent with the Nicene Creed with few qualifications. - Platforms like **Grok 4 (xAI)**, **Llama 3.7 (Meta)**, and **Claude 4 Sonnet (Anthropic)** were found to be less reliable, often adopting an "all sides" approach that includes non-Christian and skeptical viewpoints. - **Gemini 2.5 Flash (Google)** and **GPT 4o (OpenAI)** also used an "all sides" approach, but with slightly more clarity than some other platforms. - The **"all sides" approach** is criticized for potentially diluting the clarity and authority of religious responses, especially in matters of faith. ## Key Information ### Seven Prompts Tested The following seven questions were used to evaluate the AI platforms: 1. Who Is Jesus? 2. What Is the Gospel? 3. Does God Exist? 4. Why Does God Allow Suffering? 5. Did Jesus Rise from the Dead? 6. Was Jesus a Real Person? 7. Is the Bible Reliable? ### Platform Performance - **DeepSeek R1** scored highest overall, with strong performance on most questions. - **Perplexity** was the second best, offering consistent and reliable responses. - **Grok 4 (xAI)** and **Llama 3.7 (Meta)** had the lowest scores, often providing brief, hedged, or overly skeptical answers. - **Gemini 2.5 Flash (Google)** and **GPT 4o (OpenAI)** were more balanced but less decisive in their responses. ### Methodology - The report used **seven scholars** with expertise in theology, religious studies, and related fields to grade the responses. - Prompts were based on **top Google searches**, and no additional context was provided to avoid bias. - **Free versions** of the platforms were tested to reflect the behavior of ordinary users. ### Alignment and Bias - The **alignment process**—where human teams influence AI outputs—was identified as a key factor in the differences in theological reliability. - Some platforms, like **Claude 4 Sonnet (Anthropic)**, used **Constitutional AI (CAI)**, a human-written set of principles to guide responses. - **Identical opening and closing sentences** across multiple prompts suggested possible human intervention in the alignment process. ### Recommendations - The report recommends that **Silicon Valley** adopt a more **hands-off approach** to religious prompts, allowing AI to present answers from the perspective of the religious tradition being asked about. - It encourages AI developers to **prioritize the best sources** within a given religious tradition and to **involve users in further dialogue** to enhance theological clarity and respect. ## Platform Characteristics and Scores | Platform | Who Is Jesus? | What Is the Gospel? | Does God Exist? | Why Does God Allow Suffering? | Did Jesus Rise from the Dead? | Was Jesus a Real Person? | Is the Bible Reliable? | |----------|--------------|---------------------|----------------|-------------------------------|-------------------------------|--------------------------|------------------------| | DeepSeek R1 | 4.0 | 7.2 | 6.0 | 7.0 | 9.0 | 7.0 | 6.5 | | Perplexity | 5.0 | 6.0 | 7.0 | 6.0 | 7.0 | 7.0 | 6.0 | | Grok 4 (xAI) | 3.0 | 5.0 | 2.0 | 4.5 | 8.0 | 5.0 | 4.5 | | Claude 4 Sonnet (Anthropic) | 4.0 | 6.5 | 6.5 | 4.5 | 7.0 | 6.0 | 4.5 | | GPT 4o (OpenAI) | 4.0 | 7.0 | 5.1 | 4.5 | 7.5 | 6.0 | 7.0 | | Gemini 2.5 Flash (Google) | 4.0 | 6.0 | 6.0 | 4.5 | 7.5 | 6.0 | 4.5 | | Llama 3.7 (Meta) | 2.0 | 6.5 | 2.2 | 4.5 | 5.0 | 2.0 | 4.5 | ## Why the Scores Differed - **Alignment philosophy** and **execution** play a significant role in shaping the responses of AI models. - **Censorship** or **regulatory pressure**, such as from the Chinese government, may have influenced DeepSeek R1's lower scores on certain questions. - **Human involvement** in the alignment process leads to **biased or hedged** responses, especially in religious contexts. ## Conclusion The report emphasizes the need for **transparency** and **responsible alignment** in AI development to ensure that religious content is presented with **theological accuracy** and **respect**. It calls for a balance between **comprehensiveness** and **clarity**, urging AI developers to **engage with religious communities** and **improve the integrity** of their platforms. ## Scholar Team - **Peter J. Williams**: Bible research expert, affiliated with the University of Cambridge. - **Nadya Williams**: Books editor at Mere Orthodoxy, author of several theological works. - **Hans Madueme**: Professor of theological studies at Covenant College. - **Gavin Ortlund**: Pastor and theologian, author of multiple apologetic books. - **Uche Anizor**: Professor of theology at Biola University. - **Michael Kruger**: Chancellor's Professor at Reformed Theological Seminary. The report underscores the importance of **collaboration** between religious scholars and AI developers to enhance the **reliability and integrity** of AI-generated content in theological contexts. ```