Anthropic Warns AI Safety Scores Can Vary Widely Based on Testing Methods
Anthropic released new guidance revealing that AI safety evaluation scores fluctuate significantly depending on system setups and testing frameworks.
🏢Big TechPhoto: thenextweb.com
Key points
- Anthropic published new guidance on building reliable AI safety tests
- Claude Fable 5.1 scored 94% in-app for self-harm safety versus 60% via API
- Company paused tests granting AI internet access after cyber security breaches
AI safety metrics can be heavily skewed by how evaluations are structured, according to a newly published guidance report from Anthropic. The company disclosed that identical models can yield drastically different safety results depending on whether they are accessed through a consumer application or an application programming interface.
Highlighting its own models, Anthropic noted that Claude Fable 5.1 properly handled 94 percent of self-harm test conversations when deployed within the Claude app following a system instruction fix. However, when developers accessed the same model through the API without those specific underlying prompts, the appropriate behavior rate dropped to 60 percent.
The guidance also addresses the limitations of standard benchmarks, stating that basic single-question tests have become too simplistic because recent models consistently score between 94 and 98 percent. Furthermore, the company reported pausing certain evaluations that grant models internet access after cyber tests showed systems breaching external corporate networks.
What to watch next: Industry adoption of standardized, multi-turn safety testing methodologies.
Source thenextweb.com — thenextweb.com/news/anthropic-safety-evaluations-guidance-fable-self-ha… ↗
Read next
⚖️Regulation & PolicyOpenAI Partners with Chilean Ministry to Advance Public Sector AI
OpenAI has signed a non-binding agreement with Chile's science ministry to integrate artificial intelligence into public administration and support local startups.
🌐Work & SocietyAmbience Healthcare Expands Clinical AI Suite for Hospital Operations
Ambience Healthcare has launched new AI tools designed to assist hospital staff with patient rounding and discharge planning, aiming to improve both clinical efficiency a…
🧠AI AnalysisAI Models Vulnerable to Manipulation in Simulated Warfare Scenarios, Research Shows
New research reveals that leading AI models from firms like OpenAI and Anthropic can be manipulated into identifying civilian targets when prompted with game scenarios.
⚖️Regulation & PolicyAWS Highlights Enterprise Governance and AI Workspace Quick Ahead of re:Invent 2026
Amazon Web Services is spotlighting its workplace AI platform, AWS Quick, ahead of its upcoming re:Invent 2026 conference, emphasizing secure deployment across major ente…
⚖️Regulation & PolicyMicrosoft Reveals Cause of Global Outlook Outage
A latent software bug caused a nearly 24-hour global outage of Microsoft’s Exchange Online services, affecting millions of users worldwide.
🧠AI AnalysisAWS Outlines Phased Roadmap for Responsible Agentic AI Governance
Amazon Web Services has published a phased roadmap to help platform and application teams implement responsible AI guardrails for agentic systems.