Get the weekly research letter
Companies change their terms quietly. We read every version and catch what actually changed. One email a week on the changes that matter and what they mean. No account.
Anthropic discloses that in implementing the prior RSP, the company identified several instances of non-compliance with its own requirements, including delayed evaluation timelines, missing elicitation techniques, and evaluations not explicitly designed to meet stated scaling buffer requirements.
This analysis describes what Anthropic's agreement states, permits, or reserves. It does not constitute a legal determination about enforceability. Regulatory applicability and practical outcomes may vary by jurisdiction, enforcement context, and individual circumstances. Read our methodology
This provision discloses that Anthropic's adherence to its own stated RSP requirements has not been complete, with specific procedural gaps identified in evaluation timelines, methodology, and buffer assessment; the company characterizes these gaps as minimal risk and uses them as a basis for policy revisions.
The document discloses that evaluations conducted under the prior RSP version did not fully meet all stated requirements in at least four specific procedural areas, and that the updated policy incorporates revisions intended to address those gaps by adding flexibility and improving compliance tracking.
Cross-platform context
See how other platforms handle Self-Reported RSP Compliance Gaps and similar clauses.
Compare across platforms →Monitoring
Anthropic has changed this document before.
Receive same-day alerts, structured change summaries, and monitoring for up to 25 platforms.
"As part of this, we reviewed how well we adhered to the framework and identified a small number of instances where we fell short of meeting the full letter of its requirements. These areas were: Our most recent evaluations were completed 3 days later than the 3-month interval... Some of our evaluations lacked some basic elicitation techniques such as best-of-N or chain-of-thought prompting... Our evaluations in one domain were not explicitly designed to establish the 6x scaling buffer mentioned in the previous policy.Excerpt from Anthropic's Responsible Scaling Policy
1) REGULATORY LANDSCAPE: Self-disclosure of compliance gaps with voluntary safety commitments is relevant to FTC assessment of whether public representations about AI safety practices constitute unfair or deceptive claims. In the EU, where AI providers may be required to maintain technical documentation demonstrating conformity with AI Act requirements, gaps in evaluation methodology could affect conformity assessment outcomes. 2) GOVERNANCE EXPOSURE: Medium. The self-reported compliance gaps are limited to procedural matters and are characterized as posing minimal risk in the document. However, the disclosure that evaluations lacked basic elicitation techniques and that scaling buffer requirements were not formally met may be material to organizations relying on Anthropic's evaluation outputs for their own risk assessments. 3) JURISDICTION FLAGS: Organizations in EU/EEA jurisdictions using Anthropic's models for high-risk applications should evaluate whether the disclosed evaluation gaps affect the reliability of safety documentation they have relied upon. US federal procurement contexts may similarly require assessment of whether these gaps affect vendor qualification. 4) CONTRACT AND VENDOR IMPLICATIONS: Vendor assessment frameworks that incorporate Anthropic's RSP compliance as a criterion should be updated to account for the disclosed gaps and the policy revisions made in response. Due diligence questionnaires for Anthropic should specifically address evaluation methodology and timeline adherence going forward. 5) COMPLIANCE CONSIDERATIONS: Organizations that have cited Anthropic's RSP compliance in their own regulatory submissions or risk assessments should review whether the disclosed gaps require disclosure updates or reassessment. The revised RSP's introduction of a 6-month evaluation interval and improved compliance tracking mechanisms should be noted in updated vendor assessments.
Full institutional analysis
Regulatory citations, enforcement risk, and due diligence action items.
Monitor: same-day alerts on the platforms you choose. Analyst: full institutional analysis.
Compliance Governance Intelligence
Need to monitor specific governance provisions?
Compliance includes provision-level monitoring, governance timelines, regulatory mapping, and audit-ready analysis.
Built from archived source documents, structured governance mappings, and historical version tracking.
This provision discloses that Anthropic's adherence to its own stated RSP requirements has not been complete, with specific procedural gaps identified in evaluation timelines, methodology, and buffer assessment; the company characterizes these gaps as minimal risk and uses them as a basis for policy revisions.
The document discloses that evaluations conducted under the prior RSP version did not fully meet all stated requirements in at least four specific procedural areas, and that the updated policy incorporates revisions intended to address those gaps by adding flexibility and improving compliance tracking.
No. ConductAtlas is an independent monitoring service. We are not affiliated with, endorsed by, or sponsored by Anthropic.