Before any AI-generated recommendation in a designated high-risk domain (legal, medical, financial, credit, insurance, housing, employment, education, healthcare access, public benefits, legal status) reaches an affected individual, a qualified human with relevant expertise and applicable licensure must review and have authority to modify that recommendation. The reviewing person retains accountability for the final recommendation.
This analysis describes what Anthropic's agreement states, permits, or reserves. It does not constitute a legal determination about enforceability. Regulatory applicability and practical outcomes may vary by jurisdiction, enforcement context, and individual circumstances. Read our methodology
This provision establishes an affirmative operational obligation on operators and developers deploying Claude in twelve enumerated high-stakes categories, requiring documented human oversight workflows before AI output is acted upon or delivered. The clause specifies licensure requirements by reference to applicable law, meaning compliance exposure varies by jurisdiction and professional domain.
The updated policy clarifies that Anthropic's acceptable use rules apply to all users of its products and services, including API developers, cloud customers, and app users. The policy now explicitly prohibits weapons development and related activities, and introduces a Cyber Verification Program allowing researchers to apply for adjusted safeguards for authorized dual-use work. Enforcement procedures now include warnings and throttling in addition to suspension or termination. You can apply for the Cyber Verification Program or Life Sciences Verification Program if your work involves authorized dual-use or high-risk use cases covered by real-time safeguards.
View change record →⚠ The terms will apply as written, and operators who deploy AI recommendations in high-risk domains without qualified human review may be found in violation of the AUP, subject to account throttling, suspension, or termination.
Cross-platform context
See how other platforms handle High-risk AI Recommendation Human-in-the-Loop Requirement and similar clauses.
Compare across platforms →"A qualified person must meaningfully review a High-risk AI Recommendation, with the authority to change or modify it, before it is delivered as advice to an individual who might rely on it or before it is used to implement a decision. A qualified person is someone with the training or experience to evaluate the output in that field, and who holds a license where applicable law requires one for the underlying activity. The qualified person remains responsible for the accuracy and appropriateness of what is delivered or decided.Excerpt from Anthropic's API Usage Policy
1) REGULATORY LANDSCAPE: This provision engages the EU AI Act's requirements for high-risk AI systems (Annex III), including conformity assessments, human oversight mechanisms, and logging obligations, as well as GDPR Article 22 on automated decision-making.
Enforcement risk, jurisdiction flags, contract triggers, and due diligence action items.
Get the weekly coverage letter
Companies change their terms without announcing it. We capture governance documents, compare each new version with the last, and publish what changed, with the source text behind it. One email a week on what we found and what we could not reach.
This provision establishes an affirmative operational obligation on operators and developers deploying Claude in twelve enumerated high-stakes categories, requiring documented human oversight workflows before AI output is acted upon or delivered. The clause specifies licensure requirements by reference to applicable law, meaning compliance exposure varies by jurisdiction and professional domain.
No. ConductAtlas is an independent monitoring service. We are not affiliated with, endorsed by, or sponsored by Anthropic.