Skip to content
Conversational AISociety

Technology. Human experience.
The conversations in between.

News & safety / Source briefing

Safety evaluation needs more than a refusal rate

Provider evaluation guidance

13 November 2026

International · conversational safety testing

Children & adults

Practical guidance / Safety & wellbeing

Anthropic’s guidance recommends testing conversations across multiple turns, checking automated graders against human judgments and reporting uncertainty. It explains why refusing to engage is not always an appropriate response to someone in distress.

Why it matters

A practical resource for teams assessing conversational products, including the difference between testing a model and testing the system people actually use.

Read with care

Provider guidance illustrated by internal evaluations, not independent validation or clinical outcomes. Its API and claude.ai results compare different configurations; they should not be presented as a controlled before-and-after test of one safeguard.

What was checked

Primary source and publication status checked; earlier method checks and limits are described in the reading cautions. No independent replication. Checked 2026-11-15.

Latest updates → · Monthly archive →