Anthropic 称已训练 Claude 在每次回复后对对话给出初步安全评估,并将该技术称为 self-assessment。该功能自 6 月投入使用以来,已标记出其他防护机制未能覆盖的滥用行为。Anthropic 表示,由于 Claude 已读过对话内容,自评估效率较高,且不同于针对固定危害类型的分类器,它依赖模型自身判断,会随模型改进而更准确。
We’ve trained Claude to flag potential misuse in conversations, a technique we call self-assessment. Right after it responds, Claude gives a preliminary safety assessment of the conversation.
Since we began using self-assessment in June, it has surfaced misuse that our other safeguards weren’t designed to catch.
Because Claude has already read the conversation, self-assessment is very efficient. And unlike classifiers, which target a discrete set of harms, it draws on Claude’s own judgment, so it gets more accurate as our models improve.
Read more on our new Safeguards blog:
https://safeguards.anthropic.com/2026/self-assessment/
来源:Anthropic · x.com