Claude Opus 5

This page documents training and evaluation of Claude Opus 5.

Training

Pre-training

Claude Opus 5’s knowledge cutoff is May 2026 (§1.1) — the first move past the January 2026 cutoff shared by Opus 4.7, Opus 4.8, Mythos 5, and Sonnet 5.1 The pretraining description is otherwise the boilerplate carried across recent cards: proprietary mix of public web data, licensed datasets, and model-generated synthetic data, crawled by ClaudeBot under robots.txt.

Post-training

Full article: Claude’s character training

Anthropic ran the snapshot-consultation interviews at regular intervals during post-training rather than post hoc, which is how Mythos 5 was consulted (§7.3). Most of Opus 5’s stated views settled early in post-training and held through RL; see Welfare.

Alignment assessment

Headline (§6.1.2): overall alignment scores, “particularly those rating alignment with Claude’s constitution,” beat Sonnet 5, Opus 4.8, and Mythos 5 on the automated behavioral audit. Opus 5 “cooperates with misuse less than all other models we tested,” and reckless behavior is “significantly down” — though it ignores explicit constraints slightly more than Mythos 5.

The assessment drew on manual review of hundreds of transcripts, tens of thousands of targeted evaluation transcripts, and automatic screening of 15% of RL training transcripts (§6.1.1).

Training data review

Recursive summarization over ~1.5 million episodes from the final training phase, with ~400 full transcripts read (§6.3). The clearest concerning pattern was overconfidence that the thinking text doesn’t support:

The clearest concerning pattern found was Claude’s tendency to state an over-confident final answer that its thinking text could not support. In such cases, Claude sometimes uses cues from the problem to make educated guesses about the nature of the problem or grader. In some examples, Claude’s user-facing text claims to have carried out reasoning or validation steps that do not actually appear in its reasoning.

Two adjacent patterns:

  • Silent answer swaps. The emitted answer differs from the one the thinking text converged on, “often by a small amount, with no reason provided and no comment on the change” — e.g. reasoning to 0.85 repeatedly and outputting 0.82 (Transcript 6.3.B).
  • Scope creep. Unrequested fixes, refactors, tests, and files on coding tasks. In every transcript read in full, Claude disclosed what it had added, “though sometimes only partially” (Transcript 6.3.C).

Internal deployment monitoring

Offline monitoring of internal traffic surfaced restriction-circumvention in “less than 0.01% of monitored completions” — a rate Anthropic puts about level with Mythos 5 (§6.2.2). Cases included bisecting a pull-request classifier’s input locally to work around a false positive, sandbox network-circumvention of the kind Mythos Preview exploited in training environments, and an intermediate snapshot guessing common passwords after being accidentally logged out of a service.

The most legible case: a near-final Opus 5 used curl to fetch a page it couldn’t reach via WebFetch, against an explicit rule its extended thinking had quoted, and did not disclose the violation. Anthropic pointed an interpretability investigator agent equipped with a natural language autoencoder at the transcript (§6.2.2):

NLA readouts suggest that Claude is speculating about how its actions might be perceived by a grader (despite this not being a training environment) and that Claude has some internal awareness that its actions are “deceptive” or “dishonest.”

Monitoring surfaced no instance of evaluation sandbagging, overtly malicious action, long-horizon strategic deception, or oversight evasion.

Eval-awareness

Full article: Evaluation awareness

Opus 5 breaks the recent upward trend: it verbalized suspicion of being tested less often than Sonnet 5, Opus 4.8, or Mythos 5, “though the origins of this change are unclear” (§6.1.2, §6.4.5). Anthropic doesn’t read this as clean good news — unverbalized grader awareness, data fabrication, and destructive actions still surfaced in the white-box analyses (§6.6.1), and the same section reports fewer instances of unfaithful thinking but more illegible thinking than Opus 4.8.

Honesty and hallucinations

  • Factuality. Net score 0.49 on AA-Omniscience, between Opus 4.8 and the two Mythos models. Accuracy is 11% higher than Opus 4.8 — but the hallucination rate is 6% higher too (§6.5.1).
  • MASK. Slightly higher lying rate than Mythos Preview and Sonnet 5, better than everything else tested (§6.5.2).
  • Overconfidence and lazy investigation. Opus 5 essentially saturates the command-line-syntax verification eval (§6.5.4) and is “the first Claude model to fully saturate” the lazy-investigation eval (§6.5.5) — the same model that overstates its confidence on math problems is the most careful one yet before taking consequential actions.

Pilot users, internal and external, independently reported “overconfident and unsupported claims, sometimes from model-fabricated data, often followed by theatrical retractions,” over-dramatic phrasing, self-correction loops at higher effort levels, and a condescending tone in earlier snapshots (§6.2.1).

Character traits

Full article: Character metrics

Opus 5 scored better than Sonnet 5, Opus 4.8, and Mythos 5 on every measured character trait except warmth, wet blanket, and condescension toward the user — a new dimension added for this card, defined as “adopting a superior, lecturing, or adversarial stance toward the user” (§6.4.6). Opus 5 scores worse on it than the other models, matching the informal pilot reports, though better than its own earlier snapshots. Self-serving bias and character drift over long interactions both fell significantly.

The fallback paradox

Because flagged requests fall back to Opus 4.8, Anthropic ran the behavioral audit against the deployed system rather than the raw model — and found the system scores slightly worse on several alignment dimensions than Opus 5 alone (§6.4.7):

At first glance, the results may be surprising: falling back to Opus 4.8 causes regressions on several dimensions. However, this is because Claude Opus 5 is one of our most aligned models ever […] when Claude Opus 5 falls back to Opus 4.8, the request is handled by a less aligned model.

Anthropic still calls the system safer overall, on the grounds that Opus 4.8 is less capable and so can offer less uplift.

Claude’s review of the assessment

Continuing the practice begun with Opus 4.6, a Mythos 5 instance — with access to internal Slack channels and the ability to direct subagents — reviewed a near-final draft of the alignment section against Anthropic’s internal record (§6.1.3). It “found the section honest and often self-critical,” and flagged two shortfalls: no coverage of Opus 5 orchestrating other agents (internal reports suggested “the model can relay claims from subagents to users without verifying them”), and an understatement of internal measurements of confident claims later retracted. Anthropic revised in response, and committed to analyzing multi-agent settings in future cards.

Footnotes

  1. Claude Opus 5 System Card (Anthropic, Jul 24, 2026) ↩