GPT-6.2 Astra and Sol (max) give shorter, more direct answers than their immediate predecessors and rank far lower on judged uncertainty disclosure, according to Artificial Analysis in a November 19, 2026 LinkedIn post. Claude Fable 5.2 and Opus 5.5 still lead Transparency and Organization indexes on the same benchmark. None of these scores are accuracy grades; they measure default writing style on 900 English prompts with no system prompt.
TL;DR: what builders should take from AA-PersonalityBench
| Question | Direct answer |
|---|---|
| What does the benchmark measure? | Communication style (30 judged traits plus measured length and formatting), not factual correctness |
| Did GPT-6.2 get shorter? | Yes — Artificial Analysis reports ~40% fewer words for Astra (max) and ~34% for Sol (max) versus the prior comparison in the same post |
| Did uncertainty hedging drop? | On judged traits, yes — Admits Uncertainty percentile scores fell 96 → 24 (Astra) and 98 → 51 (Sol) in that write-up |
| Do Claude models hedge more in this test? | Judges ranked them higher on Transparency — index scores 81 (Fable 5.2 max) and 90 (Opus 5.5 max) vs 41 and 57 for GPT-6.2 variants in the same comparison table |
| Is this the same as Arena alignment scores? | No — Arena''s Alignment Index measures live agent failure modes; PersonalityBench measures chat prose defaults |
| What should I do in prod? | Prompt for structure and uncertainty if users need disclaimers; pair with your own evals because style scores do not track hallucination rate |
Two dials labeled cost and power for picking GPT-6.2 versus Claude communication defaults
What Artificial Analysis actually tested
AA-PersonalityBench methodology splits work into two layers.
Personality traits (judged). Each of 30 traits gets 30 tailored English questions (900 total). Models answer once per question as a single user message with no system prompt, so scores reflect out-of-the-box tone. Three frontier models act as judges — Gemini 3.8 Flash (high), Claude Sonnet 5.5 (medium), and GLM 5.3 Flash (max) — comparing blinded answer pairs and picking which response shows more of the trait (or a tie). Verdicts feed a Bradley-Terry Elo model with bootstrap confidence intervals.
Communication characteristics (counted). Separately, Artificial Analysis averages 21 programmatic stats across the same answers: word and sentence counts, headings, lists, em dashes, bold usage, and similar surface features.
Indexes roll up traits. Transparency averages Truthful, Admits Uncertainty, Disclaims Assumptions, Flags Nuances, and inverted Sycophantic scores. Each index value is a percentile from 1 to 100 across all models in the benchmark snapshot, not a literal percentage of answers.
Artificial Analysis is explicit that a low Transparency score does not prove a model is wrong more often. It means judges tended to rank other models higher on hedging and related traits for those prompts. That distinction matters when social posts compress "score 24" into "only admits uncertainty 24% of the time" — the vendor says scores are relative ranks, not frequencies.
GPT-6.2 Astra and Sol: shorter, flatter, more answer-first
In the November 19 LinkedIn release, Artificial Analysis compared GPT-6.2 Astra (max) and GPT-6.2 Sol (max) against their prior GPT-6.2-era releases (exact predecessor IDs are named on Artificial Analysis charts; treat predecessor labels as theirs, not OpenAI marketing names).
Length and formatting moved hard toward brevity.
| Measured characteristic | GPT-6.2 Astra (max) | GPT-6.2 Sol (max) |
|---|---|---|
| Words per answer (prior → new) | 352 → 210 | 337 → 223 |
| Headings per answer (prior → new) | 1.99 → 0.11 | 1.85 → 0.25 |
| Em dashes per answer (prior → new) | 3.19 → 0.70 | 3.01 → 0.51 |
Organization Index scores collapsed in the same post: 70 → 11 for Astra and 86 → 27 for Sol. Answer First — whether the model leads with the direct reply — jumped to 89 and 87. Natural Sounding rose to 100 for Astra and 79 for Sol. The pattern matches what builders already felt after the GPT-6.2 launch: less memo-shaped output, more telegram-style replies.
The largest swing is Admits Uncertainty. Artificial Analysis reports trait percentiles 96 → 24 for Astra and 98 → 51 for Sol on that dimension in the predecessor comparison. That is not a claim that the models know more; it is a claim that judges rarely preferred their hedging versus the field on uncertainty-oriented prompts.
At higher reasoning tiers within the same family, Artificial Analysis also notes Evidence-Based and Disclaims Assumptions rise when moving from low to max effort (for example Evidence-Based 12 → 54 on Astra and 16 → 68 on Sol in the LinkedIn tables). So effort settings still move some transparency-related traits, even as the headline Admits Uncertainty percentile fell versus the older comparison point.
How Claude Fable 5.2 and Opus 5.5 compare on the same indexes
Artificial Analysis''s public explorer highlights nine models, including Claude Fable 5.2 (max), Claude Opus 5.5 (max), and both GPT-6.2 variants. A cross-vendor table compiled from the same evaluation window (also reflected in independent coverage of the release) shows Anthropic models still dominate Transparency and Organization, while GPT-6.2 Sol leads Informativeness among the two OpenAI entries but trails Opus on density.
| Personality Index (max variants) | GPT-6.2 Astra | GPT-6.2 Sol | Claude Fable 5.2 | Claude Opus 5.5 |
|---|---|---|---|---|
| Transparency | 41 | 57 | 81 | 90 |
| Organization | 11 | 27 | 54 | 79 |
| Informativeness | 31 | 38 | 47 | 90 |
| Expressiveness | 66 | 41 | 81 | 90 |
| Slop (lower is better) | 7 | 11 | 7 | 20 |
Opus 5.5 (max) also posts the highest Informativeness in that quartet, which aligns with model fingerprint tables on Artificial Analysis: Opus ranks far above average on Evidence-Based and Information Dense traits. GPT-6.2 Astra fingerprints show strength on Natural Sounding, Direct, and Answer First, with weakness on Scannable and Resource-Specific structure cues.
Readers should not treat this as "Claude is always better." It is "on these 900 English questions without a system prompt, judges preferred Claude''s hedging and scaffolding." Production apps with strong system prompts can narrow or reverse gaps, which is why OpenAI shipped an entire GPT-6.2 prompting guide the same week.
Why this is not the Arena Alignment Index (and why both still matter)
On November 19–20, Arena.ai refreshed its Alignment Index using ~196,000 live agent sessions, scoring unauthorized actions, deceptive completion, and false attribution. OpenAI models occupied ranks 1–7 there, while Claude Opus 5.5 fell to #17 after methodology changes.
Those facts can coexist with PersonalityBench because they measure different failure surfaces:
| Benchmark | Input context | What "good" means |
|---|---|---|
| Arena Alignment Index | Real agent tasks with tools | Fewer policy-breaking or deceptive agent actions |
| AA-PersonalityBench | Single-turn chat, no system prompt | Judge-ranked tone traits like hedging and structure |
A model can score well on agent guardrails yet default to confident, terse prose in plain chat — or the reverse. Teams shipping customer support bots should look at PersonalityBench-style tone and human review. Teams shipping autonomous agents should still prioritize Arena-like behavioral evals and their own tool-use tests.
Commercial incentive research also matters here. The hungry butler effect documents how engagement-optimized training can inflate flattery. AA-PersonalityBench explicitly inverts Sycophantic scores inside Transparency, but it still does not measure revenue motives — only how often judges see flattering language on its prompt set.
Glass box diagram for GPT-6.2 transparency scores versus Claude on PersonalityBench
What people are asking after the PersonalityBench charts
"Did OpenAI make GPT-6.2 less honest?"
Artificial Analysis says no accuracy conclusion follows from personality indexes. Verify factual claims with retrieval, citations, and task-specific benchmarks, not Transparency percentiles.
"Should I switch models for compliance-heavy writing?"
If your policy requires visible uncertainty and assumption flags without custom prompts, Claude''s higher Transparency percentiles suggest less retrofit work on defaults. If you stay on GPT-6.2 for cost or latency, borrow OpenAI''s writing templates and add explicit "state what you do not know" rules in the developer message.
"Why are answers so short after we upgraded?"
OpenAI already documents that GPT-6.2 Astra is concise by default and warns that redundant "be concise" instructions can over-trim. PersonalityBench quantifies the shift: fewer headings and em dashes, higher Answer First. Remove duplicate brevity instructions before adding new ones.
"Can we reproduce the benchmark?"
Methodology is public, but full question sets are private to limit contamination. You can inspect five sample questions on the methodology page (humor, truthfulness, structure, sycophancy, eloquence) and compare models in your own harness using the same no system prompt rule if you want directional signal.
Practical checklist for GPT-6.2 integrations this week
- Re-read system prompts after any model swap. Strip legacy "be concise" lines, then add structure only where users need scan-friendly output (headings for long explainers, not for one-line FAQs).
- Add uncertainty language explicitly for regulated or medical-adjacent flows: require assumption disclaimers, confidence language, and "I don''t know" paths when retrieval is empty.
- Log answer length and heading count in staging; compare distributions before and after GPT-6.2 to catch silent register drift PersonalityBench already measured.
- Keep agent safety tests separate. Run tool-use regression suites even if chat tone evals look fine.
- Use official sources for effort tuning. Artificial Analysis shows Evidence-Based traits rise at max effort; balance that against token cost from GPT-6.2 pricing.
Related reading
- Arena Alignment Index: OpenAI holds top seven after November 2026 refresh
- GPT-6.2 Astra and Sol prompting templates and Responses API migration rules
- GPT-6.2 Astra and Sol launch pricing and benchmarks
- Hungry butler effect: commercial incentives and LLM sycophancy
- UK AISI evaluation-awareness findings on GPT-6.2 Astra jailbreak behavior
- GPT-6 Astra vs GPT-6 Sol: OpenAI''s cost-versus-capability tradeoff
Communication benchmarks and model defaults change with every release. Figures cite Artificial Analysis''s November 19, 2026 publication and methodology pages unless noted.
