explainx.ai0k
TrendingAI News TodayPathwaysSkills
Pricing
explainx.ai

Upskill in AI — 16 free pathways, live workshops & bootcamps, and 50+ courses from practitioners. Plus the skills, tools, and MCP servers to practice on.

follow us

follow on google

Add explainx.ai as a preferred source

corporate training

support@explainx.ai

get started

Find your pathTake Free Evaluation

community

Join the community

learn

mind: share how you thinkpathways — start freeworkshopsbootcampscoursescompare Explainxcertificationsmock testsexplainx universitycorporate traininglearn skills & mcp

discover

skillsmcp serversexplainx mcptoolsmdx readeragentsllmsdesignsdictionarypeopleagi trackerfelony benchranks

company

aboutvisionmissionteaminstructorsteach on explainxpartnershipscommunityhackathonscareers

content

daily AI newsstate of AI — live resultsblogreleasespromptsgeneratorsresource libraryfor LLMsexplainx.ai kids

solutions

all solutionsdeveloper upskillingmarketing upskillingproduct manager upskillingleadership upskilling

newsletter · weekly

Get AI news, tools, and insights in your inbox.

supportcontactprivacytermsdata rightshow we create contentsubmission guidelines

© 2026 AISOLO Technologies Pvt Ltd

explainx.ai

On this page

  • TL;DR
  • What is in Intelligence Index v5?
  • The v5 leaderboard
  • What does it cost per task?
  • Why did open-weight models fall behind?
  • The benchmarker's dilemma
  • What this means for what you build or pay
  • Honest limitations
  • Related reading
← Back to blog

explainx / blog

Artificial Analysis Intelligence Index v5: Opus 5.5 Leads at 58, Open Weights Fall 12 Points Back

Artificial Analysis, Intelligence Index, Benchmarks, Claude Opus 5.5, Open Weights, AI Evaluation

Part of AI Benchmarks and Evals

Artificial Analysis Intelligence Index v5 is out: Claude Opus 5.5 leads at 58, 60% of the score is private, and the open-weight gap widens from 3 to 12 points.

Oct 28, 2026·8 min read·Yash Thakker
add explainx.ai
go deep
Artificial Analysis Intelligence Index v5: Opus 5.5 Leads at 58, Open Weights Fall 12 Points Back

Artificial Analysis shipped Intelligence Index v5 on October 27, 2026, and the leaderboard it produces looks different from the one you may have been using. Claude Opus 5.5 (max) leads at 58, GPT-6 Astra is one point behind, and the best open-weight model now trails the leader by 12 points instead of 3. The cause is a rebuilt benchmark: nine evaluations, four equal category weights, and roughly 60% of the score drawn from private or held-out data. This is the successor to the v4.2 update we covered in September, which had promised exactly this direction.

Weekly digest3.6k readers

Catch up on AI

Curated AI updates on agents, skills, and MCP — delivered to your inbox. Unsubscribe anytime.

TL;DR

table · 2 cols
QuestionAnswer
What launched?Intelligence Index v5, October 27, 2026, per Artificial Analysis
Who leads?Claude Opus 5.5 (max) 58, GPT-6 Astra (max) 57, GPT-6.1 Sol (max) 55, Gemini 4 Argon (high) 50
What is new?FrontierCode 2.0, Terminal-Bench-Science, HLE-Diamond, upgraded AA-Omniscience and CritPt
What was dropped?GDPval-AA v2.1, SciCode, AA-LCR v1.1
How private is it?About 60% of weight uses private test sets or held-out answers
Open weights?Gap to leader widened from 3 to 12 points; best released weights score 32
Cost per task?Opus 5.5 max about $10.04, GPT-6 Astra max $6.24, GPT-6.1 Sol max $1.27

What is in Intelligence Index v5?

According to Artificial Analysis's methodology page, v5.0 averages nine evaluations in four categories, each worth 25%.

table · 3 cols
CategoryEvaluationWeight
Knowledge WorkAA-Briefcase v1.115%
Knowledge WorkAutomationBench-AA5%
Knowledge WorkGDP.pdf5%
CodingFrontierCode 2.015%
CodingTerminal-Bench 4.010%
ScienceTerminal-Bench-Science 0.115%
ScienceCritPt v2 (hard subset)10%
GeneralAA-Omniscience v1.115%
GeneralHLE-Diamond10%

Two evaluations are new. FrontierCode 2.0 is Cognition's private coding benchmark: 132 tasks, graded on whether a repository maintainer would plausibly merge the change. Terminal-Bench-Science has 70 agentic research tasks across five domains, run in a terminal. Three were upgraded: HLE-Diamond (1,000 questions, half reasoning and half knowledge) replaces Humanity's Last Exam, AA-Omniscience v1.1 removed saturated and public questions, and CritPt v2 became a private 40-question hard subset run with a code tool.

GDPval-AA v2.1, SciCode and AA-LCR v1.1 are gone from the index, though Artificial Analysis still lists them as additional or legacy evaluations. Our earlier posts on FrontierCode 1.1 and CritPt v2 give background on those two pieces.

The v5 leaderboard

A podium of ranked AI models representing the Artificial Analysis Intelligence Index v5 leaderboardA podium of ranked AI models representing the Artificial Analysis Intelligence Index v5 leaderboard

These are Artificial Analysis's own numbers, at the effort setting named in brackets.

table · 2 cols
ModelIndex v5 score
Claude Opus 5.5 (max)58
GPT-6 Astra (max)57
GPT-6.1 Sol (max)55
Gemini 4 Argon (high)50
Kimi K3.1 Pro (weights not released)46
Claude Haiku 5.5 (max)36
DeepSeek V4.1 Flash 1017 (max), open weights32
GLM-5.3 (max), open weights32

Anthropic and OpenAI occupy the top five positions. For model-by-model background, see our launch coverage of Claude Opus 5.5, GPT-6.1 Sol and Gemini 4 Argon.

No model wins everything

The headline number hides a split decision. Per Artificial Analysis, Opus 5.5 leads three of nine evaluations and five other models share the rest:

  • FrontierCode 2.0: Opus 5.5, 46%.
  • HLE-Diamond: Opus 5.5, 68%, ahead of GPT-6 Astra (64%) and Claude Fable 5.1 (60%).
  • AA-Omniscience v1.1: Opus 5.5, 48.
  • Terminal-Bench-Science: GPT-6 Astra, 63%.
  • CritPt v2 hard subset: GPT-6 Astra, 72% at high effort.
  • AA-Briefcase: Claude Sonnet 5.5, 1812 Elo.
  • Terminal-Bench 4.0: Kimi K3.1 Pro, 67%.
  • AutomationBench-AA: Gemini 4 Argon, 78%.
  • GDP.pdf: Muse Wonder Full, 33% all-pass.

That spread is why an aggregate should be a starting filter, not a purchase decision. Our guide to reading AI benchmarks walks through the same habit.

What does it cost per task?

Artificial Analysis also publishes cost per task, and here the ranking inverts. Among the ten highest-scoring models it shows, GPT-6.1 Terra (max) is cheapest at $0.96 and Claude Fable 5.1 (max) most expensive at $13.04. The three leaders:

table · 3 cols
ModelScoreCost per task
Claude Opus 5.5 (max)58$10.04
GPT-6 Astra (max)57$6.24
GPT-6.1 Sol (max)55$1.27

GPT-6.1 Sol lands within four points of Opus 5.5 at roughly one-eighth of the cost, which fits the story in our Sol versus Astra cost-efficiency post.

Effort settings matter just as much. Opus 5.5 scores 35 at low effort for $0.98 per task and 58 at max for $10.04. Claude Sonnet 5.5 now spans 29 points from low to max (up from 20 in v4.3), and GPT-6.1 Sol's spread doubled from 10 to 20 points. So "which model" is only half the question; "which effort" is the other half.

Why costs went up

Artificial Analysis reports that median output tokens per task rose from 35k in v4.3 to 59k in v5. Four agentic evaluations (Terminal-Bench-Science, Terminal-Bench 4.0, AA-Briefcase, FrontierCode 2.0) carry 55% of the weight but about 90% of output tokens, and Terminal-Bench-Science alone accounts for about a third. A heavier agentic mix makes the benchmark itself pricier to run and rewards models that think and act for longer.

Why did open-weight models fall behind?

Open-weight model distribution illustrating the widening open-weight gap on the Intelligence IndexOpen-weight model distribution illustrating the widening open-weight gap on the Intelligence Index

Artificial Analysis reports the gap between the best open-weight model and the overall leader grew from 3 points in v4.3 to 12 in v5. Kimi K3.1 Pro leads open weights at 46, but its weights were not yet released at the time of the index; among models with weights you can actually download, DeepSeek V4.1 Flash 1017 and GLM-5.3 lead at 32, which is 26 points behind. Claude Haiku 5.5 at 36 outscores every released-weight model.

Trending Topics, which covered the shift, cites Kimi K3.1 Pro falling from 55 to 46, DeepSeek V4.1 Flash from 45 to 32, and Meta's Muse Spark Open from 39 to 25. The gaps are widest on the hardest tasks: Kimi K3.1 Pro scores 37% on HLE-Diamond versus Opus 5.5's 68%, and 34% against GPT-6 Astra's 63% on Terminal-Bench-Science. Yet Kimi tops Terminal-Bench 4.0, so the picture is not uniformly bleak. For the model itself, see our Kimi K3.1 Pro open-weights coverage and the DeepSeek V4.1 Flash 1017 release.

One caution: this is a result of this particular blend. Shift weight toward coding-in-the-terminal and the open-weight picture improves, which is exactly the point critics make about composite scores.

The benchmarker's dilemma

Nathan Lambert published a same-day reaction on Interconnects titled "Artificial Analysis v5 and the benchmarker's dilemma." The full piece sits behind a paywall, so we only cite its public opening, where he separates improving scores from designing good benchmarks: in his words, "Hill-climbing is easy, knowing what to hill-climb is hard." The article is framed as a review of the benchmarking industry and what is missing from it. We are not describing the paywalled arguments.

The dilemma shows up in v5 itself. Private test sets are the main defense against contamination, the same problem behind the GSM1k and LMArena findings. But a benchmark that is 60% secret cannot be replicated by anyone outside Artificial Analysis, so readers must trust the grading, the judge models and the choice of weights. v4.2 already drew timing and transparency questions on Hacker News, and moving from 40% to about 60% private raises the same point harder.

What this means for what you build or pay

A stack of measuring rulers showing how Intelligence Index v5 weights nine evaluations differentlyA stack of measuring rulers showing how Intelligence Index v5 weights nine evaluations differently

  • Model picking: treat the top three as a tie for general use and choose on cost per task. Sol at $1.27 versus Opus at $10.04 is a very large difference for four points.
  • Effort budget: test your own workload at medium and high effort before paying for max.
  • Open weights: if you self-host, v5 says released models are meaningfully behind on hard science and agentic work, so verify on your own tasks rather than trusting a 2025-era "gap is closing" narrative. Compare with the Mozilla claim of a roughly four-month gap.
  • Version hygiene: v5 scores are not comparable to v4.x scores. Check the version label on any chart you cite.
  • Run your own eval: a small private test set of your real tasks beats any public composite.

Honest limitations

  • All scores, costs and rankings are Artificial Analysis's own figures; we did not re-run them.
  • Some third-party aggregators show different rankings (for example compiled self-reports with GPT-5.6 Sol ahead). Those are not the v5 run and should not be mixed with it.
  • Kimi K3.1 Pro's weights were unreleased at publication, so its 46 is not usable open-weight capability yet.
  • We could only read the public opening of the Interconnects piece.

Related reading

  • Artificial Analysis Intelligence Index v4.2: what actually changed
  • Claude Opus 5.5 launch: benchmarks and pricing
  • GPT-6.1 Sol launch, pricing and benchmarks
  • GPT-6.1 Sol and Astra cost efficiency
  • Kimi K3.1 Pro open weights
  • Goodhart's Law for AI benchmarks
  • How to read an AI benchmark
  • Official Artificial Analysis v5 announcement and Trending Topics coverage

Scores and weights reflect Artificial Analysis's Intelligence Index v5 as published October 27, 2026. The live index may change; check artificialanalysis.ai before deciding.

Spotted something out of date? Let us know.
Yash Thakker

Written by

Yash Thakker

Yash is an AI expert with over 300K learners. Join his workshops →

View Yash Thakker in People in AI →

Related posts

Sep 5, 2026

Artificial Analysis Intelligence Index v4.2: What Actually Changed

Artificial Analysis published Intelligence Index v4.2 on September 4, 2026, an interim update ahead of v5: two new evaluations added (AA-Briefcase, GDP.pdf), GPQA Diamond retired as saturated, and private held-out test sets now carry 40% of the total weight. Claude Fable 5.1 leads the index, GPT-6 Astra wins on cost-per-task and token efficiency — and Hacker News raised fair questions about the timing.

Oct 13, 2026

FrontierCode 1.1: Leading AI Models Still Fail 40% of Maintainer-Graded Tasks

FrontierCode asks whether an AI agent's code change is something a maintainer would actually merge. Artificial Analysis's first results put Claude Opus 5.5 on top at 52%, with GPT-6.1 Sol close behind at a fraction of the price. Here is how it works, what the numbers say, and what to take from it.

Oct 23, 2026

DeepSeek V4.1 Flash 1017 Scores 57% on the Artificial Analysis Cyber Index: What the Number Measures

Artificial Analysis posted on October 23, 2026 that DeepSeek V4.1 Flash 1017 scores 57% on its Cyber Index, second only to OpenAI's restricted GPT-6 Sol (Daybreak Blue, max) at 69%, at $0.42 per task. We read the index methodology to explain what that number measures, and mark what we could and could not confirm.