GPT-6 Astra Scores 95% on a Robot Control Task, Up From Fable 5.1's 40%

GPT-6 Astra scored 95% on a robot-arm control task in an independent benchmark from Robocurve, up sharply from Claude Fable 5.1's 40% on the same task — while using 6.2x fewer output tokens and costing 2.3x less. The result comes from a public X thread by Jay Chooi, who runs Robocurve, a YC-backed benefit corporation focused on benchmarking robots. It's a real-time-control efficiency story more than a raw-capability one: on harder, precision-limited tasks, the two models tie.

This lands right after GPT-6 Astra's broader benchmark rollout, and it's a useful data point for anyone tracking whether large language models are closing in on genuinely real-time embodied control — a domain where token-generation speed, not just task accuracy, has historically been the binding constraint.

TL;DR

What the benchmark actually tested

Robocurve's setup had both models control robot arms by specifying a target end-effector pose — essentially, where the gripper should end up — which was then passed through an automatic inverse kinematics (IK) solver to compute the actual joint angles needed to get there. That's an important methodological detail: neither model was asked to compute joint-level robotics math directly. The task tests planning and sequencing — deciding what pose to target next, based on the current state of the arm and task — not the geometry of robot arm movement itself.

On that task, GPT-6 Astra hit 95% success, compared to Claude Fable 5.1's 40%. That's a large gap on the primary benchmark. But Chooi's thread includes an important caveat that changes the read on the result: on harder tasks that demand more precision, the two models perform identically — both succeeding on just 2 of 20 trials. Astra still wins on efficiency there too, using 3.9x fewer output tokens at 1.6x lower cost — but the success-rate gap disappears entirely once the task gets hard enough.

Why this is a latency story, not an intelligence story

Put those two results together and the picture that emerges isn't "Astra is dramatically smarter at robotics than Fable 5.1" — it's "Astra reaches a comparable ceiling using a fraction of the tokens." On the easier primary task, that efficiency gap translates directly into a large success-rate gap, plausibly because a model generating 6x more tokens per decision has more opportunity to drift, second-guess, or simply take longer to converge on a workable plan within whatever time or step budget the benchmark enforced. On the harder task, both models hit a genuine capability ceiling regardless of token budget, and the efficiency gap shows up only in cost and speed, not success rate.

That distinction matters for anyone deciding which model to build robotics or embodied-agent workflows on top of. A model that's dramatically more token-efficient at reaching the same ceiling is the more practical choice for anything resembling a real-time control loop, even if its raw ability to solve genuinely hard precision tasks is no better than a competitor's.

The real-time control argument

Chooi's thread makes a broader claim worth taking at face value as a projection, not a fact: if LLM output token speed keeps increasing at 2-7x per year — with some frontier-class models reportedly doubling output speed monthly — then LLMs could plausibly control robot arms in real time by the end of 2026, or by 2029 under a slower, more conservative trend line.

The logic is straightforward. Real-time control requires a decision loop fast enough to keep pace with a changing physical environment — a robot arm that's mid-grasp can't wait several seconds for its controlling model to finish generating a token sequence before adjusting. Every reduction in tokens-per-decision, combined with every increase in raw generation speed, shortens that loop. Astra's 6.2x token reduction on the primary task is exactly the kind of improvement that argument depends on repeating, model generation after model generation, for the "real-time by 2026-2029" timeline to hold.

Whether that specific timeline pans out is genuinely uncertain — extrapolating a hardware-and-training trend two or three years forward is a bet, not a measurement — but the direction (fewer tokens per control decision, faster raw generation) has been consistent across recent model generations, and this benchmark is a fresh, concrete data point in that direction rather than a new hypothesis.

What people are asking

Is this the same "robot control" as a humanoid robot walking or manipulating objects in the real world? Not necessarily — the thread describes an arm-control task using end-effector pose commands through an IK solver, which is a common simulation or lab setup for testing planning and decision-making, not necessarily a full physical deployment. It's a meaningful proxy for control-loop capability, but treat "robot control benchmark" as testing decision quality and speed under a specific harness, not a claim about deployed humanoid robots in the field.

Why does GPT-6 Astra do so much better on the easy task but tie on the hard one? The likely explanation, based on what's disclosed in the thread, is that the easy task has enough slack that token efficiency alone determines whether a model converges on a working plan within budget, while the hard task exceeds both models' actual planning capability regardless of how many tokens they're given — a capability ceiling that efficiency gains can't buy past.

How does this compare to Mistral's Robostral or other embodied-navigation models? Robostral Navigate is a purpose-built navigation model trained specifically for map-less robot movement using a single camera, versus general-purpose frontier LLMs like Astra and Fable 5.1 being adapted to a control task via pose commands and an external IK solver. The comparison isn't apples-to-apples — a specialized model built for one physical task and a general-purpose LLM repurposed for planning are different bets, and this benchmark says more about frontier-LLM efficiency trends than about how either compares to purpose-built robotics models.

Should this change which model I build a robotics agent on top of? If your workload resembles this benchmark's shape — pose-level planning through an external solver, with real-time responsiveness mattering — the token-efficiency gap is a legitimate signal favoring Astra for that specific pattern. If your task looks more like the harder precision benchmark, the tie suggests model choice matters less than solving the actual planning bottleneck both models hit.

Related reading on explainx.ai

• Claude Fable 5.1 and Mythos 5.1: Benchmarks, Pricing, and Safeguards — background on the model GPT-6 Astra is being compared against here
• Yann LeCun: LLMs, Physical Agents, and the Moravec Paradox — why physical-world tasks have historically resisted LLM approaches
• Mistral Robostral Navigate: Map-Less Robot Navigation — a purpose-built alternative to general-purpose LLM control
• NVIDIA MotionBricks: Real-Time Motion From Characters to Unitree G1 — another recent real-time robotics motion result
• World Humanoid Robot Games: Complete Guide — broader context on humanoid robot benchmarking
• Meta AIRA₃: Gold Medal in a Live NVIDIA Kaggle Competition — another recent externally-scored agent benchmark result, for comparison on methodology

Primary source: Jay Chooi (@chooi_jeq) on X · Robocurve

This post is based on a public X thread from Robocurve's Jay Chooi as of September 5-6, 2026. The benchmark's task suite, trial counts, and scoring methodology are described only in that thread and have not been independently replicated or published as a paper; treat the specific percentages as one group's reported results.