explainx.ai350K+ learn from us
TrendingAI News TodayPathwaysSkills
Pricing
explainx.ai

Upskill in AI — 16 free pathways, live workshops & bootcamps, and 50+ courses from practitioners. Plus the skills, tools, and MCP servers to practice on.

follow us

follow on google

Add explainx.ai as a preferred source

corporate training

support@explainx.ai

get started

Find your pathTake Free Evaluation

community

Join the community

learn

mind: share how you thinkpathways — start freeworkshopsbootcampscoursescompare Explainxcertificationsmock testsexplainx universitycorporate traininglearn skills & mcp

discover

skillsmcp serversexplainx mcpestacktoolsmdx readeragentsllmsdesignsdictionarypeopleagi trackerfelony benchranks

company

aboutvisionmissionteaminstructorsteach on explainxpartnershipscommunityhackathonscareers

content

daily AI newsstate of AI — live resultsblogreleasespromptsgeneratorsresource libraryfor LLMsexplainx.ai kids

solutions

all solutionsdeveloper upskillingmarketing upskillingproduct manager upskillingleadership upskilling

newsletter · weekly

Get AI news, tools, and insights in your inbox.

supportcontactprivacytermsdata rightshow we create contentsubmission guidelines

© 2026 AISOLO Technologies Pvt Ltd

explainx.ai

On this page

  • TL;DR
  • Why policy-only robotics stopped scaling
  • S0, S1, and S2: responsibilities, not SKUs
  • The agentic loop in plain language
  • Evaluation: nine dimensions and honest reporting
  • Roadmap L1–L4: from primitives to jobs
  • Digital agents vs physical agents: what transfers
  • Papers the survey anchors on (selected)
  • Failure modes the roadmap acknowledges
  • Open questions the survey leaves explicit
  • Connection to explainx.ai coverage threads
  • Glossary for standups
  • What builders should do this month
  • Related reading
← Back to blog

explainx / blog

Envisioning Agentic Robotics: S0, S1, S2 and a Four-Level Autonomy Roadmap

Robotics, AI Agents, Research, GPT-6 Astra, Embodied AI

Part of Robotics and Physical AI

A November 2026 survey on arXiv defines agentic robotics: foundation models plus embodied harnesses (S2) orchestrating skills (S1) and body control (S0), with nine eval dimensions and L1–L4 work delegation.

Nov 16, 2026·8 min read·Yash Thakker
add explainx.ai
go deep
Envisioning Agentic Robotics: S0, S1, S2 and a Four-Level Autonomy Roadmap

A survey posted to arXiv as 2611.18359 argues robotics is entering an agentic era. The authors—affiliated with Grid Robotics—say GPT-6 Astra and similar frontier models, wrapped in embodied harnesses, can match or beat task-specific policies on several embodied benchmarks without task fine-tuning. Their framework gives builders a vocabulary we lacked while vendors shipped demos: S0 body control, S1 skills, S2 planning and verification, plus nine evaluation dimensions and a four-level roadmap for delegating real work.

explainx.ai covered the industry pitch in Berkeley–NVIDIA agentic robotics at CoRL and Gemini Robotics 2.5 factory demos. This paper is the academic synthesis: what to measure, what stays hard in physics, and why harness design can move success rates as much as model swaps.

TL;DR

table · 2 cols
IdeaPlain-language takeaway
ParadigmShift from one policy per task to goal pursuit with tools
CoreEmbodied System 2 = foundation model + harness (context, tools, memory, verifier)
LoopSix steps: interpret → decide → act → observe → verify → continue or recover
Eval gapCommunity mixes model scores with system scores; paper pushes separation
RoadmapL1 primitives → L4 standing roles (breakfast demo in Figure 1)
Daily briefFrom Yash · 350K+ students taught

Catch up on AI

One AI story explained in plain English, plus one thing to try. Every day, free. Unsubscribe anytime.

Why policy-only robotics stopped scaling

Classic stacks chained perception, planning, and control with hand-tuned modules. Deep RL in simulation produced impressive locomotion and humanoid tracking, but policies stayed narrow.

Vision-language-action (VLA) models such as the π series unified see + language + act, broadening generalization. World-action models added video dynamics. Yet the authors note performance can still collapse when scenes or instructions shift—exactly what world-model research tries to address.

Agentic robotics proposes a different fix: keep general reasoning in a foundation model, expose callable skills (VLAs, planners, code) as S1, and let S2 verify whether the world actually changed before committing to the next step.

S0, S1, and S2: responsibilities, not SKUs

Figure 3 in the paper is the cheat sheet builders should screenshot:

S2 — intent, orchestration, verification

S2 decides whether to act, gather information, clarify, retry, or stop. It calls S1 skills or S0 interfaces, then checks evidence against the goal. In products like Gemini Robotics, a high-level VLM already does slices of this orchestration; the survey argues that without explicit verification, you cannot claim a full agentic stack.

The embodied harness is not optional fluff. It assembles context, exposes tools, maintains plans and memory, and runs a verifier. Papers cited inside the survey show harness-only changes moving success 9–35 points on some tasks—even when the planner model stays fixed.

S1 — skills and callable modules

S1 includes VLA policies, perception stacks, motion planners, and even Python cells the model writes at runtime. The survey warns more tools ≠ better results: on EmbodiedSkillBench, restricting tools helped weaker models but hurt GPT-6 Astra until it could selectively use skills—mirroring lessons from Runway Praxis video-control releases.

Robotic gripper mirroring a hand holding a cup, evoking S1 callable skills in agentic roboticsRobotic gripper mirroring a hand holding a cup, evoking S1 callable skills in agentic robotics

S0 — real-time body interface

S0 executes torques and balance loops without waiting for S2 deliberation. A real-time event monitor can estop or pause skills when humans interject or collisions occur—critical for Ring robotics pilot safety narratives.

The agentic loop in plain language

The paper’s breakfast red cup vs blue cup example is intentionally mundane:

  1. User asks for a cup at the table.
  2. S2 plans subtasks: locate, grasp, carry, place.
  3. Skills run; S0 keeps the arm stable.
  4. User changes mind mid-grasp → event monitor interrupts S2.
  5. S2 verifies cancellation before issuing conflicting commands.
  6. A skill may report success while the camera shows failure → verifier catches the mismatch.

That loop is what separates agentic robotics from open-loop VLAs. It also explains why OpenAI’s GPT-6 Astra lattice science post matters to hardware teams: the same model family is now judged on whether it can supervise tools, not just answer prompts.

Evaluation: nine dimensions and honest reporting

The authors complain the field mixes incompatible numbers—different RoboDojo harness settings for Astra, unlike comparisons on GPT-6 cyber agent releases where protocols are spelled out.

Their framework demands:

  • Independent outcome verification (not trusting skill self-reports)
  • Transparent tool and memory configs
  • Closed-loop tests while the world still moves

For practitioners, that means publishing harness JSON, skill manifests, and interrupt rules beside model names—exactly what reproducible eval harness posts argue for in cloud inference.

Robot hand reaching toward a globe, evoking closed-loop embodied evaluation in agentic roboticsRobot hand reaching toward a globe, evoking closed-loop embodied evaluation in agentic robotics

Roadmap L1–L4: from primitives to jobs

Figure 1 maps delegation depth:

table · 3 cols
LevelResponsibilityBreakfast demo
L1Single primitiveFlip one item
L2Full taskServe one plate
L3WorkflowCoordinate cooking steps
L4Standing role“Breakfast host” for the household

The authors connect L4 to sustained autonomy—robots trusted with ongoing roles, not one-off commands. That is the commercial endgame behind NVIDIA GR00T marketing and humanoid hype, but the paper stresses verification and legal monitors first.

Digital agents vs physical agents: what transfers

Section 5 of the survey asks which digital agent assumptions survive contact with physics. Highlights readers should internalize:

  • Irreversible actions — deleting a file is not dropping a mug; verifiers must observe persistent state.
  • Latency budgets — S2 deliberation cannot block S0 balance loops; the event monitor exists because physics does not wait.
  • Partial observability — wrist cameras miss occlusions; the breakfast example’s failed grasp is the canonical case.
  • Safety envelopes — predefined estop rules trump model persuasion.

That is why Gemini Robotics jailbreak sets and Asimov policy research matter even when chat benchmarks look solved.

Papers the survey anchors on (selected)

table · 2 cols
WorkRole in the argument
Zhang et al. 2026c GPT-6 Astra on RoboDojoEarly evidence frontier models beat task policies
Han et al. 2026 EmbodiedSkillBenchTool restriction helps weak models, hurts strong ones without selective use
Wei et al. 2026a SCOPEREvidence memory + verification guides recovery
Harness VLA (Zhang et al. 2026f)Memory-guided agents lift frozen VLAs

Builders should read at least one primary robotics eval (RoboDojo, EmbodiedBench, LIBERO-PRO) before quoting a single success rate from social media.

Failure modes the roadmap acknowledges

The L1–L4 ladder is not optimism—it is a responsibility gradient. Standing roles (L4) imply:

  • Accountability when the robot misjudges user intent over weeks.
  • Continual learning from physical experience without catastrophic forgetting.
  • Regulatory visibility into what S2 logged before each irreversible act.

That matches policy conversations in South Korea’s CSAT integrity panic: society tolerates AI cheating headlines before it tolerates physical harm from autonomy.

Open questions the survey leaves explicit

The authors do not claim agentic robotics is solved. They flag unsettled areas worth watching in 2027:

  • Who owns verification when S1 skills are third-party VLAs with opaque latents?
  • How to benchmark standing roles (L4) without multi-week human studies?
  • Whether execution memory should live in S2 harness or inside S1 policies (Harness VLA work cited in the survey reports large swings).
  • Legal liability when S2 replans after user interruptions mid-motion.

Those questions intersect Norway laser aquaculture robots and warehouse autonomy posts—not just humanoid hype.

Connection to explainx.ai coverage threads

This survey stitches together threads explainx.ai has followed separately:

  • Frontier models in physical loops — GPT-6 Astra science plus embodied eval citations inside arXiv 2611.18359.
  • Harness beats raw parameters — same lesson as NVIDIA SkillEvaluator for digital agents, now with torque limits.
  • Verification as product — aligns with AI homework vs exam scores: closed-loop checks matter more than open-loop confidence.

If you ship one takeaway to leadership: budget for harness engineers, not just bigger foundation weights.

Download arXiv 2611.18359 (PDF; the authors also run a project website) and read Sections 2–4 before you buy another policy-only VLA license. The figures are dense, but they are cheaper than retooling a production line around the wrong abstraction. Skim the bibliography if you need a reading list for Q1 planning. Assign one paper per sprint to your robotics pod. Discuss whether your current vendor demo maps to L1 tasks only, not promised L4 roles.

Glossary for standups

table · 2 cols
TermOne-line definition
Agentic loopSix-step cycle ending in verified world state
Embodied harnessRuntime wiring context, tools, memory, verifier
S2Planner that can refuse, clarify, or replan
S1Callable skills including VLAs and scripts
S0Millisecond body control
WAMWorld-action model predicting dynamics + actions
L4 roleOngoing responsibility, not a single command

What builders should do this month

  1. Label your stack — Map existing components to S0/S1/S2 before you rebrand a VLA as an “agent.”
  2. Invest in verifiers — Cheap RGB checks often beat bigger models without them.
  3. Benchmark the harness — A/B planner constants before you swap weights.
  4. Read Astra robotics evals skeptically — Compare budgets, tool lists, interruption policies, and harness versions.

Related reading

  • Berkeley–NVIDIA agentic robotics at CoRL 2026
  • Gemini Robotics 2.5 and jailbreak eval sets
  • GPT-6 Astra science use cases
  • Runway Praxis open video-robot control
  • Physical AI on Bedrock AgentCore
  • Qwen4-Max agents for digital work
  • miHoYo Gamer VLA for real-time game control
Spotted something out of date? Let us know.
Daily briefFrom Yash · 350K+ students taught

Catch up on AI

One AI story explained in plain English, plus one thing to try. Every day, free. Unsubscribe anytime.

  • ✓ Free
  • ✓ One email a day, no spam
  • ✓ Unsubscribe anytime
Yash Thakker

Written by

Yash Thakker

Yash is an AI expert with over 300K learners. Join his workshops →

View Yash Thakker in People in AI →

Related posts

Nov 11, 2026

SWAM: Shanghai Jiao Tong World Action Model With Open Weights

The SWAM paper on arXiv 2611.12870 trains world action models on about 47,000 hours of video and demonstrations, reporting 88.10% RoboTwin Easy success and 40% real-world success across three tasks. Authors release code, data, and weights.

Nov 10, 2026

A²-MEAS: Embodied Agents With Learned Correction Codes for Robot Failures

The November 2026 paper A²-MEAS argues better foundation models alone do not fix robot autonomy unless failure recovery is engineered. AutoLab-SJTU builds learned correction codes, MetaBrain supervision, and the A²-WLA action model, reaching 0.6411 Q-score on BEHAVIOR 2026 public tasks and strong pour-over coffee recovery rates in hardware.

Nov 9, 2026

Open-HumanWAM: 50K Hours of Egocentric Video for Robot WAMs

Researchers at Peking University’s DAGroup published Open-HumanWAM, billing it as the first fully open recipe to scale egocentric pretraining to fifty thousand hours. They ship a curated corpus, HumanWAM-Vanilla and HumanWAM-Goal checkpoints, and report log-linear gains linking human video hours to robot success on RoboTwin 2.0 and real hardware.