explainx.ainewsletter3.5k
TrendingNewsPathwaysSkills
Pricing
explainx.ai

Upskill in AI — 16 free pathways, live workshops & bootcamps, and 50+ courses from practitioners. Plus the skills, tools, and MCP servers to practice on.

follow us

corporate training

support@explainx.ai

get started

Find your pathTake Free Evaluation

learn

pathways — start freeworkshopsbootcampscoursescertificationsmock testsexplainx universitycorporate traininglearn skills & mcp

discover

skillsmcp serversexplainx mcptoolsagentsllmsdesignsdictionaryagi trackerranks

company

aboutvisionmissionteaminstructorscommunityhackathonscareers

content

daily AI newsstate of AI — live resultsblogreleasespromptsgeneratorsresource libraryfor LLMsexplainx.ai kids

solutions

all solutionsdeveloper upskillingmarketing upskillingproduct manager upskillingleadership upskilling

newsletter · weekly

Get AI news, tools, and insights in your inbox.

supportprivacytermsdata rightshow we create contentsubmission guidelines

© 2026 AISOLO Technologies Pvt Ltd

On this page

  • TL;DR
  • What a "search subagent" actually is
  • Works with any backend — but built for Mixedbread Search
  • Mixedbread's benchmark claims (vendor-published, not independently verified)
  • Pricing and availability
  • Part of a broader trend, not a lone entrant
  • What Hacker News made of it
  • Honest limitations
  • Closing
  • Related on explainx.ai
← Back to blog

explainx / blog

Mixedbread Toast 1: A Dedicated Search Subagent for Frontier Models

Mixedbread launched Toast 1, a specialized search subagent frontier models can delegate retrieval to. Vendor benchmarks claim 3.5x fewer tokens at equal accuracy — here's how it works and how to wire it in.

Aug 15, 2026·10 min read·Yash Thakker
RetrievalAgent ToolingRAGMixedbreadSearch Agents
go deep
Mixedbread Toast 1: A Dedicated Search Subagent for Frontier Models

Every agent that can call a search tool eventually hits the same tax: the frontier model itself ends up doing the grunt work of searching. It writes a query, reads back three noisy pages of results, decides it needs a follow-up query, reads more pages, and only then starts reasoning about the actual question — burning expensive context and inference budget on search mechanics instead of the task it was hired for.

Mixedbread, maker of open embedding and reranking models, just shipped Toast 1: a model built specifically to be a search subagent — a dedicated retrieval worker that a larger model delegates evidence-gathering to, rather than doing that loop itself. It's a concrete instance of a pattern this blog has covered from the harness side before — see our breakdown of Planner/Worker/Critic agent harnesses — applied specifically to retrieval as its own specialized role.

Weekly digest3.5k readers

Catch up on AI

Curated AI updates on agents, skills, and MCP — delivered to your inbox. Unsubscribe anytime.

TL;DR

table · 2 cols
QuestionAnswer
What is it?A dedicated search/retrieval subagent model that a frontier model can hand a query to
What does it do that a search tool call doesn't?Decomposes the query, runs the full search loop itself, curates a distilled evidence package back to the caller
Does it need Mixedbread's own index?No — works with any backend via OpenAI-compatible Chat Completions API; performs best with Mixedbread Search (Wholembed v3) but that's optional
Headline vendor claim~3.5x fewer tokens for identical task-accuracy scores on a legal retrieval benchmark (Mixedbread's own numbers)
Pricing$0.30/M input tokens, $0.036/M cached input, $0.72/M output
AvailabilityLive now via the Mixedbread API, plus coding-agent integrations (skills installer, OpenCode)
Are these numbers independently verified?No — all benchmark figures below are Mixedbread's own vendor-published claims, not reproduced by explainx.ai

What a "search subagent" actually is

Most agents today do retrieval the same way: the frontier model gets a search() tool, and when it decides it needs information, it calls that tool, reads whatever comes back, and decides what to do next — all inside its own reasoning loop. That's a general-purpose model spending its most expensive resource (context window, inference compute) on a narrow, repetitive task: issuing queries, skimming noisy results, and deciding when it has "enough."

Toast 1 inverts that. Instead of the frontier model doing its own search loop, it hands the entire question over to Toast 1 as a subagent call. Toast 1 then:

  1. Decomposes the query into subqueries
  2. Issues search calls against whatever backend is configured
  3. Inspects and reads the returned sources
  4. Curates a distilled, relevant evidence package
  5. Hands that package back to the calling model

The calling model — Claude Opus 5, GPT-5.6 Sol, or whatever frontier model is orchestrating — never sees the raw, noisy search traffic. It only sees the finished evidence, freeing its context window and compute budget for reasoning toward a final answer rather than mechanically working a search loop. This is the same underlying idea explainx.ai covers in RAG vs MCP: retrieval and reasoning are different jobs, and there's a real cost to making the most expensive model in the pipeline do both.

It's also a variant of the subagent pattern generally — a bounded, separately invoked worker handling one part of a larger task — applied narrowly to search, the way multi-agent harnesses split planning, execution, and review into distinct roles.

Works with any backend — but built for Mixedbread Search

Toast 1 doesn't require ripping out an existing retrieval index. It exposes an OpenAI-compatible Chat Completions API, so it can be pointed at a current search backend as a drop-in tool call from any agent harness.

Mixedbread says it performs best when paired with Mixedbread Search, their own multimodal, multilingual search product built on Wholembed v3, a late-interaction retrieval embedding model — the same family of technique behind ColBERT-style retrievers that score at the token level rather than compressing a document to a single vector. But the explicit design intent is that a team doesn't have to migrate off an existing index to use Toast 1 as the search subagent layer.

Mixedbread's benchmark claims (vendor-published, not independently verified)

All of the numbers below come from Mixedbread's own launch post. explainx.ai has not reproduced them. Vendor-published benchmarks routinely favor the shipping product's evaluation setup, and none of these figures have been checked against an independent harness — treat them as directional claims worth understanding, not settled facts.

1. OfficeQA Pro V2 (Databricks enterprise financial-analysis benchmark)

OfficeQA Pro V2 is a Databricks-released set of 90 realistic enterprise financial-analysis questions, scored on answer correctness.

table · 3 cols
ConfigurationAnswer correctnessCost per task
GPT-5.6 Sol in Codex + Toast 1 as sub-agent70%~$1.15-$1.20
Claude Fable 5 on Databricks' "Genie" system60%~$4.00
GPT-5.6 Sol in Codex, no Toast 133%—

Mixedbread says the Toast-1-assisted configuration was the highest-scoring, most cost-efficient point in Databricks' entire evaluated field for that release.

2. Harvey LAB "Firm Knowledge" legal retrieval benchmark

Harvey LAB's legal-knowledge search benchmark was tested on a randomly sampled 33-task subset for tractability. Mixedbread held GPT-5.6 Sol and task difficulty constant and swapped only the retrieval stack:

table · 4 cols
Retrieval stackTotal tokensTurns/taskTask score
Vanilla filesystem-search agent80.6M21.755
Mixedbread Search alone47.0M14.655
Mixedbread Search + Toast 1 sub-agent23.0M11.255

Same correctness score across all three — the difference is entirely in how many tokens and turns it took to get there. Mixedbread frames that as roughly 3.5x fewer total tokens and 60%+ cost reduction purely from upgrading the retrieval layer, with no change to task accuracy.

3. Standalone retrieval quality (BrowseComp Plus, OfficeQA Pro, LongSeal)

As a standalone retriever — not paired with a frontier model as caller — Mixedbread reports Toast 1 matches or approaches frontier-model-level retrieval quality, comparable to GPT-5.6 Sol and ahead of Kimi K3 and GLM-5.2 on their eval set, while claiming to run roughly 7-11x cheaper:

table · 3 cols
ModeMedian latencyCost per query
Standard Toast 1 run~8 seconds~$0.016-$0.023
Highest-quality "fusion" configuration~11 seconds~$0.05-$0.07
Frontier-model retrieval agents (comparison set)~20 seconds to 4 minutes—

Pricing and availability

Toast 1 is live now via the Mixedbread API. Launch pricing:

table · 2 cols
MeterRate
Input tokens$0.30 / million
Cached input tokens$0.036 / million (cache writes free)
Output tokens$0.72 / million

Integration paths Mixedbread shipped at launch:

  • OpenAI-compatible Chat Completions API — point any existing agent harness at it as a tool
  • npx skills add mixedbread-ai/skills — installer for coding agents, similar in spirit to explainx.ai's own skills registry or the agent skills pattern generally
  • OpenCode integration
  • Python/TypeScript SDK — invoke Toast 1 directly against a Mixedbread "store" (their managed retrieval index) by setting agentic: True on a search call

A representative snippet from Mixedbread's own docs, using the Python SDK against a managed store:

python
from mixedbread import Mixedbread

mxbai = Mixedbread(api_key="YOUR_API_KEY")

result = mxbai.stores.search(
    store_identifiers=["your-store-id"],
    query="What were the key drivers of Q3 margin compression?",
    agentic=True,  # routes the query through Toast 1 as a search subagent
)

print(result.evidence)

If a team already has a search backend it doesn't want to touch, the Chat Completions path is the more relevant one — Toast 1 becomes a tool call inside an existing agent harness or MCP server setup rather than a wholesale index migration. Teams building their own MCP-based tool layer can browse comparable retrieval tooling on explainx.ai's MCP server registry.

Part of a broader trend, not a lone entrant

Mixedbread frames Toast 1 as one instance of a category forming across the industry: specialized search agents, distinct from general frontier models. Their launch post explicitly names two other companies building in the same lane — SID-1 and Chroma's Context-1.

The argument underneath all three: as frontier-model intelligence gets more metered and expensive, there's a growing case for purpose-built, cheaper subagents that match frontier quality on one narrow task — retrieval — rather than reflexively reaching for the most expensive general-purpose model for every step of a pipeline. That's the same cost-vs-capability tradeoff explainx.ai has tracked across multi-agent harness design more broadly: split a task into roles, and route each role to the cheapest model that reliably handles it.

What Hacker News made of it

The Hacker News discussion (174 points at time of writing) was relatively light on technical pushback. Commenters mostly asked clarifying questions about how Toast 1 integrates with an existing retrieval stack, some joked that "Toast" and "Mixedbread" branding is hard to search for (an irony not lost on a search-product launch), and there was general interest in the underlying cost/latency tradeoff versus simply doing better prompt engineering on a general-purpose frontier model's native search loop. No major methodology controversy was reported in the thread.

That last question — better prompting versus a dedicated subagent — is the real one worth sitting with. Mixedbread's Harvey LAB numbers suggest the gain isn't really about search quality per se (task score held flat at 55 across all three configurations); it's about how many tokens and turns it takes to reach that same score. If that pattern holds up under independent testing, it argues for treating retrieval as its own budget line in a harness's budget-pressure accounting, the same way tiered memory or a two-tier verifier get their own budgets.

Honest limitations

  • Every benchmark number here is Mixedbread's own, published in their launch post — not reproduced by explainx.ai or, as far as we can tell, by any independent third party yet.
  • "Same score, fewer tokens" is the strongest claim, and also the easiest to game with benchmark-specific tuning — worth re-testing on a workload that isn't one of Mixedbread's own showcase evals before trusting the magnitude.
  • Standalone retrieval-quality comparisons (BrowseComp Plus, OfficeQA Pro, LongSeal) are run against a set of competitor models chosen by Mixedbread, not a neutral third-party leaderboard.
  • The underlying trend — specialized retrieval subagents as a cost-saving pattern — is real and worth understanding regardless of any single vendor's numbers. SID-1 and Context-1 existing as parallel entrants is itself evidence the pattern has legs beyond one company's benchmark table.

Closing

Toast 1 is a bet that retrieval deserves its own specialized model rather than living inside a frontier model's general-purpose reasoning loop — the same "split by role, route by cost" logic that shows up across modern agent harness design. Whether Mixedbread's specific 3.5x token-reduction number survives independent testing is an open question. That specialized search subagents are becoming a real category — with Mixedbread, SID-1, and Chroma's Context-1 all shipping into it — is not.

Related on explainx.ai

  • RAG vs MCP: The Complete Guide to Context-Aware AI Systems
  • What is MCP? Model Context Protocol Guide
  • From ReAct Loop to Production Harness: DAG Planning, Budget Pressure
  • YC Open-Sources QM: Company-Wide Multi-Agent Harness
  • TencentDB Agent Memory v2: Team Hub
  • Top 10 MCP Server Directories & Registries (2026)
  • What are agent skills?
  • /mcp-servers — explainx.ai MCP server registry
  • /skills — explainx.ai agent skills registry
  • Dictionary: Search Subagent

Sources

  • Mixedbread's official Toast 1 launch post (mixedbread.com) — benchmark figures, pricing, and integration details
  • Hacker News discussion thread (174 points) on the Toast 1 launch
  • Databricks OfficeQA Pro V2 benchmark release
  • Harvey LAB "Firm Knowledge" legal-search benchmark

Pricing, benchmark figures, and integration details reflect Mixedbread's own launch announcement as of August 15, 2026. All benchmark numbers are vendor-published and have not been independently reproduced by explainx.ai — verify against current Mixedbread documentation before citing exact figures in production decisions.

Spotted something out of date? Let us know.
Yash Thakker

Written by

Yash Thakker

Yash is an AI expert with over 300K learners. Join his workshops →

Related posts

Aug 15, 2026

"Don't Classify, Hallucinate": The HyDE Trick for Cheap LLM Classification

Doug Turnbull's "don't classify, hallucinate" post (216 points, 85 comments on Hacker News) flips structured-output classification on its head: instead of shipping a 500-category taxonomy to the LLM on every call, ask a cheap model to invent a plausible-sounding category, then embed that hallucination and nearest-neighbor it against real categories. It works because it's really HyDE (Hypothetical Document Embeddings) applied to classification instead of search.

Aug 6, 2026

Castform + Neon: A 4B Open Model Matches GPT-5.6 Sol at 1/100th the Cost

A joint Neon and Castform blog post (August 5, 2026) claims a small open-weight model, RL post-trained against Neon's hybrid Postgres search, retrieves as accurately as GPT-5.6 Sol while costing about 100x less per request. It's a self-reported benchmark, not an independent one — but the pattern it demonstrates is worth understanding.

Jul 28, 2026

Top 10 Closed-Source and Open-Source Embedding Models (2026)

The generation model gets the demo; the embedding model decides whether RAG finds the right paragraph. Here are the top 10 closed-source APIs and top 10 open-source checkpoints builders should shortlist in 2026.