explainx.ai350K+ learn from us
TrendingAI News TodayPathwaysSkills
Pricing
explainx.ai

Upskill in AI — 16 free pathways, live workshops & bootcamps, and 50+ courses from practitioners. Plus the skills, tools, and MCP servers to practice on.

follow us

follow on google

Add explainx.ai as a preferred source

corporate training

support@explainx.ai

get started

Find your pathTake Free Evaluation

community

Join the community

learn

mind: share how you thinkpathways — start freeworkshopsbootcampscoursescompare Explainxcertificationsmock testsexplainx universitycorporate traininglearn skills & mcp

discover

skillsmcp serversexplainx mcpestacktoolsmdx readeragentsllmsdesignsdictionarypeopleagi trackerfelony benchranks

company

aboutvisionmissionteaminstructorsteach on explainxpartnershipscommunityhackathonscareers

content

daily AI newsstate of AI — live resultsblogreleasespromptsgeneratorsresource libraryfor LLMsexplainx.ai kids

solutions

all solutionsdeveloper upskillingmarketing upskillingproduct manager upskillingleadership upskilling

newsletter · weekly

Get AI news, tools, and insights in your inbox.

supportcontactprivacytermsdata rightshow we create contentsubmission guidelines

© 2026 AISOLO Technologies Pvt Ltd

explainx.ai

On this page

  • Update (November 9, 2026): Google publishes official specs and software stack
  • What developers are saying
  • TL;DR: what reporting claims
  • How this fits Google's April eighth-gen launch
  • What Amin Vahdat told Bloomberg
  • Confidential compute vs long context: why both matter now
  • Software stack: what you can use before 2027 hardware
  • Competitive landscape
  • What is not confirmed yet
  • What developers should watch next
  • Workload mapping cheat sheet
  • Energy and floor-space framing
  • External customer count: what "nearly 100" implies
  • Porting checklist for PyTorch teams
  • Related reading
← Back to blog

explainx / blog

Google TPU 8tx and 8i Max: Four Eighth-Gen Variants in One Year

Google, TPU, AI Chips, AI Infrastructure, Inference

Part of Google Gemini and DeepMind

Google is adding TPU 8tx for confidential workloads and TPU 8i Max for long-context inference, Bloomberg reports. What Amin Vahdat said, how they differ from 8t/8i, and what builders should watch.

Nov 9, 2026·10 min read·Yash Thakker
add explainx.ai
go deep
Google TPU 8tx and 8i Max: Four Eighth-Gen Variants in One Year

Google added TPU 8tx for confidential workloads and TPU 8i Max for long-context inference on November 9, 2026, bringing its eighth-generation portfolio to four systems in one year. Google's official post by SVP Amin Vahdat confirms the systems reuse existing eighth-gen silicon while reconfiguring packaging, memory, and networking. Morning coverage had summarized Bloomberg's report before the blog went live.

For builders, the headline is specialization, not a new training generation. Google already split TPU 8t (pre-training scale) and TPU 8i (low-latency inference) at Cloud Next in April 2026, documented in Google's technical deep dive. The November systems are packaging and networking SKUs for regulated customers and memory-hungry agents.

Update (November 9, 2026): Google publishes official specs and software stack

Google's November 9 blog post replaces relayed Bloomberg summaries as the primary source. Vahdat repeats the system vs chip distinction: new silicon takes years, while Google can ship specialized supercomputers in months by adjusting memory, optical networking, and security around the same TPU 8t and 8i dies.

Confirmed numbers from Google's post (not independently benchmarked here):

table · 2 cols
ClaimSource
2.7× better training performance (8t vs prior gen)Google blog, April baseline reiterated
80% better inference price-performance (8i vs prior gen)Google blog
Up to 2× lower latency vs TPU 8t on 8txGoogle blog, citing Boardfly networking
Dual TPU 8i on one package for 8i MaxGoogle blog with product diagram

TPU 8tx pairs eighth-gen training-grade silicon with 5th Gen AMD EPYC hosts for confidential compute, keeping data and weights protected in active use. Google positions it for fine-tuning, distillation, and agent RL on sensitive data without moving workloads between clusters.

TPU 8i Max places two TPU 8i chips on one package, doubling compute, SRAM, and HBM bandwidth in the same rack footprint — aimed at agent swarms over full codebases or long video.

The post also bundles a software stack for builders: open-source TorchTPU for native PyTorch, vLLM and SGLang backends, a TPU agent suite preview for Claude Code and Cursor onboarding, Agent Compute Engine to park idle agent KV state off-chip, open-source TPU Sync for tiering massive KV caches, and GKE dynamic slicing with optical circuit switching. Those pieces matter even before 8tx or 8i Max capacity is on a public SKU list.

What developers are saying

On Hacker News, the thread is still thin (single-digit points) but pointed:

  • gniv asked whether availability timelines would appear in the 9 a.m. PT broadcast Google teased in the post.
  • pierreb-aiva highlighted Google's Agent Compute Engine line — agents that pause for tools could shed on-chip memory in milliseconds — as the most novel software claim in the announcement (comment).
  • xnx framed the news as "more bad news for Nvidia today" (comment), reflecting how quickly TPU specialization stories get read as competitive pressure.

Treat HN reactions as early sentiment, not verified benchmarks.

TL;DR: what reporting claims

table · 3 cols
PieceTPU 8tx (per Bloomberg via Reuters)TPU 8i Max (per Bloomberg via Reuters)
Primary goalConfidential / secure workloadsLong context and high memory bandwidth
SiliconExisting eighth-gen, reconfiguredDual TPU 8i on one package
Notable partnerPaired with AMD CPUs in Bloomberg's account—
TimingExpected 2027 in relayed reportsExpected 2027 in relayed reports
Google blog postPublished Nov 9, 2026Same
Daily briefFrom Yash · 350K+ students taught

Catch up on AI

One AI story explained in plain English, plus one thing to try. Every day, free. Unsubscribe anytime.

How this fits Google's April eighth-gen launch

Google's own April materials never promised only two SKUs forever. The agentic-era TPU post framed TPU 8i around Boardfly networking, larger on-chip SRAM, and MoE-friendly collectives, exactly the bottlenecks agent swarms hit when contexts stretch across codebases or video.

TPU 8i Max, as described in third-party reporting, pushes that story one step further: two inference chips per package to double memory and bandwidth without growing rack footprint. That mirrors how hyperscalers squeeze more inference per square meter as agents become the default interface.

TPU 8tx tackles a different constraint: data stays encrypted through processing, which government and regulated-industry buyers ask for before they fine-tune or run RL on private data. Nvidia has marketed comparable GPU features for years; Google's reported 8tx entry says TPUs are competing on security posture, not just FLOPS per dollar.

We covered Google's external TPU push when Oracle announced Google TPUs on OCI in 2027. Nearly a hundred external customers on TPUs were cited in follow-on trade coverage after the November news, signaling that specialization tracks commercial demand, not only internal Gemini training.

What Amin Vahdat told Bloomberg

Reuters relays Vahdat's specialization thesis: customers asked for workload-specific configurations, and Google can ship them in months by rearranging systems rather than waiting for a full new generation. That is consistent with Google's modular Cloud Next narrative, where Axion Arm hosts feed TPUs and Boardfly topology optimizes inference collectives.

The AMD pairing for 8tx, if accurate as Bloomberg described, is another data point in Google's multi-vendor host strategy. It does not replace Axion everywhere, but it shows Google willing to mix CPU vendors where compliance buyers expect familiar x86 paths.

Confidential compute vs long context: why both matter now

Confidential paths matter when enterprises distil frontier models on private documents or run agent RL loops on customer data. Without in-use encryption, teams shard workloads across clusters and accept audit risk. A TPU system marketed for confidential compute is Google's bid to keep those jobs on one stack.

Long-context paths matter because agent products keep raising default windows. Memory bandwidth, not peak FLOPS, often caps how many parallel tool calls a rack can serve. Doubling 8i capacity per package is a direct response to that wall, the same pressure we explain in KV cache and inference guides and speculative decoding.

Software stack: what you can use before 2027 hardware

Google's pitch to external customers depends on software friction staying low. The TorchTPU project and first-party support for vLLM and SGLang mean PyTorch shops can port inference paths without rewriting kernels, a theme we compared in vLLM vs SGLang.

If you are benchmarking today:

  1. Run baselines on current Cloud TPU or Ironwood instances while eighth-gen GA dates settle.
  2. Track Google's pricing page; TPU list prices still emphasize Ironwood and Trillium, not 8t/8i names.
  3. Treat Bloomberg performance anecdotes as hypotheses until Google publishes tables.

Competitive landscape

Specialized AI accelerator SKUs competing on confidential compute and long contextSpecialized AI accelerator SKUs competing on confidential compute and long context

table · 3 cols
VendorRecent moveBuilder takeaway
GoogleFour reported eighth-gen system variantsPick SKU by workload: train, infer, confidential, long context
MicrosoftMaia 300 inference silicon for 2027Hyperscalers custom-tune for tokens per megawatt
NvidiaGPU confidential compute + Groq licensing for inferenceStill default for mixed CUDA shops
OracleOCI TPUs in 2027Multi-cloud TPU option forming

Rumored large cloud purchases of Google TPUs, which we tracked in claimed vs verified reporting, would accelerate only if specialization keeps improving serving economics, not training peak FLOPS alone.

For a broader cheat sheet on accelerators, see AI chip architectures compared.

What is not confirmed yet

Reuters explicitly noted Google did not immediately respond. As of November 9, 2026 we did not find a blog.google or cloud.google.com page titled TPU 8tx or 8i Max. Until Google posts specs:

  • Treat launch timing as reported for 2027, not GA on Cloud Console.
  • Do not assume 8tx equals any particular encryption standard without a Google whitepaper.
  • Do not quote rack-level speedups unless Google publishes them.

That gap is normal for Bloomberg-first hardware stories. Our Google Cloud A5 and Rubin NVL72 GA post followed a similar pattern: partner news first, Google pages afterward.

What developers should watch next

Watch for three publishes: a Google Cloud SKU list update, confidential-compute documentation for 8tx, and TorchTPU release notes calling out 8i Max memory topology. Oracle's 2027 TPU roadmap may name which variants leave Google's fence first.

If you run regulated workloads, start compliance conversations now; hardware without audit artifacts rarely ships to production on day one. If you build agents, stress-test memory per concurrent session on current 8i-class paths so you know whether 8i Max is a nice-to-have or a capacity unlock.

Workload mapping cheat sheet

Use this table as a planning stub until Google publishes official SKU docs. It merges April Google materials with November Bloomberg reporting and our prior Oracle coverage.

table · 3 cols
If your job looks like…Likely fitWhy
Frontier pre-training at 9k+ chip scaleTPU 8t podsGoogle's deep dive emphasizes torus scale and embedding-heavy training
Low-latency chat or tool-calling agentsTPU 8i today, 8i Max when listedBoardfly plus larger on-chip SRAM target decode bottlenecks
Fine-tuning or RL on regulated recordsTPU 8tx (when available)Confidential path keeps weights and activations in a protected domain
Multi-hour video or repo contextTPU 8i Max (when available)Dual-chip package aims at memory bandwidth per rack
CUDA-first research with no GCP contractNvidia or AMD GPUsTorchTPU helps porting, but CUDA remains the default laptop stack

None of these rows are purchase orders. They tell you which questions to ask a Google account team before you rewrite a training pipeline.

Energy and floor-space framing

Google's April posts emphasized tokens per dollar and watts per token for 8i because inference bills dominate many product P&Ls after models ship. Specialized variants extend that logic: 8i Max trades capital expense in packaging for operating expense saved on renting extra racks; 8tx trades compliance audit cost against risk of multi-cluster data copies.

If you benchmark for procurement, mirror Microsoft's tokens-per-megawatt language in our Maia 300 coverage but insist on your own prompts, batch sizes, and context lengths. Vendor tables almost always use friendly mixture-of-experts mixes.

External customer count: what "nearly 100" implies

On Alphabet's Q3 2026 earnings call, Google Cloud CEO Thomas Kurian said nearly 100 customers already use TPUs, with strong demand from more prospects, per CRN's recap. That is separate from the November 8tx/8i Max Bloomberg report, but it explains why Google is speeding variant cadence: enterprise buyers want security attestations and long-context serving, not only training FLOPS records.

Startups evaluating GCP should ask whether their contract includes eighth-gen access timelines, not only committed use discounts on older Ironwood or Trillium instances listed on the public pricing page.

Porting checklist for PyTorch teams

If you already train on GPUs but want a TPU option when eighth-gen SKUs appear:

  1. Run a toy model through TorchTPU with the same dtype settings you use in production.
  2. Benchmark prefill and decode separately; agent products usually fail on decode queues.
  3. Log collective times when you experiment with MoE models; Boardfly benefits show up only at scale.
  4. Document confidentiality requirements early if you hope to land on 8tx instead of generic 8i.

Book quarterly business reviews with your cloud rep once eighth-gen names appear in contracts; variant SKUs often roll out to committed spend customers before they hit public documentation.

Google's Project Suncatcher orbital compute concept is unrelated to this week's variant news, but it shows how far Google's infrastructure team thinks about specialization tiers across earth and orbit.

Related reading

  • Oracle will offer Google TPUs on OCI in 2027
  • Hugging Face TorchTPU: native PyTorch on Google TPUs
  • vLLM vs SGLang inference server comparison
  • What is a KV cache in LLM inference?
  • AI chip architectures: GPU, TPU, Trainium, Cerebras, Groq
  • Microsoft Maia 300 inference chip plans
Spotted something out of date? Let us know.
Daily briefFrom Yash · 350K+ students taught

Catch up on AI

One AI story explained in plain English, plus one thing to try. Every day, free. Unsubscribe anytime.

  • ✓ Free
  • ✓ One email a day, no spam
  • ✓ Unsubscribe anytime
Yash Thakker

Written by

Yash Thakker

Yash is an AI expert with over 300K learners. Join his workshops →

View Yash Thakker in People in AI →

Related posts

Oct 2, 2026

How Orbital AI Compute Works: Power, TPUs, and Cooling

Project Suncatcher is a hardware survival test, not Gemini from space. This how-it-works guide walks the energy loop — solar in a dawn-dusk orbit, TIM and heat pipes, a radiator that can only reject so many watts, radiation upsets, and why four TPUs pause after about 15 minutes — with interactive labs.

Sep 25, 2026

Google Put Four TPUs in Orbit: What Project Suncatcher Is Actually Testing

Google confirmed the Transporter-18 launch: a Planet-built prototype carrying four TPUs is in orbit and responding. The chips still only burst about 15 minutes before they must cool. This is a hardware survival test, not Gemini from space.

Nov 8, 2026

What Is the KV Cache in LLM Inference? Memory, Context and Tuning

Every new token in an LLM forward pass needs attention over all prior tokens. The KV cache keeps those past key and value tensors in GPU memory so decode steps stay fast. That speed comes at a price: VRAM grows with context length, layer count, and concurrent sessions — the main reason long chats and big batches OOM on local and server GPUs alike.