explainx.ainewsletter3.5k
TrendingNewsPathwaysSkills
Pricing
explainx.ai

Upskill in AI — 16 free pathways, live workshops & bootcamps, and 50+ courses from practitioners. Plus the skills, tools, and MCP servers to practice on.

follow us

custom AI agents

[email protected]

get started

Find your pathTake Free Evaluation

learn

pathways — start freeworkshopsbootcampscoursescertificationsmock testsexplainx universitycorporate traininglearn skills & mcp

discover

skillsmcp serversexplainx mcptoolsagentsllmsdesignsagi trackerranks

company

aboutvisionmissionteaminstructorscommunityhackathonscareers

content

daily AI newsstate of AI — live resultsblogreleasespromptsgeneratorsresource librarydemofor LLMs

solutions

all solutionsdeveloper upskillingmarketing upskillingproduct manager upskillingleadership upskilling

More from us

InfloqInfluencer marketingBgBlurPrivacy-first blurOlly SocialSocial AI copilotCeptoryVideo intelligenceBgRemoverBackground removal

newsletter · weekly

Get AI news, tools, and insights in your inbox.

supportprivacytermsdata rightssubmission guidelines

© 2026 AISOLO Technologies Pvt Ltd

On this page

  • TL;DR
  • What people are asking
  • What a parameter is (mechanically)
  • Total vs active parameters (MoE)
  • Top 10 disclosed model sizes (July 2026)
  • Closed models: the “undisclosed” tier
  • Practical checklist
  • Honest limitations
  • FAQ in practice
  • Closing
  • Related on explainx.ai
← Back to blog

explainx / blog

What Are LLM Parameters? Top 10 Model Sizes (July 2026)

LLM parameters are learned weights. Total vs active MoE, memory math, and the top 10 disclosed model sizes as of July 2026 — Kimi K3 2.8T to Qwen 3.5.

Jul 31, 2026·9 min read·Yash Thakker
LLM BasicsModel ParametersMoEOpen Weights2026 Guide
go deep
What Are LLM Parameters? Top 10 Model Sizes (July 2026)

“How big is the model?” usually means one number: parameters. In July 2026 that number can be 2.8 trillion — and still not tell you the bill.

Parameters are the learned weights inside a neural net. They are not tokens (pieces of text) and not context window (how much text fits per request). This guide explains what the count measures, why total vs active matters for MoE, and ranks the top 10 disclosed model sizes as of July 2026 — with Kimi K3 at 2.8T on top of the open-flagship chart.

If you already read our April parameters primer, treat this as the July 2026 scale update plus a fuller top-10 table.

Weekly digest3.5k readers

Catch up on AI

Curated AI updates on agents, skills, and MCP — delivered to your inbox. Unsubscribe anytime.

TL;DR

QuestionAnswer
What are parameters?Learnable weights (and biases) in the checkpoint
UnitBillions (B) or trillions (T)
Dense vs MoEDense ≈ all weights run; MoE = huge total, smaller active
Largest disclosed (Jul 2026)Kimi K3 — 2.8T total
#2 / #3Qwen 3.8-Max ~2.4T · DeepSeek V4 Pro 1.6T
Closed frontierUsually undisclosed (Claude / GPT / Gemini)
Best use of the numberMemory planning + MoE cost intuition — not “smarter”
CompanionTokens · context · Fable size rumor debate

What people are asking

“Are parameters the same as neurons?”

No. A neuron (unit) applies an activation to an incoming signal. Parameters are the adjustable numbers on the connections (and biases) that make that math learnable. Counting parameters is counting scalars in weight tensors, not “how many brain cells.”

“Is a 2.8T model 2.8× smarter than a 1T model?”

No. Capacity can grow with size under similar data and compute, but quality is training recipe, data mix, post-training, and the agent harness. Moonshot itself says K3 trails Claude Fable 5 and GPT-5.6 Sol overall despite leading open total size.

“Why does MoE break the ‘bigger = costlier’ intuition?”

Because you pay roughly for active experts per token, not every expert in the warehouse. K3’s 16 of 896 experts is the inference story; 2.8T is the warehouse size.

What a parameter is (mechanically)

A modern LLM is mostly a transformer: stacked layers of attention and feed-forward networks. Each layer holds large matrices. During pretraining, gradient updates nudge those matrix entries so next-token prediction improves. Fine-tuning / RL / preference stages keep adjusting the same (or LoRA-adapted) weights.

Parameter count = how many of those learned scalars exist in the released checkpoint (sometimes excluding tokenizer embeddings or multimodal towers — read the card).

ConceptWhat it measures
ParametersSize of learned weights
TokensText pieces in/out (explainer)
Context windowMax tokens per request
FLOPsCompute to train or run
$/M tokensAPI meter — often decoupled from public size

Memory rule of thumb

PrecisionBytes / param70B weights alone1T weights alone
fp16 / bf16~2~140 GB~2 TB
int8~1~70 GB~1 TB
4-bit~0.5~35 GB~500 GB

Add KV cache (scales with context × layers × batch) and activations. 1-bit GGUF / Unsloth style packs stretch consumer hardware further — still not “2.8T dense on a laptop.”

Total vs active parameters (MoE)

Dense: almost all parameters participate each step. “70B” ≈ 70B weights on the hot path.

Mixture of experts (MoE): many expert FFNs; a router picks a few per token.

TermMeaningWhy you care
Total paramsAll experts + shared layersDownload size, “headline” brag
Active / activatedWeights used for a typical tokenLatency, $/token, VRAM if experts page in
ExpertsParallel specialist FFNsCapacity without proportional cost

Examples (vendor-reported):

ModelTotalActive (typical)
Kimi K32.8T16 / 896 experts
DeepSeek V4 Pro1.6T~49B
DeepSeek V4 Flash284B~13B
Llama 4 Maverick400B17B
Llama 4 Scout109B17B

Same 17B active on Scout vs Maverick, different totals and context — Meta’s card is the textbook “don’t confuse the two columns” example. Deeper primer: parameters billions explained.

Top 10 disclosed model sizes (July 2026)

Scope: flagship / frontier-class models with public or widely tracked total parameter counts, ranked by total params as of late July 2026. Closed API models without official counts are excluded from the ranked list (see next section).

Numbers come from vendor docs and explainx.ai’s July open-frontier tracking (Kimi chart + sibling posts). Re-verify cards before procurement.

RankModelOrgTotal paramsNotes
1Kimi K3Moonshot2.8TOpen 3T-class claim; MoE 16/896; weights live Jul 26
2Qwen 3.8-MaxAlibaba~2.4TPreview / open weights rolling; China open-weight push
3DeepSeek V4 ProDeepSeek1.6T~49B active; aggressive API pricing
4LongCat-2.0LongCat1.6TMoE coding-agent class; confirm weight status
5MiMo V2.5 ProXiaomi1.02TMay 2026 open-flagship tracker
6InklingThinking Machines975BOpen MoE; Jun/Jul 2026
7GLM-5 / 5.xZhipu / Z.AI744BStrong local + coding-plan story
8DeepSeek-R1DeepSeek671B2025 open reasoning landmark; still widely cited
9MiniMax M3MiniMax428BJun 2026 open-flagship tracker
10Llama 4 Maverick / Qwen 3.5Meta / Alibaba~400B / 397BMaverick 400B total / 17B active; Qwen 3.5 ~397B

Honorable mentions: Llama 4 Scout 109B total / 17B active (huge context, not a total-size top-10); dense coding 70B-class models that punch above size on SWE benches.

How to read this leaderboard

  1. Open-weight / disclosed ≠ closed frontier quality. Fable 5 and GPT-5.6 Sol still win many overall tables without publishing B/T.
  2. Ties and “~” mean marketing vs audited cards — prefer primary docs.
  3. Active params reorder the cost ranking (V4 Pro’s 49B active vs a dense 70B).
  4. Charts move monthly — this snapshot is July 2026.

Open frontier model size — Kimi K3 2.8T leads mid-2026 tracker

Community open-flagship size chart used in our Kimi K3 coverage (July 2025–July 2026).

Closed models: the “undisclosed” tier

FamilyPublic size?What to use instead
Claude (Sonnet / Opus / Fable / Mythos)Officially noContext, tools, price; rumor debate is unverified
GPT-5.x / SolTypically noArena / SWE / product evals
GeminiUsually no on consumer cardsModalities + context docs

Viral claims (“Fable is 10T”) are not Anthropic statements. Throughput reverse-engineering and partner leaks are weak evidence. For buyers: benchmarks + harness + price, not folklore.

Practical checklist

text
□ Need local fit? → active params + quantization + KV for your context
□ Comparing MoE? → always ask total AND active (and expert count)
□ Closed API? → ignore rumor B/T; run your eval suite
□ Open weights? → read LICENSE + model card before production
□ Ranking “largest”? → say “disclosed total as of <date>”
□ Quality bet? → prefer task benches over size leaderboard

Example: picking between two MoEs

If you care about…Prefer
Headline open scale / researchKimi K3 2.8T
Cheap reasoning APIDeepSeek V4 Pro (1.6T / ~49B active)
Meta ecosystem + documented MoE tableLlama 4 Maverick / Scout
Local Mac experimentsSmaller Quants / GLM local guides — not full 2.8T dense

Honest limitations

  • Top-10 is disclosed totals, not “best models.”
  • Some “open” sizes are preview / pending weights — status changes weekly.
  • Multimodal towers can add params not in the LLM headline.
  • Distillation and rename games (Opus pricing cliffs) break naive size→price maps.
  • Our World in Data / academic lists lag 2026 China open releases — prefer primary cards.
  • Parameter count says nothing about safety, copyright, or eval harness quality.

FAQ in practice

Should I fine-tune a 2.8T MoE? Usually no — LoRA on a smaller dense or distillate is cheaper and easier to host. Reserve full-scale fine-tunes for labs with multi-node training budgets.

Does quantization change the “parameter count”? No. Quantization changes bytes per parameter, not how many parameters exist. A 70B model stays 70B at 4-bit; it just occupies less disk and VRAM.

Where do embeddings / vision towers fit? Multimodal cards sometimes list a separate vision or audio encoder budget. When comparing “LLM size,” check whether the headline number is language-only or the full multimodal stack.

Closing

Parameters = how many learned numbers the model stores. July 2026’s disclosed race is led by Kimi K3 at 2.8T, with Qwen 3.8-Max ~2.4T and DeepSeek V4 Pro 1.6T close behind on the open chart — while Western closed frontiers mostly refuse to publish a number at all. Learn total vs active, plan memory from active + precision, and buy with evals, not trillions.

Follow @explainx_ai when the next open flagship reshuffles this table.

Related on explainx.ai

  • What are parameters? (April primer)
  • What are LLM tokens?
  • LLM context window explained 2026
  • Kimi K3 open weights — 2.8T
  • Kimi K3 API / architecture guide
  • Claude / Fable parameter rumor debate
  • Qwen 3.8-Max preview — ~2.4T
  • DeepSeek V4 Pro pricing
  • Inkling 975B open MoE
  • Top 10 open-weight models for laptops
  • Caveman token compression

Sources

  • Moonshot — Kimi K3 / platform docs
  • DeepSeek — V4 Pro model & pricing docs
  • Meta — Llama 4 model card
  • Alibaba Qwen 3.8-Max / Qwen 3.5 public materials
  • explainx.ai July 2026 open-frontier size tracking (Kimi K3 post)

Parameter figures are vendor-reported or community-tracked as of July 31, 2026. Prefer the live model card for any deployment decision. Closed-model size rumors remain unverified unless the lab publishes them.

Yash Thakker

Written by

Yash Thakker

Yash is an AI expert with over 300K learners. Join his workshops →

Related posts

Jul 29, 2026

Deltafin: Run Kimi K3 (2.8T MoE) on One Apple Silicon Mac

Not chat-speed — an existence proof. Deltafin keeps a ~114 GB spine local, pulls 16 experts/layer from disk or Hugging Face, and serves greedy, reproducible tokens (plus reasoning_content) over an OpenAI-compatible server.

Jul 29, 2026

Kimi K3 Architecture Explained: LatentMoE, NoPE, KDA, Attention Residuals

K3 is a scaled-up Kimi Linear (48B → 2.8T) with LatentMoE as the new piece. explainx.ai walks Raschka’s map, the NoPE HN debate, and how this differs from DeepSeek V4’s mHC residual path.

Jul 17, 2026

How to Run Kimi K3 Locally — Confirmed Hardware Tiers and vLLM Setup (2026)

Moonshot's Kimi K3 open weights went live July 26, 2026. This guide covers what actually changed once the download landed — confirmed license, real disk and VRAM numbers, a working vLLM serve command instead of a placeholder, and where community GGUF quants stand two days after release.