Adaptation Curve

Lens · Models · Compute Architecture

Active parameter counts have plateaued while scale-up domains are set to expand 8x, signaling a shift from model size to interconnect as the frontier lever.

Frontier models have held active parameters per token near 280–288B since 2023, even as NVLink domain sizes jump from 72 GPUs today to 576 in 2027. For lab and app teams, this means the next wave of capability gains is more likely to come from larger coherent compute domains than from raw parameter scaling—and hardware roadmap decisions made now will determine who can exploit that shift.

Why this matters to you

If you're planning a 2027 training run, the rack scale-up domain (heading to 576) is your real ceiling — not peak FLOPS. The model you can train is bounded by what fits in one coherent NVLink domain.

The scissors

FIG 2The scissors: model size vs. the rack

Frontier total parameters (left, log) against the NVLink scale-up domain (right) — the 8 → 72 → 576 staircase. Models got bigger because the coherent fast domain got bigger.

20202021202220232024202520262027100B300B1T2TTotal params872576GPUs / scale-up domainGPT-3PaLMGPT-4*DeepSeek-V3Kimi K2NVL8NVL72NVL576* Undisclosed param counts shown as estimates (params_disclosed=false in DB)
The 8→72 step (GB200 NVL72, 2025) is a 9× expansion of the coherent domain — and it lands the same year ultra-sparse trillion-parameter MoE models became routine. Cause and effect, not coincidence.
Model size and rack scale-up, climbing in lockstep. The 8→72→576 staircase is why trillion-parameter MoE became routine.

The alligator jaws

202020222024202620B100B1TParameterstotal → 1T+active ~288B (flat)gap = sparsity
Total parameters open toward 1T; active stays flat near 30B. The widening gap is the sparsity story — no axis label required.

The flip

100%2026n=2MoEDensepublished model releases
Dense was the default in 2023. By 2025, essentially every open release is MoE. The architecture followed the hardware.

Release cadence

Full timeline →
ModelArchTotal paramsActiveDate
mythos Mythos 5undisclosed2026-06-09
fable Fable 5undisclosed2026-06-09
claude Opus 4.8undisclosed2026-05-28
qwen Qwen3.7-Maxundisclosed2026-05-19
gemini Gemini 3.5 Flashundisclosed2026-05-19
Composer Composer 2.5undisclosedmoe1040B32B2026-05-18
grok Grok 4.3undisclosed2026-04-30
deepseek DeepSeek-V4 Preview (V4-Pro)1600B49B2026-04-24
gpt GPT-5.5undisclosed2026-04-23
claude Opus 4.7undisclosed2026-04-16
gemma Gemma 4 31B (Dense, flagship)31B31B2026-04-02
Composer Composer 2undisclosedmoe1040B32B2026-03-19

The Disclosure Cliff. 27 model releases in the corpus have no disclosed parameter count — the closed frontier stopped publishing in 2025. We track confirmed vs. inferred and flag the blanks honestly, because the blank is itself a finding.

See the Claude family →