GPU Infrastructure Capacity Planning Reliability Gemma

Decoupled DiLoCo

Decoupled DiLoCo codebase

Software product/codebase titled Decoupled DiLoCo. I could not verify a first-party product page in this run, so this is a low-confidence catalog entry.

Recent stories

1 linked story

releasePRIMARY2026-04-23

Google DeepMind releases Decoupled DiLoCo with 12B Gemma training across 4 US regions

Google DeepMind introduced Decoupled DiLoCo, a distributed-training method that trained a 12B Gemma model across four US regions and mixed TPU6e/v5p hardware while tolerating failures. It matters because it targets the networking and uptime bottlenecks that make frontier training geographically rigid and operationally fragile.