GPU Infrastructure Capacity Planning Reliability Gemma

Decoupled DiLoCo

Open-source research code for low-communication distributed training

Visit site

Open-source research software for Decoupled DiLoCo, a distributed low-communication training approach.

Recent stories

1 linked story

releasePRIMARY2026-04-23

Google DeepMind releases Decoupled DiLoCo with 12B Gemma training across 4 US regions

Google DeepMind introduced Decoupled DiLoCo, a distributed-training method that trained a 12B Gemma model across four US regions and mixed TPU6e/v5p hardware while tolerating failures. It matters because it targets the networking and uptime bottlenecks that make frontier training geographically rigid and operationally fragile.