Decoupled DiLoCo for Resilient Distributed Pre-training April 23, 2026 Authored by: Professor Blake Woodworth Decoupled DiLoCo for Resilient Distributed Pre-training Read more at: https://arxiv.org/abs/2604.21428