Title
Weight Factorization and Centralization for Continual Learning in Speech Recognition Enes Yavuz Ugan Ngoc-Quan Pham Alexander Waibel CLL MoMe 27 0 0 19 Jun 2025
TAH-QUANT: Effective Activation Quantization in Pipeline Parallelism over Slow Network Guangxin He Yuan Cao Yutong He Tianyi Bai Kun Yuan Binhang Yuan MQ 61 0 0 02 Jun 2025
MuLoCo: Muon is a practical inner optimizer for DiLoCo Benjamin Thérien Xiaolong Huang Irina Rish Eugene Belilovsky MoE 57 0 0 29 May 2025
Communication-Efficient Language Model Training Scales Reliably and Robustly: Scaling Laws for DiLoCo Zachary B. Charles Gabriel Teston Lucio Dery Keith Rush Nova Fallen Zachary Garrett Arthur Szlam Arthur Douillard 461 6 0 12 Mar 2025