Anytime Pretraining: Horizon-Free Learning-Rate Schedules with Weight Averaging
Publication information:
A. Meterez*, P. A. Nair*, D. Morwani*, C. Pehlevan, and S. Kakade,
“Anytime Pretraining: Horizon-Free Learning-Rate Schedules with Weight Averaging”, arXiv preprint arXiv:2602.03702, 2026.