Depthwise Hyperparameter Transfer in Residual Networks: Dynamics and Scaling Limit

Publication information:

B. Bordelon*, L. Noci*, M. B. Li, B. Hanin*, and C. Pehlevan*,
“Depthwise Hyperparameter Transfer in Residual Networks: Dynamics and Scaling Limit”, International Conference on Learning Representations (ICLR), 2024.