Depthwise Hyperparameter Transfer in Residual Networks: Dynamics and Scaling Limit

Publication information:

B. Bordelon*, L. Noci*, M. Li, B. Hanin*, and C. Pehlevan*,
“Depthwise Hyperparameter Transfer in Residual Networks: Dynamics and Scaling Limit”, in NeurIPS 2023 Workshop on Mathematics of Modern Machine Learning, 2023.