Infinite Limits of Multi-head Transformer Dynamics

Publication information:

B. Bordelon, H. T. Chaudhry, and C. Pehlevan,
“Infinite Limits of Multi-head Transformer Dynamics”, Advances in Neural Information Processing Systems (NeurIPS), 2024.