What can linear attention learn from nonlinear teachers in-context?
Publication information:
M. I. Letey, A. Rysmakhanov, Y. M. Lu, C. Pehlevan, and J. A. Zavatone-Veth,
“What can linear attention learn from nonlinear teachers in-context?”, NeurIPS 2026 Workshop on Principles of Generative Modeling (PriGM), 2026.