Pretrain-Test Task Alignment Model for In-Context Learning by Linear Attention

Publication information:

M. I. Letey, Y. M. Lu, and C. Pehlevan,
“Pretrain-Test Task Alignment Model for In-Context Learning by Linear Attention”, NeurIPS Workshop: What Can(’t) Transformers Do?, 2025.