Attention approximates Sparse Distributed Memory

Publication information:

T. Bricken and C. Pehlevan,
“Attention approximates Sparse Distributed Memory”, in Advances in Neural Information Processing Systems (NeurIPS), 2021.
Share on: