Papers
Communities
Events
Blog
Pricing
Search
Open menu
Home
Papers
2410.23819
Cited By
Weight decay induces low-rank attention layers
31 October 2024
Seijin Kobayashi
Yassir Akram
J. Oswald
Re-assign community
ArXiv
PDF
HTML
Papers citing
"Weight decay induces low-rank attention layers"
2 / 2 papers shown
Title
Formation of Representations in Neural Networks
Liu Ziyin
Isaac Chuang
Tomer Galanti
T. Poggio
39
4
0
03 Oct 2024
Remove Symmetries to Control Model Expressivity and Improve Optimization
Liu Ziyin
Yizhou Xu
Isaac Chuang
AAML
41
1
0
28 Aug 2024
1