Adaptive Sparse Allocation with Mutual Choice & Feature Choice Sparse
Autoencoders

v1v2 (latest)

Adaptive Sparse Allocation with Mutual Choice & Feature Choice Sparse Autoencoders

4 November 2024

ArXiv (abs)PDF HTML

Papers citing "Adaptive Sparse Allocation with Mutual Choice & Feature Choice Sparse Autoencoders"

7 / 7 papers shown

Title
Revisiting End-To-End Sparse Autoencoder Training: A Short Finetune Is All You Need Adam Karvonen 75 0 0 21 Mar 2025
Measuring Progress in Dictionary Learning for Language Model Interpretability with Board Game Models Adam Karvonen Benjamin Wright Can Rager Rico Angell Jannik Brinkmann Logan Smith C. M. Verdun David Bau Samuel Marks 68 31 0 31 Jul 2024
Routers in Vision Mixture of Experts: An Empirical Study Tianlin Liu Mathieu Blondel C. Riquelme J. Puigcerver MoE 73 3 0 29 Jan 2024
Adaptive Computation with Elastic Input Sequence Fuzhao Xue Valerii Likhosherstov Anurag Arnab N. Houlsby Mostafa Dehghani Yang You 63 20 0 30 Jan 2023
Mixture-of-Experts with Expert Choice Routing Yan-Quan Zhou Tao Lei Han-Chu Liu Nan Du Yanping Huang Vincent Zhao Andrew M. Dai Zhifeng Chen Quoc V. Le James Laudon MoE 298 358 0 18 Feb 2022
Adaptive Computation Time for Recurrent Neural Networks Alex Graves 114 547 0 29 Mar 2016
Building high-level features using large scale unsupervised learning Quoc V. Le MarcÁurelio Ranzato R. Monga M. Devin Kai Chen G. Corrado J. Dean A. Ng SSL OffRL CVBM 119 2,271 0 29 Dec 2011