Sparse Autoencoder Features for Classifications and Transferability

Sparse Autoencoder Features for Classifications and Transferability

17 February 2025

Hugo J. W. L. Aerts

Thomas Hartvigsen

Danielle S. Bitterman

ArXiv (abs)PDF HTML

Papers citing "Sparse Autoencoder Features for Classifications and Transferability"

14 / 14 papers shown

Title
SAE-SSV: Supervised Steering in Sparse Representation Spaces for Reliable Control of Language Models Zirui He Mingyu Jin Bo Shen Ali Payani Yongfeng Zhang Mengnan Du LLMSV 72 0 0 22 May 2025
Investigating task-specific prompts and sparse autoencoders for activation monitoring Henk Tillman Dan Mossing LLMSV 85 1 0 28 Apr 2025
Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering Yu Zhao Alessio Devoto Giwon Hong Xiaotang Du Aryo Pradipta Gema Hongru Wang Xuanli He Kam-Fai Wong Pasquale Minervini KELM LLMSV 112 28 0 21 Oct 2024
Looking Inward: Language Models Can Learn About Themselves by Introspection Felix J Binder James Chua Tomek Korbak Henry Sleight John Hughes Robert Long Ethan Perez Miles Turpin Owain Evans KELM AIFin LRM 92 17 0 17 Oct 2024
Sparse Feature Circuits: Discovering and Editing Interpretable Causal Graphs in Language Models Samuel Marks Can Rager Eric J. Michaud Yonatan Belinkov David Bau Aaron Mueller 138 159 0 28 Mar 2024
Attribution Patching Outperforms Automated Circuit Discovery Aaquib Syed Can Rager Arthur Conmy 135 67 0 16 Oct 2023
Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 small Kevin Wang Alexandre Variengien Arthur Conmy Buck Shlegeris Jacob Steinhardt 314 563 0 01 Nov 2022
Toy Models of Superposition Nelson Elhage Tristan Hume Catherine Olsson Nicholas Schiefer T. Henighan ... Sam McCandlish Jared Kaplan Dario Amodei Martin Wattenberg C. Olah AAML MILM 195 380 0 21 Sep 2022
Locating and Editing Factual Associations in GPT Kevin Meng David Bau A. Andonian Yonatan Belinkov KELM 251 1,389 0 10 Feb 2022
Entity-Based Knowledge Conflicts in Question Answering Shayne Longpre Kartik Perisetla Anthony Chen Nikhil Ramesh Chris DuBois Sameer Singh HILM 333 263 0 10 Sep 2021
An Interpretability Illusion for BERT Tolga Bolukbasi Adam Pearce Ann Yuan Andy Coenen Emily Reif Fernanda Viégas Martin Wattenberg MILM FAtt 83 81 0 14 Apr 2021
Efficient Intent Detection with Dual Sentence Encoders I. Casanueva Tadas Temvcinas D. Gerz Matthew Henderson Ivan Vulić VLM 370 479 0 10 Mar 2020
Baseline Needs More Love: On Simple Word-Embedding-Based Models and Associated Pooling Mechanisms Dinghan Shen Guoyin Wang Wenlin Wang Martin Renqiang Min Qinliang Su Yizhe Zhang Chunyuan Li Ricardo Henao Lawrence Carin 60 330 0 24 May 2018
Deep Learning using Rectified Linear Units (ReLU) Abien Fred Agarap 81 3,241 0 22 Mar 2018

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.