Supermasks in Superposition

Supermasks in Superposition

26 June 2020

Mitchell Wortsman

Vivek Ramanujan

Aniruddha Kembhavi

Mohammad Rastegari

Papers citing "Supermasks in Superposition"

18 / 68 papers shown

Title
Learning to Prompt for Continual Learning Zifeng Wang Zizhao Zhang Chen-Yu Lee Han Zhang Ruoxi Sun Xiaoqi Ren Guolong Su Vincent Perot Jennifer Dy Tomas Pfister CLL VPVLM KELM VLM 22 738 0 16 Dec 2021
Forward Compatible Training for Large-Scale Embedding Retrieval Systems Vivek Ramanujan Pavan Kumar Anasosalu Vasu Ali Farhadi Oncel Tuzel Hadi Pouransari VLM 32 16 0 06 Dec 2021
Hidden-Fold Networks: Random Recurrent Residuals Using Sparse Supermasks Ángel López García-Arias Masanori Hashimoto Masato Motomura Jaehoon Yu 39 5 0 24 Nov 2021
Avoiding Forgetting and Allowing Forward Transfer in Continual Learning via Sparse Networks Ghada Sokar Decebal Constantin Mocanu Mykola Pechenizkiy CLL 35 8 0 11 Oct 2021
Powerpropagation: A sparsity inducing weight reparameterisation Jonathan Richard Schwarz Siddhant M. Jayakumar Razvan Pascanu P. Latham Yee Whye Teh 92 54 0 01 Oct 2021
Recent Advances of Continual Learning in Computer Vision: An Overview Haoxuan Qu Hossein Rahmani Li Xu Bryan M. Williams Jun Liu VLM CLL 25 73 0 23 Sep 2021
Task-agnostic Continual Learning with Hybrid Probabilistic Models Polina Kirichenko Mehrdad Farajtabar Dushyant Rao Balaji Lakshminarayanan Nir Levine Ang Li Huiyi Hu A. Wilson Razvan Pascanu VLM BDL CLL 27 19 0 24 Jun 2021
Generative Feature-driven Image Replay for Continual Learning Kevin Thandiackal Tiziano Portenier Andrea Giovannini M. Gabrani O. Goksel CLL VLM DiffM 18 9 0 09 Jun 2021
Structured Ensembles: an Approach to Reduce the Memory Footprint of Ensemble Methods Jary Pomponi Simone Scardapane A. Uncini UQCV 49 7 0 06 May 2021
Efficient Feature Transformations for Discriminative and Generative Continual Learning Vinay Kumar Verma Kevin J Liang Nikhil Mehta Piyush Rai Lawrence Carin CLL 38 76 0 25 Mar 2021
Recent Advances on Neural Network Pruning at Initialization Huan Wang Can Qin Yue Bai Yulun Zhang Yun Fu CVBM 33 64 0 11 Mar 2021
Sparse Training Theory for Scalable and Efficient Agents Decebal Constantin Mocanu Elena Mocanu T. Pinto Selima Curci Phuong H. Nguyen M. Gibescu D. Ernst Z. Vale 45 17 0 02 Mar 2021
Posterior Meta-Replay for Continual Learning Christian Henning Maria R. Cervera Francesco DÁngelo J. Oswald Regina Traber Benjamin Ehret Seijin Kobayashi Benjamin Grewe João Sacramento CLL BDL 51 54 0 01 Mar 2021
Efficient Continual Learning with Modular Networks and Task-Driven Priors Tom Véniat Ludovic Denoyer MarcÁurelio Ranzato CLL 30 97 0 23 Dec 2020
Efficient Estimation of Influence of a Training Instance Sosuke Kobayashi Sho Yokoi Jun Suzuki Kentaro Inui TDI 32 15 0 08 Dec 2020
BinPlay: A Binary Latent Autoencoder for Generative Replay Continual Learning Kamil Deja Pawel Wawrzyñski Daniel Marczak Wojciech Masarczyk Tomasz Trzciñski SyDa 16 9 0 25 Nov 2020
Energy-Based Models for Continual Learning Shuang Li Yilun Du Gido M. van de Ven Igor Mordatch 27 42 0 24 Nov 2020
Linear Mode Connectivity in Multitask and Continual Learning Seyed Iman Mirzadeh Mehrdad Farajtabar Dilan Görür Razvan Pascanu H. Ghasemzadeh CLL 37 139 0 09 Oct 2020