Forget-free Continual Learning with Soft-Winning SubNetworks

27 March 2023

Haeyong Kang

Jaehong Yoon

Sultan Rizky Hikmawan Madjid

Papers citing "Forget-free Continual Learning with Soft-Winning SubNetworks"

50 / 58 papers shown

Title
On the Soft-Subnetwork for Few-shot Class Incremental Learning Haeyong Kang Jaehong Yoon Sultan Rizky Hikmawan Madjid Sung Ju Hwang Chang D. Yoo CLL 81 42 0 15 Sep 2022
Few-Shot Class-Incremental Learning from an Open-Set Perspective Can Peng Kun-li Zhao Tianren Wang Meng Li Brian C. Lovell CLL 41 89 0 30 Jul 2022
Few-Shot Class-Incremental Learning via Entropy-Regularized Data-Free Replay Huan Liu Li Gu Zhixiang Chi Yang Wang Yuanhao Yu Jun Chen Jingshan Tang 65 84 0 22 Jul 2022
Meta-ticket: Finding optimal subnetworks for few-shot learning within randomly initialized neural networks Daiki Chijiwa Shin'ya Yamaguchi Atsutoshi Kumagai Yasutoshi Ida 68 9 0 31 May 2022
Few-Shot Class-Incremental Learning by Sampling Multi-Phase Tasks Da-Wei Zhou Han-Jia Ye Liang Ma Di Xie Shiliang Pu De-Chuan Zhan CLL 83 125 0 31 Mar 2022
Constrained Few-shot Class-incremental Learning Michael Hersche G. Karunaratne G. Cherubini Luca Benini Abu Sebastian Abbas Rahimi CLL 92 142 0 30 Mar 2022
Overcoming Catastrophic Forgetting in Incremental Few-Shot Learning by Finding Flat Minima Guangyuan Shi Jiaxin Chen Wenlong Zhang Li-Ming Zhan Xiao-Ming Wu CLL 121 152 0 30 Oct 2021
Subspace Regularizers for Few-Shot Class Incremental Learning Afra Feyza Akyürek Ekin Akyürek Derry Wijaya Jacob Andreas CLL 59 61 0 13 Oct 2021
Flattening Sharpness for Dynamic Gradient Projection Memory Benefits Continual Learning Danruo Deng Guangyong Chen Jianye Hao Qiong Wang Pheng-Ann Heng CLL AAML 46 79 0 09 Oct 2021
Self-Promoted Prototype Refinement for Few-Shot Class-Incremental Learning Kai Zhu Yang Cao Wei Zhai Jie Cheng Zhengjun Zha CLL 101 145 0 19 Jul 2021
Online Coreset Selection for Rehearsal-based Continual Learning Jaehong Yoon Divyam Madaan Eunho Yang Sung Ju Hwang CLL 67 141 0 02 Jun 2021
Few-Shot Incremental Learning with Continually Evolved Classifiers Chi Zhang Nan Song Guosheng Lin Yun Zheng Pan Pan Yinghui Xu CLL 81 294 0 07 Apr 2021
Gradient Projection Memory for Continual Learning Gobinda Saha Isha Garg Kaushik Roy VLM CLL 67 282 0 17 Mar 2021
Semantic-aware Knowledge Distillation for Few-Shot Class-Incremental Learning A. Cheraghian Shafin Rahman Pengfei Fang S. Roy L. Petersson Mehrtash Harandi CLL 126 184 0 06 Mar 2021
Few-Shot Lifelong Learning Pratik Mazumder Pravendra Singh Piyush Rai CLL 55 120 0 01 Mar 2021
Continual Learning in Low-rank Orthogonal Subspaces Arslan Chaudhry Naeemullah Khan P. Dokania Philip Torr CLL 51 121 0 22 Oct 2020
Linear Mode Connectivity in Multitask and Continual Learning Seyed Iman Mirzadeh Mehrdad Farajtabar Dilan Görür Razvan Pascanu H. Ghasemzadeh CLL 61 141 0 09 Oct 2020
La-MAML: Look-ahead Meta Learning for Continual Learning Gunshi Gupta Karmesh Yadav Liam Paull CLL VLM 66 69 0 27 Jul 2020
Supermasks in Superposition Mitchell Wortsman Vivek Ramanujan Rosanne Liu Aniruddha Kembhavi Mohammad Rastegari J. Yosinski Ali Farhadi SSL CLL 64 293 0 26 Jun 2020
Few-Shot Class-Incremental Learning Xiaoyu Tao Xiaopeng Hong Xinyuan Chang Songlin Dong Xing Wei Yihong Gong CLL 88 410 0 23 Apr 2020
Continual Learning with Node-Importance based Adaptive Group Sparse Regularization Sangwon Jung Hongjoon Ahn Sungmin Cha Taesup Moon CLL 48 124 0 30 Mar 2020
Good Subnetworks Provably Exist: Pruning via Greedy Forward Selection Mao Ye Chengyue Gong Lizhen Nie Denny Zhou Adam R. Klivans Qiang Liu 64 110 0 03 Mar 2020
PyHessian: Neural Networks Through the Lens of the Hessian Z. Yao A. Gholami Kurt Keutzer Michael W. Mahoney ODL 51 302 0 16 Dec 2019
Fantastic Generalization Measures and Where to Find Them Yiding Jiang Behnam Neyshabur H. Mobahi Dilip Krishnan Samy Bengio AI4CE 129 606 0 04 Dec 2019
What's Hidden in a Randomly Weighted Neural Network? Vivek Ramanujan Mitchell Wortsman Aniruddha Kembhavi Ali Farhadi Mohammad Rastegari 66 356 0 29 Nov 2019
Decoupling Representation and Classifier for Long-Tailed Recognition Bingyi Kang Saining Xie Marcus Rohrbach Zhicheng Yan Albert Gordo Jiashi Feng Yannis Kalantidis OODD 172 1,217 0 21 Oct 2019
Online Continual Learning with Maximally Interfered Retrieval Rahaf Aljundi Lucas Caccia Eugene Belilovsky Massimo Caccia Min Lin Laurent Charlin Tinne Tuytelaars CLL 67 541 0 11 Aug 2019
Task Agnostic Continual Learning via Meta Learning Xu He Jakub Sygnowski Alexandre Galashov Andrei A. Rusu Yee Whye Teh Razvan Pascanu OOD CLL FedML 49 94 0 12 Jun 2019
Discovering Neural Wirings Mitchell Wortsman Ali Farhadi Mohammad Rastegari AI4CE 96 121 0 03 Jun 2019
Large Scale Incremental Learning Yue Wu Yinpeng Chen Lijuan Wang Yuancheng Ye Zicheng Liu Yandong Guo Y. Fu CLL 89 1,256 0 30 May 2019
Deconstructing Lottery Tickets: Zeros, Signs, and the Supermask Hattie Zhou Janice Lan Rosanne Liu J. Yosinski UQCV 52 386 0 03 May 2019
Learn to Grow: A Continual Structure Learning Framework for Overcoming Catastrophic Forgetting Xilai Li Yingbo Zhou Tianfu Wu R. Socher Caiming Xiong CLL 70 429 0 31 Mar 2019
Continual Learning via Neural Pruning Siavash Golkar Michael Kagan Kyunghyun Cho CLL 48 161 0 11 Mar 2019
On Tiny Episodic Memories in Continual Learning Arslan Chaudhry Marcus Rohrbach Mohamed Elhoseiny Thalaiyasingam Ajanthan P. Dokania Philip Torr MarcÁurelio Ranzato CLL 82 399 0 27 Feb 2019
Scalable and Order-robust Continual Learning with Additive Parameter Decomposition Jaehong Yoon Saehoon Kim Eunho Yang Sung Ju Hwang CLL 70 177 0 25 Feb 2019
Functional Regularisation for Continual Learning with Gaussian Processes Michalis K. Titsias Jonathan Richard Schwarz A. G. Matthews Razvan Pascanu Yee Whye Teh CLL BDL 61 186 0 31 Jan 2019
Efficient Lifelong Learning with A-GEM Arslan Chaudhry MarcÁurelio Ranzato Marcus Rohrbach Mohamed Elhoseiny CLL 188 1,453 0 02 Dec 2018
Learning to Learn without Forgetting by Maximizing Transfer and Minimizing Interference Matthew D Riemer Ignacio Cases R. Ajemian Miao Liu Irina Rish Y. Tu Gerald Tesauro CLL 72 783 0 29 Oct 2018
Reinforced Continual Learning Ju Xu Zhanxing Zhu CLL 95 377 0 31 May 2018
The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks Jonathan Frankle Michael Carbin 225 3,461 0 09 Mar 2018
Alleviating catastrophic forgetting using context-dependent gating and synaptic stabilization Nicolas Y. Masse Gregory D. Grant David J. Freedman 73 281 0 02 Feb 2018
Overcoming catastrophic forgetting with hard attention to the task Joan Serrà Dídac Surís M. Miron Alexandros Karatzoglou CLL 98 1,075 0 04 Jan 2018
PackNet: Adding Multiple Tasks to a Single Network by Iterative Pruning Arun Mallya Svetlana Lazebnik CLL 105 1,298 0 15 Nov 2017
Hierarchical Representations for Efficient Architecture Search Hanxiao Liu Karen Simonyan Oriol Vinyals Chrisantha Fernando Koray Kavukcuoglu 3DV 83 926 0 01 Nov 2017
Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms Han Xiao Kashif Rasul Roland Vollgraf 264 8,876 0 25 Aug 2017
Lifelong Learning with Dynamically Expandable Networks Jaehong Yoon Eunho Yang Jeongtae Lee Sung Ju Hwang CLL 117 1,222 0 04 Aug 2017
Gradient Episodic Memory for Continual Learning David Lopez-Paz MarcÁurelio Ranzato VLM CLL 111 2,711 0 26 Jun 2017
Continual Learning with Deep Generative Replay Hanul Shin Jung Kwon Lee Jaehong Kim Jiwon Kim KELM CLL 76 2,069 0 24 May 2017
Overcoming catastrophic forgetting in neural networks J. Kirkpatrick Razvan Pascanu Neil C. Rabinowitz J. Veness Guillaume Desjardins ... A. Grabska-Barwinska Demis Hassabis Claudia Clopath D. Kumaran R. Hadsell CLL 344 7,498 0 02 Dec 2016
iCaRL: Incremental Classifier and Representation Learning Sylvestre-Alvise Rebuffi Alexander Kolesnikov G. Sperl Christoph H. Lampert CLL OOD 129 3,754 0 23 Nov 2016