v1v2 (latest)

PackNet: Adding Multiple Tasks to a Single Network by Iterative Pruning

15 November 2017

Arun Mallya

Svetlana Lazebnik

CLL

ArXiv (abs)PDF HTML Github (233★)

Papers citing "PackNet: Adding Multiple Tasks to a Single Network by Iterative Pruning"

50 / 751 papers shown

Title
Continual Learning on Graphs: A Survey Zonggui Tian Duanhao Zhang Hong-Ning Dai 105 5 0 09 Feb 2024
Fine-tuning Reinforcement Learning Models is Secretly a Forgetting Mitigation Problem Maciej Wolczyk Bartłomiej Cupiał M. Ostaszewski Michal Bortkiewicz Michal Zajkac Razvan Pascanu Lukasz Kuciñski Piotr Milo's CLL 150 18 0 05 Feb 2024
Class incremental learning with probability dampening and cascaded gated classifier Jary Pomponi Alessio Devoto Simone Scardapane CLL 74 0 0 02 Feb 2024
Multi-granularity Knowledge Transfer for Continual Reinforcement Learning Chaofan Pan Lingfei Ren Hao Wang Linbo Xiong Wei Wei Yonghao Li Xin Yang 138 3 0 25 Jan 2024
Hierarchical Prompts for Rehearsal-free Continual Learning Yukun Zuo Hantao Yao Lu Yu Liansheng Zhuang Changsheng Xu CLL VLM 67 1 0 21 Jan 2024
Towards Open-World Gesture Recognition Junxiao Shen Matthias De Lange X. Xu Enmin Zhou Ran Tan Naveen Suda Maciej Lazarewicz Per Ola Kristensson Amy Karlson Evan Strasnick 47 3 0 20 Jan 2024
CEL: A Continual Learning Model for Disease Outbreak Prediction by Leveraging Domain Adaptation via Elastic Weight Consolidation Saba Aslam Abdur Rasool Hongyan Wu Xiaoli Li 63 5 0 17 Jan 2024
Solving Continual Offline Reinforcement Learning with Decision Transformer Kaixin Huang Li Shen Chen Zhao Chun Yuan Dacheng Tao CLL OffRL 93 5 0 16 Jan 2024
Hierarchical Augmentation and Distillation for Class Incremental Audio-Visual Video Recognition Yukun Zuo Hantao Yao Liansheng Zhuang Changsheng Xu 71 3 0 11 Jan 2024
t-DGR: A Trajectory-Based Deep Generative Replay Method for Continual Learning in Decision Making William Yue Bo Liu Peter Stone 62 5 0 04 Jan 2024
A Comprehensive Study of Knowledge Editing for Large Language Models Ningyu Zhang Yunzhi Yao Bo Tian Peng Wang Shumin Deng ... Lei Liang Qing Cui Xiao-Jun Zhu Jun Zhou Huajun Chen KELM 170 88 0 02 Jan 2024
Continual Learning in Medical Image Analysis: A Comprehensive Review of Recent Advancements and Future Prospects Pratibha Kumari Joohi Chauhan Afshin Bozorgpour Boqiang Huang Reza Azad Dorit Merhof 116 11 0 28 Dec 2023
Federated Continual Learning via Knowledge Fusion: A Survey Xin Yang Hao Yu Xin Gao Hao Wang Junbo Zhang Tianrui Li FedML 81 44 0 27 Dec 2023
Recursive Distillation for Open-Set Distributed Robot Localization Kenta Tsukahara Kanji Tanaka 70 0 0 26 Dec 2023
Doubly Perturbed Task Free Continual Learning Byung Hyun Lee Min-hwan Oh Se Young Chun 84 3 0 20 Dec 2023
Continual Learning: Forget-free Winning Subnetworks for Video Representations Haeyong Kang Jaehong Yoon Sung Ju Hwang Chang D. Yoo CLL 137 2 0 19 Dec 2023
Catastrophic Forgetting in Deep Learning: A Comprehensive Taxonomy Everton L. Aleixo J. Colonna Marco Cristo Everlandio Fernandes CLL 114 27 0 16 Dec 2023
Learning a Low-Rank Feature Representation: Achieving Better Trade-Off between Stability and Plasticity in Continual Learning Zhenrong Liu Yang Li Yi Gong Yik-Chung Wu CLL 47 1 0 14 Dec 2023
ELSA: Partial Weight Freezing for Overhead-Free Sparse Network Deployment Paniz Halvachi Alexandra Peste Dan Alistarh Christoph H. Lampert 70 0 0 11 Dec 2023
Class-Prototype Conditional Diffusion Model with Gradient Projection for Continual Learning Khanh Doan Quyen Tran Tung Lam Tran Tuan Nguyen Dinh Q. Phung Trung Le DiffM 64 2 0 10 Dec 2023
IL-NeRF: Incremental Learning for Neural Radiance Fields with Camera Pose Alignment Letian Zhang Ming Li Chong Chen Jie Xu CLL 63 3 0 10 Dec 2023
Continual learning for surface defect segmentation by subnetwork creation and selection Aleksandr Dekhovich Miguel A. Bessa CLL 64 3 0 08 Dec 2023
Wake-Sleep Consolidated Learning Amelia Sorrenti Giovanni Bellitto Federica Proietto Salanitri M. Pennisi S. Palazzo C. Spampinato CLL 61 0 0 06 Dec 2023
Benchmarking Continual Learning from Cognitive Perspectives Xiaoqian Liu Junge Zhang Mingyi Zhang Peipei Yang 88 1 0 06 Dec 2023
MIND: Multi-Task Incremental Network Distillation Jacopo Bonato Francesco Pelosin Luigi Sabetta Alessandro Nicolosi CLL 98 10 0 05 Dec 2023
Efficient Expansion and Gradient Based Task Inference for Replay Free Incremental Learning Soumya Roy Vinay Kumar Verma Deepak Gupta CLL 123 3 0 02 Dec 2023
Towards Redundancy-Free Sub-networks in Continual Learning Cheng Chen Jingkuan Song LianLi Gao Hengtao Shen 42 1 0 01 Dec 2023
Continual Self-supervised Learning: Towards Universal Multi-modal Medical Data Representation Learning Yiwen Ye Yutong Xie Jianpeng Zhang Ziyang Chen Qi Wu Yong-quan Xia CLL 64 19 0 29 Nov 2023
Class-Adaptive Sampling Policy for Efficient Continual Learning Hossein Rezaei Mohammad Sabokrou 83 0 0 27 Nov 2023
KOPPA: Improving Prompt-based Continual Learning with Key-Query Orthogonal Projection and Prototype-based One-Versus-All Quyen Tran Lam C. Tran Khoat Than Toan M. Tran Dinh Q. Phung Trung Le VLM 89 6 0 26 Nov 2023
Efficient Rehearsal Free Zero Forgetting Continual Learning using Adaptive Weight Modulation Yonatan Sverdlov Shimon Ullman 77 0 0 26 Nov 2023
Task adaption by biologically inspired stochastic comodulation Gauthier Boeshertz Caroline Haimerl Cristina Savin 59 0 0 25 Nov 2023
CMFDFormer: Transformer-based Copy-Move Forgery Detection with Continual Learning Yaqi Liu Chao Xia Song Xiao Qingxiao Guan Wenqian Dong Yifan Zhang Neng H. Yu 55 3 0 22 Nov 2023
Density Distribution-based Learning Framework for Addressing Online Continual Learning Challenges Shilin Zhang Jiahui Wang CLL 59 0 0 22 Nov 2023
CovarNav: Machine Unlearning via Model Inversion and Covariance Navigation Ali Abbasi Chayne Thrash Elaheh Akbari Daniel Zhang Soheil Kolouri MU 70 4 0 21 Nov 2023
BrainWash: A Poisoning Attack to Forget in Continual Learning Ali Abbasi Parsa Nooralinejad Hamed Pirsiavash Soheil Kolouri CLL KELM AAML 119 6 0 20 Nov 2023
Replay-enhanced Continual Reinforcement Learning Tiantian Zhang Kevin Zehua Shen Zichuan Lin Bo Yuan Xueqian Wang Xiu Li Deheng Ye CLL OffRL 76 7 0 20 Nov 2023
One Size Fits All for Semantic Shifts: Adaptive Prompt Tuning for Continual Learning Doyoung Kim Susik Yoon Dongmin Park Youngjun Lee Hwanjun Song Jihwan Bang Jae-Gil Lee VLM 97 4 0 18 Nov 2023
Online Continual Knowledge Learning for Language Models Yuhao Wu Tongjun Shi Karthick Sharma Chun Seah Shuhao Zhang CLL KELM 97 4 0 16 Nov 2023
Investigating the Impact of Weight Sharing Decisions on Knowledge Transfer in Continual Learning Joshua Andle Ali Payani Salimeh Yasaei Sekeh CLL 65 2 0 16 Nov 2023
A Data-Free Approach to Mitigate Catastrophic Forgetting in Federated Class Incremental Learning for Vision Tasks Sara Babakniya Zalan Fabian Chaoyang He Mahdi Soltanolkotabi Salman Avestimehr FedML CLL 84 32 0 13 Nov 2023
Concept Matching: Clustering-based Federated Continual Learning Xiaopeng Jiang Marcello Restelli FedML 103 0 0 12 Nov 2023
Look-Ahead Selective Plasticity for Continual Learning of Visual Tasks Rouzbeh Meshkinnejad Jie Mei Daniel Lizotte Y. Mohsenzadeh SSL CLL 107 3 0 02 Nov 2023
Robust Feature Learning and Global Variance-Driven Classifier Alignment for Long-Tail Class Incremental Learning Jaya Kalla Soma Biswas CLL 99 5 0 02 Nov 2023
Class Incremental Learning with Pre-trained Vision-Language Models Xialei Liu Xusheng Cao Haori Lu Jia-Wen Xiao Andrew D. Bagdanov Ming-Ming Cheng VLM 87 12 0 31 Oct 2023
Look At Me, No Replay! SurpriseNet: Anomaly Detection Inspired Class Incremental Learning Anton Lee Yaqian Zhang Heitor Murilo Gomes Albert Bifet Bernhard Pfahringer CLL 69 2 0 30 Oct 2023
Towards Plastic and Stable Exemplar-Free Incremental Learning: A Dual-Learner Framework with Cumulative Parameter Averaging Wenju Sun Qingyong Li Wen Wang Yangli-ao Geng CLL MoMe 79 3 0 28 Oct 2023
Fantastic Gains and Where to Find Them: On the Existence and Prospect of General Knowledge Transfer between Any Pretrained Model Karsten Roth Lukas Thede Almut Sophia Koepke Oriol Vinyals Olivier J. Hénaff Zeynep Akata AAML 119 13 0 26 Oct 2023
CL-MASR: A Continual Learning Benchmark for Multilingual ASR Luca Della Libera Pooneh Mousavi Salah Zaiem Cem Subakan Mirco Ravanelli AuLLM CLL 98 13 0 25 Oct 2023
Visually Grounded Continual Language Learning with Selective Specialization Kyra Ahrens Lennart Bengtson Jae Hee Lee Stefan Wermter 92 0 0 24 Oct 2023