v1v2 (latest)

PackNet: Adding Multiple Tasks to a Single Network by Iterative Pruning

15 November 2017

Arun Mallya

Svetlana Lazebnik

CLL

ArXiv (abs)PDF HTML Github (233★)

Papers citing "PackNet: Adding Multiple Tasks to a Single Network by Iterative Pruning"

50 / 751 papers shown

Title
Buffer-based Gradient Projection for Continual Federated Learning Shenghong Dai Jy-yong Sohn Yicong Chen S. Alam Ravikumar Balakrishnan Suman Banerjee N. Himayat Kangwook Lee FedML 97 2 0 03 Sep 2024
Towards General Industrial Intelligence: A Survey on IIoT-Enhanced Continual Large Models Jiao Chen Jiayi He Fangfang Chen Zuohong Lv Jianhua Tang Weihua Li Zuozhu Liu Howard H. Yang Guangjie Han AI4CE 82 1 0 02 Sep 2024
Diffusion-Driven Data Replay: A Novel Approach to Combat Forgetting in Federated Class Continual Learning Jinglin Liang Jin Zhong Hanlin Gu Zhongqi Lu Xingxing Tang Gang Dai Shuangping Huang Lixin Fan Qiang Yang DiffM 110 9 0 02 Sep 2024
Incremental Open-set Domain Adaptation Sayan Rakshit Hmrishav Bandyopadhyay Nibaran Das Biplab Banerjee CLL 69 1 0 31 Aug 2024
Anno-incomplete Multi-dataset Detection Yiran Xu Haoxiang Zhong Kai Wu Jialin Li Yong Liu Chengjie Wang Shu-Tao Xia Hongen Liao ObjD 73 0 0 29 Aug 2024
Prior-free Balanced Replay: Uncertainty-guided Reservoir Sampling for Long-Tailed Continual Learning Lei Liu Li Liu Yawen Cui CLL 57 0 0 27 Aug 2024
Mitigating the Stability-Plasticity Dilemma in Adaptive Train Scheduling with Curriculum-Driven Continual DQN Expansion Achref Jaziri Etienne Kunzel Visvanathan Ramesh CLL 106 0 0 19 Aug 2024
SRTFD: Scalable Real-Time Fault Diagnosis through Online Continual Learning Dandan Zhao Karthick Sharma Hongpeng Yin Yuxin Qi Shuhao Zhang AI4CE 75 0 0 11 Aug 2024
SR-CIS: Self-Reflective Incremental System with Decoupled Memory and Reasoning Biqing Qi Junqi Gao Xinquan Chen Dong Li Weinan Zhang Bowen Zhou CLL 65 1 0 04 Aug 2024
Towards Generalizable Reinforcement Learning via Causality-Guided Self-Adaptive Representations Yupei Yang Erdun Gao Fan Feng Xinyue Wang Shikui Tu Lei Xu CML OOD TTA 108 1 0 30 Jul 2024
EverAdapt: Continuous Adaptation for Dynamic Machine Fault Diagnosis Environments Edward Mohamed Ragab Yuecong Xu Min-man Wu Yuecong Xu Zhenghua Chen Abdulla Alseiari Xiaoli Li 68 2 0 24 Jul 2024
Local vs Global continual learning Giulia Lanzillotta Sidak Pal Singh Benjamin Grewe Thomas Hofmann CLL 83 0 0 23 Jul 2024
Strike a Balance in Continual Panoptic Segmentation Jinpeng Chen Runmin Cong Yuxuan Luo H. Ip Sam Kwong 108 4 0 23 Jul 2024
CLIP with Generative Latent Replay: a Strong Baseline for Incremental Learning Emanuele Frascaroli Aniello Panariello Pietro Buzzega Lorenzo Bonicelli Angelo Porrello Simone Calderara VLM CLL 81 6 0 22 Jul 2024
Flatness-aware Sequential Learning Generates Resilient Backdoors Hoang Pham The-Anh Ta Anh Tran Khoa D. Doan FedML AAML 76 1 0 20 Jul 2024
Adaptive Cascading Network for Continual Test-Time Adaptation Kien X. Nguyen Fengchun Qiao Xi Peng TTA CLL VLM 76 1 0 17 Jul 2024
CroMo-Mixup: Augmenting Cross-Model Representations for Continual Self-Supervised Learning Erum Mushtaq D. Yaldiz Yavuz Faruk Bakman Jie Ding Chenyang Tao Dimitrios Dimitriadis A. Avestimehr CLL 90 1 0 16 Jul 2024
Mitigating Background Shift in Class-Incremental Semantic Segmentation Gilhan Park WonJun Moon Subeen Lee Tae-Young Kim Jae-Pil Heo CLL VLM 97 3 0 16 Jul 2024
Bridge Past and Future: Overcoming Information Asymmetry in Incremental Object Detection Qijie Mo Yipeng Gao Shenghao Fu Junkai Yan Ancong Wu Wei-Shi Zheng CLL 93 7 0 16 Jul 2024
Overcoming Catastrophic Forgetting in Federated Class-Incremental Learning via Federated Global Twin Generator Thinh Nguyen Khoa D. Doan Binh T. Nguyen Danh Le-Phuoc Kok-Seng Wong FedML 77 0 0 13 Jul 2024
Cs2K: Class-specific and Class-shared Knowledge Guidance for Incremental Semantic Segmentation Wei Cong Yang Cong Yuyang Liu Gan Sun VLM CLL 79 3 0 12 Jul 2024
BiasPruner: Debiased Continual Learning for Medical Image Classification Nourhan Bayasi Jamil Fayyad Alceu Bissoto Ghassan Hamarneh Rafeef Garbi CLL 78 4 0 11 Jul 2024
Exemplar-free Continual Representation Learning via Learnable Drift Compensation Alex Gomez-Villa Dipam Goswami Kai Wang Andrew D. Bagdanov Bartlomiej Twardowski Joost van de Weijer CLL SSL 79 11 0 11 Jul 2024
CLEO: Continual Learning of Evolving Ontologies Shishir Muralidhara Saqib Bukhari Georg Schneider Didier Stricker René Schuster CLL 77 1 0 11 Jul 2024
How to Leverage Predictive Uncertainty Estimates for Reducing Catastrophic Forgetting in Online Continual Learning Giuseppe Serra Ben Werner Florian Buettner 90 2 0 10 Jul 2024
CrowdTransfer: Enabling Crowd Knowledge Transfer in AIoT Community Yan Liu Bin Guo Nuo Li Yasan Ding Zhouyangzi Zhang Zhiwen Yu 138 1 0 09 Jul 2024
Mind the Interference: Retaining Pre-trained Knowledge in Parameter Efficient Continual Learning of Vision-Language Models Longxiang Tang Zhuotao Tian Kai Li Chunming He Hantao Zhou Hengshuang Zhao Xiu Li Jiaya Jia CLL VLM 105 24 0 07 Jul 2024
PECTP: Parameter-Efficient Cross-Task Prompts for Incremental Vision Transformer Qian Feng Hanbin Zhao Chao Zhang Jiahua Dong Henghui Ding Yu-Gang Jiang Hui Qian VLM 71 5 0 04 Jul 2024
TEAL: New Selection Strategy for Small Buffers in Experience Replay Class Incremental Learning Shahar Shaul-Ariel D. Weinshall VLM 79 0 0 30 Jun 2024
MoE-CT: A Novel Approach For Large Language Models Training With Resistance To Catastrophic Forgetting Tianhao Li Shangjie Li Binbin Xie Deyi Xiong Baosong Yang CLL 120 4 0 25 Jun 2024
Forget but Recall: Incremental Latent Rectification in Continual Learning Nghia D. Nguyen Hieu Trung Nguyen Ang Li H. Pham Viet Anh Nguyen Khoa D. Doan CLL 90 0 0 25 Jun 2024
Continual Learning with Diffusion-based Generative Replay for Industrial Streaming Data Jiayi He Jiao Chen Qianmiao Liu Suyan Dai Jianhua Tang Dongpo Liu DiffM AI4CE 83 4 0 22 Jun 2024
Finding Task-specific Subnetworks in Multi-task Spoken Language Understanding Model Hayato Futami Siddhant Arora Yosuke Kashiwagi E. Tsunoo Shinji Watanabe 86 1 0 18 Jun 2024
Reflecting on the State of Rehearsal-free Continual Learning with Pretrained Models Lukas Thede Karsten Roth Olivier J. Hénaff Matthias Bethge Zeynep Akata CLL 86 5 0 13 Jun 2024
Step Out and Seek Around: On Warm-Start Training with Incremental Data Maying Shen Hongxu Yin Pavlo Molchanov Lei Mao Jose M. Alvarez CLL 99 1 0 06 Jun 2024
Choice of PEFT Technique in Continual Learning: Prompt Tuning is Not All You Need Martin Wistuba Prabhu Teja Sivaprasad Lukas Balles Giovanni Zappella 77 1 0 05 Jun 2024
Continual Traffic Forecasting via Mixture of Experts Sanghyun Lee Chanyoung Park CLL 88 4 0 05 Jun 2024
Parameterizing Federated Continual Learning for Reproducible Research Bart Cox Jeroen Galjaard Aditya Shankar Jérémie Decouchant Lydia Y. Chen FedML 90 0 0 04 Jun 2024
Distribution Aligned Semantics Adaption for Lifelong Person Re-Identification Qizao Wang Xuelin Qian Bin Li Xiangyang Xue 100 1 0 30 May 2024
Lifelong Learning Using a Dynamically Growing Tree of Sub-networks for Domain Generalization in Video Object Segmentation Islam I. Osman Mohamed S. Shehata 132 0 0 29 May 2024
Federated Continual Learning Goes Online: Leveraging Uncertainty for Modality-Agnostic Class-Incremental Learning Giuseppe Serra Florian Buettner CLL FedML 98 0 0 29 May 2024
MLAE: Masked LoRA Experts for Parameter-Efficient Fine-Tuning Junjie Wang Guangjing Yang Wentao Chen Huahui Yi Xiaohu Wu Qicheng Lao MoE ALM 82 0 0 29 May 2024
Improving Data-aware and Parameter-aware Robustness for Continual Learning Hanxi Xiao Fan Lyu CLL 71 0 0 27 May 2024
MonoDETRNext: Next-generation Accurate and Efficient Monocular 3D Object Detection Method Pan Liao Feng Yang Di Wu Liu Bo 56 1 0 24 May 2024
U-TELL: Unsupervised Task Expert Lifelong Learning Indu Solomon Aye Phyu Phyu Aung Uttam Kumar Senthilnath Jayavelu CLL 62 1 0 23 May 2024
Mitigating Interference in the Knowledge Continuum through Attention-Guided Incremental Learning Prashant Shivaram Bhat Bharath Renjith Elahe Arani Bahram Zonooz CLL 73 2 0 22 May 2024
Task agnostic continual learning with Pairwise layer architecture Santtu Keskinen CLL 67 1 0 22 May 2024
A Methodology-Oriented Study of Catastrophic Forgetting in Incremental Deep Neural Networks Ashutosh Kumar Sonali Agarwal D. J. Hemanth 72 0 0 11 May 2024
Non-stationary Domain Generalization: Theory and Algorithm Thai-Hoang Pham Xueru Zhang Ping Zhang OOD 99 1 0 10 May 2024
Continual Learning in the Presence of Repetition Hamed Hemati Lorenzo Pellegrini Xiaotian Duan Zixuan Zhao Fangfang Xia ... Shiji Zhao Shao-Yuan Li Sheng-Jun Huang Vincenzo Lomonaco Gido M. van de Ven CLL 86 4 0 07 May 2024