v1v2 (latest)

PackNet: Adding Multiple Tasks to a Single Network by Iterative Pruning

15 November 2017

Arun Mallya

Svetlana Lazebnik

CLL

ArXiv (abs)PDF HTML Github (233★)

Papers citing "PackNet: Adding Multiple Tasks to a Single Network by Iterative Pruning"

50 / 751 papers shown

Title
Reviewing continual learning from the perspective of human-level intelligence Yifan Chang Wenbo Li Jian Peng Bo Tang Yuzhi Kang Yinjie Lei Yuanmiao Gui Qing Zhu Yu Liu Haifeng Li 108 4 0 23 Nov 2021
FFNB: Forgetting-Free Neural Blocks for Deep Continual Visual Learning H. Sahbi Haoming Zhan AI4CE 47 2 0 22 Nov 2021
TaskDrop: A Competitive Baseline for Continual Learning of Sentiment Classification Jianping Mei Yilun Zheng Qianwei Zhou Rui Yan VLM CLL 115 6 0 05 Nov 2021
International Workshop on Continual Semi-Supervised Learning: Introduction, Benchmarks and Baselines Ajmal Shahbaz Salman Khan M. Hossain Vincenzo Lomonaco Kevin J. Cannons Zhan Xu Fabio Cuzzolin CLL MU 66 4 0 27 Oct 2021
Multi-Domain Incremental Learning for Semantic Segmentation Prachi Garg Rohit Saluja V. Balasubramanian Chetan Arora A. Subramanian C. V. Jawahar CLL 104 36 0 23 Oct 2021
HCV: Hierarchy-Consistency Verification for Incremental Implicitly-Refined Classification Kai Wang Xialei Liu Luis Herranz Joost van de Weijer CLL 114 4 0 21 Oct 2021
Class Incremental Online Streaming Learning S. Banerjee Vinay Kumar Verma T. Parag M. Singh Vinay P. Namboodiri CLL 51 4 0 20 Oct 2021
Online Continual Learning on Class Incremental Blurry Task Configuration with Anytime Inference Hyun-woo Koh Dahyun Kim Jung-Woo Ha Jonghyun Choi CLL 65 69 0 19 Oct 2021
FedSpeech: Federated Text-to-Speech with Continual Learning Ziyue Jiang Yi Ren Ming Lei Zhou Zhao FedML 166 28 0 14 Oct 2021
Avoiding Forgetting and Allowing Forward Transfer in Continual Learning via Sparse Networks Ghada Sokar Decebal Constantin Mocanu Mykola Pechenizkiy CLL 94 8 0 11 Oct 2021
Flattening Sharpness for Dynamic Gradient Projection Memory Benefits Continual Learning Danruo Deng Guangyong Chen Jianye Hao Qiong Wang Pheng-Ann Heng CLL AAML 58 82 0 09 Oct 2021
Powerpropagation: A sparsity inducing weight reparameterisation Jonathan Richard Schwarz Siddhant M. Jayakumar Razvan Pascanu P. Latham Yee Whye Teh 194 55 0 01 Oct 2021
Recent Advances of Continual Learning in Computer Vision: An Overview Haoxuan Qu Hossein Rahmani Li Xu Bryan M. Williams Jun Liu VLM CLL 136 78 0 23 Sep 2021
Neural network relief: a pruning algorithm based on neural activity Aleksandr Dekhovich David Tax M. Sluiter Miguel A. Bessa 115 11 0 22 Sep 2021
AirLoop: Lifelong Loop Closure Detection Dasong Gao Chen Wang Sebastian Scherer 65 16 0 18 Sep 2021
Total Recall: a Customized Continual Learning Method for Neural Semantic Parsers Zhuang Li Zhuang Li Gholamreza Haffari CLL 88 15 0 11 Sep 2021
Saliency Guided Experience Packing for Replay in Continual Learning Gobinda Saha Kaushik Roy VLM KELM CLL 136 23 0 10 Sep 2021
On robustness of generative representations against catastrophic forgetting Wojciech Masarczyk Kamil Deja Tomasz Trzciñski 48 3 0 04 Sep 2021
Complementary Calibration: Boosting General Continual Learning with Collaborative Distillation and Self-Supervision Zhong Ji Jin Li Qiang Wang Zhongfei Zhang CLL 74 19 0 03 Sep 2021
Catastrophic Interference in Reinforcement Learning: A Solution Based on Context Division and Knowledge Distillation Tiantian Zhang Xueqian Wang Bin Liang Bo Yuan OffRL 80 18 0 01 Sep 2021
Compact representations of convolutional neural networks via weight pruning and quantization Giosuè Cataldo Marinò A. Petrini D. Malchiodi Marco Frasca MQ 23 4 0 28 Aug 2021
Adaptive Explainable Continual Learning Framework for Regression Problems with Focus on Power Forecasts Yujiang He AI4TS CLL 53 2 0 24 Aug 2021
Online Continual Learning with Natural Distribution Shifts: An Empirical Study with Visual Data Zhipeng Cai Ozan Sener V. Koltun CLL 65 87 0 20 Aug 2021
An Investigation of Replay-based Approaches for Continual Learning Benedikt Bagus A. Gepperth CLL 84 35 0 15 Aug 2021
Continual Semi-Supervised Learning through Contrastive Interpolation Consistency Matteo Boschini Pietro Buzzega Lorenzo Bonicelli Angelo Porrello Simone Calderara CLL 75 41 0 14 Aug 2021
Continual Neural Mapping: Learning An Implicit Scene Representation from Sequential Observations Zike Yan Yuxin Tian Xuesong Shi Ping Guo Peng Wang H. Zha CLL 71 47 0 12 Aug 2021
DIODE: Dilatable Incremental Object Detection Can Peng Kun-li Zhao Sam Maksoud Tianren Wang Brian C. Lovell CLL ObjD 121 9 0 12 Aug 2021
Discriminative Distillation to Reduce Class Confusion in Continual Learning Changhong Zhong Z. Cui Ruixuan Wang Weishi Zheng 57 1 0 11 Aug 2021
Dual-Tuning: Joint Prototype Transfer and Structure Regularization for Compatible Feature Learning Yan Bai J. Jiao Shengsen Wu Yihang Lou Jun Liu Xuetao Feng Ling-yu Duan 79 7 0 06 Aug 2021
Generalized Source-free Domain Adaptation Shiqi Yang Yaxing Wang Joost van de Weijer Luis Herranz Shangling Jui TTA 96 259 0 03 Aug 2021
Sequoia: A Software Framework to Unify Continual Learning Research Fabrice Normandin Florian Golemo O. Ostapenko Pau Rodríguez López Matthew D Riemer ... Dominic Zhao Timothée Lesort Laurent Charlin Irina Rish Massimo Caccia CLL 105 21 0 02 Aug 2021
Task-Specific Normalization for Continual Learning of Blind Image Quality Models Weixia Zhang Kede Ma Guangtao Zhai Xiaokang Yang VLM 105 24 0 28 Jul 2021
In Defense of the Learning Without Forgetting for Task Incremental Learning Guy Oren Lior Wolf CLL 63 16 0 26 Jul 2021
More Parameters? No Thanks! Zeeshan Khan Kartheek Akella Vinay P. Namboodiri C. V. Jawahar 40 1 0 20 Jul 2021
Continual Learning for Task-oriented Dialogue System with Iterative Network Pruning, Expanding and Masking Binzong Geng Fajie Yuan Qiancheng Xu Ying Shen Ruifeng Xu Min Yang CLL 82 36 0 17 Jul 2021
Kernel Continual Learning Mohammad Mahdi Derakhshani Xiantong Zhen Ling Shao Cees G. M. Snoek CLL BDL VLM 127 38 0 12 Jul 2021
A First Look at Class Incremental Learning in Deep Learning Mobile Traffic Classification Giampaolo Bovenzi Lixuan Yang A. Finamore Giuseppe Aceto D. Ciuonzo A. Pescapé Dario Rossi 77 23 0 09 Jul 2021
Evaluating the progress of Deep Reinforcement Learning in the real world: aligning domain-agnostic and domain-specific research J. Luis E. Crawley B. Cameron OffRL 77 6 0 07 Jul 2021
Split-and-Bridge: Adaptable Class Incremental Learning within a Single Neural Network Jong-Yeong Kim Dong-Wan Choi CLL 66 25 0 03 Jul 2021
Co $^2$ L: Contrastive Continual Learning Hyuntak Cha Jaeho Lee Jinwoo Shin CLL SSL VLM 147 309 0 28 Jun 2021
Learning without Forgetting for 3D Point Cloud Objects T. Chowdhury Mahira Jalisha A. Cheraghian Shafin Rahman 3DPC 80 9 0 27 Jun 2021
Iterative Network Pruning with Uncertainty Regularization for Lifelong Sentiment Classification Binzong Geng Min Yang Fajie Yuan Shupeng Wang Xiang Ao Ruifeng Xu CLL 77 19 0 21 Jun 2021
Graceful Degradation and Related Fields J. Dymond 77 4 0 21 Jun 2021
Invariant Information Bottleneck for Domain Generalization Yue Liu Yifei Shen Yezhen Wang Wenzhen Zhu Colorado Reed Jun Zhang Dongsheng Li Kurt Keutzer Han Zhao OOD 97 117 0 11 Jun 2021
Instance-Level Task Parameters: A Robust Multi-task Weighting Framework Pavan Kumar Anasosalu Vasu Shreyas Saxena Oncel Tuzel 38 5 0 11 Jun 2021
Optimizing Reusable Knowledge for Continual Learning via Metalearning J. Hurtado Alain Raymond-Sáez Alvaro Soto CLL 89 38 0 09 Jun 2021
Ex uno plures: Splitting One Model into an Ensemble of Subnetworks Zhilu Zhang Vianne R. Gao M. Sabuncu UQCV 101 6 0 09 Jun 2021
Model Zoo: A Growing "Brain" That Learns Continually Rahul Ramesh Pratik Chaudhari CLL FedML 111 66 0 06 Jun 2021
Can Subnetwork Structure be the Key to Out-of-Distribution Generalization? Dinghuai Zhang Kartik Ahuja Yilun Xu Yisen Wang Aaron Courville OOD 99 96 0 05 Jun 2021
A study on the plasticity of neural networks Tudor Berariu Wojciech M. Czarnecki Soham De J. Bornschein Samuel L. Smith Razvan Pascanu Claudia Clopath CLL AI4CE 81 32 0 31 May 2021