v1v2 (latest)

PackNet: Adding Multiple Tasks to a Single Network by Iterative Pruning

15 November 2017

Arun Mallya

Svetlana Lazebnik

CLL

ArXiv (abs)PDF HTML Github (233★)

Papers citing "PackNet: Adding Multiple Tasks to a Single Network by Iterative Pruning"

50 / 751 papers shown

Title
ScaIL: Classifier Weights Scaling for Class Incremental Learning Eden Belouadah Adrian Daniel Popescu CLL 97 79 0 16 Jan 2020
Dynamic Task Weighting Methods for Multi-task Networks in Autonomous Driving Systems Isabelle Leang Ganesh Sistu Fabian Burger Andrei Bursuc S. Yogamani 94 53 0 07 Jan 2020
Frosting Weights for Better Continual Training Xiaofeng Zhu Feng Liu Goce Trajcevski Dingding Wang FedML AI4CE CLL 53 5 0 07 Jan 2020
Overcoming Long-term Catastrophic Forgetting through Adversarial Neural Pruning and Synaptic Consolidation Jian-wei Peng Bo Tang Jiang Hao Zhuo Li Yinjie Lei Tao R. Lin Haifeng Li AAML CLL 75 38 0 19 Dec 2019
Dreaming to Distill: Data-free Knowledge Transfer via DeepInversion Hongxu Yin Pavlo Molchanov Zhizhong Li J. Álvarez Arun Mallya Derek Hoiem N. Jha Jan Kautz 147 570 0 18 Dec 2019
Compacting, Picking and Growing for Unforgetting Continual Learning Steven C. Y. Hung Cheng-Hao Tu Cheng-En Wu Chien-Hung Chen Yi-Ming Chan Chu-Song Chen CLL 115 318 0 15 Oct 2019
Learning to Remember from a Multi-Task Teacher Yuwen Xiong Mengye Ren R. Urtasun CLL KELM OOD 69 4 0 10 Oct 2019
Biologically-Inspired Spatial Neural Networks Zhiqing Zhang Jacek Tabor Marek Śmieja Szymon Maszke 43 3 0 07 Oct 2019
Continual Learning in Neural Networks Rahaf Aljundi CLL 94 34 0 07 Oct 2019
A continual learning survey: Defying forgetting in classification tasks Matthias De Lange Rahaf Aljundi Marc Masana Sarah Parisot Xu Jia A. Leonardis Greg Slabaugh Tinne Tuytelaars CLL KELM 81 246 0 18 Sep 2019
Deep Elastic Networks with Model Selection for Multi-Task Learning Chanho Ahn Eunwoo Kim Songhwai Oh 105 49 0 11 Sep 2019
LAMOL: LAnguage MOdeling for Lifelong Language Learning Fan-Keng Sun Cheng-Hao Ho Hung-yi Lee CLL KELM 97 213 0 07 Sep 2019
Language Features Matter: Effective Language Representations for Vision-Language Tasks Andrea Burns Reuben Tan Kate Saenko Stan Sclaroff Bryan A. Plummer VLM 58 27 0 17 Aug 2019
Continual Learning by Asymmetric Loss Approximation with Single-Side Overestimation Dongmin Park Seokil Hong Bohyung Han Kyoung Mu Lee AAML CLL 156 40 0 08 Aug 2019
Context-Aware Multipath Networks Dumindu Tissera Kumara Kahatapitiya Rukshan Wijesinghe Subha Fernando Ranga Rodrigo 45 7 0 26 Jul 2019
Adaptive Compression-based Lifelong Learning Shivangi Srivastava Maxim Berman Matthew B. Blaschko D. Tuia CLL 77 10 0 23 Jul 2019
NetTailor: Tuning the Architecture, Not Just the Weights Pedro Morgado Nuno Vasconcelos MQ 56 29 0 29 Jun 2019
Continual Learning for Robotics: Definition, Framework, Learning Strategies, Opportunities and Challenges Timothée Lesort Vincenzo Lomonaco Andrei Stoian Davide Maltoni David Filliat Natalia Díaz Rodríguez CLL 139 250 0 29 Jun 2019
Task Agnostic Continual Learning via Meta Learning Xu He Jakub Sygnowski Alexandre Galashov Andrei A. Rusu Yee Whye Teh Razvan Pascanu OOD CLL FedML 60 94 0 12 Jun 2019
Uncertainty-guided Continual Learning with Bayesian Neural Networks Sayna Ebrahimi Mohamed Elhoseiny Trevor Darrell Marcus Rohrbach CLL BDL 68 197 0 06 Jun 2019
Continual learning with hypernetworks J. Oswald Christian Henning Benjamin Grewe João Sacramento CLL 111 363 0 03 Jun 2019
Progressive Learning of Low-Precision Networks Zhengguang Zhou Wen-gang Zhou Xutao Lv Xuan Huang Xiaoyu Wang Houqiang Li MQ 55 11 0 28 May 2019
Uncertainty-based Continual Learning with Adaptive Regularization Hongjoon Ahn Sungmin Cha Donggyu Lee Taesup Moon BDL 102 221 0 28 May 2019
Single-Net Continual Learning with Progressive Segmented Training (PST) Xiaocong Du Gouranga Charan Frank Liu Yu Cao CLL 64 13 0 28 May 2019
Budget-Aware Adapters for Multi-Domain Learning Rodrigo Berriel Stéphane Lathuilière Moin Nabi T. Klein Thiago Oliveira-Santos N. Sebe Elisa Ricci OOD 111 41 0 15 May 2019
Towards Efficient Model Compression via Learned Global Ranking Ting-Wu Chin Ruizhou Ding Cha Zhang Diana Marculescu 83 172 0 28 Apr 2019
Deep Virtual Networks for Memory Efficient Inference of Multiple Tasks Eunwoo Kim Chanho Ahn Philip Torr Songhwai Oh 59 12 0 09 Apr 2019
M2KD: Multi-model and Multi-level Knowledge Distillation for Incremental Learning Peng Zhou Long Mai Jianming Zhang N. Xu Zuxuan Wu L. Davis CLL VLM 85 55 0 03 Apr 2019
The RGB-D Triathlon: Towards Agile Visual Toolboxes for Robots Fabio Cermelli Massimiliano Mancini Elisa Ricci Barbara Caputo 55 3 0 01 Apr 2019
Many Task Learning with Task Routing Gjorgji Strezoski Nanne van Noord Marcel Worring MoE 76 96 0 28 Mar 2019
Gradient based sample selection for online continual learning Rahaf Aljundi Min Lin Baptiste Goujaud Yoshua Bengio BDL CLL 146 840 0 20 Mar 2019
Class-incremental Learning via Deep Model Consolidation Junting Zhang Jie Zhang Shalini Ghosh Dawei Li Serafettin Tasci Larry Heck Heming Zhang C.-C. Jay Kuo CLL 121 341 0 19 Mar 2019
Dense Classification and Implanting for Few-Shot Learning Yann Lifchitz Yannis Avrithis Sylvaine Picard Andrei Bursuc VLM 65 198 0 12 Mar 2019
Online Meta-Learning Chelsea Finn Aravind Rajeswaran Sham Kakade Sergey Levine CLL 87 256 0 22 Feb 2019
Incremental Learning with Maximum Entropy Regularization: Rethinking Forgetting and Intransigence Dahyun Kim Jihwan Bae Yeonsik Jo Jonghyun Choi OOD CLL 75 20 0 03 Feb 2019
Overcoming Catastrophic Forgetting by Soft Parameter Pruning Jian-wei Peng Jiang Hao Zhuo Li Enqiang Guo X. Wan Min Deng Qing Zhu Haifeng Li CLL 27 5 0 04 Dec 2018
Incremental Learning for Semantic Segmentation of Large-Scale Remote Sensing Data O. Tasar Y. Tarabalka Pierre Alliez CLL 115 127 0 29 Oct 2018
Marginal Replay vs Conditional Replay for Continual Learning Timothée Lesort A. Gepperth Andrei Stoian David Filliat BDL 100 35 0 29 Oct 2018
Layer-compensated Pruning for Resource-constrained Convolutional Neural Networks Ting-Wu Chin Cha Zhang Diana Marculescu 86 46 0 01 Oct 2018
StackNet: Stacking Parameters for Continual learning Jangho Kim Jeesoo Kim Nojun Kwak CLL 29 6 0 07 Sep 2018
Catastrophic Importance of Catastrophic Forgetting Albert Ierusalem CLL AI4CE 18 2 0 20 Aug 2018
Learning Visual Question Answering by Bootstrapping Hard Attention Mateusz Malinowski Carl Doersch Adam Santoro Peter W. Battaglia OOD 92 96 0 01 Aug 2018
The Natural Language Decathlon: Multitask Learning as Question Answering Bryan McCann N. Keskar Caiming Xiong R. Socher AIMat MLLM BDL 161 647 0 20 Jun 2018
Selfless Sequential Learning Rahaf Aljundi Marcus Rohrbach Tinne Tuytelaars CLL 72 114 0 14 Jun 2018
Adding New Tasks to a Single Network with Weight Transformations using Binary Masks Massimiliano Mancini Elisa Ricci Barbara Caputo Samuel Rota Buló 103 52 0 28 May 2018
Meta Transfer Learning for Facial Emotion Recognition Dung Nguyen Tien Kien Nguyen Sridha Sridharan Iman Abbasnejad David Dean Clinton Fookes 34 18 0 25 May 2018
Pixel-wise Attentional Gating for Parsimonious Pixel Labeling Shu Kong Charless C. Fowlkes 99 40 0 03 May 2018
Cortex Neural Network: learning with Neural Network groups Liyao (Mars) Gao 20 1 0 10 Apr 2018
Alleviating catastrophic forgetting using context-dependent gating and synaptic stabilization Nicolas Y. Masse Gregory D. Grant David J. Freedman 75 283 0 02 Feb 2018
Piggyback: Adapting a Single Network to Multiple Tasks by Learning to Mask Weights Arun Mallya Dillon Davis Svetlana Lazebnik CLL 72 35 0 19 Jan 2018