Self-Attention Meta-Learner for Continual Learning

28 January 2021

Ghada Sokar

Decebal Constantin Mocanu

Mykola Pechenizkiy

CLL

ArXiv (abs)PDF HTML

Papers citing "Self-Attention Meta-Learner for Continual Learning"

40 / 40 papers shown

Title
Learning Invariant Representation for Continual Learning Ghada Sokar Decebal Constantin Mocanu Mykola Pechenizkiy BDL CLL 56 16 0 15 Jan 2021
SpaceNet: Make Free Space For Continual Learning Ghada Sokar Decebal Constantin Mocanu Mykola Pechenizkiy CLL 67 81 0 15 Jul 2020
Online Fast Adaptation and Knowledge Accumulation: a New Approach to Continual Learning Massimo Caccia Pau Rodríguez López O. Ostapenko Fabrice Normandin Min Lin ... I. Laradji Irina Rish Alexande Lacoste David Vazquez Laurent Charlin CLL KELM 67 66 0 12 Mar 2020
Attention on Attention for Image Captioning Lun Huang Wenmin Wang Jie Chen Xiao-Yong Wei 72 832 0 19 Aug 2019
Stand-Alone Self-Attention in Vision Models Prajit Ramachandran Niki Parmar Ashish Vaswani Irwan Bello Anselm Levskaya Jonathon Shlens VLM SLR ViT 104 1,216 0 13 Jun 2019
Meta-Learning Representations for Continual Learning Khurram Javed Martha White KELM CLL 80 320 0 29 May 2019
Three scenarios for continual learning Gido M. van de Ven A. Tolias CLL 99 895 0 15 Apr 2019
Learning without Memorizing Prithviraj Dhar Rajat Vikram Singh Kuan-Chuan Peng Ziyan Wu Rama Chellappa CLL 88 486 0 20 Nov 2018
Don't forget, there is more than forgetting: new metrics for Continual Learning Natalia Díaz Rodríguez Vincenzo Lomonaco David Filliat Davide Maltoni CLL 60 164 0 31 Oct 2018
Learning to Learn without Forgetting by Maximizing Transfer and Minimizing Interference Matthew D Riemer Ignacio Cases R. Ajemian Miao Liu Irina Rish Y. Tu Gerald Tesauro CLL 97 789 0 29 Oct 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.8K 95,229 0 11 Oct 2018
Dual Attention Network for Scene Segmentation J. Fu Qingbin Liu Haijie Tian Yong Li Yongjun Bao Zhiwei Fang Hanqing Lu SSeg 324 5,114 0 09 Sep 2018
Continuous Learning in Single-Incremental-Task Scenarios Davide Maltoni Vincenzo Lomonaco CLL 98 310 0 22 Jun 2018
Progress & Compress: A scalable framework for continual learning Jonathan Richard Schwarz Jelena Luketina Wojciech M. Czarnecki A. Grabska-Barwinska Yee Whye Teh Razvan Pascanu R. Hadsell CLL 129 889 0 16 May 2018
Context Encoding for Semantic Segmentation Hang Zhang Kristin J. Dana Jianping Shi Zhongyue Zhang Xiaogang Wang A. Tyagi Amit Agrawal SSeg 99 1,252 0 23 Mar 2018
Continual Lifelong Learning with Neural Networks: A Review G. I. Parisi Ronald Kemker Jose L. Part Christopher Kanan S. Wermter KELM CLL 205 2,899 0 21 Feb 2018
Rotate your Networks: Better Weight Consolidation and Less Catastrophic Forgetting Xialei Liu Marc Masana Luis Herranz Joost van de Weijer Antonio M. López Andrew D. Bagdanov CLL 85 279 0 08 Feb 2018
Overcoming catastrophic forgetting with hard attention to the task Joan Serrà Dídac Surís M. Miron Alexandros Karatzoglou CLL 111 1,081 0 04 Jan 2018
Memory Aware Synapses: Learning what (not) to forget Rahaf Aljundi F. Babiloni Mohamed Elhoseiny Marcus Rohrbach Tinne Tuytelaars KELM CLL 87 1,646 0 27 Nov 2017
PackNet: Adding Multiple Tasks to a Single Network by Iterative Pruning Arun Mallya Svetlana Lazebnik CLL 109 1,309 0 15 Nov 2017
Meta-Learning and Universality: Deep Representations and Gradient Descent can Approximate any Learning Algorithm Chelsea Finn Sergey Levine SSL 107 223 0 31 Oct 2017
Squeeze-and-Excitation Networks Jie Hu Li Shen Samuel Albanie Gang Sun Enhua Wu 427 26,568 0 05 Sep 2017
Lifelong Learning with Dynamically Expandable Networks Jaehong Yoon Eunho Yang Jeongtae Lee Sung Ju Hwang CLL 125 1,229 0 04 Aug 2017
Learning Transferable Architectures for Scalable Image Recognition Barret Zoph Vijay Vasudevan Jonathon Shlens Quoc V. Le 186 5,608 0 21 Jul 2017
Gradient Episodic Memory for Continual Learning David Lopez-Paz MarcÁurelio Ranzato VLM CLL 131 2,738 0 26 Jun 2017
Continual Learning with Deep Generative Replay Hanul Shin Jung Kwon Lee Jaehong Kim Jiwon Kim KELM CLL 80 2,087 0 24 May 2017
CORe50: a New Dataset and Benchmark for Continuous Object Recognition Vincenzo Lomonaco Davide Maltoni 181 494 0 09 May 2017
Residual Attention Network for Image Classification Fei Wang Mengqing Jiang Chao Qian Shuo Yang Cheng Li Honggang Zhang Xiaogang Wang Xiaoou Tang 117 3,313 0 23 Apr 2017
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 831 11,952 0 09 Mar 2017
Feature Pyramid Networks for Object Detection Nayeon Lee Piotr Dollár Ross B. Girshick Kaiming He Bharath Hariharan Serge J. Belongie ObjD 488 22,143 0 09 Dec 2016
Overcoming catastrophic forgetting in neural networks J. Kirkpatrick Razvan Pascanu Neil C. Rabinowitz J. Veness Guillaume Desjardins ... A. Grabska-Barwinska Demis Hassabis Claudia Clopath D. Kumaran R. Hadsell CLL 374 7,572 0 02 Dec 2016
iCaRL: Incremental Classifier and Representation Learning Sylvestre-Alvise Rebuffi Alexander Kolesnikov G. Sperl Christoph H. Lampert CLL OOD 162 3,782 0 23 Nov 2016
SCA-CNN: Spatial and Channel-wise Attention in Convolutional Networks for Image Captioning Long Chen Hanwang Zhang Jun Xiao Liqiang Nie Jian Shao Wei Liu Tat-Seng Chua 82 1,664 0 17 Nov 2016
Online Contrastive Divergence with Generative Replay: Experience Replay without Storing Data Decebal Constantin Mocanu M. T. Vega Eric Eaton Peter Stone A. Liotta OffRL 81 26 0 18 Oct 2016
Learning without Forgetting Zhizhong Li Derek Hoiem CLL OOD SSL 308 4,432 0 29 Jun 2016
Progressive Neural Networks Andrei A. Rusu Neil C. Rabinowitz Guillaume Desjardins Hubert Soyer J. Kirkpatrick Koray Kavukcuoglu Razvan Pascanu R. Hadsell CLL AI4CE 83 2,465 0 15 Jun 2016
DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs Liang-Chieh Chen George Papandreou Iasonas Kokkinos Kevin Patrick Murphy Alan Yuille SSeg 270 18,284 0 02 Jun 2016
Distilling the Knowledge in a Neural Network Geoffrey E. Hinton Oriol Vinyals J. Dean FedML 367 19,745 0 09 Mar 2015
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift Sergey Ioffe Christian Szegedy OOD 467 43,347 0 11 Feb 2015
Neural Machine Translation by Jointly Learning to Align and Translate Dzmitry Bahdanau Kyunghyun Cho Yoshua Bengio AIMat 578 27,338 0 01 Sep 2014