Orthogonal Gradient Descent for Continual Learning

15 October 2019

Papers citing "Orthogonal Gradient Descent for Continual Learning"

32 / 82 papers shown

Title
Incremental Task Learning with Incremental Rank Updates Rakib Hyder Ken Shao Boyu Hou P. Markopoulos Ashley Prater-Bennette Ulugbek S. Kamilov CLL 16 13 0 19 Jul 2022
Debugging using Orthogonal Gradient Descent Narsimha Chilkuri C. Eliasmith 26 1 0 17 Jun 2022
Switchable Representation Learning Framework with Self-compatibility Shengsen Wu Yan Bai Yihang Lou Xiongkun Linghu Jianzhong He Ling-yu Duan 22 1 0 16 Jun 2022
Prompt-aligned Gradient for Prompt Tuning Beier Zhu Yulei Niu Yucheng Han Yuehua Wu Hanwang Zhang VLM 189 272 0 30 May 2022
Memory-efficient Reinforcement Learning with Value-based Knowledge Consolidation Qingfeng Lan Yangchen Pan Jun Luo A. R. Mahmood OffRL 29 7 0 22 May 2022
How catastrophic can catastrophic forgetting be in linear regression? Itay Evron E. Moroshko Rachel A. Ward Nati Srebro Daniel Soudry CLL 30 48 0 19 May 2022
Memory Bounds for Continual Learning Xi Chen Christos H. Papadimitriou Binghui Peng CLL LRM 29 22 0 22 Apr 2022
Efficient Test-Time Model Adaptation without Forgetting Shuaicheng Niu Jiaxiang Wu Yifan Zhang Yaofo Chen S. Zheng P. Zhao Mingkui Tan OOD VLM TTA 33 311 0 06 Apr 2022
Modelling continual learning in humans with Hebbian context gating and exponentially decaying task signals Timo Flesch D. G. Nagy Andrew M. Saxe Christopher Summerfield 34 34 0 22 Mar 2022
Continual Feature Selection: Spurious Features in Continual Learning Timothée Lesort CLL 30 10 0 02 Mar 2022
Architecture Matters in Continual Learning Seyed Iman Mirzadeh Arslan Chaudhry Dong Yin Timothy Nguyen Razvan Pascanu Dilan Görür Mehrdad Farajtabar OOD KELM 118 58 0 01 Feb 2022
Technical Report for ICCV 2021 Challenge SSLAD-Track3B: Transformers Are Better Continual Learners Duo Li Guimei Cao Yunlu Xu Zhanzhan Cheng Yi Niu CLL 27 21 0 13 Jan 2022
DyTox: Transformers for Continual Learning with DYnamic TOken eXpansion Arthur Douillard Alexandre Ramé Guillaume Couairon Matthieu Cord CLL 30 295 0 22 Nov 2021
One Pass ImageNet Huiyi Hu Ang Li Daniele Calandriello Dilan Görür VLM 13 18 0 03 Nov 2021
Provable Lifelong Learning of Representations Xinyuan Cao Weiyang Liu Santosh Vempala CLL 21 13 0 27 Oct 2021
Saliency Guided Experience Packing for Replay in Continual Learning Gobinda Saha Kaushik Roy VLM KELM CLL 94 22 0 10 Sep 2021
A review of mobile robot motion planning methods: from classical motion planning workflows to reinforcement learning-based architectures Changyin Sun Zicheng He Chunwei Song Changyin Sun 38 54 0 31 Aug 2021
Auxiliary Task Update Decomposition: The Good, The Bad and The Neutral Lucio Dery Yann N. Dauphin David Grangier MoMe 18 29 0 25 Aug 2021
Learning a Neural Diff for Speech Models J. Macoskey Grant P. Strimel Ariya Rastrow 18 2 0 03 Aug 2021
Bayesian Embeddings for Few-Shot Open World Recognition John Willes James Harrison Ali Harakeh Chelsea Finn Marco Pavone Steven Waslander BDL OffRL 22 18 0 29 Jul 2021
Task-agnostic Continual Learning with Hybrid Probabilistic Models Polina Kirichenko Mehrdad Farajtabar Dushyant Rao Balaji Lakshminarayanan Nir Levine Ang Li Huiyi Hu A. Wilson Razvan Pascanu VLM BDL CLL 27 19 0 24 Jun 2021
Continual Learning in Sensor-based Human Activity Recognition: an Empirical Benchmark Analysis Saurav Jha Martin Schiemer F. Zambonelli Juan Ye 23 48 0 19 Apr 2021
Gradient Projection Memory for Continual Learning Gobinda Saha Isha Garg Kaushik Roy VLM CLL 47 267 0 17 Mar 2021
Sketching Curvature for Efficient Out-of-Distribution Detection for Deep Neural Networks Apoorva Sharma Navid Azizan Marco Pavone UQCV 25 45 0 24 Feb 2021
Continual Learning with Deep Artificial Neurons Blake Camp J. Mandivarapu Rolando Estrada 18 8 0 13 Nov 2020
Continual Learning in Low-rank Orthogonal Subspaces Arslan Chaudhry Naeemullah Khan P. Dokania Philip Torr CLL 33 114 0 22 Oct 2020
Linear Mode Connectivity in Multitask and Continual Learning Seyed Iman Mirzadeh Mehrdad Farajtabar Dilan Görür Razvan Pascanu H. Ghasemzadeh CLL 37 139 0 09 Oct 2020
A Theoretical Analysis of Catastrophic Forgetting through the NTK Overlap Matrix T. Doan Mehdi Abbana Bennani Bogdan Mazoure Guillaume Rabusseau Pierre Alquier CLL 20 80 0 07 Oct 2020
Generalisation Guarantees for Continual Learning with Orthogonal Gradient Descent Mehdi Abbana Bennani Thang Doan Masashi Sugiyama CLL 50 61 0 21 Jun 2020
Understanding the Role of Training Regimes in Continual Learning Seyed Iman Mirzadeh Mehrdad Farajtabar Razvan Pascanu H. Ghasemzadeh CLL 21 219 0 12 Jun 2020
Disturbance-immune Weight Sharing for Neural Architecture Search Shuaicheng Niu Jiaxiang Wu Yifan Zhang Yong Guo P. Zhao Junzhou Huang Mingkui Tan 15 27 0 29 Mar 2020
Gradient Surgery for Multi-Task Learning Tianhe Yu Saurabh Kumar Abhishek Gupta Sergey Levine Karol Hausman Chelsea Finn 41 1,172 0 19 Jan 2020