Linear Mode Connectivity in Multitask and Continual Learning

9 October 2020

Papers citing "Linear Mode Connectivity in Multitask and Continual Learning"

41 / 41 papers shown

Title
Mitigating Catastrophic Forgetting in the Incremental Learning of Medical Images Sara Yavari Jacob Furst CLL 58 0 0 28 Apr 2025
Dynamic Fisher-weighted Model Merging via Bayesian Optimization Sanwoo Lee Jiahao Liu Qifan Wang J. Wang Xunliang Cai Yunfang Wu MoMe 151 0 0 26 Apr 2025
Task-conditioned Ensemble of Expert Models for Continuous Learning Renu Sharma Debasmita Pal Arun Ross OOD KELM 153 0 0 11 Apr 2025
Accurate Forgetting for Heterogeneous Federated Continual Learning Abudukelimu Wuerkaixi Sen Cui Junzhe Zhang Kunda Yan Bo Han Gang Niu Lei Fang Changshui Zhang Masashi Sugiyama 119 8 0 20 Feb 2025
Linear Mode Connectivity in Differentiable Tree Ensembles Ryuichi Kanoh M. Sugiyama 72 1 0 17 Feb 2025
Budgeted Online Continual Learning by Adaptive Layer Freezing and Frequency-based Sampling Minhyuk Seo Hyunseo Koh Jonghyun Choi 36 1 0 19 Oct 2024
Mitigating the Stability-Plasticity Dilemma in Adaptive Train Scheduling with Curriculum-Driven Continual DQN Expansion Achref Jaziri Etienne Kunzel Visvanathan Ramesh CLL 53 0 0 19 Aug 2024
An Effective Dynamic Gradient Calibration Method for Continual Learning Weichen Lin Jiaxiang Chen Ru Huang Huihua Ding CLL 44 0 0 30 Jul 2024
MoFO: Momentum-Filtered Optimizer for Mitigating Forgetting in LLM Fine-Tuning Yupeng Chen Senmiao Wang Zhihang Lin Zhihang Lin Yushun Zhang Tian Ding Ruoyu Sun Ruoyu Sun CLL 80 1 0 30 Jul 2024
Federated Learning over Connected Modes Dennis Grinwald Philipp Wiesner Shinichi Nakajima FedML 45 0 0 05 Mar 2024
Continual Learning through Networks Splitting and Merging with Dreaming-Meta-Weighted Model Fusion Yi Sun Xin Xu Jian Li Guanglei Xie Yifei Shi Qiang Fang CLL MoMe 31 1 0 12 Dec 2023
Train ñ Trade: Foundations of Parameter Markets Tzu-Heng Huang Harit Vishwakarma Frederic Sala AIFin 29 2 0 07 Dec 2023
Continual Learning: Applications and the Road Forward Eli Verwimp Rahaf Aljundi Shai Ben-David Matthias Bethge Andrea Cossu ... J. Weijer Bing Liu Vincenzo Lomonaco Tinne Tuytelaars Gido M. van de Ven CLL 43 44 0 20 Nov 2023
Two Complementary Perspectives to Continual Learning: Ask Not Only What to Optimize, But Also How Timm Hess Tinne Tuytelaars Gido M. van de Ven 44 7 0 08 Nov 2023
HPCR: Holistic Proxy-based Contrastive Replay for Online Continual Learning Huiwei Lin Shanshan Feng Baoquan Zhang Xutao Li Y. Ong CLL 42 0 0 26 Sep 2023
FedSoup: Improving Generalization and Personalization in Federated Learning via Selective Model Interpolation Minghui Chen Meirui Jiang Qianming Dou Zehua Wang Xiaoxiao Li FedML 35 15 0 20 Jul 2023
Achieving a Better Stability-Plasticity Trade-off via Auxiliary Networks in Continual Learning Sang-Ho Kim Lorenzo Noci Antonio Orvieto Thomas Hofmann CLL 24 35 0 16 Mar 2023
Knowledge is a Region in Weight Space for Fine-tuned Language Models Almog Gueta Elad Venezian Colin Raffel Noam Slonim Yoav Katz Leshem Choshen 34 49 0 09 Feb 2023
ColD Fusion: Collaborative Descent for Distributed Multitask Finetuning Shachar Don-Yehiya Elad Venezian Colin Raffel Noam Slonim Yoav Katz Leshem Choshen MoMe 28 52 0 02 Dec 2022
Continual Learning with Optimal Transport based Mixture Model Quyen Tran Hoang Phan Khoat Than Dinh Q. Phung Trung Le CLL 21 1 0 30 Nov 2022
Building a Subspace of Policies for Scalable Continual Learning Jean-Baptiste Gaya T. Doan Lucas Caccia Laure Soulier Ludovic Denoyer Roberta Raileanu CLL 29 29 0 18 Nov 2022
Is Multi-Task Learning an Upper Bound for Continual Learning? Zihao Wu Huy Tran Hamed Pirsiavash Soheil Kolouri SSL CLL 28 4 0 26 Oct 2022
Exploring Mode Connectivity for Pre-trained Language Models Yujia Qin Cheng Qian Jing Yi Weize Chen Yankai Lin Xu Han Zhiyuan Liu Maosong Sun Jie Zhou 29 20 0 25 Oct 2022
Multiple Modes for Continual Learning Siddhartha Datta N. Shadbolt CLL MoMe 45 2 0 29 Sep 2022
Learn the Time to Learn: Replay Scheduling in Continual Learning Marcus Klasson Hedvig Kjellström Chen Zhang CLL 24 9 0 18 Sep 2022
Causes of Catastrophic Forgetting in Class-Incremental Semantic Segmentation Tobias Kalb Jürgen Beyerer CLL 35 8 0 16 Sep 2022
A Multi-Head Model for Continual Learning via Out-of-Distribution Replay Gyuhak Kim Zixuan Ke Bin Liu VLM CLL OODD 25 29 0 20 Aug 2022
How to Reuse and Compose Knowledge for a Lifetime of Tasks: A Survey on Continual Learning and Functional Composition Jorge Armando Mendez Mendez Eric Eaton KELM CLL 32 27 0 15 Jul 2022
Interpolating Compressed Parameter Subspaces Siddhartha Datta N. Shadbolt 37 5 0 19 May 2022
Explaining the Effectiveness of Multi-Task Learning for Efficient Knowledge Extraction from Spine MRI Reports Arijit Sehanobish M. Sandora Nabila Abraham Jayashri Pawar Danielle Torres Anasuya Das M. Becker Richard Herzog Benjamin Odry Ron Vianu 19 3 0 06 May 2022
Federated Geometric Monte Carlo Clustering to Counter Non-IID Datasets Federico Lucchetti Jérémie Decouchant Maria Fernandes L. Chen Marcus Volp FedML 17 0 0 23 Apr 2022
Fusing finetuned models for better pretraining Leshem Choshen Elad Venezian Noam Slonim Yoav Katz FedML AI4CE MoMe 48 87 0 06 Apr 2022
Low-Loss Subspace Compression for Clean Gains against Multi-Agent Backdoor Attacks Siddhartha Datta N. Shadbolt AAML 29 6 0 07 Mar 2022
Architecture Matters in Continual Learning Seyed Iman Mirzadeh Arslan Chaudhry Dong Yin Timothy Nguyen Razvan Pascanu Dilan Görür Mehrdad Farajtabar OOD KELM 116 58 0 01 Feb 2022
Learning Curves for Continual Learning in Neural Networks: Self-Knowledge Transfer and Forgetting Ryo Karakida S. Akaho CLL 29 11 0 03 Dec 2021
Towards Better Plasticity-Stability Trade-off in Incremental Learning: A Simple Linear Connector Guoliang Lin Hanlu Chu Hanjiang Lai MoMe CLL 29 43 0 15 Oct 2021
Recent Advances of Continual Learning in Computer Vision: An Overview Haoxuan Qu Hossein Rahmani Li Xu Bryan M. Williams Jun Liu VLM CLL 25 73 0 23 Sep 2021
Towards Generalized and Incremental Few-Shot Object Detection Yiting Li H. Zhu Jun Ma C. Teo Chen Xiang P. Vadakkepat T. Lee CLL ObjD 26 9 0 23 Sep 2021
Task-agnostic Continual Learning with Hybrid Probabilistic Models Polina Kirichenko Mehrdad Farajtabar Dushyant Rao Balaji Lakshminarayanan Nir Levine Ang Li Huiyi Hu A. Wilson Razvan Pascanu VLM BDL CLL 24 19 0 24 Jun 2021
Federated Continual Learning with Weighted Inter-client Transfer Jaehong Yoon Wonyoung Jeong Giwoong Lee Eunho Yang Sung Ju Hwang FedML 40 199 0 06 Mar 2020
Overcoming Catastrophic Interference by Conceptors Xu He H. Jaeger BDL 26 13 0 16 Jul 2017