Boosting Continual Learning of Vision-Language Models via Mixture-of-Experts Adapters

18 March 2024

Huchuan Lu

Papers citing "Boosting Continual Learning of Vision-Language Models via Mixture-of-Experts Adapters"

50 / 59 papers shown

Title
Beyond CLIP Generalization: Against Forward&Backward Forgetting Adapter for Continual Learning of Vision-Language Models Songlin Dong Chenhao Ding Jiangyang Li Jizhou Han Qiang Wang Yuhang He Yihong Gong CLL VLM 40 0 0 12 May 2025
Distribution-aware Forgetting Compensation for Exemplar-Free Lifelong Person Re-identification Shiben Liu Huijie Fan Qiang Wang Baojie Fan Yandong Tang Liangqiong Qu OOD CLL 57 0 0 21 Apr 2025
Parameter-Efficient Continual Fine-Tuning: A Survey Eric Nuertey Coleman Luigi Quarantiello Ziyue Liu Qinwen Yang Samrat Mukherjee J. Hurtado Vincenzo Lomonaco CLL 29 0 0 18 Apr 2025
Self-Controlled Dynamic Expansion Model for Continual Learning RunQing Wu KaiHui Huang HanYi Zhang Fei Ye CLL VLM 50 0 0 14 Apr 2025
Saliency-Motion Guided Trunk-Collateral Network for Unsupervised Video Object Segmentation Xiangyu Zheng Wanyun Li Songcheng He Jianping Fan Xiaoqiang Li We Zhang VOS 35 0 0 08 Apr 2025
Continual Cross-Modal Generalization Yan Xia Hai Huang Minghui Fang Zhou Zhao CLL 54 0 0 01 Apr 2025
LLaVA-CMoE: Towards Continual Mixture of Experts for Large Vision-Language Models Hengyuan Zhao Ziqin Wang Qixin Sun Kaiyou Song Yilin Li Xiaolin Hu Qingpei Guo Si Liu KELM CLL MoE 65 0 0 27 Mar 2025
IAP: Improving Continual Learning of Vision-Language Models via Instance-Aware Prompting Hao Fu Hanbin Zhao Jiahua Dong Chao Zhang Hui Qian CLL VLM 91 0 0 26 Mar 2025
Knowledge Graph Enhanced Generative Multi-modal Models for Class-Incremental Learning Xusheng Cao Haori Lu Linlan Huang Fei Yang Xialei Liu Ming-Ming Cheng CLL KELM 55 0 0 24 Mar 2025
LoRASculpt: Sculpting LoRA for Harmonizing General and Specialized Knowledge in Multimodal Large Language Models Jian Liang Wenke Huang Guancheng Wan Qu Yang Mang Ye MoMe CLL AI4CE 60 1 0 21 Mar 2025
SketchFusion: Learning Universal Sketch Features through Fusing Foundation Models Subhadeep Koley Tapas Kumar Dutta Aneeshan Sain Pinaki Nath Chowdhury A. Bhunia Yi-Zhe Song VLM 66 0 0 18 Mar 2025
Optimized 3D Gaussian Splatting using Coarse-to-Fine Image Frequency Modulation Umar Farooq Jean-Yves Guillemaut Adrian Hilton M. Volino 3DGS 69 0 0 18 Mar 2025
Continual Text-to-Video Retrieval with Frame Fusion and Task-Aware Routing Zecheng Zhao Zhi Chen Zi-Rui Huang S. Sadiq Tong Chen 36 0 0 13 Mar 2025
IDEA: Inverted Text with Cooperative Deformable Aggregation for Multi-modal Object Re-Identification Yuhao Wang Yongfeng Lv Pingping Zhang Huchuan Lu 76 2 0 13 Mar 2025
Enhanced Continual Learning of Vision-Language Models with Model Fusion Haoyuan Gao Zicong Zhang Yuqi Wei Linglan Zhao Guilin Li Yuan Li Linghe Kong Weiran Huang CLL VLM 167 0 0 12 Mar 2025
A Comprehensive Survey of Mixture-of-Experts: Algorithms, Theory, and Applications Siyuan Mu Sen Lin MoE 135 2 0 10 Mar 2025
Merge then Realign: Simple and Effective Modality-Incremental Continual Learning for Multimodal LLMs Dingkun Zhang Shuhan Qi Xinyu Xiao Kehai Chen Xuan Wang CLL MoMe 66 0 0 08 Mar 2025
Towards Differential Handling of Various Blur Regions for Accurate Image Deblurring Hu Gao Depeng Dang 53 0 0 27 Feb 2025
C-LoRA: Continual Low-Rank Adaptation for Pre-trained Models Xin Zhang Liang Bai Xian Yang Jiye Liang CLL 65 0 0 25 Feb 2025
Theory on Mixture-of-Experts in Continual Learning Hongbo Li Sen-Fon Lin Lingjie Duan Yingbin Liang Ness B. Shroff MoE MoMe CLL 153 14 0 20 Feb 2025
VLM-Assisted Continual learning for Visual Question Answering in Self-Driving Yuxin Lin Mengshi Qi Liang Liu Huadong Ma CLL 37 1 0 02 Feb 2025
DesCLIP: Robust Continual Adaptation via General Attribute Descriptions for Pretrained Vision-Language Models Chiyuan He Zihuan Qiu Fanman Meng Linfeng Xu Q. Wu Yiming Li VLM CLL KELM 63 0 0 02 Feb 2025
Incrementally Learning Multiple Diverse Data Domains via Multi-Source Dynamic Expansion Model RunQing Wu Fei Ye QiHe Liu Guoxi Huang Jinyu Guo Rongyao Hu CLL 175 0 0 15 Jan 2025
A Multi-Modal Deep Learning Framework for Pan-Cancer Prognosis Binyu Zhang Shichao Li Junpeng Jian Zhu Meng Limei Guo Zhicheng Zhao 39 0 0 13 Jan 2025
Fresh-CL: Feature Realignment through Experts on Hypersphere in Continual Learning Zhongyi Zhou Yaxin Peng Pin Yi Minjie Zhu Chaomin Shen 136 0 0 04 Jan 2025
Generate to Discriminate: Expert Routing for Continual Learning Yewon Byun Sanket Vaibhav Mehta Saurabh Garg Emma Strubell Michael Oberst Bryan Wilder Zachary Chase Lipton 78 0 0 31 Dec 2024
Retaining and Enhancing Pre-trained Knowledge in Vision-Language Models with Prompt Ensembling Donggeun Kim Yujin Jo Myungjoo Lee Taesup Kim VLM 78 0 0 10 Dec 2024
FoundIR: Unleashing Million-scale Training Data to Advance Foundation Models for Image Restoration Hao Li Xiang Chen Jiangxin Dong Jinhui Tang Jinshan Pan 73 2 0 02 Dec 2024
Adaptive Rank, Reduced Forgetting: Knowledge Retention in Continual Learning Vision-Language Models with Dynamic Rank-Selective LoRA Haodong Lu Chongyang Zhao Jason Xue Lina Yao Kristen Moore Dong Gong VLM KELM CLL 88 3 0 01 Dec 2024
DESIRE: Dynamic Knowledge Consolidation for Rehearsal-Free Continual Learning Haiyang Guo Fei Zhu Fanhu Zeng Bing Liu Xu-Yao Zhang MoMe CLL 89 3 0 28 Nov 2024
DA-MoE: Addressing Depth-Sensitivity in Graph-Level Analysis through Mixture of Experts Zelin Yao Chuang Liu Xianke Meng Yibing Zhan Jia Wu Shirui Pan Wenbin Hu 28 1 0 05 Nov 2024
One VLM to Keep it Learning: Generation and Balancing for Data-free Continual Visual Question Answering Deepayan Das Davide Talon Massimiliano Mancini Yiming Wang Elisa Ricci 41 0 0 04 Nov 2024
Is Multiple Object Tracking a Matter of Specialization? G. Mancusi Mattia Bernardi Aniello Panariello Angelo Porrello Rita Cucchiara Simone Calderara MoMe 36 1 0 01 Nov 2024
Human-inspired Perspectives: A Survey on AI Long-term Memory Zihong He Weizhe Lin Hao Zheng Fan Zhang Matt Jones Laurence Aitchison X. Xu Miao Liu Per Ola Kristensson Junxiao Shen 77 2 0 01 Nov 2024
Towards Optimal Adapter Placement for Efficient Transfer Learning Aleksandra I. Nowak Otniel-Bogdan Mercea Anurag Arnab Jonas Pfeiffer Yann N. Dauphin Utku Evci 25 0 0 21 Oct 2024
Brain-inspired continual pre-trained learner via silent synaptic consolidation Xuming Ran Juntao Yao Yusong Wang Mingkun Xu Dianbo Liu AAML CLL 25 0 0 08 Oct 2024
Recent Advances of Multimodal Continual Learning: A Comprehensive Survey Dianzhi Yu Xinni Zhang Yankai Chen Aiwei Liu Yifei Zhang Philip S. Yu Irwin King VLM CLL 44 9 0 07 Oct 2024
Mixture of Multicenter Experts in Multimodal Generative AI for Advanced Radiotherapy Target Delineation Y. Oh Sangjoon Park Xiang Li Wang Yi Jonathan Paly ... Quanzheng Li Wei Liu W. Koom Jin Sung Kim Kyungsang Kim 25 0 0 27 Sep 2024
Onboard Satellite Image Classification for Earth Observation: A Comparative Study of ViT Models Thanh-Dung Le Vu Nguyen Ha T. Nguyen G. Eappen P. Thiruvasagam ... J. L. González-Rios Luis M. Garces-Socarras Symeon Chatzinotas Juan Carlos Merlano-Duncan Symeon Chatzinotas 36 4 0 05 Sep 2024
Towards General Industrial Intelligence: A Survey on IIoT-Enhanced Continual Large Models Jiao Chen Jiayi He Fangfang Chen Zuohong Lv Jianhua Tang Weihua Li Zuozhu Liu Howard H. Yang Guangjie Han AI4CE 36 1 0 02 Sep 2024
Boosting Open-Domain Continual Learning via Leveraging Intra-domain Category-aware Prototype Yadong Lu Shitian Zhao Boxiang Yun Dongsheng Jiang Yin Li Qingli Li Yan Wang VLM CLL 28 1 0 19 Aug 2024
A Survey on Model MoErging: Recycling and Routing Among Specialized Experts for Collaborative Learning Prateek Yadav Colin Raffel Mohammed Muqeeth Lucas Caccia Haokun Liu Tianlong Chen Joey Tianyi Zhou Leshem Choshen Alessandro Sordoni MoMe 46 21 0 13 Aug 2024
SaulLM-54B & SaulLM-141B: Scaling Up Domain Adaptation for the Legal Domain Pierre Colombo T. Pires Malik Boudiaf Rui Melo Dominic Culver Sofia Morgado Etienne Malaboeuf Gabriel Hautreux Johanne Charpentier Michael Desa ELM AILaw ALM 40 12 0 28 Jul 2024
CLIP with Generative Latent Replay: a Strong Baseline for Incremental Learning Emanuele Frascaroli Aniello Panariello Pietro Buzzega Lorenzo Bonicelli Angelo Porrello Simone Calderara VLM CLL 35 3 0 22 Jul 2024
Mixture of A Million Experts Xu Owen He MoE 41 25 0 04 Jul 2024
Advancing Cross-domain Discriminability in Continual Learning of Vison-Language Models Yicheng Xu Yuxin Chen Jiahao Nie Yusong Wang Huiping Zhuang Manabu Okumura VLM CLL 46 6 0 27 Jun 2024
Auto-selected Knowledge Adapters for Lifelong Person Re-identification Xuelin Qian Ruiqi Wu Gong Cheng Junwei Han CLL 52 2 0 29 May 2024
Mixture of Experts Meets Prompt-Based Continual Learning Minh Le An Nguyen Huy Nguyen Trang Nguyen Trang Pham L. Ngo Nhat Ho CLL 49 7 0 23 May 2024
FeTT: Continual Class Incremental Learning via Feature Transformation Tuning Sunyuan Qiang Xuxin Lin Yanyan Liang Jun Wan Du Zhang CLL 48 1 0 20 May 2024
Learning More Generalized Experts by Merging Experts in Mixture-of-Experts Sejik Park FedML CLL MoMe 37 5 0 19 May 2024