v1v2 (latest)

Learning without Forgetting for Vision-Language Models

30 May 2023

Da-Wei Zhou

Ziwei Liu

Papers citing "Learning without Forgetting for Vision-Language Models"

50 / 116 papers shown

Title
A simple but strong baseline for online continual learning: Repeated Augmented Rehearsal Yaqian Zhang Bernhard Pfahringer E. Frank Albert Bifet N. Lim Yunzhe Jia CLL 188 44 0 28 Sep 2022
Exploring Example Influence in Continual Learning Q. Sun Fan Lyu Fanhua Shang Wei Feng Liang Wan CLL 128 49 0 25 Sep 2022
SparCL: Sparse Continual Learning on the Edge Zifeng Wang Zheng Zhan Yifan Gong Geng Yuan Wei Niu T. Jian Bin Ren Stratis Ioannidis Yanzhi Wang Jennifer Dy CLL 124 64 0 20 Sep 2022
Image as a Foreign Language: BEiT Pretraining for All Vision and Vision-Language Tasks Wenhui Wang Hangbo Bao Li Dong Johan Bjorck Zhiliang Peng ... Kriti Aggarwal O. Mohammed Saksham Singhal Subhojit Som Furu Wei MLLM VLM ViT 160 647 0 22 Aug 2022
S-Prompts Learning with Pre-trained Transformers: An Occam's Razor for Domain Incremental Learning Yabin Wang Zhiwu Huang Xiaopeng Hong CLL VLM 145 226 0 26 Jul 2022
Tip-Adapter: Training-free Adaption of CLIP for Few-shot Classification Renrui Zhang Zhang Wei Rongyao Fang Peng Gao Kunchang Li Jifeng Dai Yu Qiao Hongsheng Li VLM 145 321 0 19 Jul 2022
AdaptFormer: Adapting Vision Transformers for Scalable Visual Recognition Shoufa Chen Chongjian Ge Zhan Tong Jiangliu Wang Yibing Song Jue Wang Ping Luo 255 706 0 26 May 2022
A Model or 603 Exemplars: Towards Memory-Efficient Class-Incremental Learning Da-Wei Zhou Qiwen Wang Han-Jia Ye De-Chuan Zhan 83 140 0 26 May 2022
CoCa: Contrastive Captioners are Image-Text Foundation Models Jiahui Yu Zirui Wang Vijay Vasudevan Legg Yeung Mojtaba Seyedhosseini Yonghui Wu VLM CLIP OffRL 334 1,314 0 04 May 2022
Flamingo: a Visual Language Model for Few-Shot Learning Jean-Baptiste Alayrac Jeff Donahue Pauline Luc Antoine Miech Iain Barr ... Mikolaj Binkowski Ricardo Barreira Oriol Vinyals Andrew Zisserman Karen Simonyan MLLM VLM 431 3,621 0 29 Apr 2022
DualPrompt: Complementary Prompting for Rehearsal-free Continual Learning Zifeng Wang Zizhao Zhang Sayna Ebrahimi Ruoxi Sun Han Zhang ... Xiaoqi Ren Guolong Su Vincent Perot Jennifer Dy Tomas Pfister CLL VLM VPVLM 140 506 0 10 Apr 2022
FOSTER: Feature Boosting and Compression for Class-Incremental Learning Fu Lee Wang Da-Wei Zhou Han-Jia Ye De-Chuan Zhan CLL 97 262 0 10 Apr 2022
Class-Incremental Learning for Action Recognition in Videos Jaeyoo Park Minsoo Kang Bohyung Han CLL 84 52 0 25 Mar 2022
R-DFCIL: Relation-Guided Representation Learning for Data-Free Class Incremental Learning Qiankun Gao Chen Zhao Guohao Li Jian Zhang CLL 86 70 0 24 Mar 2022
Visual Prompt Tuning Menglin Jia Luming Tang Bor-Chun Chen Claire Cardie Serge Belongie Bharath Hariharan Ser-Nam Lim VLM VPVLM 252 1,661 0 23 Mar 2022
Conditional Prompt Learning for Vision-Language Models Kaiyang Zhou Jingkang Yang Chen Change Loy Ziwei Liu VLM CLIP VPVLM 163 1,367 0 10 Mar 2022
Mind the Gap: Understanding the Modality Gap in Multi-modal Contrastive Representation Learning Weixin Liang Yuhui Zhang Yongchan Kwon Serena Yeung James Zou VLM 154 430 0 03 Mar 2022
SLIP: Self-supervision meets Language-Image Pre-training Norman Mu Alexander Kirillov David Wagner Saining Xie VLM CLIP 158 493 0 23 Dec 2021
PyCIL: A Python Toolbox for Class-Incremental Learning Da-Wei Zhou Fu Lee Wang Han-Jia Ye De-Chuan Zhan CLL 124 98 0 23 Dec 2021
Learning to Prompt for Continual Learning Zifeng Wang Zizhao Zhang Chen-Yu Lee Han Zhang Ruoxi Sun Xiaoqi Ren Guolong Su Vincent Perot Jennifer Dy Tomas Pfister CLL VPVLM KELM VLM 114 801 0 16 Dec 2021
Mimicking the Oracle: An Initial Phase Decorrelation Approach for Class Incremental Learning Yujun Shi Kuangqi Zhou Jian Liang Zihang Jiang Jiashi Feng Philip Torr Song Bai Vincent Y. F. Tan CLL 110 65 0 09 Dec 2021
Florence: A New Foundation Model for Computer Vision Lu Yuan Dongdong Chen Yi-Ling Chen Noel Codella Xiyang Dai ... Zhen Xiao Jianwei Yang Michael Zeng Luowei Zhou Pengchuan Zhang VLM 210 907 0 22 Nov 2021
DyTox: Transformers for Continual Learning with DYnamic TOken eXpansion Arthur Douillard Alexandre Ramé Guillaume Couairon Matthieu Cord CLL 151 314 0 22 Nov 2021
LiT: Zero-Shot Transfer with Locked-image text Tuning Xiaohua Zhai Tianlin Li Basil Mustafa Andreas Steiner Daniel Keysers Alexander Kolesnikov Lucas Beyer VLM 200 561 0 15 Nov 2021
LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairs Christoph Schuhmann Richard Vencu Romain Beaumont R. Kaczmarczyk Clayton Mullis Aarush Katta Theo Coombes J. Jitsev Aran Komatsuzaki VLM MLLM CLIP 256 1,446 0 03 Nov 2021
CLIP-Adapter: Better Vision-Language Models with Feature Adapters Peng Gao Shijie Geng Renrui Zhang Teli Ma Rongyao Fang Yongfeng Zhang Hongsheng Li Yu Qiao VLM CLIP 355 1,066 0 09 Oct 2021
Robust fine-tuning of zero-shot models Mitchell Wortsman Gabriel Ilharco Jong Wook Kim Mike Li Simon Kornblith ... Raphael Gontijo-Lopes Hannaneh Hajishirzi Ali Farhadi Hongseok Namkoong Ludwig Schmidt VLM 266 742 0 04 Sep 2021
Learning to Prompt for Vision-Language Models Kaiyang Zhou Jingkang Yang Chen Change Loy Ziwei Liu VPVLM CLIP VLM 560 2,450 0 02 Sep 2021
Pre-Trained Models: Past, Present and Future Xu Han Zhengyan Zhang Ning Ding Yuxian Gu Xiao Liu ... Jie Tang Ji-Rong Wen Jinhui Yuan Wayne Xin Zhao Jun Zhu AIFin MQ AI4MH 179 865 0 14 Jun 2021
DER: Dynamically Expandable Representation for Class Incremental Learning Shipeng Yan Jiangwei Xie Xuming He CLL 75 462 0 31 Mar 2021
Learning Transferable Visual Models From Natural Language Supervision Alec Radford Jong Wook Kim Chris Hallacy Aditya A. Ramesh Gabriel Goh ... Amanda Askell Pamela Mishkin Jack Clark Gretchen Krueger Ilya Sutskever CLIP VLM 1.1K 30,116 0 26 Feb 2021
Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision Chao Jia Yinfei Yang Ye Xia Yi-Ting Chen Zarana Parekh Hieu H. Pham Quoc V. Le Yun-hsuan Sung Zhen Li Tom Duerig VLM CLIP 571 3,917 0 11 Feb 2021
Prefix-Tuning: Optimizing Continuous Prompts for Generation Xiang Lisa Li Percy Liang 257 4,339 0 01 Jan 2021
Class-incremental learning: survey and performance evaluation on image classification Marc Masana Xialei Liu Bartlomiej Twardowski Mikel Menta Andrew D. Bagdanov Joost van de Weijer CLL 103 701 0 28 Oct 2020
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 801 41,948 0 22 Oct 2020
The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalization Dan Hendrycks Steven Basart Norman Mu Saurav Kadavath Frank Wang ... Samyak Parajuli Mike Guo Basel Alomair Jacob Steinhardt Justin Gilmer OOD 435 1,762 0 29 Jun 2020
MgSvF: Multi-Grained Slow vs. Fast Framework for Few-Shot Class-Incremental Learning Hanbin Zhao Yongjian Fu Mintong Kang Qi Tian Leilei Gan Xi Li CLL 149 104 0 28 Jun 2020
Dark Experience for General Continual Learning: a Strong, Simple Baseline Pietro Buzzega Matteo Boschini Angelo Porrello Davide Abati Simone Calderara BDL CLL 101 928 0 15 Apr 2020
Memory-Efficient Incremental Learning Through Feature Adaptation Ahmet Iscen Jeffrey O. Zhang Svetlana Lazebnik Cordelia Schmid CLL VLM 85 165 0 01 Apr 2020
Semantic Drift Compensation for Class-Incremental Learning Lu Yu Bartlomiej Twardowski Xialei Liu Luis Herranz Kai Wang Yongmei Cheng Shangling Jui Joost van de Weijer CLL 95 345 0 01 Apr 2020
Mnemonics Training: Multi-Class Incremental Learning without Forgetting Yaoyao Liu Yuting Su Anan Liu Bernt Schiele Qianru Sun CLL 101 347 0 24 Feb 2020
Revisiting Meta-Learning as Supervised Learning Wei-Lun Chao Han-Jia Ye De-Chuan Zhan M. Campbell Kilian Q. Weinberger OOD FedML 88 24 0 03 Feb 2020
PyTorch: An Imperative Style, High-Performance Deep Learning Library Adam Paszke Sam Gross Francisco Massa Adam Lerer James Bradbury ... Sasank Chilamkurthy Benoit Steiner Lu Fang Junjie Bai Soumith Chintala ODL 670 42,867 0 03 Dec 2019
Maintaining Discrimination and Fairness in Class Incremental Learning Bowen Zhao Xi Xiao Guojun Gan Bin Zhang Shutao Xia CLL 155 434 0 16 Nov 2019
Large Scale Incremental Learning Yue Wu Yinpeng Chen Lijuan Wang Yuancheng Ye Zicheng Liu Yandong Guo Y. Fu CLL 143 1,264 0 30 May 2019
Learning to Remember: A Synaptic Plasticity Driven Framework for Continual Learning O. Ostapenko M. Puscas T. Klein P. Jähnichen Moin Nabi CLL 195 304 0 05 Apr 2019
Gradient based sample selection for online continual learning Rahaf Aljundi Min Lin Baptiste Goujaud Yoshua Bengio BDL CLL 150 840 0 20 Mar 2019
Parameter-Efficient Transfer Learning for NLP N. Houlsby A. Giurgiu Stanislaw Jastrzebski Bruna Morrone Quentin de Laroussilhe Andrea Gesmundo Mona Attariyan Sylvain Gelly 246 4,558 0 02 Feb 2019
Task-Free Continual Learning Rahaf Aljundi Klaas Kelchtermans Tinne Tuytelaars CLL 144 362 0 10 Dec 2018
Efficient Lifelong Learning with A-GEM Arslan Chaudhry MarcÁurelio Ranzato Marcus Rohrbach Mohamed Elhoseiny CLL 241 1,467 0 02 Dec 2018