Convolutional Bypasses Are Better Vision Transformer Adapters

14 July 2022

Papers citing "Convolutional Bypasses Are Better Vision Transformer Adapters"

40 / 90 papers shown

Title
S-Adapter: Generalizing Vision Transformer for Face Anti-Spoofing with Statistical Tokens Rizhao Cai Zitong Yu Chen Kong Haoliang Li Changsheng Chen Yongjian Hu Alex C. Kot 42 11 0 07 Sep 2023
Parameter-Efficient Transfer Learning for Remote Sensing Image-Text Retrieval Yuan. Yuan Yangfan Zhan Zhitong Xiong VLM 33 39 0 24 Aug 2023
SimDA: Simple Diffusion Adapter for Efficient Video Generation Zhen Xing Qi Dai Hang-Rui Hu Zuxuan Wu Yu-Gang Jiang VGen DiffM 35 81 0 18 Aug 2023
ZhiJian: A Unifying and Rapidly Deployable Toolbox for Pre-trained Model Reuse Yi-Kai Zhang Lu Ren Chao Yi Qiwen Wang De-Chuan Zhan Han-Jia Ye 23 2 0 17 Aug 2023
Multimodal Adaptation of CLIP for Few-Shot Action Recognition Jiazheng Xing Mengmeng Wang Xiaojun Hou Guangwen Dai Jingdong Wang Yong-Jin Liu VLM 22 0 0 03 Aug 2023
Revisiting the Parameter Efficiency of Adapters from the Perspective of Precision Redundancy Shibo Jie Haoqing Wang Zhiwei Deng 19 31 0 31 Jul 2023
Pre-train, Adapt and Detect: Multi-Task Adapter Tuning for Camouflaged Object Detection Yinghui Xing Dexuan Kong Shizhou Zhang Geng Chen Lingyan Ran Peng Wang Yanning Zhang 43 4 0 20 Jul 2023
SAMAug: Point Prompt Augmentation for Segment Anything Model Haixing Dai Chong Ma Zhiling Yan Zheng Liu Enze Shi ... Wei Liu Quanzheng Li Lichao Sun Shu Zhang Tianming Liu Xiang Li VLM 42 44 0 03 Jul 2023
Review of Large Vision Models and Visual Prompt Engineering Jiaqi Wang Zheng Liu Lin Zhao Zihao Wu Chong Ma ... Bao Ge Yixuan Yuan Dinggang Shen Tianming Liu Shu Zhang VLM LRM 55 146 0 03 Jul 2023
TaCA: Upgrading Your Visual Foundation Model with Task-agnostic Compatible Adapter Binjie Zhang Yixiao Ge Xuyuan Xu Ying Shan Mike Zheng Shou 47 7 0 22 Jun 2023
Parameter-efficient is not sufficient: Exploring Parameter, Memory, and Time Efficient Adapter Tuning for Dense Predictions Dongshuo Yin Xueting Han Bin Li Hao Feng Jinghua Bai VPVLM 31 17 0 16 Jun 2023
Retrieval-Enhanced Visual Prompt Learning for Few-shot Classification Jintao Rong Hao Chen Tianrun Chen Linlin Ou Xinyi Yu Yifan Liu VLM VPVLM 15 6 0 04 Jun 2023
Do We Really Need a Large Number of Visual Prompts? Youngeun Kim Yuhang Li Abhishek Moitra Ruokai Yin Priyadarshini Panda VLM VPVLM 43 5 0 26 May 2023
VLAB: Enhancing Video Language Pre-training by Feature Adapting and Blending Xingjian He Sihan Chen Fan Ma Zhicheng Huang Xiaojie Jin Zikang Liu Dongmei Fu Yi Yang Jiaheng Liu Jiashi Feng VLM CLIP 23 17 0 22 May 2023
Visual Tuning Bruce X. B. Yu Jianlong Chang Haixin Wang Lin Liu Shijie Wang ... Lingxi Xie Haojie Li Zhouchen Lin Qi Tian Chang Wen Chen VLM 49 38 0 10 May 2023
Consolidator: Mergeable Adapter with Grouped Connections for Visual Adaptation Tianxiang Hao Hui Chen Yuchen Guo Guiguang Ding 42 16 0 30 Apr 2023
PVP: Pre-trained Visual Parameter-Efficient Tuning Zhao-quan Song Ke Yang Naiyang Guan Junjie Zhu Peng Qiao Qingyong Hu VPVLM VLM 35 3 0 26 Apr 2023
Visual Prompt Multi-Modal Tracking Jiawen Zhu Simiao Lai Xin Chen D. Wang Huchuan Lu VLM 38 150 0 20 Mar 2023
Dual-path Adaptation from Image to Video Transformers Jungin Park Jiyoung Lee Kwanghoon Sohn ViT 21 37 0 17 Mar 2023
Rehearsal-Free Domain Continual Face Anti-Spoofing: Generalize More and Forget Less Rizhao Cai Yawen Cui Zhi Li Zitong Yu Haoliang Li Yongjian Hu Alex C. Kot CLL 39 20 0 16 Mar 2023
Sensitivity-Aware Visual Parameter-Efficient Fine-Tuning Haoyu He Jianfei Cai Jing Zhang Dacheng Tao Bohan Zhuang VPVLM 22 50 0 15 Mar 2023
Revisit Parameter-Efficient Transfer Learning: A Two-Stage Paradigm Hengyuan Zhao Hao Luo Yuyang Zhao Pichao Wang F. Wang Mike Zheng Shou 29 5 0 14 Mar 2023
ViM: Vision Middleware for Unified Downstream Transferring Yutong Feng Biao Gong Jianwen Jiang Yiliang Lv Yujun Shen Deli Zhao Jingren Zhou 32 1 0 13 Mar 2023
Audio-Visual Deception Detection: DOLOS Dataset and Parameter-Efficient Crossmodal Learning Xiaobao Guo Nithish Muthuchamy Selvaraj Zitong Yu A. Kong Bingquan Shen Alex C. Kot 38 8 0 09 Mar 2023
Adapter Incremental Continual Learning of Efficient Audio Spectrogram Transformers Nithish Muthuchamy Selvaraj Xiaobao Guo A. Kong Bingquan Shen Alex C. Kot CLL 25 8 0 28 Feb 2023
Towards Efficient Visual Adaption via Structural Re-parameterization Gen Luo Minglang Huang Yiyi Zhou Xiaoshuai Sun Guannan Jiang Zhiyu Wang Rongrong Ji VLM VPVLM 14 78 0 16 Feb 2023
Generalized Few-Shot Continual Learning with Contrastive Mixture of Adapters Yawen Cui Zitong Yu Rizhao Cai Xuna Wang Alex C. Kot Li Liu CLL 31 7 0 12 Feb 2023
Rethinking Vision Transformer and Masked Autoencoder in Multimodal Face Anti-Spoofing Zitong Yu Rizhao Cai Yawen Cui Xin Liu Yongjian Hu Alex C. Kot 24 21 0 11 Feb 2023
Flexible-modal Deception Detection with Audio-Visual Adapter Zhaoxu Li Zitong Yu Nithish Muthuchamy Selvaraj Xiaobao Guo Bingquan Shen A. Kong Alex C. Kot 35 2 0 11 Feb 2023
AIM: Adapting Image Models for Efficient Video Action Recognition Taojiannan Yang Yi Zhu Yusheng Xie Aston Zhang Cheng Chen Mu Li ViT 58 144 0 06 Feb 2023
On the Efficacy of Differentially Private Few-shot Image Classification Marlon Tobaben Aliaksandra Shysheya J. Bronskill Andrew J. Paverd Shruti Tople Santiago Zanella Béguelin Richard Turner Antti Honkela 38 11 0 02 Feb 2023
Visual Query Tuning: Towards Effective Usage of Intermediate Representations for Parameter and Memory Efficient Transfer Learning Cheng-Hao Tu Zheda Mai Wei-Lun Chao 29 44 0 06 Dec 2022
FacT: Factor-Tuning for Lightweight Adaptation on Vision Transformer Shibo Jie Zhi-Hong Deng 23 126 0 06 Dec 2022
Prompt Tuning with Soft Context Sharing for Vision-Language Models Kun Ding Ying Wang Pengzhang Liu Qiang Yu Hao Zhang Shiming Xiang Chunhong Pan VPVLM VLM 29 14 0 29 Aug 2022
FiT: Parameter Efficient Few-shot Transfer Learning for Personalized and Federated Image Classification Aliaksandra Shysheya J. Bronskill Massimiliano Patacchiola Sebastian Nowozin Richard Turner 3DH FedML 40 27 0 17 Jun 2022
AdaptFormer: Adapting Vision Transformers for Scalable Visual Recognition Shoufa Chen Chongjian Ge Zhan Tong Jiangliu Wang Yibing Song Jue Wang Ping Luo 152 638 0 26 May 2022
Vision Transformer Adapter for Dense Predictions Zhe Chen Yuchen Duan Wenhai Wang Junjun He Tong Lu Jifeng Dai Yu Qiao 43 543 0 17 May 2022
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 308 7,443 0 11 Nov 2021
P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Tasks Xiao Liu Kaixuan Ji Yicheng Fu Weng Lam Tam Zhengxiao Du Zhilin Yang Jie Tang VLM 238 806 0 14 Oct 2021
Learning to Prompt for Vision-Language Models Kaiyang Zhou Jingkang Yang Chen Change Loy Ziwei Liu VPVLM CLIP VLM 348 2,271 0 02 Sep 2021