v1v2v3v4 (latest)

ExPLoRA: Parameter-Efficient Extended Pre-Training to Adapt Vision Transformers under Domain Shifts

16 June 2024

Papers citing "ExPLoRA: Parameter-Efficient Extended Pre-Training to Adapt Vision Transformers under Domain Shifts"

50 / 77 papers shown

Title
A Sensor Agnostic Domain Generalization Framework for Leveraging Geospatial Foundation Models: Enhancing Semantic Segmentation viaSynergistic Pseudo-Labeling and Generative Learning Anan Yaghmour Melba M. Crawford Saurabh Prasad 55 0 0 02 May 2025
Efficient Self-Supervised Learning for Earth Observation via Dynamic Dataset Curation Thomas Kerdreux A. Tuel Quentin Febvre A. Mouche Bertrand Chapron 124 0 0 09 Apr 2025
5%>100%: Breaking Performance Shackles of Full Fine-Tuning on Visual Recognition Tasks Dongshuo Yin Leiyi Hu Bin Li Youqun Zhang Xue Yang 95 10 0 15 Aug 2024
Adapters Strike Back Jan-Martin O. Steitz Stefan Roth 69 7 0 10 Jun 2024
Advancing human-centric AI for robust X-ray analysis through holistic self-supervised learning Théo Moutakanni Piotr Bojanowski G. Chassagnon Céline Hudelot Armand Joulin Yann LeCun Matthew Muckley Maxime Oquab M. Revel Maria Vakalopoulou MedIm AI4CE LM&MA 52 10 0 02 May 2024
Connect Later: Improving Fine-tuning for Robustness with Targeted Augmentations Helen Qu Sang Michael Xie 77 5 0 08 Jan 2024
Mixtral of Experts Albert Q. Jiang Alexandre Sablayrolles Antoine Roux A. Mensch Blanche Savary ... Théophile Gervet Thibaut Lavril Thomas Wang Timothée Lacroix William El Sayed MoE LLMAG 164 1,123 0 08 Jan 2024
SA $^2$ VP: Spatially Aligned-and-Adapted Visual Prompt Wenjie Pei Tongqi Xia Fanglin Chen Jinsong Li Jiandong Tian Guangming Lu VLM VPVLM 45 11 0 16 Dec 2023
DiffusionSat: A Generative Foundation Model for Satellite Imagery Samar Khanna Patrick Liu Linqi Zhou Chenlin Meng Robin Rombach Marshall Burke David B. Lobell Stefano Ermon 68 65 0 06 Dec 2023
Adapter is All You Need for Tuning Visual Tasks Dongshuo Yin Leiyi Hu Bin Li Youqun Zhang 51 15 0 25 Nov 2023
Parameter-Efficient Orthogonal Finetuning via Butterfly Factorization Weiyang Liu Zeju Qiu Yao Feng Yuliang Xiu Yuxuan Xue ... Songyou Peng Yandong Wen Michael J. Black Adrian Weller Bernhard Schölkopf 94 72 0 10 Nov 2023
Vision Transformers Need Registers Zilong Chen Maxime Oquab Julien Mairal Huaping Liu ViT 188 355 0 28 Sep 2023
Differentiable Weight Masks for Domain Transfer Samarth Khanna Skanda Vaidyanath Akash Velu 59 1 0 26 Aug 2023
DomainAdaptor: A Novel Approach to Test-time Adaptation Jian Zhang Lei Qi Yinghuan Shi Yang Gao OOD TTA 83 17 0 20 Aug 2023
E^2VPT: An Effective and Efficient Approach for Visual Prompt Tuning Cheng Han Qifan Wang Yiming Cui Zhiwen Cao Wenguan Wang Siyuan Qi Dongfang Liu VPVLM VLM 86 54 0 25 Jul 2023
ReLoRA: High-Rank Training Through Low-Rank Updates Vladislav Lialin Namrata Shivagunde Sherin Muckatira Anna Rumshisky BDL 88 117 0 11 Jul 2023
One-for-All: Generalized LoRA for Parameter-Efficient Fine-tuning Arnav Chavan Zhuang Liu D. K. Gupta Eric P. Xing Zhiqiang Shen 88 92 0 13 Jun 2023
Controlling Text-to-Image Diffusion by Orthogonal Finetuning Zeju Qiu Wei-yu Liu Haiwen Feng Yuxuan Xue Yao Feng Zhen Liu Dan Zhang Adrian Weller Bernhard Schölkopf DiffM 100 158 0 12 Jun 2023
Improving Visual Prompt Tuning for Self-supervised Vision Transformers S. Yoo Eunji Kim Dahuin Jung Jungbeom Lee Sung-Hoon Yoon VLM 123 43 0 08 Jun 2023
Empirical Analysis of the Strengths and Weaknesses of PEFT Techniques for LLMs George Pu Anirudh Jain Jihan Yin Russell Kaplan 71 43 0 28 Apr 2023
Text2Seg: Remote Sensing Image Semantic Segmentation via Text-Guided Visual Foundation Models Jielu Zhang Zhongliang Zhou Gengchen Mai Lan Mu Mengxuan Hu Sheng Li VLM 68 48 0 20 Apr 2023
W-MAE: Pre-trained weather model with masked autoencoder for multi-variable weather forecasting Xin Man Chenghong Zhang Jin Feng Changyu Li Jie Shao AI4Cl 111 25 0 18 Apr 2023
DINOv2: Learning Robust Visual Features without Supervision Maxime Oquab Timothée Darcet Théo Moutakanni Huy Q. Vo Marc Szafraniec ... Hervé Jégou Julien Mairal Patrick Labatut Armand Joulin Piotr Bojanowski VLM CLIP SSL 392 3,506 0 14 Apr 2023
Patch-Mix Transformer for Unsupervised Domain Adaptation: A Game Perspective Jinjing Zhu Haotian Bai Lin Wang ViT 134 77 0 23 Mar 2023
FireRisk: A Remote Sensing Dataset for Fire Risk Assessment with Benchmarks Using Supervised and Self-supervised Learning Shuchang Shen Sachith Seneviratne Xinye Wanyan M. Kirley 73 14 0 13 Mar 2023
Convolutional Visual Prompt for Robust Visual Perception Yun-Yun Tsai Chengzhi Mao Junfeng Yang VLM VPVLM 100 15 0 01 Mar 2023
LLaMA: Open and Efficient Foundation Language Models Hugo Touvron Thibaut Lavril Gautier Izacard Xavier Martinet Marie-Anne Lachaux ... Faisal Azhar Aurelien Rodriguez Armand Joulin Edouard Grave Guillaume Lample ALM PILM 1.5K 13,472 0 27 Feb 2023
Towards Geospatial Foundation Models via Continual Pretraining Matías Mendieta Boran Han Xingjian Shi Yi Zhu Chen Chen VLM AI4CE 115 73 0 09 Feb 2023
Scale-MAE: A Scale-Aware Masked Autoencoder for Multiscale Geospatial Representation Learning Colorado Reed Ritwik Gupta Shufan Li S. Brockman Christopher Funk Brian Clipp Kurt Keutzer Salvatore Candido M. Uyttendaele Trevor Darrell 165 190 0 30 Dec 2022
Finetune like you pretrain: Improved finetuning of zero-shot vision models Sachin Goyal Ananya Kumar Sankalp Garg Zico Kolter Aditi Raghunathan CLIP VLM 120 156 0 01 Dec 2022
Scaling & Shifting Your Features: A New Baseline for Efficient Model Tuning Dongze Lian Daquan Zhou Jiashi Feng Xinchao Wang 86 262 0 17 Oct 2022
Visual Prompt Tuning for Test-time Domain Adaptation Yunhe Gao Xingjian Shi Yi Zhu Hongya Wang Zhiqiang Tang Xiong Zhou Mu Li Dimitris N. Metaxas VPVLM VLM 154 89 0 10 Oct 2022
Pro-tuning: Unified Prompt Tuning for Vision Tasks Xing Nie Bolin Ni Jianlong Chang Gaomeng Meng Chunlei Huo Zhaoxiang Zhang Shiming Xiang Qi Tian Chunhong Pan AAML VPVLM VLM 106 75 0 28 Jul 2022
SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagery Yezhen Cong Samarth Khanna Chenlin Meng Patrick Liu Erik Rozi Yutong He Marshall Burke David B. Lobell Stefano Ermon ViT 82 275 0 17 Jul 2022
Vision Transformer Adapter for Dense Predictions Zhe Chen Yuchen Duan Wenhai Wang Junjun He Tong Lu Jifeng Dai Yu Qiao 138 567 0 17 May 2022
Safe Self-Refinement for Transformer-based Domain Adaptation Tao Sun Cheng Lu Tianshuo Zhang Haibin Ling ViT 65 86 0 16 Apr 2022
PaLM: Scaling Language Modeling with Pathways Aakanksha Chowdhery Sharan Narang Jacob Devlin Maarten Bosma Gaurav Mishra ... Kathy Meier-Hellstern Douglas Eck J. Dean Slav Petrov Noah Fiedel PILM LRM 535 6,301 0 05 Apr 2022
MultiMAE: Multi-modal Multi-task Masked Autoencoders Roman Bachmann David Mizrahi Andrei Atanov Amir Zamir 134 278 0 04 Apr 2022
VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Training Zhan Tong Yibing Song Jue Wang Limin Wang ViT 230 1,206 0 23 Mar 2022
Visual Prompt Tuning Menglin Jia Luming Tang Bor-Chun Chen Claire Cardie Serge Belongie Bharath Hariharan Ser-Nam Lim VLM VPVLM 158 1,645 0 23 Mar 2022
Masked Autoencoders for Point Cloud Self-supervised Learning Yatian Pang Wenxiao Wang Francis E. H. Tay Wen Liu Yonghong Tian Liuliang Yuan 3DPC ViT 111 477 0 13 Mar 2022
Towards Unsupervised Domain Adaptation via Domain-Transformer Chuan-Xian Ren Yiteng Zhai You-Wei Luo Meng Li ViT 66 9 0 24 Feb 2022
High-Resolution Image Synthesis with Latent Diffusion Models Robin Rombach A. Blattmann Dominik Lorenz Patrick Esser Bjorn Ommer 3DV 505 15,788 0 20 Dec 2021
iBOT: Image BERT Pre-Training with Online Tokenizer Jinghao Zhou Chen Wei Huiyu Wang Wei Shen Cihang Xie Alan Yuille Tao Kong 88 742 0 15 Nov 2021
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 477 7,827 0 11 Nov 2021
CDTrans: Cross-domain Transformer for Unsupervised Domain Adaptation Tongkun Xu Weihua Chen Pichao Wang Fan Wang Hao Li Rong Jin ViT 136 220 0 13 Sep 2021
TVT: Transferable Vision Transformer for Unsupervised Domain Adaptation Jinyu Yang Jingjing Liu N. Xu Junzhou Huang 85 127 0 12 Aug 2021
LoRA: Low-Rank Adaptation of Large Language Models J. E. Hu Yelong Shen Phillip Wallis Zeyuan Allen-Zhu Yuanzhi Li Shean Wang Lu Wang Weizhu Chen OffRL AI4TS AI4CE ALM AIMat 502 10,526 0 17 Jun 2021
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 732 6,135 0 29 Apr 2021
Seasonal Contrast: Unsupervised Pre-Training from Uncurated Remote Sensing Data Oscar Manas Alexandre Lacoste Xavier Giró-i-Nieto David Vazquez Pau Rodríguez López 87 266 0 30 Mar 2021