BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models

18 June 2021

Papers citing "BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models"

50 / 819 papers shown

Title
Revisiting Prefix-tuning: Statistical Benefits of Reparameterization among Prompts Minh Le Chau Nguyen Huy Nguyen Quyen Tran Trung Le Nhat Ho 44 4 0 03 Oct 2024
Differentially Private Parameter-Efficient Fine-tuning for Large ASR Models Hongbin Liu Lun Wang Om Thakkar Abhradeep Thakurta Arun Narayanan 37 0 0 02 Oct 2024
PrivTuner with Homomorphic Encryption and LoRA: A P3EFT Scheme for Privacy-Preserving Parameter-Efficient Fine-Tuning of AI Foundation Models Yang Li Wenhan Yu Jun Zhao 35 1 0 01 Oct 2024
HDMoLE: Mixture of LoRA Experts with Hierarchical Routing and Dynamic Thresholds for Fine-Tuning LLM-based ASR Models Bingshen Mu Kun Wei Qijie Shao Yong Xu Lei Xie MoE 44 1 0 30 Sep 2024
Pear: Pruning and Sharing Adapters in Visual Parameter-Efficient Fine-Tuning Yibo Zhong Yao Zhou 26 0 0 29 Sep 2024
Vision-Language Models are Strong Noisy Label Detectors Tong Wei Yiming Li Chun-Shu Li Jiang-Xin Shi Yu-Feng Li Min-Ling Zhang VLM 39 3 0 29 Sep 2024
PEDRO: Parameter-Efficient Fine-tuning with Prompt DEpenDent Representation MOdification Tianfang Xie Tianjing Li Wei Zhu Wei Han Yi Zhao 34 5 0 26 Sep 2024
On the Implicit Relation Between Low-Rank Adaptation and Differential Privacy Saber Malekmohammadi G. Farnadi 32 2 0 26 Sep 2024
Parameter-efficient Bayesian Neural Networks for Uncertainty-aware Depth Estimation Richard D. Paul Alessio Quercia Vincent Fortuin Katharina Nöh Hanno Scharr UQCV BDL 29 2 0 25 Sep 2024
Vision-Language Model Fine-Tuning via Simple Parameter-Efficient Modification Ming Li J. Zhong Chenxin Li Liuzhuozheng Li Nie Lin Masashi Sugiyama CLIP VLM 30 5 0 25 Sep 2024
Multiple-Exit Tuning: Towards Inference-Efficient Adaptation for Vision Transformer Zheng Liu Jinchao Zhu Nannan Li Gao Huang 29 0 0 21 Sep 2024
HUT: A More Computation Efficient Fine-Tuning Method With Hadamard Updated Transformation Geyuan Zhang Xiaofei Zhou Chuheng Chen 29 0 0 20 Sep 2024
Beyond LoRA: Exploring Efficient Fine-Tuning Techniques for Time Series Foundational Models Divij Gupta Anubhav Bhatti Surajsinh Parmar AI4TS 34 1 0 17 Sep 2024
Propulsion: Steering LLM with Tiny Fine-Tuning Md. Kowsher Nusrat Jahan Prottasha Prakash Bhat 51 4 0 17 Sep 2024
CtRNet-X: Camera-to-Robot Pose Estimation in Real-world Conditions Using a Single Camera Jingpei Lu Zekai Liang Tristin Xie Florian Ritcher Shan Lin Sainan Liu Michael C. Yip 29 5 0 16 Sep 2024
Self-Masking Networks for Unsupervised Adaptation Alfonso Taboada Warmerdam Mathilde Caron Yuki M. Asano 49 1 0 11 Sep 2024
PanAdapter: Two-Stage Fine-Tuning with Spatial-Spectral Priors Injecting for Pansharpening Ruocheng Wu ZiEn Zhang ShangQi Deng YuLe Duan LiangJian Deng 45 0 0 11 Sep 2024
FLoRA: Federated Fine-Tuning Large Language Models with Heterogeneous Low-Rank Adaptations Ziyao Wang Zheyu Shen Yexiao He Guoheng Sun Hongyi Wang Lingjuan Lyu Ang Li 32 29 0 09 Sep 2024
LLMs Will Always Hallucinate, and We Need to Live With This Sourav Banerjee Ayushi Agarwal Saloni Singla HILM LRM 32 35 0 09 Sep 2024
Efficient Training of Large Vision Models via Advanced Automated Progressive Learning Changlin Li Jiawei Zhang Sihao Lin Zongxin Yang Junwei Liang Xiaodan Liang Xiaojun Chang VLM 33 0 0 06 Sep 2024
iConFormer: Dynamic Parameter-Efficient Tuning with Input-Conditioned Adaptation Hayeon Jo Hyesong Choi Minhee Cho Dongbo Min 44 1 0 04 Sep 2024
A Novel Hybrid Parameter-Efficient Fine-Tuning Approach for Hippocampus Segmentation and Alzheimer's Disease Diagnosis Wangang Cheng Guanghua He Keli Hu Mingyu Fang Liang Dong Zhong Li Hancan Zhu 44 0 0 02 Sep 2024
Pre-training Everywhere: Parameter-Efficient Fine-Tuning for Medical Image Analysis via Target Parameter Pre-training Xingliang Lei Yiwen Ye Ziyang Chen Minglei Shu Yong Xia 50 1 0 27 Aug 2024
CVPT: Cross-Attention help Visual Prompt Tuning adapt visual task Lingyun Huang Jianxu Mao Yaonan Wang Junfei Yi Ziming Tao VLM VPVLM 50 1 0 27 Aug 2024
Step-by-Step Unmasking for Parameter-Efficient Fine-tuning of Large Language Models Aradhye Agarwal Suhas K Ramesh Ayan Sengupta Tanmoy Chakraborty 25 1 0 26 Aug 2024
NoRA: Nested Low-Rank Adaptation for Efficient Fine-Tuning Large Models Cheng Lin Lujun Li Dezhi Li Jie Zou Wei Xue Yike Guo AI4TS 46 4 0 18 Aug 2024
OU-CoViT: Copula-Enhanced Bi-Channel Multi-Task Vision Transformers with Dual Adaptation for OU-UWF Images Yang Li Jianing Deng Chong Zhong Danjuan Yang Meiyan Li A. H. Welsh Aiyi Liu Xingtao Zhou Catherine C. Liu Bo Fu 29 0 0 18 Aug 2024
5%>100%: Breaking Performance Shackles of Full Fine-Tuning on Visual Recognition Tasks Dongshuo Yin Leiyi Hu Bin Li Youqun Zhang Xue Yang 46 7 0 15 Aug 2024
SeLoRA: Self-Expanding Low-Rank Adaptation of Latent Diffusion Model for Medical Image Synthesis Yuchen Mao Hongwei Bran Li Wei Pang G. Papanastasiou G. Yang Chengjia Wang MedIm 47 2 0 13 Aug 2024
Token Compensator: Altering Inference Cost of Vision Transformer without Re-Tuning Shibo Jie Yehui Tang Jianyuan Guo Zhi-Hong Deng Kai Han Yunhe Wang VLM 41 4 0 13 Aug 2024
Multi-scale Contrastive Adaptor Learning for Segmenting Anything in Underperformed Scenes Ke Zhou Zhongwei Qiu Dongmei Fu VLM 43 1 0 12 Aug 2024
Unsupervised Domain Adaption Harnessing Vision-Language Pre-training Wenlve Zhou Zhiheng Zhou VLM 38 33 0 05 Aug 2024
Contribution-based Low-Rank Adaptation with Pre-training Model for Real Image Restoration Donwon Park Leixian Shen Se Young Chun 32 2 0 02 Aug 2024
Tensor Train Low-rank Approximation (TT-LoRA): Democratizing AI with Accelerated LLMs Afia Anjum Maksim E. Eren V. Setlur Boian Alexandrov Manish Bhattarai 29 2 0 02 Aug 2024
Memorization Capacity for Additive Fine-Tuning with Small ReLU Networks Jy-yong Sohn Dohyun Kwon Seoyeon An Kangwook Lee 46 0 0 01 Aug 2024
Multi-Modal Parameter-Efficient Fine-tuning via Graph Neural Network Bin Cheng Jiaxuan Lu 30 0 0 01 Aug 2024
CELLM: An Efficient Communication in Large Language Models Training for Federated Learning Raja Vavekanand Kira Sam 56 0 0 30 Jul 2024
Forecast-PEFT: Parameter-Efficient Fine-Tuning for Pre-trained Motion Forecasting Models Jifeng Wang Kaouther Messaoud Yuejiang Liu Juergen Gall Alexandre Alahi 42 0 0 28 Jul 2024
Ego-VPA: Egocentric Video Understanding with Parameter-efficient Adaptation Tz-Ying Wu Kyle Min Subarna Tripathi Nuno Vasconcelos EgoV 55 0 0 28 Jul 2024
Parameter-Efficient Fine-Tuning via Circular Convolution Aochuan Chen Jiashun Cheng Zijing Liu Ziqi Gao Fugee Tsung Yu Li Jia Li 56 2 0 27 Jul 2024
Parameter-Efficient Fine-Tuning for Continual Learning: A Neural Tangent Kernel Perspective Jingren Liu Zhong Ji YunLong Yu Jiale Cao Yanwei Pang Jungong Han Xuelong Li CLL 42 5 0 24 Jul 2024
Exploring the Effectiveness and Consistency of Task Selection in Intermediate-Task Transfer Learning Pin-Jie Lin Miaoran Zhang Marius Mosbach Dietrich Klakow 38 0 0 23 Jul 2024
Zero-Shot Embeddings Inform Learning and Forgetting with Vision-Language Encoders Laura Niss Kevin Vogt-Lowell Theodoros Tsiligkaridis VLM 41 0 0 22 Jul 2024
DriveDiTFit: Fine-tuning Diffusion Transformers for Autonomous Driving Jiahang Tu Wei Ji Han Zhao Chao Zhang Roger Zimmermann Hui Qian 38 5 0 22 Jul 2024
CP-Prompt: Composition-Based Cross-modal Prompting for Domain-Incremental Continual Learning Yu Feng Zhen Tian Yifan Zhu Zongfu Han Haoran Luo Guangwei Zhang Meina Song CLL VLM 44 6 0 22 Jul 2024
Missing Modality Prediction for Unpaired Multimodal Learning via Joint Embedding of Unimodal Models Donggeun Kim Taesup Kim 31 4 0 17 Jul 2024
Enhancing Parameter Efficiency and Generalization in Large-Scale Models: A Regularized and Masked Low-Rank Adaptation Approach Yuzhu Mao Siqi Ping Zihao Zhao Yang Liu Wenbo Ding 37 1 0 16 Jul 2024
SDPT: Synchronous Dual Prompt Tuning for Fusion-based Visual-Language Pre-trained Models Yang Zhou Yongjian Wu Jiya Saiyin Bingzheng Wei Maode Lai Eric Chang Yan Xu VLM 51 0 0 16 Jul 2024
Revolutionizing Bridge Operation and maintenance with LLM-based Agents: An Overview of Applications and Insights Xinyu-Chen Lianzhen-Zhang LLMAG AI4CE 45 2 0 14 Jul 2024
Low-Rank Interconnected Adaptation Across Layers Yibo Zhong Yao Zhou OffRL MoE 48 1 0 13 Jul 2024