BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models

18 June 2021

Papers citing "BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models"

50 / 819 papers shown

Title
Revisiting semi-supervised learning in the era of foundation models Ping Zhang Zheda Mai Quang-Huy Nguyen Wei-Lun Chao 52 0 0 12 Mar 2025
1LoRA: Summation Compression for Very Low-Rank Adaptation Alessio Quercia Zhuo Cao Arya Bangun Richard D. Paul Abigail Morrison Ira Assent Hanno Scharr 58 0 0 11 Mar 2025
Achieving More with Less: Additive Prompt Tuning for Rehearsal-Free Class-Incremental Learning Haoran Chen Ping Wang Zihan Zhou Xinming Zhang Zuxuan Wu Yu Jiang CLL 60 0 0 11 Mar 2025
AI-native Memory 2.0: Second Me Jiale Wei Xiang Ying Tao Gao Fangyi Bao Felix Tao Jingbo Shang 59 1 0 11 Mar 2025
Multi-Attribute Multi-Grained Adaptation of Pre-Trained Language Models for Text Understanding from Bayesian Perspective You Zhang Jin Wang Liang-Chih Yu Dan Xu Xuejie Zhang 40 0 0 08 Mar 2025
Dynamically evolving segment anything model with continuous learning for medical image segmentation Zhaori Liu Mengyang Li Hu Han Enli Zhang Shiguang Shan Zhiming Zhao VLM 57 0 0 08 Mar 2025
Improving SAM for Camouflaged Object Detection via Dual Stream Adapters Jiaming Liu Linghe Kong Guihai Chen 76 0 0 08 Mar 2025
Integrating Frequency-Domain Representations with Low-Rank Adaptation in Vision-Language Models Md Azim Khan A. Gangopadhyay Jianwu Wang Robert F. Erbacher VLM 59 0 0 08 Mar 2025
Quantum-PEFT: Ultra parameter-efficient fine-tuning Toshiaki Koike-Akino F. Tonin Yongtao Wu Frank Zhengqing Wu Leyla Naz Candogan V. Cevher MQ 54 3 0 07 Mar 2025
Beyond H&E: Unlocking Pathological Insights with Polarization via Self-supervised Learning Yao Du Jiaxin Zhuang Xiaoyu Zheng Jing Cong Limei Guo Chao He Lin Luo Xiaomeng Li MedIm 54 1 0 05 Mar 2025
Personalized Federated Fine-tuning for Heterogeneous Data: An Automatic Rank Learning Approach via Two-Level LoRA Jie Hao Yuman Wu Ali Payani Myungjin Lee Mingrui Liu 45 1 0 05 Mar 2025
Towards hyperparameter-free optimization with differential privacy Zhiqi Bu Ruixuan Liu 32 2 0 02 Mar 2025
Dynamic Gradient Sparsification Training for Few-Shot Fine-tuning of CT Lymph Node Segmentation Foundation Model Zihao Luo Zijun Gao Wenjun Liao Shichuan Zhang Guotai Wang Xiangde Luo 47 0 0 02 Mar 2025
Unsupervised Parameter Efficient Source-free Post-pretraining Abhishek Jha Tinne Tuytelaars Yuki M. Asano OOD 45 0 0 28 Feb 2025
HaLoRA: Hardware-aware Low-Rank Adaptation for Large Language Models Based on Hybrid Compute-in-Memory Architecture Taiqiang Wu Chenchen Ding Wenyong Zhou Yuxin Cheng Xincheng Feng Shuqi Wang Chufan Shi Z. Liu Ngai Wong 58 0 0 27 Feb 2025
MobiLLM: Enabling LLM Fine-Tuning on the Mobile Device via Server Assisted Side Tuning Liang Li Xingke Yang Wen Wu Hao Wang Tomoaki Ohtsuki Xin Fu Miao Pan Xuemin Shen 38 1 0 27 Feb 2025
CLLoRA: An Approach to Measure the Effects of the Context Length for LLM Fine-Tuning Ping Zhang Zhaorui Zhang Sheng Di Yao Xin Benben Liu 50 1 0 26 Feb 2025
NEAT: Nonlinear Parameter-efficient Adaptation of Pre-trained Models Yibo Zhong Haoxiang Jiang Lincan Li Ryumei Nakada Tianci Liu Linjun Zhang Huaxiu Yao Haoyu Wang 82 2 0 24 Feb 2025
DP-MemArc: Differential Privacy Transfer Learning for Memory Efficient Language Models Yanming Liu Xinyue Peng Yuwei Zhang Xiaolan Ke Songhang Deng ... Sheng Cheng Xun Wang Jianwei Yin Tianyu Du Xuhong Zhang 86 0 0 21 Feb 2025
LowRA: Accurate and Efficient LoRA Fine-Tuning of LLMs under 2 Bits Zikai Zhou Qizheng Zhang Hermann Kumbong Kunle Olukotun MQ 276 0 0 12 Feb 2025
The impact of allocation strategies in subset learning on the expressive power of neural networks Ofir Schlisselberg Ran Darshan 93 0 0 10 Feb 2025
KARST: Multi-Kernel Kronecker Adaptation with Re-Scaling Transmission for Visual Classification Yue Zhu Haiwen Diao Shang Gao Long Chen Huchuan Lu 89 0 0 10 Feb 2025
DiTASK: Multi-Task Fine-Tuning with Diffeomorphic Transformations Krishna Sri Ipsit Mantri Carola-Bibiane Schönlieb Bruno Ribeiro Chaim Baskin Moshe Eliasof 43 0 0 09 Feb 2025
LoCA: Location-Aware Cosine Adaptation for Parameter-Efficient Fine-Tuning Zhekai Du Yinjie Min Jingjing Li Ke Lu Changliang Zou Liuhua Peng Tingjin Chu Mingming Gong 186 1 0 05 Feb 2025
Robust Federated Finetuning of LLMs via Alternating Optimization of LoRA Shuangyi Chen Yuanxin Guo Yue Ju Harik Dalal Ashish Khisti 48 2 0 03 Feb 2025
PARA: Parameter-Efficient Fine-tuning with Prompt Aware Representation Adjustment Zequan Liu Yi Zhao Ming Tan Wei Zhu Aaron Xuxiang Tian 43 0 0 03 Feb 2025
Memory-Efficient Fine-Tuning of Transformers via Token Selection Antoine Simoulin Namyong Park Xiaoyi Liu Grey Yang 115 0 0 31 Jan 2025
BLoB: Bayesian Low-Rank Adaptation by Backpropagation for Large Language Models Yibin Wang Haizhou Shi Ligong Han Dimitris N. Metaxas Hao Wang BDL UQLM 116 7 0 28 Jan 2025
Rethinking the Bias of Foundation Model under Long-tailed Distribution Jiahao Chen Bin Qin Jiangmeng Li Hao Chen Bing-Huang Su 85 0 0 27 Jan 2025
Parameter-Efficient Fine-Tuning for Foundation Models Dan Zhang Tao Feng Lilong Xue Yuandong Wang Yuxiao Dong J. Tang 46 8 0 23 Jan 2025
A Resource-Efficient Training Framework for Remote Sensing Text--Image Retrieval Weihang Zhang Jihao Li Shuoke Li Ziqing Niu Jialiang Chen Wenkai Zhang VLM 46 0 0 18 Jan 2025
Transforming Vision Transformer: Towards Efficient Multi-Task Asynchronous Learning Hanwen Zhong Jiaxin Chen Yutong Zhang Di Huang Yunhong Wang MoE 44 0 0 12 Jan 2025
A Hessian-informed hyperparameter optimization for differential learning rate Shiyun Xu Zhiqi Bu Yiliang Zhang Ian Barnett 39 1 0 12 Jan 2025
GraphLoRA: Structure-Aware Contrastive Low-Rank Adaptation for Cross-Graph Transfer Learning Zhe-Rui Yang Jindong Han Chang-Dong Wang Hao Liu OffRL 35 1 0 08 Jan 2025
CM3T: Framework for Efficient Multimodal Learning for Inhomogeneous Interaction Datasets Tanay Agrawal Mohammed Guermal Michal Balazia François Brémond 31 0 0 08 Jan 2025
MaPPER: Multimodal Prior-guided Parameter Efficient Tuning for Referring Expression Comprehension Ting Liu Zunnan Xu Yue Hu Liangtao Shi Zhiqiang Wang Quanjun Yin 65 2 0 03 Jan 2025
GaLore $+$ : Boosting Low-Rank Adaptation for LLMs with Cross-Head Projection Xutao Liao Shaohui Li Yuhui Xu Zhi Li Y. Liu You He VLM 59 3 0 31 Dec 2024
Privacy in Fine-tuning Large Language Models: Attacks, Defenses, and Future Directions Hao Du Shang Liu Lele Zheng Yang Cao Atsuyoshi Nakamura Lei Chen AAML 114 3 0 21 Dec 2024
IV-tuning: Parameter-Efficient Transfer Learning for Infrared-Visible Tasks Yaming Zhang Chenqiang Gao Fangcen Liu Junjie Guo Lan Wang Xinggan Peng Deyu Meng 106 0 0 21 Dec 2024
In-Context Learning Distillation for Efficient Few-Shot Fine-Tuning Yifei Duan Liu Li Zirui Zhai Jinxia Yao 80 0 0 17 Dec 2024
Enhance Vision-Language Alignment with Noise Sida Huang Hongyuan Zhang Xuelong Li VLM 82 1 0 14 Dec 2024
Selective Visual Prompting in Vision Mamba Yifeng Yao Zichen Liu Zhenyu Cui Yuxin Peng Jiahuan Zhou VLM Mamba 93 1 0 12 Dec 2024
PETALface: Parameter Efficient Transfer Learning for Low-resolution Face Recognition Kartik Narayan Nithin Gopalakrishnan Nair Jennifer Xu Rama Chellappa Vishal M. Patel CVBM CLL 72 1 0 10 Dec 2024
KaSA: Knowledge-Aware Singular-Value Adaptation of Large Language Models Fan Wang Juyong Jiang Chansung Park Sunghun Kim Jing Tang 94 1 0 08 Dec 2024
Mixture of Physical Priors Adapter for Parameter-Efficient Fine-Tuning Zehua Wang C. J. Li QiXiang Ye Tong Zhang MoE 84 1 0 03 Dec 2024
Sustainable Self-evolution Adversarial Training Wenxuan Wang Chenglei Wang Huihui Qi Menghao Ye Xuelin Qian Peng Wang Yanning Zhang AAML 71 0 0 03 Dec 2024
Unified Parameter-Efficient Unlearning for LLMs Chenlu Ding Jiancan Wu Yancheng Yuan Jinda Lu Kai Zhang Alex Su Xiang Wang Xiangnan He MU KELM 100 6 0 30 Nov 2024
Enhancing Parameter-Efficient Fine-Tuning of Vision Transformers through Frequency-Based Adaptation S. Ly Hien Nguyen 82 1 0 28 Nov 2024
DESIRE: Dynamic Knowledge Consolidation for Rehearsal-Free Continual Learning Haiyang Guo Fei Zhu Fanhu Zeng Bing Liu Xu-Yao Zhang MoMe CLL 91 3 0 28 Nov 2024
How to Learn a New Language? An Efficient Solution for Self-Supervised Learning Models Unseen Languages Adaption in Low-Resource Scenario Shih-Heng Wang Zih-Ching Chen Jiatong Shi Ming To Chuang Guan-Ting Lin Kuan Po Huang David Harwath Shang-Wen Li Hung-yi Lee 81 1 0 27 Nov 2024