Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Survey

21 March 2024

Papers citing "Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Survey"

50 / 224 papers shown

Title
Parallel Scaling Law for Language Models Mouxiang Chen Binyuan Hui Zeyu Cui Jiaxi Yang Dayiheng Liu Jianling Sun Junyang Lin Zhongxin Liu MoE LRM 37 0 0 15 May 2025
PT-MoE: An Efficient Finetuning Framework for Integrating Mixture-of-Experts into Prompt Tuning Zongqian Li Yixuan Su Nigel Collier MoE 19 0 0 14 May 2025
Towards Artificial General or Personalized Intelligence? A Survey on Foundation Models for Personalized Federated Intelligence Yu Qiao Huy Q. Le Avi Deb Raha Phuong-Nam Tran Apurba Adhikary Mengchun Zhang Loc X. Nguyen Eui-nam Huh Dusit Niyato C. Hong AI4CE 31 0 0 11 May 2025
Fine-Tuning Large Language Models and Evaluating Retrieval Methods for Improved Question Answering on Building Codes Mohammad Aqib Mohd Hamza Qipei Mei Ying Hei Chui RALM ELM 52 0 0 07 May 2025
Pushing the Limits of Low-Bit Optimizers: A Focus on EMA Dynamics Cong Xu Wenbin Liang Mo Yu Anan Liu K. Zhang Lizhuang Ma J. Wang J. Wang W. Zhang MQ 51 0 0 01 May 2025
A Survey on Parameter-Efficient Fine-Tuning for Foundation Models in Federated Learning Jieming Bian Yuanzhe Peng Lei Wang Yin Huang Jie Xu FedML 65 0 0 29 Apr 2025
Efficient LLMs with AMP: Attention Heads and MLP Pruning Leandro Giusti Mugnaini Bruno Yamamoto Lucas Lauton de Alcantara Victor Zacarias Edson Bollis Lucas Pellicer A. H. R. Costa Artur Jordao 37 0 0 29 Apr 2025
ReCIT: Reconstructing Full Private Data from Gradient in Parameter-Efficient Fine-Tuning of Large Language Models Jin Xie Ruishi He Songze Li Xiaojun Jia Shouling Ji SILM AAML 66 0 0 29 Apr 2025
DYNAMAX: Dynamic computing for Transformers and Mamba based architectures Miguel Nogales Matteo Gambella Manuel Roveri 56 0 0 29 Apr 2025
Can Differentially Private Fine-tuning LLMs Protect Against Privacy Attacks? Hao Du Shang Liu Yang Cao AAML 47 0 0 28 Apr 2025
Fine-tune Smarter, Not Harder: Parameter-Efficient Fine-Tuning for Geospatial Foundation Models Francesc Marti Escofet Benedikt Blumenstiel L. Scheibenreif P. Fraccaro Konrad Schindler 46 0 0 24 Apr 2025
Prompt-Tuning SAM: From Generalist to Specialist with only 2048 Parameters and 16 Training Images Tristan Piater Björn Barz Alexander Freytag VLM MedIm 60 0 0 23 Apr 2025
From Human Memory to AI Memory: A Survey on Memory Mechanisms in the Era of LLMs Yaxiong Wu Sheng Liang Chen Zhang Y. Wang Y. Zhang Huifeng Guo Ruiming Tang Y. Liu KELM 38 1 0 22 Apr 2025
Tina: Tiny Reasoning Models via LoRA Shangshang Wang Julian Asilis Ömer Faruk Akgül Enes Burak Bilgin Ollie Liu W. Neiswanger OffRL LRM 35 1 0 22 Apr 2025
EasyEdit2: An Easy-to-use Steering Framework for Editing Large Language Models Ziwen Xu Shuxun Wang Kewei Xu Haoming Xu Mengru Wang Xinle Deng Yunzhi Yao Guozhou Zheng H. Chen Ningyu Zhang KELM LLMSV 149 0 0 21 Apr 2025
Histogram-based Parameter-efficient Tuning for Passive Sonar Classification Amirmohammad Mohammadi Davelle Carreiro A. V. Dine Joshua Peeples 36 0 0 21 Apr 2025
Vision-Centric Representation-Efficient Fine-Tuning for Robust Universal Foreground Segmentation Guoyi Zhang Siyang Chen Guangsheng Xu Han Wang Xiaohu Zhang 34 0 0 20 Apr 2025
Efficient Parameter Adaptation for Multi-Modal Medical Image Segmentation and Prognosis Numan Saeed Shahad Hardan Muhammad Ridzuan Nada Saadi Karthik Nandakumar Mohammad Yaqub MedIm 133 0 0 18 Apr 2025
Aspect-Based Summarization with Self-Aspect Retrieval Enhanced Generation Yichao Feng Shuai Zhao Y. Li Luwei Xiao Xiaobao Wu Anh Tuan Luu RALM 29 0 0 17 Apr 2025
Foundation Models for Remote Sensing: An Analysis of MLLMs for Object Localization Darryl Hannan John Cooper Dylan White Timothy Doster Henry Kvinge Y. Watkins 24 0 0 14 Apr 2025
UP-Person: Unified Parameter-Efficient Transfer Learning for Text-based Person Retrieval Yating Liu Yaowei Li Xiangyuan Lan Wenming Yang Zimo Liu Q. Liao 31 0 0 14 Apr 2025
Vision-Language Model for Object Detection and Segmentation: A Review and Evaluation Yongchao Feng Yajie Liu Shuai Yang Wenrui Cai J. Zhang ... Jiahui Lv Z. Liu Tengyuan Shi Qingjie Liu Y. Wang MLLM VLM 63 1 0 13 Apr 2025
A Short Survey on Small Reasoning Models: Training, Inference, Applications and Research Directions Chengyu Wang Taolin Zhang Richang Hong Jun Huang ReLM LRM 39 1 0 12 Apr 2025
Long Context In-Context Compression by Getting to the Gist of Gisting Aleksandar Petrov Mark Sandler A. Zhmoginov Nolan Miller Max Vladymyrov 27 0 0 11 Apr 2025
Position: Beyond Euclidean -- Foundation Models Should Embrace Non-Euclidean Geometries Neil He Jiahong Liu Buze Zhang N. Bui Ali Maatouk Menglin Yang Irwin King Melanie Weber Rex Ying 29 0 0 11 Apr 2025
Adaptive Additive Parameter Updates of Vision Transformers for Few-Shot Continual Learning Kyle Stein A. Mahyari Guillermo Francia III Eman El-Sheikh CLL 65 0 0 11 Apr 2025
SDEIT: Semantic-Driven Electrical Impedance Tomography Dong Liu Yuanchao Wu Bowen Tong Jiansong Deng DiffM 30 0 0 05 Apr 2025
Foundation Models for Time Series: A Survey Siva Rama Krishna Kottapalli Karthik Hubli Sandeep Chandrashekhara Garima Jain Sunayana Hubli Gayathri Botla Ramesh Doddaiah AI4TS AI4CE 27 0 0 05 Apr 2025
FISH-Tuning: Enhancing PEFT Methods with Fisher Information Kang Xue Ming Dong Xinhui Tu Tingting He 28 0 0 05 Apr 2025
CATS: Mitigating Correlation Shift for Multivariate Time Series Classification Xiao Lin Zhichen Zeng Tianxin Wei Zhining Liu Yuzhong Chen Hanghang Tong AI4TS 32 0 0 05 Apr 2025
Bridging the Linguistic Divide: A Survey on Leveraging Large Language Models for Machine Translation Baban Gain Dibyanayan Bandyopadhyay Asif Ekbal LM&MA 52 1 0 02 Apr 2025
MetaLoRA: Tensor-Enhanced Adaptive Low-Rank Fine-tuning Maolin Wang Xiangyu Zhao AI4CE 43 0 0 01 Apr 2025
IntrinsiX: High-Quality PBR Generation using Image Priors Peter Kocsis Lukas Höllein Matthias Nießner 33 0 0 01 Apr 2025
LATex: Leveraging Attribute-based Text Knowledge for Aerial-Ground Person Re-Identification Xiang Hu Yuhao Wang Pingping Zhang Huchuan Lu VLM 37 0 0 31 Mar 2025
Assessing Code Understanding in LLMs Cosimo Laneve Alvise Spanò Dalila Ressi S. Rossi M. Bugliesi 46 0 0 31 Mar 2025
MiZero: The Shadowy Defender Against Text Style Infringements Ziwei Zhang Juan Wen Wanli Peng Zhengxian Wu Y. Zhou Yiming Xue 46 0 0 30 Mar 2025
Efficient Adaptation For Remote Sensing Visual Grounding Hasan Moughnieh Mohamad Chalhoub Hasan Nasrallah Cristiano Nattero Paolo Campanella Giovanni Nico A. Ghandour 46 0 0 29 Mar 2025
Task-Aware Parameter-Efficient Fine-Tuning of Large Pre-Trained Models at the Edge Senkang Hu Yanan Ma Yihang Tao Zhengru Fang Zihan Fang Yiqin Deng Sam Kwong Yuguang Fang 24 0 0 29 Mar 2025
GateLens: A Reasoning-Enhanced LLM Agent for Automotive Software Release Analytics Arsham Gholamzadeh Khoee Shuai Wang Yinan Yu R. Feldt Dhasarathy Parthasarathy 51 1 0 27 Mar 2025
Neuroplasticity in Artificial Intelligence -- An Overview and Inspirations on Drop In & Out Learning Yupei Li M. Milling Björn Schuller AI4CE 107 0 0 27 Mar 2025
LLaVA-CMoE: Towards Continual Mixture of Experts for Large Vision-Language Models Hengyuan Zhao Ziqin Wang Qixin Sun Kaiyou Song Yilin Li Xiaolin Hu Qingpei Guo Si Liu KELM CLL MoE 65 0 0 27 Mar 2025
Unlocking the Hidden Potential of CLIP in Generalizable Deepfake Detection Andrii Yermakov Jan Cech Jiri Matas AAML CLIP 53 1 0 25 Mar 2025
Hiding Images in Diffusion Models by Editing Learned Score Functions Haoyu Chen Yunqiao Yang Nan Zhong Kede Ma DiffM 65 0 0 24 Mar 2025
FisherTune: Fisher-Guided Robust Tuning of Vision Foundation Models for Domain Generalized Segmentation Dong Zhao Jinlong Li Shuang Wang Mengyao Wu Qi Zang N. Sebe Zhun Zhong 141 0 0 23 Mar 2025
Decoupling Angles and Strength in Low-rank Adaptation Massimo Bini Leander Girrbach Zeynep Akata 40 0 0 23 Mar 2025
Detecting and Mitigating DDoS Attacks with AI: A Survey Alexandru Apostu Silviu Florin Gheorghe Andrei Iulian Hiji Nicolae Cleju A. Pătraşcu Cristian Rusu Radu Tudor Ionescu Paul Irofti AAML 41 0 0 22 Mar 2025
A Foundational individual Mobility Prediction Model based on Open-Source Large Language Models Zhenlin Qin Leizhen Wang Francisco Camara Pereira Zhenlinag Ma 34 0 0 19 Mar 2025
Empowering Smaller Models: Tuning LLaMA and Gemma with Chain-of-Thought for Ukrainian Exam Tasks Mykyta Syromiatnikov Victoria Ruvinskaya Nataliia Komleva ALM LRM 72 0 0 18 Mar 2025
DPC: Dual-Prompt Collaboration for Tuning Vision-Language Models Haoyang Li Liang Wang Chao Wang Jing Jiang Yan Peng Guodong Long VLM 64 1 0 17 Mar 2025
Analytic Subspace Routing: How Recursive Least Squares Works in Continual Learning of Large Language Model Kai Tong Kang Pan Xiao Zhang Erli Meng Run He Yawen Cui Nuoyan Guo Huiping Zhuang KELM CLL 57 0 0 17 Mar 2025