v1v2 (latest)

The Power of Scale for Parameter-Efficient Prompt Tuning

18 April 2021

Papers citing "The Power of Scale for Parameter-Efficient Prompt Tuning"

50 / 2,607 papers shown

Title
PFMBench: Protein Foundation Model Benchmark Zhangyang Gao Hao Wang Cheng Tan Chenrui Xu Mengdi Liu Bozhen Hu Linlin Chao Xiaoming Zhang Stan Z. Li 19 0 0 01 Jun 2025
Prompt-Tuned LLM-Augmented DRL for Dynamic O-RAN Network Slicing Fatemeh Lotfi Hossein Rajoli Fatemeh Afghah 25 0 0 31 May 2025
Assortment of Attention Heads: Accelerating Federated PEFT with Head Pruning and Strategic Client Selection Yeshwanth Venkatesha Souvik Kundu Priyadarshini Panda 29 1 0 31 May 2025
FLoE: Fisher-Based Layer Selection for Efficient Sparse Adaptation of Low-Rank Experts Xinyi Wang Lirong Gao Haobo Wang Yiming Zhang Junbo Zhao MoE 40 0 0 31 May 2025
Lossless Token Sequence Compression via Meta-Tokens John Harvill Ziwei Fan Hao Wang Yizhou Sun Hao Ding Luke Huan Anoop Deoras 28 0 0 30 May 2025
Beyond Multiple Choice: Evaluating Steering Vectors for Adaptive Free-Form Summarization Joschka Braun Carsten Eickhoff Seyed Ali Bahrainian LLMSV 23 0 0 30 May 2025
Benchmarking Foundation Models for Zero-Shot Biometric Tasks Redwan Sony Parisa Farmanifard Hamzeh Alzwairy Nitish Shukla Arun Ross CVBM VLM 56 0 0 30 May 2025
Tournament of Prompts: Evolving LLM Instructions Through Structured Debates and Elo Ratings Anirudh Nair Adi Banerjee Laurent Mombaerts Matthew Hagen Tarik Borogovac 25 0 0 30 May 2025
Position: Federated Foundation Language Model Post-Training Should Focus on Open-Source Models Nikita Agrawal Simon Mertel R. Mayer 66 0 0 29 May 2025
MaCP: Minimal yet Mighty Adaptation via Hierarchical Cosine Projection Yixian Shen Qi Bi Jia-Hong Huang Hongyi Zhu Andy D. Pimentel Anuj Pathania 26 0 0 29 May 2025
An Empirical Study of Federated Prompt Learning for Vision Language Model Zhihao Wang Wenke Huang Tian Chen Zekun Shi Guancheng Wan Yu Qiao Bin Yang Jian Wang Bing Li Mang Ye FedML VLM 26 0 0 29 May 2025
Beyond Zero Initialization: Investigating the Impact of Non-Zero Initialization on LoRA Fine-Tuning Dynamics Shiwei Li Xiandi Luo Xing Tang Haozhao Wang Hao Chen Weihong Luo Yuhua Li Xiuqiang He Ruixuan Li AI4CE 53 0 0 29 May 2025
Evaluating the Sensitivity of LLMs to Prior Context Robert Hankache Kingsley Nketia Acheampong Liang Song Marek Brynda Raad Khraishi Greig A. Cowan 30 0 0 29 May 2025
MAP: Revisiting Weight Decomposition for Low-Rank Adaptation Chongjie Si Zhiyi Shi Yadao Wang Xiaokang Yang Susanto Rahardja Wei Shen 62 0 0 29 May 2025
SC-LoRA: Balancing Efficient Fine-tuning and Knowledge Preservation via Subspace-Constrained LoRA Minrui Luo Fuhang Kuang Yu Wang Zirui Liu Tianxing He CLL 58 0 0 29 May 2025
Adaptive Federated LoRA in Heterogeneous Wireless Networks with Independent Sampling Yanzhao Hou Jiaxiang Geng Boyu Li Xiaofeng Tao Juncheng Wang Xiaodong Xu B. Luo 41 0 0 29 May 2025
Look Within or Look Beyond? A Theoretical Comparison Between Parameter-Efficient and Full Fine-Tuning Yongkang Liu Xingle Xu Ercong Nie Zijing Wang Shi Feng Daling Wang Qian Li Hinrich Schutze 35 0 0 28 May 2025
Efficient Ensemble for Fine-tuning Language Models on Multiple Datasets Dongyue Li Ziniu Zhang Lu Wang Hongyang R. Zhang 39 1 0 28 May 2025
Privacy-preserving Prompt Personalization in Federated Learning for Multimodal Large Language Models Sizai Hou Songze Li Baturalp Buyukates 66 0 0 28 May 2025
MoRE: A Mixture of Low-Rank Experts for Adaptive Multi-Task Learning Dacao Zhang Kun Zhang Shimao Chu Le Wu Xin Li Si Wei MoE ALM OffRL 37 0 0 28 May 2025
On Geometry-Enhanced Parameter-Efficient Fine-Tuning for 3D Scene Segmentation Liyao Tang Zhe Chen Dacheng Tao 3DPC 54 0 0 28 May 2025
Flexible Tool Selection through Low-dimensional Attribute Alignment of Vision and Language Guangfu Hao Haojie Wen Liangxuna Guo Yang Chen Yanchao Bi S. Yu 64 0 0 28 May 2025
Information-Theoretic Complementary Prompts for Improved Continual Text Classification Duzhen Zhang Yong Ren Chenxing Li Dong Yu Tielin Zhang CLL VLM 110 0 0 27 May 2025
Continual Learning on CLIP via Incremental Prompt Tuning with Intrinsic Textual Anchors Haodong Lu Xinyu Zhang Kristen Moore Jason Xue Lina Yao Anton van den Hengel Dong Gong CLL VLM 67 0 0 27 May 2025
Exploring the Latent Capacity of LLMs for One-Step Text Generation Gleb Mezentsev Ivan Oseledets 35 0 0 27 May 2025
Why Do More Experts Fail? A Theoretical Analysis of Model Merging Zijing Wang Xingle Xu Yongkang Liu Yiqun Zhang Peiqin Lin Shi Feng Xiaocui Yang Daling Wang Hinrich Schütze MoMe 43 0 0 27 May 2025
PMA: Towards Parameter-Efficient Point Cloud Understanding via Point Mamba Adapter Yaohua Zha Yanzi Wang Hang Guo Jinpeng Wang Tao Dai Bin Chen Zhihao Ouyang Xue Yuerong Ke Chen Shu-Tao Xia 102 1 0 27 May 2025
LoFT: Low-Rank Adaptation That Behaves Like Full Fine-Tuning Nurbek Tastan Stefanos Laskaridis Martin Takáč Karthik Nandakumar Samuel Horváth AI4CE 86 0 0 27 May 2025
DenseLoRA: Dense Low-Rank Adaptation of Large Language Models Lin Mu Xiaoyu Wang Li Ni Yang Li Zhize Wu Peiquan Jin Yiwen Zhang ALM AI4CE 33 0 0 27 May 2025
Improved Representation Steering for Language Models Zhengxuan Wu Qinan Yu Aryaman Arora Christopher D. Manning Christopher Potts LLMSV 76 0 0 27 May 2025
CSTrack: Enhancing RGB-X Tracking via Compact Spatiotemporal Features X. Feng D. Zhang Shuyan Hu X. Li M. Wu Jie Zhang Xiaosha Chen Kexin Huang 62 0 0 26 May 2025
Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation Tanjil Hasan Sakib Md. Tanzib Hosain Md. Kishor Morol ALM 45 0 0 26 May 2025
MetaWriter: Personalized Handwritten Text Recognition Using Meta-Learned Prompt Tuning Wenhao Gu Li Gu Ching Yee Suen Yang Wang 36 0 0 26 May 2025
APE: Selective Fine-tuning with Acceptance Criteria for Language Model Adaptation Javier Marín 57 0 0 26 May 2025
Rethinking Gating Mechanism in Sparse MoE: Handling Arbitrary Modality Inputs with Confidence-Guided Gate Liangwei Nathan Zheng Wei Emma Zhang Mingyu Guo Miao Xu Olaf Maennel Weitong Chen MoE 35 0 0 26 May 2025
MA-RAG: Multi-Agent Retrieval-Augmented Generation via Collaborative Chain-of-Thought Reasoning Thang Nguyen Peter Chin Yu-Wing Tai LRM 80 1 0 26 May 2025
Optimization-Inspired Few-Shot Adaptation for Large Language Models Boyan Gao Xin Wang Yibo Yang David A. Clifton 59 0 0 25 May 2025
LiSTEN: Learning Soft Token Embeddings for Neural Audio LLMs Pooneh Mousavi Shubham Gupta Cem Subakan Mirco Ravanelli 51 0 0 24 May 2025
HD-PiSSA: High-Rank Distributed Orthogonal Adaptation Yiding Wang Fauxu meng Xuefeng Zhang Fan Jiang Pingzhi Tang Muhan Zhang 48 0 0 24 May 2025
Few-Shot Optimization for Sensor Data Using Large Language Models: A Case Study on Fatigue Detection Elsen Ronando Sozo Inoue 34 0 0 24 May 2025
ThanoRA: Task Heterogeneity-Aware Multi-Task Low-Rank Adaptation Jian Liang Wenke Huang Xianda Guo Guancheng Wan Bo Du Mang Ye MoMe MoE 73 0 0 24 May 2025
RefLoRA: Refactored Low-Rank Adaptation for Efficient Fine-Tuning of Large Models Yilang Zhang Bingcong Li G. Giannakis 246 1 0 24 May 2025
Representation Discrepancy Bridging Method for Remote Sensing Image-Text Retrieval Hailong Ning Siying Wang Tao Lei Xiaopeng Cao Huanmin Dou Bin Zhao Asoke K. Nandi Petia Radeva 30 0 0 22 May 2025
Understanding Prompt Tuning and In-Context Learning via Meta-Learning Tim Genewein Kevin Wenliang Li Jordi Grau-Moya Anian Ruoss Laurent Orseau Marcus Hutter VPVLM 84 1 0 22 May 2025
Align-GRAG: Reasoning-Guided Dual Alignment for Graph Retrieval-Augmented Generation Derong Xu Pengyue Jia Xiaopeng Li Yingyi Zhang Maolin Wang ... Yichao Wang Huifeng Guo Ruiming Tang Enhong Chen Tong Xu RALM 84 0 0 22 May 2025
Amplify Adjacent Token Differences: Enhancing Long Chain-of-Thought Reasoning with Shift-FFN Yao Xu Mingyu Xu Fangyu Lei Wangtao Sun Xiangrong Zeng Bingning Wang Guang Liu Shizhu He Jun Zhao Kang Liu LRM 77 1 0 22 May 2025
Small Language Models in the Real World: Insights from Industrial Text Classification Lujun Li Lama Sleem Niccolo Gentile Geoffrey Nichil Radu State LLMAG 218 0 0 21 May 2025
Quaff: Quantized Parameter-Efficient Fine-Tuning under Outlier Spatial Stability Hypothesis Hong Huang Dapeng Wu 112 0 0 20 May 2025
OSoRA: Output-Dimension and Singular-Value Initialized Low-Rank Adaptation Jialong Han Si Zhang Ke Zhang 37 0 0 20 May 2025
Soft Prompts for Evaluation: Measuring Conditional Distance of Capabilities Ross Nordby 58 0 0 20 May 2025