v1v2 (latest)

Parameter-Efficient Transfer Learning for NLP

2 February 2019

N. Houlsby

A. Giurgiu

Stanislaw Jastrzebski

Bruna Morrone

Quentin de Laroussilhe

Papers citing "Parameter-Efficient Transfer Learning for NLP"

50 / 2,860 papers shown

Title
Sci-LoRA: Mixture of Scientific LoRAs for Cross-Domain Lay Paraphrasing Ming Cheng Jiaying Gong Hoda Eldardiry AI4CE 61 0 0 24 May 2025
ThanoRA: Task Heterogeneity-Aware Multi-Task Low-Rank Adaptation Jian Liang Wenke Huang Xianda Guo Guancheng Wan Bo Du Mang Ye MoMe MoE 78 0 0 24 May 2025
RefLoRA: Refactored Low-Rank Adaptation for Efficient Fine-Tuning of Large Models Yilang Zhang Bingcong Li G. Giannakis 248 1 0 24 May 2025
HD-PiSSA: High-Rank Distributed Orthogonal Adaptation Yiding Wang Fauxu meng Xuefeng Zhang Fan Jiang Pingzhi Tang Muhan Zhang 50 0 0 24 May 2025
The Unreasonable Effectiveness of Model Merging for Cross-Lingual Transfer in LLMs Lucas Bandarkar Nanyun Peng MoMe LRM 56 0 0 23 May 2025
TabSTAR: A Foundation Tabular Model With Semantically Target-Aware Representations Alan Arazi Eilam Shapira Roi Reichart LMTD 215 0 0 23 May 2025
Towards VM Rescheduling Optimization Through Deep Reinforcement Learning Xianzhong Ding Yunkai Zhang Binbin Chen Donghao Ying Tieying Zhang Jianjun Chen Lei Zhang Alberto Cerpa Wan Du VLM 148 2 0 23 May 2025
COLORA: Efficient Fine-Tuning for Convolutional Models with a Study Case on Optical Coherence Tomography Image Classification M. Rivera A. Hoyos 140 0 0 23 May 2025
Representation Discrepancy Bridging Method for Remote Sensing Image-Text Retrieval Hailong Ning Siying Wang Tao Lei Xiaopeng Cao Huanmin Dou Bin Zhao Asoke K. Nandi Petia Radeva 46 0 0 22 May 2025
Four Eyes Are Better Than Two: Harnessing the Collaborative Potential of Large Models via Differentiated Thinking and Complementary Ensembles Jun Xie Xiongjun Guan Yingjian Zhu Zhaoran Zhao Xinming Wang Hongzhu Yi Feng Chen Zhepeng Wang 197 0 0 22 May 2025
Amplify Adjacent Token Differences: Enhancing Long Chain-of-Thought Reasoning with Shift-FFN Yao Xu Mingyu Xu Fangyu Lei Wangtao Sun Xiangrong Zeng Bingning Wang Guang Liu Shizhu He Jun Zhao Kang Liu LRM 79 1 0 22 May 2025
HOFT: Householder Orthogonal Fine-tuning Alejandro Moreno Arcas Albert Sanchis Jorge Civera Alfons Juan 76 0 0 22 May 2025
UWSAM: Segment Anything Model Guided Underwater Instance Segmentation and A Large-scale Benchmark Dataset Hua Li Shijie Lian Zhiyuan Li Runmin Cong Sam Kwong VLM 85 0 0 21 May 2025
Accelerating Autoregressive Speech Synthesis Inference With Speech Speculative Decoding Zijian Lin Yang Zhang Yougen Yuan Yuming Yan Jinjiang Liu Zhiyong Wu Pengfei Hu Qun Yu 106 0 0 21 May 2025
AdUE: Improving uncertainty estimation head for LoRA adapters in LLMs Artem Zabolotnyi Roman Makarov Mile Mitrovic P. Proskura Oleg Travkin Roman Alferov Alexey Zaytsev UQCV 73 0 0 21 May 2025
Parameter-Efficient Fine-Tuning of Multispectral Foundation Models for Hyperspectral Image Classification Bernardin Ligan Khalide Jbilou Fahd Kalloubi Ahmed Ratnani 203 0 0 21 May 2025
VP Lab: a PEFT-Enabled Visual Prompting Laboratory for Semantic Segmentation Niccolo Avogaro Thomas Frick Yagmur G. Cinar Daniel Caraballo Cezary Skura ... Cristiano Malossi Konrad Schindler Andrea Bartezzaghi Roy Assaf Mattia Rigotti VLM 39 0 0 21 May 2025
Dual Decomposition of Weights and Singular Value Low Rank Adaptation Jialong Han Si Zhang Ke Zhang 51 0 0 20 May 2025
OSoRA: Output-Dimension and Singular-Value Initialized Low-Rank Adaptation Jialong Han Si Zhang Ke Zhang 43 0 0 20 May 2025
Towards Rehearsal-Free Continual Relation Extraction: Capturing Within-Task Variance with Adaptive Prompting Bao-Ngoc Dao Quang Nguyen Luyen Ngo Dinh Minh Le Nam Le Linh Ngo Van CLL 68 0 0 20 May 2025
Soft Prompts for Evaluation: Measuring Conditional Distance of Capabilities Ross Nordby 58 0 0 20 May 2025
FuxiMT: Sparsifying Large Language Models for Chinese-Centric Multilingual Machine Translation Shaolin Zhu Tianyu Dong Bo Li Deyi Xiong MoE 96 0 0 20 May 2025
Adapting Pretrained Language Models for Citation Classification via Self-Supervised Contrastive Learning Tong Li Jiachuan Wang Yongqi Zhang Shuangyin Li Lei Chen VLM 233 0 0 20 May 2025
Integration of TinyML and LargeML: A Survey of 6G and Beyond Thai-Hoc Vu Ngo Hoang Tu Thien Huynh-The Kyungchun Lee Sunghwan Kim Miroslav Voznak Quoc-Viet Pham 71 0 0 20 May 2025
Quaff: Quantized Parameter-Efficient Fine-Tuning under Outlier Spatial Stability Hypothesis Hong Huang Dapeng Wu 114 0 0 20 May 2025
3D Visual Illusion Depth Estimation Chengtang Yao Zhidan Liu Jiaxi Zeng Lidong Yu Yuwei Wu Yunde Jia MDE 163 0 0 19 May 2025
Mamba-Adaptor: State Space Model Adaptor for Visual Recognition Fei Xie Jiahao Nie Yujin Tang W. Zhang Hongshen Zhao Mamba 146 0 0 19 May 2025
SRLoRA: Subspace Recomposition in Low-Rank Adaptation via Importance-Based Fusion and Reinitialization Haodong Yang Lei Wang Md Zakir Hossain 99 0 0 18 May 2025
Scalable Strategies for Continual Learning with Replay Truman Hickok CLL 99 0 0 18 May 2025
AltLoRA: Towards Better Gradient Approximation in Low-Rank Adaptation with Alternating Projections Xin Yu Yujia Wang Jinghui Chen Lingzhou Xue 104 0 0 18 May 2025
Dynamic Perturbed Adaptive Method for Infinite Task-Conflicting Time Series Jiang You Xiaozhen Wang Arben Cela AI4TS 87 0 0 17 May 2025
LoRASuite: Efficient LoRA Adaptation Across Large Language Model Upgrades Yanan Li Fanxu Meng Muhan Zhang Shiai Zhu Shangguang Wang Mengwei Xu MoMe 85 0 0 17 May 2025
Memory-Efficient Orthogonal Fine-Tuning with Principal Subspace Adaptation Fei Wu Jia Hu Geyong Min Shiqiang Wang 114 0 0 16 May 2025
Concept Drift Guided LayerNorm Tuning for Efficient Multimodal Metaphor Identification Wenhao Qian Zhenzhen Hu Zijie Song Jia Li 139 0 0 16 May 2025
GenKnowSub: Improving Modularity and Reusability of LLMs through General Knowledge Subtraction Mohammadtaha Bagherifard Sahar Rajabi Ali Edalat Yadollah Yaghoobzadeh KELM 71 0 0 16 May 2025
Vaiage: A Multi-Agent Solution to Personalized Travel Planning Binwen Liu Jiexi Ge Jiamin Wang LLMAG 41 0 0 16 May 2025
Spatiotemporal Field Generation Based on Hybrid Mamba-Transformer with Physics-informed Fine-tuning Peimian Du Jiabin Liu Xiaowei Jin Mengwang Zuo Hui Li AI4CE 144 0 0 16 May 2025
InvDesFlow-AL: Active Learning-based Workflow for Inverse Design of Functional Materials Xiao-Qi Han Peng-Jie Guo Ze-Feng Gao Hao Sun Zhong-Yi Lu AI4CE 69 0 0 14 May 2025
Quantum-Enhanced Parameter-Efficient Learning for Typhoon Trajectory Forecasting Chen-Yu Liu Kuan-Cheng Chen Yi-Chien Chen Samuel Yen-Chi Chen Wei-Hao Huang Wei-Jia Huang Yen-Jui Chang 85 0 0 14 May 2025
Parameter-Efficient Fine-Tuning of Vision Foundation Model for Forest Floor Segmentation from UAV Imagery Mohammad Wasil Ahmad Drak Brennan Penfold Ludovico Scarton Maximilian Johenneken Alexander Asteroth Sebastian Houben 70 0 0 13 May 2025
Large Language Models Meet Stance Detection: A Survey of Tasks, Methods, Applications, Challenges and Future Directions Lata Pangtey Anukriti Bhatnagar Shubhi Bansal Shahid Shafi Dar Nagendra Kumar 79 0 0 13 May 2025
FAD: Frequency Adaptation and Diversion for Cross-domain Few-shot Learning Ruixiao Shi Fu Feng Yucheng Xie Jing Wang Xin Geng 73 0 0 13 May 2025
RepCali: High Efficient Fine-tuning Via Representation Calibration in Latent Space for Pre-trained Language Models Fujun Zhang Xiaoying Fan Xiangdong Su Guanglai Gao 80 0 0 13 May 2025
Towards Artificial General or Personalized Intelligence? A Survey on Foundation Models for Personalized Federated Intelligence Yu Qiao Huy Q. Le Avi Deb Raha Phuong-Nam Tran Apurba Adhikary Mengchun Zhang Loc X. Nguyen Eui-nam Huh Dusit Niyato Choong Seon Hong AI4CE 165 1 0 11 May 2025
DAPE: Dual-Stage Parameter-Efficient Fine-Tuning for Consistent Video Editing with Diffusion Models Junhao Xia Chaoyang Zhang Yecheng Zhang Chengyang Zhou Zhichang Wang Bochun Liu Dongshuo Yin DiffM VGen 103 0 0 11 May 2025
Causal Prompt Calibration Guided Segment Anything Model for Open-Vocabulary Multi-Entity Segmentation Wenwen Qiang Jianqi Zhang Jingyao Wang Changwen Zheng VLM 147 0 0 10 May 2025
Task-Adapter++: Task-specific Adaptation with Order-aware Alignment for Few-shot Action Recognition Congqi Cao Peiheng Han Y. Zhang Yating Yu Qinyi Lv Lingtong Min Yanning Zhang VLM 135 0 0 09 May 2025
Split Matching for Inductive Zero-shot Semantic Segmentation Jialei Chen Xu Zheng Dongyue Li Chong Yi Seigo Ito D. Paudel Luc Van Gool Hiroshi Murase Daisuke Deguchi VLM 214 0 0 08 May 2025
GroverGPT-2: Simulating Grover's Algorithm via Chain-of-Thought Reasoning and Quantum-Native Tokenization Min Chen Jinglei Cheng Pingzhi Li Haoran Wang Tianlong Chen Junyu Liu LRM 138 0 0 08 May 2025
Collaborative Multi-LoRA Experts with Achievement-based Multi-Tasks Loss for Unified Multimodal Information Extraction Li Yuan Yi Cai Xudong Shen Qing Li Qingbao Huang Zikun Deng Tao Wang MoMe OffRL MoE 97 0 0 08 May 2025