LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models

4 April 2023

Lei Wang

Papers citing "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"

41 / 141 papers shown

Title
Development of a Reliable and Accessible Caregiving Language Model (CaLM) B. Parmanto Bayu Aryoyudanta Wilbert Soekinto Agus Setiawan Yuhan Wang Haomin Hu Andi Saptono Yong K Choi 32 0 0 11 Mar 2024
SEED: Customize Large Language Models with Sample-Efficient Adaptation for Code Generation Xue Jiang Yihong Dong Zhi Jin Ge Li VLM 47 4 0 29 Feb 2024
On Languaging a Simulation Engine Han Liu Liantang Li 28 0 0 26 Feb 2024
LLM Inference Unveiled: Survey and Roofline Model Insights Zhihang Yuan Yuzhang Shang Yang Zhou Zhen Dong Zhe Zhou ... Yong Jae Lee Yan Yan Beidi Chen Guangyu Sun Kurt Keutzer 50 80 0 26 Feb 2024
A Survey on Knowledge Distillation of Large Language Models Xiaohan Xu Ming Li Chongyang Tao Tao Shen Reynold Cheng Jinyang Li Can Xu Dacheng Tao Dinesh Manocha KELM VLM 44 102 0 20 Feb 2024
DoRA: Weight-Decomposed Low-Rank Adaptation Shih-yang Liu Chien-Yi Wang Hongxu Yin Pavlo Molchanov Yu-Chiang Frank Wang Kwang-Ting Cheng Min-Hung Chen 44 346 0 14 Feb 2024
Retrieval-Augmented Thought Process as Sequential Decision Making T. Pouplin Hao Sun Samuel Holt M. Schaar KELM RALM LRM 13 4 0 12 Feb 2024
Sentinels of the Stream: Unleashing Large Language Models for Dynamic Packet Classification in Software Defined Networks -- Position Paper Shariq Murtuza 29 1 0 10 Feb 2024
ApiQ: Finetuning of 2-Bit Quantized Large Language Model Baohao Liao Christian Herold Shahram Khadivi Christof Monz CLL MQ 47 12 0 07 Feb 2024
Efficient Multi-domain Text Recognition Deep Neural Network Parameterization with Residual Adapters Jiayou Chao Wei Zhu 34 0 0 01 Jan 2024
From Prompt Engineering to Prompt Science With Human in the Loop Chirag Shah 42 9 0 01 Jan 2024
Partial Fine-Tuning: A Successor to Full Fine-Tuning for Vision Transformers Peng Ye Yongqi Huang Chongjun Tu Minglei Li Tao Chen Tong He Wanli Ouyang 38 4 0 25 Dec 2023
From Google Gemini to OpenAI Q* (Q-Star): A Survey of Reshaping the Generative Artificial Intelligence (AI) Research Landscape Timothy R. McIntosh Teo Susnjak Tong Liu Paul Watters Malka N. Halgamuge 94 46 0 18 Dec 2023
Large Scale Foundation Models for Intelligent Manufacturing Applications: A Survey Haotian Zhang S. D. Semujju Zhicheng Wang Xianwei Lv Kang Xu ... Jing Wu Zhuo Long Wensheng Liang Xiaoguang Ma Ruiyan Zhuang UQCV AI4TS AI4CE 29 4 0 11 Dec 2023
ASPEN: High-Throughput LoRA Fine-Tuning of Large Language Models with a Single GPU Zhengmao Ye Dengchun Li Jingqi Tian Tingfeng Lan Jie Zuo ... Hui Lu Yexi Jiang Jian Sha Ke Zhang Mingjie Tang 102 5 0 05 Dec 2023
Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer Bowen Tan Yun Zhu Lijuan Liu Eric P. Xing Zhiting Hu Jindong Chen ALM LRM 45 7 0 12 Nov 2023
Prediction of Arabic Legal Rulings using Large Language Models Adel Ammar Anis Koubaa Bilel Benjdira Omar Najar Serry Sibaee AILaw ELM 17 7 0 16 Oct 2023
Compresso: Structured Pruning with Collaborative Prompting Learns Compact Large Language Models Song Guo Jiahang Xu Li Zhang Mao Yang 25 14 0 08 Oct 2023
DiffPrompter: Differentiable Implicit Visual Prompts for Semantic-Segmentation in Adverse Conditions Sanket Kalwar Mihir Ungarala Shruti Jain Aaron Monis Krishna Reddy Konda Sourav Garg K. M. Krishna VLM 37 0 0 06 Oct 2023
Sweeping Heterogeneity with Smart MoPs: Mixture of Prompts for LLM Task Adaptation Chen Dun Mirian Hipolito Garcia Guoqing Zheng Ahmed Hassan Awadallah Anastasios Kyrillidis Robert Sim 84 6 0 04 Oct 2023
Bridging the Gap Between Foundation Models and Heterogeneous Federated Learning Sixing Yu J. P. Muñoz Ali Jannesari AI4CE 79 7 0 30 Sep 2023
HyPoradise: An Open Baseline for Generative Speech Recognition with Large Language Models Cheng Chen Yuchen Hu Chao-Han Huck Yang Sabato Marco Siniscalchi Pin-Yu Chen E. Chng 32 42 0 27 Sep 2023
QA-LoRA: Quantization-Aware Low-Rank Adaptation of Large Language Models Yuhui Xu Lingxi Xie Xiaotao Gu Xin Chen Heng Chang Hengheng Zhang Zhensu Chen Xiaopeng Zhang Qi Tian MQ 21 92 0 26 Sep 2023
Towards Green AI in Fine-tuning Large Language Models via Adaptive Backpropagation Kai Huang Hanyu Yin Heng Huang Wei Gao 33 11 0 22 Sep 2023
RGAT: A Deeper Look into Syntactic Dependency Information for Coreference Resolution Yuan Meng Xuhao Pan Jun Chang Yue Wang 14 1 0 10 Sep 2023
From Base to Conversational: Japanese Instruction Dataset and Tuning Large Language Models Masahiro Suzuki Masanori Hirano Hiroki Sakaji 39 6 0 07 Sep 2023
Sparks of Large Audio Models: A Survey and Outlook S. Latif Moazzam Shoukat Fahad Shamshad Muhammad Usama Yi Ren ... Wenwu Wang Xulong Zhang Roberto Togneri Min Zhang Björn W. Schuller LM&MA AuLLM 33 38 0 24 Aug 2023
Exploring Parameter-Efficient Fine-Tuning Techniques for Code Generation with Large Language Models Martin Weyssow Xin Zhou Kisub Kim David Lo H. Sahraoui 38 27 0 21 Aug 2023
Information Retrieval Meets Large Language Models: A Strategic Report from Chinese IR Community Qingyao Ai Ting Bai Bo Zhao Yi-Ju Chang Jiawei Chen ... Peng-Zhen Zhang Fan Zhang Wei-na Zhang Hao Fei Xiaofei Zhu 52 58 0 19 Jul 2023
A Comprehensive Overview of Large Language Models Humza Naveed Asad Ullah Khan Shi Qiu Muhammad Saqib Saeed Anwar Muhammad Usman Naveed Akhtar Nick Barnes Ajmal Mian OffRL 70 529 0 12 Jul 2023
My3DGen: A Scalable Personalized 3D Generative Model Luchao Qi Jiaye Wu Annie N. Wang Sheng-Yu Wang Roni Sengupta 3DH 39 3 0 11 Jul 2023
PRISMA-DFLLM: An Extension of PRISMA for Systematic Literature Reviews using Domain-specific Finetuned Large Language Models Teo Susnjak 22 11 0 15 Jun 2023
Xiezhi: An Ever-Updating Benchmark for Holistic Domain Knowledge Evaluation Zhouhong Gu Xiaoxuan Zhu Haoning Ye Lin Zhang Jianchen Wang ... Zili Wang Shusen Wang Weiguo Zheng Hongwei Feng Yanghua Xiao ALM ELM 30 58 0 09 Jun 2023
Domain Specialization as the Key to Make Large Language Models Disruptive: A Comprehensive Survey Chen Ling Xujiang Zhao Jiaying Lu Chengyuan Deng Can Zheng ... Chris White Quanquan Gu Jian Pei Carl Yang Liang Zhao ALM 33 126 0 30 May 2023
EmbodiedGPT: Vision-Language Pre-Training via Embodied Chain of Thought Yao Mu Qinglong Zhang Mengkang Hu Wen Wang Mingyu Ding Jun Jin Bin Wang Jifeng Dai Yu Qiao Ping Luo LM&Ro LRM 25 222 0 24 May 2023
WizardLM: Empowering Large Language Models to Follow Complex Instructions Can Xu Qingfeng Sun Kai Zheng Xiubo Geng Pu Zhao Jiazhan Feng Chongyang Tao Daxin Jiang ALM 46 911 0 24 Apr 2023
Towards Robust Low-Resource Fine-Tuning with Multi-View Compressed Representations Linlin Liu Xingxuan Li Megh Thakkar Xin Li Chenyu You Luo Si Lidong Bing 27 2 0 16 Nov 2022
Large Language Models are Zero-Shot Reasoners Takeshi Kojima S. Gu Machel Reid Yutaka Matsuo Yusuke Iwasawa ReLM LRM 328 4,077 0 24 May 2022
SPoT: Better Frozen Model Adaptation through Soft Prompt Transfer Tu Vu Brian Lester Noah Constant Rami Al-Rfou Daniel Cer VLM LRM 137 277 0 15 Oct 2021
Exploring Universal Intrinsic Task Subspace via Prompt Tuning Yujia Qin Xiaozhi Wang Yusheng Su Yankai Lin Ning Ding ... Juanzi Li Lei Hou Peng Li Maosong Sun Jie Zhou VLM VPVLM 107 27 0 15 Oct 2021
The Power of Scale for Parameter-Efficient Prompt Tuning Brian Lester Rami Al-Rfou Noah Constant VPVLM 280 3,858 0 18 Apr 2021