Papers
Communities
Events
Blog
Pricing
Search
Open menu
Home
Papers
2106.09685
Cited By
v1
v2 (latest)
LoRA: Low-Rank Adaptation of Large Language Models
17 June 2021
J. E. Hu
Yelong Shen
Phillip Wallis
Zeyuan Allen-Zhu
Yuanzhi Li
Shean Wang
Lu Wang
Weizhu Chen
OffRL
AI4TS
AI4CE
ALM
AIMat
Re-assign community
ArXiv (abs)
PDF
HTML
Github (11998★)
Papers citing
"LoRA: Low-Rank Adaptation of Large Language Models"
50 / 6,910 papers shown
Title
SDXL-Lightning: Progressive Adversarial Diffusion Distillation
Shanchuan Lin
Anran Wang
Xiao Yang
154
134
0
21 Feb 2024
Kuaiji: the First Chinese Accounting Large Language Model
Jiayuan Luo
Songhua Yang
Xiaoling Qiu
Panyu Chen
Yufei Nai
Wenxuan Zeng
Wentao Zhang
Xinke Jiang
RALM
ALM
46
1
0
21 Feb 2024
Neeko: Leveraging Dynamic LoRA for Efficient Multi-Character Role-Playing Agent
Xiaoyan Yu
Tongxu Luo
Yifan Wei
Fangyu Lei
Yiming Huang
Peng Hao
Liehuang Zhu
LLMAG
103
28
0
21 Feb 2024
MORE: Multi-mOdal REtrieval Augmented Generative Commonsense Reasoning
Wanqing Cui
Keping Bi
Jiafeng Guo
Xueqi Cheng
SyDa
ReLM
RALM
LRM
102
9
0
21 Feb 2024
Reliable LLM-based User Simulator for Task-Oriented Dialogue Systems
Ivan Sekulić
Silvia Terragni
Victor Guimaraes
Nghia Khau
Bruna Guedes
Modestas Filipavicius
A. Manso
Roland Mathis
53
7
0
20 Feb 2024
BiMediX: Bilingual Medical Mixture of Experts LLM
Sara Pieri
Sahal Shaji Mullappilly
Fahad Shahbaz Khan
Rao Muhammad Anwer
Salman Khan
Timothy Baldwin
Hisham Cholakkal
LM&MA
70
15
0
20 Feb 2024
RoCode: A Dataset for Measuring Code Intelligence from Problem Definitions in Romanian
Adrian Cosma
Ioan-Bogdan Iordache
Paolo Rosso
OffRL
45
3
0
20 Feb 2024
Bayesian Reward Models for LLM Alignment
Adam X. Yang
Maxime Robeyns
Thomas Coste
Zhengyan Shi
Jun Wang
Haitham Bou-Ammar
Laurence Aitchison
73
19
0
20 Feb 2024
The Hidden Space of Transformer Language Adapters
Jesujoba Oluwadara Alabi
Marius Mosbach
Matan Eyal
Dietrich Klakow
Mor Geva
112
10
1
20 Feb 2024
A Survey on Knowledge Distillation of Large Language Models
Xiaohan Xu
Ming Li
Chongyang Tao
Tao Shen
Reynold Cheng
Jinyang Li
Can Xu
Dacheng Tao
Dinesh Manocha
KELM
VLM
175
135
0
20 Feb 2024
SiLLM: Large Language Models for Simultaneous Machine Translation
Shoutao Guo
Shaolei Zhang
Zhengrui Ma
Min Zhang
Yang Feng
LRM
103
10
0
20 Feb 2024
Understanding the effects of language-specific class imbalance in multilingual fine-tuning
Vincent Jung
Lonneke van der Plas
100
9
0
20 Feb 2024
Can GNN be Good Adapter for LLMs?
Xuanwen Huang
Kaiqiao Han
Yang Yang
Dezheng Bao
Quanjin Tao
Ziwei Chai
Qi Zhu
AI4CE
93
45
0
20 Feb 2024
Large Language Model-based Human-Agent Collaboration for Complex Task Solving
Xueyang Feng
Zhiyuan Chen
Yujia Qin
Yankai Lin
Xu Chen
Zhiyuan Liu
Ji-Rong Wen
LLMAG
103
24
0
20 Feb 2024
OPDAI at SemEval-2024 Task 6: Small LLMs can Accelerate Hallucination Detection with Weakly Supervised Data
Chengcheng Wei
Ze Chen
Songtan Fang
Jiarong He
Max Gao
53
3
0
20 Feb 2024
MoELoRA: Contrastive Learning Guided Mixture of Experts on Parameter-Efficient Fine-Tuning for Large Language Models
Tongxu Luo
Jiahe Lei
Fangyu Lei
Weihao Liu
Shizhu He
Jun Zhao
Kang Liu
MoE
ALM
84
29
0
20 Feb 2024
SDXL Finetuned with LoRA for Coloring Therapy: Generating Graphic Templates Inspired by United Arab Emirates Culture
Abdulla Alfalasi
Esrat Khan
Mohamed Alhashmi
Raed Aldweik
Davor Svetinovic
27
0
0
20 Feb 2024
Advancing Large Language Models to Capture Varied Speaking Styles and Respond Properly in Spoken Conversations
Guan-Ting Lin
Cheng-Han Chiang
Hung-yi Lee
113
29
0
20 Feb 2024
Model Composition for Multimodal Large Language Models
Chi Chen
Yiyang Du
Zheng Fang
Ziyue Wang
Ziyue Wang
...
Ming Yan
Ji Zhang
Fei Huang
Maosong Sun
Yang Liu
MoMe
80
3
0
20 Feb 2024
CST: Calibration Side-Tuning for Parameter and Memory Efficient Transfer Learning
Feng Chen
51
0
0
20 Feb 2024
Are LLMs Rational Investors? A Study on Detecting and Reducing the Financial Bias in LLMs
Yuhang Zhou
Yuchen Ni
Yu Gan
Zhangyue Yin
Xiang Liu
Jian Zhang
Sen Liu
Xipeng Qiu
Guangnan Ye
Hongfeng Chai
AIFin
76
4
0
20 Feb 2024
HyperMoE: Towards Better Mixture of Experts via Transferring Among Experts
Hao Zhao
Zihan Qiu
Huijia Wu
Zili Wang
Zhaofeng He
Jie Fu
MoE
127
13
0
20 Feb 2024
A Comprehensive Review of Machine Learning Advances on Data Change: A Cross-Field Perspective
Jeng-Lin Li
Chih-Fan Hsu
Ming-Ching Chang
Wei-Chao Chen
OOD
110
2
0
20 Feb 2024
Reflect-RL: Two-Player Online RL Fine-Tuning for LMs
Runlong Zhou
Simon S. Du
Beibin Li
OffRL
89
4
0
20 Feb 2024
A Unified Taxonomy-Guided Instruction Tuning Framework for Entity Set Expansion and Taxonomy Expansion
Yanzhen Shen
Yu Zhang
Yunyi Zhang
Jiawei Han
128
10
0
20 Feb 2024
Comparing Specialised Small and General Large Language Models on Text Classification: 100 Labelled Samples to Achieve Break-Even Performance
Branislav Pecher
Ivan Srba
Maria Bielikova
ALM
100
8
0
20 Feb 2024
GenAudit: Fixing Factual Errors in Language Model Outputs with Evidence
Kundan Krishna
S. Ramprasad
Prakhar Gupta
Byron C. Wallace
Zachary Chase Lipton
Jeffrey P. Bigham
HILM
KELM
SyDa
128
9
0
19 Feb 2024
Multilinear Mixture of Experts: Scalable Expert Specialization through Factorization
James Oldfield
Markos Georgopoulos
Grigorios G. Chrysos
Christos Tzelepis
Yannis Panagakis
M. Nicolaou
Jiankang Deng
Ioannis Patras
MoE
128
10
0
19 Feb 2024
The Revolution of Multimodal Large Language Models: A Survey
Davide Caffagni
Federico Cocchi
Luca Barsellotti
Nicholas Moratelli
Sara Sarto
Lorenzo Baraldi
Lorenzo Baraldi
Marcella Cornia
Rita Cucchiara
LRM
VLM
139
64
0
19 Feb 2024
LoRA+: Efficient Low Rank Adaptation of Large Models
Soufiane Hayou
Nikhil Ghosh
Bin Yu
AI4CE
123
188
0
19 Feb 2024
Secure Federated Learning Across Heterogeneous Cloud and High-Performance Computing Resources -- A Case Study on Federated Fine-tuning of LLaMA 2
Zilinghan Li
Shilan He
Pranshu Chaturvedi
Volodymyr V. Kindratenko
Eliu A. Huerta
Kibaek Kim
Ravi K. Madduri
FedML
78
3
0
19 Feb 2024
Amplifying Training Data Exposure through Fine-Tuning with Pseudo-Labeled Memberships
Myung Gyo Oh
Hong Eun Ahn
L. Park
T.-H. Kwon
MIALM
AAML
87
0
0
19 Feb 2024
Defending Against Weight-Poisoning Backdoor Attacks for Parameter-Efficient Fine-Tuning
Shuai Zhao
Leilei Gan
Anh Tuan Luu
Jie Fu
Lingjuan Lyu
Meihuizi Jia
Jinming Wen
AAML
94
25
0
19 Feb 2024
Training Table Question Answering via SQL Query Decomposition
Raphael Mouravieff
Benjamin Piwowarski
Sylvain Lamprier
ReLM
LMTD
78
1
0
19 Feb 2024
Acquiring Clean Language Models from Backdoor Poisoned Datasets by Downscaling Frequency Space
Zongru Wu
Zhuosheng Zhang
Pengzhou Cheng
Gongshen Liu
AAML
134
6
0
19 Feb 2024
Team QUST at SemEval-2024 Task 8: A Comprehensive Study of Monolingual and Multilingual Approaches for Detecting AI-generated Text
Xiaoman Xu
Xiangrun Li
Taihang Wang
Jianxiang Tian
Ye Jiang
DeLMO
54
3
0
19 Feb 2024
SIBO: A Simple Booster for Parameter-Efficient Fine-Tuning
Zhihao Wen
Jie Zhang
Yuan Fang
MoE
82
3
0
19 Feb 2024
Automating Dataset Updates Towards Reliable and Timely Evaluation of Large Language Models
Jiahao Ying
Yixin Cao
Yushi Bai
Qianru Sun
Bo Wang
Wei Tang
Zhaojun Ding
Yizhe Yang
Xuanjing Huang
Shuicheng Yan
KELM
59
10
0
19 Feb 2024
InMD-X: Large Language Models for Internal Medicine Doctors
Hansle Gwon
Imjin Ahn
Hyoje Jung
Byeolhee Kim
Young-Hak Kim
Tae Joon Jun
LM&MA
85
1
0
19 Feb 2024
NOTE: Notable generation Of patient Text summaries through Efficient approach based on direct preference optimization
Imjin Ahn
Hansle Gwon
Young-Hak Kim
Tae Joon Jun
Sanghyun Park
72
3
0
19 Feb 2024
ComFusion: Personalized Subject Generation in Multiple Specific Scenes From Single Image
Yan Hong
Jianfu Zhang
DiffM
104
3
0
19 Feb 2024
Head-wise Shareable Attention for Large Language Models
Zouying Cao
Yifei Yang
Hai Zhao
76
4
0
19 Feb 2024
Learning the Unlearned: Mitigating Feature Suppression in Contrastive Learning
Jihai Zhang
Xiang Lan
Xiaoye Qu
Yu Cheng
Mengling Feng
Bryan Hooi
SSL
104
5
0
19 Feb 2024
Parameter Efficient Finetuning for Speech Emotion Recognition and Domain Adaptation
Nineli Lashkarashvili
Wen Wu
Guangzhi Sun
P. Woodland
73
8
0
19 Feb 2024
Language Models are Homer Simpson! Safety Re-Alignment of Fine-tuned Language Models through Task Arithmetic
Rishabh Bhardwaj
Do Duc Anh
Soujanya Poria
MoMe
114
48
0
19 Feb 2024
Uncertainty quantification in fine-tuned LLMs using LoRA ensembles
Oleksandr Balabanov
Hampus Linander
UQCV
119
20
0
19 Feb 2024
ChartX & ChartVLM: A Versatile Benchmark and Foundation Model for Complicated Chart Reasoning
Renqiu Xia
Bo Zhang
Hancheng Ye
Xiangchao Yan
Qi Liu
...
Min Dou
Botian Shi
Junchi Yan
Junchi Yan
Yu Qiao
LRM
187
68
0
19 Feb 2024
Extensible Embedding: A Flexible Multipler For LLM's Context Length
Ninglu Shao
Shitao Xiao
Zheng Liu
Peitian Zhang
54
1
0
18 Feb 2024
Efficient Multimodal Learning from Data-centric Perspective
Muyang He
Yexin Liu
Boya Wu
Jianhao Yuan
Yueze Wang
Tiejun Huang
Bo Zhao
MLLM
93
88
0
18 Feb 2024
Knowledge-to-SQL: Enhancing SQL Generation with Data Expert LLM
Zijin Hong
Zheng Yuan
Hao Chen
Qinggang Zhang
Feiran Huang
Xiao Huang
124
32
0
18 Feb 2024
Previous
1
2
3
...
96
97
98
...
137
138
139
Next