ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2106.09685
  4. Cited By
LoRA: Low-Rank Adaptation of Large Language Models
v1v2 (latest)

LoRA: Low-Rank Adaptation of Large Language Models

17 June 2021
J. E. Hu
Yelong Shen
Phillip Wallis
Zeyuan Allen-Zhu
Yuanzhi Li
Shean Wang
Lu Wang
Weizhu Chen
    OffRLAI4TSAI4CEALMAIMat
ArXiv (abs)PDFHTMLGithub (11998★)

Papers citing "LoRA: Low-Rank Adaptation of Large Language Models"

50 / 6,910 papers shown
Title
SDXL-Lightning: Progressive Adversarial Diffusion Distillation
SDXL-Lightning: Progressive Adversarial Diffusion Distillation
Shanchuan Lin
Anran Wang
Xiao Yang
154
134
0
21 Feb 2024
Kuaiji: the First Chinese Accounting Large Language Model
Kuaiji: the First Chinese Accounting Large Language Model
Jiayuan Luo
Songhua Yang
Xiaoling Qiu
Panyu Chen
Yufei Nai
Wenxuan Zeng
Wentao Zhang
Xinke Jiang
RALMALM
46
1
0
21 Feb 2024
Neeko: Leveraging Dynamic LoRA for Efficient Multi-Character
  Role-Playing Agent
Neeko: Leveraging Dynamic LoRA for Efficient Multi-Character Role-Playing Agent
Xiaoyan Yu
Tongxu Luo
Yifan Wei
Fangyu Lei
Yiming Huang
Peng Hao
Liehuang Zhu
LLMAG
103
28
0
21 Feb 2024
MORE: Multi-mOdal REtrieval Augmented Generative Commonsense Reasoning
MORE: Multi-mOdal REtrieval Augmented Generative Commonsense Reasoning
Wanqing Cui
Keping Bi
Jiafeng Guo
Xueqi Cheng
SyDaReLMRALMLRM
102
9
0
21 Feb 2024
Reliable LLM-based User Simulator for Task-Oriented Dialogue Systems
Reliable LLM-based User Simulator for Task-Oriented Dialogue Systems
Ivan Sekulić
Silvia Terragni
Victor Guimaraes
Nghia Khau
Bruna Guedes
Modestas Filipavicius
A. Manso
Roland Mathis
53
7
0
20 Feb 2024
BiMediX: Bilingual Medical Mixture of Experts LLM
BiMediX: Bilingual Medical Mixture of Experts LLM
Sara Pieri
Sahal Shaji Mullappilly
Fahad Shahbaz Khan
Rao Muhammad Anwer
Salman Khan
Timothy Baldwin
Hisham Cholakkal
LM&MA
70
15
0
20 Feb 2024
RoCode: A Dataset for Measuring Code Intelligence from Problem
  Definitions in Romanian
RoCode: A Dataset for Measuring Code Intelligence from Problem Definitions in Romanian
Adrian Cosma
Ioan-Bogdan Iordache
Paolo Rosso
OffRL
45
3
0
20 Feb 2024
Bayesian Reward Models for LLM Alignment
Bayesian Reward Models for LLM Alignment
Adam X. Yang
Maxime Robeyns
Thomas Coste
Zhengyan Shi
Jun Wang
Haitham Bou-Ammar
Laurence Aitchison
73
19
0
20 Feb 2024
The Hidden Space of Transformer Language Adapters
The Hidden Space of Transformer Language Adapters
Jesujoba Oluwadara Alabi
Marius Mosbach
Matan Eyal
Dietrich Klakow
Mor Geva
112
10
1
20 Feb 2024
A Survey on Knowledge Distillation of Large Language Models
A Survey on Knowledge Distillation of Large Language Models
Xiaohan Xu
Ming Li
Chongyang Tao
Tao Shen
Reynold Cheng
Jinyang Li
Can Xu
Dacheng Tao
Dinesh Manocha
KELMVLM
175
135
0
20 Feb 2024
SiLLM: Large Language Models for Simultaneous Machine Translation
SiLLM: Large Language Models for Simultaneous Machine Translation
Shoutao Guo
Shaolei Zhang
Zhengrui Ma
Min Zhang
Yang Feng
LRM
103
10
0
20 Feb 2024
Understanding the effects of language-specific class imbalance in
  multilingual fine-tuning
Understanding the effects of language-specific class imbalance in multilingual fine-tuning
Vincent Jung
Lonneke van der Plas
100
9
0
20 Feb 2024
Can GNN be Good Adapter for LLMs?
Can GNN be Good Adapter for LLMs?
Xuanwen Huang
Kaiqiao Han
Yang Yang
Dezheng Bao
Quanjin Tao
Ziwei Chai
Qi Zhu
AI4CE
93
45
0
20 Feb 2024
Large Language Model-based Human-Agent Collaboration for Complex Task
  Solving
Large Language Model-based Human-Agent Collaboration for Complex Task Solving
Xueyang Feng
Zhiyuan Chen
Yujia Qin
Yankai Lin
Xu Chen
Zhiyuan Liu
Ji-Rong Wen
LLMAG
103
24
0
20 Feb 2024
OPDAI at SemEval-2024 Task 6: Small LLMs can Accelerate Hallucination
  Detection with Weakly Supervised Data
OPDAI at SemEval-2024 Task 6: Small LLMs can Accelerate Hallucination Detection with Weakly Supervised Data
Chengcheng Wei
Ze Chen
Songtan Fang
Jiarong He
Max Gao
53
3
0
20 Feb 2024
MoELoRA: Contrastive Learning Guided Mixture of Experts on
  Parameter-Efficient Fine-Tuning for Large Language Models
MoELoRA: Contrastive Learning Guided Mixture of Experts on Parameter-Efficient Fine-Tuning for Large Language Models
Tongxu Luo
Jiahe Lei
Fangyu Lei
Weihao Liu
Shizhu He
Jun Zhao
Kang Liu
MoEALM
84
29
0
20 Feb 2024
SDXL Finetuned with LoRA for Coloring Therapy: Generating Graphic
  Templates Inspired by United Arab Emirates Culture
SDXL Finetuned with LoRA for Coloring Therapy: Generating Graphic Templates Inspired by United Arab Emirates Culture
Abdulla Alfalasi
Esrat Khan
Mohamed Alhashmi
Raed Aldweik
Davor Svetinovic
27
0
0
20 Feb 2024
Advancing Large Language Models to Capture Varied Speaking Styles and
  Respond Properly in Spoken Conversations
Advancing Large Language Models to Capture Varied Speaking Styles and Respond Properly in Spoken Conversations
Guan-Ting Lin
Cheng-Han Chiang
Hung-yi Lee
113
29
0
20 Feb 2024
Model Composition for Multimodal Large Language Models
Model Composition for Multimodal Large Language Models
Chi Chen
Yiyang Du
Zheng Fang
Ziyue Wang
Ziyue Wang
...
Ming Yan
Ji Zhang
Fei Huang
Maosong Sun
Yang Liu
MoMe
80
3
0
20 Feb 2024
CST: Calibration Side-Tuning for Parameter and Memory Efficient Transfer
  Learning
CST: Calibration Side-Tuning for Parameter and Memory Efficient Transfer Learning
Feng Chen
51
0
0
20 Feb 2024
Are LLMs Rational Investors? A Study on Detecting and Reducing the
  Financial Bias in LLMs
Are LLMs Rational Investors? A Study on Detecting and Reducing the Financial Bias in LLMs
Yuhang Zhou
Yuchen Ni
Yu Gan
Zhangyue Yin
Xiang Liu
Jian Zhang
Sen Liu
Xipeng Qiu
Guangnan Ye
Hongfeng Chai
AIFin
76
4
0
20 Feb 2024
HyperMoE: Towards Better Mixture of Experts via Transferring Among
  Experts
HyperMoE: Towards Better Mixture of Experts via Transferring Among Experts
Hao Zhao
Zihan Qiu
Huijia Wu
Zili Wang
Zhaofeng He
Jie Fu
MoE
127
13
0
20 Feb 2024
A Comprehensive Review of Machine Learning Advances on Data Change: A
  Cross-Field Perspective
A Comprehensive Review of Machine Learning Advances on Data Change: A Cross-Field Perspective
Jeng-Lin Li
Chih-Fan Hsu
Ming-Ching Chang
Wei-Chao Chen
OOD
110
2
0
20 Feb 2024
Reflect-RL: Two-Player Online RL Fine-Tuning for LMs
Reflect-RL: Two-Player Online RL Fine-Tuning for LMs
Runlong Zhou
Simon S. Du
Beibin Li
OffRL
89
4
0
20 Feb 2024
A Unified Taxonomy-Guided Instruction Tuning Framework for Entity Set Expansion and Taxonomy Expansion
A Unified Taxonomy-Guided Instruction Tuning Framework for Entity Set Expansion and Taxonomy Expansion
Yanzhen Shen
Yu Zhang
Yunyi Zhang
Jiawei Han
128
10
0
20 Feb 2024
Comparing Specialised Small and General Large Language Models on Text Classification: 100 Labelled Samples to Achieve Break-Even Performance
Comparing Specialised Small and General Large Language Models on Text Classification: 100 Labelled Samples to Achieve Break-Even Performance
Branislav Pecher
Ivan Srba
Maria Bielikova
ALM
100
8
0
20 Feb 2024
GenAudit: Fixing Factual Errors in Language Model Outputs with Evidence
GenAudit: Fixing Factual Errors in Language Model Outputs with Evidence
Kundan Krishna
S. Ramprasad
Prakhar Gupta
Byron C. Wallace
Zachary Chase Lipton
Jeffrey P. Bigham
HILMKELMSyDa
128
9
0
19 Feb 2024
Multilinear Mixture of Experts: Scalable Expert Specialization through
  Factorization
Multilinear Mixture of Experts: Scalable Expert Specialization through Factorization
James Oldfield
Markos Georgopoulos
Grigorios G. Chrysos
Christos Tzelepis
Yannis Panagakis
M. Nicolaou
Jiankang Deng
Ioannis Patras
MoE
128
10
0
19 Feb 2024
The Revolution of Multimodal Large Language Models: A Survey
The Revolution of Multimodal Large Language Models: A Survey
Davide Caffagni
Federico Cocchi
Luca Barsellotti
Nicholas Moratelli
Sara Sarto
Lorenzo Baraldi
Lorenzo Baraldi
Marcella Cornia
Rita Cucchiara
LRMVLM
139
64
0
19 Feb 2024
LoRA+: Efficient Low Rank Adaptation of Large Models
LoRA+: Efficient Low Rank Adaptation of Large Models
Soufiane Hayou
Nikhil Ghosh
Bin Yu
AI4CE
123
188
0
19 Feb 2024
Secure Federated Learning Across Heterogeneous Cloud and
  High-Performance Computing Resources -- A Case Study on Federated Fine-tuning
  of LLaMA 2
Secure Federated Learning Across Heterogeneous Cloud and High-Performance Computing Resources -- A Case Study on Federated Fine-tuning of LLaMA 2
Zilinghan Li
Shilan He
Pranshu Chaturvedi
Volodymyr V. Kindratenko
Eliu A. Huerta
Kibaek Kim
Ravi K. Madduri
FedML
78
3
0
19 Feb 2024
Amplifying Training Data Exposure through Fine-Tuning with
  Pseudo-Labeled Memberships
Amplifying Training Data Exposure through Fine-Tuning with Pseudo-Labeled Memberships
Myung Gyo Oh
Hong Eun Ahn
L. Park
T.-H. Kwon
MIALMAAML
87
0
0
19 Feb 2024
Defending Against Weight-Poisoning Backdoor Attacks for
  Parameter-Efficient Fine-Tuning
Defending Against Weight-Poisoning Backdoor Attacks for Parameter-Efficient Fine-Tuning
Shuai Zhao
Leilei Gan
Anh Tuan Luu
Jie Fu
Lingjuan Lyu
Meihuizi Jia
Jinming Wen
AAML
94
25
0
19 Feb 2024
Training Table Question Answering via SQL Query Decomposition
Training Table Question Answering via SQL Query Decomposition
Raphael Mouravieff
Benjamin Piwowarski
Sylvain Lamprier
ReLMLMTD
78
1
0
19 Feb 2024
Acquiring Clean Language Models from Backdoor Poisoned Datasets by
  Downscaling Frequency Space
Acquiring Clean Language Models from Backdoor Poisoned Datasets by Downscaling Frequency Space
Zongru Wu
Zhuosheng Zhang
Pengzhou Cheng
Gongshen Liu
AAML
134
6
0
19 Feb 2024
Team QUST at SemEval-2024 Task 8: A Comprehensive Study of Monolingual
  and Multilingual Approaches for Detecting AI-generated Text
Team QUST at SemEval-2024 Task 8: A Comprehensive Study of Monolingual and Multilingual Approaches for Detecting AI-generated Text
Xiaoman Xu
Xiangrun Li
Taihang Wang
Jianxiang Tian
Ye Jiang
DeLMO
54
3
0
19 Feb 2024
SIBO: A Simple Booster for Parameter-Efficient Fine-Tuning
SIBO: A Simple Booster for Parameter-Efficient Fine-Tuning
Zhihao Wen
Jie Zhang
Yuan Fang
MoE
82
3
0
19 Feb 2024
Automating Dataset Updates Towards Reliable and Timely Evaluation of
  Large Language Models
Automating Dataset Updates Towards Reliable and Timely Evaluation of Large Language Models
Jiahao Ying
Yixin Cao
Yushi Bai
Qianru Sun
Bo Wang
Wei Tang
Zhaojun Ding
Yizhe Yang
Xuanjing Huang
Shuicheng Yan
KELM
59
10
0
19 Feb 2024
InMD-X: Large Language Models for Internal Medicine Doctors
InMD-X: Large Language Models for Internal Medicine Doctors
Hansle Gwon
Imjin Ahn
Hyoje Jung
Byeolhee Kim
Young-Hak Kim
Tae Joon Jun
LM&MA
85
1
0
19 Feb 2024
NOTE: Notable generation Of patient Text summaries through Efficient
  approach based on direct preference optimization
NOTE: Notable generation Of patient Text summaries through Efficient approach based on direct preference optimization
Imjin Ahn
Hansle Gwon
Young-Hak Kim
Tae Joon Jun
Sanghyun Park
72
3
0
19 Feb 2024
ComFusion: Personalized Subject Generation in Multiple Specific Scenes
  From Single Image
ComFusion: Personalized Subject Generation in Multiple Specific Scenes From Single Image
Yan Hong
Jianfu Zhang
DiffM
104
3
0
19 Feb 2024
Head-wise Shareable Attention for Large Language Models
Head-wise Shareable Attention for Large Language Models
Zouying Cao
Yifei Yang
Hai Zhao
76
4
0
19 Feb 2024
Learning the Unlearned: Mitigating Feature Suppression in Contrastive
  Learning
Learning the Unlearned: Mitigating Feature Suppression in Contrastive Learning
Jihai Zhang
Xiang Lan
Xiaoye Qu
Yu Cheng
Mengling Feng
Bryan Hooi
SSL
104
5
0
19 Feb 2024
Parameter Efficient Finetuning for Speech Emotion Recognition and Domain
  Adaptation
Parameter Efficient Finetuning for Speech Emotion Recognition and Domain Adaptation
Nineli Lashkarashvili
Wen Wu
Guangzhi Sun
P. Woodland
73
8
0
19 Feb 2024
Language Models are Homer Simpson! Safety Re-Alignment of Fine-tuned
  Language Models through Task Arithmetic
Language Models are Homer Simpson! Safety Re-Alignment of Fine-tuned Language Models through Task Arithmetic
Rishabh Bhardwaj
Do Duc Anh
Soujanya Poria
MoMe
114
48
0
19 Feb 2024
Uncertainty quantification in fine-tuned LLMs using LoRA ensembles
Uncertainty quantification in fine-tuned LLMs using LoRA ensembles
Oleksandr Balabanov
Hampus Linander
UQCV
119
20
0
19 Feb 2024
ChartX & ChartVLM: A Versatile Benchmark and Foundation Model for Complicated Chart Reasoning
ChartX & ChartVLM: A Versatile Benchmark and Foundation Model for Complicated Chart Reasoning
Renqiu Xia
Bo Zhang
Hancheng Ye
Xiangchao Yan
Qi Liu
...
Min Dou
Botian Shi
Junchi Yan
Junchi Yan
Yu Qiao
LRM
187
68
0
19 Feb 2024
Extensible Embedding: A Flexible Multipler For LLM's Context Length
Extensible Embedding: A Flexible Multipler For LLM's Context Length
Ninglu Shao
Shitao Xiao
Zheng Liu
Peitian Zhang
54
1
0
18 Feb 2024
Efficient Multimodal Learning from Data-centric Perspective
Efficient Multimodal Learning from Data-centric Perspective
Muyang He
Yexin Liu
Boya Wu
Jianhao Yuan
Yueze Wang
Tiejun Huang
Bo Zhao
MLLM
93
88
0
18 Feb 2024
Knowledge-to-SQL: Enhancing SQL Generation with Data Expert LLM
Knowledge-to-SQL: Enhancing SQL Generation with Data Expert LLM
Zijin Hong
Zheng Yuan
Hao Chen
Qinggang Zhang
Feiran Huang
Xiao Huang
124
32
0
18 Feb 2024
Previous
123...969798...137138139
Next