ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2106.09685
  4. Cited By
LoRA: Low-Rank Adaptation of Large Language Models
v1v2 (latest)

LoRA: Low-Rank Adaptation of Large Language Models

17 June 2021
J. E. Hu
Yelong Shen
Phillip Wallis
Zeyuan Allen-Zhu
Yuanzhi Li
Shean Wang
Lu Wang
Weizhu Chen
    OffRLAI4TSAI4CEALMAIMat
ArXiv (abs)PDFHTMLGithub (11998★)

Papers citing "LoRA: Low-Rank Adaptation of Large Language Models"

50 / 6,909 papers shown
Title
Code Soliloquies for Accurate Calculations in Large Language Models
Code Soliloquies for Accurate Calculations in Large Language Models
Shashank Sonkar
Myco Le
Xinghe Chen
Naiming Liu
D. B. Mallick
Richard G. Baraniuk
SyDa
60
15
0
21 Sep 2023
PEFTT: Parameter-Efficient Fine-Tuning for low-resource Tibetan
  pre-trained language models
PEFTT: Parameter-Efficient Fine-Tuning for low-resource Tibetan pre-trained language models
Mingjun Zhou
Daiqing Zhuoma
Qun Nuo
T. Nyima
88
0
0
21 Sep 2023
Prompt Tuned Embedding Classification for Multi-Label Industry Sector
  Allocation
Prompt Tuned Embedding Classification for Multi-Label Industry Sector Allocation
V. Buchner
Lele Cao
Jan-Christoph Kalo
Vilhelm von Ehrenheim
VLM
83
2
0
21 Sep 2023
Knowledge Sanitization of Large Language Models
Knowledge Sanitization of Large Language Models
Yoichi Ishibashi
Hidetoshi Shimodaira
KELM
129
25
0
21 Sep 2023
SAM-OCTA: A Fine-Tuning Strategy for Applying Foundation Model to OCTA
  Image Segmentation Tasks
SAM-OCTA: A Fine-Tuning Strategy for Applying Foundation Model to OCTA Image Segmentation Tasks
Chengliang Wang
Xinrun Chen
Haojian Ning
Shiying Li
67
15
0
21 Sep 2023
Sparsely Shared LoRA on Whisper for Child Speech Recognition
Sparsely Shared LoRA on Whisper for Child Speech Recognition
W. Liu
Ying Qin
Zhiyuan Peng
Tan Lee
66
19
0
21 Sep 2023
LLM-based Medical Assistant Personalization with Short- and Long-Term
  Memory Coordination
LLM-based Medical Assistant Personalization with Short- and Long-Term Memory Coordination
Kai Zhang
Yangyang Kang
Fubang Zhao
Xiaozhong Liu
90
30
0
21 Sep 2023
A Paradigm Shift in Machine Translation: Boosting Translation
  Performance of Large Language Models
A Paradigm Shift in Machine Translation: Boosting Translation Performance of Large Language Models
Haoran Xu
Young Jin Kim
Amr Sharaf
Hany Awadalla
106
70
0
20 Sep 2023
Towards Effective Disambiguation for Machine Translation with Large
  Language Models
Towards Effective Disambiguation for Machine Translation with Large Language Models
Vivek Iyer
Pinzhen Chen
Alexandra Birch
78
12
0
20 Sep 2023
Hate speech detection in algerian dialect using deep learning
Hate speech detection in algerian dialect using deep learning
Dihia Lanasri
Juan Olano
Sifal Klioui
Sin Liang Lee
Lamia Sekkai
76
3
0
20 Sep 2023
DreamLLM: Synergistic Multimodal Comprehension and Creation
DreamLLM: Synergistic Multimodal Comprehension and Creation
Runpei Dong
Chunrui Han
Yuang Peng
Zekun Qi
Zheng Ge
...
Hao-Ran Wei
Xiangwen Kong
Xiangyu Zhang
Kaisheng Ma
Li Yi
MLLM
109
199
0
20 Sep 2023
Retrieve-Rewrite-Answer: A KG-to-Text Enhanced LLMs Framework for
  Knowledge Graph Question Answering
Retrieve-Rewrite-Answer: A KG-to-Text Enhanced LLMs Framework for Knowledge Graph Question Answering
Yike Wu
Nan Hu
Sheng Bi
Guilin Qi
Jie Ren
Anhuan Xie
Wei Song
RALM
92
67
0
20 Sep 2023
The Languini Kitchen: Enabling Language Modelling Research at Different
  Scales of Compute
The Languini Kitchen: Enabling Language Modelling Research at Different Scales of Compute
Aleksandar Stanić
Dylan R. Ashley
Oleg Serikov
Louis Kirsch
Francesco Faccio
Jürgen Schmidhuber
Thomas Hofmann
Imanol Schlag
MoE
86
9
0
20 Sep 2023
XATU: A Fine-grained Instruction-based Benchmark for Explainable Text
  Updates
XATU: A Fine-grained Instruction-based Benchmark for Explainable Text Updates
Haopeng Zhang
Hayate Iso
Sairam Gurajada
Nikita Bhutani
115
6
0
20 Sep 2023
End-to-End Speech Recognition Contextualization with Large Language
  Models
End-to-End Speech Recognition Contextualization with Large Language Models
Egor Lakomkin
Chunyang Wu
Yassir Fathullah
Ozlem Kalinli
M. Seltzer
Christian Fuegen
126
22
0
19 Sep 2023
CFGPT: Chinese Financial Assistant with Large Language Model
CFGPT: Chinese Financial Assistant with Large Language Model
Jiangtong Li
Hao Wang
Guoxuan Wang
Yang Lei
Dawei Cheng
Zhijun Ding
Changjun Jiang
55
12
0
19 Sep 2023
Forgedit: Text Guided Image Editing via Learning and Forgetting
Forgedit: Text Guided Image Editing via Learning and Forgetting
Shiwen Zhang
Shuai Xiao
Weilin Huang
DiffM
76
21
0
19 Sep 2023
Investigating the Catastrophic Forgetting in Multimodal Large Language
  Models
Investigating the Catastrophic Forgetting in Multimodal Large Language Models
Yuexiang Zhai
Shengbang Tong
Xiao Li
Mu Cai
Qing Qu
Yong Jae Lee
Yi Ma
VLMMLLMCLL
171
88
0
19 Sep 2023
Using fine-tuning and min lookahead beam search to improve Whisper
Using fine-tuning and min lookahead beam search to improve Whisper
Andrea Do
Oscar Brown
Zhengjie Wang
Nikhil Mathew
Zixin Liu
Jawwad Ahmed
Cheng Yu
67
2
0
19 Sep 2023
360$^\circ$ Reconstruction From a Single Image Using Space Carved
  Outpainting
360∘^\circ∘ Reconstruction From a Single Image Using Space Carved Outpainting
Nuri Ryu
Minsu Gong
Geon-Yeong Kim
Joo-Haeng Lee
Sunghyun Cho
3DGS
76
1
0
19 Sep 2023
Drive as You Speak: Enabling Human-Like Interaction with Large Language
  Models in Autonomous Vehicles
Drive as You Speak: Enabling Human-Like Interaction with Large Language Models in Autonomous Vehicles
Can Cui
Yunsheng Ma
Xu Cao
Wenqian Ye
Ziran Wang
121
113
0
19 Sep 2023
Automatic Personalized Impression Generation for PET Reports Using Large
  Language Models
Automatic Personalized Impression Generation for PET Reports Using Large Language Models
Xin Tie
Muheon Shin
Ali Pirasteh
Nevein Ibrahim
Zachary Huemann
...
K. M. Kelly
John W. Garrett
Junjie Hu
Steve Y. Cho
Tyler Bradshaw
LM&MA
114
10
0
18 Sep 2023
An Empirical Study of Scaling Instruct-Tuned Large Multimodal Models
An Empirical Study of Scaling Instruct-Tuned Large Multimodal Models
Yadong Lu
Chunyuan Li
Haotian Liu
Jianwei Yang
Jianfeng Gao
Yelong Shen
MLLM
164
31
0
18 Sep 2023
Corpus Synthesis for Zero-shot ASR domain Adaptation using Large
  Language Models
Corpus Synthesis for Zero-shot ASR domain Adaptation using Large Language Models
Hsuan Su
Ting-Yao Hu
H. Koppula
Raviteja Vemulapalli
Jen-Hao Rick Chang
Karren D. Yang
G. Mantena
Oncel Tuzel
SyDa
86
3
0
18 Sep 2023
R2GenGPT: Radiology Report Generation with Frozen LLMs
R2GenGPT: Radiology Report Generation with Frozen LLMs
Zhanyu Wang
Lingqiao Liu
Lei Wang
Luping Zhou
MedImLM&MAVLM
93
75
0
18 Sep 2023
A Few-Shot Approach to Dysarthric Speech Intelligibility Level
  Classification Using Transformers
A Few-Shot Approach to Dysarthric Speech Intelligibility Level Classification Using Transformers
Paleti Nikhil Chowdary
Vadlapudi Sai Aravind
Gorantla V N S L Vishnu Vardhan
Menta Sai Akshay
Menta Sai Aashish
G. JyothishLal.
18
6
0
17 Sep 2023
OWL: A Large Language Model for IT Operations
OWL: A Large Language Model for IT Operations
Hongcheng Guo
Jian Yang
Jiaheng Liu
Liqun Yang
Linzheng Chai
...
Tieqiao Zheng
Liangfan Zheng
Bo Zhang
Ke Xu
Zhoujun Li
VLM
119
43
0
17 Sep 2023
MVP: Meta Visual Prompt Tuning for Few-Shot Remote Sensing Image Scene
  Classification
MVP: Meta Visual Prompt Tuning for Few-Shot Remote Sensing Image Scene Classification
Junjie Zhu
Yiying Li
Chunping Qiu
Ke Yang
Naiyang Guan
Xiaodong Yi
95
7
0
17 Sep 2023
Enhancing Quantised End-to-End ASR Models via Personalisation
Enhancing Quantised End-to-End ASR Models via Personalisation
Qiuming Zhao
Guangzhi Sun
Chao Zhang
Mingxing Xu
Thomas Fang Zheng
MQ
64
3
0
17 Sep 2023
Exploring the impact of low-rank adaptation on the performance,
  efficiency, and regularization of RLHF
Exploring the impact of low-rank adaptation on the performance, efficiency, and regularization of RLHF
Simeng Sun
Dhawal Gupta
Mohit Iyyer
89
20
0
16 Sep 2023
Sorted LLaMA: Unlocking the Potential of Intermediate Layers of Large
  Language Models for Dynamic Inference
Sorted LLaMA: Unlocking the Potential of Intermediate Layers of Large Language Models for Dynamic Inference
Parsa Kavehzadeh
Mojtaba Valipour
Marzieh S. Tahaei
Ali Ghodsi
Boxing Chen
Mehdi Rezagholizadeh
87
6
0
16 Sep 2023
Monolingual or Multilingual Instruction Tuning: Which Makes a Better
  Alpaca
Monolingual or Multilingual Instruction Tuning: Which Makes a Better Alpaca
Pinzhen Chen
Shaoxiong Ji
Nikolay Bogoychev
Andrey Kutuzov
Barry Haddow
Kenneth Heafield
99
47
0
16 Sep 2023
MA-SAM: Modality-agnostic SAM Adaptation for 3D Medical Image
  Segmentation
MA-SAM: Modality-agnostic SAM Adaptation for 3D Medical Image Segmentation
Cheng Chen
Juzheng Miao
Dufan Wu
Zhiling Yan
Sekeun Kim
...
Lichao Sun
Xiang Li
Tianming Liu
Pheng-Ann Heng
Quanzheng Li
MedIm
127
63
0
16 Sep 2023
MusiLingo: Bridging Music and Text with Pre-trained Language Models for
  Music Captioning and Query Response
MusiLingo: Bridging Music and Text with Pre-trained Language Models for Music Captioning and Query Response
Zihao Deng
Yi Ma
Yudong Liu
Rongchen Guo
Ge Zhang
Wenhu Chen
Wenhao Huang
Emmanouil Benetos
MLLMAuLLM
114
27
0
15 Sep 2023
Viewpoint Integration and Registration with Vision Language Foundation
  Model for Image Change Understanding
Viewpoint Integration and Registration with Vision Language Foundation Model for Image Change Understanding
Xiaonan Lu
Jianlong Yuan
Ruigang Niu
Yuan Hu
Fan Wang
48
2
0
15 Sep 2023
SCT: A Simple Baseline for Parameter-Efficient Fine-Tuning via Salient
  Channels
SCT: A Simple Baseline for Parameter-Efficient Fine-Tuning via Salient Channels
Henry Hengyuan Zhao
Pichao Wang
Yuyang Zhao
Hao Luo
F. Wang
Mike Zheng Shou
ViT
115
14
0
15 Sep 2023
Learning by Self-Explaining
Learning by Self-Explaining
Wolfgang Stammer
Felix Friedrich
David Steinmann
Manuel Brack
Hikaru Shindo
Kristian Kersting
138
12
0
15 Sep 2023
Reward Engineering for Generating Semi-structured Explanation
Reward Engineering for Generating Semi-structured Explanation
Paul Burgess
Wray Buntine
Ehsan Shareghi
LRM
59
0
0
15 Sep 2023
BROW: Better featuRes fOr Whole slide image based on self-distillation
BROW: Better featuRes fOr Whole slide image based on self-distillation
Yuan Wu
Shaojie Li
Zhiqiang Du
Wentao Zhu
55
5
0
15 Sep 2023
FedJudge: Federated Legal Large Language Model
FedJudge: Federated Legal Large Language Model
Linan Yue
Qi Liu
Yichao Du
Weibo Gao
Ye Liu
Fangzhou Yao
ELMAILawFedML
89
8
0
15 Sep 2023
InvestLM: A Large Language Model for Investment using Financial Domain
  Instruction Tuning
InvestLM: A Large Language Model for Investment using Financial Domain Instruction Tuning
Yi Yang
Yixuan Tang
Kar Yan Tam
ALMAIFin
72
69
0
15 Sep 2023
MMICL: Empowering Vision-language Model with Multi-Modal In-Context
  Learning
MMICL: Empowering Vision-language Model with Multi-Modal In-Context Learning
Haozhe Zhao
Zefan Cai
Shuzheng Si
Xiaojian Ma
Kaikai An
Liang Chen
Zixuan Liu
Sheng Wang
Wenjuan Han
Baobao Chang
MLLMVLM
128
143
0
14 Sep 2023
Safety-Tuned LLaMAs: Lessons From Improving the Safety of Large Language
  Models that Follow Instructions
Safety-Tuned LLaMAs: Lessons From Improving the Safety of Large Language Models that Follow Instructions
Federico Bianchi
Mirac Suzgun
Giuseppe Attanasio
Paul Röttger
Dan Jurafsky
Tatsunori Hashimoto
James Zou
ALMLM&MALRM
96
219
0
14 Sep 2023
CATfOOD: Counterfactual Augmented Training for Improving Out-of-Domain
  Performance and Calibration
CATfOOD: Counterfactual Augmented Training for Improving Out-of-Domain Performance and Calibration
Rachneet Sachdeva
Martin Tutek
Iryna Gurevych
OODD
102
13
0
14 Sep 2023
SwitchGPT: Adapting Large Language Models for Non-Text Outputs
SwitchGPT: Adapting Large Language Models for Non-Text Outputs
Xinyu Wang
Bohan Zhuang
Qi Wu
MLLM
76
3
0
14 Sep 2023
DiffTalker: Co-driven audio-image diffusion for talking faces via
  intermediate landmarks
DiffTalker: Co-driven audio-image diffusion for talking faces via intermediate landmarks
Zipeng Qi
Xulong Zhang
Ning Cheng
Jing Xiao
Jianzong Wang
96
7
0
14 Sep 2023
DePT: Decoupled Prompt Tuning
DePT: Decoupled Prompt Tuning
Ji Zhang
Shihan Wu
Lianli Gao
Hengtao Shen
Jingkuan Song
VLM
77
33
0
14 Sep 2023
Sight Beyond Text: Multi-Modal Training Enhances LLMs in Truthfulness
  and Ethics
Sight Beyond Text: Multi-Modal Training Enhances LLMs in Truthfulness and Ethics
Haoqin Tu
Bingchen Zhao
Chen Wei
Cihang Xie
MLLM
71
15
0
13 Sep 2023
Can Whisper perform speech-based in-context learning?
Can Whisper perform speech-based in-context learning?
Siyin Wang
Chao-Han Huck Yang
Ji Wu
Chao Zhang
117
29
0
13 Sep 2023
Hydra: Multi-head Low-rank Adaptation for Parameter Efficient
  Fine-tuning
Hydra: Multi-head Low-rank Adaptation for Parameter Efficient Fine-tuning
Sanghyeon Kim
Hyunmo Yang
Younghyun Kim
Youngjoon Hong
Eunbyung Park
AI4CE
73
18
0
13 Sep 2023
Previous
123...119120121...137138139
Next