Papers
Communities
Events
Blog
Pricing
Search
Open menu
Home
Papers
2106.09685
Cited By
v1
v2 (latest)
LoRA: Low-Rank Adaptation of Large Language Models
17 June 2021
J. E. Hu
Yelong Shen
Phillip Wallis
Zeyuan Allen-Zhu
Yuanzhi Li
Shean Wang
Lu Wang
Weizhu Chen
OffRL
AI4TS
AI4CE
ALM
AIMat
Re-assign community
ArXiv (abs)
PDF
HTML
Github (11998★)
Papers citing
"LoRA: Low-Rank Adaptation of Large Language Models"
50 / 6,911 papers shown
Title
LOGIN: A Large Language Model Consulted Graph Neural Network Training Framework
Yiran Qiao
Xiang Ao
Yang Liu
Jiarong Xu
Xiaoqian Sun
Qing He
100
4
0
22 May 2024
FreeCustom: Tuning-Free Customized Image Generation for Multi-Concept Composition
Ganggui Ding
Canyu Zhao
Wen Wang
Zhen Yang
Zide Liu
Hao Chen
Chunhua Shen
DiffM
84
26
0
22 May 2024
Thermodynamic Natural Gradient Descent
Kaelan Donatella
Samuel Duffield
Maxwell Aifer
Denis Melanson
Gavin Crooks
Patrick J. Coles
55
3
0
22 May 2024
Getting More from Less: Large Language Models are Good Spontaneous Multilingual Learners
Shimao Zhang
Changjiang Gao
Wenhao Zhu
Jiajun Chen
Xin Huang
Xue Han
Junlan Feng
Chao Deng
Shujian Huang
66
9
0
22 May 2024
Dense Connector for MLLMs
Huanjin Yao
Wenhao Wu
Taojiannan Yang
Yuxin Song
Mengxi Zhang
Haocheng Feng
Yifan Sun
Zhiheng Li
Wanli Ouyang
Jingdong Wang
MLLM
VLM
102
25
0
22 May 2024
DETAIL: Task DEmonsTration Attribution for Interpretable In-context Learning
Zijian Zhou
Xiaoqiang Lin
Xinyi Xu
Alok Prakash
Daniela Rus
K. H. Low
72
4
0
22 May 2024
CG-FedLLM: How to Compress Gradients in Federated Fune-tuning for Large Language Models
Huiwen Wu
Xiaohan Li
Deyi Zhang
Xiaogang Xu
Xiaogang Xu
Puning Zhao
Zhe Liu
FedML
75
2
0
22 May 2024
Class-Conditional self-reward mechanism for improved Text-to-Image models
Safouane El Ghazouali
Arnaud Gucciardi
Umberto Michelucci
EGVM
48
0
0
22 May 2024
Enhanced Creativity and Ideation through Stable Video Synthesis
Elijah Miller
Thomas Dupont
Mingming Wang
VGen
61
1
0
22 May 2024
Model Editing as a Robust and Denoised variant of DPO: A Case Study on Toxicity
Rheeya Uppaal
Apratim De
Yiting He
Yiquao Zhong
Junjie Hu
168
7
0
22 May 2024
Comparative Analysis of Different Efficient Fine Tuning Methods of Large Language Models (LLMs) in Low-Resource Setting
Krishna Prasad Varadarajan Srinivasan
Prasanth Gumpena
Madhusudhana Yattapu
Vishal H. Brahmbhatt
34
1
0
21 May 2024
ReALLM: A general framework for LLM compression and fine-tuning
Louis Leconte
Lisa Bedin
Van Minh Nguyen
Eric Moulines
MQ
129
1
0
21 May 2024
Adversarial DPO: Harnessing Harmful Data for Reducing Toxicity with Minimal Impact on Coherence and Evasiveness in Dialogue Agents
San Kim
Gary Geunbae Lee
AAML
134
3
0
21 May 2024
Large Language Models Meet NLP: A Survey
Libo Qin
Qiguang Chen
Xiachong Feng
Yang Wu
Yongheng Zhang
Hai-Tao Zheng
Min Li
Wanxiang Che
Philip S. Yu
ALM
LM&MA
ELM
LRM
123
59
0
21 May 2024
Multi-Subject Personalization
Arushi Jain
Shubham Paliwal
Monika Sharma
Vikram Jamwal
Lovekesh Vig
DiffM
42
1
0
21 May 2024
SPO: Multi-Dimensional Preference Sequential Alignment With Implicit Reward Modeling
Xingzhou Lou
Junge Zhang
Jian Xie
Lifeng Liu
Dong Yan
Kaiqi Huang
96
13
0
21 May 2024
Mining the Explainability and Generalization: Fact Verification Based on Self-Instruction
Guangyao Lu
Yulin Liu
105
0
0
21 May 2024
A Survey of Deep Learning-based Radiology Report Generation Using Multimodal Data
Xinyi Wang
Grazziela Figueredo
Ruizhe Li
Wei Emma Zhang
Weitong Chen
Xin Chen
MedIm
ViT
124
2
0
21 May 2024
Training Data Attribution via Approximate Unrolled Differentiation
Juhan Bae
Wu Lin
Jonathan Lorraine
Roger C. Grosse
TDI
MU
162
18
0
20 May 2024
MoRA: High-Rank Updating for Parameter-Efficient Fine-Tuning
Ting Jiang
Shaohan Huang
Shengyue Luo
Zihan Zhang
Haizhen Huang
...
Weiwei Deng
Feng Sun
Qi Zhang
Deqing Wang
Fuzhen Zhuang
92
31
0
20 May 2024
Imp: Highly Capable Large Multimodal Models for Mobile Devices
Zhenwei Shao
Zhou Yu
Jun Yu
Xuecheng Ouyang
Lihao Zheng
Zhenbiao Gai
Mingyang Wang
Jiajun Ding
75
11
0
20 May 2024
TinyLLaVA Factory: A Modularized Codebase for Small-scale Large Multimodal Models
Junlong Jia
Ying Hu
Xi Weng
Yiming Shi
Miao Li
...
Baichuan Zhou
Ziyu Liu
Jie Luo
Lei Huang
Ji Wu
97
9
0
20 May 2024
OpenRLHF: An Easy-to-use, Scalable and High-performance RLHF Framework
Jian Hu
Xibin Wu
Wei Shen
OpenLLMAI Team
Dehao Zhang
...
Weikai Fang
Xianyu
Yu Cao
Haotian Xu
Yiming Liu
VLM
AI4CE
139
130
0
20 May 2024
Your Transformer is Secretly Linear
Anton Razzhigaev
Matvey Mikhalchuk
Elizaveta Goncharova
Nikolai Gerasimenko
Ivan Oseledets
Denis Dimitrov
Andrey Kuznetsov
81
6
0
19 May 2024
MeteoRA: Multiple-tasks Embedded LoRA for Large Language Models
Jingwei Xu
Junyu Lai
Yunpeng Huang
MoE
MoMe
93
11
0
19 May 2024
Learning More Generalized Experts by Merging Experts in Mixture-of-Experts
Sejik Park
FedML
CLL
MoMe
78
5
0
19 May 2024
Uni-MoE: Scaling Unified Multimodal LLMs with Mixture of Experts
Yunxin Li
Shenyuan Jiang
Baotian Hu
Longyue Wang
Wanqi Zhong
Wenhan Luo
Lin Ma
Min Zhang
MoE
111
42
0
18 May 2024
Automated Multi-level Preference for MLLMs
Mengxi Zhang
Wenhao Wu
Yu Lu
Yuxin Song
Kang Rong
...
Jianbo Zhao
Fanglong Liu
Yifan Sun
Haocheng Feng
Jingdong Wang
MLLM
129
15
0
18 May 2024
LLM-based Multi-Agent Reinforcement Learning: Current and Future Directions
Chuanneng Sun
Songjun Huang
D. Pompili
LLMAG
125
35
0
17 May 2024
Generative AI for 2D Character Animation
Jaime Guajardo
Ozgun Y. Bursalioglu
Dan B. Goldman
VGen
49
3
0
17 May 2024
Improving face generation quality and prompt following with synthetic captions
Michail Tarasiou
Stylianos Moschoglou
Jiankang Deng
Stefanos Zafeiriou
24
0
0
17 May 2024
ECR-Chain: Advancing Generative Language Models to Better Emotion-Cause Reasoners through Reasoning Chains
Zhaopei Huang
Jinming Zhao
Qin Jin
ReLM
LRM
85
6
0
17 May 2024
Large Language Model (LLM) for Telecommunications: A Comprehensive Survey on Principles, Key Techniques, and Opportunities
Hao Zhou
Chengming Hu
Ye Yuan
Yufei Cui
Yili Jin
...
Di Wu
Xue Liu
Charlie Zhang
Xianbin Wang
Jiangchuan Liu
118
79
0
17 May 2024
Efficient Multimodal Large Language Models: A Survey
Yizhang Jin
Jian Li
Yexin Liu
Tianjun Gu
Kai Wu
...
Xin Tan
Zhenye Gan
Yabiao Wang
Chengjie Wang
Lizhuang Ma
LRM
122
58
0
17 May 2024
BugBlitz-AI: An Intelligent QA Assistant
Yi Yao
Jun Wang
Yabai Hu
Lifeng Wang
Yi Zhou
Jack Chen
Xuming Gai
Zhenming Wang
Wenjun Liu
32
2
0
17 May 2024
Not All Prompts Are Secure: A Switchable Backdoor Attack Against Pre-trained Vision Transformers
Shengyuan Yang
Jiawang Bai
Kuofeng Gao
Yong-Liang Yang
Yiming Li
Shu-Tao Xia
AAML
SILM
116
5
0
17 May 2024
UniCL: A Universal Contrastive Learning Framework for Large Time Series Models
Jiawei Li
Jingshu Peng
Haoyang Li
Lei Chen
AI4TS
97
3
0
17 May 2024
Towards Better Question Generation in QA-based Event Extraction
Zijin Hong
Jian Liu
112
9
0
17 May 2024
Grounded 3D-LLM with Referent Tokens
Yilun Chen
Shuai Yang
Haifeng Huang
Tai Wang
Ruiyuan Lyu
Runsen Xu
Dahua Lin
Jiangmiao Pang
118
37
0
16 May 2024
Text-to-Vector Generation with Neural Path Representation
Peiying Zhang
Nanxuan Zhao
Jing Liao
116
12
0
16 May 2024
Fine-Tuning Large Vision-Language Models as Decision-Making Agents via Reinforcement Learning
Yuexiang Zhai
Hao Bai
Zipeng Lin
Jiayi Pan
Shengbang Tong
...
Alane Suhr
Saining Xie
Yann LeCun
Yi-An Ma
Sergey Levine
LLMAG
LRM
143
81
0
16 May 2024
A Systematic Evaluation of Large Language Models for Natural Language Generation Tasks
Xuanfan Ni
Piji Li
ELM
LRM
69
9
0
16 May 2024
DocuMint: Docstring Generation for Python using Small Language Models
Bibek Poudel
Adam Cook
Sekou Traore
Shelah Ameli
ALM
74
1
0
16 May 2024
Low-Rank Adaptation of Time Series Foundational Models for Out-of-Domain Modality Forecasting
Divij Gupta
Anubhav Bhatti
Surajsinh Parmar
Chen Dan
Yuwei Liu
Bingjie Shen
San Lee
AI4TS
76
4
0
16 May 2024
Listen Again and Choose the Right Answer: A New Paradigm for Automatic Speech Recognition with Large Language Models
Yuchen Hu
Chen Chen
Chengwei Qin
Qiushi Zhu
Eng Siong Chng
Ruizhe Li
AuLLM
KELM
100
7
0
16 May 2024
Flow Score Distillation for Diverse Text-to-3D Generation
Runjie Yan
Kailu Wu
Kaisheng Ma
76
3
0
16 May 2024
SecureLLM: Using Compositionality to Build Provably Secure Language Models for Private, Sensitive, and Secret Data
Abdulrahman Alabdulakreem
Christian M Arnold
Yerim Lee
Pieter M Feenstra
Boris Katz
Andrei Barbu
69
4
0
16 May 2024
Cross-sensor self-supervised training and alignment for remote sensing
V. Marsocci
Nicolas Audebert
86
1
0
16 May 2024
A survey on fairness of large language models in e-commerce: progress, application, and challenge
Qingyang Ren
Zilin Jiang
Jinghan Cao
Sijia Li
Chiqu Li
Yiyang Liu
Shuning Huo
Tiange He
Yuan Chen
AILaw
FaML
106
7
0
15 May 2024
LoRA Learns Less and Forgets Less
D. Biderman
Jose Javier Gonzalez Ortiz
Jacob P. Portes
Mansheej Paul
Philip Greengard
...
Sam Havens
Vitaliy Chiley
Jonathan Frankle
Cody Blakeney
John P. Cunningham
CLL
133
142
0
15 May 2024
Previous
1
2
3
...
79
80
81
...
137
138
139
Next