ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2106.09685
  4. Cited By
LoRA: Low-Rank Adaptation of Large Language Models
v1v2 (latest)

LoRA: Low-Rank Adaptation of Large Language Models

17 June 2021
J. E. Hu
Yelong Shen
Phillip Wallis
Zeyuan Allen-Zhu
Yuanzhi Li
Shean Wang
Lu Wang
Weizhu Chen
    OffRLAI4TSAI4CEALMAIMat
ArXiv (abs)PDFHTMLGithub (11998★)

Papers citing "LoRA: Low-Rank Adaptation of Large Language Models"

50 / 6,909 papers shown
Title
LMFlow: An Extensible Toolkit for Finetuning and Inference of Large
  Foundation Models
LMFlow: An Extensible Toolkit for Finetuning and Inference of Large Foundation Models
Shizhe Diao
Boyao Wang
Hanze Dong
Kashun Shum
Jipeng Zhang
Wei Xiong
Tong Zhang
ALM
100
66
0
21 Jun 2023
DiNADO: Norm-Disentangled Neurally-Decomposed Oracles for Controlling
  Language Models
DiNADO: Norm-Disentangled Neurally-Decomposed Oracles for Controlling Language Models
Sidi Lu
Wenbo Zhao
Chenyang Tao
Arpit Gupta
Shan Wu
Tagyoung Chung
Nanyun Peng
44
1
0
20 Jun 2023
A Simple and Effective Pruning Approach for Large Language Models
A Simple and Effective Pruning Approach for Large Language Models
Mingjie Sun
Zhuang Liu
Anna Bair
J. Zico Kolter
173
440
0
20 Jun 2023
Harnessing the Power of Adversarial Prompting and Large Language Models
  for Robust Hypothesis Generation in Astronomy
Harnessing the Power of Adversarial Prompting and Large Language Models for Robust Hypothesis Generation in Astronomy
I. Ciucă
Y. Ting 丁
Sandor Kruk
K. Iyer
86
11
0
20 Jun 2023
Democratizing LLMs for Low-Resource Languages by Leveraging their
  English Dominant Abilities with Linguistically-Diverse Prompts
Democratizing LLMs for Low-Resource Languages by Leveraging their English Dominant Abilities with Linguistically-Diverse Prompts
Xuan-Phi Nguyen
Sharifah Mahani Aljunied
Shafiq Joty
Lidong Bing
118
38
0
20 Jun 2023
RS5M and GeoRSCLIP: A Large Scale Vision-Language Dataset and A Large
  Vision-Language Model for Remote Sensing
RS5M and GeoRSCLIP: A Large Scale Vision-Language Dataset and A Large Vision-Language Model for Remote Sensing
Zilun Zhang
Tiancheng Zhao
Yulong Guo
Yuxiang Cai
DiffMVLM
146
67
0
20 Jun 2023
A Novel Counterfactual Data Augmentation Method for Aspect-Based
  Sentiment Analysis
A Novel Counterfactual Data Augmentation Method for Aspect-Based Sentiment Analysis
Dongming Wu
Lulu Wen
Chao Chen
Zhaoshu Shi
79
3
0
20 Jun 2023
InRank: Incremental Low-Rank Learning
InRank: Incremental Low-Rank Learning
Jiawei Zhao
Yifei Zhang
Beidi Chen
F. Schafer
Anima Anandkumar
71
7
0
20 Jun 2023
MotionGPT: Finetuned LLMs Are General-Purpose Motion Generators
MotionGPT: Finetuned LLMs Are General-Purpose Motion Generators
Yaqi Zhang
Di Huang
B. Liu
Shixiang Tang
Yan Lu
Lu Chen
Lei Bai
Qi Chu
Nenghai Yu
Wanli Ouyang
168
104
0
19 Jun 2023
Structured Thoughts Automaton: First Formalized Execution Model for
  Auto-Regressive Language Models
Structured Thoughts Automaton: First Formalized Execution Model for Auto-Regressive Language Models
T. Vanderbruggen
C. Liao
P. Pirkelbauer
Pei-Hung Lin
LRMALM
61
2
0
16 Jun 2023
Just One Byte (per gradient): A Note on Low-Bandwidth Decentralized
  Language Model Finetuning Using Shared Randomness
Just One Byte (per gradient): A Note on Low-Bandwidth Decentralized Language Model Finetuning Using Shared Randomness
E. Zelikman
Qian Huang
Percy Liang
Nick Haber
Noah D. Goodman
97
16
0
16 Jun 2023
Group Orthogonalization Regularization For Vision Models Adaptation and
  Robustness
Group Orthogonalization Regularization For Vision Models Adaptation and Robustness
Yoav Kurtz
Noga Bar
Raja Giryes
60
0
0
16 Jun 2023
ClinicalGPT: Large Language Models Finetuned with Diverse Medical Data
  and Comprehensive Evaluation
ClinicalGPT: Large Language Models Finetuned with Diverse Medical Data and Comprehensive Evaluation
Guangyu Wang
Guoxing Yang
Zongxin Du
Longjun Fan
Xiaohu Li
LM&MAELMAI4MH
74
88
0
16 Jun 2023
A Low-rank Matching Attention based Cross-modal Feature Fusion Method
  for Conversational Emotion Recognition
A Low-rank Matching Attention based Cross-modal Feature Fusion Method for Conversational Emotion Recognition
Yun-Xu Shou
Xiangyong Cao
Deyu Meng
B. Dong
Qinghua Zheng
109
50
0
16 Jun 2023
Learning to Summarize and Answer Questions about a Virtual Robot's Past
  Actions
Learning to Summarize and Answer Questions about a Virtual Robot's Past Actions
Chad DeChant
Iretiayo Akinola
Daniel Bauer
88
8
0
16 Jun 2023
LabelBench: A Comprehensive Framework for Benchmarking Adaptive
  Label-Efficient Learning
LabelBench: A Comprehensive Framework for Benchmarking Adaptive Label-Efficient Learning
Jifan Zhang
Yifang Chen
Gregory H. Canal
Stephen Mussmann
Arnav M. Das
...
Yinglun Zhu
Jeffrey Bilmes
S. Du
Kevin Jamieson
Robert D. Nowak
VLM
100
12
0
16 Jun 2023
AvatarBooth: High-Quality and Customizable 3D Human Avatar Generation
AvatarBooth: High-Quality and Customizable 3D Human Avatar Generation
Yifei Zeng
Yuanxun Lu
Xinya Ji
Yao Yao
Hao Zhu
Xun Cao
DiffM
74
30
0
16 Jun 2023
Full Parameter Fine-tuning for Large Language Models with Limited
  Resources
Full Parameter Fine-tuning for Large Language Models with Limited Resources
Kai Lv
Yuqing Yang
Tengxiao Liu
Qi-jie Gao
Qipeng Guo
Xipeng Qiu
130
134
0
16 Jun 2023
Parameter-efficient is not sufficient: Exploring Parameter, Memory, and
  Time Efficient Adapter Tuning for Dense Predictions
Parameter-efficient is not sufficient: Exploring Parameter, Memory, and Time Efficient Adapter Tuning for Dense Predictions
Dongshuo Yin
Xueting Han
Bin Li
Hao Feng
Jinghua Bai
VPVLM
78
19
0
16 Jun 2023
Listener Model for the PhotoBook Referential Game with CLIPScores as
  Implicit Reference Chain
Listener Model for the PhotoBook Referential Game with CLIPScores as Implicit Reference Chain
Shih-Lun Wu
Yi-Hui Chou
Liang Li
61
0
0
16 Jun 2023
DreamSim: Learning New Dimensions of Human Visual Similarity using
  Synthetic Data
DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Data
Stephanie Fu
Netanel Y. Tamir
Shobhita Sundaram
Lucy Chai
Richard Y. Zhang
Tali Dekel
Phillip Isola
EGVM
100
123
0
15 Jun 2023
Conditional Human Sketch Synthesis with Explicit Abstraction Control
Conditional Human Sketch Synthesis with Explicit Abstraction Control
Da Chen
DiffM
63
0
0
15 Jun 2023
Domain-specific ChatBots for Science using Embeddings
Domain-specific ChatBots for Science using Embeddings
Kevin G. Yager
70
8
0
15 Jun 2023
PRISMA-DFLLM: An Extension of PRISMA for Systematic Literature Reviews
  using Domain-specific Finetuned Large Language Models
PRISMA-DFLLM: An Extension of PRISMA for Systematic Literature Reviews using Domain-specific Finetuned Large Language Models
Teo Susnjak
70
11
0
15 Jun 2023
Radiology-GPT: A Large Language Model for Radiology
Radiology-GPT: A Large Language Model for Radiology
Zheng Liu
Aoxiao Zhong
Yiwei Li
Longtao Yang
Chao Ju
...
Wen Liu
Dinggang Shen
Xiang Li
Quanzheng Li
Tianming Liu
LM&MAMedImAI4CE
143
60
0
14 Jun 2023
Babel-ImageNet: Massively Multilingual Evaluation of Vision-and-Language
  Representations
Babel-ImageNet: Massively Multilingual Evaluation of Vision-and-Language Representations
Gregor Geigle
Radu Timofte
Goran Glavaš
VLMMLLM
61
5
0
14 Jun 2023
PoetryDiffusion: Towards Joint Semantic and Metrical Manipulation in
  Poetry Generation
PoetryDiffusion: Towards Joint Semantic and Metrical Manipulation in Poetry Generation
Zhiyuan Hu
Chumin Liu
Yue Feng
Anh Tuan Luu
Bryan Hooi
DiffM
61
5
0
14 Jun 2023
ZeroForge: Feedforward Text-to-Shape Without 3D Supervision
ZeroForge: Feedforward Text-to-Shape Without 3D Supervision
Kelly O. Marshall
Minh Pham
Ameya Joshi
Anushrut Jignasu
Aditya Balu
Adarsh Krishnamurthy
A. Hegde
CLIP
60
3
0
14 Jun 2023
ArtWhisperer: A Dataset for Characterizing Human-AI Interactions in
  Artistic Creations
ArtWhisperer: A Dataset for Characterizing Human-AI Interactions in Artistic Creations
Kailas Vodrahalli
James Zou
59
7
0
13 Jun 2023
AutoML in the Age of Large Language Models: Current Challenges, Future
  Opportunities and Risks
AutoML in the Age of Large Language Models: Current Challenges, Future Opportunities and Risks
Alexander Tornede
Difan Deng
Theresa Eimer
Joseph Giovanelli
Aditya Mohan
...
Sarah Segel
Daphne Theodorakopoulos
Tanja Tornede
Henning Wachsmuth
Marius Lindauer
119
24
0
13 Jun 2023
One-for-All: Generalized LoRA for Parameter-Efficient Fine-tuning
One-for-All: Generalized LoRA for Parameter-Efficient Fine-tuning
Arnav Chavan
Zhuang Liu
D. K. Gupta
Eric P. Xing
Zhiqiang Shen
102
92
0
13 Jun 2023
Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translation
Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translation
Shuai Yang
Yifan Zhou
Ziwei Liu
Chen Change Loy
VGenDiffM
102
221
0
13 Jun 2023
Unlocking Foundation Models for Privacy-Enhancing Speech Understanding:
  An Early Study on Low Resource Speech Training Leveraging Label-guided
  Synthetic Speech Content
Unlocking Foundation Models for Privacy-Enhancing Speech Understanding: An Early Study on Low Resource Speech Training Leveraging Label-guided Synthetic Speech Content
Tiantian Feng
Digbalay Bose
Xuan Shi
Shrikanth Narayanan
60
1
0
13 Jun 2023
TART: A plug-and-play Transformer module for task-agnostic reasoning
TART: A plug-and-play Transformer module for task-agnostic reasoning
Kush S. Bhatia
A. Narayan
Chris De Sa
Christopher Ré
LRMReLMVLM
63
15
0
13 Jun 2023
Controlling Text-to-Image Diffusion by Orthogonal Finetuning
Controlling Text-to-Image Diffusion by Orthogonal Finetuning
Zeju Qiu
Wei-yu Liu
Haiwen Feng
Yuxuan Xue
Yao Feng
Zhen Liu
Dan Zhang
Adrian Weller
Bernhard Schölkopf
DiffM
126
158
0
12 Jun 2023
Scalable 3D Captioning with Pretrained Models
Scalable 3D Captioning with Pretrained Models
Tiange Luo
C. Rockwell
Honglak Lee
Justin Johnson
116
160
0
12 Jun 2023
Transformers learn through gradual rank increase
Transformers learn through gradual rank increase
Enric Boix-Adserà
Etai Littwin
Emmanuel Abbe
Samy Bengio
J. Susskind
102
37
0
12 Jun 2023
The BEA 2023 Shared Task on Generating AI Teacher Responses in
  Educational Dialogues
The BEA 2023 Shared Task on Generating AI Teacher Responses in Educational Dialogues
Anaïs Tack
E. Kochmar
Zheng Yuan
Serge Bibauw
Chris Piech
71
24
0
12 Jun 2023
VillanDiffusion: A Unified Backdoor Attack Framework for Diffusion
  Models
VillanDiffusion: A Unified Backdoor Attack Framework for Diffusion Models
Sheng-Yen Chou
Pin-Yu Chen
Tsung-Yi Ho
DiffM
104
56
0
12 Jun 2023
CoTran: An LLM-based Code Translator using Reinforcement Learning with
  Feedback from Compiler and Symbolic Execution
CoTran: An LLM-based Code Translator using Reinforcement Learning with Feedback from Compiler and Symbolic Execution
Prithwish Jana
Piyush Jha
Haoyang Ju
Gautham Kishore
Aryan Mahajan
Vijay Ganesh
99
14
0
11 Jun 2023
Language Versatilists vs. Specialists: An Empirical Revisiting on
  Multilingual Transfer Ability
Language Versatilists vs. Specialists: An Empirical Revisiting on Multilingual Transfer Ability
Jiacheng Ye
Xijia Tao
Lingpeng Kong
LRM
75
27
0
11 Jun 2023
LAMM: Language-Assisted Multi-Modal Instruction-Tuning Dataset,
  Framework, and Benchmark
LAMM: Language-Assisted Multi-Modal Instruction-Tuning Dataset, Framework, and Benchmark
Zhen-fei Yin
Jiong Wang
Jianjian Cao
Zhelun Shi
Dingning Liu
...
Lei Bai
Xiaoshui Huang
Zhiyong Wang
Jing Shao
Wanli Ouyang
MLLM
118
169
0
11 Jun 2023
Face0: Instantaneously Conditioning a Text-to-Image Model on a Face
Face0: Instantaneously Conditioning a Text-to-Image Model on a Face
Dani Valevski
Danny Lumen
Yossi Matias
Yaniv Leviathan
DiffMVLM
77
77
0
11 Jun 2023
AutoSAM: Adapting SAM to Medical Images by Overloading the Prompt
  Encoder
AutoSAM: Adapting SAM to Medical Images by Overloading the Prompt Encoder
Tal Shaharabany
Aviad Dahan
Raja Giryes
Lior Wolf
MedImVLM
73
73
0
10 Jun 2023
14 Examples of How LLMs Can Transform Materials Science and Chemistry: A
  Reflection on a Large Language Model Hackathon
14 Examples of How LLMs Can Transform Materials Science and Chemistry: A Reflection on a Large Language Model Hackathon
Kevin Maik Jablonka
Qianxiang Ai
Alexander H Al-Feghali
S. Badhwar
Joshua D. Bocarsly Andres M Bran
...
Aristana Scourtas
K. J. Schmidt
Ian Foster
Andrew D. White
Ben Blaiszik
168
111
0
09 Jun 2023
GANeRF: Leveraging Discriminators to Optimize Neural Radiance Fields
GANeRF: Leveraging Discriminators to Optimize Neural Radiance Fields
Barbara Roessle
Norman Muller
Lorenzo Porzi
Samuel Rota Buló
Peter Kontschieder
Matthias Nießner
77
19
0
09 Jun 2023
FinGPT: Open-Source Financial Large Language Models
FinGPT: Open-Source Financial Large Language Models
Hongyang Yang
Xiao-Yang Liu
Chris Wang
AIFin
90
230
0
09 Jun 2023
How Can Recommender Systems Benefit from Large Language Models: A Survey
How Can Recommender Systems Benefit from Large Language Models: A Survey
Jianghao Lin
Xinyi Dai
Yunjia Xi
Weiwen Liu
Bo Chen
...
Chenxu Zhu
Huifeng Guo
Yong Yu
Ruiming Tang
Weinan Zhang
LRM
187
224
0
09 Jun 2023
Xiezhi: An Ever-Updating Benchmark for Holistic Domain Knowledge
  Evaluation
Xiezhi: An Ever-Updating Benchmark for Holistic Domain Knowledge Evaluation
Zhouhong Gu
Xiaoxuan Zhu
Haoning Ye
Lin Zhang
Jianchen Wang
...
Zili Wang
Shusen Wang
Weiguo Zheng
Hongwei Feng
Yanghua Xiao
ALMELM
148
60
0
09 Jun 2023
Customizing General-Purpose Foundation Models for Medical Report
  Generation
Customizing General-Purpose Foundation Models for Medical Report Generation
Bang-ju Yang
Asif Raza
Yuexian Zou
Tong Zhang
MedIm
87
11
0
09 Jun 2023
Previous
123...126127128...137138139
Next