ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2106.09685
  4. Cited By
LoRA: Low-Rank Adaptation of Large Language Models
v1v2 (latest)

LoRA: Low-Rank Adaptation of Large Language Models

17 June 2021
J. E. Hu
Yelong Shen
Phillip Wallis
Zeyuan Allen-Zhu
Yuanzhi Li
Shean Wang
Lu Wang
Weizhu Chen
    OffRLAI4TSAI4CEALMAIMat
ArXiv (abs)PDFHTMLGithub (11998★)

Papers citing "LoRA: Low-Rank Adaptation of Large Language Models"

50 / 6,909 papers shown
Title
Generalized Few-Shot Continual Learning with Contrastive Mixture of
  Adapters
Generalized Few-Shot Continual Learning with Contrastive Mixture of Adapters
Yawen Cui
Zitong Yu
Rizhao Cai
Xuna Wang
Alex C. Kot
Li Liu
CLL
99
8
0
12 Feb 2023
Adding Conditional Control to Text-to-Image Diffusion Models
Adding Conditional Control to Text-to-Image Diffusion Models
Lvmin Zhang
Anyi Rao
Maneesh Agrawala
AI4CE
202
4,192
1
10 Feb 2023
Is This Loss Informative? Faster Text-to-Image Customization by Tracking
  Objective Dynamics
Is This Loss Informative? Faster Text-to-Image Customization by Tracking Objective Dynamics
Anton Voronov
Mikhail Khoroshikh
Artem Babenko
Max Ryabinin
71
6
0
09 Feb 2023
UDApter -- Efficient Domain Adaptation Using Adapters
UDApter -- Efficient Domain Adaptation Using Adapters
Bhavitvya Malik
Abhinav Ramesh Kashyap
MingSung Kan
Soujanya Poria
88
16
0
07 Feb 2023
AIM: Adapting Image Models for Efficient Video Action Recognition
AIM: Adapting Image Models for Efficient Video Action Recognition
Taojiannan Yang
Yi Zhu
Yusheng Xie
Aston Zhang
Chong Chen
Mu Li
ViT
146
157
0
06 Feb 2023
On the Efficacy of Differentially Private Few-shot Image Classification
On the Efficacy of Differentially Private Few-shot Image Classification
Marlon Tobaben
Aliaksandra Shysheya
J. Bronskill
Andrew Paverd
Shruti Tople
Santiago Zanella Béguelin
Richard Turner
Antti Honkela
96
12
0
02 Feb 2023
A Survey on Efficient Training of Transformers
A Survey on Efficient Training of Transformers
Bohan Zhuang
Jing Liu
Zizheng Pan
Haoyu He
Yuetian Weng
Chunhua Shen
128
49
0
02 Feb 2023
An Empirical Study on the Transferability of Transformer Modules in
  Parameter-Efficient Fine-Tuning
An Empirical Study on the Transferability of Transformer Modules in Parameter-Efficient Fine-Tuning
Mohammad AkbarTajari
S. Rajaee
Mohammad Taher Pilehvar
50
2
0
01 Feb 2023
FLAME: A small language model for spreadsheet formulas
FLAME: A small language model for spreadsheet formulas
Harshit Joshi
Abishai Ebenezer
J. Cambronero
Sumit Gulwani
Aditya Kanade
Vu Le
Ivan Radivcek
Gust Verbruggen
LMTD
90
13
0
31 Jan 2023
The Flan Collection: Designing Data and Methods for Effective
  Instruction Tuning
The Flan Collection: Designing Data and Methods for Effective Instruction Tuning
Shayne Longpre
Le Hou
Tu Vu
Albert Webson
Hyung Won Chung
...
Denny Zhou
Quoc V. Le
Barret Zoph
Jason W. Wei
Adam Roberts
ALM
122
678
0
31 Jan 2023
Differentiable Entailment for Parameter Efficient Few Shot Learning
Differentiable Entailment for Parameter Efficient Few Shot Learning
Ethan Kim
Jerry Yang
43
0
0
31 Jan 2023
Composer's Assistant: An Interactive Transformer for Multi-Track MIDI
  Infilling
Composer's Assistant: An Interactive Transformer for Multi-Track MIDI Infilling
Martin E. Malandro
63
7
0
29 Jan 2023
AutoPEFT: Automatic Configuration Search for Parameter-Efficient
  Fine-Tuning
AutoPEFT: Automatic Configuration Search for Parameter-Efficient Fine-Tuning
Han Zhou
Xingchen Wan
Ivan Vulić
Anna Korhonen
81
48
0
28 Jan 2023
Understanding INT4 Quantization for Transformer Models: Latency Speedup,
  Composability, and Failure Cases
Understanding INT4 Quantization for Transformer Models: Latency Speedup, Composability, and Failure Cases
Xiaoxia Wu
Cheng-rong Li
Reza Yazdani Aminabadi
Z. Yao
Yuxiong He
MQ
69
25
0
27 Jan 2023
Minimax Optimal Rate for Parameter Estimation in Multivariate Deviated
  Models
Minimax Optimal Rate for Parameter Estimation in Multivariate Deviated Models
Dat Do
Huy Nguyen
Khai Nguyen
Nhat Ho
53
4
0
27 Jan 2023
Probing Out-of-Distribution Robustness of Language Models with
  Parameter-Efficient Transfer Learning
Probing Out-of-Distribution Robustness of Language Models with Parameter-Efficient Transfer Learning
Hyunsoo Cho
Choonghyun Park
Junyeop Kim
Sungmin Cho
Kang Min Yoo
Sang-goo Lee
OODD
87
3
0
27 Jan 2023
Low-Rank Winograd Transformation for 3D Convolutional Neural Networks
Low-Rank Winograd Transformation for 3D Convolutional Neural Networks
Ziran Qin
Mingbao Lin
Weiyao Lin
3DPC
77
3
0
26 Jan 2023
BERT-ERC: Fine-tuning BERT is Enough for Emotion Recognition in
  Conversation
BERT-ERC: Fine-tuning BERT is Enough for Emotion Recognition in Conversation
Xiangyu Qin
Zhiyu Wu
J. Cui
Ting Zhang
Yanran Li
Jian Luan
Bin Wang
L. xilinx Wang
62
26
0
17 Jan 2023
Recommending Root-Cause and Mitigation Steps for Cloud Incidents using
  Large Language Models
Recommending Root-Cause and Mitigation Steps for Cloud Incidents using Large Language Models
Toufique Ahmed
Supriyo Ghosh
Chetan Bansal
Thomas Zimmermann
Xuchao Zhang
Saravan Rajmohan
AI4CE
77
58
0
10 Jan 2023
A Survey on Transformers in Reinforcement Learning
A Survey on Transformers in Reinforcement Learning
Wenzhe Li
Hao Luo
Zichuan Lin
Chongjie Zhang
Zongqing Lu
Deheng Ye
OffRLMUAI4CE
119
58
0
08 Jan 2023
ANNA: Abstractive Text-to-Image Synthesis with Filtered News Captions
ANNA: Abstractive Text-to-Image Synthesis with Filtered News Captions
Aashish Anantha Ramakrishnan
Sharon X. Huang
Dongwon Lee
108
6
0
05 Jan 2023
Parameter-Efficient Fine-Tuning Design Spaces
Parameter-Efficient Fine-Tuning Design Spaces
Jiaao Chen
Aston Zhang
Xingjian Shi
Mu Li
Alexander J. Smola
Diyi Yang
119
67
0
04 Jan 2023
Principled and Efficient Transfer Learning of Deep Models via Neural
  Collapse
Principled and Efficient Transfer Learning of Deep Models via Neural Collapse
Xiao Li
Sheng Liu
Jin-li Zhou
Xin Lu
C. Fernandez‐Granda
Zhihui Zhu
Q. Qu
AAML
97
20
0
23 Dec 2022
SPT: Semi-Parametric Prompt Tuning for Multitask Prompted Learning
SPT: Semi-Parametric Prompt Tuning for Multitask Prompted Learning
M Saiful Bari
Aston Zhang
Shuai Zheng
Xingjian Shi
Yi Zhu
Shafiq Joty
Mu Li
RALMVLMVPVLMLRM
92
5
0
21 Dec 2022
KronA: Parameter Efficient Tuning with Kronecker Adapter
KronA: Parameter Efficient Tuning with Kronecker Adapter
Ali Edalati
Marzieh S. Tahaei
I. Kobyzev
V. Nia
J. Clark
Mehdi Rezagholizadeh
98
104
0
20 Dec 2022
Evaluating Psychological Safety of Large Language Models
Evaluating Psychological Safety of Large Language Models
Xingxuan Li
Yutong Li
Linlin Liu
Shafiq Joty
Lidong Bing
LM&MA
93
24
0
20 Dec 2022
Mini-Model Adaptation: Efficiently Extending Pretrained Models to New
  Languages via Aligned Shallow Training
Mini-Model Adaptation: Efficiently Extending Pretrained Models to New Languages via Aligned Shallow Training
Kelly Marchisio
Patrick Lewis
Yihong Chen
Mikel Artetxe
78
19
0
20 Dec 2022
HINT: Hypernetwork Instruction Tuning for Efficient Zero- & Few-Shot
  Generalisation
HINT: Hypernetwork Instruction Tuning for Efficient Zero- & Few-Shot Generalisation
Hamish Ivison
Akshita Bhagia
Yizhong Wang
Hannaneh Hajishirzi
Matthew E. Peters
141
20
0
20 Dec 2022
Large Language Models Are Reasoning Teachers
Large Language Models Are Reasoning Teachers
Namgyu Ho
Laura Schmid
Se-Young Yun
ReLMELMLRM
128
351
0
20 Dec 2022
When Federated Learning Meets Pre-trained Language Models'
  Parameter-Efficient Tuning Methods
When Federated Learning Meets Pre-trained Language Models' Parameter-Efficient Tuning Methods
Zhuo Zhang
Yuanhang Yang
Yong Dai
Zhuang Li
Zenglin Xu
FedML
124
85
0
20 Dec 2022
BLOOM+1: Adding Language Support to BLOOM for Zero-Shot Prompting
BLOOM+1: Adding Language Support to BLOOM for Zero-Shot Prompting
Zheng-Xin Yong
Hailey Schoelkopf
Niklas Muennighoff
Alham Fikri Aji
David Ifeoluwa Adelani
...
Genta Indra Winata
Stella Biderman
Edward Raff
Dragomir R. Radev
Vassilina Nikoulina
CLLVLMAI4CELRM
147
89
0
19 Dec 2022
An Extensible Plug-and-Play Method for Multi-Aspect Controllable Text
  Generation
An Extensible Plug-and-Play Method for Multi-Aspect Controllable Text Generation
Xuancheng Huang
Zijun Liu
Peng Li
Tao Li
Maosong Sun
Yang Liu
95
10
0
19 Dec 2022
Decoder Tuning: Efficient Language Understanding as Decoding
Decoder Tuning: Efficient Language Understanding as Decoding
Ganqu Cui
Wentao Li
Ning Ding
Longtao Huang
Zhiyuan Liu
Maosong Sun
78
6
0
16 Dec 2022
Vision Transformers are Parameter-Efficient Audio-Visual Learners
Vision Transformers are Parameter-Efficient Audio-Visual Learners
Yan-Bo Lin
Yi-Lin Sung
Jie Lei
Joey Tianyi Zhou
Gedas Bertasius
108
78
0
15 Dec 2022
Position: Considerations for Differentially Private Learning with
  Large-Scale Public Pretraining
Position: Considerations for Differentially Private Learning with Large-Scale Public Pretraining
Florian Tramèr
Gautam Kamath
Nicholas Carlini
SILM
129
72
0
13 Dec 2022
Towards Practical Plug-and-Play Diffusion Models
Towards Practical Plug-and-Play Diffusion Models
Hyojun Go
Yunsung Lee
Jin-Young Kim
Seunghyun Lee
Myeongho Jeong
Hyun Seung Lee
Seungtaek Choi
DiffM
119
17
0
12 Dec 2022
Parameter-Efficient Finetuning of Transformers for Source Code
Parameter-Efficient Finetuning of Transformers for Source Code
Shamil Ayupov
Nadezhda Chirkova
29
18
0
12 Dec 2022
Searching for Effective Multilingual Fine-Tuning Methods: A Case Study
  in Summarization
Searching for Effective Multilingual Fine-Tuning Methods: A Case Study in Summarization
Yiwei Qin
Graham Neubig
Pengfei Liu
67
3
0
12 Dec 2022
Multi-Concept Customization of Text-to-Image Diffusion
Multi-Concept Customization of Text-to-Image Diffusion
Nupur Kumari
Bin Zhang
Richard Y. Zhang
Eli Shechtman
Jun-Yan Zhu
215
877
0
08 Dec 2022
FacT: Factor-Tuning for Lightweight Adaptation on Vision Transformer
FacT: Factor-Tuning for Lightweight Adaptation on Vision Transformer
Shibo Jie
Zhi-Hong Deng
80
137
0
06 Dec 2022
Exploring the Limits of Differentially Private Deep Learning with
  Group-wise Clipping
Exploring the Limits of Differentially Private Deep Learning with Group-wise Clipping
Jiyan He
Xuechen Li
Da Yu
Huishuai Zhang
Janardhan Kulkarni
Y. Lee
A. Backurs
Nenghai Yu
Jiang Bian
118
49
0
03 Dec 2022
SumREN: Summarizing Reported Speech about Events in News
SumREN: Summarizing Reported Speech about Events in News
R. Reddy
Heba Elfardy
Hou Pong Chan
Kevin Small
Chenhui Xu
58
5
0
02 Dec 2022
Systematic Analysis for Pretrained Language Model Priming for
  Parameter-Efficient Fine-tuning
Systematic Analysis for Pretrained Language Model Priming for Parameter-Efficient Fine-tuning
Shih-Cheng Huang
Shi Wang
Min-Han Shih
Saurav Sahay
Hung-yi Lee
91
0
0
02 Dec 2022
Data-Efficient Finetuning Using Cross-Task Nearest Neighbors
Data-Efficient Finetuning Using Cross-Task Nearest Neighbors
Hamish Ivison
Noah A. Smith
Hannaneh Hajishirzi
Pradeep Dasigi
120
22
0
01 Dec 2022
Learning Label Modular Prompts for Text Classification in the Wild
Learning Label Modular Prompts for Text Classification in the Wild
Hailin Chen
Amrita Saha
Shafiq Joty
Steven C. H. Hoi
OODVLM
69
5
0
30 Nov 2022
Soft Alignment Objectives for Robust Adaptation of Language Generation
Soft Alignment Objectives for Robust Adaptation of Language Generation
Michal vStefánik
Marek Kadlcík
Petr Sojka
77
2
0
29 Nov 2022
On the Effectiveness of Parameter-Efficient Fine-Tuning
On the Effectiveness of Parameter-Efficient Fine-Tuning
Z. Fu
Haoran Yang
Anthony Man-Cho So
Wai Lam
Lidong Bing
Nigel Collier
76
162
0
28 Nov 2022
A Comprehensive Survey on Enterprise Financial Risk Analysis from Big Data Perspective
A Comprehensive Survey on Enterprise Financial Risk Analysis from Big Data Perspective
Yu Zhao
Huaming Du
Qing Li
Fuzhen Zhuang
Ji Liu
Gang Kou
Gang Kou
155
1
0
28 Nov 2022
Self-Destructing Models: Increasing the Costs of Harmful Dual Uses of
  Foundation Models
Self-Destructing Models: Increasing the Costs of Harmful Dual Uses of Foundation Models
Peter Henderson
E. Mitchell
Christopher D. Manning
Dan Jurafsky
Chelsea Finn
94
54
0
27 Nov 2022
MAEDAY: MAE for few and zero shot AnomalY-Detection
MAEDAY: MAE for few and zero shot AnomalY-Detection
Eli Schwartz
Assaf Arbelle
Leonid Karlinsky
Sivan Harary
Florian Scheidegger
Sivan Doveh
Raja Giryes
ViTUQCV
83
36
0
25 Nov 2022
Previous
123...134135136137138139
Next