ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2106.09685
  4. Cited By
LoRA: Low-Rank Adaptation of Large Language Models
v1v2 (latest)

LoRA: Low-Rank Adaptation of Large Language Models

17 June 2021
J. E. Hu
Yelong Shen
Phillip Wallis
Zeyuan Allen-Zhu
Yuanzhi Li
Shean Wang
Lu Wang
Weizhu Chen
    OffRLAI4TSAI4CEALMAIMat
ArXiv (abs)PDFHTMLGithub (11998★)

Papers citing "LoRA: Low-Rank Adaptation of Large Language Models"

50 / 6,910 papers shown
Title
Eight Methods to Evaluate Robust Unlearning in LLMs
Eight Methods to Evaluate Robust Unlearning in LLMs
Aengus Lynch
Phillip Guo
Aidan Ewart
Stephen Casper
Dylan Hadfield-Menell
ELMMU
132
82
0
26 Feb 2024
ConSept: Continual Semantic Segmentation via Adapter-based Vision
  Transformer
ConSept: Continual Semantic Segmentation via Adapter-based Vision Transformer
Bowen Dong
Guanglei Yang
W. Zuo
Lei Zhang
93
1
0
26 Feb 2024
UN-SAM: Universal Prompt-Free Segmentation for Generalized Nuclei Images
UN-SAM: Universal Prompt-Free Segmentation for Generalized Nuclei Images
Zhen Chen
Qing Xu
Xinyu Liu
Yixuan Yuan
MedIm
95
17
0
26 Feb 2024
LangGPT: Rethinking Structured Reusable Prompt Design Framework for LLMs
  from the Programming Language
LangGPT: Rethinking Structured Reusable Prompt Design Framework for LLMs from the Programming Language
Ming Wang
Yuanzhong Liu
Xiaoyu Liang
Songlian Li
Yijie Huang
...
Shi Feng
Chi Zhang
Yifei Zhang
Minghui Zheng
Jigang Li
135
15
0
26 Feb 2024
Aligning Large Language Models to a Domain-specific Graph Database
Aligning Large Language Models to a Domain-specific Graph Database
Yuanyuan Liang
Keren Tan
Tingyu Xie
Wenbiao Tao
Siyuan Wang
Yunshi Lan
Weining Qian
95
8
0
26 Feb 2024
Integrating Large Language Models with Graphical Session-Based
  Recommendation
Integrating Large Language Models with Graphical Session-Based Recommendation
Naicheng Guo
Hongwei Cheng
Qianqiao Liang
Lin Chen
Bing Han
97
5
0
26 Feb 2024
Immunization against harmful fine-tuning attacks
Immunization against harmful fine-tuning attacks
Domenic Rosati
Jan Wehner
Kai Williams
Lukasz Bartoszcze
Jan Batzner
Hassan Sajjad
Frank Rudzicz
AAML
109
22
0
26 Feb 2024
LLM Inference Unveiled: Survey and Roofline Model Insights
LLM Inference Unveiled: Survey and Roofline Model Insights
Zhihang Yuan
Yuzhang Shang
Yang Zhou
Zhen Dong
Zhe Zhou
...
Yong Jae Lee
Yan Yan
Beidi Chen
Guangyu Sun
Kurt Keutzer
240
91
0
26 Feb 2024
Feedback Efficient Online Fine-Tuning of Diffusion Models
Feedback Efficient Online Fine-Tuning of Diffusion Models
Masatoshi Uehara
Yulai Zhao
Kevin Black
Ehsan Hajiramezanali
Gabriele Scalia
N. Diamant
Alex Tseng
Sergey Levine
Tommaso Biancalani
121
28
0
26 Feb 2024
Personalized Federated Instruction Tuning via Neural Architecture Search
Personalized Federated Instruction Tuning via Neural Architecture Search
Peng Zhang
Yingbo Zhou
Ming Hu
Junxian Feng
Jiawen Weng
Mingsong Chen
FedML
79
5
0
26 Feb 2024
QASE Enhanced PLMs: Improved Control in Text Generation for MRC
QASE Enhanced PLMs: Improved Control in Text Generation for MRC
Lin Ai
Zheng Hui
Zizhou Liu
Julia Hirschberg
58
0
0
26 Feb 2024
m2mKD: Module-to-Module Knowledge Distillation for Modular Transformers
m2mKD: Module-to-Module Knowledge Distillation for Modular Transformers
Ka Man Lo
Yiming Liang
Wenyu Du
Yuantao Fan
Zili Wang
Wenhao Huang
Lei Ma
Jie Fu
MoE
105
2
0
26 Feb 2024
GenAINet: Enabling Wireless Collective Intelligence via Knowledge Transfer and Reasoning
GenAINet: Enabling Wireless Collective Intelligence via Knowledge Transfer and Reasoning
Han Zou
Qiyang Zhao
Lina Bariah
Yu Tian
M. Bennis
S. Lasaulce
158
14
0
26 Feb 2024
One-stage Prompt-based Continual Learning
One-stage Prompt-based Continual Learning
Youngeun Kim
Yuhang Li
Priyadarshini Panda
VLMCLL
82
7
0
25 Feb 2024
ChatMusician: Understanding and Generating Music Intrinsically with LLM
ChatMusician: Understanding and Generating Music Intrinsically with LLM
Ti-Fen Pan
Hanfeng Lin
Yi Wang
Zeyue Tian
Shangda Wu
...
Gus Xia
Roger Dannenberg
Wei Xue
Shiyin Kang
Yike Guo
176
44
0
25 Feb 2024
PeriodicLoRA: Breaking the Low-Rank Bottleneck in LoRA Optimization
PeriodicLoRA: Breaking the Low-Rank Bottleneck in LoRA Optimization
Xiangdi Meng
Damai Dai
Weiyao Luo
Zhe Yang
Shaoxiang Wu
Xiaochen Wang
Peiyi Wang
Qingxiu Dong
Liang Chen
Zhifang Sui
170
13
0
25 Feb 2024
InstructEdit: Instruction-based Knowledge Editing for Large Language
  Models
InstructEdit: Instruction-based Knowledge Editing for Large Language Models
Ningyu Zhang
Bo Tian
Siyuan Cheng
Xiaozhuan Liang
Yi Hu
Kouying Xue
Yanjie Gou
Xi Chen
Huajun Chen
KELM
97
5
0
25 Feb 2024
StochCA: A Novel Approach for Exploiting Pretrained Models with
  Cross-Attention
StochCA: A Novel Approach for Exploiting Pretrained Models with Cross-Attention
SeungWon Seo
Suho Lee
Sangheum Hwang
83
0
0
25 Feb 2024
LoRA Meets Dropout under a Unified Framework
LoRA Meets Dropout under a Unified Framework
Sheng Wang
Liheng Chen
Jiyue Jiang
Boyang Xue
Lingpeng Kong
Chuan Wu
79
17
0
25 Feb 2024
Multimodal Instruction Tuning with Conditional Mixture of LoRA
Multimodal Instruction Tuning with Conditional Mixture of LoRA
Ying Shen
Zhiyang Xu
Qifan Wang
Yu Cheng
Wenpeng Yin
Lifu Huang
82
20
0
24 Feb 2024
SemEval-2024 Task 8: Weighted Layer Averaging RoBERTa for Black-Box
  Machine-Generated Text Detection
SemEval-2024 Task 8: Weighted Layer Averaging RoBERTa for Black-Box Machine-Generated Text Detection
Ayan Datta
Aryan Chandramania
Radhika Mamidi
DeLMO
27
1
0
24 Feb 2024
PRoLoRA: Partial Rotation Empowers More Parameter-Efficient LoRA
PRoLoRA: Partial Rotation Empowers More Parameter-Efficient LoRA
Sheng Wang
Boyang Xue
Jiacheng Ye
Jiyue Jiang
Liheng Chen
Lingpeng Kong
Chuan Wu
92
15
0
24 Feb 2024
Addressing Order Sensitivity of In-Context Demonstration Examples in
  Causal Language Models
Addressing Order Sensitivity of In-Context Demonstration Examples in Causal Language Models
Yanzheng Xiang
Hanqi Yan
Lin Gui
Yulan He
68
9
0
23 Feb 2024
MegaScale: Scaling Large Language Model Training to More Than 10,000
  GPUs
MegaScale: Scaling Large Language Model Training to More Than 10,000 GPUs
Ziheng Jiang
Yanghua Peng
Yinmin Zhong
Qi Huang
Yangrui Chen
...
Zhe Li
X. Jia
Jia-jun Ye
Xin Jin
Xin Liu
LRM
126
124
0
23 Feb 2024
Language-Based User Profiles for Recommendation
Language-Based User Profiles for Recommendation
Joyce Zhou
Yijia Dai
Thorsten Joachims
74
9
0
23 Feb 2024
A Data-Centric Approach To Generate Faithful and High Quality Patient
  Summaries with Large Language Models
A Data-Centric Approach To Generate Faithful and High Quality Patient Summaries with Large Language Models
S. Hegselmann
Zejiang Shen
Florian Gierse
Monica Agrawal
David Sontag
Xiaoyi Jiang
HILMVLM
98
6
0
23 Feb 2024
AutoMMLab: Automatically Generating Deployable Models from Language
  Instructions for Computer Vision Tasks
AutoMMLab: Automatically Generating Deployable Models from Language Instructions for Computer Vision Tasks
Zekang Yang
Wang Zeng
Sheng Jin
Chao Qian
Ping Luo
Wentao Liu
MLLMVLM
106
10
0
23 Feb 2024
Chitchat as Interference: Adding User Backstories to Task-Oriented
  Dialogues
Chitchat as Interference: Adding User Backstories to Task-Oriented Dialogues
Armand Stricker
P. Paroubek
81
4
0
23 Feb 2024
Fine-Tuning of Continuous-Time Diffusion Models as Entropy-Regularized
  Control
Fine-Tuning of Continuous-Time Diffusion Models as Entropy-Regularized Control
Masatoshi Uehara
Yulai Zhao
Kevin Black
Ehsan Hajiramezanali
Gabriele Scalia
N. Diamant
Alex Tseng
Tommaso Biancalani
Sergey Levine
94
52
0
23 Feb 2024
Advancing Parameter Efficiency in Fine-tuning via Representation Editing
Advancing Parameter Efficiency in Fine-tuning via Representation Editing
Muling Wu
Tianlong Li
Xiaohua Wang
Changze Lv
Changze Lv
Zixuan Ling
Jianhao Zhu
Cenyuan Zhang
Xiaoqing Zheng
Xuanjing Huang
81
25
0
23 Feb 2024
PEMT: Multi-Task Correlation Guided Mixture-of-Experts Enables
  Parameter-Efficient Transfer Learning
PEMT: Multi-Task Correlation Guided Mixture-of-Experts Enables Parameter-Efficient Transfer Learning
Zhisheng Lin
Han Fu
Chenghao Liu
Zhuo Li
Jianling Sun
MoEMoMe
67
6
0
23 Feb 2024
Fine-tuning Large Language Models for Domain-specific Machine
  Translation
Fine-tuning Large Language Models for Domain-specific Machine Translation
Jiawei Zheng
Hanghai Hong
Xiaoli Wang
Jingsong Su
Yonggui Liang
Shikai Wu
ALM
69
41
0
23 Feb 2024
KIEval: A Knowledge-grounded Interactive Evaluation Framework for Large
  Language Models
KIEval: A Knowledge-grounded Interactive Evaluation Framework for Large Language Models
Zhuohao Yu
Chang Gao
Wenjin Yao
Yidong Wang
Wei Ye
Jindong Wang
Xing Xie
Yue Zhang
Shikun Zhang
90
28
0
23 Feb 2024
Second-Order Fine-Tuning without Pain for LLMs:A Hessian Informed Zeroth-Order Optimizer
Second-Order Fine-Tuning without Pain for LLMs:A Hessian Informed Zeroth-Order Optimizer
Yanjun Zhao
Sizhe Dang
Haishan Ye
Guang Dai
Yi Qian
Ivor W.Tsang
177
13
0
23 Feb 2024
opp/ai: Optimistic Privacy-Preserving AI on Blockchain
opp/ai: Optimistic Privacy-Preserving AI on Blockchain
Cathie So
KD Conway
Xiaohang Yu
Suning Yao
Kartin Wong
55
3
0
22 Feb 2024
CommVQA: Situating Visual Question Answering in Communicative Contexts
CommVQA: Situating Visual Question Answering in Communicative Contexts
N. Naik
Christopher Potts
Elisa Kreiss
CoGe
39
0
0
22 Feb 2024
Mitigating Fine-tuning based Jailbreak Attack with Backdoor Enhanced
  Safety Alignment
Mitigating Fine-tuning based Jailbreak Attack with Backdoor Enhanced Safety Alignment
Jiong Wang
Jiazhao Li
Yiquan Li
Xiangyu Qi
Junjie Hu
Yixuan Li
P. McDaniel
Muhao Chen
Bo Li
Chaowei Xiao
AAMLSILM
113
22
0
22 Feb 2024
PALO: A Polyglot Large Multimodal Model for 5B People
PALO: A Polyglot Large Multimodal Model for 5B People
Muhammad Maaz
H. Rasheed
Abdelrahman M. Shaker
Salman Khan
Hisham Cholakal
Rao M. Anwer
Timothy Baldwin
Michael Felsberg
Fahad S. Khan
VLMLRM
151
15
0
22 Feb 2024
Identifying Multiple Personalities in Large Language Models with
  External Evaluation
Identifying Multiple Personalities in Large Language Models with External Evaluation
Xiaoyang Song
Yuta Adachi
Jessie Feng
Mouwei Lin
Linhao Yu
Frank Li
Akshat Gupta
Gopala Anumanchipalli
Simerjot Kaur
LLMAG
88
8
0
22 Feb 2024
Consolidating Attention Features for Multi-view Image Editing
Consolidating Attention Features for Multi-view Image Editing
Or Patashnik
Rinon Gal
Daniel Cohen-Or
Jun-Yan Zhu
Fernando de la Torre
73
6
0
22 Feb 2024
Customize-A-Video: One-Shot Motion Customization of Text-to-Video
  Diffusion Models
Customize-A-Video: One-Shot Motion Customization of Text-to-Video Diffusion Models
Yixuan Ren
Yang Zhou
Jimei Yang
Jing Shi
Difan Liu
Feng Liu
Mingi Kwon
Abhinav Shrivastava
DiffMVGen
145
37
0
22 Feb 2024
Prompting a Pretrained Transformer Can Be a Universal Approximator
Prompting a Pretrained Transformer Can Be a Universal Approximator
Aleksandar Petrov
Philip Torr
Adel Bibi
74
12
0
22 Feb 2024
Two-stage Cytopathological Image Synthesis for Augmenting Cervical
  Abnormality Screening
Two-stage Cytopathological Image Synthesis for Augmenting Cervical Abnormality Screening
Zhenrong Shen
Manman Fei
Xin Wang
Jiangdong Cai
Sheng Wang
Lichi Zhang
Qian Wang
MedIm
121
0
0
22 Feb 2024
Q-Probe: A Lightweight Approach to Reward Maximization for Language
  Models
Q-Probe: A Lightweight Approach to Reward Maximization for Language Models
Kenneth Li
Samy Jelassi
Hugh Zhang
Sham Kakade
Martin Wattenberg
David Brandfonbrener
138
11
0
22 Feb 2024
CoLoRA: Continuous low-rank adaptation for reduced implicit neural
  modeling of parameterized partial differential equations
CoLoRA: Continuous low-rank adaptation for reduced implicit neural modeling of parameterized partial differential equations
Jules Berman
Benjamin Peherstorfer
91
10
0
22 Feb 2024
Towards Seamless Adaptation of Pre-trained Models for Visual Place
  Recognition
Towards Seamless Adaptation of Pre-trained Models for Visual Place Recognition
Feng Lu
Lijun Zhang
Xiangyuan Lan
Shuting Dong
Yaowei Wang
Chun Yuan
114
34
0
22 Feb 2024
Towards Robust Instruction Tuning on Multimodal Large Language Models
Towards Robust Instruction Tuning on Multimodal Large Language Models
Wei Han
Hui Chen
Soujanya Poria
MLLM
80
1
0
22 Feb 2024
Cost-Efficient Subjective Task Annotation and Modeling through Few-Shot
  Annotator Adaptation
Cost-Efficient Subjective Task Annotation and Modeling through Few-Shot Annotator Adaptation
Preni Golazizian
Ali Omrani
Alireza S. Ziabari
Morteza Dehghani
49
1
0
21 Feb 2024
Real-time 3D-aware Portrait Editing from a Single Image
Real-time 3D-aware Portrait Editing from a Single Image
Qingyan Bai
Zifan Shi
Yinghao Xu
Hao Ouyang
Qiuyu Wang
Ceyuan Yang
Xuan Wang
Gordon Wetzstein
Yujun Shen
Qifeng Chen
3DHDiffM
122
10
0
21 Feb 2024
Towards Building Multilingual Language Model for Medicine
Towards Building Multilingual Language Model for Medicine
Pengcheng Qiu
Chaoyi Wu
Xiaoman Zhang
Weixiong Lin
Haicheng Wang
Ya Zhang
Yanfeng Wang
Weidi Xie
LM&MAELM
124
90
0
21 Feb 2024
Previous
123...959697...137138139
Next