ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2106.09685
  4. Cited By
LoRA: Low-Rank Adaptation of Large Language Models
v1v2 (latest)

LoRA: Low-Rank Adaptation of Large Language Models

17 June 2021
J. E. Hu
Yelong Shen
Phillip Wallis
Zeyuan Allen-Zhu
Yuanzhi Li
Shean Wang
Lu Wang
Weizhu Chen
    OffRLAI4TSAI4CEALMAIMat
ArXiv (abs)PDFHTMLGithub (11998★)

Papers citing "LoRA: Low-Rank Adaptation of Large Language Models"

50 / 6,910 papers shown
Title
Learning to Learn Faster from Human Feedback with Language Model
  Predictive Control
Learning to Learn Faster from Human Feedback with Language Model Predictive Control
Jacky Liang
Fei Xia
Wenhao Yu
Andy Zeng
Montse Gonzalez Arenas
...
N. Heess
Kanishka Rao
Nik Stewart
Jie Tan
Carolina Parada
LM&Ro
127
35
0
18 Feb 2024
Can LLMs Reason with Rules? Logic Scaffolding for Stress-Testing and
  Improving LLMs
Can LLMs Reason with Rules? Logic Scaffolding for Stress-Testing and Improving LLMs
Siyuan Wang
Zhongyu Wei
Yejin Choi
Xiang Ren
ReLMELMLRM
45
24
0
18 Feb 2024
InfuserKI: Enhancing Large Language Models with Knowledge Graphs via
  Infuser-Guided Knowledge Integration
InfuserKI: Enhancing Large Language Models with Knowledge Graphs via Infuser-Guided Knowledge Integration
Fali Wang
Runxue Bao
Suhang Wang
Wenchao Yu
Yanchi Liu
Wei Cheng
Haifeng Chen
KELM
75
13
0
18 Feb 2024
LoRETTA: Low-Rank Economic Tensor-Train Adaptation for
  Ultra-Low-Parameter Fine-Tuning of Large Language Models
LoRETTA: Low-Rank Economic Tensor-Train Adaptation for Ultra-Low-Parameter Fine-Tuning of Large Language Models
Yifan Yang
Jiajun Zhou
Ngai Wong
Zheng Zhang
75
8
0
18 Feb 2024
Visual Concept-driven Image Generation with Text-to-Image Diffusion Model
Visual Concept-driven Image Generation with Text-to-Image Diffusion Model
Tanzila Rahman
Shweta Mahajan
Hsin-Ying Lee
Jian Ren
Sergey Tulyakov
Leonid Sigal
167
4
0
18 Feb 2024
EVEDIT: Event-based Knowledge Editing with Deductive Editing Boundaries
EVEDIT: Event-based Knowledge Editing with Deductive Editing Boundaries
Jiateng Liu
Pengfei Yu
Yuji Zhang
Sha Li
Zixuan Zhang
Heng Ji
KELM
84
17
0
17 Feb 2024
MoRAL: MoE Augmented LoRA for LLMs' Lifelong Learning
MoRAL: MoE Augmented LoRA for LLMs' Lifelong Learning
Shu Yang
Muhammad Asif Ali
Cheng-Long Wang
Lijie Hu
Di Wang
CLLMoE
114
46
0
17 Feb 2024
Aligning Large Language Models by On-Policy Self-Judgment
Aligning Large Language Models by On-Policy Self-Judgment
Sangkyu Lee
Sungdong Kim
Ashkan Yousefpour
Minjoon Seo
Kang Min Yoo
Youngjae Yu
OSLM
75
12
0
17 Feb 2024
LLM can Achieve Self-Regulation via Hyperparameter Aware Generation
LLM can Achieve Self-Regulation via Hyperparameter Aware Generation
Siyin Wang
Shimin Li
Tianxiang Sun
Jinlan Fu
Qinyuan Cheng
Jiasheng Ye
Junjie Ye
Xipeng Qiu
Xuanjing Huang
71
6
0
17 Feb 2024
CoLLaVO: Crayon Large Language and Vision mOdel
CoLLaVO: Crayon Large Language and Vision mOdel
Byung-Kwan Lee
Beomchan Park
Chae Won Kim
Yonghyun Ro
VLMMLLM
117
18
0
17 Feb 2024
ZeroG: Investigating Cross-dataset Zero-shot Transferability in Graphs
ZeroG: Investigating Cross-dataset Zero-shot Transferability in Graphs
Yuhan Li
Peisong Wang
Zhixun Li
Jeffrey Xu Yu
Jia Li
99
47
0
17 Feb 2024
I Learn Better If You Speak My Language: Understanding the Superior
  Performance of Fine-Tuning Large Language Models with LLM-Generated Responses
I Learn Better If You Speak My Language: Understanding the Superior Performance of Fine-Tuning Large Language Models with LLM-Generated Responses
Xuan Ren
Biao Wu
Lingqiao Liu
73
6
0
17 Feb 2024
Instruction Diversity Drives Generalization To Unseen Tasks
Instruction Diversity Drives Generalization To Unseen Tasks
Dylan Zhang
Justin Wang
Francois Charton
ALM
63
6
0
16 Feb 2024
An Empirical Study on Cross-lingual Vocabulary Adaptation for Efficient
  Language Model Inference
An Empirical Study on Cross-lingual Vocabulary Adaptation for Efficient Language Model Inference
Atsuki Yamaguchi
Aline Villavicencio
Nikolaos Aletras
77
11
0
16 Feb 2024
Towards Uncovering How Large Language Model Works: An Explainability
  Perspective
Towards Uncovering How Large Language Model Works: An Explainability Perspective
Haiyan Zhao
Fan Yang
Bo Shen
Himabindu Lakkaraju
Jundong Li
91
13
0
16 Feb 2024
AbsInstruct: Eliciting Abstraction Ability from LLMs through Explanation
  Tuning with Plausibility Estimation
AbsInstruct: Eliciting Abstraction Ability from LLMs through Explanation Tuning with Plausibility Estimation
Zhaowei Wang
Wei Fan
Qing Zong
Hongming Zhang
Sehyun Choi
Tianqing Fang
Xin Liu
Yangqiu Song
Ginny Wong
Simon See
96
14
0
16 Feb 2024
Speaking in Wavelet Domain: A Simple and Efficient Approach to Speed up
  Speech Diffusion Model
Speaking in Wavelet Domain: A Simple and Efficient Approach to Speed up Speech Diffusion Model
Xiangyu Zhang
Daijiao Liu
Hexin Liu
Qiquan Zhang
Hanyu Meng
Leibny Paola García
Chng Eng Siong
Lina Yao
DiffM
78
4
0
16 Feb 2024
Efficiency at Scale: Investigating the Performance of Diminutive
  Language Models in Clinical Tasks
Efficiency at Scale: Investigating the Performance of Diminutive Language Models in Clinical Tasks
Niall Taylor
U. Ghose
Omid Rohanian
Mohammadmahdi Nouriborji
Andrey Kormilitzin
David Clifton
A. Nevado-Holgado
LM&MAALM
74
6
0
16 Feb 2024
InSaAF: Incorporating Safety through Accuracy and Fairness | Are LLMs
  ready for the Indian Legal Domain?
InSaAF: Incorporating Safety through Accuracy and Fairness | Are LLMs ready for the Indian Legal Domain?
Yogesh Tripathi
Raghav Donakanti
Sahil Girhepuje
Ishan Kavathekar
Bhaskara Hanuma Vedula
Gokul S Krishnan
Shreya Goyal
Anmol Goel
Balaraman Ravindran
Ponnurangam Kumaraguru
ALMAILawELM
72
2
0
16 Feb 2024
Make a Cheap Scaling: A Self-Cascade Diffusion Model for
  Higher-Resolution Adaptation
Make a Cheap Scaling: A Self-Cascade Diffusion Model for Higher-Resolution Adaptation
Lanqing Guo
Yin-Yin He
Haoxin Chen
Menghan Xia
Xiaodong Cun
...
Yong Zhang
Xintao Wang
Qifeng Chen
Ying Shan
Bihan Wen
81
30
0
16 Feb 2024
Large Language Models as Zero-shot Dialogue State Tracker through
  Function Calling
Large Language Models as Zero-shot Dialogue State Tracker through Function Calling
Zekun Li
Zhiyu Zoey Chen
Mike Ross
Patrick Huber
Seungwhan Moon
Zhaojiang Lin
Xin Luna Dong
Adithya Sagar
Xifeng Yan
Paul A. Crook
120
25
0
16 Feb 2024
QDyLoRA: Quantized Dynamic Low-Rank Adaptation for Efficient Large
  Language Model Tuning
QDyLoRA: Quantized Dynamic Low-Rank Adaptation for Efficient Large Language Model Tuning
Hossein Rajabzadeh
Mojtaba Valipour
Tianshu Zhu
Marzieh S. Tahaei
Hyock Ju Kwon
Ali Ghodsi
Boxing Chen
Mehdi Rezagholizadeh
67
10
0
16 Feb 2024
FinTral: A Family of GPT-4 Level Multimodal Financial Large Language
  Models
FinTral: A Family of GPT-4 Level Multimodal Financial Large Language Models
Gagan Bhatia
El Moatez Billah Nagoudi
Hasan Cavusoglu
Muhammad Abdul-Mageed
AIFin
102
26
0
16 Feb 2024
Steering Conversational Large Language Models for Long Emotional Support
  Conversations
Steering Conversational Large Language Models for Long Emotional Support Conversations
Navid Madani
Sougata Saha
Rohini Srihari
83
5
0
16 Feb 2024
DataDreamer: A Tool for Synthetic Data Generation and Reproducible LLM
  Workflows
DataDreamer: A Tool for Synthetic Data Generation and Reproducible LLM Workflows
Ajay Patel
Colin Raffel
Chris Callison-Burch
SyDaAI4CE
77
27
0
16 Feb 2024
Squat: Quant Small Language Models on the Edge
Squat: Quant Small Language Models on the Edge
Xuan Shen
Zhenglun Kong
Zhenglun Kong
Zhaoyang Han
Changdi Yang
...
Lei Lu
Cheng Lyu
Zhihao Shu
Wei Niu
Miriam Leeser
MQ
131
22
0
16 Feb 2024
Prompt-Based Bias Calibration for Better Zero/Few-Shot Learning of
  Language Models
Prompt-Based Bias Calibration for Better Zero/Few-Shot Learning of Language Models
Kang He
Yinghan Long
Kaushik Roy
121
2
0
15 Feb 2024
Recovering the Pre-Fine-Tuning Weights of Generative Models
Recovering the Pre-Fine-Tuning Weights of Generative Models
Eliahu Horwitz
Jonathan Kahana
Yedid Hoshen
81
12
0
15 Feb 2024
BitDelta: Your Fine-Tune May Only Be Worth One Bit
BitDelta: Your Fine-Tune May Only Be Worth One Bit
James Liu
Guangxuan Xiao
Kai Li
Jason D. Lee
Song Han
Tri Dao
Tianle Cai
75
26
0
15 Feb 2024
GaussianObject: Just Taking Four Images to Get A High-Quality 3D Object
  with Gaussian Splatting
GaussianObject: Just Taking Four Images to Get A High-Quality 3D Object with Gaussian Splatting
Chen Yang
Sikuang Li
Jiemin Fang
Ruofan Liang
Lingxi Xie
Xiaopeng Zhang
Wei Shen
Qi Tian
3DGS
72
23
0
15 Feb 2024
Knowledge-Infused LLM-Powered Conversational Health Agent: A Case Study
  for Diabetes Patients
Knowledge-Infused LLM-Powered Conversational Health Agent: A Case Study for Diabetes Patients
Mahyar Abbasian
Zhongqi Yang
Elahe Khatibi
Pengfei Zhang
N. Nagesh
Iman Azimi
Ramesh C. Jain
Amir M. Rahmani
LM&MA
83
17
0
15 Feb 2024
Quantized Embedding Vectors for Controllable Diffusion Language Models
Quantized Embedding Vectors for Controllable Diffusion Language Models
Cheng Kang
Xinye Chen
Yong Hu
Daniel Novak
74
0
0
15 Feb 2024
Both Matter: Enhancing the Emotional Intelligence of Large Language
  Models without Compromising the General Intelligence
Both Matter: Enhancing the Emotional Intelligence of Large Language Models without Compromising the General Intelligence
Weixiang Zhao
Zhuojun Li
Shilong Wang
Yang Wang
Yulin Hu
Yanyan Zhao
Chen Wei
Bing Qin
116
5
0
15 Feb 2024
RS-DPO: A Hybrid Rejection Sampling and Direct Preference Optimization
  Method for Alignment of Large Language Models
RS-DPO: A Hybrid Rejection Sampling and Direct Preference Optimization Method for Alignment of Large Language Models
Saeed Khaki
JinJin Li
Lan Ma
Liu Yang
Prathap Ramachandra
81
24
0
15 Feb 2024
LoraRetriever: Input-Aware LoRA Retrieval and Composition for Mixed
  Tasks in the Wild
LoraRetriever: Input-Aware LoRA Retrieval and Composition for Mixed Tasks in the Wild
Ziyu Zhao
Leilei Gan
Guoyin Wang
Wangchunshu Zhou
Hongxia Yang
Kun Kuang
Leilei Gan
MoMe
105
40
0
15 Feb 2024
NutePrune: Efficient Progressive Pruning with Numerous Teachers for
  Large Language Models
NutePrune: Efficient Progressive Pruning with Numerous Teachers for Large Language Models
Shengrui Li
Junzhe Chen
Xueting Han
Jing Bai
86
6
0
15 Feb 2024
Efficient Language Adaptive Pre-training: Extending State-of-the-Art
  Large Language Models for Polish
Efficient Language Adaptive Pre-training: Extending State-of-the-Art Large Language Models for Polish
Szymon Ruciñski
85
5
0
15 Feb 2024
Model Compression and Efficient Inference for Large Language Models: A
  Survey
Model Compression and Efficient Inference for Large Language Models: A Survey
Wenxiao Wang
Wei Chen
Yicong Luo
Yongliu Long
Zhengkai Lin
Liye Zhang
Binbin Lin
Deng Cai
Xiaofei He
MQ
116
58
0
15 Feb 2024
Arrange, Inpaint, and Refine: Steerable Long-term Music Audio Generation
  and Editing via Content-based Controls
Arrange, Inpaint, and Refine: Steerable Long-term Music Audio Generation and Editing via Content-based Controls
Liwei Lin
Gus Xia
Yixiao Zhang
Junyan Jiang
72
13
0
14 Feb 2024
Magic-Me: Identity-Specific Video Customized Diffusion
Magic-Me: Identity-Specific Video Customized Diffusion
Ze Ma
Daquan Zhou
Chun-Hsiao Yeh
Xue-She Wang
Xiuyu Li
Huanrui Yang
Zhen Dong
Kurt Keutzer
Jiashi Feng
VGenDiffM
86
32
0
14 Feb 2024
Instruction Backdoor Attacks Against Customized LLMs
Instruction Backdoor Attacks Against Customized LLMs
Rui Zhang
Hongwei Li
Rui Wen
Wenbo Jiang
Yuan Zhang
Michael Backes
Yun Shen
Yang Zhang
AAMLSILM
106
32
0
14 Feb 2024
Chinese MentalBERT: Domain-Adaptive Pre-training on Social Media for
  Chinese Mental Health Text Analysis
Chinese MentalBERT: Domain-Adaptive Pre-training on Social Media for Chinese Mental Health Text Analysis
Wei-dong Zhai
Hongzhi Qi
Qing Zhao
Jianqiang Li
Ziqi Wang
Han Wang
Bing Xiang Yang
Guanghui Fu
AI4MH
51
10
0
14 Feb 2024
Into the Unknown: Self-Learning Large Language Models
Into the Unknown: Self-Learning Large Language Models
Teddy Ferdinan
Jan Kocoñ
P. Kazienko
81
3
0
14 Feb 2024
SafeDecoding: Defending against Jailbreak Attacks via Safety-Aware
  Decoding
SafeDecoding: Defending against Jailbreak Attacks via Safety-Aware Decoding
Zhangchen Xu
Fengqing Jiang
Luyao Niu
Jinyuan Jia
Bill Yuchen Lin
Radha Poovendran
AAML
192
111
0
14 Feb 2024
Open-Vocabulary Segmentation with Unpaired Mask-Text Supervision
Open-Vocabulary Segmentation with Unpaired Mask-Text Supervision
Zhaoqing Wang
Xiaobo Xia
Ziye Chen
Xiao He
Yandong Guo
Biwei Huang
Tongliang Liu
VLM
98
13
0
14 Feb 2024
MUSTARD: Mastering Uniform Synthesis of Theorem and Proof Data
MUSTARD: Mastering Uniform Synthesis of Theorem and Proof Data
Yinya Huang
Xiaohan Lin
Zhengying Liu
Qingxing Cao
Huajian Xin
Haiming Wang
Zhenguo Li
Linqi Song
Xiaodan Liang
ALM
125
38
0
14 Feb 2024
Reinforcement Learning from Human Feedback with Active Queries
Reinforcement Learning from Human Feedback with Active Queries
Kaixuan Ji
Jiafan He
Quanquan Gu
105
19
0
14 Feb 2024
PIN: Positional Insert Unlocks Object Localisation Abilities in VLMs
PIN: Positional Insert Unlocks Object Localisation Abilities in VLMs
Michael Dorkenwald
Nimrod Barazani
Cees G. M. Snoek
Yuki M. Asano
VLMMLLM
61
12
0
13 Feb 2024
Knowledge Editing on Black-box Large Language Models
Knowledge Editing on Black-box Large Language Models
Xiaoshuai Song
Zhengyang Wang
Keqing He
Guanting Dong
Yutao Mou
Jinxu Zhao
Weiran Xu
KELM
74
4
0
13 Feb 2024
A Survey of Generative AI for de novo Drug Design: New Frontiers in
  Molecule and Protein Generation
A Survey of Generative AI for de novo Drug Design: New Frontiers in Molecule and Protein Generation
Xiangru Tang
Howard Dai
Elizabeth Knight
Fang Wu
Yunyang Li
Tianxiao Li
Mark B. Gerstein
99
31
0
13 Feb 2024
Previous
123...979899...137138139
Next