ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2106.09685
  4. Cited By
LoRA: Low-Rank Adaptation of Large Language Models
v1v2 (latest)

LoRA: Low-Rank Adaptation of Large Language Models

17 June 2021
J. E. Hu
Yelong Shen
Phillip Wallis
Zeyuan Allen-Zhu
Yuanzhi Li
Shean Wang
Lu Wang
Weizhu Chen
    OffRLAI4TSAI4CEALMAIMat
ArXiv (abs)PDFHTMLGithub (11998★)

Papers citing "LoRA: Low-Rank Adaptation of Large Language Models"

50 / 6,909 papers shown
Title
Selective Demonstrations for Cross-domain Text-to-SQL
Selective Demonstrations for Cross-domain Text-to-SQL
Shuaichen Chang
Eric Fosler-Lussier
65
22
0
10 Oct 2023
MuseChat: A Conversational Music Recommendation System for Videos
MuseChat: A Conversational Music Recommendation System for Videos
Zhikang Dong
Bin Chen
Xiulong Liu
Paweł Polak
Peng Zhang
LRM
121
27
0
10 Oct 2023
Efficient Adaptation of Large Vision Transformer via Adapter
  Re-Composing
Efficient Adaptation of Large Vision Transformer via Adapter Re-Composing
Wei Dong
Dawei Yan
Zhijun Lin
Peng Wang
80
24
0
10 Oct 2023
GeoLLM: Extracting Geospatial Knowledge from Large Language Models
GeoLLM: Extracting Geospatial Knowledge from Large Language Models
Rohin Manvi
Samar Khanna
Gengchen Mai
Marshall Burke
David B. Lobell
Stefano Ermon
70
55
0
10 Oct 2023
Factual and Personalized Recommendations using Language Models and
  Reinforcement Learning
Factual and Personalized Recommendations using Language Models and Reinforcement Learning
Jihwan Jeong
Yinlam Chow
Guy Tennenholtz
Chih-Wei Hsu
Azamat Tulepbergenov
Mohammad Ghavamzadeh
Craig Boutilier
88
4
0
09 Oct 2023
Factorized Tensor Networks for Multi-Task and Multi-Domain Learning
Factorized Tensor Networks for Multi-Task and Multi-Domain Learning
Yash Garg
Nebiyou Yismaw
Rakib Hyder
Ashley Prater-Bennette
M. Salman Asif
58
2
0
09 Oct 2023
FireAct: Toward Language Agent Fine-tuning
FireAct: Toward Language Agent Fine-tuning
Baian Chen
Chang Shu
Ehsan Shareghi
Nigel Collier
Karthik Narasimhan
Shunyu Yao
ALMLLMAG
177
112
0
09 Oct 2023
TAIL: Task-specific Adapters for Imitation Learning with Large
  Pretrained Models
TAIL: Task-specific Adapters for Imitation Learning with Large Pretrained Models
Zuxin Liu
Jesse Zhang
Kavosh Asadi
Yao Liu
Ding Zhao
Shoham Sabach
Rasool Fakoor
ALMAI4CE
111
30
0
09 Oct 2023
Fine-grained Audio-Visual Joint Representations for Multimodal Large
  Language Models
Fine-grained Audio-Visual Joint Representations for Multimodal Large Language Models
Guangzhi Sun
Wenyi Yu
Changli Tang
Xianzhao Chen
Tian Tan
Wei Li
Lu Lu
Zejun Ma
Chao Zhang
101
13
0
09 Oct 2023
GraphLLM: Boosting Graph Reasoning Ability of Large Language Model
GraphLLM: Boosting Graph Reasoning Ability of Large Language Model
Ziwei Chai
Tianjie Zhang
Liang Wu
Kaiqiao Han
Xiaohai Hu
Xuanwen Huang
Yang Yang
AI4MHLRM
67
68
0
09 Oct 2023
Foundation Models Meet Visualizations: Challenges and Opportunities
Foundation Models Meet Visualizations: Challenges and Opportunities
Weikai Yang
Mengchen Liu
Zheng Wang
Shixia Liu
87
40
0
09 Oct 2023
LLMLingua: Compressing Prompts for Accelerated Inference of Large
  Language Models
LLMLingua: Compressing Prompts for Accelerated Inference of Large Language Models
Huiqiang Jiang
Qianhui Wu
Chin-Yew Lin
Yuqing Yang
Lili Qiu
109
118
0
09 Oct 2023
Empower Nested Boolean Logic via Self-Supervised Curriculum Learning
Empower Nested Boolean Logic via Self-Supervised Curriculum Learning
Hongqiu Wu
Linfeng Liu
Haizhen Zhao
Min Zhang
LRMAI4CENAIELM
84
7
0
09 Oct 2023
Fast and Robust Early-Exiting Framework for Autoregressive Language
  Models with Synchronized Parallel Decoding
Fast and Robust Early-Exiting Framework for Autoregressive Language Models with Synchronized Parallel Decoding
Sangmin Bae
Jongwoo Ko
Hwanjun Song
SeYoung Yun
88
61
0
09 Oct 2023
Hierarchical Side-Tuning for Vision Transformers
Hierarchical Side-Tuning for Vision Transformers
Weifeng Lin
Ziheng Wu
Wentao Yang
Mingxin Huang
Jun Huang
Lianwen Jin
109
8
0
09 Oct 2023
Augmented Embeddings for Custom Retrievals
Augmented Embeddings for Custom Retrievals
Anirudh Khatry
Yasharth Bajpai
Priyanshu Gupta
Sumit Gulwani
Ashish Tiwari
RALM
53
1
0
09 Oct 2023
IPDreamer: Appearance-Controllable 3D Object Generation with Complex
  Image Prompts
IPDreamer: Appearance-Controllable 3D Object Generation with Complex Image Prompts
Bo-Wen Zeng
Shanglin Li
Yutang Feng
Ling Yang
Hong Li
...
Conghui He
Wentao Zhang
Jianzhuang Liu
Baochang Zhang
Shuicheng Yan
DiffM
97
2
0
09 Oct 2023
Improving Discriminative Multi-Modal Learning with Large-Scale
  Pre-Trained Models
Improving Discriminative Multi-Modal Learning with Large-Scale Pre-Trained Models
Chenzhuang Du
Yue Zhao
Chonghua Liao
Jiacheng You
Jie Fu
Hang Zhao
86
2
0
08 Oct 2023
Toolink: Linking Toolkit Creation and Using through Chain-of-Solving on
  Open-Source Model
Toolink: Linking Toolkit Creation and Using through Chain-of-Solving on Open-Source Model
Cheng Qian
Chenyan Xiong
Zhenghao Liu
Zhiyuan Liu
LRM
92
18
0
08 Oct 2023
UReader: Universal OCR-free Visually-situated Language Understanding
  with Multimodal Large Language Model
UReader: Universal OCR-free Visually-situated Language Understanding with Multimodal Large Language Model
Jiabo Ye
Anwen Hu
Haiyang Xu
Qinghao Ye
Mingshi Yan
...
Ji Zhang
Qin Jin
Liang He
Xin Lin
Feiyan Huang
VLMMLLM
212
98
0
08 Oct 2023
How Reliable Are AI-Generated-Text Detectors? An Assessment Framework
  Using Evasive Soft Prompts
How Reliable Are AI-Generated-Text Detectors? An Assessment Framework Using Evasive Soft Prompts
Tharindu Kumarage
Paras Sheth
Raha Moraffah
Joshua Garland
Huan Liu
DeLMO
63
26
0
08 Oct 2023
FairTune: Optimizing Parameter Efficient Fine Tuning for Fairness in
  Medical Image Analysis
FairTune: Optimizing Parameter Efficient Fine Tuning for Fairness in Medical Image Analysis
Raman Dutt
Ondrej Bohdal
Sotirios A. Tsaftaris
Timothy M. Hospedales
127
14
0
08 Oct 2023
Compresso: Structured Pruning with Collaborative Prompting Learns
  Compact Large Language Models
Compresso: Structured Pruning with Collaborative Prompting Learns Compact Large Language Models
Song Guo
Jiahang Xu
Li Zhang
Mao Yang
87
15
0
08 Oct 2023
TEMPO: Prompt-based Generative Pre-trained Transformer for Time Series
  Forecasting
TEMPO: Prompt-based Generative Pre-trained Transformer for Time Series Forecasting
Defu Cao
Furong Jia
Sercan O. Arik
Tomas Pfister
Yixiang Zheng
Wen Ye
Yan Liu
AI4TS
111
138
0
08 Oct 2023
Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High Sparsity
Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High Sparsity
Lu Yin
You Wu
Zhenyu Zhang
Cheng-Yu Hsieh
Yaqing Wang
...
Mykola Pechenizkiy
Yi Liang
Michael Bendersky
Zhangyang Wang
Shiwei Liu
137
103
0
08 Oct 2023
Chat Vector: A Simple Approach to Equip LLMs with Instruction Following
  and Model Alignment in New Languages
Chat Vector: A Simple Approach to Equip LLMs with Instruction Following and Model Alignment in New Languages
Shih-Cheng Huang
Pin-Zu Li
Yu-Chi Hsu
Kuang-Ming Chen
Yu Tung Lin
Shih-Kai Hsiao
Richard Tzong-Han Tsai
Hung-yi Lee
MoMe
83
17
0
07 Oct 2023
FinGPT: Instruction Tuning Benchmark for Open-Source Large Language
  Models in Financial Datasets
FinGPT: Instruction Tuning Benchmark for Open-Source Large Language Models in Financial Datasets
Neng Wang
Hongyang Yang
Chris Wang
81
51
0
07 Oct 2023
Parameter Efficient Multi-task Model Fusion with Partial Linearization
Parameter Efficient Multi-task Model Fusion with Partial Linearization
Anke Tang
Li Shen
Yong Luo
Yibing Zhan
Han Hu
Bo Du
Yixin Chen
Dacheng Tao
MoMe
124
36
0
07 Oct 2023
EasyPhoto: Your Smart AI Photo Generator
EasyPhoto: Your Smart AI Photo Generator
Ziheng Wu
Jiaqi Xu
Xinyi Zou
Kunzhe Huang
Xing Shi
Jun Huang
34
4
0
07 Oct 2023
Profit: Benchmarking Personalization and Robustness Trade-off in
  Federated Prompt Tuning
Profit: Benchmarking Personalization and Robustness Trade-off in Federated Prompt Tuning
Liam Collins
Shanshan Wu
Sewoong Oh
K. Sim
FedML
94
10
0
06 Oct 2023
Segmented Harmonic Loss: Handling Class-Imbalanced Multi-Label Clinical
  Data for Medical Coding with Large Language Models
Segmented Harmonic Loss: Handling Class-Imbalanced Multi-Label Clinical Data for Medical Coding with Large Language Models
Surjya Ray
Pratik Mehta
Hongen Zhang
Ada Chaman
Jian Wang
Chung-Jen Ho
Michael Chiou
T. Suleman
31
1
0
06 Oct 2023
Talk like a Graph: Encoding Graphs for Large Language Models
Talk like a Graph: Encoding Graphs for Large Language Models
Bahare Fatemi
Jonathan J. Halcrow
Bryan Perozzi
AI4CE
96
113
0
06 Oct 2023
Amortizing intractable inference in large language models
Amortizing intractable inference in large language models
Marvin Schmitt
Moksh Jain
Daniel Habermann
Younesse Kaddar
Ullrich Kothe
Stefan T. Radev
Nikolay Malkin
AIFinBDL
130
57
0
06 Oct 2023
From task structures to world models: What do LLMs know?
From task structures to world models: What do LLMs know?
ilker. yildirim
L. A. Paul
85
54
0
06 Oct 2023
Demystifying Embedding Spaces using Large Language Models
Demystifying Embedding Spaces using Large Language Models
Guy Tennenholtz
Yinlam Chow
Chih-Wei Hsu
Jihwan Jeong
Lior Shani
Azamat Tulepbergenov
Deepak Ramachandran
Martin Mladenov
Craig Boutilier
57
15
0
06 Oct 2023
The Role of Federated Learning in a Wireless World with Foundation
  Models
The Role of Federated Learning in a Wireless World with Foundation Models
Zihan Chen
Howard H. Yang
Y. C. Tay
Kai Fong Ernest Chong
Tony Q.S. Quek
AI4CE
62
8
0
06 Oct 2023
Robust Multimodal Learning with Missing Modalities via
  Parameter-Efficient Adaptation
Robust Multimodal Learning with Missing Modalities via Parameter-Efficient Adaptation
Md Kaykobad Reza
Ashley Prater-Bennette
M. Salman Asif
72
8
0
06 Oct 2023
Aligning Text-to-Image Diffusion Models with Reward Backpropagation
Aligning Text-to-Image Diffusion Models with Reward Backpropagation
Mihir Prabhudesai
Anirudh Goyal
Deepak Pathak
Katerina Fragkiadaki
141
133
0
05 Oct 2023
A Long Way to Go: Investigating Length Correlations in RLHF
A Long Way to Go: Investigating Length Correlations in RLHF
Prasann Singhal
Tanya Goyal
Jiacheng Xu
Greg Durrett
160
161
0
05 Oct 2023
Beyond One-Preference-Fits-All Alignment: Multi-Objective Direct
  Preference Optimization
Beyond One-Preference-Fits-All Alignment: Multi-Objective Direct Preference Optimization
Zhanhui Zhou
Jie Liu
Chao Yang
Jing Shao
Yu Liu
Xiangyu Yue
Wanli Ouyang
Yu Qiao
73
61
0
05 Oct 2023
Fine-tuning Aligned Language Models Compromises Safety, Even When Users
  Do Not Intend To!
Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!
Xiangyu Qi
Yi Zeng
Tinghao Xie
Pin-Yu Chen
Ruoxi Jia
Prateek Mittal
Peter Henderson
SILM
181
635
0
05 Oct 2023
GoLLIE: Annotation Guidelines improve Zero-Shot Information-Extraction
GoLLIE: Annotation Guidelines improve Zero-Shot Information-Extraction
Oscar Sainz
Iker García-Ferrero
Rodrigo Agerri
Oier López de Lacalle
German Rigau
Eneko Agirre
169
92
0
05 Oct 2023
Adapting Large Language Models for Content Moderation: Pitfalls in Data
  Engineering and Supervised Fine-tuning
Adapting Large Language Models for Content Moderation: Pitfalls in Data Engineering and Supervised Fine-tuning
Huan Ma
Changqing Zhang
Huazhu Fu
Peilin Zhao
Bing Wu
OffRLAI4MH
113
21
0
05 Oct 2023
Fine-tune Language Models to Approximate Unbiased In-context Learning
Fine-tune Language Models to Approximate Unbiased In-context Learning
Timothy Chu
Zhao Song
Chiwun Yang
110
16
0
05 Oct 2023
Reformulating Domain Adaptation of Large Language Models as
  Adapt-Retrieve-Revise
Reformulating Domain Adaptation of Large Language Models as Adapt-Retrieve-Revise
Zhen Wan
Yating Zhang
Yexiang Wang
Fei Cheng
Sadao Kurohashi
CLLAILaw
108
10
0
05 Oct 2023
SoK: Access Control Policy Generation from High-level Natural Language
  Requirements
SoK: Access Control Policy Generation from High-level Natural Language Requirements
Sakuna Jayasundara
N. Arachchilage
Giovanni Russello
40
2
0
05 Oct 2023
EfficientDM: Efficient Quantization-Aware Fine-Tuning of Low-Bit
  Diffusion Models
EfficientDM: Efficient Quantization-Aware Fine-Tuning of Low-Bit Diffusion Models
Yefei He
Jing Liu
Weijia Wu
Hong Zhou
Bohan Zhuang
DiffMMQ
143
51
0
05 Oct 2023
On the Performance of Multimodal Language Models
On the Performance of Multimodal Language Models
Utsav Garg
Erhan Bas
MLLM
29
0
0
04 Oct 2023
Talking Models: Distill Pre-trained Knowledge to Downstream Models via
  Interactive Communication
Talking Models: Distill Pre-trained Knowledge to Downstream Models via Interactive Communication
Zhe Zhao
Qingyun Liu
Huan Gui
Bang An
Lichan Hong
Ed H. Chi
72
1
0
04 Oct 2023
Discovering Knowledge-Critical Subnetworks in Pretrained Language Models
Discovering Knowledge-Critical Subnetworks in Pretrained Language Models
Deniz Bayazit
Negar Foroutan
Zeming Chen
Gail Weiss
Antoine Bosselut
KELM
105
16
0
04 Oct 2023
Previous
123...116117118...137138139
Next