ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2106.09685
  4. Cited By
LoRA: Low-Rank Adaptation of Large Language Models
v1v2 (latest)

LoRA: Low-Rank Adaptation of Large Language Models

17 June 2021
J. E. Hu
Yelong Shen
Phillip Wallis
Zeyuan Allen-Zhu
Yuanzhi Li
Shean Wang
Lu Wang
Weizhu Chen
    OffRLAI4TSAI4CEALMAIMat
ArXiv (abs)PDFHTMLGithub (11998★)

Papers citing "LoRA: Low-Rank Adaptation of Large Language Models"

50 / 6,910 papers shown
Title
SiRA: Sparse Mixture of Low Rank Adaptation
SiRA: Sparse Mixture of Low Rank Adaptation
Yun Zhu
Nevan Wichers
Chu-Cheng Lin
Xinyi Wang
Tianlong Chen
...
Han Lu
Canoee Liu
Liangchen Luo
Jindong Chen
Lei Meng
MoE
77
28
0
15 Nov 2023
AbsPyramid: Benchmarking the Abstraction Ability of Language Models with
  a Unified Entailment Graph
AbsPyramid: Benchmarking the Abstraction Ability of Language Models with a Unified Entailment Graph
Zhaowei Wang
Haochen Shi
Weiqi Wang
Tianqing Fang
Hongming Zhang
Sehyun Choi
Xin Liu
Yangqiu Song
95
20
0
15 Nov 2023
CLEAN-EVAL: Clean Evaluation on Contaminated Large Language Models
CLEAN-EVAL: Clean Evaluation on Contaminated Large Language Models
Wenhong Zhu
Hong-ping Hao
Zhiwei He
Yun-Ze Song
Yumeng Zhang
Hanxu Hu
Yiran Wei
Rui Wang
Hongyuan Lu
AAMLELM
52
12
0
15 Nov 2023
Grounding Gaps in Language Model Generations
Grounding Gaps in Language Model Generations
Omar Shaikh
Kristina Gligorić
Ashna Khetan
Matthias Gerstgrasser
Diyi Yang
Dan Jurafsky
60
25
0
15 Nov 2023
How Vocabulary Sharing Facilitates Multilingualism in LLaMA?
How Vocabulary Sharing Facilitates Multilingualism in LLaMA?
Fei Yuan
Shuai Yuan
Zhiyong Wu
Lei Li
89
13
0
15 Nov 2023
HeLM: Highlighted Evidence augmented Language Model for Enhanced
  Table-to-Text Generation
HeLM: Highlighted Evidence augmented Language Model for Enhanced Table-to-Text Generation
Junyi Bian
Xiaolei Qin
Wuhe Zou
Mengzuo Huang
Congyi Luo
Ke Zhang
Weidong Zhang
LMTD
59
2
0
15 Nov 2023
MAP's not dead yet: Uncovering true language model modes by conditioning
  away degeneracy
MAP's not dead yet: Uncovering true language model modes by conditioning away degeneracy
Davis Yoshida
Kartik Goyal
Kevin Gimpel
MoE
54
0
0
15 Nov 2023
Think-in-Memory: Recalling and Post-thinking Enable LLMs with Long-Term
  Memory
Think-in-Memory: Recalling and Post-thinking Enable LLMs with Long-Term Memory
Lei Liu
Xiaoyan Yang
Yue Shen
Binbin Hu
Qing Cui
Jinjie Gu
Guannan Zhang
LRMLLMAGKELM
95
23
0
15 Nov 2023
Explore Spurious Correlations at the Concept Level in Language Models
  for Text Classification
Explore Spurious Correlations at the Concept Level in Language Models for Text Classification
Yuhang Zhou
Paiheng Xu
Xiaoyu Liu
Bang An
Wei Ai
Furong Huang
LRM
187
28
0
15 Nov 2023
Plum: Prompt Learning using Metaheuristic
Plum: Prompt Learning using Metaheuristic
Boyao Wang
Shuo Xing
Shizhe Diao
Wenhe Sun
Xiang Liu
Kashun Shum
Renjie Pi
Jipeng Zhang
Tong Zhang
VLMOffRLLRM
80
6
0
14 Nov 2023
Sparsity-Preserving Differentially Private Training of Large Embedding
  Models
Sparsity-Preserving Differentially Private Training of Large Embedding Models
Badih Ghazi
Yangsibo Huang
Pritish Kamath
Ravi Kumar
Pasin Manurangsi
Amer Sinha
Chiyuan Zhang
66
2
0
14 Nov 2023
MeLo: Low-rank Adaptation is Better than Fine-tuning for Medical Image
  Diagnosis
MeLo: Low-rank Adaptation is Better than Fine-tuning for Medical Image Diagnosis
Yitao Zhu
Zhenrong Shen
Zihao Zhao
Sheng Wang
Xin Wang
Xiangyu Zhao
Dinggang Shen
Qian Wang
MedIm
72
32
0
14 Nov 2023
Secure Transformer Inference Protocol
Secure Transformer Inference Protocol
Mu Yuan
Lan Zhang
Xiang-Yang Li
85
3
0
14 Nov 2023
SAMIHS: Adaptation of Segment Anything Model for Intracranial Hemorrhage
  Segmentation
SAMIHS: Adaptation of Segment Anything Model for Intracranial Hemorrhage Segmentation
Yinuo Wang
Kai Chen
Weimin Yuan
Cai Meng
XiangZhi Bai
VLM
75
11
0
14 Nov 2023
Vision-Language Instruction Tuning: A Review and Analysis
Vision-Language Instruction Tuning: A Review and Analysis
Chen Li
Yixiao Ge
Dian Li
Ying Shan
VLM
90
12
0
14 Nov 2023
SAIE Framework: Support Alone Isn't Enough -- Advancing LLM Training
  with Adversarial Remarks
SAIE Framework: Support Alone Isn't Enough -- Advancing LLM Training with Adversarial Remarks
Mengsay Loem
Masahiro Kaneko
Naoaki Okazaki
LRM
68
5
0
14 Nov 2023
Carpe Diem: On the Evaluation of World Knowledge in Lifelong Language
  Models
Carpe Diem: On the Evaluation of World Knowledge in Lifelong Language Models
Yujin Kim
Jaehong Yoon
Seonghyeon Ye
Sangmin Bae
Namgyu Ho
Sung Ju Hwang
Se-Young Yun
KELM
104
13
0
14 Nov 2023
Chat-UniVi: Unified Visual Representation Empowers Large Language Models
  with Image and Video Understanding
Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video Understanding
Peng Jin
Ryuichi Takanobu
Caiwan Zhang
Xiaochun Cao
Li-ming Yuan
MLLM
146
249
0
14 Nov 2023
Forgetting before Learning: Utilizing Parametric Arithmetic for
  Knowledge Updating in Large Language Models
Forgetting before Learning: Utilizing Parametric Arithmetic for Knowledge Updating in Large Language Models
Shiwen Ni
Dingwei Chen
Chengming Li
Xiping Hu
Ruifeng Xu
Min Yang
KELMMoMe
108
8
0
14 Nov 2023
Qwen-Audio: Advancing Universal Audio Understanding via Unified
  Large-Scale Audio-Language Models
Qwen-Audio: Advancing Universal Audio Understanding via Unified Large-Scale Audio-Language Models
Yunfei Chu
Jin Xu
Xiaohuan Zhou
Qian Yang
Shiliang Zhang
Zhijie Yan
Chang Zhou
Jingren Zhou
AuLLM
144
351
0
14 Nov 2023
Can Knowledge Graphs Reduce Hallucinations in LLMs? : A Survey
Can Knowledge Graphs Reduce Hallucinations in LLMs? : A Survey
Garima Agrawal
Tharindu Kumarage
Zeyad Alghami
Huanmin Liu
108
97
0
14 Nov 2023
One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View
  Generation and 3D Diffusion
One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusion
Minghua Liu
Ruoxi Shi
Linghao Chen
Zhuoyang Zhang
Chao Xu
Xinyue Wei
Hansheng Chen
Chong Zeng
Jiayuan Gu
Hao Su
140
208
0
14 Nov 2023
GPT-4V in Wonderland: Large Multimodal Models for Zero-Shot Smartphone
  GUI Navigation
GPT-4V in Wonderland: Large Multimodal Models for Zero-Shot Smartphone GUI Navigation
An Yan
Zhengyuan Yang
Wanrong Zhu
Kevin Qinghong Lin
Linjie Li
...
Yiwu Zhong
Julian McAuley
Jianfeng Gao
Zicheng Liu
Lijuan Wang
LLMAGLM&Ro
148
111
0
13 Nov 2023
Speech-based Slot Filling using Large Language Models
Speech-based Slot Filling using Large Language Models
Guangzhi Sun
Shutong Feng
Dongcheng Jiang
Chao Zhang
Milica Gasic
P. Woodland
85
1
0
13 Nov 2023
FIRST: A Million-Entry Dataset for Text-Driven Fashion Synthesis and
  Design
FIRST: A Million-Entry Dataset for Text-Driven Fashion Synthesis and Design
Zhen Huang
Yihao Li
Dong Pei
Jiapeng Zhou
Xuliang Ning
Jianlin Han
Xiaoguang Han
Xuejun Chen
93
3
0
13 Nov 2023
What Large Language Models Bring to Text-rich VQA?
What Large Language Models Bring to Text-rich VQA?
Xuejing Liu
Wei Tang
Xinzhe Ni
Jinghui Lu
Rui Zhao
Zechao Li
Fei Tan
52
9
0
13 Nov 2023
Exploring the Factual Consistency in Dialogue Comprehension of Large
  Language Models
Exploring the Factual Consistency in Dialogue Comprehension of Large Language Models
Shuaijie She
Shujian Huang
Xingyun Wang
Yanke Zhou
Jiajun Chen
ELMHILM
50
0
0
13 Nov 2023
ExpNote: Black-box Large Language Models are Better Task Solvers with
  Experience Notebook
ExpNote: Black-box Large Language Models are Better Task Solvers with Experience Notebook
Wangtao Sun
Xuanqing Yu
Shizhu He
Jun Zhao
Kang Liu
LRM
51
2
0
13 Nov 2023
To Transformers and Beyond: Large Language Models for the Genome
To Transformers and Beyond: Large Language Models for the Genome
Micaela Elisa Consens
Cameron Dufault
Michael Wainberg
Duncan Forster
Mehran Karimzadeh
Hani Goodarzi
Fabian J. Theis
Alan Moses
Bo Wang
LM&MAMedIm
68
33
0
13 Nov 2023
Large Language Models are In-context Teachers for Knowledge Reasoning
Large Language Models are In-context Teachers for Knowledge Reasoning
Jiachen Zhao
Zonghai Yao
Zhichao Yang
Hong-ye Yu
ReLMLRM
59
2
0
12 Nov 2023
Tunable Soft Prompts are Messengers in Federated Learning
Tunable Soft Prompts are Messengers in Federated Learning
Chenhe Dong
Yuexiang Xie
Bolin Ding
Ying Shen
Yaliang Li
FedML
84
8
0
12 Nov 2023
IMPUS: Image Morphing with Perceptually-Uniform Sampling Using Diffusion
  Models
IMPUS: Image Morphing with Perceptually-Uniform Sampling Using Diffusion Models
Zhaoyuan Yang
Zhengyang Yu
Zhiwei Xu
Jaskirat Singh
Jing Zhang
Dylan Campbell
Peter Tu
Richard Hartley
99
11
0
12 Nov 2023
Aggregate, Decompose, and Fine-Tune: A Simple Yet Effective
  Factor-Tuning Method for Vision Transformer
Aggregate, Decompose, and Fine-Tune: A Simple Yet Effective Factor-Tuning Method for Vision Transformer
Dongping Chen
64
3
0
12 Nov 2023
Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small
  Scorer
Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer
Bowen Tan
Yun Zhu
Lijuan Liu
Eric P. Xing
Zhiting Hu
Jindong Chen
ALMLRM
103
7
0
12 Nov 2023
In-context Vectors: Making In Context Learning More Effective and
  Controllable Through Latent Space Steering
In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space Steering
Sheng Liu
Haotian Ye
Lei Xing
James Y. Zou
133
117
0
11 Nov 2023
Monkey: Image Resolution and Text Label Are Important Things for Large
  Multi-modal Models
Monkey: Image Resolution and Text Label Are Important Things for Large Multi-modal Models
Zhang Li
Biao Yang
Qiang Liu
Zhiyin Ma
Shuo Zhang
Jingxu Yang
Yabo Sun
Yuliang Liu
Xiang Bai
MLLM
135
278
0
11 Nov 2023
PECoP: Parameter Efficient Continual Pretraining for Action Quality
  Assessment
PECoP: Parameter Efficient Continual Pretraining for Action Quality Assessment
Amirhossein Dadashzadeh
Shuchao Duan
Alan Whone
Majid Mirmehdi
55
11
0
11 Nov 2023
TransformCode: A Contrastive Learning Framework for Code Embedding via
  Subtree Transformation
TransformCode: A Contrastive Learning Framework for Code Embedding via Subtree Transformation
Zixiang Xian
Rubing Huang
Dave Towey
Chunrong Fang
Zhenyu Chen
75
6
0
10 Nov 2023
Tamil-Llama: A New Tamil Language Model Based on Llama 2
Tamil-Llama: A New Tamil Language Model Based on Llama 2
Abhinand Balachandran
62
33
0
10 Nov 2023
LCM-LoRA: A Universal Stable-Diffusion Acceleration Module
LCM-LoRA: A Universal Stable-Diffusion Acceleration Module
Simian Luo
Yiqin Tan
Suraj Patil
Daniel Gu
Patrick von Platen
Apolinário Passos
Longbo Huang
Jian Li
Hang Zhao
MoMe
191
162
0
09 Nov 2023
u-LLaVA: Unifying Multi-Modal Tasks via Large Language Model
u-LLaVA: Unifying Multi-Modal Tasks via Large Language Model
Jinjin Xu
Liwu Xu
Yuzhe Yang
Xiang Li
Fanyi Wang
Yanchun Xie
Yi-Jie Huang
Yaqian Li
MoEMLLMVLM
133
16
0
09 Nov 2023
BeLLM: Backward Dependency Enhanced Large Language Model for Sentence
  Embeddings
BeLLM: Backward Dependency Enhanced Large Language Model for Sentence Embeddings
Xianming Li
Jing Li
78
16
0
09 Nov 2023
A Survey of Large Language Models in Medicine: Progress, Application,
  and Challenge
A Survey of Large Language Models in Medicine: Progress, Application, and Challenge
Hongjian Zhou
Fenglin Liu
Boyang Gu
Xinyu Zou
Jinfa Huang
...
Yefeng Zheng
Lei A. Clifton
Zheng Li
Fenglin Liu
David Clifton
LM&MA
175
128
0
09 Nov 2023
On the steerability of large language models toward data-driven personas
On the steerability of large language models toward data-driven personas
Junyi Li
Ninareh Mehrabi
Charith Peris
Palash Goyal
Kai-Wei Chang
Aram Galstyan
Richard Zemel
Rahul Gupta
146
37
0
08 Nov 2023
LongQLoRA: Efficient and Effective Method to Extend Context Length of
  Large Language Models
LongQLoRA: Efficient and Effective Method to Extend Context Length of Large Language Models
Jianxin Yang
43
6
0
08 Nov 2023
Massive Editing for Large Language Models via Meta Learning
Massive Editing for Large Language Models via Meta Learning
Chenmien Tan
Ge Zhang
Jie Fu
KELM
113
43
0
08 Nov 2023
A Data Perspective on Enhanced Identity Preservation for Diffusion
  Personalization
A Data Perspective on Enhanced Identity Preservation for Diffusion Personalization
Xingzhe He
Zhiwen Cao
Nicholas I. Kolkin
Lantao Yu
Kun Wan
Helge Rhodin
Ratheesh Kalarot
93
14
0
07 Nov 2023
Mini but Mighty: Finetuning ViTs with Mini Adapters
Mini but Mighty: Finetuning ViTs with Mini Adapters
Imad Eddine Marouf
Enzo Tartaglione
Stéphane Lathuilière
65
5
0
07 Nov 2023
Conversations in Galician: a Large Language Model for an
  Underrepresented Language
Conversations in Galician: a Large Language Model for an Underrepresented Language
Eliseo Bao Souto
Anxo Perez
Javier Parapar
22
2
0
07 Nov 2023
Unified Low-Resource Sequence Labeling by Sample-Aware Dynamic Sparse
  Finetuning
Unified Low-Resource Sequence Labeling by Sample-Aware Dynamic Sparse Finetuning
Sarkar Snigdha Sarathi Das
Ranran Haoran Zhang
Peng Shi
Wenpeng Yin
Rui Zhang
156
15
0
07 Nov 2023
Previous
123...111112113...137138139
Next