ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2106.09685
  4. Cited By
LoRA: Low-Rank Adaptation of Large Language Models
v1v2 (latest)

LoRA: Low-Rank Adaptation of Large Language Models

17 June 2021
J. E. Hu
Yelong Shen
Phillip Wallis
Zeyuan Allen-Zhu
Yuanzhi Li
Shean Wang
Lu Wang
Weizhu Chen
    OffRLAI4TSAI4CEALMAIMat
ArXiv (abs)PDFHTMLGithub (11998★)

Papers citing "LoRA: Low-Rank Adaptation of Large Language Models"

50 / 6,909 papers shown
Title
LoRA ensembles for large language model fine-tuning
LoRA ensembles for large language model fine-tuning
Xi Wang
Laurence Aitchison
Maja Rudolph
UQCV
111
39
0
29 Sep 2023
Revolutionizing Mobile Interaction: Enabling a 3 Billion Parameter GPT
  LLM on Mobile
Revolutionizing Mobile Interaction: Enabling a 3 Billion Parameter GPT LLM on Mobile
Samuel Carreira
Tomás Marques
J. Ribeiro
Carlos Grilo
16
0
0
29 Sep 2023
Batch Calibration: Rethinking Calibration for In-Context Learning and
  Prompt Engineering
Batch Calibration: Rethinking Calibration for In-Context Learning and Prompt Engineering
Han Zhou
Xingchen Wan
Lev Proleev
Diana Mincu
Jilin Chen
Katherine A. Heller
Subhrajit Roy
UQLM
85
61
0
29 Sep 2023
RECOMBINER: Robust and Enhanced Compression with Bayesian Implicit
  Neural Representations
RECOMBINER: Robust and Enhanced Compression with Bayesian Implicit Neural Representations
Carlos Rombaldo Junior
Ingolf Becker
Zongyu Guo
Shane Johnson
76
12
0
29 Sep 2023
Fine-grained Late-interaction Multi-modal Retrieval for Retrieval
  Augmented Visual Question Answering
Fine-grained Late-interaction Multi-modal Retrieval for Retrieval Augmented Visual Question Answering
Weizhe Lin
Jinghong Chen
Jingbiao Mei
Alexandru Coca
Bill Byrne
73
40
0
29 Sep 2023
SCALE: Synergized Collaboration of Asymmetric Language Translation
  Engines
SCALE: Synergized Collaboration of Asymmetric Language Translation Engines
Xin Cheng
Xun Wang
Tao Ge
Si-Qing Chen
Yongbin Li
Dongyan Zhao
Rui Yan
93
2
0
29 Sep 2023
Interpretable Long-Form Legal Question Answering with
  Retrieval-Augmented Large Language Models
Interpretable Long-Form Legal Question Answering with Retrieval-Augmented Large Language Models
Antoine Louis
Gijs van Dijck
Gerasimos Spanakis
ELMAILaw
67
41
0
29 Sep 2023
Understanding and Mitigating the Label Noise in Pre-training on
  Downstream Tasks
Understanding and Mitigating the Label Noise in Pre-training on Downstream Tasks
Hao Chen
Jindong Wang
Ankit Shah
Ran Tao
Hongxin Wei
Berfin cSimcsek
Masashi Sugiyama
Bhiksha Raj
108
31
0
29 Sep 2023
Enabling Differentially Private Federated Learning for Speech Recognition: Benchmarks, Adaptive Optimizers and Gradient Clipping
Enabling Differentially Private Federated Learning for Speech Recognition: Benchmarks, Adaptive Optimizers and Gradient Clipping
Martin Pelikan
Sheikh Shams Azam
Vitaly Feldman
Jan Honza Silovsky
Kunal Talwar
Christopher G. Brinton
Tatiana Likhomanenko
101
8
0
29 Sep 2023
RealFill: Reference-Driven Generation for Authentic Image Completion
RealFill: Reference-Driven Generation for Authentic Image Completion
Luming Tang
Nataniel Ruiz
Qinghao Chu
Yuanzhen Li
Aleksander Holynski
...
Bharath Hariharan
Yael Pritch
Neal Wadhwa
Kfir Aberman
Michael Rubinstein
DiffM
89
45
0
28 Sep 2023
Qwen Technical Report
Qwen Technical Report
Jinze Bai
Shuai Bai
Yunfei Chu
Zeyu Cui
Kai Dang
...
Zhenru Zhang
Chang Zhou
Jingren Zhou
Xiaohuan Zhou
Tianhang Zhu
OSLM
369
1,922
0
28 Sep 2023
A Benchmark for Learning to Translate a New Language from One Grammar
  Book
A Benchmark for Learning to Translate a New Language from One Grammar Book
Garrett Tanzer
Mirac Suzgun
Chenguang Xi
Dan Jurafsky
Luke Melas-Kyriazi
86
61
0
28 Sep 2023
Language Models as a Service: Overview of a New Paradigm and its
  Challenges
Language Models as a Service: Overview of a New Paradigm and its Challenges
Emanuele La Malfa
Aleksandar Petrov
Simon Frieder
Christoph Weinhuber
Ryan Burnell
Raza Nazar
Anthony Cohn
Nigel Shadbolt
Michael Wooldridge
ALMELM
75
6
0
28 Sep 2023
Chatmap : Large Language Model Interaction with Cartographic Data
Chatmap : Large Language Model Interaction with Cartographic Data
Eren Unlu
KELM
66
4
0
28 Sep 2023
CCEdit: Creative and Controllable Video Editing via Diffusion Models
CCEdit: Creative and Controllable Video Editing via Diffusion Models
Danfeng Hong
Wenming Weng
Hao Li
Yuhui Yuan
Jing Yao
Chong Luo
Zhibo Chen
Baining Guo
DiffMVGen
95
49
0
28 Sep 2023
Large Language Models in Finance: A Survey
Large Language Models in Finance: A Survey
Yinheng Li
Shaofei Wang
Han Ding
Hang Chen
AIFin
134
217
0
28 Sep 2023
The Trickle-down Impact of Reward (In-)consistency on RLHF
The Trickle-down Impact of Reward (In-)consistency on RLHF
Lingfeng Shen
Sihao Chen
Linfeng Song
Lifeng Jin
Baolin Peng
Haitao Mi
Daniel Khashabi
Dong Yu
93
23
0
28 Sep 2023
Forgetting Private Textual Sequences in Language Models via
  Leave-One-Out Ensemble
Forgetting Private Textual Sequences in Language Models via Leave-One-Out Ensemble
Zhe Liu
Ozlem Kalinli
MUKELM
90
2
0
28 Sep 2023
Pushing Large Language Models to the 6G Edge: Vision, Challenges, and Opportunities
Pushing Large Language Models to the 6G Edge: Vision, Challenges, and Opportunities
Zhengyi Lin
Guanqiao Qu
Qiyuan Chen
Randy Sarayar
Zhe Chen
Kaibin Huang
105
98
0
28 Sep 2023
AnyMAL: An Efficient and Scalable Any-Modality Augmented Language Model
AnyMAL: An Efficient and Scalable Any-Modality Augmented Language Model
Avamarie Brueggeman
Andrea Madotto
Zhaojiang Lin
Tushar Nagarajan
Matt Smith
...
Peyman Heidari
Yue Liu
Kavya Srinet
Babak Damavandi
Anuj Kumar
MLLM
86
94
0
27 Sep 2023
Exploiting the Signal-Leak Bias in Diffusion Models
Exploiting the Signal-Leak Bias in Diffusion Models
Martin Nicolas Everaert
Athanasios Fitsios
Marco Bocchio
Sami Arpa
Sabine Süsstrunk
R. Achanta
DiffM
75
28
0
27 Sep 2023
Emu: Enhancing Image Generation Models Using Photogenic Needles in a
  Haystack
Emu: Enhancing Image Generation Models Using Photogenic Needles in a Haystack
Xiaoliang Dai
Ji Hou
Chih-Yao Ma
Sam S. Tsai
Jialiang Wang
...
Roshan Sumbaly
Vignesh Ramanathan
Zijian He
Peter Vajda
Devi Parikh
VLM
91
216
0
27 Sep 2023
Identifying and Mitigating Privacy Risks Stemming from Language Models:
  A Survey
Identifying and Mitigating Privacy Risks Stemming from Language Models: A Survey
Victoria Smith
Ali Shahin Shamsabadi
Carolyn Ashurst
Adrian Weller
PILM
101
27
0
27 Sep 2023
HyPoradise: An Open Baseline for Generative Speech Recognition with
  Large Language Models
HyPoradise: An Open Baseline for Generative Speech Recognition with Large Language Models
Cheng Chen
Yuchen Hu
Chao-Han Huck Yang
Sabato Marco Siniscalchi
Pin-Yu Chen
Eng Siong Chng
99
48
0
27 Sep 2023
Conversational Feedback in Scripted versus Spontaneous Dialogues: A
  Comparative Analysis
Conversational Feedback in Scripted versus Spontaneous Dialogues: A Comparative Analysis
Ildikó Pilán
Laurent Prévot
Hendrik Buschmeier
Pierre Lison
46
10
0
27 Sep 2023
Generative Speech Recognition Error Correction with Large Language
  Models and Task-Activating Prompting
Generative Speech Recognition Error Correction with Large Language Models and Task-Activating Prompting
Chao-Han Huck Yang
Yile Gu
Yi-Chieh Liu
Shalini Ghosh
I. Bulyko
A. Stolcke
KELMLRM
120
52
0
27 Sep 2023
From LAION-5B to LAION-EO: Filtering Billions of Images Using Anchor
  Datasets for Satellite Image Extraction
From LAION-5B to LAION-EO: Filtering Billions of Images Using Anchor Datasets for Satellite Image Extraction
Mikolaj Czerkawski
Alistair Francis
83
9
0
27 Sep 2023
Graph Neural Prompting with Large Language Models
Graph Neural Prompting with Large Language Models
Yijun Tian
Huan Song
Zichen Wang
Haozhu Wang
Ziqing Hu
Fang Wang
Nitesh Chawla
Panpan Xu
AI4CE
107
49
0
27 Sep 2023
Efficient Low-rank Backpropagation for Vision Transformer Adaptation
Efficient Low-rank Backpropagation for Vision Transformer Adaptation
Yuedong Yang
Hung-Yueh Chiang
Guihong Li
Diana Marculescu
R. Marculescu
93
9
0
26 Sep 2023
Low-rank Adaptation of Large Language Model Rescoring for
  Parameter-Efficient Speech Recognition
Low-rank Adaptation of Large Language Model Rescoring for Parameter-Efficient Speech Recognition
Yu Yu
Chao-Han Huck Yang
J. Kolehmainen
Prashanth Gurunath Shivakumar
Yile Gu
...
Denis Filimonov
Shalini Ghosh
A. Stolcke
Ariya Rastrow
I. Bulyko
103
10
0
26 Sep 2023
InternLM-XComposer: A Vision-Language Large Model for Advanced
  Text-image Comprehension and Composition
InternLM-XComposer: A Vision-Language Large Model for Advanced Text-image Comprehension and Composition
Pan Zhang
Xiaoyi Wang
Bin Wang
Yuhang Cao
Chao Xu
...
Conghui He
Xingcheng Zhang
Yu Qiao
Da Lin
Jiaqi Wang
MLLM
189
241
0
26 Sep 2023
LAVIE: High-Quality Video Generation with Cascaded Latent Diffusion
  Models
LAVIE: High-Quality Video Generation with Cascaded Latent Diffusion Models
Yaohui Wang
Xinyuan Chen
Xin Ma
Shangchen Zhou
Ziqi Huang
...
Chen Change Loy
Bo Dai
Dahua Lin
Yu Qiao
Ziwei Liu
VGenDiffM
112
231
0
26 Sep 2023
BLIP-Adapter: Parameter-Efficient Transfer Learning for Mobile
  Screenshot Captioning
BLIP-Adapter: Parameter-Efficient Transfer Learning for Mobile Screenshot Captioning
Ching-Yu Chiang
I-Hua Chang
Shih-Wei Liao
83
1
0
26 Sep 2023
ConPET: Continual Parameter-Efficient Tuning for Large Language Models
ConPET: Continual Parameter-Efficient Tuning for Large Language Models
Chenyan Song
Xu Han
Zheni Zeng
Kuai Li
Chen Chen
Zhiyuan Liu
Maosong Sun
Taojiannan Yang
CLLKELM
102
11
0
26 Sep 2023
QA-LoRA: Quantization-Aware Low-Rank Adaptation of Large Language Models
QA-LoRA: Quantization-Aware Low-Rank Adaptation of Large Language Models
Yuhui Xu
Lingxi Xie
Xiaotao Gu
Xin Chen
Heng Chang
Hengheng Zhang
Zhensu Chen
Xiaopeng Zhang
Qi Tian
MQ
82
108
0
26 Sep 2023
Aligning Large Multimodal Models with Factually Augmented RLHF
Aligning Large Multimodal Models with Factually Augmented RLHF
Zhiqing Sun
Sheng Shen
Shengcao Cao
Haotian Liu
Chunyuan Li
...
Liangyan Gui
Yu-Xiong Wang
Yiming Yang
Kurt Keutzer
Trevor Darrell
VLM
140
396
0
25 Sep 2023
When Automated Assessment Meets Automated Content Generation: Examining
  Text Quality in the Era of GPTs
When Automated Assessment Meets Automated Content Generation: Examining Text Quality in the Era of GPTs
Marialena Bevilacqua
Kezia Oketch
Ruiyang Qin
Will Stamey
Xinyuan Zhang
Yi Gan
Kai Yang
A. Abbasi
DeLMO
87
13
0
25 Sep 2023
Joint Audio and Speech Understanding
Joint Audio and Speech Understanding
Yuan Gong
Alexander H. Liu
Hongyin Luo
Leonid Karlinsky
James R. Glass
AuLLM
124
82
0
25 Sep 2023
LORD: Low Rank Decomposition Of Monolingual Code LLMs For One-Shot
  Compression
LORD: Low Rank Decomposition Of Monolingual Code LLMs For One-Shot Compression
Ayush Kaushal
Tejas Vaidhya
Irina Rish
121
16
0
25 Sep 2023
Prompting and Fine-Tuning Open-Sourced Large Language Models for Stance
  Classification
Prompting and Fine-Tuning Open-Sourced Large Language Models for Stance Classification
Iain J. Cruickshank
Lynnette Hui Xian Ng
81
9
0
24 Sep 2023
EvalLM: Interactive Evaluation of Large Language Model Prompts on
  User-Defined Criteria
EvalLM: Interactive Evaluation of Large Language Model Prompts on User-Defined Criteria
Tae Soo Kim
Yoonjoo Lee
Jamin Shin
Young-Ho Kim
Juho Kim
101
72
0
24 Sep 2023
A SAM-based Solution for Hierarchical Panoptic Segmentation of Crops and
  Weeds Competition
A SAM-based Solution for Hierarchical Panoptic Segmentation of Crops and Weeds Competition
K. Nguyen
T. Phung
Hoang-Giang Cao
56
7
0
24 Sep 2023
Identifying Systematic Errors in Object Detectors with the SCROD
  Pipeline
Identifying Systematic Errors in Object Detectors with the SCROD Pipeline
Valentyn Boreiko
Matthias Hein
J. H. Metzen
71
6
0
23 Sep 2023
Investigating Large Language Models and Control Mechanisms to Improve
  Text Readability of Biomedical Abstracts
Investigating Large Language Models and Control Mechanisms to Improve Text Readability of Biomedical Abstracts
Z. Li
Samuel Belkadi
Nicolo Micheletti
Lifeng Han
Matthew Shardlow
Goran Nenadic
98
5
0
22 Sep 2023
Towards Green AI in Fine-tuning Large Language Models via Adaptive
  Backpropagation
Towards Green AI in Fine-tuning Large Language Models via Adaptive Backpropagation
Kai Huang
Hanyu Yin
Heng Huang
Wei Gao
95
11
0
22 Sep 2023
Affect Recognition in Conversations Using Large Language Models
Affect Recognition in Conversations Using Large Language Models
Shutong Feng
Guangzhi Sun
Nurul Lubis
Chao Zhang
Milica Gavsić
59
5
0
22 Sep 2023
AnglE-optimized Text Embeddings
AnglE-optimized Text Embeddings
Xianming Li
Jing Li
RALM
89
101
0
22 Sep 2023
DRG-LLaMA : Tuning LLaMA Model to Predict Diagnosis-related Group for
  Hospitalized Patients
DRG-LLaMA : Tuning LLaMA Model to Predict Diagnosis-related Group for Hospitalized Patients
Hanyin Wang
Chufan Gao
Christopher Dantona
Bryan Hull
Jimeng Sun
LM&MA
60
70
0
22 Sep 2023
LongLoRA: Efficient Fine-tuning of Long-Context Large Language Models
LongLoRA: Efficient Fine-tuning of Long-Context Large Language Models
Yukang Chen
Shengju Qian
Haotian Tang
Xin Lai
Zhijian Liu
Song Han
Jiaya Jia
167
170
0
21 Sep 2023
On the Relationship between Skill Neurons and Robustness in Prompt
  Tuning
On the Relationship between Skill Neurons and Robustness in Prompt Tuning
Leon Ackermann
Xenia Ohmer
AAML
42
0
0
21 Sep 2023
Previous
123...118119120...137138139
Next