Papers
Communities
Events
Blog
Pricing
Search
Open menu
Home
Papers
2402.11417
Cited By
LoRETTA: Low-Rank Economic Tensor-Train Adaptation for Ultra-Low-Parameter Fine-Tuning of Large Language Models
18 February 2024
Yifan Yang
Jiajun Zhou
Ngai Wong
Zheng Zhang
Re-assign community
ArXiv
PDF
HTML
Papers citing
"LoRETTA: Low-Rank Economic Tensor-Train Adaptation for Ultra-Low-Parameter Fine-Tuning of Large Language Models"
7 / 7 papers shown
Title
Decentralized Low-Rank Fine-Tuning of Large Language Models
Sajjad Ghiasvand
Mahnoosh Alizadeh
Ramtin Pedarsani
ALM
66
0
0
26 Jan 2025
DoTA: Weight-Decomposed Tensor Adaptation for Large Language Models
Xiaolin Hu
Xiang Cheng
Peiyu Liu
Wei Liu
Jian Luan
Bin Wang
Y. Liu
42
1
0
31 Dec 2024
Communication-Efficient and Tensorized Federated Fine-Tuning of Large Language Models
Sajjad Ghiasvand
Yifan Yang
Zhiyu Xue
Mahnoosh Alizadeh
Zheng Zhang
Ramtin Pedarsani
FedML
38
3
0
16 Oct 2024
Tensor Train Low-rank Approximation (TT-LoRA): Democratizing AI with Accelerated LLMs
Afia Anjum
Maksim E. Eren
V. Setlur
Boian Alexandrov
Manish Bhattarai
29
2
0
02 Aug 2024
BEBERT: Efficient and Robust Binary Ensemble BERT
Jiayi Tian
Chao Fang
Hong Wang
Zhongfeng Wang
MQ
32
16
0
28 Oct 2022
The Power of Scale for Parameter-Efficient Prompt Tuning
Brian Lester
Rami Al-Rfou
Noah Constant
VPVLM
280
3,858
0
18 Apr 2021
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding
Alex Jinpeng Wang
Amanpreet Singh
Julian Michael
Felix Hill
Omer Levy
Samuel R. Bowman
ELM
299
6,984
0
20 Apr 2018
1