ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2402.11417
  4. Cited By
LoRETTA: Low-Rank Economic Tensor-Train Adaptation for
  Ultra-Low-Parameter Fine-Tuning of Large Language Models

LoRETTA: Low-Rank Economic Tensor-Train Adaptation for Ultra-Low-Parameter Fine-Tuning of Large Language Models

18 February 2024
Yifan Yang
Jiajun Zhou
Ngai Wong
Zheng Zhang
ArXivPDFHTML

Papers citing "LoRETTA: Low-Rank Economic Tensor-Train Adaptation for Ultra-Low-Parameter Fine-Tuning of Large Language Models"

7 / 7 papers shown
Title
Decentralized Low-Rank Fine-Tuning of Large Language Models
Sajjad Ghiasvand
Mahnoosh Alizadeh
Ramtin Pedarsani
ALM
66
0
0
26 Jan 2025
DoTA: Weight-Decomposed Tensor Adaptation for Large Language Models
DoTA: Weight-Decomposed Tensor Adaptation for Large Language Models
Xiaolin Hu
Xiang Cheng
Peiyu Liu
Wei Liu
Jian Luan
Bin Wang
Y. Liu
44
1
0
31 Dec 2024
Communication-Efficient and Tensorized Federated Fine-Tuning of Large
  Language Models
Communication-Efficient and Tensorized Federated Fine-Tuning of Large Language Models
Sajjad Ghiasvand
Yifan Yang
Zhiyu Xue
Mahnoosh Alizadeh
Zheng Zhang
Ramtin Pedarsani
FedML
38
3
0
16 Oct 2024
Tensor Train Low-rank Approximation (TT-LoRA): Democratizing AI with
  Accelerated LLMs
Tensor Train Low-rank Approximation (TT-LoRA): Democratizing AI with Accelerated LLMs
Afia Anjum
Maksim E. Eren
V. Setlur
Boian Alexandrov
Manish Bhattarai
31
2
0
02 Aug 2024
BEBERT: Efficient and Robust Binary Ensemble BERT
BEBERT: Efficient and Robust Binary Ensemble BERT
Jiayi Tian
Chao Fang
Hong Wang
Zhongfeng Wang
MQ
32
16
0
28 Oct 2022
The Power of Scale for Parameter-Efficient Prompt Tuning
The Power of Scale for Parameter-Efficient Prompt Tuning
Brian Lester
Rami Al-Rfou
Noah Constant
VPVLM
280
3,858
0
18 Apr 2021
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language
  Understanding
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding
Alex Jinpeng Wang
Amanpreet Singh
Julian Michael
Felix Hill
Omer Levy
Samuel R. Bowman
ELM
299
6,984
0
20 Apr 2018
1