FusionAI: Decentralized Training and Deploying LLMs with Massive Consumer-Level GPUs

3 September 2023

Papers citing "FusionAI: Decentralized Training and Deploying LLMs with Massive Consumer-Level GPUs"

7 / 7 papers shown

Title
DeServe: Towards Affordable Offline LLM Inference via Decentralization Linyu Wu Xiaoyuan Liu Tianneng Shi Zhe Ye D. Song OffRL 42 0 0 28 Jan 2025
LongGenBench: Long-context Generation Benchmark Xiang Liu Peijie Dong Xuming Hu Xiaowen Chu RALM 45 8 0 05 Oct 2024
FedImpro: Measuring and Improving Client Update in Federated Learning Zhenheng Tang Yonggang Zhang S. Shi Xinmei Tian Tongliang Liu Bo Han Xiaowen Chu FedML 22 13 0 10 Feb 2024
Revisiting Neural Scaling Laws in Language and Vision Ibrahim M. Alabdulmohsin Behnam Neyshabur Xiaohua Zhai 156 102 0 13 Sep 2022
Emerging Trends in Federated Learning: From Model Fusion to Federated X Learning Shaoxiong Ji Yue Tan Teemu Saravirta Zhiqin Yang Yixin Liu Lauri Vasankari Shirui Pan Guodong Long A. Walid FedML 37 76 0 25 Feb 2021
Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism M. Shoeybi M. Patwary Raul Puri P. LeGresley Jared Casper Bryan Catanzaro MoE 245 1,821 0 17 Sep 2019
A Style-Based Generator Architecture for Generative Adversarial Networks Tero Karras S. Laine Timo Aila 279 10,354 0 12 Dec 2018