Offline Energy-Optimal LLM Serving: Workload-Based Energy Models for LLM Inference on Heterogeneous Systems

4 July 2024

Papers citing "Offline Energy-Optimal LLM Serving: Workload-Based Energy Models for LLM Inference on Heterogeneous Systems"

10 / 10 papers shown

Title
Mixtral of Experts Albert Q. Jiang Alexandre Sablayrolles Antoine Roux A. Mensch Blanche Savary ... Théophile Gervet Thibaut Lavril Thomas Wang Timothée Lacroix William El Sayed MoE LLMAG 164 1,123 0 08 Jan 2024
Exploding AI Power Use: an Opportunity to Rethink Grid Planning and Management Liuzixuan Lin Rajini Wijayawardana V. Rao Hai Nguyen Emmanuel Wedan Gnibga Andrew A. Chien 37 10 0 20 Nov 2023
From Words to Watts: Benchmarking the Energy Costs of Large Language Model Inference S. Samsi Dan Zhao Joseph McDonald Baolin Li Adam Michaleas Michael Jones William Bergeron J. Kepner Devesh Tiwari V. Gadepally 76 150 0 04 Oct 2023
Energy-Efficient GPU Clusters Scheduling for Deep Learning Diandian Gu Xintong Xie Gang Huang Xin Jin Xuanzhe Liu GNN 55 7 0 13 Apr 2023
Estimating the Carbon Footprint of BLOOM, a 176B Parameter Language Model A. Luccioni S. Viguier Anne-Laure Ligozat 101 290 0 03 Nov 2022
Treehouse: A Case For Carbon-Aware Datacenter Software Thomas Anderson Adam Belay Mosharaf Chowdhury Asaf Cidon Irene Zhang 87 63 0 06 Jan 2022
Sustainable AI: Environmental Implications, Challenges and Opportunities Carole-Jean Wu Ramya Raghavendra Udit Gupta Bilge Acun Newsha Ardalani ... Maximilian Balandat Joe Spisak R. Jain Michael G. Rabbat K. Hazelwood 132 411 0 30 Oct 2021
Characterization and Prediction of Deep Learning Workloads in Large-Scale GPU Datacenters Qi Hu Peng Sun Shengen Yan Yonggang Wen Tianwei Zhang 3DH GNN 82 133 0 03 Sep 2021
Carbon Emissions and Large Neural Network Training David A. Patterson Joseph E. Gonzalez Quoc V. Le Chen Liang Lluís-Miquel Munguía D. Rothchild David R. So Maud Texier J. Dean AI4CE 341 682 0 21 Apr 2021
Towards the Systematic Reporting of the Energy and Carbon Footprints of Machine Learning Peter Henderson Jie Hu Joshua Romoff Emma Brunskill Dan Jurafsky Joelle Pineau 94 457 0 31 Jan 2020