Great Power, Great Responsibility: Recommendations for Reducing Energy
for Training Language Models

Great Power, Great Responsibility: Recommendations for Reducing Energy for Training Language Models

19 May 2022

Joseph McDonald

Baolin Li

Devesh Tiwari

Papers citing "Great Power, Great Responsibility: Recommendations for Reducing Energy for Training Language Models"

4 / 4 papers shown

Title
Towards Sustainable NLP: Insights from Benchmarking Inference Energy in Large Language Models S. Poddar Paramita Koley Janardan Misra Niloy Ganguly Saptarshi Ghosh Saptarshi Ghosh 61 0 0 08 Feb 2025
Adaptive Inference: Theoretical Limits and Unexplored Opportunities S. Hor Ying Qian Mert Pilanci Amin Arbabian 23 0 0 06 Feb 2024
Carbon Emissions and Large Neural Network Training David A. Patterson Joseph E. Gonzalez Quoc V. Le Chen Liang Lluís-Miquel Munguía D. Rothchild David R. So Maud Texier J. Dean AI4CE 244 644 0 21 Apr 2021
Big Bird: Transformers for Longer Sequences Manzil Zaheer Guru Guruganesh Kumar Avinava Dubey Joshua Ainslie Chris Alberti ... Philip Pham Anirudh Ravula Qifan Wang Li Yang Amr Ahmed VLM 280 2,015 0 28 Jul 2020