Great Power, Great Responsibility: Recommendations for Reducing Energy
for Training Language Models

Great Power, Great Responsibility: Recommendations for Reducing Energy for Training Language Models

19 May 2022

Joseph McDonald

Baolin Li

Devesh Tiwari

Papers citing "Great Power, Great Responsibility: Recommendations for Reducing Energy for Training Language Models"

5 / 5 papers shown

Title
Fast RoPE Attention: Combining the Polynomial Method and Fast Fourier Transform Josh Alman Zhao Song 4 0 0 17 May 2025
Towards Sustainable NLP: Insights from Benchmarking Inference Energy in Large Language Models S. Poddar Paramita Koley Janardan Misra Niloy Ganguly Saptarshi Ghosh Saptarshi Ghosh 64 0 0 08 Feb 2025
Adaptive Inference: Theoretical Limits and Unexplored Opportunities S. Hor Ying Qian Mert Pilanci Amin Arbabian 23 0 0 06 Feb 2024
Carbon Emissions and Large Neural Network Training David A. Patterson Joseph E. Gonzalez Quoc V. Le Chen Liang Lluís-Miquel Munguía D. Rothchild David R. So Maud Texier J. Dean AI4CE 253 645 0 21 Apr 2021
Big Bird: Transformers for Longer Sequences Manzil Zaheer Guru Guruganesh Kumar Avinava Dubey Joshua Ainslie Chris Alberti ... Philip Pham Anirudh Ravula Qifan Wang Li Yang Amr Ahmed VLM 285 2,017 0 28 Jul 2020