The Carbon Footprint of Machine Learning Training Will Plateau, Then Shrink

11 April 2022

Papers citing "The Carbon Footprint of Machine Learning Training Will Plateau, Then Shrink"

50 / 114 papers shown

Title
Breaking the ICE: Exploring promises and challenges of benchmarks for Inference Carbon & Energy estimation for LLMs Samarth Sikand Rohit Mehra Priyavanshi Pathania Nikhil Bamby Vibhu Saujanya Sharma Vikrant Kaulgud Sanjay Podder Adam P. Burden 20 0 0 10 Jun 2025
Brevity is the soul of sustainability: Characterizing LLM response lengths S. Poddar Paramita Koley Janardan Misra Sanjay Podder Navveen Balani Niloy Ganguly Saptarshi Ghosh 32 0 0 10 Jun 2025
AnnaAgent: Dynamic Evolution Agent System with Multi-Session Memory for Realistic Seeker Simulation Ming Wang Peidong Wang Lin Wu Xiaocui Yang Daling Wang Shi Feng Yuxin Chen B. Wang Yifei Zhang 35 0 0 31 May 2025
ResSVD: Residual Compensated SVD for Large Language Model Compression Haolei Bai Siyong Jian Tuo Liang Yu Yin Huan Wang 46 0 0 26 May 2025
Guidelines for the Quality Assessment of Energy-Aware NAS Benchmarks Nick Kocher Christian Wassermann Leona Hennig Jonas Seng Holger Hoos Kristian Kersting Marius Lindauer Matthias Müller 109 0 0 21 May 2025
The Energy Cost of Reasoning: Analyzing Energy Usage in LLMs with Test-time Compute Yunho Jin Gu-Yeon Wei David Brooks LRM 115 0 0 20 May 2025
GreenFactory: Ensembling Zero-Cost Proxies to Estimate Performance of Neural Networks Gabriel Cortes Nuno Lourenço Paolo Romano Penousal Machado UQCV FedML 65 0 0 14 May 2025
Energy Considerations of Large Language Model Inference and Efficiency Optimizations Jared Fernandez Clara Na Vashisth Tiwari Yonatan Bisk Sasha Luccioni Emma Strubell 115 5 0 24 Apr 2025
Out of Style: RAG's Fragility to Linguistic Variation Tianyu Cao Neel Bhandari Akhila Yerukola Akari Asai Maarten Sap 78 2 0 11 Apr 2025
A Survey of Scaling in Large Language Model Reasoning Zihan Chen Song Wang Zhen Tan Xingbo Fu Zhenyu Lei Peng Wang Huan Liu Cong Shen Jundong Li LRM 239 2 0 02 Apr 2025
Green MLOps to Green GenOps: An Empirical Study of Energy Consumption in Discriminative and Generative AI Operations Adrián Sánchez-Mompó Ioannis Mavromatis Peizheng Li Konstantinos Katsaros Aftab Khan 99 0 0 31 Mar 2025
Entropy-based Exploration Conduction for Multi-step Reasoning Jinghan Zhang Xiting Wang Fengran Mo Yeyang Zhou Wanfu Gao Kunpeng Liu LRM 122 5 0 20 Mar 2025
VisTW: Benchmarking Vision-Language Models for Traditional Chinese in Taiwan Zhi Rui Tam Ya-Ting Pai Yen-Wei Lee Yun-Nung Chen CoGe 173 0 0 13 Mar 2025
DynTaskMAS: A Dynamic Task Graph-driven Framework for Asynchronous and Parallel LLM-based Multi-Agent Systems Junwei Yu Yepeng Ding Hiroyuki Sato AI4CE LLMAG 82 0 0 10 Mar 2025
FairSense-AI: Responsible AI Meets Sustainability Shaina Raza Mukund Sayeeganesh Chettiar Matin Yousefabadi Tahniat Khan Marcelo Lotif 84 0 0 04 Mar 2025
Climate And Resource Awareness is Imperative to Achieving Sustainable AI (and Preventing a Global AI Arms Race) Pedram Bakhtiarifard Pınar Tözün Christian Igel Raghavendra Selvan 119 0 0 27 Feb 2025
Can LLM Agents Maintain a Persona in Discourse? Pranav Bhandari Nicolas Fay Michael Wise Amitava Datta Stephanie Meek Usman Naseem Mehwish Nasim 113 1 0 17 Feb 2025
Towards Sustainable NLP: Insights from Benchmarking Inference Energy in Large Language Models S. Poddar Paramita Koley Janardan Misra Niloy Ganguly Saptarshi Ghosh Saptarshi Ghosh 149 0 0 08 Feb 2025
OverThink: Slowdown Attacks on Reasoning LLMs A. Kumar Jaechul Roh A. Naseh Marzena Karpinska Mohit Iyyer Amir Houmansadr Eugene Bagdasarian LRM 155 25 0 04 Feb 2025
Towards Sustainable Large Language Model Serving Sophia Nguyen Beihao Zhou Yi Ding Sihang Liu 220 10 0 31 Dec 2024
How Green Can AI Be? A Study of Trends in Machine Learning Environmental Impacts Clément Morand Anne-Laure Ligozat Aurélie Névéol 45 0 0 23 Dec 2024
Towards Environmentally Equitable AI Mohammad Hajiesmaili Shaolei Ren R. Sitaraman Adam Wierman 121 0 0 21 Dec 2024
Shaping AI's Impact on Billions of Lives Mariano-Florentino Cuéllar J. Dean Finale Doshi-Velez John Hennessy Andy Konwinski Sanmi Koyejo Pelonomi Moiloa Emma Pierson David A. Patterson SILM AI4TS 128 1 0 03 Dec 2024
GreenMachine: Automatic Design of Zero-Cost Proxies for Energy-Efficient NAS Gabriel Cortes Nuno Lourenço Penousal Machado 124 1 0 22 Nov 2024
Principles of Visual Tokens for Efficient Video Understanding Xinyue Hao Gen Li Shreyank N. Gowda Robert B Fisher Jonathan Huang Anurag Arnab Laura Sevilla-Lara 191 0 0 20 Nov 2024
Hardware Scaling Trends and Diminishing Returns in Large-Scale Distributed Training Jared Fernandez Luca Wehrstedt Leonid Shamis Mostafa Elhoushi Kalyan Saladi Yonatan Bisk Emma Strubell Jacob Kahn 553 4 0 20 Nov 2024
A System Level Performance Evaluation for Superconducting Digital Systems Joyjit Kundu Debjyoti Bhattacharjee Nathan Josephsen Ankit Pokhrel Udara De Silva ... Steven Van Winckel Steven Brebels Manu Perumkunnil Quentin Herr Anna Herr 37 0 0 13 Nov 2024
Blind Spot Navigation in LLM Reasoning with Thought Space Explorer Jinghan Zhang Fengran Mo Xiting Wang Kunpeng Liu LM&Ro LRM 137 5 0 31 Oct 2024
AI-focused HPC Data Centers Can Provide More Power Grid Flexibility and at Lower Cost Yihong Zhou Angel Paredes Chaimaa Essayeh Thomas Morstyn 21 0 0 22 Oct 2024
Ethics Whitepaper: Whitepaper on Ethical Research into Large Language Models Eddie L. Ungless Nikolas Vitsakis Zeerak Talat James Garforth Bjorn Ross Arno Onken Atoosa Kasirzadeh Alexandra Birch 71 1 0 17 Oct 2024
TensorSocket: Shared Data Loading for Deep Learning Training Ties Robroek Neil Kim Nielsen Pınar Tözün 56 2 0 27 Sep 2024
LUT Tensor Core: A Software-Hardware Co-Design for LUT-Based Low-Bit LLM Inference Zhiwen Mo Lei Wang Jianyu Wei Zhichen Zeng Shijie Cao ... Naifeng Jing Ting Cao Jilong Xue Fan Yang Mao Yang 120 4 0 12 Aug 2024
Computing Within Limits: An Empirical Study of Energy Consumption in ML Training and Inference Ioannis Mavromatis Kostas Katsaros Aftab Khan 56 2 0 20 Jun 2024
Beyond Efficiency: Scaling AI Sustainably Carole-Jean Wu Bilge Acun Ramya Raghavendra Kim Hazelwood GNN 100 19 0 08 Jun 2024
Building Socially-Equitable Public Models Yejia Liu Jianyi Yang Pengfei Li Tongxin Li Shaolei Ren OffRL 101 0 0 04 Jun 2024
Exploring Effects of Hyperdimensional Vectors for Tsetlin Machines Vojtech Halenka Ahmed K. Kadhim Paul F. A. Clarke Bimal Bhattarai Rupsa Saha Ole-Christoffer Granmo Lei Jiao Per-Arne Andersen 82 2 0 04 Jun 2024
Carbon Connect: An Ecosystem for Sustainable Computing Benjamin C. Lee David Brooks Arthur van Benthem Udit Gupta G. Hills ... Emma Strubell Gu-Yeon Wei Adam Wierman Yuan Yao Minlan Yu 43 2 0 22 May 2024
Sociotechnical Implications of Generative Artificial Intelligence for Information Access Bhaskar Mitra Henriette Cramer Olya Gurevich 123 2 0 19 May 2024
Efficient Deep Learning with Decorrelated Backpropagation Sander Dalm Joshua Offergeld Nasir Ahmad Marcel van Gerven 173 5 0 03 May 2024
Lessons from the Use of Natural Language Inference (NLI) in Requirements Engineering Tasks Mohamad Fazelnia Viktoria Koscinski Spencer Herzog Mehdi Mirakhorli 88 8 0 24 Apr 2024
Lightweight Inference for Forward-Forward Algorithm Amin Aminifar Baichuan Huang Azra Abtahi Amir Aminifar 137 3 0 08 Apr 2024
Toward Sustainable GenAI using Generation Directives for Carbon-Friendly Large Language Model Inference Baolin Li Yankai Jiang V. Gadepally Devesh Tiwari 94 15 0 19 Mar 2024
MELTing point: Mobile Evaluation of Language Transformers Stefanos Laskaridis Kleomenis Katevas Lorenzo Minto Hamed Haddadi 95 24 0 19 Mar 2024
EncodingNet: A Novel Encoding-based MAC Design for Efficient Neural Network Acceleration Bo Liu Grace Li Zhang Xunzhao Yin Ulf Schlichtmann Bing Li MQ AI4CE 77 0 0 25 Feb 2024
Towards Physical Plausibility in Neuroevolution Systems Gabriel Cortes Nuno Lourenço Penousal Machado 78 2 0 31 Jan 2024
Information-Theoretic State Variable Selection for Reinforcement Learning Charles Westphal Stephen Hailes Mirco Musolesi 76 3 0 21 Jan 2024
Computational Argumentation-based Chatbots: a Survey Federico Castagna Nadin Kökciyan I. Sassoon Simon Parsons Elizabeth I. Sklar 108 7 0 07 Jan 2024
The Power of Training: How Different Neural Network Setups Influence the Energy Demand Daniel Geissler Bo Zhou Mengxi Liu Sungho Suh P. Lukowicz 62 9 0 03 Jan 2024
AutoXPCR: Automated Multi-Objective Model Selection for Time Series Forecasting Raphael Fischer Amal Saadallah 62 0 0 20 Dec 2023
Climate Change from Large Language Models Hongyin Zhu Prayag Tiwari ELM 72 7 0 19 Dec 2023