Carbon Emissions and Large Neural Network Training

21 April 2021

Papers citing "Carbon Emissions and Large Neural Network Training"

50 / 109 papers shown

Title
How Do Companies Manage the Environmental Sustainability of AI? An Interview Study About Green AI Efforts and Regulations Ashmita Sampatsing Sophie Vos Emma Beauxis-Aussalet Justus Bogner 30 0 0 12 May 2025
From Knowledge to Reasoning: Evaluating LLMs for Ionic Liquids Research in Chemical and Biological Engineering Gaurab Sarkar Sougata Saha 21 0 0 11 May 2025
Learn to Think: Bootstrapping LLM Reasoning Capability Through Graph Learning Hang Gao Chenhao Zhang Tie Wang Junsuo Zhao Fengge Wu Changwen Zheng Huaping Liu LRM 29 0 0 09 May 2025
The ML.ENERGY Benchmark: Toward Automated Inference Energy Measurement and Optimization Jae-Won Chung Jiachen Liu Jeff J. Ma Ruofan Wu Oh Jun Kweon Yuxuan Xia Zhiyu Wu Mosharaf Chowdhury 28 0 0 09 May 2025
Beyond Low-rank Decomposition: A Shortcut Approach for Efficient On-Device Learning Le-Trung Nguyen Ael Quélennec Van-Tam Nguyen Enzo Tartaglione 43 0 0 08 May 2025
Backdoor Attacks Against Patch-based Mixture of Experts Cedric Chan Jona te Lintelo S. Picek AAML MoE 137 0 0 03 May 2025
Efficient Shapley Value-based Non-Uniform Pruning of Large Language Models Chuan Sun Han Yu Lizhen Cui Xiaoxiao Li 83 0 0 03 May 2025
Don't be lazy: CompleteP enables compute-efficient deep transformers Nolan Dey Bin Claire Zhang Lorenzo Noci Mufan Bill Li Blake Bordelon Shane Bergsma C. Pehlevan Boris Hanin Joel Hestness 39 0 0 02 May 2025
SmallPlan: Leverage Small Language Models for Sequential Path Planning with Simulation-Powered, LLM-Guided Distillation Quang P.M. Pham Khoi T.N. Nguyen Nhi H. Doan Cuong Pham Kentaro Inui Dezhen Song 62 0 0 01 May 2025
The Rise of Small Language Models in Healthcare: A Comprehensive Survey Muskan Garg Shaina Raza Shebuti Rayana Xingyi Liu Sunghwan Sohn LM&MA AILaw 89 0 0 23 Apr 2025
Towards Sustainable NLP: Insights from Benchmarking Inference Energy in Large Language Models S. Poddar Paramita Koley Janardan Misra Niloy Ganguly Saptarshi Ghosh Saptarshi Ghosh 61 0 0 08 Feb 2025
Life-Cycle Emissions of AI Hardware: A Cradle-To-Grave Approach and Generational Trends Ian Schneider Hui Xu Stephan Benecke David Patterson Keguo Huang Parthasarathy Ranganathan Cooper Elsworth 65 2 0 01 Feb 2025
Enhancing Monocular Depth Estimation with Multi-Source Auxiliary Tasks Alessio Quercia Erenus Yildiz Zhuo Cao Kai Krajsek Abigail Morrison Ira Assent Hanno Scharr 51 0 0 22 Jan 2025
SPAM: Spike-Aware Adam with Momentum Reset for Stable LLM Training Tianjin Huang Ziquan Zhu Gaojie Jin Lu Liu Zhangyang Wang Shiwei Liu 42 1 0 12 Jan 2025
MLPerf Power: Benchmarking the Energy Efficiency of Machine Learning Systems from Microwatts to Megawatts for Sustainable AI Arya Tschand Arun Tejusve Raghunath Rajan S. Idgunji Anirban Ghosh J. Holleman ... Rowan Taubitz Sean Zhan Scott Wasson David Kanter Vijay Janapa Reddi 62 3 0 15 Oct 2024
Bridging Today and the Future of Humanity: AI Safety in 2024 and Beyond Shanshan Han 78 1 0 09 Oct 2024
SOI: Scaling Down Computational Complexity by Estimating Partial States of the Model Grzegorz Stefański P. Daniluk Artur Szumaczuk Jakub Tkaczuk 26 0 0 04 Oct 2024
SYNTHEVAL: Hybrid Behavioral Testing of NLP Models with Synthetic CheckLists Raoyuan Zhao Abdullatif Köksal Yihong Liu Leonie Weissweiler Anna Korhonen Hinrich Schütze SyDa 36 1 0 30 Aug 2024
Constructing artificial life and materials scientists with accelerated AI using Deep AndersoNN Saleem Al Dajani David Keyes AI4CE 39 0 0 29 Jul 2024
Privacy-Preserving Data Deduplication for Enhancing Federated Learning of Language Models Aydin Abadi Vishnu Asutosh Dasu Sumanta Sarkar 38 3 0 11 Jul 2024
Mobile Edge Intelligence for Large Language Models: A Contemporary Survey Guanqiao Qu Qiyuan Chen Wei Wei Zheng Lin Xianhao Chen Kaibin Huang 42 43 0 09 Jul 2024
On Giant's Shoulders: Effortless Weak to Strong by Dynamic Logits Fusion Chenghao Fan Zhenyi Lu Wei Wei Jie Tian Xiaoye Qu Dangyang Chen Yu Cheng MoMe 48 5 0 17 Jun 2024
Decision Boundary-aware Knowledge Consolidation Generates Better Instance-Incremental Learner Qiang Nie Weifu Fu Yuhuan Lin Jialin Li Yifeng Zhou Yong Liu Lei Zhu Chengjie Wang 30 0 0 05 Jun 2024
REDUCR: Robust Data Downsampling Using Class Priority Reweighting William Bankes George Hughes Ilija Bogunovic Zi Wang 18 3 0 01 Dec 2023
Power Hungry Processing: Watts Driving the Cost of AI Deployment? Sasha Luccioni Yacine Jernite Emma Strubell 42 162 0 28 Nov 2023
Online Continual Knowledge Learning for Language Models Yuhao Wu Tongjun Shi Karthick Sharma Chun Seah Shuhao Zhang CLL KELM 23 4 0 16 Nov 2023
AI-native Interconnect Framework for Integration of Large Language Model Technologies in 6G Systems Sasu Tarkoma Roberto Morabito Jaakko Sauvola 23 19 0 10 Nov 2023
Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High Sparsity Lu Yin You Wu Zhenyu (Allen) Zhang Cheng-Yu Hsieh Yaqing Wang ... Mykola Pechenizkiy Yi Liang Michael Bendersky Zhangyang Wang Shiwei Liu 28 78 0 08 Oct 2023
LLMCarbon: Modeling the end-to-end Carbon Footprint of Large Language Models Ahmad Faiz S. Kaneda Ruhan Wang Rita Osi Parteek Sharma Fan Chen Lei Jiang 23 56 0 25 Sep 2023
Efficiency is Not Enough: A Critical Perspective of Environmentally Sustainable AI Dustin Wright Christian Igel Gabrielle Samuel Raghavendra Selvan 29 15 0 05 Sep 2023
Potential Energy Advantage of Quantum Economy Junyu Liu Hansheng Jiang Zuo‐Jun Max Shen 10 1 0 15 Aug 2023
Llama 2: Open Foundation and Fine-Tuned Chat Models Hugo Touvron Louis Martin Kevin R. Stone Peter Albert Amjad Almahairi ... Sharan Narang Aurelien Rodriguez Robert Stojnic Sergey Edunov Thomas Scialom AI4MH ALM 90 10,977 0 18 Jul 2023
Solving Large-scale Spatial Problems with Convolutional Neural Networks Damian Owerko Charilaos I. Kanatsoulis Alejandro Ribeiro 22 2 0 14 Jun 2023
DoReMi: Optimizing Data Mixtures Speeds Up Language Model Pretraining Sang Michael Xie Hieu H. Pham Xuanyi Dong Nan Du Hanxiao Liu Yifeng Lu Percy Liang Quoc V. Le Tengyu Ma Adams Wei Yu MoMe MoE 31 174 0 17 May 2023
Analyzing Compression Techniques for Computer Vision Maniratnam Mandal Imran Khan 24 1 0 14 May 2023
Efficient Neural Network based Classification and Outlier Detection for Image Moderation using Compressed Sensing and Group Testing Sabyasachi Ghosh Sanyam Saxena Ajit V. Rajwade 22 0 0 12 May 2023
Backpropagation-free Training of Deep Physical Neural Networks Ali Momeni Babak Rahmani M. Malléjac Philipp del Hougne Romain Fleury AI4CE PINN 19 54 0 20 Apr 2023
Clover: Toward Sustainable AI with Carbon-Aware Machine Learning Inference Service Baolin Li S. Samsi V. Gadepally Devesh Tiwari 20 27 0 19 Apr 2023
Energy Efficiency Considerations for Popular AI Benchmarks Raphael Fischer Matthias Jakobs K. Morik 14 4 0 17 Apr 2023
DINOv2: Learning Robust Visual Features without Supervision Maxime Oquab Timothée Darcet Théo Moutakanni Huy Q. Vo Marc Szafraniec ... Hervé Jégou Julien Mairal Patrick Labatut Armand Joulin Piotr Bojanowski VLM CLIP SSL 101 3,017 0 14 Apr 2023
ChatGPT Needs SPADE (Sustainability, PrivAcy, Digital divide, and Ethics) Evaluation: A Review Sunder Ali Khowaja P. Khuwaja K. Dev Weizheng Wang Lewis Nkenyereye 27 76 0 13 Apr 2023
Energy-Efficient GPU Clusters Scheduling for Deep Learning Diandian Gu Xintong Xie Gang Huang Xin Jin Xuanzhe Liu GNN 13 7 0 13 Apr 2023
Making AI Less "Thirsty": Uncovering and Addressing the Secret Water Footprint of AI Models Pengfei Li Jianyi Yang M. A. Islam Shaolei Ren 81 120 0 06 Apr 2023
Segment Anything A. Kirillov Eric Mintun Nikhila Ravi Hanzi Mao Chloe Rolland ... Spencer Whitehead Alexander C. Berg Wan-Yen Lo Piotr Dollár Ross B. Girshick MLLM VLM 22 6,796 0 05 Apr 2023
How Efficient Are Today's Continual Learning Algorithms? Md Yousuf Harun Jhair Gallardo Tyler L. Hayes Christopher Kanan 16 22 0 29 Mar 2023
An Empirical Study of Pre-Trained Model Reuse in the Hugging Face Deep Learning Model Registry Wenxin Jiang Nicholas Synovic Matt Hyatt Taylor R. Schorlemmer R. Sethi Yung-Hsiang Lu George K. Thiruvathukal James C. Davis 25 63 0 05 Mar 2023
Discrepancies among Pre-trained Deep Neural Networks: A New Threat to Model Zoo Reliability Diego Montes Pongpatapee Peerapatanapokin Jeff Schultz Chengjun Guo Wenxin Jiang James C. Davis 11 14 0 05 Mar 2023
Topological Feature Selection Antonio Briola T. Aste 27 3 0 19 Feb 2023
Learning a Consensus Sub-Network with Polarization Regularization and One Pass Training Xiaoying Zhi Varun Babbar P. Sun Fran Silavong Ruibo Shi Sean J. Moran Sean Moran 34 1 0 17 Feb 2023
SplitOut: Out-of-the-Box Training-Hijacking Detection in Split Learning via Outlier Detection Ege Erdogan Unat Teksen Mehmet Salih Celiktenyildiz Alptekin Kupcu A. E. Cicek 32 4 0 16 Feb 2023