Estimating the Carbon Footprint of BLOOM, a 176B Parameter Language Model

3 November 2022

Papers citing "Estimating the Carbon Footprint of BLOOM, a 176B Parameter Language Model"

40 / 40 papers shown

Title
MCU: Improving Machine Unlearning through Mode Connectivity Yingdan Shi Ren Wang MU 12 0 0 16 May 2025
How Do Companies Manage the Environmental Sustainability of AI? An Interview Study About Green AI Efforts and Regulations Ashmita Sampatsing Sophie Vos Emma Beauxis-Aussalet Justus Bogner 30 0 0 12 May 2025
The ML.ENERGY Benchmark: Toward Automated Inference Energy Measurement and Optimization Jae-Won Chung Jiachen Liu Jeff J. Ma Ruofan Wu Oh Jun Kweon Yuxuan Xia Zhiyu Wu Mosharaf Chowdhury 31 0 0 09 May 2025
OBLIVIATE: Robust and Practical Machine Unlearning for Large Language Models Xiaoyu Xu Minxin Du Qingqing Ye Haibo Hu MU 57 0 0 07 May 2025
Efficient Shapley Value-based Non-Uniform Pruning of Large Language Models Chuan Sun Han Yu Lizhen Cui Xiaoxiao Li 120 0 0 03 May 2025
PatientDx: Merging Large Language Models for Protecting Data-Privacy in Healthcare José G. Moreno Jesus Lovon M'Rick Robin-Charlet Christine Damase-Michel L. Tamine MoMe LM&MA 58 0 0 24 Apr 2025
Green Prompting Marta Adamska Daria Smirnova Hamid Nasiri Zhengxin Yu Peter Garraghan 187 0 0 09 Mar 2025
Life-Cycle Emissions of AI Hardware: A Cradle-To-Grave Approach and Generational Trends Ian Schneider Hui Xu Stephan Benecke David Patterson Keguo Huang Parthasarathy Ranganathan Cooper Elsworth 70 2 0 01 Feb 2025
TAID: Temporally Adaptive Interpolated Distillation for Efficient Knowledge Transfer in Language Models Makoto Shing Kou Misaki Han Bao Sho Yokoi Takuya Akiba VLM 57 1 0 28 Jan 2025
Human services organizations and the responsible integration of AI: Considering ethics and contextualizing risk(s) Brian E. Perron Lauri Goldkind Zia Qi Bryan G. Victor SILM 36 0 0 20 Jan 2025
Surveying Attitudinal Alignment Between Large Language Models Vs. Humans Towards 17 Sustainable Development Goals Qingyang Wu Ying Xu Tingsong Xiao Yunze Xiao Yitong Li ... Yichi Zhang Shanghai Zhong Yuwei Zhang Wei Lu Yifan Yang 78 2 0 17 Jan 2025
Self-calibration for Language Model Quantization and Pruning Miles Williams G. Chrysostomou Nikolaos Aletras MQ 168 0 0 22 Oct 2024
Benchmarking Defeasible Reasoning with Large Language Models -- Initial Experiments and Future Directions Ilias Tachmazidis Sotiris Batsakis G. Antoniou ReLM LRM 27 0 0 16 Oct 2024
The Energy Cost of Artificial Intelligence Lifecycle in Communication Networks Shih-Kai Chou Jernej Hribar William Alberto Cruz Castañeda M. Mohorčič Carolina Fortuna 50 0 0 01 Aug 2024
Impact of Model Size on Fine-tuned LLM Performance in Data-to-Text Generation: A State-of-the-Art Investigation Joy Mahapatra Utpal Garain 42 8 0 19 Jul 2024
LABOR-LLM: Language-Based Occupational Representations with Large Language Models Tianyu Du Ayush Kanodia Herman Brunborg Keyon Vafa Susan Athey 37 3 0 25 Jun 2024
HORAE: A Domain-Agnostic Language for Automated Service Regulation Yutao Sun Mingshuai Chen Tiancheng Zhao Kangjia Zhao He Li ... Zhongyi Wang Liqiang Lu Shuiguang Deng Jianwei Yin Jianwei Yin 187 1 0 06 Jun 2024
Enabling High-Sparsity Foundational Llama Models with Efficient Pretraining and Deployment Abhinav Agarwalla Abhay Gupta Alexandre Marques Shubhra Pandit Michael Goin ... Tuan Nguyen Mahmoud Salem Dan Alistarh Sean Lie Mark Kurtz MoE SyDa 40 11 0 06 May 2024
Investigating Continual Pretraining in Large Language Models: Insights and Implications cCaugatay Yildiz Nishaanth Kanna Ravichandran Prishruit Punia Matthias Bethge Beyza Ermis CLL KELM LRM 58 25 0 27 Feb 2024
CroissantLLM: A Truly Bilingual French-English Language Model Manuel Faysse Patrick Fernandes Nuno M. Guerreiro António Loison Duarte M. Alves ... François Yvon André F.T. Martins Gautier Viaud C´eline Hudelot Pierre Colombo 55 32 0 01 Feb 2024
Towards Physical Plausibility in Neuroevolution Systems Gabriel Cortes Nuno Lourenço Penousal Machado 14 2 0 31 Jan 2024
TeenyTinyLlama: open-source tiny language models trained in Brazilian Portuguese N. Corrêa Sophia Falk Shiza Fatimah Aniket Sen N. D. Oliveira 30 9 0 30 Jan 2024
AI Art is Theft: Labour, Extraction, and Exploitation, Or, On the Dangers of Stochastic Pollocks T. S. Goetze 22 13 0 10 Jan 2024
Power Hungry Processing: Watts Driving the Cost of AI Deployment? Sasha Luccioni Yacine Jernite Emma Strubell 44 161 0 28 Nov 2023
Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High Sparsity Lu Yin You Wu Zhenyu (Allen) Zhang Cheng-Yu Hsieh Yaqing Wang ... Mykola Pechenizkiy Yi Liang Michael Bendersky Zhangyang Wang Shiwei Liu 30 79 0 08 Oct 2023
Efficiency is Not Enough: A Critical Perspective of Environmentally Sustainable AI Dustin Wright Christian Igel Gabrielle Samuel Raghavendra Selvan 32 15 0 05 Sep 2023
ADLER -- An efficient Hessian-based strategy for adaptive learning rate Dario Balboni D. Bacciu ODL 24 1 0 25 May 2023
GPT-SW3: An Autoregressive Language Model for the Nordic Languages Ariel Ekgren Amaru Cuba Gyllensten Felix Stollenwerk Joey Öhman T. Isbister Evangelia Gogoulou F. Carlsson Alice Heiman Judit Casademont Magnus Sahlgren 29 13 0 22 May 2023
Using Language Models to Detect Alarming Student Responses Christopher M. Ormerod Milan Patel Harry Wang 51 0 0 12 May 2023
ChatGPT Needs SPADE (Sustainability, PrivAcy, Digital divide, and Ethics) Evaluation: A Review Sunder Ali Khowaja P. Khuwaja K. Dev Weizheng Wang Lewis Nkenyereye 29 76 0 13 Apr 2023
Making AI Less "Thirsty": Uncovering and Addressing the Secret Water Footprint of AI Models Pengfei Li Jianyi Yang M. A. Islam Shaolei Ren 86 122 0 06 Apr 2023
DrBERT: A Robust Pre-trained Model in French for Biomedical and Clinical domains Yanis Labrak Adrien Bazoge Richard Dufour Mickael Rouvier Emmanuel Morin B. Daille P. Gourraud LM&MA 25 54 0 03 Apr 2023
How Efficient Are Today's Continual Learning Algorithms? Md Yousuf Harun Jhair Gallardo Tyler L. Hayes Christopher Kanan 24 24 0 29 Mar 2023
Unit Scaling: Out-of-the-Box Low-Precision Training Charlie Blake Douglas Orr Carlo Luschi MQ 24 7 0 20 Mar 2023
Counting Carbon: A Survey of Factors Influencing the Emissions of Machine Learning A. Luccioni Alex Hernandez-Garcia 34 45 0 16 Feb 2023
Demystifying Prompts in Language Models via Perplexity Estimation Hila Gonen Srini Iyer Terra Blevins Noah A. Smith Luke Zettlemoyer LRM 46 196 0 08 Dec 2022
BLOOM: A 176B-Parameter Open-Access Multilingual Language Model BigScience Workshop : Teven Le Scao Angela Fan Christopher Akiki ... Zhongli Xie Zifan Ye M. Bras Younes Belkada Thomas Wolf VLM 118 2,315 0 09 Nov 2022
What Language Model to Train if You Have One Million GPU Hours? Teven Le Scao Thomas Wang Daniel Hesslow Lucile Saulnier Stas Bekman ... Lintang Sutawika Jaesung Tae Zheng-Xin Yong Julien Launay Iz Beltagy MoE AI4CE 230 103 0 27 Oct 2022
Towards Quantifying the Carbon Emissions of Differentially Private Machine Learning Rakshit Naidu Harshita Diddee Ajinkya Mulay Aleti Vardhan Krithika Ramesh Ahmed S. Zamzam 35 14 0 14 Jul 2021
Carbon Emissions and Large Neural Network Training David A. Patterson Joseph E. Gonzalez Quoc V. Le Chen Liang Lluís-Miquel Munguía D. Rothchild David R. So Maud Texier J. Dean AI4CE 253 645 0 21 Apr 2021