Compute Trends Across Three Eras of Machine Learning

11 February 2022

Papers citing "Compute Trends Across Three Eras of Machine Learning"

50 / 117 papers shown

Title
Demystifying AI Agents: The Final Generation of Intelligence Kevin J McNamara Rhea Pritham Marpu 29 0 0 15 May 2025
LazyReview A Dataset for Uncovering Lazy Thinking in NLP Peer Reviews Sukannya Purkayastha Zhuang Li Anne Lauscher Lizhen Qu Iryna Gurevych 30 0 0 15 Apr 2025
Synthetic Data Generation & Multi-Step RL for Reasoning & Tool Use Anna Goldie Azalia Mirhoseini Hao Zhou Irene Cai Christopher D. Manning SyDa OffRL ReLM LRM 111 3 0 07 Apr 2025
Bandwidth Allocation for Cloud-Augmented Autonomous Driving Peter Schafhalter Alexander Krentsel Joseph E. Gonzalez Sylvia Ratnasamy S. Shenker Ion Stoica 79 0 0 26 Mar 2025
Measuring AI Ability to Complete Long Tasks Thomas Kwa Ben West Joel Becker Amy Deng Katharyn Garcia ... Lucas Jun Koba Sato H. Wijk Daniel M. Ziegler Elizabeth Barnes Lawrence Chan ELM 82 6 0 18 Mar 2025
The AI Pentad, the CHARME $^{2}$ D Model, and an Assessment of Current-State AI Regulation Di Kevin Gao Sudip Mittal Jiming Wu Hongwei Du Jingdao Chen Shahram Rahimi 35 0 0 08 Mar 2025
A 262 TOPS Hyperdimensional Photonic AI Accelerator powered by a Si3N4 microcomb laser Christos Pappas Antonios Prapas Theodoros Moschos Manos Kirtas Odysseas Asimopoulos ... Alain Yuji Takabayashi John D. Jost Maxim Karpov Anastasios Tefas N. Pleros 75 1 0 05 Mar 2025
A Reconfigurable Stream-Based FPGA Accelerator for Bayesian Confidence Propagation Neural Networks Muhammad Ihsan Al Hafiz Naresh B. Ravichandran A. Lansner Pawel Herman Artur Podobas 74 0 0 03 Mar 2025
Climate And Resource Awareness is Imperative to Achieving Sustainable AI (and Preventing a Global AI Arms Race) Pedram Bakhtiarifard Pınar Tözün Christian Igel Raghavendra Selvan 57 0 0 27 Feb 2025
Forecasting Frontier Language Model Agent Capabilities Govind Pimpale Axel Højmark Jérémy Scheurer Marius Hobbhahn LLMAG ELM 49 1 0 21 Feb 2025
How Green Can AI Be? A Study of Trends in Machine Learning Environmental Impacts Clément Morand Anne-Laure Ligozat Aurélie Névéol 33 0 0 23 Dec 2024
Declare and Justify: Explicit assumptions in AI evaluations are necessary for effective regulation Peter Barnett Lisa Thiergart ELM 69 2 0 19 Nov 2024
Search, Verify and Feedback: Towards Next Generation Post-training Paradigm of Foundation Models via Verifier Engineering Xinyan Guan Yanjiang Liu Xinyu Lu Boxi Cao Xianpei Han ... Le Sun Jie Lou Bowen Yu Yaojie Lu Hongyu Lin ALM 83 2 0 18 Nov 2024
A Simple Packing Algorithm for Optimized Mapping of Artificial Neural Networks onto Non-Volatile Memory Cross-Bar Arrays W. Haensch 29 0 0 07 Nov 2024
A Comparative Analysis of Counterfactual Explanation Methods for Text Classifiers Stephen McAleese Mark Keane 36 0 0 04 Nov 2024
FedMoE-DA: Federated Mixture of Experts via Domain Aware Fine-grained Aggregation Ziwei Zhan Wenkuan Zhao Yuanqing Li Weijie Liu Xiaoxi Zhang Chee Wei Tan Chuan Wu Deke Guo Xu Chen MoE 48 1 0 04 Nov 2024
Managing Bandwidth: The Key to Cloud-Assisted Autonomous Driving Alexander Krentsel Peter Schafhalter Joseph E. Gonzalez Sylvia Ratnasamy S. Shenker Ion Stoica 23 0 0 21 Oct 2024
MLPerf Power: Benchmarking the Energy Efficiency of Machine Learning Systems from Microwatts to Megawatts for Sustainable AI Arya Tschand Arun Tejusve Raghunath Rajan S. Idgunji Anirban Ghosh J. Holleman ... Rowan Taubitz Sean Zhan Scott Wasson David Kanter Vijay Janapa Reddi 62 3 0 15 Oct 2024
QoS-Nets: Adaptive Approximate Neural Network Inference E. Trommer Bernd Waschneck Akash Kumar 28 0 0 10 Oct 2024
Scaling Smart: Accelerating Large Language Model Pre-training with Small Model Initialization Mohammad Samragh Iman Mirzadeh Keivan Alizadeh Vahid Fartash Faghri Minsik Cho Moin Nabi Devang Naik Mehrdad Farajtabar LRM AI4CE 27 6 0 19 Sep 2024
Energy Consumption Trends in Sound Event Detection Systems Constance Douwes Romain Serizel 37 1 0 13 Sep 2024
Normalizing Energy Consumption for Hardware-Independent Evaluation Constance Douwes Romain Serizel 40 1 0 09 Sep 2024
The Unseen AI Disruptions for Power Grids: LLM-Induced Transients Yuzhuo Li Mariam Mughees Yize Chen Yunwei Ryan Li 25 9 0 09 Sep 2024
Coalitions of Large Language Models Increase the Robustness of AI Agents Prattyush Mangal Carol Mak Theo Kanakis Timothy Donovan Dave Braines Edward Pyzer-Knapp 41 1 0 02 Aug 2024
On the Limitations of Compute Thresholds as a Governance Strategy Sara Hooker 55 14 0 08 Jul 2024
Zyda: A 1.3T Dataset for Open Language Modeling Yury Tokpanov Beren Millidge Paolo Glorioso Jonathan Pilault Adam Ibrahim James Whittington Quentin Anthony 45 2 0 04 Jun 2024
The Future of Child Development in the AI Era. Cross-Disciplinary Perspectives Between AI and Child Development Experts Mathilde Neugnot-Cerioli Olga Muss Laurenty 29 6 0 29 May 2024
AstroPT: Scaling Large Observation Models for Astronomy Michael J. Smith Ryan J. Roberts E. Angeloudi M. Huertas-Company 46 1 0 23 May 2024
Off-the-Shelf Neural Network Architectures for Forex Time Series Prediction come at a Cost Theodoros Zafeiriou Dimitris Kalles AI4TS 26 0 0 17 May 2024
Automatic Generation of Model and Data Cards: A Step Towards Responsible AI Jiarui Liu Wenkai Li Zhijing Jin Mona T. Diab SyDa 63 3 0 10 May 2024
Towards Reverse-Engineering the Brain: Brain-Derived Neuromorphic Computing Approach with Photonic, Electronic, and Ionic Dynamicity in 3D integrated circuits S. J. B. Yoo Luis El Srouji S. Datta Shimeng Yu J. Incorvia ... Kristofer Bouchard Joy Geng Rishidev Chaudhuri Charan Ranganath Randall C O'Reilly 21 1 0 28 Mar 2024
BioMedLM: A 2.7B Parameter Language Model Trained On Biomedical Text Elliot Bolton Abhinav Venigalla Michihiro Yasunaga David Leo Wright Hall Betty Xiong ... R. Daneshjou Jonathan Frankle Percy Liang Michael Carbin Christopher D. Manning LM&MA MedIm 32 51 0 27 Mar 2024
Scenarios for the Transition to AGI Anton Korinek Donghyun Suh 29 16 0 17 Mar 2024
Optimistic Verifiable Training by Controlling Hardware Nondeterminism Megha Srivastava Simran Arora Dan Boneh 43 5 0 14 Mar 2024
Adversarial Fine-tuning of Compressed Neural Networks for Joint Improvement of Robustness and Efficiency Hallgrimur Thorsteinsson Valdemar J Henriksen Tong Chen Raghavendra Selvan AAML 42 1 0 14 Mar 2024
QuantTune: Optimizing Model Quantization with Adaptive Outlier-Driven Fine Tuning Jiun-Man Chen Yu-Hsuan Chao Yu-Jie Wang Ming-Der Shieh Chih-Chung Hsu Wei-Fen Lin MQ 32 1 0 11 Mar 2024
Model Parallelism on Distributed Infrastructure: A Literature Review from Theory to LLM Case-Studies Felix Brakel Uraz Odyurt A. Varbanescu GNN 39 11 0 06 Mar 2024
MIMDRAM: An End-to-End Processing-Using-DRAM System for High-Throughput, Energy-Efficient and Programmer-Transparent Multiple-Instruction Multiple-Data Processing Geraldo F. Oliveira Ataberk Olgun A. G. Yaglikçi F. N. Bostanci Juan Gómez Luna Saugata Ghose Onur Mutlu 26 6 0 29 Feb 2024
Scaling on-chip photonic neural processors using arbitrarily programmable wave propagation Tatsuhiro Onodera Martin M. Stein Benjamin A. Ash Mandar M. Sohoni Melissa Bosch ... Tianyu Wang Gennady Shvets Maxim R Shcherbakov Logan G. Wright Peter L. McMahon 24 10 0 27 Feb 2024
On Formally Undecidable Traits of Intelligent Machines Matthew Fox 30 0 0 14 Feb 2024
Accelerating Distributed Deep Learning using Lossless Homomorphic Compression Haoyu Li Yuchen Xu Jiayi Chen Rohit Dwivedula Wenfei Wu Keqiang He Aditya Akella Daehyeok Kim FedML AI4CE 21 4 0 12 Feb 2024
Is Adversarial Training with Compressed Datasets Effective? Tong Chen Raghavendra Selvan AAML 54 0 0 08 Feb 2024
Training DNN Models over Heterogeneous Clusters with Optimal Performance Chengyi Nie Jessica Maghakian Zhenhua Liu 18 0 0 07 Feb 2024
Neuromorphic hardware for sustainable AI data centers Bernhard Vogginger A. Rostami Vaibhav Jain Sirine Arfa Andreas Hantsch ... Ulrike Faltings Hector A. Gonzalez Chen Liu Christian Mayr Wolfgang Maaß 26 10 0 04 Feb 2024
On Catastrophic Inheritance of Large Foundation Models Hao Chen Bhiksha Raj Xing Xie Jindong Wang AI4CE 56 12 0 02 Feb 2024
SpiNNaker2: A Large-Scale Neuromorphic System for Event-Based and Asynchronous Machine Learning Hector A. Gonzalez Jiaxin Huang Florian Kelber Khaleelulla Khan Nazeer Tim Langer ... Bernhard Vogginger Timo C. Wunderlich Yexin Yan Mahmoud Akl Christian Mayr 24 16 0 09 Jan 2024
The Compute Divide in Machine Learning: A Threat to Academic Contribution and Scrutiny? T. Besiroglu S. Bergerson Amelia Michael Lennart Heim Xueyun Luo Neil Thompson 24 11 0 04 Jan 2024
Green Edge AI: A Contemporary Survey Yuyi Mao X. Yu Kaibin Huang Ying-Jun Angela Zhang Jun Zhang 41 17 0 01 Dec 2023
The Case for Universal Basic Computing Power Yue Zhu ELM 28 0 0 18 Nov 2023
A Material Lens on Coloniality in NLP William B. Held Camille Harris Michael Best Diyi Yang 20 11 0 14 Nov 2023