The Computational Limits of Deep Learning

10 July 2020

Papers citing "The Computational Limits of Deep Learning"

50 / 66 papers shown

Title
Diffused Responsibility: Analyzing the Energy Consumption of Generative Text-to-Audio Diffusion Models Riccardo Passoni Francesca Ronchini Luca Comanducci Romain Serizel Fabio Antonacci DiffM 35 0 0 12 May 2025
Beyond Low-rank Decomposition: A Shortcut Approach for Efficient On-Device Learning Le-Trung Nguyen Ael Quélennec Van-Tam Nguyen Enzo Tartaglione 43 0 0 08 May 2025
Single-shot Star-convex Polygon-based Instance Segmentation for Spatially-correlated Biomedical Objects Trina De Adrian Urbanski Artur Yakimovich 34 0 0 16 Apr 2025
A Comprehensive Survey of Mixture-of-Experts: Algorithms, Theory, and Applications Siyuan Mu Sen Lin MoE 135 1 0 10 Mar 2025
Location based Probabilistic Load Forecasting of EV Charging Sites: Deep Transfer Learning with Multi-Quantile Temporal Convolutional Network Mohammad Wazed Ali Asif bin Mustafa Md. Aukerul Moin Shuvo Bernhard Sick 15 0 0 18 Sep 2024
Energy Consumption Trends in Sound Event Detection Systems Constance Douwes Romain Serizel 35 1 0 13 Sep 2024
Physics-based reward driven image analysis in microscopy Kamyar Barakati Hui Yuan Amit Goyal Sergei V. Kalinin 23 2 0 22 Apr 2024
ICE-SEARCH: A Language Model-Driven Feature Selection Approach T. Yang Tim Tianyi Yang Fuyuan Lyu Shaoshan Liu Xue Xue Liu 36 4 0 28 Feb 2024
Compression Repair for Feedforward Neural Networks Based on Model Equivalence Evaluation Zihao Mo Yejiang Yang Shuaizheng Lu Weiming Xiang 34 1 0 18 Feb 2024
Mathematical Algorithm Design for Deep Learning under Societal and Judicial Constraints: The Algorithmic Transparency Requirement Holger Boche Adalbert Fono Gitta Kutyniok FaML 31 4 0 18 Jan 2024
SCoTTi: Save Computation at Training Time with an adaptive framework Ziyu Li Enzo Tartaglione Van-Tam Nguyen 33 0 0 19 Dec 2023
Structured Inverse-Free Natural Gradient: Memory-Efficient & Numerically-Stable KFAC Wu Lin Felix Dangel Runa Eschenhagen Kirill Neklyudov Agustinus Kristiadi Richard Turner Alireza Makhzani 22 3 0 09 Dec 2023
Applying Dimensionality Reduction as Precursor to LSTM-CNN Models for Classifying Imagery and Motor Signals in ECoG-Based BCIs Soham Bafana 15 0 0 22 Nov 2023
Affine Invariance in Continuous-Domain Convolutional Neural Networks A. Mohaddes Johannes Lederer 23 1 0 13 Nov 2023
Efficiency is Not Enough: A Critical Perspective of Environmentally Sustainable AI Dustin Wright Christian Igel Gabrielle Samuel Raghavendra Selvan 29 15 0 05 Sep 2023
Towards frugal unsupervised detection of subtle abnormalities in medical imaging Geoffroy Oudoumanessah Carole Lartizien M. Dojat Florence Forbes MedIm 17 2 0 04 Sep 2023
Solving Large-scale Spatial Problems with Convolutional Neural Networks Damian Owerko Charilaos I. Kanatsoulis Alejandro Ribeiro 22 2 0 14 Jun 2023
Photonic Advantage of Optical Encoders Luocheng Huang Quentin A. A. Tanguy Johannes E. Froch Saswata Mukherjee K. Böhringer A. Majumdar 29 21 0 02 May 2023
Training Large Language Models Efficiently with Sparsity and Dataflow V. Srinivasan Darshan Gandhi Urmish Thakker R. Prabhakar MoE 30 6 0 11 Apr 2023
Accuracy is not the only Metric that matters: Estimating the Energy Consumption of Deep Learning Models Johannes Getzner Bertrand Charpentier Stephan Günnemann 21 5 0 03 Apr 2023
An Overview on Language Models: Recent Developments and Outlook Chengwei Wei Yun Cheng Wang Bin Wang C.-C. Jay Kuo 25 42 0 10 Mar 2023
Can We Scale Transformers to Predict Parameters of Diverse ImageNet Models? Boris Knyazev Doha Hwang Simon Lacoste-Julien AI4CE 31 17 0 07 Mar 2023
Thrill-K Architecture: Towards a Solution to the Problem of Knowledge Based Understanding Gadi Singer Joscha Bach Tetiana Grinberg Nagib Hakim Phillip Howard Vasudev Lal Zev Rivlin 42 1 0 28 Feb 2023
Counting Carbon: A Survey of Factors Influencing the Emissions of Machine Learning A. Luccioni Alex Hernandez-Garcia 31 45 0 16 Feb 2023
Learning Reservoir Dynamics with Temporal Self-Modulation Yusuke Sakemi S. Nobukawa Toshitaka Matsuki Takashi Morie Kazuyuki Aihara 19 6 0 23 Jan 2023
Impact of spiking neurons leakages and network recurrences on event-based spatio-temporal pattern recognition Mohamed Sadek Bouanane D. Cherifi Elisabetta Chicca Lyes Khacef 29 13 0 14 Nov 2022
SNIPER Training: Single-Shot Sparse Training for Text-to-Speech Perry Lam Huayun Zhang Nancy F. Chen Berrak Sisman Dorien Herremans VLM 27 0 0 14 Nov 2022
On the visual analytic intelligence of neural networks Stanislaw Wo'zniak Hlynur Jónsson G. Cherubini A. Pantazi E. Eleftheriou 25 0 0 28 Sep 2022
Bayesian Learning for Disparity Map Refinement for Semi-Dense Active Stereo Vision Laurent Valentin Jospin Hamid Laga F. Boussaïd Bennamoun 32 1 0 12 Sep 2022
Annealing Optimization for Progressive Learning with Stochastic Approximation Christos N. Mavridis John S. Baras 21 10 0 06 Sep 2022
Efficient Methods for Natural Language Processing: A Survey Marcos Vinícius Treviso Ji-Ung Lee Tianchu Ji Betty van Aken Qingqing Cao ... Emma Strubell Niranjan Balasubramanian Leon Derczynski Iryna Gurevych Roy Schwartz 28 109 0 31 Aug 2022
Maintaining Performance with Less Data Dominic Sanderson Tatiana Kalgonova 33 1 0 03 Aug 2022
Making a Spiking Net Work: Robust brain-like unsupervised machine learning Peter G. Stratton Andrew Wabnitz Chip Essam A. Cheung T. Hamilton OOD 29 4 0 02 Aug 2022
Characterizing Coherent Integrated Photonic Neural Networks under Imperfections Sanmitra Banerjee Mahdi Nikdast Krishnendu Chakrabarty 22 18 0 22 Jul 2022
Context-sensitive neocortical neurons transform the effectiveness and efficiency of neural information processing Ahsan Adeel Mario Franco Mohsin Raza K. Ahmed 25 9 0 15 Jul 2022
Machine Learning Model Sizes and the Parameter Gap Pablo Villalobos J. Sevilla T. Besiroglu Lennart Heim A. Ho Marius Hobbhahn ALM ELM AI4CE 27 57 0 05 Jul 2022
Recent Advances for Quantum Neural Networks in Generative Learning Jinkai Tian Xiaoyun Sun Yuxuan Du Shanshan Zhao Qing Liu ... Xingyao Wu Min-hsiu Hsieh Tongliang Liu Wen-Bin Yang Dacheng Tao AI4CE 26 81 0 07 Jun 2022
TNN7: A Custom Macro Suite for Implementing Highly Optimized Designs of Neuromorphic TNNs Harideep Nair P. Vellaisamy Santha Bhasuthkar J. Shen MQ 17 4 0 16 May 2022
A Classical-Quantum Convolutional Neural Network for Detecting Pneumonia from Chest Radiographs V. Kulkarni S. Pawale A. Kharat 19 12 0 19 Feb 2022
Compute Trends Across Three Eras of Machine Learning J. Sevilla Lennart Heim A. Ho T. Besiroglu Marius Hobbhahn Pablo Villalobos 25 269 0 11 Feb 2022
Two Sparsities Are Better Than One: Unlocking the Performance Benefits of Sparse-Sparse Networks Kevin Lee Hunter Lawrence Spracklen Subutai Ahmad 23 20 0 27 Dec 2021
Towards the One Learning Algorithm Hypothesis: A System-theoretic Approach Christos N. Mavridis John S. Baras 26 1 0 04 Dec 2021
Incremental Learning in Semantic Segmentation from Image Labels Fabio Cermelli Dario Fontanel A. Tavera Marco Ciccone Barbara Caputo VLM CLL 35 47 0 03 Dec 2021
AI Accelerator Survey and Trends Albert Reuther Peter Michaleas Michael Jones V. Gadepally S. Samsi J. Kepner 40 79 0 18 Sep 2021
Compute and Energy Consumption Trends in Deep Learning Inference Radosvet Desislavov Fernando Martínez-Plumed José Hernández-Orallo 35 113 0 12 Sep 2021
SplitGuard: Detecting and Mitigating Training-Hijacking Attacks in Split Learning Ege Erdogan Alptekin Kupcu A. E. Cicek AAML 11 32 0 20 Aug 2021
A brain basis of dynamical intelligence for AI and computational neuroscience J. Monaco Kanaka Rajan Grace M. Hwang AI4CE 26 6 0 15 May 2021
PositNN: Training Deep Neural Networks with Mixed Low-Precision Posit Gonçalo Raposo P. Tomás Nuno Roma MQ 21 19 0 30 Apr 2021
An optical neural network using less than 1 photon per multiplication Tianyu Wang Shifan Ma Logan G. Wright Tatsuhiro Onodera Brian C. Richard Peter L. McMahon 46 177 0 27 Apr 2021
Carbon Emissions and Large Neural Network Training David A. Patterson Joseph E. Gonzalez Quoc V. Le Chen Liang Lluís-Miquel Munguía D. Rothchild David R. So Maud Texier J. Dean AI4CE 244 644 0 21 Apr 2021