v1v2v3 (latest)

What Do Compressed Deep Neural Networks Forget?

13 November 2019

Aaron Courville

Papers citing "What Do Compressed Deep Neural Networks Forget?"

50 / 59 papers shown

Title
A Coreset Selection of Coreset Selection Literature: Introduction and Recent Advances Brian B. Moser Arundhati S. Shanbhag Stanislav Frolov Federico Raue Joachim Folz Andreas Dengel 250 0 0 23 May 2025
Uncovering Memorization Effect in the Presence of Spurious Correlations Chenyu You Haocheng Dai Yifei Min Jasjeet Sekhon S. Joshi James S. Duncan 139 3 0 01 Jan 2025
Investigating the Effect of Network Pruning on Performance and Interpretability Jonathan von Rad Florian Seuffert 105 1 0 29 Sep 2024
Composable Interventions for Language Models Arinbjorn Kolbeinsson Kyle O'Brien Tianjin Huang Shanghua Gao Shiwei Liu ... Anurag J. Vaidya Faisal Mahmood Marinka Zitnik Tianlong Chen Thomas Hartvigsen KELM MU 175 4 0 09 Jul 2024
Robustness-Reinforced Knowledge Distillation with Correlation Distance and Network Pruning Seonghak Kim Gyeongdo Ham Yucheol Cho Daeshik Kim 102 4 0 23 Nov 2023
What Neural Networks Memorize and Why: Discovering the Long Tail via Influence Estimation Vitaly Feldman Chiyuan Zhang TDI 225 470 0 09 Aug 2020
What is the State of Neural Network Pruning? Davis W. Blalock Jose Javier Gonzalez Ortiz Jonathan Frankle John Guttag 280 1,054 0 06 Mar 2020
Train Large, Then Compress: Rethinking Model Size for Efficient Training and Inference of Transformers Zhuohan Li Eric Wallace Sheng Shen Kevin Lin Kurt Keutzer Dan Klein Joseph E. Gonzalez 117 151 0 26 Feb 2020
MLIR: A Compiler Infrastructure for the End of Moore's Law Chris Lattner M. Amini Uday Bondhugula Albert Cohen Andy Davis J. Pienaar River Riddle T. Shpeisman Nicolas Vasilache O. Zinenko VLM 83 250 0 25 Feb 2020
Rigging the Lottery: Making All Tickets Winners Utku Evci Trevor Gale Jacob Menick Pablo Samuel Castro Erich Elsen 199 607 0 25 Nov 2019
Natural Adversarial Examples Dan Hendrycks Kevin Zhao Steven Basart Jacob Steinhardt Basel Alomair OODD 236 1,484 0 16 Jul 2019
Towards Compact and Robust Deep Neural Networks Vikash Sehwag Shiqi Wang Prateek Mittal Suman Jana AAML 76 40 0 14 Jun 2019
Does Learning Require Memorization? A Short Tale about a Long Tail Vitaly Feldman TDI 142 502 0 12 Jun 2019
Energy and Policy Considerations for Deep Learning in NLP Emma Strubell Ananya Ganesh Andrew McCallum 83 2,659 0 05 Jun 2019
Benchmarking Neural Network Robustness to Common Corruptions and Perturbations Dan Hendrycks Thomas G. Dietterich OOD VLM 196 3,455 0 28 Mar 2019
The State of Sparsity in Deep Neural Networks Trevor Gale Erich Elsen Sara Hooker 165 763 0 25 Feb 2019
Fair Regression for Health Care Spending A. Zink Sherri Rose 88 50 0 28 Jan 2019
LPCNet: Improving Neural Speech Synthesis Through Linear Prediction J. Valin Jan Skoglund 74 451 0 28 Oct 2018
Sparse DNNs with Improved Adversarial Robustness Yiwen Guo Chao Zhang Changshui Zhang Yurong Chen AAML 86 154 0 23 Oct 2018
SNIP: Single-shot Network Pruning based on Connection Sensitivity Namhoon Lee Thalaiyasingam Ajanthan Philip Torr VLM 271 1,211 0 04 Oct 2018
Metric Learning for Novelty and Anomaly Detection Marc Masana Idoia Ruiz J. Serrat Joost van de Weijer Antonio M. López OODD 76 80 0 16 Aug 2018
Confounding variables can degrade generalization performance of radiological deep learning models J. Zech Marcus A. Badgeley Manway Liu A. Costa J. Titano Eric K. Oermann OOD 87 1,180 0 02 Jul 2018
A Benchmark for Interpretability Methods in Deep Neural Networks Sara Hooker D. Erhan Pieter-Jan Kindermans Been Kim FAtt UQCV 125 683 0 28 Jun 2018
Non-Vacuous Generalization Bounds at the ImageNet Scale: A PAC-Bayesian Compression Approach Wenda Zhou Victor Veitch Morgane Austern Ryan P. Adams Peter Orbanz 75 215 0 16 Apr 2018
Efficient Neural Audio Synthesis Nal Kalchbrenner Erich Elsen Karen Simonyan Seb Noury Norman Casagrande Edward Lockhart Florian Stimberg Aaron van den Oord Sander Dieleman Koray Kavukcuoglu 94 870 0 23 Feb 2018
Faster gaze prediction with dense networks and Fisher pruning Lucas Theis I. Korshunova Alykhan Tejani Ferenc Huszár 74 207 0 17 Jan 2018
Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference Benoit Jacob S. Kligys Bo Chen Menglong Zhu Matthew Tang Andrew G. Howard Hartwig Adam Dmitry Kalenichenko MQ 167 3,143 0 15 Dec 2017
Learning Sparse Neural Networks through $L_0$ Regularization Christos Louizos Max Welling Diederik P. Kingma 439 1,148 0 04 Dec 2017
MorphNet: Fast & Simple Resource-Constrained Structure Learning of Deep Networks A. Gordon Elad Eban Ofir Nachum Bo Chen Hao Wu Tien-Ju Yang Edward Choi 74 339 0 18 Nov 2017
Mixed Precision Training Paulius Micikevicius Sharan Narang Jonah Alben G. Diamos Erich Elsen ... Boris Ginsburg Michael Houston Oleksii Kuchaiev Ganesh Venkatesh Hao Wu 178 1,805 0 10 Oct 2017
To prune, or not to prune: exploring the efficacy of pruning for model compression Michael Zhu Suyog Gupta 202 1,282 0 05 Oct 2017
Learning Efficient Convolutional Networks through Network Slimming Zhuang Liu Jianguo Li Zhiqiang Shen Gao Huang Shoumeng Yan Changshui Zhang 133 2,426 0 22 Aug 2017
On Calibration of Modern Neural Networks Chuan Guo Geoff Pleiss Yu Sun Kilian Q. Weinberger UQCV 299 5,877 0 14 Jun 2017
Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networks Shiyu Liang Yixuan Li R. Srikant UQCV OODD 171 2,082 0 08 Jun 2017
Exploring Sparsity in Recurrent Neural Networks Sharan Narang Erich Elsen G. Diamos Shubho Sengupta 76 312 0 17 Apr 2017
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications Andrew G. Howard Menglong Zhu Bo Chen Dmitry Kalenichenko Weijun Wang Tobias Weyand M. Andreetto Hartwig Adam 3DH 1.2K 20,900 0 17 Apr 2017
What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision? Alex Kendall Y. Gal BDL OOD UD UQCV PER 362 4,721 0 15 Mar 2017
Online Learning with Abstention Corinna Cortes Giulia DeSalvo Claudio Gentile M. Mohri Scott Yang 114 48 0 09 Mar 2017
Soft Weight-Sharing for Neural Network Compression Karen Ullrich Edward Meeds Max Welling 172 419 0 13 Feb 2017
Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles Balaji Lakshminarayanan Alexander Pritzel Charles Blundell UQCV BDL 847 5,847 0 05 Dec 2016
Fair prediction with disparate impact: A study of bias in recidivism prediction instruments Alexandra Chouldechova FaML 302 2,131 0 24 Oct 2016
A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networks Dan Hendrycks Kevin Gimpel UQCV 179 3,480 0 07 Oct 2016
Quantized Neural Networks: Training Neural Networks with Low Precision Weights and Activations Itay Hubara Matthieu Courbariaux Daniel Soudry Ran El-Yaniv Yoshua Bengio MQ 160 1,870 0 22 Sep 2016
Dynamic Network Surgery for Efficient DNNs Yiwen Guo Anbang Yao Yurong Chen 84 1,060 0 16 Aug 2016
Learning Structured Sparsity in Deep Neural Networks W. Wen Chunpeng Wu Yandan Wang Yiran Chen Hai Helen Li 193 2,341 0 12 Aug 2016
On the efficient representation and execution of deep acoustic models R. Álvarez Rohit Prabhavalkar A. Bakhtin MQ 71 55 0 15 Jul 2016
Compression of Neural Machine Translation Models via Pruning A. See Minh-Thang Luong Christopher D. Manning MedIm VLM 54 220 0 29 Jun 2016
Satisfying Real-world Goals with Dataset Constraints Gabriel Goh Andrew Cotter Maya R. Gupta M. Friedlander OffRL 70 215 0 24 Jun 2016
An Analysis of Deep Neural Network Models for Practical Applications A. Canziani Adam Paszke Eugenio Culurciello 97 1,167 0 24 May 2016
Wide Residual Networks Sergey Zagoruyko N. Komodakis 358 8,002 0 23 May 2016