Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation

15 August 2013

Aaron Courville

Papers citing "Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation"

50 / 1,511 papers shown

Title
NICE: Noise Injection and Clamping Estimation for Neural Network Quantization Chaim Baskin Natan Liss Yoav Chai Evgenii Zheltonozhskii Eli Schwartz Raja Giryes A. Mendelson A. Bronstein MQ 99 62 0 29 Sep 2018
Improved Gradient-Based Optimization Over Discrete Distributions Evgeny Andriyash Arash Vahdat W. Macready 74 9 0 29 Sep 2018
Discovering Low-Precision Networks Close to Full-Precision Networks for Efficient Embedded Inference J. McKinstry S. K. Esser R. Appuswamy Deepika Bablani John V. Arthur Izzet B. Yildiz D. Modha MQ 66 94 0 11 Sep 2018
Learning Sparse Low-Precision Neural Networks With Learnable Regularization Yoojin Choi Mostafa El-Khamy Jungwon Lee MQ 66 31 0 01 Sep 2018
Revisiting Character-Based Neural Machine Translation with Capacity and Compression Colin Cherry George F. Foster Ankur Bapna Orhan Firat Wolfgang Macherey 86 96 0 29 Aug 2018
Learning to Quantize Deep Networks by Optimizing Quantization Intervals with Task Loss S. Jung Changyong Son Seohyung Lee JinWoo Son Youngjun Kwak Jae-Joon Han Sung Ju Hwang Changkyu Choi MQ 91 376 0 17 Aug 2018
DNN Feature Map Compression using Learned Representation over GF(2) Denis A. Gudovskiy Alec Hodgkinson Luca Rigazio 46 18 0 15 Aug 2018
Blended Coarse Gradient Descent for Full Quantization of Deep Neural Networks Penghang Yin Shuai Zhang J. Lyu Stanley Osher Y. Qi Jack Xin MQ 102 62 0 15 Aug 2018
Learning ReLU Networks on Linearly Separable Data: Algorithm, Optimality, and Generalization G. Wang G. Giannakis Jie Chen MLT 83 132 0 14 Aug 2018
A Survey on Methods and Theories of Quantized Neural Networks Yunhui Guo MQ 125 236 0 13 Aug 2018
Training Compact Neural Networks with Binary Weights and Low Precision Activations Bohan Zhuang Chunhua Shen Ian Reid MQ 53 14 0 08 Aug 2018
Segmental Audio Word2Vec: Representing Utterances as Sequences of Vectors with Applications in Spoken Term Detection Yu-Hsuan Wang Hung-yi Lee Lin-Shan Lee 79 54 0 07 Aug 2018
A Review of Learning with Deep Generative Models from Perspective of Graphical Modeling Zhijian Ou 112 16 0 05 Aug 2018
Learning Visual Question Answering by Bootstrapping Hard Attention Mateusz Malinowski Carl Doersch Adam Santoro Peter W. Battaglia OOD 92 96 0 01 Aug 2018
Deep Encoder-Decoder Models for Unsupervised Learning of Controllable Speech Synthesis G. Henter Jaime Lorenzo-Trueba Xin Wang Junichi Yamagishi DRL SSL 88 61 0 30 Jul 2018
LQ-Nets: Learned Quantization for Highly Accurate and Compact Deep Neural Networks Dongqing Zhang Jiaolong Yang Dongqiangzi Ye G. Hua MQ 98 705 0 26 Jul 2018
Conditional Information Gain Networks Ufuk Can Biçici Cem Keskin L. Akarun 50 9 0 25 Jul 2018
NullaNet: Training Deep Neural Networks for Reduced-Memory-Access Inference M. Nazemi Ghasem Pasandi Massoud Pedram 42 21 0 23 Jul 2018
Optimize Deep Convolutional Neural Network with Ternarized Weights and High Accuracy Zhezhi He Boqing Gong Deliang Fan 36 22 0 20 Jul 2018
Understanding and Improving Interpolation in Autoencoders via an Adversarial Regularizer David Berthelot Colin Raffel Aurko Roy Ian Goodfellow 89 265 0 19 Jul 2018
Adaptive Neural Trees Ryutaro Tanno Kai Arulkumaran Daniel C. Alexander A. Criminisi A. Nori 428 169 0 17 Jul 2018
Bridging the Accuracy Gap for 2-bit Quantized Neural Networks (QNN) Jungwook Choi P. Chuang Zhuo Wang Swagath Venkataramani Vijayalakshmi Srinivasan K. Gopalakrishnan MQ 73 76 0 17 Jul 2018
SYQ: Learning Symmetric Quantization For Efficient Deep Neural Networks Julian Faraone Nicholas J. Fraser Michaela Blott Philip H. W. Leong MQ 102 133 0 01 Jul 2018
Guided evolutionary strategies: Augmenting random search with surrogate gradients Niru Maheswaranathan Luke Metz George Tucker Dami Choi Jascha Narain Sohl-Dickstein 76 20 0 26 Jun 2018
The challenge of realistic music generation: modelling raw audio at scale Sander Dieleman Aaron van den Oord Karen Simonyan 100 186 0 26 Jun 2018
Learning K-way D-dimensional Discrete Codes for Compact Embedding Representations Ting-Li Chen Martin Renqiang Min Yizhou Sun 77 71 0 21 Jun 2018
Binary Ensemble Neural Network: More Bits per Network or More Networks per Bit? Shilin Zhu Xin Dong Hao Su MQ 108 138 0 20 Jun 2018
Adding New Tasks to a Single Network with Weight Transformations using Binary Masks Massimiliano Mancini Elisa Ricci Barbara Caputo Samuel Rota Buló 103 52 0 28 May 2018
Towards the first adversarially robust neural network model on MNIST Lukas Schott Jonas Rauber Matthias Bethge Wieland Brendel AAML OOD 89 370 0 23 May 2018
AxTrain: Hardware-Oriented Neural Network Training for Approximate Inference Xin He Liu Ke Wenyan Lu Guihai Yan Xuan Zhang 54 34 0 21 May 2018
GumBolt: Extending Gumbel trick to Boltzmann priors Amir Khoshaman Mohammad H. Amin 71 14 0 18 May 2018
Learning Permutations with Sinkhorn Policy Gradient Patrick Emami Sanjay Ranka 65 55 0 18 May 2018
PACT: Parameterized Clipping Activation for Quantized Neural Networks Jungwook Choi Zhuo Wang Swagath Venkataramani P. Chuang Vijayalakshmi Srinivasan K. Gopalakrishnan MQ 115 959 0 16 May 2018
Convolutional Generative Adversarial Networks with Binary Neurons for Polyphonic Music Generation Hao-Wen Dong Yi-Hsuan Yang GAN MGen 96 94 0 25 Apr 2018
Conducting Credit Assignment by Aligning Local Representations Alexander Ororbia A. Mali Daniel Kifer C. Lee Giles ODL 94 29 0 05 Mar 2018
Recurrent Binary Embedding for GPU-Enabled Exhaustive Retrieval from Billion-Scale Semantic Vectors Ying Shan Jian Jiao Jiehan Zhu J. C. Mao 55 11 0 18 Feb 2018
Model compression via distillation and quantization A. Polino Razvan Pascanu Dan Alistarh MQ 109 736 0 15 Feb 2018
DVAE++: Discrete Variational Autoencoders with Overlapping Transformations Arash Vahdat W. Macready Zhengbing Bian Amir Khoshaman Evgeny Andriyash 99 76 0 14 Feb 2018
Learning and Querying Fast Generative Models for Reinforcement Learning Lars Buesing T. Weber S. Racanière S. M. Ali Eslami Danilo Jimenez Rezende ... Fabio Viola F. Besse Karol Gregor Demis Hassabis Daan Wierstra OffRL 82 135 0 08 Feb 2018
Obfuscated Gradients Give a False Sense of Security: Circumventing Defenses to Adversarial Examples Anish Athalye Nicholas Carlini D. Wagner AAML 360 3,197 0 01 Feb 2018
Fast Power system security analysis with Guided Dropout Benjamin Donnot Isabelle M Guyon Marc Schoenauer Antoine Marot P. Panciatici 65 29 0 30 Jan 2018
Empirical Explorations in Training Networks with Discrete Activations S. Baluja MQ 42 1 0 16 Jan 2018
Audio Adversarial Examples: Targeted Attacks on Speech-to-Text Nicholas Carlini D. Wagner AAML 103 1,083 0 05 Jan 2018
Learning Sparse Neural Networks through $L_0$ Regularization Christos Louizos Max Welling Diederik P. Kingma 547 1,150 0 04 Dec 2017
Layer-wise Learning of Stochastic Neural Networks with Information Bottleneck Thanh T. Nguyen Jaesik Choi 85 13 0 04 Dec 2017
Probabilistic Adaptive Computation Time Michael Figurnov Artem Sobolev Dmitry Vetrov BDL 41 8 0 01 Dec 2017
Convolutional Networks with Adaptive Inference Graphs Andreas Veit Serge J. Belongie OOD GNN 113 385 0 30 Nov 2017
Towards Accurate Binary Convolutional Neural Network Xiaofan Lin Cong Zhao Wei Pan MQ 115 650 0 30 Nov 2017
Plan, Attend, Generate: Planning for Sequence-to-Sequence Models Francis Dutil Çağlar Gülçehre Adam Trischler Yoshua Bengio 56 12 0 28 Nov 2017
On the Robustness of Semantic Segmentation Models to Adversarial Attacks Anurag Arnab O. Mikšík Philip Torr AAML 124 308 0 27 Nov 2017