Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation

15 August 2013

Aaron Courville

Papers citing "Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation"

50 / 1,872 papers shown

Title
ARM: Augment-REINFORCE-Merge Gradient for Stochastic Binary Networks Mingzhang Yin Mingyuan Zhou MQ 34 11 0 30 Jul 2018
MaskConnect: Connectivity Learning by Gradient Descent Karim Ahmed Lorenzo Torresani 30 49 0 28 Jul 2018
LQ-Nets: Learned Quantization for Highly Accurate and Compact Deep Neural Networks Dongqing Zhang Jiaolong Yang Dongqiangzi Ye G. Hua MQ 23 697 0 26 Jul 2018
Conditional Information Gain Networks Ufuk Can Biçici Cem Keskin L. Akarun 17 9 0 25 Jul 2018
Backprop-Q: Generalized Backpropagation for Stochastic Computation Graphs Xiaoran Xu Songpeng Zu Yuan Zhang Hanning Zhou Wei Feng BDL 16 4 0 25 Jul 2018
NullaNet: Training Deep Neural Networks for Reduced-Memory-Access Inference M. Nazemi Ghasem Pasandi Massoud Pedram 23 21 0 23 Jul 2018
Optimize Deep Convolutional Neural Network with Ternarized Weights and High Accuracy Zhezhi He Boqing Gong Deliang Fan 18 22 0 20 Jul 2018
Understanding and Improving Interpolation in Autoencoders via an Adversarial Regularizer David Berthelot Colin Raffel Aurko Roy Ian Goodfellow 18 261 0 19 Jul 2018
Adaptive Neural Trees Ryutaro Tanno Kai Arulkumaran Daniel C. Alexander A. Criminisi A. Nori 29 165 0 17 Jul 2018
Bridging the Accuracy Gap for 2-bit Quantized Neural Networks (QNN) Jungwook Choi P. Chuang Zhuo Wang Swagath Venkataramani Vijayalakshmi Srinivasan K. Gopalakrishnan MQ 19 75 0 17 Jul 2018
Revisiting the Hierarchical Multiscale LSTM Ákos Kádár Marc-Alexandre Côté Grzegorz Chrupała A. Alishahi 22 13 0 10 Jul 2018
SYQ: Learning Symmetric Quantization For Efficient Deep Neural Networks Julian Faraone Nicholas J. Fraser Michaela Blott Philip H. W. Leong MQ 33 133 0 01 Jul 2018
Guided evolutionary strategies: Augmenting random search with surrogate gradients Niru Maheswaranathan Luke Metz George Tucker Dami Choi Jascha Narain Sohl-Dickstein 25 20 0 26 Jun 2018
The challenge of realistic music generation: modelling raw audio at scale Sander Dieleman Aaron van den Oord Karen Simonyan 23 184 0 26 Jun 2018
Learning K-way D-dimensional Discrete Codes for Compact Embedding Representations Ting-Li Chen Martin Renqiang Min Yizhou Sun 26 70 0 21 Jun 2018
Binary Ensemble Neural Network: More Bits per Network or More Networks per Bit? Shilin Zhu Xin Dong Hao Su MQ 30 135 0 20 Jun 2018
On Accurate Evaluation of GANs for Language Generation Stanislau Semeniuta Aliaksei Severyn Sylvain Gelly EGVM 39 81 0 13 Jun 2018
Latent Tree Learning with Differentiable Parsers: Shift-Reduce Parsing and Chart Parsing Jean Maillard S. Clark 29 18 0 03 Jun 2018
Adding New Tasks to a Single Network with Weight Transformations using Binary Masks Massimiliano Mancini Elisa Ricci Barbara Caputo Samuel Rota Buló 25 51 0 28 May 2018
Inducing Grammars with and for Neural Machine Translation Ke M. Tran Yonatan Bisk 28 22 0 28 May 2018
Towards the first adversarially robust neural network model on MNIST Lukas Schott Jonas Rauber Matthias Bethge Wieland Brendel AAML OOD 14 369 0 23 May 2018
AxTrain: Hardware-Oriented Neural Network Training for Approximate Inference Xin He Liu Ke Wenyan Lu Guihai Yan Xuan Zhang 27 34 0 21 May 2018
DVAE#: Discrete Variational Autoencoders with Relaxed Boltzmann Priors Arash Vahdat Evgeny Andriyash W. Macready 21 49 0 18 May 2018
GumBolt: Extending Gumbel trick to Boltzmann priors Amir Khoshaman Mohammad H. Amin 21 14 0 18 May 2018
Learning Permutations with Sinkhorn Policy Gradient Patrick Emami Sanjay Ranka 16 54 0 18 May 2018
PACT: Parameterized Clipping Activation for Quantized Neural Networks Jungwook Choi Zhuo Wang Swagath Venkataramani P. Chuang Vijayalakshmi Srinivasan K. Gopalakrishnan MQ 13 941 0 16 May 2018
NASH: Toward End-to-End Neural Architecture for Generative Semantic Hashing Dinghan Shen Qinliang Su Paidamoyo Chapfuwa Wenlin Wang Guoyin Wang Lawrence Carin Ricardo Henao 14 58 0 14 May 2018
Backpropagating through Structured Argmax using a SPIGOT Hao Peng Sam Thomson Noah A. Smith 28 42 0 12 May 2018
Convolutional Generative Adversarial Networks with Binary Neurons for Polyphonic Music Generation Hao-Wen Dong Yi-Hsuan Yang GAN MGen 27 94 0 25 Apr 2018
Convolutional Neural Networks Regularized by Correlated Noise Shamak Dutta B. Tripp Graham W. Taylor 19 6 0 03 Apr 2018
Feed-forward Uncertainty Propagation in Belief and Neural Networks Alexander Shekhovtsov B. Flach M. Busta 25 4 0 28 Mar 2018
Conducting Credit Assignment by Aligning Local Representations Alexander Ororbia A. Mali Daniel Kifer C. Lee Giles ODL 34 29 0 05 Mar 2018
Recurrent Binary Embedding for GPU-Enabled Exhaustive Retrieval from Billion-Scale Semantic Vectors Ying Shan Jian Jiao Jiehan Zhu J. C. Mao 22 11 0 18 Feb 2018
Model compression via distillation and quantization A. Polino Razvan Pascanu Dan Alistarh MQ 33 718 0 15 Feb 2018
DVAE++: Discrete Variational Autoencoders with Overlapping Transformations Arash Vahdat W. Macready Zhengbing Bian Amir Khoshaman Evgeny Andriyash 37 75 0 14 Feb 2018
Predicting Adversarial Examples with High Confidence A. Galloway Graham W. Taylor M. Moussa AAML 29 9 0 13 Feb 2018
Learning and Querying Fast Generative Models for Reinforcement Learning Lars Buesing T. Weber S. Racanière S. M. Ali Eslami Danilo Jimenez Rezende ... Fabio Viola F. Besse Karol Gregor Demis Hassabis Daan Wierstra OffRL 35 134 0 08 Feb 2018
Obfuscated Gradients Give a False Sense of Security: Circumventing Defenses to Adversarial Examples Anish Athalye Nicholas Carlini D. Wagner AAML 98 3,160 0 01 Feb 2018
Fast Power system security analysis with Guided Dropout Benjamin Donnot Isabelle M Guyon Marc Schoenauer Antoine Marot P. Panciatici 28 28 0 30 Jan 2018
Empirical Explorations in Training Networks with Discrete Activations S. Baluja MQ 31 1 0 16 Jan 2018
Audio Adversarial Examples: Targeted Attacks on Speech-to-Text Nicholas Carlini D. Wagner AAML 38 1,074 0 05 Jan 2018
Learning Sparse Neural Networks through $L_0$ Regularization Christos Louizos Max Welling Diederik P. Kingma 33 1,132 0 04 Dec 2017
Layer-wise Learning of Stochastic Neural Networks with Information Bottleneck Thanh T. Nguyen Jaesik Choi 20 13 0 04 Dec 2017
Probabilistic Adaptive Computation Time Michael Figurnov Artem Sobolev Dmitry Vetrov BDL 28 8 0 01 Dec 2017
Convolutional Networks with Adaptive Inference Graphs Andreas Veit Serge J. Belongie OOD GNN 44 382 0 30 Nov 2017
Towards Accurate Binary Convolutional Neural Network Xiaofan Lin Cong Zhao Wei Pan MQ 33 635 0 30 Nov 2017
Plan, Attend, Generate: Planning for Sequence-to-Sequence Models Francis Dutil Çağlar Gülçehre Adam Trischler Yoshua Bengio 26 12 0 28 Nov 2017
On the Robustness of Semantic Segmentation Models to Adversarial Attacks Anurag Arnab O. Mikšík Philip Torr AAML 33 304 0 27 Nov 2017
End-to-End Supervised Product Quantization for Image Search and Retrieval Benjamin Klein Lior Wolf MQ 21 65 0 23 Nov 2017
ACtuAL: Actor-Critic Under Adversarial Learning Anirudh Goyal Nan Rosemary Ke Alex Lamb R. Devon Hjelm C. Pal Joelle Pineau Yoshua Bengio GAN 30 9 0 13 Nov 2017