Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation

15 August 2013

Aaron Courville

Papers citing "Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation"

50 / 1,874 papers shown

Title
Fast Adjustable Threshold For Uniform Neural Network Quantization (Winning solution of LPIRC-II) A. Goncharenko Andrey Denisov S. Alyamkin Evgeny Terentev MQ 20 20 0 19 Dec 2018
Mask-aware networks for crowd counting Shengqin Jiang Xiaobo Lu Yinjie Lei Lingqiao Liu 20 41 0 18 Dec 2018
Deep learning incorporating biologically-inspired neural dynamics Stanisław Woźniak A. Pantazi Thomas Bohnstingl E. Eleftheriou 17 9 0 17 Dec 2018
Recent Advances in Autoencoder-Based Representation Learning Michael Tschannen Olivier Bachem Mario Lucic OOD SSL DRL 12 441 0 12 Dec 2018
A Main/Subsidiary Network Framework for Simplifying Binary Neural Network Yinghao Xu Xin Dong Yudian Li Hao Su 30 27 0 11 Dec 2018
Channel selection using Gumbel Softmax Charles Herrmann Richard Strong Bowen Ramin Zabih 25 3 0 11 Dec 2018
Efficient and Robust Machine Learning for Real-World Systems Franz Pernkopf Wolfgang Roth Matthias Zöhrer Lukas Pfeifenberger Günther Schindler Holger Froening Sebastian Tschiatschek Robert Peharz Matthew Mattina Zoubin Ghahramani OOD 27 1 0 05 Dec 2018
Learning Multimodal Graph-to-Graph Translation for Molecular Optimization Wengong Jin Kevin Kaichuang Yang Regina Barzilay Tommi Jaakkola 35 224 0 03 Dec 2018
Mixed Precision Quantization of ConvNets via Differentiable Neural Architecture Search Bichen Wu Yanghan Wang Peizhao Zhang Yuandong Tian Peter Vajda Kurt Keutzer MQ 22 272 0 30 Nov 2018
Learning Finite State Representations of Recurrent Policy Networks Anurag Koul S. Greydanus Alan Fern 19 88 0 29 Nov 2018
You Look Twice: GaterNet for Dynamic Filter Selection in CNNs Zhourong Chen Yang Li Samy Bengio Si Si 36 98 0 27 Nov 2018
Eliminating Exposure Bias and Loss-Evaluation Mismatch in Multiple Object Tracking Andrii Maksai Pascal Fua VOT 22 17 0 27 Nov 2018
Efficient non-uniform quantizer for quantized neural network targeting reconfigurable hardware Natan Liss Chaim Baskin A. Mendelson A. Bronstein Raja Giryes MQ 24 5 0 27 Nov 2018
Structured Binary Neural Networks for Accurate Image Classification and Semantic Segmentation Bohan Zhuang Chunhua Shen Mingkui Tan Lingqiao Liu Ian Reid MQ 27 152 0 22 Nov 2018
SpotTune: Transfer Learning through Adaptive Fine-tuning Yunhui Guo Humphrey Shi Abhishek Kumar Kristen Grauman Tajana Simunic Rogerio Feris 41 446 0 21 Nov 2018
Modular Networks: Learning to Decompose Neural Computation Louis Kirsch Julius Kunze David Barber 19 110 0 13 Nov 2018
Generalized Ternary Connect: End-to-End Learning and Compression of Multiplication-Free Deep Neural Networks Samyak Parajuli Aswin Raghavan S. Chai 32 7 0 12 Nov 2018
Bi-Directional Differentiable Input Reconstruction for Low-Resource Neural Machine Translation Xing Niu Weijia Xu Marine Carpuat 19 17 0 02 Nov 2018
Towards the AlexNet Moment for Homomorphic Encryption: HCNN, theFirst Homomorphic CNN on Encrypted Data with GPUs Ahmad Al Badawi Jin Chao Jie Lin Chan Fook Mun Sim Jun Jie B. Tan Xiao Nan Khin Mi Mi Aung V. Chandrasekhar 29 64 0 02 Nov 2018
Online Embedding Compression for Text Classification using Low Rank Matrix Factorization Anish Acharya Rahul Goel A. Metallinou Inderjit Dhillon 25 58 0 01 Nov 2018
End-to-End Feedback Loss in Speech Chain Framework via Straight-Through Estimator Andros Tjandra S. Sakti Satoshi Nakamura 21 44 0 31 Oct 2018
Improved Network Robustness with Adversary Critic Alexander Matyasko Lap-Pui Chau AAML 21 14 0 30 Oct 2018
Whetstone: A Method for Training Deep Artificial Neural Networks for Binary Communication William M. Severa C. Vineyard Ryan Dellana Stephen J Verzi J. Aimone 28 95 0 26 Oct 2018
Reversible Recurrent Neural Networks M. Mackay Paul Vicol Jimmy Ba Roger C. Grosse 6 52 0 25 Oct 2018
Piano Genie Chris Donahue Ian Simon Sander Dieleman 30 43 0 11 Oct 2018
Rao-Blackwellized Stochastic Gradients for Discrete Distributions Runjing Liu Jeffrey Regier Nilesh Tripuraneni Michael I. Jordan Jon D. McAuliffe 23 31 0 10 Oct 2018
Training Generative Adversarial Networks with Binary Neurons by End-to-end Backpropagation Hao-Wen Dong Yi-Hsuan Yang SyDa GAN MQ 11 11 0 10 Oct 2018
Feature Selection using Stochastic Gates Yutaro Yamada Ofir Lindenbaum S. Negahban Y. Kluger 24 43 0 09 Oct 2018
Relaxed Quantization for Discretized Neural Networks Christos Louizos M. Reisser Tijmen Blankevoort E. Gavves Max Welling MQ 36 132 0 03 Oct 2018
2018 Low-Power Image Recognition Challenge S. Alyamkin M. Ardi Achille Brighton Alexander C. Berg Yiran Chen ... George K. Thiruvathukal Baiwu Zhang Jingchi Zhang Xiaopeng Zhang Shaojie Zhuo BDL 23 13 0 03 Oct 2018
Learning to Segment Inputs for NMT Favors Character-Level Processing Julia Kreutzer Artem Sokolov 27 31 0 02 Oct 2018
Simultaneously Optimizing Weight and Quantizer of Ternary Neural Network using Truncated Gaussian Approximation Zhezhi He Deliang Fan MQ 16 66 0 02 Oct 2018
NICE: Noise Injection and Clamping Estimation for Neural Network Quantization Chaim Baskin Natan Liss Yoav Chai Evgenii Zheltonozhskii Eli Schwartz Raja Giryes A. Mendelson A. Bronstein MQ 17 60 0 29 Sep 2018
Improved Gradient-Based Optimization Over Discrete Distributions Evgeny Andriyash Arash Vahdat W. Macready 24 9 0 29 Sep 2018
Tangent: Automatic differentiation using source-code transformation for dynamically typed array programming B. V. Merrienboer D. Moldovan Alexander B. Wiltschko 17 31 0 25 Sep 2018
No Multiplication? No Floating Point? No Problem! Training Networks for Efficient Inference S. Baluja David Marwood Michele Covell Nick Johnston MQ 26 8 0 24 Sep 2018
Adversarial Defense via Data Dependent Activation Function and Total Variation Minimization Bao Wang A. Lin Weizhi Zhu Penghang Yin Andrea L. Bertozzi Stanley J. Osher AAML 39 21 0 23 Sep 2018
Discovering Low-Precision Networks Close to Full-Precision Networks for Efficient Embedded Inference J. McKinstry S. K. Esser R. Appuswamy Deepika Bablani John V. Arthur Izzet B. Yildiz D. Modha MQ 21 94 0 11 Sep 2018
Are You Sure You Want To Do That? Classification with Verification Harris Chan Atef Chaudhury Kevin Shen 11 0 0 07 Sep 2018
Learning Sparse Low-Precision Neural Networks With Learnable Regularization Yoojin Choi Mostafa El-Khamy Jungwon Lee MQ 30 31 0 01 Sep 2018
Revisiting Character-Based Neural Machine Translation with Capacity and Compression Colin Cherry George F. Foster Ankur Bapna Orhan Firat Wolfgang Macherey 25 94 0 29 Aug 2018
Learning to Quantize Deep Networks by Optimizing Quantization Intervals with Task Loss S. Jung Changyong Son Seohyung Lee JinWoo Son Youngjun Kwak Jae-Joon Han Sung Ju Hwang Changkyu Choi MQ 25 373 0 17 Aug 2018
DNN Feature Map Compression using Learned Representation over GF(2) Denis A. Gudovskiy Alec Hodgkinson Luca Rigazio 11 18 0 15 Aug 2018
Blended Coarse Gradient Descent for Full Quantization of Deep Neural Networks Penghang Yin Shuai Zhang J. Lyu Stanley Osher Y. Qi Jack Xin MQ 44 61 0 15 Aug 2018
Learning ReLU Networks on Linearly Separable Data: Algorithm, Optimality, and Generalization G. Wang G. Giannakis Jie Chen MLT 24 131 0 14 Aug 2018
A Survey on Methods and Theories of Quantized Neural Networks Yunhui Guo MQ 34 232 0 13 Aug 2018
A Fourier View of REINFORCE Adeel Pervez 29 0 0 12 Aug 2018
Training Compact Neural Networks with Binary Weights and Low Precision Activations Bohan Zhuang Chunhua Shen Ian Reid MQ 13 14 0 08 Aug 2018
Segmental Audio Word2Vec: Representing Utterances as Sequences of Vectors with Applications in Spoken Term Detection Yu-Hsuan Wang Hung-yi Lee Lin-Shan Lee 32 54 0 07 Aug 2018
A Review of Learning with Deep Generative Models from Perspective of Graphical Modeling Zhijian Ou 31 16 0 05 Aug 2018