Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation

15 August 2013

Aaron Courville

Papers citing "Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation"

50 / 1,513 papers shown

Title
What's Hidden in a Randomly Weighted Neural Network? Vivek Ramanujan Mitchell Wortsman Aniruddha Kembhavi Ali Farhadi Mohammad Rastegari 81 363 0 29 Nov 2019
Semi-Relaxed Quantization with DropBits: Training Low-Bit Neural Networks via Bit-wise Regularization J. H. Lee Jihun Yun Sung Ju Hwang Eunho Yang MQ 24 0 0 29 Nov 2019
QKD: Quantization-aware Knowledge Distillation Jangho Kim Yash Bhalgat Jinwon Lee Chirag I. Patel Nojun Kwak MQ 100 66 0 28 Nov 2019
AdaShare: Learning What To Share For Efficient Deep Multi-Task Learning Ximeng Sun Yikang Shen Rogerio Feris Kate Saenko 97 269 0 27 Nov 2019
Technical report: supervised training of convolutional spiking neural networks with PyTorch Romain Zimmer Thomas Pellegrini S. Singh T. Masquelier 71 32 0 22 Nov 2019
Learning Hierarchical Discrete Linguistic Units from Visually-Grounded Speech David Harwath Wei-Ning Hsu James R. Glass 104 85 0 21 Nov 2019
Few Shot Network Compression via Cross Distillation Haoli Bai Jiaxiang Wu Irwin King Michael Lyu FedML 97 60 0 21 Nov 2019
Deep Spiking Neural Networks for Large Vocabulary Automatic Speech Recognition Jibin Wu Emre Yilmaz Malu Zhang Haizhou Li Kay Chen Tan 72 107 0 19 Nov 2019
AddNet: Deep Neural Networks Using FPGA-Optimized Multipliers Julian Faraone M. Kumm M. Hardieck P. Zipf Xueyuan Liu David Boland Philip H. W. Leong MQ 34 45 0 19 Nov 2019
Any-Precision Deep Neural Networks Haichao Yu Haoxiang Li Humphrey Shi Thomas S. Huang G. Hua MQ 93 65 0 17 Nov 2019
Faster AutoAugment: Learning Augmentation Strategies using Backpropagation Ryuichiro Hataya Jan Zdenek Kazuki Yoshizoe Hideki Nakayama 77 208 0 16 Nov 2019
Adversarial Examples in Modern Machine Learning: A Review R. Wiyatno Anqi Xu Ousmane Amadou Dia A. D. Berker AAML 127 105 0 13 Nov 2019
Location Attention for Extrapolation to Longer Sequences Yann Dubois Gautier Dagan Dieuwke Hupkes Elia Bruni 79 44 0 10 Nov 2019
HAWQ-V2: Hessian Aware trace-Weighted Quantization of Neural Networks Zhen Dong Z. Yao Yaohui Cai Daiyaan Arfeen A. Gholami Michael W. Mahoney Kurt Keutzer MQ 97 284 0 10 Nov 2019
Turbo Autoencoder: Deep learning based channel codes for point-to-point communication channels Yihan Jiang Hyeji Kim Himanshu Asnani Sreeram Kannan Sewoong Oh Pramod Viswanath 69 138 0 08 Nov 2019
Emergence of Numeric Concepts in Multi-Agent Autonomous Communication Shangmin Guo LLMAG 57 3 0 04 Nov 2019
A Latent Morphology Model for Open-Vocabulary Neural Machine Translation Duygu Ataman Wilker Aziz Alexandra Birch 95 16 0 30 Oct 2019
A Game Theoretic Approach to Class-wise Selective Rationalization Shiyu Chang Yang Zhang Mo Yu Tommi Jaakkola 66 62 0 28 Oct 2019
Towards Unsupervised Speech Recognition and Synthesis with Quantized Speech Representation Learning Alexander H. Liu Tao Tu Hung-yi Lee Lin-Shan Lee SSL 112 50 0 28 Oct 2019
A Deep Learning Approach to Universal Binary Visible Light Communication Transceiver Hoon Lee Tony Q.S. Quek Sang Hyun Lee 55 18 0 26 Oct 2019
Masked Gradient-Based Causal Structure Learning Ignavier Ng Shengyu Zhu Zhuangyan Fang Haoyang Li Zhitang Chen Jun Wang CML 154 117 0 18 Oct 2019
The Heidelberg spiking datasets for the systematic evaluation of spiking neural networks Benjamin Cramer Yannik Stradmann Johannes Schemmel Friedemann Zenke 73 221 0 16 Oct 2019
Q8BERT: Quantized 8Bit BERT Ofir Zafrir Guy Boudoukh Peter Izsak Moshe Wasserblat MQ 112 507 0 14 Oct 2019
Straight-Through Estimator as Projected Wasserstein Gradient Flow Pengyu Cheng YooJung Choi Yitao Liang Dinghan Shen Ricardo Henao Guy Van den Broeck 86 14 0 05 Oct 2019
Variational Temporal Abstraction Taesup Kim Sungjin Ahn Yoshua Bengio DRL 102 65 0 02 Oct 2019
Additive Powers-of-Two Quantization: An Efficient Non-uniform Discretization for Neural Networks Yuhang Li Xin Dong Wei Wang MQ 84 260 0 28 Sep 2019
Impact of Low-bitwidth Quantization on the Adversarial Robustness for Embedded Neural Networks Rémi Bernhard Pierre-Alain Moëllic J. Dutertre AAML MQ 98 18 0 27 Sep 2019
Balanced Binary Neural Networks with Gated Residual Mingzhu Shen Xianglong Liu Ruihao Gong Kai Han MQ 79 36 0 26 Sep 2019
Accurate and Compact Convolutional Neural Networks with Trained Binarization Zhe Xu R. Cheung MQ 58 54 0 25 Sep 2019
Supervised Vector Quantized Variational Autoencoder for Learning Interpretable Global Representations Yifan Xue Michael Q. Ding Xinghua Lu DRL SSL 22 3 0 24 Sep 2019
Forward and Backward Information Retention for Accurate Binary Neural Networks Haotong Qin Ruihao Gong Xianglong Liu Mingzhu Shen Ziran Wei F. Yu Jingkuan Song MQ 220 334 0 24 Sep 2019
Structured Binary Neural Networks for Image Recognition Bohan Zhuang Chunhua Shen Mingkui Tan Peng Chen Lingqiao Liu Ian Reid MQ 135 19 0 22 Sep 2019
Searching for Accurate Binary Neural Architectures Mingzhu Shen Kai Han Chunjing Xu Yunhe Wang MQ 149 64 0 16 Sep 2019
Training High-Performance and Large-Scale Deep Neural Networks with Full 8-bit Integers Yukuan Yang Shuang Wu Lei Deng Tianyi Yan Yuan Xie Guoqi Li MQ 171 113 0 05 Sep 2019
Image Captioning with Sparse Recurrent Neural Network J. Tan Chee Seng Chan Joon Huang Chuah VLM 54 6 0 28 Aug 2019
PixelVAE++: Improved PixelVAE with Discrete Prior Hossein Sadeghi Evgeny Andriyash W. Vinci L. Buffoni Mohammad H. Amin BDL DRL 53 33 0 26 Aug 2019
Differentiable Product Quantization for End-to-End Embedding Compression Ting Chen Lala Li Yizhou Sun MQ 55 68 0 26 Aug 2019
Embarrassingly Simple Binary Representation Learning Yuming Shen Jie Qin Jiaxin Chen Li Liu Fan Zhu 78 22 0 26 Aug 2019
Normalizing Flows: An Introduction and Review of Current Methods I. Kobyzev S. Prince Marcus A. Brubaker TPM MedIm 100 58 0 25 Aug 2019
Video Compression With Rate-Distortion Autoencoders A. Habibian T. V. Rozendaal Jakub M. Tomczak Taco S. Cohen VGen 90 202 0 14 Aug 2019
Differentiable Soft Quantization: Bridging Full-Precision and Low-Bit Neural Networks Ruihao Gong Xianglong Liu Shenghu Jiang Tian-Hao Li Peng Hu Jiazhen Lin F. Yu Junjie Yan MQ 107 460 0 14 Aug 2019
Learn to Compress CSI and Allocate Resources in Vehicular Networks Liang Wang Hao Ye Le Liang Geoffrey Ye Li 52 40 0 12 Aug 2019
Effective Training of Convolutional Neural Networks with Low-bitwidth Weights and Activations Bohan Zhuang Jing Liu Mingkui Tan Lingqiao Liu Ian Reid Chunhua Shen MQ 99 46 0 10 Aug 2019
Cooperative image captioning Gilad Vered Gal Oren Yuval Atzmon Gal Chechik 56 2 0 26 Jul 2019
Deep-learning-based Optimization of the Under-sampling Pattern in MRI C. D. Bahadir Alan Q. Wang Adrian Dalca M. Sabuncu 51 9 0 26 Jul 2019
Noise Analysis of Photonic Modulator Neurons T. F. D. Lima A. Tait H. Saeidi M. Nahmias Hsuan-Tung Peng S. Abbaslou B. Shastri Paul R. Prucnal 39 39 0 17 Jul 2019
Large Memory Layers with Product Keys Guillaume Lample Alexandre Sablayrolles MarcÁurelio Ranzato Ludovic Denoyer Hervé Jégou MoE 93 135 0 10 Jul 2019
Single-Path Mobile AutoML: Efficient ConvNet Design and NAS Hyperparameter Optimization Dimitrios Stamoulis Ruizhou Ding Di Wang Dimitrios Lymberopoulos B. Priyantha Jie Liu Diana Marculescu 62 34 0 01 Jul 2019
Compression of Acoustic Event Detection Models With Quantized Distillation Bowen Shi Ming Sun Chieh-Chi Kao Viktor Rozgic Spyros Matsoukas Chao Wang 61 14 0 01 Jul 2019
Back to Simplicity: How to Train Accurate BNNs from Scratch? Joseph Bethge Haojin Yang Marvin Bornstein Christoph Meinel AAML MQ 64 58 0 19 Jun 2019