Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation

15 August 2013

Aaron Courville

Papers citing "Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation"

50 / 1,513 papers shown

Title
Joint Learning of Geometric and Probabilistic Constellation Shaping Maximilian Stark Fayçal Ait Aoudia J. Hoydis 57 83 0 18 Jun 2019
Structured Pruning of Recurrent Neural Networks through Neuron Selection Liangjiang Wen Xuanyang Zhang Haoli Bai Zenglin Xu 72 38 0 17 Jun 2019
Conditional Computation for Continual Learning Min Lin Jie Fu Yoshua Bengio CLL 76 10 0 16 Jun 2019
Scalable Model Compression by Entropy Penalized Reparameterization Deniz Oktay Johannes Ballé Saurabh Singh Abhinav Shrivastava 84 43 0 15 Jun 2019
Divide and Conquer: Leveraging Intermediate Feature Representations for Quantized Training of Neural Networks Ahmed T. Elthakeb Prannoy Pilligundla Alex Cloninger H. Esmaeilzadeh MQ 53 8 0 14 Jun 2019
Parameterized Structured Pruning for Deep Neural Networks Günther Schindler Wolfgang Roth Franz Pernkopf Holger Froening 51 6 0 12 Jun 2019
Self-Supervised Exploration via Disagreement Deepak Pathak Dhiraj Gandhi Abhinav Gupta SSL 85 385 0 10 Jun 2019
Fighting Quantization Bias With Bias Alexander Finkelstein Uri Almog Mark Grobman MQ 82 57 0 07 Jun 2019
Latent Weights Do Not Exist: Rethinking Binarized Neural Network Optimization K. Helwegen James Widdicombe Lukas Geiger Zechun Liu K. Cheng Roeland Nusselder MQ 85 114 0 05 Jun 2019
Learning Object Bounding Boxes for 3D Instance Segmentation on Point Clouds Bo Yang Jianan Wang R. Clark Qingyong Hu Sen Wang Andrew Markham A. Trigoni 3DPC 164 329 0 04 Jun 2019
Relation Embedding with Dihedral Group in Knowledge Graph Canran Xu Ruijiang Li 48 74 0 03 Jun 2019
Discovering Neural Wirings Mitchell Wortsman Ali Farhadi Mohammad Rastegari AI4CE 122 121 0 03 Jun 2019
Multi-Precision Quantized Neural Networks via Encoding Decomposition of -1 and +1 Qigong Sun Fanhua Shang Kan Yang Xiufang Li Yan Ren L. Jiao MQ 70 12 0 31 May 2019
Deep Learning for Distributed Optimization: Applications to Wireless Resource Management Hoon Lee Sang Hyun Lee Tony Q.S. Quek 71 94 0 31 May 2019
Quantization Loss Re-Learning Method Kunping Li MQ 28 1 0 30 May 2019
Learning Navigation Subroutines from Egocentric Videos Ashish Kumar Saurabh Gupta Jitendra Malik SSL EgoV 85 13 0 29 May 2019
EDUCE: Explaining model Decisions through Unsupervised Concepts Extraction Diane Bouchacourt Ludovic Denoyer FAtt 74 21 0 28 May 2019
Inference with Hybrid Bio-hardware Neural Networks Yuan Zeng Zubayer Ibne Ferdous Weixian Zhang Mufan Xu Anlan Yu Drew Patel Xiaochen Guo Y. Berdichevsky Zhiyuan Yan 17 4 0 28 May 2019
Leap-LSTM: Enhancing Long Short-Term Memory for Text Categorization Ting-Hao 'Kenneth' Huang Gehui Shen Zhihong Deng VLM AI4TS 48 22 0 28 May 2019
Mixed Precision DNNs: All you need is a good parametrization Stefan Uhlich Lukas Mauch Fabien Cardinaux K. Yoshiyama Javier Alonso García Stephen Tiedemann Thomas Kemp Akira Nakamura MQ 108 39 0 27 May 2019
ProbAct: A Probabilistic Activation Function for Deep Neural Networks Kumar Shridhar JoonHo Lee Hideaki Hayashi Purvanshi Mehta Brian Kenji Iwana Seokjun Kang S. Uchida Sheraz Ahmed Andreas Dengel DiffM AAML 52 32 0 26 May 2019
Additive Noise Annealing and Approximation Properties of Quantized Neural Networks Matteo Spallanzani Lukas Cavigelli G. P. Leonardi Marko Bertogna Luca Benini 56 16 0 24 May 2019
Discrete Flows: Invertible Generative Models of Discrete Data Dustin Tran Keyon Vafa Kumar Krishna Agrawal Laurent Dinh Ben Poole DRL 166 117 0 24 May 2019
Dichotomize and Generalize: PAC-Bayesian Binary Activated Deep Neural Networks Gaël Letarte Pascal Germain Benjamin Guedj Franccois Laviolette MQ AI4CE UQCV 93 54 0 24 May 2019
Interpretable Neural Predictions with Differentiable Binary Variables Jasmijn Bastings Wilker Aziz Ivan Titov 89 215 0 20 May 2019
Integer Discrete Flows and Lossless Compression Emiel Hoogeboom Jorn W. T. Peters Rianne van den Berg Max Welling 170 160 0 17 May 2019
Lightweight Monocular Depth Estimation Model by Joint End-to-End Filter pruning Sara Elkerdawy Kuanqi Cai Nilanjan Ray MDE VLM 60 20 0 13 May 2019
Improving Discrete Latent Representations With Differentiable Approximation Bridges Jason Ramapuram Russ Webb DRL 40 9 0 09 May 2019
ARSM: Augment-REINFORCE-Swap-Merge Estimator for Gradient Backpropagation Through Categorical Variables Mingzhang Yin Yuguang Yue Mingyuan Zhou 66 23 0 04 May 2019
Compression of Acoustic Event Detection Models with Low-rank Matrix Factorization and Quantization Training Bowen Shi Ming Sun Chieh-Chi Kao Viktor Rozgic Spyros Matsoukas Chao Wang 49 15 0 02 May 2019
Incorporating Symbolic Sequential Modeling for Speech Enhancement Chien-Feng Liao Yu Tsao Xugang Lu Hisashi Kawai 50 18 0 30 Apr 2019
Memory-Augmented Temporal Dynamic Learning for Action Recognition Yuan. Yuan Dong Wang Qi. Wang 70 13 0 30 Apr 2019
SEALion: a Framework for Neural Network Inference on Encrypted Data Tim van Elsloo Giorgio Patrini Hamish Ivey-Law FedML 151 42 0 29 Apr 2019
Routing Networks and the Challenges of Modular and Compositional Computation Clemens Rosenbaum Ignacio Cases Matthew D Riemer Tim Klinger 77 84 0 29 Apr 2019
Deep Neuroevolution of Recurrent and Discrete World Models S. Risi Kenneth O. Stanley OCL 133 53 0 28 Apr 2019
Path-Restore: Learning Network Path Selection for Image Restoration K. Yu Xintao Wang Chao Dong Xiaoou Tang Chen Change Loy 86 84 0 23 Apr 2019
Obfuscation for Privacy-preserving Syntactic Parsing Zhifeng Hu Serhii Havrylov Ivan Titov Shay B. Cohen 59 7 0 21 Apr 2019
Defensive Quantization: When Efficiency Meets Robustness Ji Lin Chuang Gan Song Han MQ 118 204 0 17 Apr 2019
Question Guided Modular Routing Networks for Visual Question Answering Yanze Wu Qiang Sun Jianqi Ma Bin Li Yanwei Fu Yao Peng Xiangyang Xue 69 1 0 17 Apr 2019
Unsupervised acoustic unit discovery for speech synthesis using discrete latent-variable neural networks Ryan Eloff A. Nortje Benjamin van Niekerk Avashna Govender Leanne Nortje Arnu Pretorius Elan Van Biljon Ewald van der Westhuizen Lisa van Staden Herman Kamper DRL 79 57 0 16 Apr 2019
Low-Power Computer Vision: Status, Challenges, Opportunities S. Alyamkin M. Ardi Alexander C. Berg Achille Brighton Bo Chen ... George K. Thiruvathukal Baiwu Zhang Jingchi Zhang Xiaopeng Zhang Shaojie Zhuo 47 10 0 15 Apr 2019
CondConv: Conditionally Parameterized Convolutions for Efficient Inference Brandon Yang Gabriel Bender Quoc V. Le Jiquan Ngiam MedIm 3DV 100 642 0 10 Apr 2019
$L_0$ -ARM: Network Sparsification via Stochastic Binary Optimization Yang Li Shihao Ji MQ 49 15 0 09 Apr 2019
SEQ^3: Differentiable Sequence-to-Sequence-to-Sequence Autoencoder for Unsupervised Abstractive Sentence Compression Christos Baziotis Ion Androutsopoulos Ioannis Konstas Alexandros Potamianos 74 83 0 07 Apr 2019
Modeling Point Clouds with Self-Attention and Gumbel Subset Sampling Jiancheng Yang Qiang Zhang Bingbing Ni Linguo Li Jinxian Liu Mengdie Zhou Qi Tian 3DPC 95 382 0 06 Apr 2019
FLightNNs: Lightweight Quantized Deep Neural Networks for Fast and Accurate Inference Ruizhou Ding Z. Liu Ting-Wu Chin Diana Marculescu R. D. R. D. Blanton MQ 68 26 0 05 Apr 2019
Regularizing Activation Distribution for Training Binarized Deep Networks Ruizhou Ding Ting-Wu Chin Z. Liu Diana Marculescu MQ 74 149 0 04 Apr 2019
Differentiable Sampling with Flexible Reference Word Order for Neural Machine Translation Weijia Xu Xing Niu Marine Carpuat 75 10 0 04 Apr 2019
Bit-Flip Attack: Crushing Neural Network with Progressive Bit Search Adnan Siraj Rakin Zhezhi He Deliang Fan AAML 106 227 0 28 Mar 2019
Learning Discrete Structures for Graph Neural Networks Luca Franceschi Mathias Niepert Massimiliano Pontil X. He GNN 117 414 0 28 Mar 2019