Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation

15 August 2013

Aaron Courville

Papers citing "Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation"

50 / 1,874 papers shown

Title
Designing Complex Experiments by Applying Unsupervised Machine Learning A. Glushkovsky 32 0 0 29 Sep 2021
One Loss for All: Deep Hashing with a Single Cosine Similarity based Learning Objective Jiun Tian Hoe KamWoh Ng Tianyu Zhang Chee Seng Chan Yi-Zhe Song Tao Xiang MQ 40 110 0 29 Sep 2021
Understanding and Overcoming the Challenges of Efficient Transformer Quantization Yelysei Bondarenko Markus Nagel Tijmen Blankevoort MQ 30 135 0 27 Sep 2021
Meta-Aggregator: Learning to Aggregate for 1-bit Graph Neural Networks Yongcheng Jing Yiding Yang Xinchao Wang Xiuming Zhang Dacheng Tao 37 39 0 27 Sep 2021
Distribution-sensitive Information Retention for Accurate Binary Neural Network Haotong Qin Xiangguo Zhang Ruihao Gong Yifu Ding Yi Xu Xianglong Liu MQ 25 88 0 25 Sep 2021
Learning Multi-Layered GBDT Via Back Propagation Zhendong Zhang AI4CE 33 0 0 24 Sep 2021
Unbiased Gradient Estimation with Balanced Assignments for Mixtures of Experts W. Kool Chris J. Maddison A. Mnih 60 10 0 24 Sep 2021
Training Deep Spiking Auto-encoders without Bursting or Dying Neurons through Regularization Justus F. Hübotter Pablo Lanillos Jakub M. Tomczak 29 3 0 22 Sep 2021
Noisy-to-Noisy Voice Conversion Framework with Denoising Model Chao Xie Yi-Chiao Wu Patrick Lumban Tobing Wen-Chin Huang Tomoki Toda 35 7 0 22 Sep 2021
Learning Versatile Convolution Filters for Efficient Visual Recognition Kai Han Yunhe Wang Chang Xu Chunjing Xu Enhua Wu Dacheng Tao 27 8 0 20 Sep 2021
Soft Actor-Critic With Integer Actions Ting-Han Fan Yubo Wang 35 12 0 17 Sep 2021
OMPQ: Orthogonal Mixed Precision Quantization Yuexiao Ma Taisong Jin Xiawu Zheng Yan Wang Huixia Li Yongjian Wu Guannan Jiang Wei Zhang Rongrong Ji MQ 24 34 0 16 Sep 2021
StreamHover: Livestream Transcript Summarization and Annotation Sangwoo Cho Franck Dernoncourt Timothy Jeewun Ganter Trung Bui Nedim Lipka Walter Chang Hailin Jin Jonathan Brandt H. Foroosh Fei Liu 3DGS AI4TS 42 29 0 11 Sep 2021
Block Pruning For Faster Transformers François Lagunas Ella Charlaix Victor Sanh Alexander M. Rush VLM 33 219 0 10 Sep 2021
Dynamic Collective Intelligence Learning: Finding Efficient Sparse Model via Refined Gradients for Pruned Weights Jang-Hyun Kim Jayeon Yoo Yeji Song Kiyoon Yoo Nojun Kwak 41 6 0 10 Sep 2021
Math Word Problem Generation with Mathematical Consistency and Problem Context Constraints Zichao Wang Andrew Lan Richard G. Baraniuk 64 45 0 09 Sep 2021
Variational Latent-State GPT for Semi-Supervised Task-Oriented Dialog Systems Hong Liu Yucheng Cai Zhenru Lin Zhijian Ou Yi Huang Junlan Feng DRL VLM BDL 54 18 0 09 Sep 2021
IICNet: A Generic Framework for Reversible Image Conversion Ka Leong Cheng Yueqi Xie Qifeng Chen 48 24 0 09 Sep 2021
$ECQ$^{\text{x}}$: Explainability-Driven Quantization for Low-Bit and Sparse DNNs$ ECQ $^{\text{x}}$ : Explainability-Driven Quantization for Low-Bit and Sparse DNNs Daniel Becking Maximilian Dreyer Wojciech Samek Karsten Müller Sebastian Lapuschkin MQ 232 13 0 09 Sep 2021
What's Hidden in a One-layer Randomly Weighted Transformer? Sheng Shen Z. Yao Douwe Kiela Kurt Keutzer Michael W. Mahoney 39 4 0 08 Sep 2021
GDP: Stabilized Neural Network Pruning via Gates with Differentiable Polarization Yi Guo Huan Yuan Jianchao Tan Zhangyang Wang Sen Yang Ji Liu 36 46 0 06 Sep 2021
Cluster-Promoting Quantization with Bit-Drop for Minimizing Network Quantization Loss J. H. Lee Jihun Yun Sung Ju Hwang Eunho Yang MQ 39 15 0 05 Sep 2021
Task-Oriented Communication for Multi-Device Cooperative Edge Inference Jiawei Shao Yuyi Mao Jun Zhang 31 129 0 01 Sep 2021
Quantized Convolutional Neural Networks Through the Lens of Partial Differential Equations Ido Ben-Yair Gil Ben Shalom Moshe Eliasof Eran Treister MQ 50 5 0 31 Aug 2021
Learning Energy-Based Approximate Inference Networks for Structured Applications in NLP Lifu Tu BDL 40 0 0 27 Aug 2021
4-bit Quantization of LSTM-based Speech Recognition Models A. Fasoli Chia-Yu Chen Mauricio Serrano Xiao Sun Naigang Wang ... Xiaodong Cui Brian Kingsbury Wei Zhang Zoltán Tüske K. Gopalakrishnan MQ 31 22 0 27 Aug 2021
Continual learning under domain transfer with sparse synaptic bursting Shawn L. E. Beaulieu Jeff Clune Nick Cheney CLL OOD 32 1 0 26 Aug 2021
Learning Effective and Efficient Embedding via an Adaptively-Masked Twins-based Layer Bencheng Yan Pengjie Wang Kai Zhang Wei Lin Kuang-chih Lee Jian Xu Bo Zheng 29 26 0 24 Aug 2021
Dynamic Network Quantization for Efficient Video Inference Ximeng Sun Yikang Shen Chun-Fu Chen A. Oliva Rogerio Feris Kate Saenko 46 45 0 23 Aug 2021
Supervised Compression for Resource-Constrained Edge Computing Systems Yoshitomo Matsubara Ruihan Yang Marco Levorato Stephan Mandt 38 58 0 21 Aug 2021
BlockCopy: High-Resolution Video Processing with Block-Sparse Feature Propagation and Online Policies Thomas Verelst Tinne Tuytelaars OffRL 17 15 0 20 Aug 2021
Causal Attention for Unbiased Visual Recognition Tan Wang Chan Zhou Qianru Sun Hanwang Zhang OOD CML 48 110 0 19 Aug 2021
KCNet: An Insect-Inspired Single-Hidden-Layer Neural Network with Randomized Binary Weights for Prediction and Classification Tasks Jinyung Hong Theodore P. Pavlic MQ 15 4 0 17 Aug 2021
Graph Contrastive Learning for Anomaly Detection Bo Chen Jing Zhang Yanling Wang Yuxiao Dong Jian Song Peng Zhang Kai Xu Evgeny Kharlamov Jie Tang 29 41 0 17 Aug 2021
Memory-Efficient Factorization Machines via Binarizing both Data and Model Coefficients Yu Geng Liang Lan 18 0 0 17 Aug 2021
BOBCAT: Bilevel Optimization-Based Computerized Adaptive Testing Aritra Ghosh Andrew Lan 21 33 0 17 Aug 2021
Distance-aware Quantization Dohyung Kim Junghyup Lee Bumsub Ham MQ 31 29 0 16 Aug 2021
Cross-modal Spectrum Transformation Network For Acoustic Scene classification Yang Liu A. Neophytou Sunando Sengupta Eric Sommerlade 23 9 0 13 Aug 2021
Differentiable Subset Pruning of Transformer Heads Jiaoda Li Ryan Cotterell Mrinmaya Sachan 50 54 0 10 Aug 2021
Information Bottleneck Approach to Spatial Attention Learning Qiuxia Lai Yu Li Ailing Zeng Minhao Liu Hanqiu Sun Qiang Xu 22 9 0 07 Aug 2021
Controlled Text Generation as Continuous Optimization with Multiple Constraints Sachin Kumar Eric Malmi Aliaksei Severyn Yulia Tsvetkov BDL AI4CE 48 77 0 04 Aug 2021
Rapid Elastic Architecture Search under Specialized Classes and Resource Constraints Jing Liu Bohan Zhuang Mingkui Tan Xu Liu Dinh Q. Phung Yuanqing Li Jianfei Cai 38 0 0 03 Aug 2021
Learn to Match: Automatic Matching Network Design for Visual Tracking Zhipeng Zhang Yihao Liu Tianlin Li Bing Li Weiming Hu 38 168 0 02 Aug 2021
Adaptive Precision Training (AdaPT): A dynamic fixed point quantized training approach for DNNs Lorenz Kummer Kevin Sidak Tabea Reichmann Wilfried Gansterer MQ 32 5 0 28 Jul 2021
Insights from Generative Modeling for Neural Video Compression Ruihan Yang Yibo Yang Joseph Marino Stephan Mandt VGen 40 16 0 28 Jul 2021
Joint Visual Semantic Reasoning: Multi-Stage Decoder for Text Recognition A. Bhunia Aneeshan Sain Amandeep Kumar S. Ghose Pinaki Nath Chowdhury Yi-Zhe Song 35 56 0 26 Jul 2021
Self-Conditioned Probabilistic Learning of Video Rescaling Yuan Tian Guo Lu Xiongkuo Min Zhaohui Che Guangtao Zhai G. Guo Zhiyong Gao 33 26 0 24 Jul 2021
Modelling Latent Translations for Cross-Lingual Transfer Edoardo Ponti Julia Kreutzer Ivan Vulić Siva Reddy 45 18 0 23 Jul 2021
Image-to-Image Translation with Low Resolution Conditioning M. Abid Ihsen Hedhli Jean-François Lalonde Christian Gagné 34 2 0 23 Jul 2021
Pruning Ternary Quantization Danyang Liu Xiangshan Chen Jie Fu Chen Ma Xue Liu MQ 47 0 0 23 Jul 2021