Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation

15 August 2013

Aaron Courville

Papers citing "Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation"

50 / 1,519 papers shown

Title
VA-RED $^2$ : Video Adaptive Redundancy Reduction Bowen Pan Yikang Shen Camilo Luciano Fosco Chung-Ching Lin A. Andonian Yue Meng Kate Saenko A. Oliva Rogerio Feris 84 19 0 15 Feb 2021
FAT: Learning Low-Bitwidth Parametric Representation via Frequency-Aware Transformation Chaofan Tao Rui Lin Quan Chen Zhaoyang Zhang Ping Luo Ngai Wong MQ 63 7 0 15 Feb 2021
Confounding Tradeoffs for Neural Network Quantization Sahaj Garg Anirudh Jain Joe Lou Mitchell Nahmias MQ 76 19 0 12 Feb 2021
Dynamic Precision Analog Computing for Neural Networks Sahaj Garg Joe Lou Anirudh Jain Mitchell Nahmias 75 33 0 12 Feb 2021
AdaFuse: Adaptive Temporal Fusion Network for Efficient Action Recognition Yue Meng Yikang Shen Chung-Ching Lin P. Sattigeri Leonid Karlinsky Kate Saenko A. Oliva Rogerio Feris 167 63 0 10 Feb 2021
Dynamic Neural Networks: A Survey Yizeng Han Gao Huang Shiji Song Le Yang Honghui Wang Yulin Wang 3DH AI4TS AI4CE 151 659 0 09 Feb 2021
Unlocking Pixels for Reinforcement Learning via Implicit Attention K. Choromanski Deepali Jain Wenhao Yu Xingyou Song Jack Parker-Holder ... Aldo Pacchiano Anirban Santara Yunhao Tang Jie Tan Adrian Weller OffRL 58 3 0 08 Feb 2021
Efficient Certified Defenses Against Patch Attacks on Image Classifiers J. H. Metzen Maksym Yatsura AAML 61 41 0 08 Feb 2021
Learning N:M Fine-grained Structured Sparse Neural Networks From Scratch Aojun Zhou Yukun Ma Junnan Zhu Jianbo Liu Zhijie Zhang Kun Yuan Wenxiu Sun Hongsheng Li 225 250 0 08 Feb 2021
BinaryCoP: Binary Neural Network-based COVID-19 Face-Mask Wear and Positioning Predictor on Edge Devices Nael Fasfous M. Vemparala Alexander Frickenstein Lukas Frickenstein W. Stechele CVBM 89 34 0 06 Feb 2021
RpBERT: A Text-image Relation Propagation-based BERT Model for Multimodal NER Lin Sun Jiquan Wang Kai Zhang Yindu Su Fangsheng Weng 82 141 0 05 Feb 2021
Adversarial Contrastive Pre-training for Protein Sequences Matthew B. A. McDermott Brendan Yap Harry Hsu Di Jin Peter Szolovits AAML 92 10 0 31 Jan 2021
VX2TEXT: End-to-End Learning of Video-Based Text Generation From Multimodal Inputs Xudong Lin Gedas Bertasius Jue Wang Shih-Fu Chang Devi Parikh Lorenzo Torresani VGen 102 67 0 28 Jan 2021
Overfitting for Fun and Profit: Instance-Adaptive Data Compression T. V. Rozendaal Iris A. M. Huijben Taco S. Cohen 105 47 0 21 Jan 2021
KDLSQ-BERT: A Quantized Bert Combining Knowledge Distillation with Learned Step Size Quantization Jing Jin Cai Liang Tiancheng Wu Li Zou Zhiliang Gan MQ 59 27 0 15 Jan 2021
Binary Graph Neural Networks Mehdi Bahri Gaétan Bahl Stefanos Zafeiriou GNN AI4CE 78 54 0 31 Dec 2020
Learned Multi-Resolution Variable-Rate Image Compression with Octave-based Residual Blocks Mohammad Akbari Jie Liang Jingning Han Chengjie Tu 59 21 0 31 Dec 2020
Differentiable Programming à la Moreau Vincent Roulet Zaïd Harchaoui 81 5 0 31 Dec 2020
Deep Unsupervised Image Hashing by Maximizing Bit Entropy Yun-qiang Li Jan van Gemert 41 93 0 22 Dec 2020
Resource-efficient DNNs for Keyword Spotting using Neural Architecture Search and Quantization David Peter Wolfgang Roth Franz Pernkopf 71 6 0 18 Dec 2020
FantastIC4: A Hardware-Software Co-Design Approach for Efficiently Running 4bit-Compact Multilayer Perceptrons Simon Wiedemann Suhas Shivapakash P. Wiedemann Daniel Becking Wojciech Samek F. Gerfers Thomas Wiegand MQ 67 7 0 17 Dec 2020
Taming Transformers for High-Resolution Image Synthesis Patrick Esser Robin Rombach Bjorn Ommer ViT 148 3,016 0 17 Dec 2020
Rule Extraction from Binary Neural Networks with Convolutional Rules for Model Validation Sophie Burkhardt Jannis Brugger Nicolas Wagner Zahra Ahmadi Kristian Kersting Stefan Kramer NAI FAtt 88 8 0 15 Dec 2020
BiSNN: Training Spiking Neural Networks with Binary Weights via Bayesian Learning Hyeryung Jang N. Skatchkovsky Osvaldo Simeone 87 17 0 15 Dec 2020
Towards unsupervised phone and word segmentation using self-supervised vector-quantized neural networks Herman Kamper Benjamin van Niekerk SSL MQ 91 36 0 14 Dec 2020
Movie Summarization via Sparse Graph Construction Pinelopi Papalampidi Frank Keller Mirella Lapata 98 32 0 14 Dec 2020
SenSeNet: Neural Keyphrase Generation with Document Structure Yichao Luo Zhengyan Li Bingning Wang Xiaoyu Xing Qi Zhang Xuanjing Huang 59 9 0 12 Dec 2020
PiRank: Scalable Learning To Rank via Differentiable Sorting Robin M. E. Swezey Aditya Grover Bruno Charron Stefano Ermon 91 30 0 12 Dec 2020
Recurrence of Optimum for Training Weight and Activation Quantized Networks Ziang Long Penghang Yin Jack Xin MQ 65 4 0 10 Dec 2020
Extractive Opinion Summarization in Quantized Transformer Spaces Stefanos Angelidis Reinald Kim Amplayo Yoshihiko Suhara Xiaolan Wang Mirella Lapata MQ 157 111 0 08 Dec 2020
Mix and Match: A Novel FPGA-Centric Deep Neural Network Quantization Framework Sung-En Chang Yanyu Li Mengshu Sun Runbin Shi Hayden Kwok-Hay So Xuehai Qian Yanzhi Wang Xue Lin MQ 84 89 0 08 Dec 2020
DiffPrune: Neural Network Pruning with Deterministic Approximate Binary Gates and $L_0$ Regularization Yaniv Shulman 82 3 0 07 Dec 2020
Improving Accuracy of Binary Neural Networks using Unbalanced Activation Distribution Hyungjun Kim Jihoon Park Chang-Ho Lee Jae-Joon Kim MQ 87 31 0 02 Dec 2020
Deconstructing the Structure of Sparse Neural Networks M. V. Gelder Mitchell Wortsman Kiana Ehsani 28 1 0 30 Nov 2020
Direct Evolutionary Optimization of Variational Autoencoders With Binary Latents E. Guiraud Jakob Drefs Jörg Lücke DRL 89 3 0 27 Nov 2020
TaylorGAN: Neighbor-Augmented Policy Update for Sample-Efficient Natural Language Generation Chun-Hsing Lin Siang-Ruei Wu Hung-yi Lee Yun-Nung Chen LLMAG 51 3 0 27 Nov 2020
Bringing AI To Edge: From Deep Learning's Perspective Di Liu Hao Kong Xiangzhong Luo Weichen Liu Ravi Subramaniam 116 125 0 25 Nov 2020
AI Discovering a Coordinate System of Chemical Elements: Dual Representation by Variational Autoencoders A. Glushkovsky DRL 134 6 0 24 Nov 2020
SegBlocks: Block-Based Dynamic Resolution Networks for Real-Time Segmentation Thomas Verelst Tinne Tuytelaars SSeg 53 17 0 24 Nov 2020
Learning Quantized Neural Nets by Coarse Gradient Method for Non-linear Classification Ziang Long Penghang Yin Jack Xin MQ 67 4 0 23 Nov 2020
Learning to Drop: Robust Graph Neural Network via Topological Denoising Dongsheng Luo Wei Cheng Wenchao Yu Bo Zong Jingchao Ni Haifeng Chen Xiang Zhang OOD 95 266 0 13 Nov 2020
Filter Pre-Pruning for Improved Fine-tuning of Quantized Deep Neural Networks Jun Nishikawa Ryoji Ikegaya MQ 34 1 0 13 Nov 2020
Efficient Neural Architecture Search for End-to-end Speech Recognition via Straight-Through Gradients Huahuan Zheng Keyu An Zhijian Ou 131 14 0 11 Nov 2020
Paralinguistic Privacy Protection at the Edge Ranya Aloufi Hamed Haddadi David E. Boyle 68 14 0 04 Nov 2020
Perceive, Attend, and Drive: Learning Spatial Attention for Safe Self-Driving Bob Wei Mengye Ren Wenyuan Zeng Ming Liang Binh Yang R. Urtasun 3DPC 103 44 0 02 Nov 2020
A Statistical Framework for Low-bitwidth Training of Deep Neural Networks Jianfei Chen Yujie Gai Z. Yao Michael W. Mahoney Joseph E. Gonzalez MQ 73 59 0 27 Oct 2020
Reducing the Computational Cost of Deep Generative Models with Binary Neural Networks Thomas Bird F. Kingma David Barber SyDa MQ AI4CE 143 9 0 26 Oct 2020
$P^2$ Net: Augmented Parallel-Pyramid Net for Attention Guided Pose Estimation Luanxuan Hou Jie Cao Yuan Zhao Haifeng Shen Jian-Bo Tang Ran He 42 2 0 26 Oct 2020
Neural Network Approximation: Three Hidden Layers Are Enough Zuowei Shen Haizhao Yang Shijun Zhang 139 121 0 25 Oct 2020
A Differentiable Relaxation of Graph Segmentation and Alignment for AMR Parsing Chunchuan Lyu Shay B. Cohen Ivan Titov 128 11 0 23 Oct 2020