Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation

15 August 2013

Aaron Courville

Papers citing "Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation"

50 / 1,513 papers shown

Title
Sample Complexity of Algorithm Selection Using Neural Networks and Its Applications to Branch-and-Cut Hongyu Cheng Sammy Khalife Barbara Fiedorowicz Amitabh Basu 81 2 0 04 Feb 2024
MixedNUTS: Training-Free Accuracy-Robustness Balance via Nonlinearly Mixed Classifiers Yatong Bai Mo Zhou Vishal M. Patel Somayeh Sojoudi AAML 96 8 0 03 Feb 2024
Spiking Music: Audio Compression with Event Based Auto-encoders Martim Lisboa Guillaume Bellec 75 2 0 02 Feb 2024
A Differentiable Partially Observable Generalized Linear Model with Forward-Backward Message Passing Chengrui Li Weihan Li Yule Wang Anqi Wu 56 1 0 02 Feb 2024
Neural Language of Thought Models Yi-Fu Wu Minseung Lee Sungjin Ahn MLLM VLM 133 6 0 02 Feb 2024
Lightweight Pixel Difference Networks for Efficient Visual Representation Learning Z. Su Jiehua Zhang Longguang Wang Hua Zhang Zhen Liu M. Pietikäinen Li Liu 92 22 0 01 Feb 2024
Robustly overfitting latents for flexible neural image compression Yura Perugachi-Diaz Arwin Gansekoele Sandjai Bhulai 76 2 0 31 Jan 2024
Trainable Fixed-Point Quantization for Deep Learning Acceleration on FPGAs Dingyi Dai Yichi Zhang Jiahao Zhang Zhanqiu Hu Yaohui Cai Qi Sun Zhiru Zhang MQ 95 7 0 31 Jan 2024
Forecasting VIX using Bayesian Deep Learning Héctor J. Hortúa Andrés Mora-Valencia BDL OOD 96 4 0 30 Jan 2024
X-PEFT: eXtremely Parameter-Efficient Fine-Tuning for Extreme Multi-Profile Scenarios Namju Kwak Taesup Kim MoE 31 0 0 29 Jan 2024
A Comprehensive Survey of Compression Algorithms for Language Models Seungcheol Park Jaehyeon Choi Sojin Lee U. Kang MQ 116 16 0 27 Jan 2024
Towards Cheaper Inference in Deep Networks with Lower Bit-Width Accumulators Yaniv Blumenfeld Itay Hubara Daniel Soudry 84 4 0 25 Jan 2024
Masked Particle Modeling on Sets: Towards Self-Supervised High Energy Physics Foundation Models T. Golling Lukas Heinrich Michael Kagan Samuel Klein Matthew Leigh Margarita Osadchy J. A. Raine 87 27 0 24 Jan 2024
Text-to-Image Cross-Modal Generation: A Systematic Review Maciej Żelaszczyk Jacek Mańdziuk 100 4 0 21 Jan 2024
Neglected Hessian component explains mysteries in Sharpness regularization Yann N. Dauphin Atish Agarwala Hossein Mobahi FAtt 134 7 0 19 Jan 2024
A2Q+: Improving Accumulator-Aware Weight Quantization Ian Colbert Alessandro Pappalardo Jakoba Petri-Koenig Yaman Umuroglu MQ 71 5 0 19 Jan 2024
Adaptive Self-training Framework for Fine-grained Scene Graph Generation Kibum Kim Kanghoon Yoon Yeonjun In Jinyoung Moon Donghyun Kim Chanyoung Park 88 9 0 18 Jan 2024
Optimization of Discrete Parameters Using the Adaptive Gradient Method and Directed Evolution Andrei Beinarovich Sergey Stepanov Alexander Zaslavsky 82 0 0 12 Jan 2024
A foundation for exact binarized morphological neural networks T. Aouad Hugues Talbot 33 1 0 08 Jan 2024
Training a General Spiking Neural Network with Improved Efficiency and Minimum Latency Yunpeng Yao Man Wu Zheng Chen Renyuan Zhang 100 0 0 05 Jan 2024
Retraining-free Model Quantization via One-Shot Weight-Coupling Learning Chen Tang Yuan Meng Jiacheng Jiang Shuzhao Xie Rongwei Lu Xinzhu Ma Zhi Wang Wenwu Zhu MQ 73 11 0 03 Jan 2024
Compact Neural Graphics Primitives with Learned Hash Probing Towaki Takikawa Thomas Müller Merlin Nimier-David Alex Evans Sanja Fidler Alec Jacobson Alexander Keller 69 21 0 28 Dec 2023
City-on-Web: Real-time Neural Rendering of Large-scale Scenes on the Web Kaiwen Song Xiaoyi Zeng Chenqu Ren Juyong Zhang AI4CE 83 11 0 27 Dec 2023
Compressing Image-to-Image Translation GANs Using Local Density Structures on Their Learned Manifold Alireza Ganjdanesh Shangqian Gao Hirad Alipanah Heng-Chiao Huang GAN 95 7 0 22 Dec 2023
ARBiBench: Benchmarking Adversarial Robustness of Binarized Neural Networks Peng Zhao Jiehua Zhang Bowen Peng Longguang Wang Yingmei Wei Yu Liu Li Liu AAML 86 0 0 21 Dec 2023
DSFormer: Effective Compression of Text-Transformers by Dense-Sparse Weight Factorization Rahul Chand Yashoteja Prabhu Pratyush Kumar 64 3 0 20 Dec 2023
Sign Language Production with Latent Motion Transformer Pan Xie Taiying Peng Yao Du Qipeng Zhang SLR 71 5 0 20 Dec 2023
SCoTTi: Save Computation at Training Time with an adaptive framework Ziyu Li Enzo Tartaglione Van-Tam Nguyen 92 0 0 19 Dec 2023
Continual Learning: Forget-free Winning Subnetworks for Video Representations Haeyong Kang Jaehong Yoon Sung Ju Hwang Chang D. Yoo CLL 139 2 0 19 Dec 2023
Multiple Hypothesis Dropout: Estimating the Parameters of Multi-Modal Output Distributions David D. Nguyen David Liebowitz Surya Nepal S. Kanhere OOD UQCV 60 0 0 18 Dec 2023
Learning to Act without Actions Dominik Schmidt Minqi Jiang OffRL 140 38 0 17 Dec 2023
Learning Interpretable Queries for Explainable Image Classification with Information Pursuit Stefan Kolek Aditya Chattopadhyay Kwan Ho Ryan Chan Héctor Andrade-Loarca Gitta Kutyniok René Vidal 36 2 0 16 Dec 2023
Adaptive Computation Modules: Granular Conditional Computation For Efficient Inference Bartosz Wójcik Alessio Devoto Karol Pustelnik Pasquale Minervini Simone Scardapane 86 6 0 15 Dec 2023
One Self-Configurable Model to Solve Many Abstract Visual Reasoning Problems Mikolaj Malkiñski Jacek Mańdziuk 69 4 0 15 Dec 2023
End-to-End Training of Neural Networks for Automotive Radar Interference Mitigation Christian Oswald Máté Tóth Paul Meissner Franz Pernkopf AAML 46 3 0 15 Dec 2023
USM-Lite: Quantization and Sparsity Aware Fine-tuning for Speech Recognition with Universal Speech Models Shaojin Ding David Qiu David Rim Yanzhang He Oleg Rybakov ... Tara N. Sainath Zhonglin Han Jian Li Amir Yazdanbakhsh Shivani Agrawal MQ 111 12 0 13 Dec 2023
Modality Plug-and-Play: Elastic Modality Adaptation in Multimodal LLMs for Embodied AI Kai Huang Boyuan Yang Wei Gao 68 1 0 13 Dec 2023
IDKM: Memory Efficient Neural Network Quantization via Implicit, Differentiable k-Means Sean Jaffe Ambuj K. Singh Francesco Bullo MQ 69 0 0 12 Dec 2023
Expand-and-Quantize: Unsupervised Semantic Segmentation Using High-Dimensional Space and Product Quantization Jiyoung Kim Kyuhong Shim Insu Lee B. Shim 58 2 0 12 Dec 2023
Building Universal Foundation Models for Medical Image Analysis with Spatially Adaptive Networks Lingxiao Luo Xuanzhong Chen Bingda Tang Xinsheng Chen Rong Han Chengpeng Hu Yujiang Li Ting Chen MedIm 72 2 0 12 Dec 2023
MaxQ: Multi-Axis Query for N:M Sparsity Network Jingyang Xiang Siqi Li Junhao Chen Zhuangzhi Chen Tianxin Huang Linpeng Peng Yong-Jin Liu 58 0 0 12 Dec 2023
When Bio-Inspired Computing meets Deep Learning: Low-Latency, Accurate, & Energy-Efficient Spiking Neural Networks from Artificial Neural Networks Gourav Datta Zeyu Liu James Diffenderfer B. Kailkhura Peter A. Beerel 134 1 0 12 Dec 2023
Noise Adaptor in Spiking Neural Networks Chen Li Bipin Rajendran 73 0 0 08 Dec 2023
EE-LLM: Large-Scale Training and Inference of Early-Exit Large Language Models with 3D Parallelism Yanxi Chen Xuchen Pan Yaliang Li Bolin Ding Jingren Zhou LRM 110 33 0 08 Dec 2023
Finding Interpretable Class-Specific Patterns through Efficient Neural Search Nils Philipp Walter Jonas Fischer Jilles Vreeken 47 4 0 07 Dec 2023
SmoothQuant+: Accurate and Efficient 4-bit Post-Training WeightQuantization for LLM Jiayi Pan Chengcan Wang Kaifu Zheng Yangguang Li Zhenyu Wang Bin Feng MQ 76 7 0 06 Dec 2023
Balanced Marginal and Joint Distributional Learning via Mixture Cramer-Wold Distance SeungHwan An Sungchul Hong Jong-June Jeon 64 0 0 06 Dec 2023
Compositional Generalization for Data-to-Text Generation Xinnuo Xu Ivan Titov Mirella Lapata 72 2 0 05 Dec 2023
Accelerating Learnt Video Codecs with Gradient Decay and Layer-wise Distillation Tianhao Peng Ge Gao Heming Sun Fan Zhang David Bull 49 4 0 05 Dec 2023
VividTalk: One-Shot Audio-Driven Talking Head Generation Based on 3D Hybrid Prior Xusen Sun Longhao Zhang Hao Zhu Peng Zhang Bang Zhang Xinya Ji Kangneng Zhou Daiheng Gao Liefeng Bo Xun Cao VGen 108 29 0 04 Dec 2023