Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation

15 August 2013

Aaron Courville

Papers citing "Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation"

50 / 1,513 papers shown

Title
Towards Lightweight Speaker Verification via Adaptive Neural Network Quantization Bei Liu Haoyu Wang Yanmin Qian MQ 93 1 0 08 Jun 2024
Designs for Enabling Collaboration in Human-Machine Teaming via Interactive and Explainable Systems Rohan R. Paleja Michael Munje K. Chang Reed Jensen Matthew C. Gombolay 94 2 0 07 Jun 2024
Concurrent Training and Layer Pruning of Deep Neural Networks Valentin Frank Ingmar Guenter Athanasios Sideris 3DPC 88 3 0 06 Jun 2024
On the Hardness of Probabilistic Neurosymbolic Learning Jaron Maene Vincent Derkinderen Luc de Raedt 91 4 0 06 Jun 2024
BitsFusion: 1.99 bits Weight Quantization of Diffusion Model Yang Sui Yanyu Li Anil Kag Yerlan Idelbayev Junli Cao Ju Hu Dhritiman Sagar Bo Yuan Sergey Tulyakov Jian Ren MQ 94 22 0 06 Jun 2024
How Far Can We Compress Instant-NGP-Based NeRF? Yihang Chen Qianyi Wu Mehrtash Harandi Jianfei Cai 89 19 0 06 Jun 2024
CIRCUITSYNTH: Leveraging Large Language Models for Circuit Topology Synthesis Prashanth Vijayaraghavan Luyao Shi Ehsan Degan Xin Zhang 113 2 0 06 Jun 2024
SpikeLM: Towards General Spike-Driven Language Modeling via Elastic Bi-Spiking Mechanisms Xingrun Xing Zheng Zhang Ziyi Ni Shitao Xiao Yiming Ju Siqi Fan Yequan Wang Jiajun Zhang Guoqi Li 96 11 0 05 Jun 2024
Scalable MatMul-free Language Modeling Rui-Jie Zhu Yu Zhang Ethan Sifferman Tyler Sheaves Yiqiao Wang Dustin Richmond P. Zhou Jason K. Eshraghian 104 22 0 04 Jun 2024
T2LM: Long-Term 3D Human Motion Generation from Multiple Sentences T. Lee Fabien Baradel Thomas Lucas Kyoung Mu Lee Grégory Rogez 109 6 0 02 Jun 2024
ContextFlow++: Generalist-Specialist Flow-based Generative Models with Mixed-Variable Context Encoding Denis A. Gudovskiy Tomoyuki Okuno Yohei Nakata MoE AI4CE 90 2 0 02 Jun 2024
LAGMA: LAtent Goal-guided Multi-Agent Reinforcement Learning Hyungho Na IL-Chul Moon 69 1 0 30 May 2024
Statistical Context Detection for Deep Lifelong Reinforcement Learning Jeffery Dick Saptarshi Nath Christos Peridis Eseoghene Ben-Iwhiwhu Soheil Kolouri Andrea Soltoggio OffRL 83 2 0 29 May 2024
LP-3DGS: Learning to Prune 3D Gaussian Splatting Zhaoliang Zhang Tianchen Song Yongjae Lee Li Yang Cheng-Fang Peng Rama Chellappa Deliang Fan 3DGS 76 11 0 29 May 2024
The Binary Quantized Neural Network for Dense Prediction via Specially Designed Upsampling and Attention Xingyu Ding Li Shan Guiqin Zhao Meiqi Wu Wenzhang Zhou Wei Li MQ 74 1 0 28 May 2024
F-3DGS: Factorized Coordinates and Representations for 3D Gaussian Splatting Xiangyu Sun J. Lee Daniel Rho Jong Hwan Ko Usman Ali Eunbyung Park 3DGS 80 9 0 27 May 2024
Extreme Compression of Adaptive Neural Images Leo Hoshikawa Marcos V. Conde Takeshi Ohashi Atsushi Irie 97 1 0 27 May 2024
Variational Offline Multi-agent Skill Discovery Jiayu Chen Bhargav Ganguly Tian-Shing Lan OffRL 130 3 0 26 May 2024
SPP: Sparsity-Preserved Parameter-Efficient Fine-Tuning for Large Language Models Xudong Lu Aojun Zhou Yuhui Xu Renrui Zhang Peng Gao Hongsheng Li 77 8 0 25 May 2024
MuDreamer: Learning Predictive World Models without Reconstruction Maxime Burchi Radu Timofte 75 4 0 23 May 2024
PV-Tuning: Beyond Straight-Through Estimation for Extreme LLM Compression Vladimir Malinovskii Denis Mazur Ivan Ilin Denis Kuznedelev Konstantin Burlachenko Kai Yi Dan Alistarh Peter Richtárik MQ 118 24 0 23 May 2024
RectifID: Personalizing Rectified Flow with Anchored Classifier Guidance Zhicheng Sun Zhenhao Yang Yang Jin Haozhe Chi Kun Xu ... Hao Jiang Di Zhang Yang Song Kun Gai Yadong Mu 106 4 0 23 May 2024
Poisson Variational Autoencoder Hadi Vafaii Dekel Galor Jacob L. Yates DRL 77 2 0 23 May 2024
Efficient Multitask Dense Predictor via Binarization Yuzhang Shang Dan Xu Gaowen Liu Ramana Rao Kompella Yan Yan MQ AAML 105 1 0 23 May 2024
TerDiT: Ternary Diffusion Models with Transformers Xudong Lu Aojun Zhou Ziyi Lin Qi Liu Yuhui Xu Renrui Zhang Yafei Wen Shuai Ren Peng Gao Junchi Yan MQ 124 3 0 23 May 2024
Two Heads are Better Than One: Neural Networks Quantization with 2D Hilbert Curve-based Output Representation Mykhail M. Uss Ruslan Yermolenko Olena Kolodiazhna Oleksii Shashko Ivan Safonov Volodymyr Savin Yoonjae Yeo Seowon Ji Jaeyun Jeong MQ 62 0 0 22 May 2024
QGait: Toward Accurate Quantization for Gait Recognition with Binarized Input Senmao Tian Haoyu Gao Gangyi Hong Shuyun Wang JingJie Wang Xin Yu Shunli Zhang MQ 58 1 0 22 May 2024
Dynamic Context Adaptation and Information Flow Control in Transformers: Introducing the Evaluator Adjuster Unit and Gated Residual Connections Sahil Rajesh Dhayalkar 39 1 0 22 May 2024
MotionGS : Compact Gaussian Splatting SLAM by Motion Filter Xinli Guo Weidong Zhang Ruonan Liu Peng Han Hongtian Chen 3DGS 101 4 0 18 May 2024
Learning to Predict Mutation Effects of Protein-Protein Interactions by Microenvironment-aware Hierarchical Prompt Learning Lirong Wu Yijun Tian Haitao Lin Yufei Huang Siyuan Li Nitesh Chawla Stan Z. Li 79 6 0 16 May 2024
VQDNA: Unleashing the Power of Vector Quantization for Multi-Species Genomic Sequence Modeling Siyuan Li Zedong Wang Zicheng Liu Di Wu Cheng Tan Jiangbin Zheng Yufei Huang Stan Z. Li 79 8 0 13 May 2024
Investigating the Semantic Robustness of CLIP-based Zero-Shot Anomaly Segmentation Kevin Stangl Marius Arvinte Weilin Xu Cory Cornelius VLM UQCV 92 0 0 13 May 2024
Controllable Image Generation With Composed Parallel Token Prediction Jamie Stirling Noura Al-Moubayed 87 0 0 10 May 2024
Custom Gradient Estimators are Straight-Through Estimators in Disguise Matt Schoenbauer Daniele Moro Lukasz Lew Andrew G. Howard MQ 83 4 0 08 May 2024
Learning Linear Block Error Correction Codes Yoni Choukroun Lior Wolf 79 7 0 07 May 2024
Efficient Text-driven Motion Generation via Latent Consistency Training Mengxian Hu Minghao Zhu Xun Zhou Qingqing Yan Shu Li Chengju Liu Qi Chen 79 2 0 05 May 2024
TLINet: Differentiable Neural Network Temporal Logic Inference Danyang Li Mingyu Cai C. Vasile Roberto Tron AI4CE NAI 93 0 0 03 May 2024
Inherent Trade-Offs between Diversity and Stability in Multi-Task Benchmarks Guanhua Zhang Moritz Hardt 100 11 0 02 May 2024
ESC: Efficient Speech Coding with Cross-Scale Residual Vector Quantized Transformers Yuzhe Gu Enmao Diao 106 4 0 30 Apr 2024
Stochastic Spiking Neural Networks with First-to-Spike Coding Yi Jiang Sen Lu Abhronil Sengupta 110 0 0 26 Apr 2024
Converting High-Performance and Low-Latency SNNs through Explicit Modelling of Residual Error in ANNs Zhipeng Huang Jianhao Ding Zhiyu Pan Haoran Li Ying Fang Zhaofei Yu Jian K. Liu 75 0 0 26 Apr 2024
How to Parameterize Asymmetric Quantization Ranges for Quantization-Aware Training Jaeseong You Minseop Park Kyunggeun Lee Seokjun An Chirag I. Patel Markus Nagel MQ 70 2 0 25 Apr 2024
Elucidating the theoretical underpinnings of surrogate gradient learning in spiking neural networks Julia Gygax Friedemann Zenke 105 4 0 23 Apr 2024
AdaQAT: Adaptive Bit-Width Quantization-Aware Training Cédric Gernigon Silviu-Ioan Filip Olivier Sentieys Clément Coggiola Mickael Bruno 43 2 0 22 Apr 2024
IMO: Greedy Layer-Wise Sparse Representation Learning for Out-of-Distribution Text Classification with Pre-trained Models Tao Feng Zhuang Li Zhuang Li Haolan Zhan Yuncheng Hua Gholamreza Haffari VLM 97 1 0 21 Apr 2024
MP-DPD: Low-Complexity Mixed-Precision Neural Networks for Energy-Efficient Digital Predistortion of Wideband Power Amplifiers Yizhuo Wu Ang Li Mohammadreza Beikmirza G. Singh Qinyu Chen Leo C. N. de Vreede M. Alavi Chang Gao MQ 59 5 0 18 Apr 2024
MIDGET: Music Conditioned 3D Dance Generation Jinwu Wang Wei Mao Miaomiao Liu 74 0 0 18 Apr 2024
Tripod: Three Complementary Inductive Biases for Disentangled Representation Learning Kyle Hsu Jubayer Ibn Hamid Kaylee Burns Chelsea Finn Jiajun Wu CML 71 6 0 16 Apr 2024
SparseDM: Toward Sparse Efficient Diffusion Models Kafeng Wang Jianfei Chen He Li Zhenpeng Mi Jun-Jie Zhu DiffM 189 10 0 16 Apr 2024
SQUAT: Stateful Quantization-Aware Training in Recurrent Spiking Neural Networks Sreyes P. Venkatesh Razvan Marinescu Jason K. Eshraghian MQ 114 5 0 15 Apr 2024