Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation

15 August 2013

Aaron Courville

Papers citing "Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation"

50 / 1,511 papers shown

Title
Optimizing LLMs for Resource-Constrained Environments: A Survey of Model Compression Techniques Sanjay Surendranath Girija Shashank Kapoor Lakshit Arora Dipen Pradhan Aman Raj Ankit Shetgaonkar 162 0 0 05 May 2025
HybridGS: High-Efficiency Gaussian Splatting Data Compression using Dual-Channel Sparse Representation and Point Cloud Encoder Qi Yang Le Yang G. Van der Auwera Zhu Li 73 0 0 03 May 2025
BitNet v2: Native 4-bit Activations with Hadamard Transformation for 1-bit LLMs Hongyu Wang Shuming Ma Furu Wei MQ 99 4 0 25 Apr 2025
POET: Prompt Offset Tuning for Continual Human Action Adaptation Prachi Garg Joseph K J V. Balasubramanian Necati Cihan Camgöz Chengde Wan Kenrick Kin Weiguang Si Shugao Ma Fernando de la Torre 137 0 0 25 Apr 2025
Precision Neural Network Quantization via Learnable Adaptive Modules Wenqiang Zhou Zhendong Yu Xianglong Liu Jiaming Yang Rong Xiao Tao Wang Chenwei Tang Jiancheng Lv MQ 67 0 0 24 Apr 2025
DRAWER: Digital Reconstruction and Articulation With Environment Realism Hongchi Xia Entong Su Marius Memmel Arhan Jain Raymond Yu Numfor Mbiziwo-Tiapo Ali Farhadi Abhishek Gupta Shenlong Wang Wei-Chiu Ma VGen 122 1 0 21 Apr 2025
TTRD3: Texture Transfer Residual Denoising Dual Diffusion Model for Remote Sensing Image Super-Resolution Yide Liu Haijiang Sun Xiaowen Zhang Qiaoyuan Liu Zhouchang Chen Chongzhuo Xiao DiffM 76 0 0 17 Apr 2025
Learning Compatible Multi-Prize Subnetworks for Asymmetric Retrieval Yushuai Sun Zikun Zhou D. Jiang Yaowei Wang Jun Yu Guangming Lu Wenjie Pei 74 0 0 16 Apr 2025
Optimizing Compound Retrieval Systems Harrie Oosterhuis R. Jagerman Zhen Qin Xuanhui Wang 74 0 0 16 Apr 2025
Dense Backpropagation Improves Training for Sparse Mixture-of-Experts Ashwinee Panda Vatsal Baherwani Zain Sarwar Benjamin Thérien Supriyo Chakraborty Tom Goldstein MoE 135 0 0 16 Apr 2025
Quantization Error Propagation: Revisiting Layer-Wise Post-Training Quantization Yamato Arai Yuma Ichikawa MQ 107 0 0 13 Apr 2025
Slow Thinking for Sequential Recommendation Junjie Zhang Beichen Zhang Wenqi Sun Hongyu Lu Wayne Xin Zhao Yu Chen Ji-Rong Wen OffRL LRM 109 1 0 13 Apr 2025
LauraTSE: Target Speaker Extraction using Auto-Regressive Decoder-Only Language Models Beilong Tang Bang Zeng Ming Li AI4TS 77 0 0 10 Apr 2025
DyDiT++: Dynamic Diffusion Transformers for Efficient Visual Generation Wangbo Zhao Yizeng Han Jiasheng Tang Kai Wang Hao Luo Yibing Song Gao Huang Fan Wang Yang You 165 0 0 09 Apr 2025
Push-Grasp Policy Learning Using Equivariant Models and Grasp Score Optimization Boce Hu Heng Tian Dian Wang Haojie Huang Xupeng Zhu Robin Walters Robert Platt 101 2 0 03 Apr 2025
Moment Quantization for Video Temporal Grounding Xiaolong Sun Le Wang Sanping Zhou Liushuai Shi Kun Xia Mengnan Liu Yabing Wang Gang Hua MQ 73 0 0 03 Apr 2025
Adapting World Models with Latent-State Dynamics Residuals JB Lanier Kyungmin Kim Armin Karamzade Yifei Liu Ankita Sinha Kat He Davide Corsi Roy Fox 81 0 0 03 Apr 2025
AdaRank: Adaptive Rank Pruning for Enhanced Model Merging Chanhyuk Lee Jiho Choi Chanryeol Lee Donggyun Kim Seunghoon Hong MoMe 83 1 0 28 Mar 2025
Harnessing uncertainty when learning through Equilibrium Propagation in neural networks Jonathan Peters Philippe Talatchian 87 0 0 28 Mar 2025
Boosting Large Language Models with Mask Fine-Tuning M. Zhang Yue Bai Huan Wang Yizhou Wang Qihua Dong Y. Fu CLL 100 0 0 27 Mar 2025
TC-GS: Tri-plane based compression for 3D Gaussian Splatting Taorui Wang Zitong Yu Yong Xu 3DGS 98 1 0 26 Mar 2025
Optimal Scaling Laws for Efficiency Gains in a Theoretical Transformer-Augmented Sectional MoE Framework Soham Sane MoE 100 0 0 26 Mar 2025
Faster Parameter-Efficient Tuning with Token Redundancy Reduction Kwonyoung Kim Jungin Park Jin-Hwa Kim Hyeongjun Kwon Kwanghoon Sohn 141 1 0 26 Mar 2025
QUAD: Quantization and Parameter-Efficient Tuning of LLM with Activation Decomposition Yuxuan Hu Xiaodong Chen Cuiping Li Hong Chen Jing Zhang MQ 122 1 0 25 Mar 2025
CODA: Repurposing Continuous VAEs for Discrete Tokenization Zeyu Liu Zanlin Ni Yeguo Hua Xin Deng Xiao Ma Cheng Zhong Gao Huang 84 0 0 22 Mar 2025
Optimized Minimal 3D Gaussian Splatting J. Lee J. Ko Eunbyung Park 3DGS 76 0 0 21 Mar 2025
Offline Model-Based Optimization: Comprehensive Review Minsu Kim Jiayao Gu Ye Yuan Taeyoung Yun Ziqiang Liu Yoshua Bengio Can Chen OffRL 123 4 0 21 Mar 2025
Input-Triggered Hardware Trojan Attack on Spiking Neural Networks Spyridon Raptis Paul Kling Ioannis Kaskampas Ihsen Alouani Haralampos-G. Stratigopoulos AAML 87 1 0 20 Mar 2025
Towards Automated Semantic Interpretability in Reinforcement Learning via Vision-Language Models Zhaoxin Li Zhang Xi-Jia Batuhan Altundas Letian Chen Rohan R. Paleja Matthew C. Gombolay OffRL 76 0 0 20 Mar 2025
Efficient ANN-Guided Distillation: Aligning Rate-based Features of Spiking Neural Networks through Hybrid Block-wise Replacement Shu Yang Chao Yu Lei Liu Hanzhi Ma Aili Wang Erping Li 100 1 0 20 Mar 2025
Natural Quantization of Neural Networks Richard Barney Djamil Lakhdar-Hamina Victor Galitski MQ 64 0 0 19 Mar 2025
Cube: A Roblox View of 3D Intelligence Foundation AI Team Roblox Kiran Bhat Nishchaie Khanna Karun Channa Tinghui Zhou ... Kyle Price Steve Han Yiqing Wang A. Singh David Baszucki 135 1 0 19 Mar 2025
PARQ: Piecewise-Affine Regularized Quantization Lisa Jin Jianhao Ma Zechun Liu Andrey Gromov Aaron Defazio Lin Xiao MQ 73 1 0 19 Mar 2025
Efficient Personalization of Quantized Diffusion Model without Backpropagation H. Seo Wongi Jeong Kyungryeol Lee Se Young Chun DiffM MQ 139 0 0 19 Mar 2025
Robust Machine Unlearning for Quantized Neural Networks via Adaptive Gradient Reweighting with Similar Labels Yujia Tong Yuze Wang Jingling Yuan Chuang Hu NoLa 108 0 0 18 Mar 2025
ClusComp: A Simple Paradigm for Model Compression and Efficient Finetuning Baohao Liao Christian Herold Seyyed Hadi Hashemi Stefan Vasilev Shahram Khadivi Christof Monz MQ 136 0 0 17 Mar 2025
Stabilizing Quantization-Aware Training by Implicit-Regularization on Hessian Matrix Junbiao Pang Tianyang Cai 132 1 0 14 Mar 2025
Generative Binary Memory: Pseudo-Replay Class-Incremental Learning on Binarized Embeddings Yanis Basso-Bert Anca Molnos Romain Lemaire William Guicquero Antoine Dupret BDL 113 0 0 13 Mar 2025
TAR3D: Creating High-Quality 3D Assets via Next-Part Prediction Xuying Zhang Yutong Liu Yangguang Li Renrui Zhang Yong Liu ... Wanli Ouyang Zhiwei Xiong Peng Gao Qibin Hou Ming-Ming Cheng 239 3 0 13 Mar 2025
LUMOS: Language-Conditioned Imitation Learning with World Models Iman Nematollahi Branton DeMoss Akshay L Chandra Nick Hawes Wolfram Burgard Ingmar Posner OffRL 71 1 0 13 Mar 2025
PCGS: Progressive Compression of 3D Gaussian Splatting Yihang Chen Mengyao Li Qianyi Wu Weiyao Lin Mehrtash Harandi Jianfei Cai 3DGS 96 2 0 11 Mar 2025
Towards Experience Replay for Class-Incremental Learning in Fully-Binary Networks Yanis Basso-Bert Anca Molnos Romain Lemaire William Guicquero Antoine Dupret CLL 136 0 0 10 Mar 2025
SMILENet: Unleashing Extra-Large Capacity Image Steganography via a Synergistic Mosaic InvertibLE Hiding Network Jun-Jie Huang Zihan Chen Tianrui Liu Wentao Zhao Xin Deng Xinwang Liu Meng Wang Pier Luigi Dragotti 144 0 0 07 Mar 2025
MergeQuant: Accurate 4-bit Static Quantization of Large Language Models by Channel-wise Calibration Jinguang Wang Jiangming Wang Haifeng Sun Tingting Yang Zirui Zhuang Wanyi Ning Yuexi Yin Q. Qi Jianxin Liao MQ MoMe 99 0 0 07 Mar 2025
Learning Transformer-based World Models with Contrastive Predictive Coding Maxime Burchi Radu Timofte 126 2 0 06 Mar 2025
Boosting Offline Optimizers with Surrogate Sensitivity Manh Cuong Dao Phi Le Nguyen Thao Nguyen Truong Trong Nghia Hoang OffRL 104 6 0 06 Mar 2025
10K is Enough: An Ultra-Lightweight Binarized Network for Infrared Small-Target Detection Biqiao Xin Qianchen Mao Bingshu Wang Jiangbin Zheng Yong Zhao C. L. P. Chen MQ 136 0 0 04 Mar 2025
Deep Robust Reversible Watermarking Jiale Chen Wei Wang Chongyang Shi Li Dong Yuanman Li Xiping Hu 68 0 0 04 Mar 2025
Spark-TTS: An Efficient LLM-Based Text-to-Speech Model with Single-Stream Decoupled Speech Tokens Xiang Wang Mingqi Jiang Zejun Ma Ziyu Zhang Shixuan Liu ... Zhifei Li Xie Chen Lei Xie Yu Guo Wei Xue 132 22 0 03 Mar 2025
Discrete-Time Hybrid Automata Learning: Legged Locomotion Meets Skateboarding Hang Liu Sangli Teng Ben Liu Wei Zhang Maani Ghaffari 129 4 0 03 Mar 2025