Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation

15 August 2013

Aaron Courville

Papers citing "Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation"

50 / 1,517 papers shown

Title
Sub-network Discovery and Soft-masking for Continual Learning of Mixed Tasks Zixuan Ke Bing Liu Wenhan Xiong Asli Celikyilmaz Haoran Li CLL 75 7 0 13 Oct 2023
Real-Time Neural BRDF with Spherically Distributed Primitives Yishun Dou Zhong Zheng Qiaoqiao Jin Bingbing Ni Yugang Chen Junxiang Ke 3DH 40 1 0 12 Oct 2023
QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Models Jing Liu Ruihao Gong Xiuying Wei Zhiwei Dong Jianfei Cai Bohan Zhuang MQ 96 54 0 12 Oct 2023
AutoFHE: Automated Adaption of CNNs for Efficient Evaluation over FHE Wei Ao Vishnu Boddeti AAML 82 21 0 12 Oct 2023
NoMaD: Goal Masked Diffusion Policies for Navigation and Exploration A. Sridhar Dhruv Shah Catherine Glossop Sergey Levine 112 129 0 11 Oct 2023
Generalized Neural Sorting Networks with Error-Free Differentiable Swap Functions Jungtaek Kim Jeongbeen Yoon Minsu Cho 64 2 0 11 Oct 2023
Breaking Down Word Semantics from Pre-trained Language Models through Layer-wise Dimension Selection Nayoung Choi 52 0 0 08 Oct 2023
Revisiting Block-based Quantisation: What is Important for Sub-8-bit LLM Inference? Cheng Zhang Jianyi Cheng Ilia Shumailov George A. Constantinides Yiren Zhao MQ 82 10 0 08 Oct 2023
Exploiting Activation Sparsity with Dense to Dynamic-k Mixture-of-Experts Conversion Filip Szatkowski Eric Elmoznino Younesse Kaddar Simone Scardapane MoE 66 6 0 06 Oct 2023
Taming Binarized Neural Networks and Mixed-Integer Programs Johannes Aspman Georgios Korpas Georgios Korpas AI4CE 83 7 0 05 Oct 2023
GRAPES: Learning to Sample Graphs for Scalable Graph Neural Networks Taraneh Younesian Daniel Daza Emile van Krieken Thiviyan Thanapalasingam Peter Bloem 70 6 0 05 Oct 2023
EfficientDM: Efficient Quantization-Aware Fine-Tuning of Low-Bit Diffusion Models Yefei He Jing Liu Weijia Wu Hong Zhou Bohan Zhuang DiffM MQ 145 51 0 05 Oct 2023
Discovering Knowledge-Critical Subnetworks in Pretrained Language Models Deniz Bayazit Negar Foroutan Zeming Chen Gail Weiss Antoine Bosselut KELM 105 16 0 04 Oct 2023
Soft Convex Quantization: Revisiting Vector Quantization with Convex Optimization Tanmay Gautam Reid Pryzant Ziyi Yang Chenguang Zhu Somayeh Sojoudi MQ 58 4 0 04 Oct 2023
NOLA: Compressing LoRA using Linear Combination of Random Basis Soroush Abbasi Koohpayegani K. Navaneet Parsa Nooralinejad Soheil Kolouri Hamed Pirsiavash 145 16 0 04 Oct 2023
QuATON: Quantization Aware Training of Optical Neurons Hasindu Kariyawasam Ramith Hettiarachchi Quansan Yang Alex Matlock Takahiro Nambara Hiroyuki Kusaka Yuichiro Kunai Peter T C So Edward S Boyden D. Wadduwage MQ 64 1 0 04 Oct 2023
Feather: An Elegant Solution to Effective DNN Sparsification Athanasios Glentis Georgoulakis George Retsinas Petros Maragos 61 1 0 03 Oct 2023
FedL2P: Federated Learning to Personalize Royson Lee Minyoung Kim Da Li Xinchi Qiu Timothy M. Hospedales Ferenc Huszár Nicholas D. Lane FedML 71 0 0 03 Oct 2023
Dodo: Dynamic Contextual Compression for Decoder-only LMs Guanghui Qin Corby Rosset Ethan C. Chau Nikhil Rao Benjamin Van Durme 57 11 0 03 Oct 2023
Equivariant Adaptation of Large Pretrained Models Arnab Kumar Mondal Siba Smarak Panigrahi Sekouba Kaba Sai Rajeswar Siamak Ravanbakhsh 114 28 0 02 Oct 2023
BTR: Binary Token Representations for Efficient Retrieval Augmented Language Models Qingqing Cao Sewon Min Yizhong Wang Hannaneh Hajishirzi MQ RALM 81 5 0 02 Oct 2023
Modularity in Deep Learning: A Survey Haozhe Sun Isabelle Guyon MoMe 108 3 0 02 Oct 2023
Sparse Backpropagation for MoE Training Liyuan Liu Jianfeng Gao Weizhu Chen MoE 71 9 0 01 Oct 2023
Consciousness-Inspired Spatio-Temporal Abstractions for Better Generalization in Reinforcement Learning Mingde Zhao Safa Alver H. V. Seijen Romain Laroche Doina Precup Yoshua Bengio 61 3 0 30 Sep 2023
PB-LLM: Partially Binarized Large Language Models Yuzhang Shang Zhihang Yuan Qiang Wu Zhen Dong MQ 102 48 0 29 Sep 2023
SHACIRA: Scalable HAsh-grid Compression for Implicit Neural Representations Sharath Girish Abhinav Shrivastava Kamal Gupta 104 25 0 27 Sep 2023
Finite Scalar Quantization: VQ-VAE Made Simple Fabian Mentzer David C. Minnen E. Agustsson Michael Tschannen 111 190 0 27 Sep 2023
LAPP: Layer Adaptive Progressive Pruning for Compressing CNNs from Scratch P. Zhai K. Guo Fan Liu Xiaofen Xing Xiangmin Xu 60 3 0 25 Sep 2023
Flow Factorized Representation Learning Yue Song Thomas Anderson Keller N. Sebe Max Welling DRL OOD 130 3 0 22 Sep 2023
SupeRBNN: Randomized Binary Neural Network Using Adiabatic Superconductor Josephson Devices Zechao Li Geng Yuan Tomoharu Yamauchi Zabihi Masoud Yanyue Xie ... Xulong Tang Nobuyuki Yoshikawa Devesh Tiwari Yanzhi Wang O. Chen MQ 83 4 0 21 Sep 2023
BELT:Bootstrapping Electroencephalography-to-Language Decoding and Zero-Shot Sentiment Classification by Natural Language Supervision Jinzhao Zhou Yiqun Duan Yu-Cheng Chang Yu-Kai Wang Chin-Teng Lin 76 6 0 21 Sep 2023
Information based explanation methods for deep learning agents -- with applications on large open-source chess models Patrik Hammersborg Inga Strümke 35 1 0 18 Sep 2023
Mitigating Adversarial Attacks in Federated Learning with Trusted Execution Environments Simon Queyrut V. Schiavoni Pascal Felber AAML FedML 74 10 0 13 Sep 2023
Differentiable JPEG: The Devil is in the Details Christoph Reich Biplob K. Debnath Deep Patel S. Chakradhar DiffM 108 10 0 13 Sep 2023
Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs Wenhua Cheng Weiwei Zhang Haihao Shen Yiyang Cai Xin He Kaokao Lv Yi. Liu MQ 160 25 0 11 Sep 2023
When to Learn What: Model-Adaptive Data Augmentation Curriculum Chengkai Hou Jieyu Zhang Dinesh Manocha 71 17 0 09 Sep 2023
INSURE: An Information Theory Inspired Disentanglement and Purification Model for Domain Generalization Xi Yu Huan-Hsin Tseng Shinjae Yoo Haibin Ling Yuewei Lin OOD 124 11 0 08 Sep 2023
Dynamic Frame Interpolation in Wavelet Domain Lingtong Kong Boyuan Jiang Donghao Luo Wenqing Chu Ying Tai Chengjie Wang Jie Yang 67 3 0 07 Sep 2023
Bandwidth-efficient Inference for Neural Image Compression Shanzhi Yin Tongda Xu Yongsheng Liang Yuanyuan Wang Yanghao Li Yan Wang Jingjing Liu 53 1 0 06 Sep 2023
A skeletonization algorithm for gradient-based optimization Fernando Navarro Johannes C. Paetzold V. Zimmer Suprosanna Shit Ivan Ezhov Robbie Holland Monika Probst Julia A. Schnabel Daniel Rueckert ODL MedIm 70 21 0 05 Sep 2023
Enhance Multi-domain Sentiment Analysis of Review Texts through Prompting Strategies Yajing Wang Zongwei Luo LRM 40 5 0 05 Sep 2023
SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models Xin Zhang Dong Zhang Shimin Li Yaqian Zhou Xipeng Qiu 117 66 0 31 Aug 2023
Unsupervised Text Style Transfer with Deep Generative Models Zhongtao Jiang Yuanzhe Zhang Yiming Ju Kang Liu 80 0 0 31 Aug 2023
ScrollNet: Dynamic Weight Importance for Continual Learning Fei Yang Kai Wang Joost van de Weijer 64 5 0 31 Aug 2023
Low-bit Quantization for Deep Graph Neural Networks with Smoothness-aware Message Propagation Shuang Wang B. Eravcı Rustam Guliyev Hakan Ferhatosmanoglu GNN MQ 67 9 0 29 Aug 2023
Fast Feedforward Networks Peter Belcak Roger Wattenhofer 54 4 0 28 Aug 2023
Differentiable Weight Masks for Domain Transfer Samarth Khanna Skanda Vaidyanath Akash Velu 68 1 0 26 Aug 2023
MST-compression: Compressing and Accelerating Binary Neural Networks with Minimum Spanning Tree Quang Hieu Vo Linh-Tam Tran Sung-Ho Bae Lokwon Kim Choong Seon Hong MQ 94 1 0 26 Aug 2023
A2Q: Accumulator-Aware Quantization with Guaranteed Overflow Avoidance Ian Colbert Alessandro Pappalardo Jakoba Petri-Koenig MQ 111 9 0 25 Aug 2023
Stochastic Configuration Machines for Industrial Artificial Intelligence Dianhui Wang Matthew J. Felicetti AI4CE 64 9 0 25 Aug 2023