Bridging Discrete and Backpropagation: Straight-Through and Beyond

Bridging Discrete and Backpropagation: Straight-Through and Beyond

17 April 2023

Xiaodong Liu

Papers citing "Bridging Discrete and Backpropagation: Straight-Through and Beyond"

13 / 13 papers shown

Title
An Introduction to Discrete Variational Autoencoders Alan Jeffares Liyuan Liu DRL BDL CML 41 0 0 15 May 2025
Adaptive Layer-skipping in Pre-trained LLMs Xuan Luo Weizhi Wang Xifeng Yan 173 0 0 31 Mar 2025
Quantum-PEFT: Ultra parameter-efficient fine-tuning Toshiaki Koike-Akino F. Tonin Yongtao Wu Frank Zhengqing Wu Leyla Naz Candogan V. Cevher MQ 54 3 0 07 Mar 2025
DISP-LLM: Dimension-Independent Structural Pruning for Large Language Models Shangqian Gao Chi-Heng Lin Ting Hua Tang Zheng Yilin Shen Hongxia Jin Yen-Chang Hsu 30 3 0 15 Oct 2024
Steering Masked Discrete Diffusion Models via Discrete Denoising Posterior Prediction Jarrid Rector-Brooks Mohsin Hasan Zhangzhi Peng Zachary Quinn Chenghao Liu ... Michael Bronstein Yoshua Bengio Pranam Chatterjee Alexander Tong Avishek Joey Bose DiffM 50 6 0 10 Oct 2024
FedBAT: Communication-Efficient Federated Learning via Learnable Binarization Shiwei Li Wenchao Xu Haozhao Wang Xing Tang Tianzhe Xiao Shijie Xu Weihong Luo Yuhua Li Xiuqiang He Ruixuan Li FedML 38 2 0 06 Aug 2024
Revisiting Score Function Estimators for $k$ -Subset Sampling Klas Wijk Ricardo Vinuesa Hossein Azizpour TDI 32 1 0 22 Jul 2024
Elucidating the theoretical underpinnings of surrogate gradient learning in spiking neural networks Julia Gygax Friedemann Zenke 53 3 0 23 Apr 2024
Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone Marah Abdin Sam Ade Jacobs A. A. Awan J. Aneja Ahmed Hassan Awadallah ... Li Zhang Yi Zhang Yue Zhang Yunan Zhang Xiren Zhou LRM ALM 59 1,038 0 22 Apr 2024
VQSynery: Robust Drug Synergy Prediction With Vector Quantization Mechanism Jiawei Wu Mingyuan Yan Dianbo Liu 40 2 0 05 Mar 2024
Multi-objective Differentiable Neural Architecture Search R. Sukthanker Arber Zela B. Staffler Samuel Dooley Josif Grabocka Frank Hutter 50 1 0 28 Feb 2024
Sparse Backpropagation for MoE Training Liyuan Liu Jianfeng Gao Weizhu Chen MoE 27 9 0 01 Oct 2023
Rao-Blackwellizing the Straight-Through Gumbel-Softmax Gradient Estimator Max B. Paulus Chris J. Maddison Andreas Krause BDL 42 38 0 09 Oct 2020