Fast, Differentiable and Sparse Top-k: a Convex Analysis Perspective

2 February 2023

Papers citing "Fast, Differentiable and Sparse Top-k: a Convex Analysis Perspective"

21 / 21 papers shown

Title
Learning Cascade Ranking as One Network Yunli Wang Zhenru Zhang Ziyi Wang Zhiyong Yang Yunshui Li Jian Yang Shiyang Wen Peng Jiang Kun Gai 84 0 0 12 Mar 2025
Universal generalization guarantees for Wasserstein distributionally robust models Tam Le Jérome Malick OOD 118 3 0 28 Jan 2025
Soft Condorcet Optimization for Ranking of General Agents Marc Lanctot Kate Larson Michael Kaisers Quentin Berthet I. Gemp Manfred Diaz Roberto-Rafael Maura-Rivero Yoram Bachrach Anna Koop Doina Precup 216 0 0 31 Oct 2024
Mixture-of-Experts with Expert Choice Routing Yan-Quan Zhou Tao Lei Han-Chu Liu Nan Du Yanping Huang Vincent Zhao Andrew M. Dai Zhifeng Chen Quoc V. Le James Laudon MoE 298 358 0 18 Feb 2022
Scaling Vision with Sparse Mixture of Experts C. Riquelme J. Puigcerver Basil Mustafa Maxim Neumann Rodolphe Jenatton André Susano Pinto Daniel Keysers N. Houlsby MoE 109 601 0 10 Jun 2021
DSelect-k: Differentiable Selection in the Mixture of Experts with Applications to Multi-Task Learning Hussein Hazimeh Zhe Zhao Aakanksha Chowdhery M. Sathiamoorthy Yihua Chen Rahul Mazumder Lichan Hong Ed H. Chi MoE 151 144 0 07 Jun 2021
Implicit MLE: Backpropagating Through Discrete Exponential Family Distributions Mathias Niepert Pasquale Minervini Luca Franceschi 62 85 0 03 Jun 2021
BASE Layers: Simplifying Training of Large, Sparse Models M. Lewis Shruti Bhosale Tim Dettmers Naman Goyal Luke Zettlemoyer MoE 191 278 0 30 Mar 2021
SoftSort: A Continuous Relaxation for the argsort Operator S. Prillo Julian Martin Eisenschlos ODL 45 67 0 29 Jun 2020
What is the State of Neural Network Pruning? Davis W. Blalock Jose Javier Gonzalez Ortiz Jonathan Frankle John Guttag 267 1,052 0 06 Mar 2020
Structured Prediction with Projection Oracles Mathieu Blondel 73 33 0 24 Oct 2019
The Limited Multi-Label Projection Layer Brandon Amos V. Koltun J. Zico Kolter 64 36 0 20 Jun 2019
Differentiable Ranks and Sorting using Optimal Transport Marco Cuturi O. Teboul Jean-Philippe Vert OT 81 158 0 28 May 2019
Stochastic Optimization of Sorting Networks via Continuous Relaxations Aditya Grover Eric Wang Aaron Zweig Stefano Ermon 63 174 0 21 Mar 2019
The State of Sparsity in Deep Neural Networks Trevor Gale Erich Elsen Sara Hooker 161 758 0 25 Feb 2019
The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks Jonathan Frankle Michael Carbin 233 3,473 0 09 Mar 2018
Smooth Loss Functions for Deep Top-k Classification Leonard Berrada Andrew Zisserman M. P. Kumar 49 118 0 21 Feb 2018
Revisiting Unreasonable Effectiveness of Data in Deep Learning Era Chen Sun Abhinav Shrivastava Saurabh Singh Abhinav Gupta VLM 188 2,401 0 10 Jul 2017
Learning both Weights and Connections for Efficient Neural Networks Song Han Jeff Pool J. Tran W. Dally CVBM 313 6,681 0 08 Jun 2015
Memory Bounded Deep Convolutional Networks Maxwell D. Collins Pushmeet Kohli 106 172 0 03 Dec 2014
Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distances Marco Cuturi OT 215 4,262 0 04 Jun 2013