On Controllable Sparse Alternatives to Softmax

v1v2 (latest)

On Controllable Sparse Alternatives to Softmax

29 October 2018

Saneem A. Chemmengath

Priyanka Agrawal

Mitesh M. Khapra

Karthik Sankaranarayanan

H. G. Ramaswamy

ArXiv (abs)PDF HTML

Papers citing "On Controllable Sparse Alternatives to Softmax"

12 / 12 papers shown

Title
A Regularized Framework for Sparse and Structured Neural Attention Vlad Niculae Mathieu Blondel 84 100 0 22 May 2017
Diversity driven Attention Model for Query-based Abstractive Summarization Preksha Nema Mitesh Khapra Anirban Laha Balaraman Ravindran 79 169 0 26 Apr 2017
On the Properties of the Softmax Function with Application in Game Theory and Reinforcement Learning Bolin Gao Lacra Pavel FAtt 72 308 0 03 Apr 2017
OpenNMT: Open-Source Toolkit for Neural Machine Translation Guillaume Klein Yoon Kim Yuntian Deng Jean Senellart Alexander M. Rush 330 1,900 0 10 Jan 2017
From Softmax to Sparsemax: A Sparse Model of Attention and Multi-Label Classification André F. T. Martins Ramón Fernández Astudillo 184 726 0 05 Feb 2016
An Exploration of Softmax Alternatives Belonging to the Spherical Loss Family A. D. Brébisson Pascal Vincent 61 98 0 16 Nov 2015
A Neural Attention Model for Abstractive Sentence Summarization Alexander M. Rush S. Chopra Jason Weston CVBM 186 2,702 0 02 Sep 2015
Describing Multimedia Content using Attention-based Encoder--Decoder Networks Kyunghyun Cho Aaron Courville Yoshua Bengio 80 411 0 04 Jul 2015
Show, Attend and Tell: Neural Image Caption Generation with Visual Attention Ke Xu Jimmy Ba Ryan Kiros Kyunghyun Cho Aaron Courville Ruslan Salakhutdinov R. Zemel Yoshua Bengio DiffM 350 10,079 0 10 Feb 2015
Efficient Exact Gradient Update for training Deep Networks with Very Large Sparse Targets Pascal Vincent A. D. Brébisson Xavier Bouthillier 75 49 0 22 Dec 2014
Neural Machine Translation by Jointly Learning to Align and Translate Dzmitry Bahdanau Kyunghyun Cho Yoshua Bengio AIMat 578 27,327 0 01 Sep 2014
Optimization with Sparsity-Inducing Penalties Francis R. Bach Rodolphe Jenatton Julien Mairal G. Obozinski 223 1,058 0 03 Aug 2011