Efficient Contextual Representation Learning Without Softmax Layer

28 February 2019

Papers citing "Efficient Contextual Representation Learning Without Softmax Layer"

20 / 20 papers shown

Title
Dissecting Contextual Word Embeddings: Architecture and Representation Matthew E. Peters Mark Neumann Luke Zettlemoyer Wen-tau Yih 92 429 0 27 Aug 2018
Evaluation of sentence embeddings in downstream and linguistic probing tasks C. Perone Roberto Silveira Thomas S. Paula ELM 65 155 0 16 Jun 2018
Higher-order Coreference Resolution with Coarse-to-fine Inference Kenton Lee Luheng He Luke Zettlemoyer BDL 73 469 0 15 Apr 2018
An Analysis of Neural Language Modeling at Multiple Scales Stephen Merity N. Keskar R. Socher 50 170 0 22 Mar 2018
Building a Web-Scale Dependency-Parsed Corpus from CommonCrawl Alexander Panchenko Eugen Ruppert Stefano Faralli Simone Paolo Ponzetto Chris Biemann 48 46 0 04 Oct 2017
Learned in Translation: Contextualized Word Vectors Bryan McCann James Bradbury Caiming Xiong R. Socher 115 907 0 01 Aug 2017
End-to-end Neural Coreference Resolution Kenton Lee Luheng He M. Lewis Luke Zettlemoyer LRM BDL 79 892 0 21 Jul 2017
Language Modeling with Gated Convolutional Networks Yann N. Dauphin Angela Fan Michael Auli David Grangier 212 2,391 0 23 Dec 2016
Tying Word Vectors and Word Classifiers: A Loss Framework for Language Modeling Hakan Inan Khashayar Khosravi R. Socher 108 384 0 04 Nov 2016
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation Yonghui Wu M. Schuster Zhiwen Chen Quoc V. Le Mohammad Norouzi ... Alex Rudnick Oriol Vinyals G. Corrado Macduff Hughes J. Dean AIMat 869 6,781 0 26 Sep 2016
Using the Output Embedding to Improve Language Models Ofir Press Lior Wolf 67 733 0 20 Aug 2016
Layer Normalization Jimmy Lei Ba J. Kiros Geoffrey E. Hinton 338 10,467 0 21 Jul 2016
Enriching Word Vectors with Subword Information Piotr Bojanowski Edouard Grave Armand Joulin Tomas Mikolov NAI SSL VLM 209 9,957 0 15 Jul 2016
SQuAD: 100,000+ Questions for Machine Comprehension of Text Pranav Rajpurkar Jian Zhang Konstantin Lopyrev Percy Liang RALM 231 8,113 0 16 Jun 2016
Neural Machine Translation of Rare Words with Subword Units Rico Sennrich Barry Haddow Alexandra Birch 195 7,729 0 31 Aug 2015
Character-Aware Neural Language Models Yoon Kim Yacine Jernite David Sontag Alexander M. Rush 91 1,668 0 26 Aug 2015
Long Short-Term Memory Based Recurrent Neural Network Architectures for Large Vocabulary Speech Recognition Hasim Sak A. Senior F. Beaufays 81 1,050 0 05 Feb 2014
One Billion Word Benchmark for Measuring Progress in Statistical Language Modeling Ciprian Chelba Tomas Mikolov M. Schuster Qi Ge T. Brants P. Koehn T. Robinson 153 1,103 0 11 Dec 2013
A Fast and Simple Algorithm for Training Neural Probabilistic Language Models A. Mnih Yee Whye Teh 145 578 0 27 Jun 2012
Natural Language Processing (almost) from Scratch R. Collobert Jason Weston Léon Bottou Michael Karlen Koray Kavukcuoglu Pavel P. Kuksa 159 7,721 0 02 Mar 2011