Reconsidering Token Embeddings with the Definitions for Pre-trained Language Models

2 August 2024

Papers citing "Reconsidering Token Embeddings with the Definitions for Pre-trained Language Models"

16 / 16 papers shown

Title
Lacking the embedding of a word? Look it up into a traditional dictionary Elena Sofia Ruzzetti Leonardo Ranaldi Michele Mastromattei Francesca Fallucchi Fabio Massimo Zanzotto 51 15 0 24 Sep 2021
BillSum: A Corpus for Automatic Summarization of US Legislation Anastassia Kornilova Vladimir Eidelman AILaw 60 156 0 01 Oct 2019
Language Models as Knowledge Bases? Fabio Petroni Tim Rocktaschel Patrick Lewis A. Bakhtin Yuxiang Wu Alexander H. Miller Sebastian Riedel KELM AI4MH 576 2,673 0 03 Sep 2019
BIGPATENT: A Large-Scale Dataset for Abstractive and Coherent Summarization Eva Sharma Chen Li Lu Wang AILaw 75 223 0 10 Jun 2019
Rare Words: A Major Problem for Contextualized Embeddings And How to Fix it by Attentive Mimicking Timo Schick Hinrich Schütze 59 97 0 14 Apr 2019
Attentive Mimicking: Better Word Embeddings by Attending to Informative Contexts Timo Schick Hinrich Schütze 63 49 0 02 Apr 2019
fairseq: A Fast, Extensible Toolkit for Sequence Modeling Myle Ott Sergey Edunov Alexei Baevski Angela Fan Sam Gross Nathan Ng David Grangier Michael Auli VLM FaML 111 3,156 0 01 Apr 2019
FRAGE: Frequency-Agnostic Word Representation Chengyue Gong Di He Xu Tan Tao Qin Liwei Wang Tie-Yan Liu OOD 64 144 0 18 Sep 2018
Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarization Shashi Narayan Shay B. Cohen Mirella Lapata AILaw 146 1,682 0 27 Aug 2018
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 1.1K 7,182 0 20 Apr 2018
Learning to Compute Word Embeddings On the Fly Dzmitry Bahdanau Tom Bosc Stanislaw Jastrzebski Edward Grefenstette Pascal Vincent Yoshua Bengio 77 83 0 01 Jun 2017
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation Yonghui Wu M. Schuster Zhiwen Chen Quoc V. Le Mohammad Norouzi ... Alex Rudnick Oriol Vinyals G. Corrado Macduff Hughes J. Dean AIMat 905 6,796 0 26 Sep 2016
Using the Output Embedding to Improve Language Models Ofir Press Lior Wolf 79 736 0 20 Aug 2016
Neural Machine Translation of Rare Words with Subword Units Rico Sennrich Barry Haddow Alexandra Birch 224 7,755 0 31 Aug 2015
Teaching Machines to Read and Comprehend Karl Moritz Hermann Tomás Kociský Edward Grefenstette L. Espeholt W. Kay Mustafa Suleyman Phil Blunsom 347 3,551 0 10 Jun 2015
SimLex-999: Evaluating Semantic Models with (Genuine) Similarity Estimation Felix Hill Roi Reichart Anna Korhonen 101 1,303 0 15 Aug 2014