Improved Biomedical Word Embeddings in the Transformer Era

22 December 2020

Papers citing "Improved Biomedical Word Embeddings in the Transformer Era"

15 / 15 papers shown

Title
A Primer in BERTology: What we know about how BERT works Anna Rogers Olga Kovaleva Anna Rumshisky OffRL 54 1,478 0 27 Feb 2020
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter Victor Sanh Lysandre Debut Julien Chaumond Thomas Wolf 117 7,386 0 02 Oct 2019
MultiFiT: Efficient Multi-lingual Language Model Fine-tuning Julian Martin Eisenschlos Sebastian Ruder Piotr Czapla Marcin Kardas Sylvain Gugger Jeremy Howard 39 99 0 10 Sep 2019
RoBERTa: A Robustly Optimized BERT Pretraining Approach Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy M. Lewis Luke Zettlemoyer Veselin Stoyanov AIMat 385 24,160 0 26 Jul 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 870 93,936 0 11 Oct 2018
Medical Concept Embedding with Time-Aware Attention Xiangrui Cai Jinyang Gao K. Ngiam Beng Chin Ooi Ying Zhang Xiaojie Yuan 48 64 0 06 Jun 2018
Deep contextualized word representations Matthew E. Peters Mark Neumann Mohit Iyyer Matt Gardner Christopher Clark Kenton Lee Luke Zettlemoyer NAI 95 11,520 0 15 Feb 2018
Retrofitting Concept Vector Representations of Medical Concepts to Improve Estimates of Semantic Similarity and Relatedness Zhiguo Yu Byron C. Wallace T. Johnson T. Cohen 29 23 0 21 Sep 2017
Using millions of emoji occurrences to learn any-domain representations for detecting sentiment, emotion and sarcasm Bjarke Felbo A. Mislove Anders Søgaard Iyad Rahwan Sune Lehmann 61 741 0 01 Aug 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 401 129,831 0 12 Jun 2017
Knowledge-Based Biomedical Word Sense Disambiguation with Neural Concept Embeddings A. Sabbir Antonio Jimeno Yepes Ramakanth Kavuluru 28 35 0 26 Oct 2016
Enriching Word Vectors with Subword Information Piotr Bojanowski Edouard Grave Armand Joulin Tomas Mikolov NAI SSL VLM 185 9,924 0 15 Jul 2016
Multi-layer Representation Learning for Medical Concepts Edward Choi M. T. Bahadori Elizabeth Searles Catherine Coffey Jimeng Sun SSL AI4TS 31 505 0 17 Feb 2016
Cyclical Learning Rates for Training Neural Networks L. Smith ODL 108 2,515 0 03 Jun 2015
Efficient Estimation of Word Representations in Vector Space Tomas Mikolov Kai Chen G. Corrado J. Dean 3DV 526 31,406 0 16 Jan 2013