ResearchTrend.AI
  • Papers
  • Communities
  • Organizations
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 1802.05365
  4. Cited By
Deep contextualized word representations
v1v2 (latest)

Deep contextualized word representations

15 February 2018
Matthew E. Peters
Mark Neumann
Mohit Iyyer
Matt Gardner
Christopher Clark
Kenton Lee
Luke Zettlemoyer
    NAI
ArXiv (abs)PDFHTML

Papers citing "Deep contextualized word representations"

50 / 4,508 papers shown
Title
Plug and Play Autoencoders for Conditional Text Generation
Plug and Play Autoencoders for Conditional Text Generation
Florian Mai
Nikolaos Pappas
Ivan Montero
Noah A. Smith
U. Washington
109
37
0
06 Oct 2020
Using Sentences as Semantic Representations in Large Scale Zero-Shot
  Learning
Using Sentences as Semantic Representations in Large Scale Zero-Shot Learning
Yannick Le Cacheux
Hervé Le Borgne
M. Crucianu
VLM
53
6
0
06 Oct 2020
Robustness and Reliability of Gender Bias Assessment in Word Embeddings:
  The Role of Base Pairs
Robustness and Reliability of Gender Bias Assessment in Word Embeddings: The Role of Base Pairs
Haiyang Zhang
Alison Sneyd
Mark Stevenson
46
15
0
06 Oct 2020
Intrinsic Probing through Dimension Selection
Intrinsic Probing through Dimension Selection
Lucas Torroba Hennigen
Adina Williams
Ryan Cotterell
78
58
0
06 Oct 2020
Neural Mask Generator: Learning to Generate Adaptive Word Maskings for
  Language Model Adaptation
Neural Mask Generator: Learning to Generate Adaptive Word Maskings for Language Model Adaptation
Minki Kang
Moonsu Han
Sung Ju Hwang
OOD
83
18
0
06 Oct 2020
Analyzing Individual Neurons in Pre-trained Language Models
Analyzing Individual Neurons in Pre-trained Language Models
Nadir Durrani
Hassan Sajjad
Fahim Dalvi
Yonatan Belinkov
MILM
104
105
0
06 Oct 2020
On the Interplay Between Fine-tuning and Sentence-level Probing for
  Linguistic Knowledge in Pre-trained Transformers
On the Interplay Between Fine-tuning and Sentence-level Probing for Linguistic Knowledge in Pre-trained Transformers
Marius Mosbach
A. Khokhlova
Michael A. Hedderich
Dietrich Klakow
61
46
0
06 Oct 2020
Do Explicit Alignments Robustly Improve Multilingual Encoders?
Do Explicit Alignments Robustly Improve Multilingual Encoders?
Shijie Wu
Mark Dredze
62
7
0
06 Oct 2020
An Empirical Study of Tokenization Strategies for Various Korean NLP
  Tasks
An Empirical Study of Tokenization Strategies for Various Korean NLP Tasks
Kyubyong Park
Joohong Lee
Seongbo Jang
Dawoon Jung
71
65
0
06 Oct 2020
Pretrained Language Model Embryology: The Birth of ALBERT
Pretrained Language Model Embryology: The Birth of ALBERT
Cheng-Han Chiang
Sung-Feng Huang
Hung-yi Lee
83
42
0
06 Oct 2020
On the Branching Bias of Syntax Extracted from Pre-trained Language
  Models
On the Branching Bias of Syntax Extracted from Pre-trained Language Models
Huayang Li
Lemao Liu
Guoping Huang
Shuming Shi
55
6
0
06 Oct 2020
UnQovering Stereotyping Biases via Underspecified Questions
UnQovering Stereotyping Biases via Underspecified Questions
Tao Li
Tushar Khot
Daniel Khashabi
Ashish Sabharwal
Vivek Srikumar
100
138
0
06 Oct 2020
On the Role of Supervision in Unsupervised Constituency Parsing
On the Role of Supervision in Unsupervised Constituency Parsing
Freda Shi
Karen Livescu
Kevin Gimpel
SSL
72
22
0
06 Oct 2020
Interactive Fiction Game Playing as Multi-Paragraph Reading
  Comprehension with Reinforcement Learning
Interactive Fiction Game Playing as Multi-Paragraph Reading Comprehension with Reinforcement Learning
Xiaoxiao Guo
Mo Yu
Yupeng Gao
Chuang Gan
Murray Campbell
Shiyu Chang
66
31
0
05 Oct 2020
SeqMix: Augmenting Active Sequence Labeling via Sequence Mixup
SeqMix: Augmenting Active Sequence Labeling via Sequence Mixup
Rongzhi Zhang
Yue Yu
Chao Zhang
VLM
94
95
0
05 Oct 2020
The Grammar of Emergent Languages
The Grammar of Emergent Languages
Oskar van der Wal
S. D. Boer
Elia Bruni
Dieuwke Hupkes
89
17
0
05 Oct 2020
A Fully Hyperbolic Neural Model for Hierarchical Multi-Class
  Classification
A Fully Hyperbolic Neural Model for Hierarchical Multi-Class Classification
F. López
Michael Strube
84
32
0
05 Oct 2020
Linguistic Profiling of a Neural Language Model
Linguistic Profiling of a Neural Language Model
Alessio Miaschi
D. Brunato
F. Dell’Orletta
Giulia Venturi
101
49
0
05 Oct 2020
Unsupervised Reference-Free Summary Quality Evaluation via Contrastive
  Learning
Unsupervised Reference-Free Summary Quality Evaluation via Contrastive Learning
Hanlu Wu
Tengfei Ma
Lingfei Wu
Tariro Manyumwa
S. Ji
SSL
80
57
0
05 Oct 2020
Improving AMR Parsing with Sequence-to-Sequence Pre-training
Improving AMR Parsing with Sequence-to-Sequence Pre-training
Dong Xu
Junhui Li
Muhua Zhu
Min Zhang
Guodong Zhou
AIMat
66
69
0
05 Oct 2020
Effective Unsupervised Domain Adaptation with Adversarially Trained
  Language Models
Effective Unsupervised Domain Adaptation with Adversarially Trained Language Models
Thuy-Trang Vu
Dinh Q. Phung
Gholamreza Haffari
99
25
0
05 Oct 2020
Local Additivity Based Data Augmentation for Semi-supervised NER
Local Additivity Based Data Augmentation for Semi-supervised NER
Jiaao Chen
Zhenghui Wang
Ran Tian
Zichao Yang
Diyi Yang
97
58
0
04 Oct 2020
Transformers for Modeling Physical Systems
Transformers for Modeling Physical Systems
N. Geneva
N. Zabaras
AI4CE
130
146
0
04 Oct 2020
An Empirical Study on Large-Scale Multi-Label Text Classification
  Including Few and Zero-Shot Labels
An Empirical Study on Large-Scale Multi-Label Text Classification Including Few and Zero-Shot Labels
Ilias Chalkidis
Manos Fergadiotis
Sotiris Kotitsas
Prodromos Malakasiotis
Nikolaos Aletras
Ion Androutsopoulos
VLMAI4TS
68
86
0
04 Oct 2020
A Survey of Unsupervised Dependency Parsing
A Survey of Unsupervised Dependency Parsing
Wenjuan Han
Yong Jiang
Hwee Tou Ng
Kewei Tu
SSL
49
10
0
04 Oct 2020
A Geometry-Inspired Attack for Generating Natural Language Adversarial
  Examples
A Geometry-Inspired Attack for Generating Natural Language Adversarial Examples
Zhao Meng
Roger Wattenhofer
GANAAML
74
32
0
03 Oct 2020
Mining Knowledge for Natural Language Inference from Wikipedia
  Categories
Mining Knowledge for Natural Language Inference from Wikipedia Categories
Mingda Chen
Zewei Chu
K. Stratos
Kevin Gimpel
62
8
0
03 Oct 2020
Unsupervised Point Cloud Pre-Training via Occlusion Completion
Unsupervised Point Cloud Pre-Training via Occlusion Completion
Hanchen Wang
Qi Liu
Xiangyu Yue
Joan Lasenby
Matt J. Kusner
3DPC
147
256
0
02 Oct 2020
Syntax Representation in Word Embeddings and Neural Networks -- A Survey
Syntax Representation in Word Embeddings and Neural Networks -- A Survey
Tomasz Limisiewicz
David Marecek
NAI
84
9
0
02 Oct 2020
LUKE: Deep Contextualized Entity Representations with Entity-aware
  Self-attention
LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attention
Ikuya Yamada
Akari Asai
Hiroyuki Shindo
Hideaki Takeda
Yuji Matsumoto
147
679
0
02 Oct 2020
Exploiting Unsupervised Data for Emotion Recognition in Conversations
Exploiting Unsupervised Data for Emotion Recognition in Conversations
Wenxiang Jiao
Michael R. Lyu
Irwin King
93
13
0
02 Oct 2020
Continual Learning for Natural Language Generation in Task-oriented
  Dialog Systems
Continual Learning for Natural Language Generation in Task-oriented Dialog Systems
Fei Mi
Liangwei Chen
Mengjie Zhao
Minlie Huang
Boi Faltings
CLLKELM
65
71
0
02 Oct 2020
Which *BERT? A Survey Organizing Contextualized Encoders
Which *BERT? A Survey Organizing Contextualized Encoders
Patrick Xia
Shijie Wu
Benjamin Van Durme
70
50
0
02 Oct 2020
JAKET: Joint Pre-training of Knowledge Graph and Language Understanding
JAKET: Joint Pre-training of Knowledge Graph and Language Understanding
Donghan Yu
Chenguang Zhu
Yiming Yang
Michael Zeng
KELM
98
145
0
02 Oct 2020
XDA: Accurate, Robust Disassembly with Transfer Learning
XDA: Accurate, Robust Disassembly with Transfer Learning
Kexin Pei
Jonas Guan
David Williams-King
Junfeng Yang
Suman Jana
115
63
0
02 Oct 2020
Enriching Word Embeddings with Temporal and Spatial Information
Enriching Word Embeddings with Temporal and Spatial Information
Hongyu Gong
S. Bhat
Pramod Viswanath
104
12
0
02 Oct 2020
ISAAQ -- Mastering Textbook Questions with Pre-trained Transformers and
  Bottom-Up and Top-Down Attention
ISAAQ -- Mastering Textbook Questions with Pre-trained Transformers and Bottom-Up and Top-Down Attention
José Manuél Gómez-Pérez
Raúl Ortega
63
24
0
01 Oct 2020
Evaluating Multilingual BERT for Estonian
Evaluating Multilingual BERT for Estonian
Claudia Kittask
Kirill Milintsevich
Kairit Sirts
48
8
0
01 Oct 2020
A Survey on Explainability in Machine Reading Comprehension
A Survey on Explainability in Machine Reading Comprehension
Mokanarangan Thayaparan
Marco Valentino
André Freitas
FaML
116
49
0
01 Oct 2020
CoLAKE: Contextualized Language and Knowledge Embedding
CoLAKE: Contextualized Language and Knowledge Embedding
Tianxiang Sun
Yunfan Shao
Xipeng Qiu
Qipeng Guo
Yaru Hu
Xuanjing Huang
Zheng Zhang
KELM
123
185
0
01 Oct 2020
CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked
  Language Models
CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Models
Nikita Nangia
Clara Vania
Rasika Bhalerao
Samuel R. Bowman
179
691
0
30 Sep 2020
Pea-KD: Parameter-efficient and Accurate Knowledge Distillation on BERT
Pea-KD: Parameter-efficient and Accurate Knowledge Distillation on BERT
Ikhyun Cho
U. Kang
25
1
0
30 Sep 2020
OWL2Vec*: Embedding of OWL Ontologies
OWL2Vec*: Embedding of OWL Ontologies
Jiaoyan Chen
Pan Hu
Ernesto Jiménez-Ruiz
Ole Magnus Holter
Denvar Antonyrajah
Ian Horrocks
3DV
87
141
0
30 Sep 2020
Multiple Word Embeddings for Increased Diversity of Representation
Multiple Word Embeddings for Increased Diversity of Representation
Brian Lester
Daniel Pressel
Amy Hemmeter
Sagnik Ray Choudhury
S. Bangalore
60
7
0
30 Sep 2020
Development of Word Embeddings for Uzbek Language
Development of Word Embeddings for Uzbek Language
B. Mansurov
A. Mansurov
34
4
0
30 Sep 2020
MaP: A Matrix-based Prediction Approach to Improve Span Extraction in
  Machine Reading Comprehension
MaP: A Matrix-based Prediction Approach to Improve Span Extraction in Machine Reading Comprehension
Huaishao Luo
Yu Shi
Ming Gong
Linjun Shou
Tianrui Li
32
4
0
29 Sep 2020
NatCat: Weakly Supervised Text Classification with Naturally Annotated
  Resources
NatCat: Weakly Supervised Text Classification with Naturally Annotated Resources
Zewei Chu
K. Stratos
Kevin Gimpel
46
5
0
29 Sep 2020
Cross-lingual Alignment Methods for Multilingual BERT: A Comparative
  Study
Cross-lingual Alignment Methods for Multilingual BERT: A Comparative Study
Saurabh Kulshreshtha
José Luis Redondo García
Ching-Yun Chang
74
48
0
29 Sep 2020
Parsing with Multilingual BERT, a Small Corpus, and a Small Treebank
Parsing with Multilingual BERT, a Small Corpus, and a Small Treebank
Ethan C. Chau
Lucy H. Lin
Noah A. Smith
104
15
0
29 Sep 2020
CokeBERT: Contextual Knowledge Selection and Embedding towards Enhanced
  Pre-Trained Language Models
CokeBERT: Contextual Knowledge Selection and Embedding towards Enhanced Pre-Trained Language Models
Yusheng Su
Xu Han
Zhengyan Zhang
Peng Li
Zhiyuan Liu
Yankai Lin
Jie Zhou
Maosong Sun
ODL
103
25
0
29 Sep 2020
Previous
123...484950...899091
Next