ResearchTrend.AI
  • Papers
  • Communities
  • Organizations
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 1802.05365
  4. Cited By
Deep contextualized word representations
v1v2 (latest)

Deep contextualized word representations

15 February 2018
Matthew E. Peters
Mark Neumann
Mohit Iyyer
Matt Gardner
Christopher Clark
Kenton Lee
Luke Zettlemoyer
    NAI
ArXiv (abs)PDFHTML

Papers citing "Deep contextualized word representations"

50 / 4,508 papers shown
Title
Graph-based Topic Extraction from Vector Embeddings of Text Documents:
  Application to a Corpus of News Articles
Graph-based Topic Extraction from Vector Embeddings of Text Documents: Application to a Corpus of News Articles
M. Altuncu
S. Yaliraki
Mauricio Barahona
20
9
0
28 Oct 2020
Image Representations Learned With Unsupervised Pre-Training Contain
  Human-like Biases
Image Representations Learned With Unsupervised Pre-Training Contain Human-like Biases
Ryan Steed
Aylin Caliskan
SSL
120
162
0
28 Oct 2020
A Comprehensive Survey on Word Representation Models: From Classical to
  State-Of-The-Art Word Representation Language Models
A Comprehensive Survey on Word Representation Models: From Classical to State-Of-The-Art Word Representation Language Models
Usman Naseem
Imran Razzak
S. Khan
M. Prasad
86
161
0
28 Oct 2020
Learning Contextualised Cross-lingual Word Embeddings and Alignments for
  Extremely Low-Resource Languages Using Parallel Corpora
Learning Contextualised Cross-lingual Word Embeddings and Alignments for Extremely Low-Resource Languages Using Parallel Corpora
Takashi Wada
Tomoharu Iwata
Yuji Matsumoto
Timothy Baldwin
Jey Han Lau
142
7
0
27 Oct 2020
WNUT-2020 Task 1 Overview: Extracting Entities and Relations from Wet
  Lab Protocols
WNUT-2020 Task 1 Overview: Extracting Entities and Relations from Wet Lab Protocols
Jeniya Tabassum
Sydney Lee
Wei Xu
Alan Ritter
108
18
0
27 Oct 2020
Strongly Incremental Constituency Parsing with Graph Neural Networks
Strongly Incremental Constituency Parsing with Graph Neural Networks
Kaiyu Yang
Jia Deng
83
35
0
27 Oct 2020
Unmasking Contextual Stereotypes: Measuring and Mitigating BERT's Gender
  Bias
Unmasking Contextual Stereotypes: Measuring and Mitigating BERT's Gender Bias
Marion Bartl
Malvina Nissim
Albert Gatt
99
125
0
27 Oct 2020
Dynamic Boundary Time Warping for Sub-sequence Matching with Few
  Examples
Dynamic Boundary Time Warping for Sub-sequence Matching with Few Examples
Łukasz Borchmann
Dawid Jurkiewicz
Filip Graliñski
Tomasz Górecki
66
0
0
27 Oct 2020
Discovering and Interpreting Biased Concepts in Online Communities
Discovering and Interpreting Biased Concepts in Online Communities
Xavier Ferrer-Aran
Tom van Nuenen
Natalia Criado
Jose Such
57
2
0
27 Oct 2020
Effective FAQ Retrieval and Question Matching With Unsupervised
  Knowledge Injection
Effective FAQ Retrieval and Question Matching With Unsupervised Knowledge Injection
Wen-Ting Tseng
Tien-Hong Lo
Yung-Chang Hsu
Berlin Chen
RALM
28
2
0
27 Oct 2020
To BERT or Not to BERT: Comparing Task-specific and Task-agnostic
  Semi-Supervised Approaches for Sequence Tagging
To BERT or Not to BERT: Comparing Task-specific and Task-agnostic Semi-Supervised Approaches for Sequence Tagging
Kasturi Bhattacharjee
Miguel Ballesteros
Rishita Anubhai
Smaranda Muresan
Jie Ma
Faisal Ladhak
Yaser Al-Onaizan
SSL
99
20
0
27 Oct 2020
Fine-grained Information Status Classification Using Discourse
  Context-Aware BERT
Fine-grained Information Status Classification Using Discourse Context-Aware BERT
Yufang Hou
55
6
0
26 Oct 2020
A Survey of Embedding Space Alignment Methods for Language and Knowledge
  Graphs
A Survey of Embedding Space Alignment Methods for Language and Knowledge Graphs
Alexander Kalinowski
Yuan An
AI4TS
63
5
0
26 Oct 2020
Multimodal Topic Learning for Video Recommendation
Multimodal Topic Learning for Video Recommendation
Shi Pu
Yijiang He
Zheng Li
Mao Zheng
62
8
0
26 Oct 2020
Autoencoding Improves Pre-trained Word Embeddings
Autoencoding Improves Pre-trained Word Embeddings
Masahiro Kaneko
Danushka Bollegala
LLMSV
88
14
0
25 Oct 2020
Commonsense knowledge adversarial dataset that challenges ELECTRA
Commonsense knowledge adversarial dataset that challenges ELECTRA
Gongqi Lin
Yuan Miao
Xiaoyong Yang
Wenwu Ou
Li-zhen Cui
Wenting Guo
Chunyan Miao
AAML
38
3
0
25 Oct 2020
Fine-tuning ERNIE for chest abnormal imaging signs extraction
Fine-tuning ERNIE for chest abnormal imaging signs extraction
Zhaoning Li
Jiangtao Ren
MedIm
49
8
0
25 Oct 2020
Probing Acoustic Representations for Phonetic Properties
Probing Acoustic Representations for Phonetic Properties
Danni Ma
Neville Ryant
M. Liberman
112
45
0
25 Oct 2020
Large Scale Legal Text Classification Using Transformer Models
Large Scale Legal Text Classification Using Transformer Models
Zein Shaheen
G. Wohlgenannt
Erwin Filtz
AILaw
85
72
0
24 Oct 2020
When Being Unseen from mBERT is just the Beginning: Handling New
  Languages With Multilingual Language Models
When Being Unseen from mBERT is just the Beginning: Handling New Languages With Multilingual Language Models
Benjamin Muller
Antonis Anastasopoulos
Benoît Sagot
Djamé Seddah
LRM
246
170
0
24 Oct 2020
ReadOnce Transformers: Reusable Representations of Text for Transformers
ReadOnce Transformers: Reusable Representations of Text for Transformers
Shih-Ting Lin
Ashish Sabharwal
Tushar Khot
117
3
0
24 Oct 2020
Unsupervised Vision-and-Language Pre-training Without Parallel Images
  and Captions
Unsupervised Vision-and-Language Pre-training Without Parallel Images and Captions
Liunian Harold Li
Haoxuan You
Zhecan Wang
Alireza Zareian
Shih-Fu Chang
Kai-Wei Chang
SSLVLM
108
12
0
24 Oct 2020
Pre-training Text-to-Text Transformers for Concept-centric Common Sense
Pre-training Text-to-Text Transformers for Concept-centric Common Sense
Wangchunshu Zhou
Dong-Ho Lee
Ravi Kiran Selvam
Seyeon Lee
Bill Yuchen Lin
Xiang Ren
LRMVLM
57
72
0
24 Oct 2020
Deep Clustering of Text Representations for Supervision-free Probing of
  Syntax
Deep Clustering of Text Representations for Supervision-free Probing of Syntax
Vikram Gupta
Haoyue Shi
Kevin Gimpel
Mrinmaya Sachan
94
9
0
24 Oct 2020
Structure-Grounded Pretraining for Text-to-SQL
Structure-Grounded Pretraining for Text-to-SQL
Xiang Deng
Ahmed Hassan Awadallah
Christopher Meek
Oleksandr Polozov
Huan Sun
Matthew Richardson
LMTD
171
159
0
24 Oct 2020
Char2Subword: Extending the Subword Embedding Space Using Robust
  Character Compositionality
Char2Subword: Extending the Subword Embedding Space Using Robust Character Compositionality
Gustavo Aguilar
Bryan McCann
Tong Niu
Nazneen Rajani
N. Keskar
Thamar Solorio
122
13
0
24 Oct 2020
Applying Occam's Razor to Transformer-Based Dependency Parsing: What
  Works, What Doesn't, and What is Really Necessary
Applying Occam's Razor to Transformer-Based Dependency Parsing: What Works, What Doesn't, and What is Really Necessary
Stefan Grünewald
Annemarie Friedrich
Jonas Kuhn
116
11
0
23 Oct 2020
Dynamic Contextualized Word Embeddings
Dynamic Contextualized Word Embeddings
Valentin Hofmann
J. Pierrehumbert
Hinrich Schütze
121
52
0
23 Oct 2020
On the Transformer Growth for Progressive BERT Training
On the Transformer Growth for Progressive BERT Training
Xiaotao Gu
Liyuan Liu
Hongkun Yu
Jing Li
Chong Chen
Jiawei Han
VLM
137
54
0
23 Oct 2020
GiBERT: Introducing Linguistic Knowledge into BERT through a Lightweight
  Gated Injection Method
GiBERT: Introducing Linguistic Knowledge into BERT through a Lightweight Gated Injection Method
Nicole Peinelt
Marek Rei
Maria Liakata
77
2
0
23 Oct 2020
Event-Driven Learning of Systematic Behaviours in Stock Markets
Event-Driven Learning of Systematic Behaviours in Stock Markets
Xianchao Wu
AIFin
49
7
0
23 Oct 2020
Unsupervised Cross-lingual Adaptation for Sequence Tagging and Beyond
Unsupervised Cross-lingual Adaptation for Sequence Tagging and Beyond
Xin Li
Lidong Bing
Wenxuan Zhang
Zheng Li
Wai Lam
129
25
0
23 Oct 2020
BARThez: a Skilled Pretrained French Sequence-to-Sequence Model
BARThez: a Skilled Pretrained French Sequence-to-Sequence Model
Moussa Kamal Eddine
A. Tixier
Michalis Vazirgiannis
BDL
144
65
0
23 Oct 2020
A Survey on Recent Approaches for Natural Language Processing in
  Low-Resource Scenarios
A Survey on Recent Approaches for Natural Language Processing in Low-Resource Scenarios
Michael A. Hedderich
Lukas Lange
Heike Adel
Jannik Strötgen
Dietrich Klakow
391
301
0
23 Oct 2020
FAME: Feature-Based Adversarial Meta-Embeddings for Robust Input
  Representations
FAME: Feature-Based Adversarial Meta-Embeddings for Robust Input Representations
Lukas Lange
Heike Adel
Jannik Strötgen
Dietrich Klakow
63
7
0
23 Oct 2020
Domain Divergences: a Survey and Empirical Analysis
Domain Divergences: a Survey and Empirical Analysis
Abhinav Ramesh Kashyap
Devamanyu Hazarika
Min-Yen Kan
Roger Zimmermann
277
40
0
23 Oct 2020
Generating Long Financial Report using Conditional Variational
  Autoencoders with Knowledge Distillation
Generating Long Financial Report using Conditional Variational Autoencoders with Knowledge Distillation
Yunpeng Ren
Ziao Wang
Yiyuan Wang
Xiaofeng Zhang
60
9
0
23 Oct 2020
Learning Similarity between Movie Characters and Its Potential
  Implications on Understanding Human Experiences
Learning Similarity between Movie Characters and Its Potential Implications on Understanding Human Experiences
Zhilin Wang
Weizhe Lin
Xiaodong Wu
60
1
0
23 Oct 2020
Summarizing Utterances from Japanese Assembly Minutes using Political
  Sentence-BERT-based Method for QA Lab-PoliInfo-2 Task of NTCIR-15
Summarizing Utterances from Japanese Assembly Minutes using Political Sentence-BERT-based Method for QA Lab-PoliInfo-2 Task of NTCIR-15
Daiki Shirafuji
Hiromichi Kameya
Rafal Rzepka
K. Araki
67
4
0
22 Oct 2020
Text Mining to Identify and Extract Novel Disease Treatments From
  Unstructured Datasets
Text Mining to Identify and Extract Novel Disease Treatments From Unstructured Datasets
Rahul Yedida
S. Abrar
C. Melo-Filho
E. Muratov
Rada Y. Chirkova
A. Tropsha
18
1
0
22 Oct 2020
A Joint Learning Approach based on Self-Distillation for Keyphrase
  Extraction from Scientific Documents
A Joint Learning Approach based on Self-Distillation for Keyphrase Extraction from Scientific Documents
T. Lai
Trung Bui
Doo Soon Kim
Quan Hung Tran
58
11
0
22 Oct 2020
Language Models are Open Knowledge Graphs
Language Models are Open Knowledge Graphs
Chenguang Wang
Xiao Liu
Basel Alomair
SSLKELM
86
137
0
22 Oct 2020
AdapterDrop: On the Efficiency of Adapters in Transformers
AdapterDrop: On the Efficiency of Adapters in Transformers
Andreas Rucklé
Gregor Geigle
Max Glockner
Tilman Beck
Jonas Pfeiffer
Nils Reimers
Iryna Gurevych
154
268
0
22 Oct 2020
Not all parameters are born equal: Attention is mostly what you need
Not all parameters are born equal: Attention is mostly what you need
Nikolay Bogoychev
MoE
59
7
0
22 Oct 2020
Detecting and Exorcising Statistical Demons from Language Models with
  Anti-Models of Negative Data
Detecting and Exorcising Statistical Demons from Language Models with Anti-Models of Negative Data
Michael L. Wick
Kate Silverstein
Jean-Baptiste Tristan
Adam Craig Pocock
Mark Johnson
45
3
0
22 Oct 2020
Towards Fully Bilingual Deep Language Modeling
Towards Fully Bilingual Deep Language Modeling
Li-Hsin Chang
S. Pyysalo
Jenna Kanerva
Filip Ginter
67
3
0
22 Oct 2020
Similarity Analysis of Self-Supervised Speech Representations
Similarity Analysis of Self-Supervised Speech Representations
Yu-An Chung
Yonatan Belinkov
James R. Glass
SSL
129
37
0
22 Oct 2020
Knowledge Distillation for BERT Unsupervised Domain Adaptation
Knowledge Distillation for BERT Unsupervised Domain Adaptation
Minho Ryu
K. Lee
112
35
0
22 Oct 2020
Latte-Mix: Measuring Sentence Semantic Similarity with Latent
  Categorical Mixtures
Latte-Mix: Measuring Sentence Semantic Similarity with Latent Categorical Mixtures
Minghan Li
He Bai
Luchen Tan
Kun Xiong
Ming Li
Jimmy J. Lin
FedML
43
0
0
21 Oct 2020
Semantic Role Labeling as Syntactic Dependency Parsing
Semantic Role Labeling as Syntactic Dependency Parsing
Tianze Shi
Igor Malioutov
Ozan Irsoy
71
16
0
21 Oct 2020
Previous
123...454647...899091
Next