ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 1810.04805
  4. Cited By
BERT: Pre-training of Deep Bidirectional Transformers for Language
  Understanding

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

11 October 2018
Jacob Devlin
Ming-Wei Chang
Kenton Lee
Kristina Toutanova
    VLM
    SSL
    SSeg
ArXivPDFHTML

Papers citing "BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding"

50 / 18,599 papers shown
Title
A Surprisingly Robust Trick for Winograd Schema Challenge
A Surprisingly Robust Trick for Winograd Schema Challenge
Vid Kocijan
Ana-Maria Cretu
Oana-Maria Camburu
Yordan Yordanov
Thomas Lukasiewicz
26
101
0
15 May 2019
BERT Rediscovers the Classical NLP Pipeline
BERT Rediscovers the Classical NLP Pipeline
Ian Tenney
Dipanjan Das
Ellie Pavlick
MILM
SSeg
50
1,445
0
15 May 2019
Sense Vocabulary Compression through the Semantic Knowledge of WordNet
  for Neural Word Sense Disambiguation
Sense Vocabulary Compression through the Semantic Knowledge of WordNet for Neural Word Sense Disambiguation
Loïc Vial
Benjamin Lecouteux
D. Schwab
16
90
0
14 May 2019
Style Transformer: Unpaired Text Style Transfer without Disentangled
  Latent Representation
Style Transformer: Unpaired Text Style Transfer without Disentangled Latent Representation
Ning Dai
Jianze Liang
Xipeng Qiu
Xuanjing Huang
DRL
16
202
0
14 May 2019
Entity-Relation Extraction as Multi-Turn Question Answering
Entity-Relation Extraction as Multi-Turn Question Answering
Xiaoya Li
Fan Yin
Zijun Sun
Xiayu Li
Arianna Yuan
Duo Chai
Mingxin Zhou
Jiwei Li
35
346
0
14 May 2019
PatentBERT: Patent Classification with Fine-Tuning a pre-trained BERT
  Model
PatentBERT: Patent Classification with Fine-Tuning a pre-trained BERT Model
Jieh-Sheng Lee
J. Hsiang
19
93
0
14 May 2019
A Review of Keyphrase Extraction
A Review of Keyphrase Extraction
Eirini Papagiannopoulou
Grigorios Tsoumakas
21
166
0
13 May 2019
Almost Unsupervised Text to Speech and Automatic Speech Recognition
Almost Unsupervised Text to Speech and Automatic Speech Recognition
Yi Ren
Xu Tan
Tao Qin
Sheng Zhao
Zhou Zhao
Tie-Yan Liu
44
101
0
13 May 2019
Synchronous Bidirectional Neural Machine Translation
Synchronous Bidirectional Neural Machine Translation
Long Zhou
Jiajun Zhang
Chengqing Zong
22
106
0
13 May 2019
A logical-based corpus for cross-lingual evaluation
A logical-based corpus for cross-lingual evaluation
Felipe Salvatore
Marcelo Finger
R. Hirata
21
1
0
10 May 2019
Deep Unsupervised Cardinality Estimation
Deep Unsupervised Cardinality Estimation
Zongheng Yang
Eric Liang
Amog Kamsetty
Chenggang Wu
Yan Duan
Peter Chen
Pieter Abbeel
J. M. Hellerstein
S. Krishnan
Ion Stoica
29
203
0
10 May 2019
Language Modeling with Deep Transformers
Language Modeling with Deep Transformers
Kazuki Irie
Albert Zeyer
Ralf Schluter
Hermann Ney
KELM
46
171
0
10 May 2019
Improving Discrete Latent Representations With Differentiable
  Approximation Bridges
Improving Discrete Latent Representations With Differentiable Approximation Bridges
Jason Ramapuram
Russ Webb
DRL
19
9
0
09 May 2019
Unified Language Model Pre-training for Natural Language Understanding
  and Generation
Unified Language Model Pre-training for Natural Language Understanding and Generation
Li Dong
Nan Yang
Wenhui Wang
Furu Wei
Xiaodong Liu
Yu-Chiang Frank Wang
Jianfeng Gao
M. Zhou
H. Hon
ELM
AI4CE
80
1,551
0
08 May 2019
Show, Price and Negotiate: A Negotiator with Online Value Look-Ahead
Show, Price and Negotiate: A Negotiator with Online Value Look-Ahead
Amin Parvaneh
Ehsan Abbasnejad
Qi Wu
Javen Qinfeng Shi
Anton van den Hengel
OffRL
29
5
0
07 May 2019
Neural Architecture Refinement: A Practical Way for Avoiding Overfitting
  in NAS
Neural Architecture Refinement: A Practical Way for Avoiding Overfitting in NAS
Yangzhou Jiang
Cong Zhao
Zeyang Dou
Lei Pang
14
5
0
07 May 2019
Taming Pretrained Transformers for Extreme Multi-label Text
  Classification
Taming Pretrained Transformers for Extreme Multi-label Text Classification
Wei-Cheng Chang
Hsiang-Fu Yu
Kai Zhong
Yiming Yang
Inderjit Dhillon
27
20
0
07 May 2019
Investigating the Successes and Failures of BERT for Passage Re-Ranking
Investigating the Successes and Failures of BERT for Passage Re-Ranking
Harshith Padigela
Hamed Zamani
W. Bruce Croft
27
47
0
05 May 2019
Learning to Denoise Distantly-Labeled Data for Entity Typing
Learning to Denoise Distantly-Labeled Data for Entity Typing
Yasumasa Onoe
Greg Durrett
32
57
0
04 May 2019
ASER: A Large-scale Eventuality Knowledge Graph
ASER: A Large-scale Eventuality Knowledge Graph
Hongming Zhang
Xin Liu
Haojie Pan
Yangqiu Song
C. Leung
SLR
32
159
0
01 May 2019
Deep Learning for Audio Signal Processing
Deep Learning for Audio Signal Processing
Hendrik Purwins
Yue Liu
Tuomas Virtanen
Jan Schlüter
Shuo-yiin Chang
Tara N. Sainath
VLM
34
587
0
30 Apr 2019
Very Deep Self-Attention Networks for End-to-End Speech Recognition
Very Deep Self-Attention Networks for End-to-End Speech Recognition
Ngoc-Quan Pham
T. Nguyen
Jan Niehues
Markus Müller
Sebastian Stüker
A. Waibel
28
161
0
30 Apr 2019
Segmentation is All You Need
Segmentation is All You Need
Zehua Cheng
Yuxiang Wu
Zhenghua Xu
Thomas Lukasiewicz
Weiyan Wang
33
20
0
30 Apr 2019
Towards Efficient Model Compression via Learned Global Ranking
Towards Efficient Model Compression via Learned Global Ranking
Ting-Wu Chin
Ruizhou Ding
Cha Zhang
Diana Marculescu
16
170
0
28 Apr 2019
Improved Conditional VRNNs for Video Prediction
Improved Conditional VRNNs for Video Prediction
Lluis Castrejon
Nicolas Ballas
Aaron Courville
VGen
DRL
23
161
0
27 Apr 2019
TVQA+: Spatio-Temporal Grounding for Video Question Answering
TVQA+: Spatio-Temporal Grounding for Video Question Answering
Jie Lei
Licheng Yu
Tamara L. Berg
Joey Tianyi Zhou
31
227
0
25 Apr 2019
Probing What Different NLP Tasks Teach Machines about Function Word
  Comprehension
Probing What Different NLP Tasks Teach Machines about Function Word Comprehension
Najoung Kim
Roma Patel
Adam Poliak
Alex Jinpeng Wang
Patrick Xia
...
Alexis Ross
Tal Linzen
Benjamin Van Durme
Samuel R. Bowman
Ellie Pavlick
28
106
0
25 Apr 2019
Tetra-Tagging: Word-Synchronous Parsing with Linear-Time Inference
Tetra-Tagging: Word-Synchronous Parsing with Linear-Time Inference
Nikita Kitaev
Dan Klein
38
21
0
22 Apr 2019
Understanding Roles and Entities: Datasets and Models for Natural
  Language Inference
Understanding Roles and Entities: Datasets and Models for Natural Language Inference
Arindam Mitra
Ishan Shrivastava
Chitta Baral
28
2
0
22 Apr 2019
Poly-encoders: Transformer Architectures and Pre-training Strategies for
  Fast and Accurate Multi-sentence Scoring
Poly-encoders: Transformer Architectures and Pre-training Strategies for Fast and Accurate Multi-sentence Scoring
Samuel Humeau
Kurt Shuster
Marie-Anne Lachaux
Jason Weston
35
280
0
22 Apr 2019
Improving Multi-Task Deep Neural Networks via Knowledge Distillation for
  Natural Language Understanding
Improving Multi-Task Deep Neural Networks via Knowledge Distillation for Natural Language Understanding
Xiaodong Liu
Pengcheng He
Weizhu Chen
Jianfeng Gao
FedML
13
181
0
20 Apr 2019
Language Models with Transformers
Language Models with Transformers
Chenguang Wang
Mu Li
Alex Smola
20
121
0
20 Apr 2019
Mask-Predict: Parallel Decoding of Conditional Masked Language Models
Mask-Predict: Parallel Decoding of Conditional Masked Language Models
Marjan Ghazvininejad
Omer Levy
Yinhan Liu
Luke Zettlemoyer
MoE
27
35
0
19 Apr 2019
An Evaluation of Transfer Learning for Classifying Sales Engagement
  Emails at Large Scale
An Evaluation of Transfer Learning for Classifying Sales Engagement Emails at Large Scale
Yong Liu
Pavel A. Dmitriev
Yifei Huang
Andrew Brooks
Li Dong
21
4
0
19 Apr 2019
ERNIE: Enhanced Representation through Knowledge Integration
ERNIE: Enhanced Representation through Knowledge Integration
Yu Sun
Shuohuan Wang
Yukun Li
Shikun Feng
Xuyi Chen
Han Zhang
Xin Tian
Danxiang Zhu
Hao Tian
Hua Wu
79
895
0
19 Apr 2019
Beto, Bentz, Becas: The Surprising Cross-Lingual Effectiveness of BERT
Beto, Bentz, Becas: The Surprising Cross-Lingual Effectiveness of BERT
Shijie Wu
Mark Dredze
VLM
SSeg
44
670
0
19 Apr 2019
Evaluating the Underlying Gender Bias in Contextualized Word Embeddings
Evaluating the Underlying Gender Bias in Contextualized Word Embeddings
Christine Basta
Marta R. Costa-jussá
Noe Casas
27
189
0
18 Apr 2019
DocBERT: BERT for Document Classification
DocBERT: BERT for Document Classification
Ashutosh Adhikari
Achyudh Ram
Raphael Tang
Jimmy J. Lin
LLMAG
VLM
15
296
0
17 Apr 2019
Document Expansion by Query Prediction
Document Expansion by Query Prediction
Rodrigo Nogueira
Wei Yang
Jimmy J. Lin
Kyunghyun Cho
54
408
0
17 Apr 2019
Amobee at SemEval-2019 Tasks 5 and 6: Multiple Choice CNN Over
  Contextual Embedding
Amobee at SemEval-2019 Tasks 5 and 6: Multiple Choice CNN Over Contextual Embedding
A. Rozental
Dadi Biton
17
14
0
17 Apr 2019
Natural Language Semantics With Pictures: Some Language & Vision
  Datasets and Potential Uses for Computational Semantics
Natural Language Semantics With Pictures: Some Language & Vision Datasets and Potential Uses for Computational Semantics
David Schlangen
33
6
0
15 Apr 2019
Pre-training of Context-aware Item Representation for Next Basket
  Recommendation
Pre-training of Context-aware Item Representation for Next Basket Recommendation
Jingxuan Yang
Jun Xu
Jianzhuo Tong
Sheng Gao
Jun Guo
Jirong Wen
15
7
0
14 Apr 2019
Membership Inference Attacks on Sequence-to-Sequence Models: Is My Data
  In Your Machine Translation System?
Membership Inference Attacks on Sequence-to-Sequence Models: Is My Data In Your Machine Translation System?
Sorami Hisamoto
Matt Post
Kevin Duh
MIACV
SLR
36
106
0
11 Apr 2019
Deep Neural Networks Ensemble for Detecting Medication Mentions in
  Tweets
Deep Neural Networks Ensemble for Detecting Medication Mentions in Tweets
D. Weissenbacher
A. Sarker
A. Klein
K. O’Connor
Arjun Magge Ranganatha
G. Gonzalez-Hernandez
21
47
0
10 Apr 2019
Jointly Measuring Diversity and Quality in Text Generation Models
Jointly Measuring Diversity and Quality in Text Generation Models
Ehsan Montahaei
Danial Alihosseini
M. Baghshah
27
76
0
08 Apr 2019
UM-IU@LING at SemEval-2019 Task 6: Identifying Offensive Tweets Using
  BERT and SVMs
UM-IU@LING at SemEval-2019 Task 6: Identifying Offensive Tweets Using BERT and SVMs
Jian Zhu
Zuoyu Tian
Sandra Kübler
VLM
27
39
0
06 Apr 2019
Evaluating Coherence in Dialogue Systems using Entailment
Evaluating Coherence in Dialogue Systems using Entailment
Nouha Dziri
Ehsan Kamalloo
K. Mathewson
Osmar Zaiane
14
94
0
06 Apr 2019
Publicly Available Clinical BERT Embeddings
Publicly Available Clinical BERT Embeddings
Emily Alsentzer
John R. Murphy
Willie Boag
W. Weng
Di Jin
Tristan Naumann
Matthew B. A. McDermott
AI4MH
48
1,932
0
06 Apr 2019
Gender Bias in Contextualized Word Embeddings
Gender Bias in Contextualized Word Embeddings
Jieyu Zhao
Tianlu Wang
Mark Yatskar
Ryan Cotterell
Vicente Ordonez
Kai-Wei Chang
FaML
42
417
0
05 Apr 2019
PoMo: Generating Entity-Specific Post-Modifiers in Context
PoMo: Generating Entity-Specific Post-Modifiers in Context
Jun Seok Kang
IV RobertL.Logan
Zewei Chu
Yang Chen
Dheeru Dua
Kevin Gimpel
Sameer Singh
Niranjan Balasubramanian
34
11
0
05 Apr 2019
Previous
123...368369370371372
Next