ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 1810.04805
  4. Cited By
BERT: Pre-training of Deep Bidirectional Transformers for Language
  Understanding

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

11 October 2018
Jacob Devlin
Ming-Wei Chang
Kenton Lee
Kristina Toutanova
    VLM
    SSL
    SSeg
ArXivPDFHTML

Papers citing "BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding"

50 / 17,895 papers shown
Title
CODA-19: Using a Non-Expert Crowd to Annotate Research Aspects on
  10,000+ Abstracts in the COVID-19 Open Research Dataset
CODA-19: Using a Non-Expert Crowd to Annotate Research Aspects on 10,000+ Abstracts in the COVID-19 Open Research Dataset
Ting-Hao 'Kenneth' Huang
Huang Chieh-Yang
C. C. Ding
Yen-Chia Hsu
C. Lee Giles
27
14
0
05 May 2020
SLEDGE: A Simple Yet Effective Baseline for COVID-19 Scientific
  Knowledge Search
SLEDGE: A Simple Yet Effective Baseline for COVID-19 Scientific Knowledge Search
Sean MacAvaney
Arman Cohan
Nazli Goharian
25
23
0
05 May 2020
Neural CRF Model for Sentence Alignment in Text Simplification
Neural CRF Model for Sentence Alignment in Text Simplification
Chao Jiang
Mounica Maddela
Wuwei Lan
Yang Zhong
Wenyuan Xu
28
157
0
05 May 2020
Multi-Stage Conversational Passage Retrieval: An Approach to Fusing Term
  Importance Estimation and Neural Query Rewriting
Multi-Stage Conversational Passage Retrieval: An Approach to Fusing Term Importance Estimation and Neural Query Rewriting
Sheng-Chieh Lin
Jheng-Hong Yang
Rodrigo Nogueira
Ming-Feng Tsai
Chuan-Ju Wang
Jimmy J. Lin
29
24
0
05 May 2020
ImpactCite: An XLNet-based method for Citation Impact Analysis
ImpactCite: An XLNet-based method for Citation Impact Analysis
Dominique Mercier
Syed Tahseen Raza Rizvi
Vikas Rajashekar
Andreas Dengel
Sheraz Ahmed
19
14
0
05 May 2020
Smart To-Do : Automatic Generation of To-Do Items from Emails
Smart To-Do : Automatic Generation of To-Do Items from Emails
Sudipto Mukherjee
Subhabrata Mukherjee
Marcello Hasegawa
Ahmed Hassan Awadallah
Ryen W. White
24
14
0
05 May 2020
Probabilistic Assumptions Matter: Improved Models for
  Distantly-Supervised Document-Level Question Answering
Probabilistic Assumptions Matter: Improved Models for Distantly-Supervised Document-Level Question Answering
Hao Cheng
Ming-Wei Chang
Kenton Lee
Kristina Toutanova
35
22
0
05 May 2020
Fine-grained Financial Opinion Mining: A Survey and Research Agenda
Fine-grained Financial Opinion Mining: A Survey and Research Agenda
Chung-Chi Chen
Hen-Hsen Huang
Hsin-Hsi Chen
AIFin
AI4TS
6
4
0
05 May 2020
Exploring Content Selection in Summarization of Novel Chapters
Exploring Content Selection in Summarization of Novel Chapters
Faisal Ladhak
Bryan Li
Yaser Al-Onaizan
Kathleen McKeown
71
35
0
04 May 2020
Spying on your neighbors: Fine-grained probing of contextual embeddings
  for information about surrounding words
Spying on your neighbors: Fine-grained probing of contextual embeddings for information about surrounding words
Josef Klafka
Allyson Ettinger
53
42
0
04 May 2020
Code and Named Entity Recognition in StackOverflow
Code and Named Entity Recognition in StackOverflow
Jeniya Tabassum
Mounica Maddela
Wei-ping Xu
Alan Ritter
59
115
0
04 May 2020
CAiRE-COVID: A Question Answering and Query-focused Multi-Document
  Summarization System for COVID-19 Scholarly Information Management
CAiRE-COVID: A Question Answering and Query-focused Multi-Document Summarization System for COVID-19 Scholarly Information Management
Dan Su
Yan Xu
Tiezheng Yu
Farhad Bin Siddique
Elham J. Barezi
Pascale Fung
RALM
19
31
0
04 May 2020
To Test Machine Comprehension, Start by Defining Comprehension
To Test Machine Comprehension, Start by Defining Comprehension
Jesse Dunietz
Greg Burnham
Akash Bharadwaj
Owen Rambow
Jennifer Chu-Carroll
D. Ferrucci
FaML
54
65
0
04 May 2020
Does Visual Self-Supervision Improve Learning of Speech Representations
  for Emotion Recognition?
Does Visual Self-Supervision Improve Learning of Speech Representations for Emotion Recognition?
Abhinav Shukla
Stavros Petridis
M. Pantic
SSL
32
28
0
04 May 2020
The Sensitivity of Language Models and Humans to Winograd Schema
  Perturbations
The Sensitivity of Language Models and Humans to Winograd Schema Perturbations
Mostafa Abdou
Vinit Ravishankar
Maria Barrett
Yonatan Belinkov
Desmond Elliott
Anders Søgaard
ReLM
LRM
62
34
0
04 May 2020
From SPMRL to NMRL: What Did We Learn (and Unlearn) in a Decade of
  Parsing Morphologically-Rich Languages (MRLs)?
From SPMRL to NMRL: What Did We Learn (and Unlearn) in a Decade of Parsing Morphologically-Rich Languages (MRLs)?
Reut Tsarfaty
Dan Bareket
Stav Klein
Amit Seker
21
39
0
04 May 2020
Noise Pollution in Hospital Readmission Prediction: Long Document
  Classification with Reinforcement Learning
Noise Pollution in Hospital Readmission Prediction: Long Document Classification with Reinforcement Learning
Liyan Xu
J. Hogan
R. Patzer
Jinho Choi
19
4
0
04 May 2020
Robust Encodings: A Framework for Combating Adversarial Typos
Robust Encodings: A Framework for Combating Adversarial Typos
Erik Jones
Robin Jia
Aditi Raghunathan
Percy Liang
AAML
142
102
0
04 May 2020
On the Limitations of Cross-lingual Encoders as Exposed by
  Reference-Free Machine Translation Evaluation
On the Limitations of Cross-lingual Encoders as Exposed by Reference-Free Machine Translation Evaluation
Wei-Ye Zhao
Goran Glavavs
Maxime Peyrard
Yang Gao
Robert West
Steffen Eger
ELM
26
63
0
03 May 2020
Knowledge Graph-Augmented Abstractive Summarization with Semantic-Driven
  Cloze Reward
Knowledge Graph-Augmented Abstractive Summarization with Semantic-Driven Cloze Reward
Luyang Huang
Lingfei Wu
Lu Wang
RALM
32
161
0
03 May 2020
Let Me Choose: From Verbal Context to Font Selection
Let Me Choose: From Verbal Context to Font Selection
Amirreza Shirani
Franck Dernoncourt
J. Echevarria
P. Asente
Nedim Lipka
Thamar Solorio
32
19
0
03 May 2020
Improving Aspect-Level Sentiment Analysis with Aspect Extraction
Improving Aspect-Level Sentiment Analysis with Aspect Extraction
Navonil Majumder
Rishabh Bhardwaj
Soujanya Poria
Amir Zadeh
Alexander Gelbukh
Amir Hussain
Louis-Philippe Morency
16
30
0
03 May 2020
Dynamic Programming Encoding for Subword Segmentation in Neural Machine
  Translation
Dynamic Programming Encoding for Subword Segmentation in Neural Machine Translation
Xuanli He
Gholamreza Haffari
Mohammad Norouzi
21
45
0
03 May 2020
Encoder-Decoder Models Can Benefit from Pre-trained Masked Language
  Models in Grammatical Error Correction
Encoder-Decoder Models Can Benefit from Pre-trained Masked Language Models in Grammatical Error Correction
Masahiro Kaneko
Masato Mita
Shun Kiyono
Jun Suzuki
Kentaro Inui
35
143
0
03 May 2020
How Does Selective Mechanism Improve Self-Attention Networks?
How Does Selective Mechanism Improve Self-Attention Networks?
Xinwei Geng
Longyue Wang
Xing Wang
Bing Qin
Ting Liu
Zhaopeng Tu
AAML
39
35
0
03 May 2020
Understanding and Improving Information Transfer in Multi-Task Learning
Understanding and Improving Information Transfer in Multi-Task Learning
Sen Wu
Hongyang R. Zhang
Christopher Ré
18
154
0
02 May 2020
Quantifying Attention Flow in Transformers
Quantifying Attention Flow in Transformers
Samira Abnar
Willem H. Zuidema
60
778
0
02 May 2020
Clue: Cross-modal Coherence Modeling for Caption Generation
Clue: Cross-modal Coherence Modeling for Caption Generation
Malihe Alikhani
Piyush Sharma
Shengjie Li
Radu Soricut
Matthew Stone
38
56
0
02 May 2020
Zero-Shot Transfer Learning with Synthesized Data for Multi-Domain
  Dialogue State Tracking
Zero-Shot Transfer Learning with Synthesized Data for Multi-Domain Dialogue State Tracking
Giovanni Campagna
Agata Foryciarz
M. Moradshahi
M. Lam
21
97
0
02 May 2020
Improving Truthfulness of Headline Generation
Improving Truthfulness of Headline Generation
Kazuki Matsumaru
Sho Takase
Naoaki Okazaki
HILM
8
49
0
02 May 2020
Social Biases in NLP Models as Barriers for Persons with Disabilities
Social Biases in NLP Models as Barriers for Persons with Disabilities
Ben Hutchinson
Vinodkumar Prabhakaran
Emily L. Denton
Kellie Webster
Yu Zhong
Stephen Denuyl
16
302
0
02 May 2020
Teaching Machine Comprehension with Compositional Explanations
Teaching Machine Comprehension with Compositional Explanations
Qinyuan Ye
Xiao Huang
Elizabeth Boschee
Xiang Ren
LRM
ReLM
21
34
0
02 May 2020
IsoBN: Fine-Tuning BERT with Isotropic Batch Normalization
IsoBN: Fine-Tuning BERT with Isotropic Batch Normalization
Wenxuan Zhou
Bill Yuchen Lin
Xiang Ren
14
24
0
02 May 2020
A Simple Language Model for Task-Oriented Dialogue
A Simple Language Model for Task-Oriented Dialogue
Ehsan Hosseini-Asl
Bryan McCann
Chien-Sheng Wu
Semih Yavuz
R. Socher
31
526
0
02 May 2020
ForecastQA: A Question Answering Challenge for Event Forecasting with
  Temporal Text Data
ForecastQA: A Question Answering Challenge for Event Forecasting with Temporal Text Data
Woojeong Jin
Rahul Khanna
Suji Kim
Dong-Ho Lee
Fred Morstatter
Aram Galstyan
Xiang Ren
AI4TS
13
36
0
02 May 2020
RICA: Evaluating Robust Inference Capabilities Based on Commonsense
  Axioms
RICA: Evaluating Robust Inference Capabilities Based on Commonsense Axioms
Pei Zhou
Rahul Khanna
Seyeon Lee
Bill Yuchen Lin
Daniel E. Ho
Jay Pujara
Xiang Ren
ReLM
21
36
0
02 May 2020
Mega-COV: A Billion-Scale Dataset of 100+ Languages for COVID-19
Mega-COV: A Billion-Scale Dataset of 100+ Languages for COVID-19
Muhammad Abdul-Mageed
AbdelRahim Elmadany
El Moatez Billah Nagoudi
Dinesh Pabbi
Kunal Verma
Rannie Lin
21
18
0
02 May 2020
ProtoQA: A Question Answering Dataset for Prototypical Common-Sense
  Reasoning
ProtoQA: A Question Answering Dataset for Prototypical Common-Sense Reasoning
Michael Boratko
Xiang Lorraine Li
Rajarshi Das
Timothy J. O'Gorman
Daniel Le
Andrew McCallum
27
56
0
02 May 2020
BERT-kNN: Adding a kNN Search Component to Pretrained Language Models
  for Better QA
BERT-kNN: Adding a kNN Search Component to Pretrained Language Models for Better QA
Nora Kassner
Hinrich Schütze
RALM
21
68
0
02 May 2020
UnifiedQA: Crossing Format Boundaries With a Single QA System
UnifiedQA: Crossing Format Boundaries With a Single QA System
Daniel Khashabi
Sewon Min
Tushar Khot
Ashish Sabharwal
Oyvind Tafjord
Peter Clark
Hannaneh Hajishirzi
46
721
0
02 May 2020
DeFormer: Decomposing Pre-trained Transformers for Faster Question
  Answering
DeFormer: Decomposing Pre-trained Transformers for Faster Question Answering
Qingqing Cao
H. Trivedi
A. Balasubramanian
Niranjan Balasubramanian
32
66
0
02 May 2020
Contrastive Self-Supervised Learning for Commonsense Reasoning
Contrastive Self-Supervised Learning for Commonsense Reasoning
T. Klein
Moin Nabi
LRM
SSL
19
63
0
02 May 2020
We Need to Talk About Random Splits
We Need to Talk About Random Splits
Anders Søgaard
Sebastian Ebert
Jasmijn Bastings
Katja Filippova
34
97
0
01 May 2020
From Zero to Hero: On the Limitations of Zero-Shot Cross-Lingual
  Transfer with Multilingual Transformers
From Zero to Hero: On the Limitations of Zero-Shot Cross-Lingual Transfer with Multilingual Transformers
Anne Lauscher
Vinit Ravishankar
Ivan Vulić
Goran Glavaš
29
56
0
01 May 2020
Probing Contextual Language Models for Common Ground with Visual
  Representations
Probing Contextual Language Models for Common Ground with Visual Representations
Gabriel Ilharco
Rowan Zellers
Ali Farhadi
Hannaneh Hajishirzi
30
14
0
01 May 2020
Multi-Dimensional Gender Bias Classification
Multi-Dimensional Gender Bias Classification
Emily Dinan
Angela Fan
Ledell Yu Wu
Jason Weston
Douwe Kiela
Adina Williams
FaML
22
122
0
01 May 2020
Learning an Unreferenced Metric for Online Dialogue Evaluation
Learning an Unreferenced Metric for Online Dialogue Evaluation
Koustuv Sinha
Prasanna Parthasarathi
Jasmine Wang
Ryan J. Lowe
William L. Hamilton
Joelle Pineau
OffRL
29
84
0
01 May 2020
When BERT Plays the Lottery, All Tickets Are Winning
When BERT Plays the Lottery, All Tickets Are Winning
Sai Prasanna
Anna Rogers
Anna Rumshisky
MILM
16
186
0
01 May 2020
POINTER: Constrained Progressive Text Generation via Insertion-based
  Generative Pre-training
POINTER: Constrained Progressive Text Generation via Insertion-based Generative Pre-training
Yizhe Zhang
Guoyin Wang
Chunyuan Li
Zhe Gan
Chris Brockett
Bill Dolan
34
30
0
01 May 2020
Do Neural Ranking Models Intensify Gender Bias?
Do Neural Ranking Models Intensify Gender Bias?
Navid Rekabsaz
Markus Schedl
16
57
0
01 May 2020
Previous
123...333334335...356357358
Next