ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 1905.05950
  4. Cited By
BERT Rediscovers the Classical NLP Pipeline
v1v2 (latest)

BERT Rediscovers the Classical NLP Pipeline

15 May 2019
Ian Tenney
Dipanjan Das
Ellie Pavlick
    MILMSSeg
ArXiv (abs)PDFHTML

Papers citing "BERT Rediscovers the Classical NLP Pipeline"

50 / 821 papers shown
Title
Understanding Performance of Long-Document Ranking Models through
  Comprehensive Evaluation and Leaderboarding
Understanding Performance of Long-Document Ranking Models through Comprehensive Evaluation and Leaderboarding
Leonid Boytsov
David Akinpelu
Tianyi Lin
Fangwei Gao
Yutian Zhao
Jeffrey Huang
Nipun Katyal
Eric Nyberg
178
9
0
04 Jul 2022
Linguistically inspired roadmap for building biologically reliable
  protein language models
Linguistically inspired roadmap for building biologically reliable protein language models
Mai Ha Vu
Rahmad Akbar
Philippe A. Robert
B. Swiatczak
Victor Greiff
G. K. Sandve
Dag Trygve Tryslew Haug
101
36
0
03 Jul 2022
VL-CheckList: Evaluating Pre-trained Vision-Language Models with
  Objects, Attributes and Relations
VL-CheckList: Evaluating Pre-trained Vision-Language Models with Objects, Attributes and Relations
Tiancheng Zhao
Tianqi Zhang
Mingwei Zhu
Haozhan Shen
Kyusong Lee
Xiaopeng Lu
Jianwei Yin
VLMCoGeMLLM
116
99
0
01 Jul 2022
Masked Part-Of-Speech Model: Does Modeling Long Context Help
  Unsupervised POS-tagging?
Masked Part-Of-Speech Model: Does Modeling Long Context Help Unsupervised POS-tagging?
Xiang Zhou
Shiyue Zhang
Joey Tianyi Zhou
60
1
0
30 Jun 2022
Analyzing Encoded Concepts in Transformer Language Models
Analyzing Encoded Concepts in Transformer Language Models
Hassan Sajjad
Nadir Durrani
Fahim Dalvi
Firoj Alam
A. Khan
Jia Xu
59
47
0
27 Jun 2022
Discovering Salient Neurons in Deep NLP Models
Discovering Salient Neurons in Deep NLP Models
Nadir Durrani
Fahim Dalvi
Hassan Sajjad
KELMMILM
114
16
0
27 Jun 2022
Towards Unsupervised Content Disentanglement in Sentence Representations
  via Syntactic Roles
Towards Unsupervised Content Disentanglement in Sentence Representations via Syntactic Roles
G. Felhi
Joseph Le Roux
Djamé Seddah
DRL
47
5
0
22 Jun 2022
Methods for Estimating and Improving Robustness of Language Models
Methods for Estimating and Improving Robustness of Language Models
Michal Stefánik
57
3
0
16 Jun 2022
Evaluating Self-Supervised Learning for Molecular Graph Embeddings
Evaluating Self-Supervised Learning for Molecular Graph Embeddings
Hanchen Wang
Jean Kaddour
Shengchao Liu
Jian Tang
Joan Lasenby
Qi Liu
121
23
0
16 Jun 2022
Cross-lingual AMR Aligner: Paying Attention to Cross-Attention
Cross-lingual AMR Aligner: Paying Attention to Cross-Attention
Abelardo Carlos Martínez Lorenzo
Pere-Lluís Huguet Cabot
Roberto Navigli
75
4
0
15 Jun 2022
Transition-based Abstract Meaning Representation Parsing with Contextual
  Embeddings
Transition-based Abstract Meaning Representation Parsing with Contextual Embeddings
Yi Liang
85
0
0
13 Jun 2022
Unsupervised and Few-shot Parsing from Pretrained Language Models
Unsupervised and Few-shot Parsing from Pretrained Language Models
Zhiyuan Zeng
Deyi Xiong
35
4
0
10 Jun 2022
Abstraction not Memory: BERT and the English Article System
Abstraction not Memory: BERT and the English Article System
Harish Tayyar Madabushi
Dagmar Divjak
P. Milin
26
5
0
08 Jun 2022
Dict-TTS: Learning to Pronounce with Prior Dictionary Knowledge for
  Text-to-Speech
Dict-TTS: Learning to Pronounce with Prior Dictionary Knowledge for Text-to-Speech
Ziyue Jiang
Zhe Su
Zhou Zhao
Qian Yang
Yi Ren
Jinglin Liu
Zhe Ye
73
5
0
05 Jun 2022
ZeroQuant: Efficient and Affordable Post-Training Quantization for
  Large-Scale Transformers
ZeroQuant: Efficient and Affordable Post-Training Quantization for Large-Scale Transformers
Z. Yao
Reza Yazdani Aminabadi
Minjia Zhang
Xiaoxia Wu
Conglong Li
Yuxiong He
VLMMQ
177
484
0
04 Jun 2022
Latent Topology Induction for Understanding Contextualized
  Representations
Latent Topology Induction for Understanding Contextualized Representations
Yao Fu
Mirella Lapata
BDL
367
6
0
03 Jun 2022
Vietnamese Hate and Offensive Detection using PhoBERT-CNN and Social
  Media Streaming Data
Vietnamese Hate and Offensive Detection using PhoBERT-CNN and Social Media Streaming Data
K. Tran
An Trong Nguyen
Phu Gia Hoang
Canh Duc Luu
Trong-Hop Do
Kiet Van Nguyen
60
23
0
01 Jun 2022
Transformer with Fourier Integral Attentions
Transformer with Fourier Integral Attentions
T. Nguyen
Minh Pham
Tam Nguyen
Khai Nguyen
Stanley J. Osher
Nhat Ho
68
4
0
01 Jun 2022
CEBaB: Estimating the Causal Effects of Real-World Concepts on NLP Model
  Behavior
CEBaB: Estimating the Causal Effects of Real-World Concepts on NLP Model Behavior
Eldar David Abraham
Karel DÓosterlinck
Amir Feder
Y. Gat
Atticus Geiger
Christopher Potts
Roi Reichart
Zhengxuan Wu
CML
131
47
0
27 May 2022
On Building Spoken Language Understanding Systems for Low Resourced
  Languages
On Building Spoken Language Understanding Systems for Low Resourced Languages
Akshat Gupta
58
8
0
25 May 2022
Garden-Path Traversal in GPT-2
Garden-Path Traversal in GPT-2
William Jurayj
William Rudman
Carsten Eickhoff
36
5
0
24 May 2022
Towards Tracing Factual Knowledge in Language Models Back to the
  Training Data
Towards Tracing Factual Knowledge in Language Models Back to the Training Data
Ekin Akyürek
Tolga Bolukbasi
Frederick Liu
Binbin Xiong
Ian Tenney
Jacob Andreas
Kelvin Guu
HILM
53
12
0
23 May 2022
What Drives the Use of Metaphorical Language? Negative Insights from
  Abstractness, Affect, Discourse Coherence and Contextualized Word
  Representations
What Drives the Use of Metaphorical Language? Negative Insights from Abstractness, Affect, Discourse Coherence and Contextualized Word Representations
P. Piccirilli
Sabine Schulte im Walde
60
4
0
23 May 2022
The Geometry of Multilingual Language Model Representations
The Geometry of Multilingual Language Model Representations
Tyler A. Chang
Zhuowen Tu
Benjamin Bergen
108
69
0
22 May 2022
Life after BERT: What do Other Muppets Understand about Language?
Life after BERT: What do Other Muppets Understand about Language?
Vladislav Lialin
Kevin Zhao
Namrata Shivagunde
Anna Rumshisky
110
6
0
21 May 2022
Assessing the Limits of the Distributional Hypothesis in Semantic
  Spaces: Trait-based Relational Knowledge and the Impact of Co-occurrences
Assessing the Limits of the Distributional Hypothesis in Semantic Spaces: Trait-based Relational Knowledge and the Impact of Co-occurrences
Mark Anderson
Jose Camacho-Collados
69
0
0
16 May 2022
Discovering Latent Concepts Learned in BERT
Discovering Latent Concepts Learned in BERT
Fahim Dalvi
A. Khan
Firoj Alam
Nadir Durrani
Jia Xu
Hassan Sajjad
SSL
50
61
0
15 May 2022
Is the Computation of Abstract Sameness Relations Human-Like in Neural
  Language Models?
Is the Computation of Abstract Sameness Relations Human-Like in Neural Language Models?
Lukas Thoma
Benjamin Roth
76
0
0
12 May 2022
Exploiting Inductive Bias in Transformers for Unsupervised
  Disentanglement of Syntax and Semantics with VAEs
Exploiting Inductive Bias in Transformers for Unsupervised Disentanglement of Syntax and Semantics with VAEs
G. Felhi
Joseph Le Roux
Djamé Seddah
DRL
56
2
0
12 May 2022
EigenNoise: A Contrastive Prior to Warm-Start Representations
EigenNoise: A Contrastive Prior to Warm-Start Representations
H. Heidenreich
Jake Williams
38
1
0
09 May 2022
When a sentence does not introduce a discourse entity, Transformer-based
  models still sometimes refer to it
When a sentence does not introduce a discourse entity, Transformer-based models still sometimes refer to it
Sebastian Schuster
Tal Linzen
77
25
0
06 May 2022
Adaptable Adapters
Adaptable Adapters
N. Moosavi
Quentin Delfosse
Kristian Kersting
Iryna Gurevych
99
21
0
03 May 2022
SemAttack: Natural Textual Attacks via Different Semantic Spaces
SemAttack: Natural Textual Attacks via Different Semantic Spaces
Wei Ping
Chejian Xu
Xiangyu Liu
Yuk-Kit Cheng
Yue Liu
SILMAAML
119
53
0
03 May 2022
Visualizing and Explaining Language Models
Visualizing and Explaining Language Models
Adrian M. P. Braşoveanu
Razvan Andonie
MILMVLM
107
5
0
30 Apr 2022
AdapterBias: Parameter-efficient Token-dependent Representation Shift
  for Adapters in NLP Tasks
AdapterBias: Parameter-efficient Token-dependent Representation Shift for Adapters in NLP Tasks
Chin-Lun Fu
Zih-Ching Chen
Yun-Ru Lee
Hung-yi Lee
85
49
0
30 Apr 2022
UniTE: Unified Translation Evaluation
UniTE: Unified Translation Evaluation
Boyi Deng
Dayiheng Liu
Baosong Yang
Haibo Zhang
Boxing Chen
Derek F. Wong
Lidia S. Chao
94
41
0
28 Apr 2022
LyS_ACoruña at SemEval-2022 Task 10: Repurposing Off-the-Shelf Tools
  for Sentiment Analysis as Semantic Dependency Parsing
LyS_ACoruña at SemEval-2022 Task 10: Repurposing Off-the-Shelf Tools for Sentiment Analysis as Semantic Dependency Parsing
I. Alonso-Alonso
David Vilares
Carlos Gómez-Rodríguez
105
1
0
27 Apr 2022
Probing for the Usage of Grammatical Number
Probing for the Usage of Grammatical Number
Karim Lasri
Tiago Pimentel
Alessandro Lenci
Thierry Poibeau
Ryan Cotterell
80
58
0
19 Apr 2022
Mono vs Multilingual BERT for Hate Speech Detection and Text
  Classification: A Case Study in Marathi
Mono vs Multilingual BERT for Hate Speech Detection and Text Classification: A Case Study in Marathi
Abhishek Velankar
H. Patil
Raviraj Joshi
88
33
0
19 Apr 2022
CILDA: Contrastive Data Augmentation using Intermediate Layer Knowledge
  Distillation
CILDA: Contrastive Data Augmentation using Intermediate Layer Knowledge Distillation
Md. Akmal Haidar
Mehdi Rezagholizadeh
Abbas Ghaddar
Khalil Bibi
Philippe Langlais
Pascal Poupart
CLL
79
7
0
15 Apr 2022
Text Revision by On-the-Fly Representation Optimization
Text Revision by On-the-Fly Representation Optimization
Jingjing Li
Zichao Li
Tao Ge
Irwin King
Michael R. Lyu
BDL
88
18
0
15 Apr 2022
MVSTER: Epipolar Transformer for Efficient Multi-View Stereo
MVSTER: Epipolar Transformer for Efficient Multi-View Stereo
Xiaofen Wang
Zheng Hua Zhu
Fangbo Qin
Yun Ye
Guan Huang
Xu Chi
Yijia He
Xingang Wang
119
83
0
15 Apr 2022
Probing for Constituency Structure in Neural Language Models
Probing for Constituency Structure in Neural Language Models
David Arps
Younes Samih
Laura Kallmeyer
Hassan Sajjad
57
14
0
13 Apr 2022
A Review on Language Models as Knowledge Bases
A Review on Language Models as Knowledge Bases
Badr AlKhamissi
Millicent Li
Asli Celikyilmaz
Mona T. Diab
Marjan Ghazvininejad
KELM
103
187
0
12 Apr 2022
Classification of Natural Language Processing Techniques for
  Requirements Engineering
Classification of Natural Language Processing Techniques for Requirements Engineering
Liping Zhao
Waad Alhoshan
Alessio Ferrari
Keletso J. Letsholo
VLMAI4TS
70
10
0
08 Apr 2022
Pretraining Text Encoders with Adversarial Mixture of Training Signal
  Generators
Pretraining Text Encoders with Adversarial Mixture of Training Signal Generators
Yu Meng
Chenyan Xiong
Payal Bajaj
Saurabh Tiwary
Paul N. Bennett
Jiawei Han
Xia Song
MoE
78
16
0
07 Apr 2022
End-to-End Instance Edge Detection
End-to-End Instance Edge Detection
Xueyan Zou
Haotian Liu
Yong Jae Lee
68
2
0
06 Apr 2022
An Exploratory Study on Code Attention in BERT
An Exploratory Study on Code Attention in BERT
Rishab Sharma
Fuxiang Chen
Fatemeh H. Fard
David Lo
77
27
0
05 Apr 2022
Design considerations for a hierarchical semantic compositional
  framework for medical natural language understanding
Design considerations for a hierarchical semantic compositional framework for medical natural language understanding
R. Taira
A. Garlid
W. Speier
30
1
0
05 Apr 2022
Socratic Models: Composing Zero-Shot Multimodal Reasoning with Language
Socratic Models: Composing Zero-Shot Multimodal Reasoning with Language
Andy Zeng
Maria Attarian
Brian Ichter
K. Choromanski
Adrian S. Wong
...
Michael S. Ryoo
Vikas Sindhwani
Johnny Lee
Vincent Vanhoucke
Peter R. Florence
ReLMLRM
166
589
0
01 Apr 2022
Previous
123...8910...151617
Next