XLNet: Generalized Autoregressive Pretraining for Language Understanding

19 June 2019

Papers citing "XLNet: Generalized Autoregressive Pretraining for Language Understanding"

50 / 1,444 papers shown

Title
Quantitative Argument Summarization and Beyond: Cross-Domain Key Point Analysis Roy Bar-Haim Yoav Kantor Lilach Eden Roni Friedman Dan Lahav Noam Slonim 32 43 0 11 Oct 2020
SMYRF: Efficient Attention using Asymmetric Clustering Giannis Daras Nikita Kitaev Augustus Odena A. Dimakis 31 44 0 11 Oct 2020
SJTU-NICT's Supervised and Unsupervised Neural Machine Translation Systems for the WMT20 News Translation Task Z. Li Hai Zhao Rui Wang Kehai Chen Masao Utiyama Eiichiro Sumita 36 15 0 11 Oct 2020
Contrastive Representation Learning: A Framework and Review Phúc H. Lê Khắc Graham Healy Alan F. Smeaton SSL AI4TS 184 687 0 10 Oct 2020
On the Importance of Adaptive Data Collection for Extremely Imbalanced Pairwise Tasks Stephen Mussmann Robin Jia Percy Liang 29 15 0 10 Oct 2020
Automated Concatenation of Embeddings for Structured Prediction Xinyu Wang Yong-jia Jiang Nguyen Bach Tao Wang Zhongqiang Huang Fei Huang Kewei Tu 35 172 0 10 Oct 2020
What Do Position Embeddings Learn? An Empirical Study of Pre-Trained Language Model Positional Encoding Yu-An Wang Yun-Nung Chen SSL 10 94 0 10 Oct 2020
Infusing Disease Knowledge into BERT for Health Question Answering, Medical Inference and Disease Name Recognition Yun He Ziwei Zhu Yin Zhang Qin Chen James Caverlee AI4MH 36 108 0 08 Oct 2020
A Mathematical Exploration of Why Language Models Help Solve Downstream Tasks Nikunj Saunshi Sadhika Malladi Sanjeev Arora 25 87 0 07 Oct 2020
What Can We Learn from Collective Human Opinions on Natural Language Inference Data? Yixin Nie Xiang Zhou Joey Tianyi Zhou 29 129 0 07 Oct 2020
Poison Attacks against Text Datasets with Conditional Adversarially Regularized Autoencoder Alvin Chan Yi Tay Yew-Soon Ong Aston Zhang SILM 23 56 0 06 Oct 2020
How Effective is Task-Agnostic Data Augmentation for Pretrained Transformers? Shayne Longpre Yu Wang Christopher DuBois ViT 19 83 0 05 Oct 2020
Effective Unsupervised Domain Adaptation with Adversarially Trained Language Models Thuy-Trang Vu Dinh Q. Phung Gholamreza Haffari 19 24 0 05 Oct 2020
On Losses for Modern Language Models Stephane Aroca-Ouellette Frank Rudzicz 22 32 0 04 Oct 2020
Tell Me How to Ask Again: Question Data Augmentation with Controllable Rewriting in Continuous Space Dayiheng Liu Yeyun Gong Jie Fu Yu Yan Jiusheng Chen Jiancheng Lv Nan Duan M. Zhou 15 37 0 04 Oct 2020
LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attention Ikuya Yamada Akari Asai Hiroyuki Shindo Hideaki Takeda Yuji Matsumoto 26 662 0 02 Oct 2020
Data Transfer Approaches to Improve Seq-to-Seq Retrosynthesis Katsuhiko Ishiguro K. Ujihara R. Sawada Hirotaka Akita Masaaki Kotera 32 6 0 02 Oct 2020
Near-imperceptible Neural Linguistic Steganography via Self-Adjusting Arithmetic Coding Jiaming Shen Heng Ji Jiawei Han 21 33 0 01 Oct 2020
CoLAKE: Contextualized Language and Knowledge Embedding Tianxiang Sun Yunfan Shao Xipeng Qiu Qipeng Guo Yaru Hu Xuanjing Huang Zheng-Wei Zhang KELM 33 181 0 01 Oct 2020
Phonemer at WNUT-2020 Task 2: Sequence Classification Using COVID Twitter BERT and Bagging Ensemble Technique based on Plurality Voting Anshul Wadhawan 24 7 0 01 Oct 2020
Examining the rhetorical capacities of neural language models Zining Zhu Chuer Pan Mohamed Abdalla Frank Rudzicz 36 10 0 01 Oct 2020
Utterance-level Dialogue Understanding: An Empirical Study Deepanway Ghosal Navonil Majumder Rada Mihalcea Soujanya Poria 27 23 0 29 Sep 2020
A Simple but Tough-to-Beat Data Augmentation Approach for Natural Language Understanding and Generation Dinghan Shen Ming Zheng Yelong Shen Yanru Qu Weizhu Chen AAML 29 130 0 29 Sep 2020
Improve Transformer Models with Better Relative Position Embeddings Zhiheng Huang Davis Liang Peng Xu Bing Xiang ViT 26 127 0 28 Sep 2020
RecoBERT: A Catalog Language Model for Text-Based Recommendations Itzik Malkiel Oren Barkan Avi Caciularu Noam Razin Ori Katz Noam Koenigstein 14 13 0 25 Sep 2020
No Answer is Better Than Wrong Answer: A Reflection Model for Document Level Machine Reading Comprehension Xuguang Wang Linjun Shou Ming Gong Nan Duan Daxin Jiang 24 12 0 25 Sep 2020
Global-to-Local Neural Networks for Document-Level Relation Extraction D. Wang Wei Hu E. Cao Weijian Sun NAI 18 118 0 22 Sep 2020
The birth of Romanian BERT Stefan Daniel Dumitrescu Andrei-Marius Avram S. Pyysalo VLM 8 76 0 18 Sep 2020
Self-Supervised Meta-Learning for Few-Shot Natural Language Classification Tasks Trapit Bansal Rishikesh Jha Tsendsuren Munkhdalai Andrew McCallum SSL VLM 30 87 0 17 Sep 2020
GraphCodeBERT: Pre-training Code Representations with Data Flow Daya Guo Shuo Ren Shuai Lu Zhangyin Feng Duyu Tang ... Dawn Drain Neel Sundaresan Jian Yin Daxin Jiang M. Zhou 88 1,094 0 17 Sep 2020
Code-switching pre-training for neural machine translation Zhen Yang Bojie Hu Ambyera Han Shen Huang Qi Ju 27 71 0 17 Sep 2020
Efficient Transformer-based Large Scale Language Representations using Hardware-friendly Block Structured Pruning Bingbing Li Zhenglun Kong Tianyun Zhang Ji Li ZeLin Li Hang Liu Caiwen Ding VLM 32 64 0 17 Sep 2020
Reasoning about Goals, Steps, and Temporal Ordering with WikiHow Li Zhang Qing Lyu Chris Callison-Burch ReLM LRM 32 85 0 16 Sep 2020
Multi-span Style Extraction for Generative Reading Comprehension Junjie Yang ZhuoSheng Zhang Hai Zhao SyDa 19 14 0 15 Sep 2020
Augmented Natural Language for Generative Sequence Labeling Ben Athiwaratkun Cicero Nogueira dos Santos Jason Krone Bing Xiang VLM 19 61 0 15 Sep 2020
BERT-QE: Contextualized Query Expansion for Document Re-ranking Zhi Zheng Kai Hui Xianpei Han Xianpei Han Le Sun Andrew Yates 27 93 0 15 Sep 2020
It's Not Just Size That Matters: Small Language Models Are Also Few-Shot Learners Timo Schick Hinrich Schütze 51 956 0 15 Sep 2020
MLMLM: Link Prediction with Mean Likelihood Masked Language Model Louis Clouâtre P. Trempe Amal Zouaq Sarath Chandar 25 43 0 15 Sep 2020
Learning an Effective Context-Response Matching Model with Self-Supervised Tasks for Retrieval-based Dialogues Ruijian Xu Chongyang Tao Daxin Jiang Xueliang Zhao Dongyan Zhao Rui Yan 29 70 0 14 Sep 2020
On Robustness and Bias Analysis of BERT-based Relation Extraction Luoqiu Li Xiang Chen Hongbin Ye Zhen Bi Shumin Deng Ningyu Zhang Huajun Chen 32 18 0 14 Sep 2020
Rank over Class: The Untapped Potential of Ranking in Natural Language Processing Amir Atapour-Abarghouei Stephen Bonner A. Mcgough 10 4 0 10 Sep 2020
Investigating Gender Bias in BERT Rishabh Bhardwaj Navonil Majumder Soujanya Poria 33 106 0 10 Sep 2020
Probabilistic Predictions of People Perusing: Evaluating Metrics of Language Model Performance for Psycholinguistic Modeling Sophie Hao S. Mendelsohn Rachel Sterneck Randi Martinez Robert Frank 19 46 0 08 Sep 2020
Adversarial Watermarking Transformer: Towards Tracing Text Provenance with Data Hiding Sahar Abdelnabi Mario Fritz WaLM 28 44 0 07 Sep 2020
A Comparison of Pre-trained Vision-and-Language Models for Multimodal Representation Learning across Medical Images and Reports Yikuan Li Hanyin Wang Yuan Luo 19 63 0 03 Sep 2020
ASTRAL: Adversarial Trained LSTM-CNN for Named Entity Recognition Jiuniu Wang Wenjia Xu Xingyu Fu Guangluan Xu Yirong Wu 27 57 0 02 Sep 2020
Zero-Resource Knowledge-Grounded Dialogue Generation Linxiao Li Can Xu Wei Wu Yufan Zhao Xueliang Zhao Chongyang Tao 36 70 0 29 Aug 2020
A Survey of Evaluation Metrics Used for NLG Systems Ananya B. Sai Akash Kumar Mohankumar Mitesh M. Khapra ELM 33 230 0 27 Aug 2020
Conceptualized Representation Learning for Chinese Biomedical Text Mining Ningyu Zhang Qianghuai Jia Kangping Yin Liang Dong Feng Gao Nengwei Hua OOD 42 65 0 25 Aug 2020
Hybrid Ranking Network for Text-to-SQL Qin Lyu K. Chakrabarti Shobhit Hathi Souvik Kundu Jianwen Zhang Zheng Chen AIMat 22 83 0 11 Aug 2020