XLNet: Generalized Autoregressive Pretraining for Language Understanding

19 June 2019

Papers citing "XLNet: Generalized Autoregressive Pretraining for Language Understanding"

50 / 1,487 papers shown

Title
DOBF: A Deobfuscation Pre-Training Objective for Programming Languages Baptiste Roziere Marie-Anne Lachaux Marc Szafraniec Guillaume Lample AI4CE 52 138 0 15 Feb 2021
Improved Bengali Image Captioning via deep convolutional neural network based encoder-decoder model Mohammad Faiyaz Khan S. M. S. Shifath Md. Saiful Islam VLM 35 18 0 14 Feb 2021
CATE: Computation-aware Neural Architecture Encoding with Transformers Shen Yan Kaiqiang Song Z. Feng Mi Zhang 24 24 0 14 Feb 2021
Less is More: ClipBERT for Video-and-Language Learning via Sparse Sampling Jie Lei Linjie Li Luowei Zhou Zhe Gan Tamara L. Berg Joey Tianyi Zhou Jingjing Liu CLIP 46 648 0 11 Feb 2021
Multi-turn Dialogue Reading Comprehension with Pivot Turns and Knowledge Zhuosheng Zhang Junlong Li Hai Zhao 40 23 0 10 Feb 2021
Bias Out-of-the-Box: An Empirical Analysis of Intersectional Occupational Biases in Popular Generative Language Models Hannah Rose Kirk Yennie Jun Haider Iqbal Elias Benussi Filippo Volpin F. Dreyer Aleksandar Shtedritski Yuki M. Asano 22 181 0 08 Feb 2021
Unifying Vision-and-Language Tasks via Text Generation Jaemin Cho Jie Lei Hao Tan Joey Tianyi Zhou MLLM 277 525 0 04 Feb 2021
Generating images from caption and vice versa via CLIP-Guided Generative Latent Space Search Federico A. Galatolo M. G. Cimino G. Vaglini VLM 45 85 0 02 Feb 2021
Decoupling the Role of Data, Attention, and Losses in Multimodal Transformers Lisa Anne Hendricks John F. J. Mellor R. Schneider Jean-Baptiste Alayrac Aida Nematzadeh 79 110 0 31 Jan 2021
Combining pre-trained language models and structured knowledge Pedro Colon-Hernandez Catherine Havasi Jason B. Alonso Matthew Huggins C. Breazeal KELM 43 48 0 28 Jan 2021
A transformer based approach for fighting COVID-19 fake news S. M. S. Shifath Mohammad Faiyaz Khan Md. Saiful Islam MedIm 34 23 0 28 Jan 2021
Identifying COVID-19 Fake News in Social Media Tathagata Raha Vijayasaradhi Indurthi Aayush Upadhyaya Jeevesh Kataria Pramud Bommakanti Vikram Keswani Vasudeva Varma GNN MedIm 25 12 0 28 Jan 2021
Muppet: Massive Multi-task Representations with Pre-Finetuning Armen Aghajanyan Anchit Gupta Akshat Shrivastava Xilun Chen Luke Zettlemoyer Sonal Gupta 33 266 0 26 Jan 2021
Enhanced word embeddings using multi-semantic representation through lexical chains Terry Ruas C. H. P. Ferreira W. Grosky F. O. França D. D. Medeiros 20 18 0 22 Jan 2021
Open-Domain Conversational Search Assistant with Transformers Rafael Ferreira Mariana Leite David Semedo João Magalhães 16 11 0 20 Jan 2021
SUGAR: Subgraph Neural Network with Reinforcement Pooling and Self-Supervised Mutual Information Mechanism Qingyun Sun Jianxin Li Hao Peng Jia Wu Yuanxing Ning Phillip S. Yu Lifang He 26 162 0 20 Jan 2021
Learning to Augment for Data-Scarce Domain BERT Knowledge Distillation Lingyun Feng Minghui Qiu Yaliang Li Haitao Zheng Ying Shen 46 10 0 20 Jan 2021
Efficiently Fusing Pretrained Acoustic and Linguistic Encoders for Low-resource Speech Recognition Cheng Yi Shiyu Zhou Bo Xu 51 40 0 17 Jan 2021
LIME: Learning Inductive Bias for Primitives of Mathematical Reasoning Yuhuai Wu M. Rabe Wenda Li Jimmy Ba Roger C. Grosse Christian Szegedy AIMat LRM 82 53 0 15 Jan 2021
Fake News Detection System using XLNet model with Topic Distributions: CONSTRAINT@AAAI2021 Shared Task Akansha Gautam Venktesh V Sarah Masud 10 32 0 12 Jan 2021
Of Non-Linearity and Commutativity in BERT Sumu Zhao Damian Pascual Gino Brunner Roger Wattenhofer 36 16 0 12 Jan 2021
Robustness of on-device Models: Adversarial Attack to Deep Learning Models on Android Apps Yujin Huang Han Hu Chunyang Chen AAML FedML 79 33 0 12 Jan 2021
Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity W. Fedus Barret Zoph Noam M. Shazeer MoE 11 2,087 0 11 Jan 2021
Cisco at AAAI-CAD21 shared task: Predicting Emphasis in Presentation Slides using Contextualized Embeddings Sreyan Ghosh Sonal Kumar H. Jalan Hemant Yadav R. Shah 39 2 0 10 Jan 2021
LightXML: Transformer with Dynamic Negative Sampling for High-Performance Extreme Multi-label Text Classification Ting Jiang Deqing Wang Leilei Sun Huayi Yang Zhengyang Zhao Fuzhen Zhuang VLM 128 136 0 09 Jan 2021
Simplified DOM Trees for Transferable Attribute Extraction from the Web Yichao Zhou Ying Sheng N. Vo Nick Edmonds Sandeep Tata 127 28 0 07 Jan 2021
TextBox: A Unified, Modularized, and Extensible Framework for Text Generation Junyi Li Tianyi Tang Gaole He Jinhao Jiang Xiaoxuan Hu Puzhao Xie Zhipeng Chen Zhuohao Yu Wayne Xin Zhao Ji-Rong Wen 37 25 0 06 Jan 2021
I-BERT: Integer-only BERT Quantization Sehoon Kim A. Gholami Z. Yao Michael W. Mahoney Kurt Keutzer MQ 107 345 0 05 Jan 2021
Retrieving and Reading: A Comprehensive Survey on Open-domain Question Answering Fengbin Zhu Wenqiang Lei Chao Wang Jianming Zheng Soujanya Poria Tat-Seng Chua RALM 222 253 0 04 Jan 2021
Few-Shot Question Answering by Pretraining Span Selection Ori Ram Yuval Kirstain Jonathan Berant Amir Globerson Omer Levy 36 97 0 02 Jan 2021
Improving Sequence-to-Sequence Pre-training via Sequence Span Rewriting Wangchunshu Zhou Tao Ge Canwen Xu Ke Xu Furu Wei LRM 16 15 0 02 Jan 2021
End-to-end Semantic Role Labeling with Neural Transition-based Model Hao Fei Meishan Zhang Bobo Li Donghong Ji OffRL 21 36 0 02 Jan 2021
Learning to Emphasize: Dataset and Shared Task Models for Selecting Emphasis in Presentation Slides Amirreza Shirani Gia-Lac Tran Hieu Trinh Franck Dernoncourt Nedim Lipka P. Asente J. Echevarria Thamar Solorio 190 1 0 02 Jan 2021
Transformer based Automatic COVID-19 Fake News Detection System Sunil Gundapu R. Mamidi 32 70 0 01 Jan 2021
How Do Your Biomedical Named Entity Recognition Models Generalize to Novel Entities? Hyunjae Kim Jaewoo Kang AI4CE 94 21 0 01 Jan 2021
MiniLMv2: Multi-Head Self-Attention Relation Distillation for Compressing Pretrained Transformers Wenhui Wang Hangbo Bao Shaohan Huang Li Dong Furu Wei MQ 30 257 0 31 Dec 2020
ERNIE-Doc: A Retrospective Long-Document Modeling Transformer Siyu Ding Junyuan Shang Shuohuan Wang Yu Sun Hao Tian Hua Wu Haifeng Wang 73 53 0 31 Dec 2020
XLM-T: Scaling up Multilingual Machine Translation with Pretrained Cross-lingual Transformer Encoders Shuming Ma Jian Yang Haoyang Huang Zewen Chi Li Dong ... Akiko Eriguchi Saksham Singhal Xia Song Arul Menezes Furu Wei LRM 26 33 0 31 Dec 2020
CLEAR: Contrastive Learning for Sentence Representation Zhuofeng Wu Sinong Wang Jiatao Gu Madian Khabsa Fei Sun Hao Ma SSL 33 320 0 31 Dec 2020
Optimizing Deeper Transformers on Small Datasets Peng Xu Dhruv Kumar Wei Yang Wenjie Zi Keyi Tang Chenyang Huang Jackie C.K. Cheung S. Prince Yanshuai Cao AI4CE 24 69 0 30 Dec 2020
DynaSent: A Dynamic Benchmark for Sentiment Analysis Christopher Potts Zhengxuan Wu Atticus Geiger Douwe Kiela 230 77 0 30 Dec 2020
ERICA: Improving Entity and Relation Understanding for Pre-trained Language Models via Contrastive Learning Yujia Qin Yankai Lin Ryuichi Takanobu Zhiyuan Liu Peng Li Heng Ji Minlie Huang Maosong Sun Jie Zhou 60 125 0 30 Dec 2020
RADDLE: An Evaluation Benchmark and Analysis Platform for Robust Task-oriented Dialog Systems Baolin Peng Chunyuan Li Zhu Zhang Chenguang Zhu Jinchao Li Jianfeng Gao 21 49 0 29 Dec 2020
Universal Sentence Representation Learning with Conditional Masked Language Model Ziyi Yang Yinfei Yang Daniel Cer Jax Law Eric F. Darve SSL 24 57 0 28 Dec 2020
DeepHateExplainer: Explainable Hate Speech Detection in Under-resourced Bengali Language Md. Rezaul Karim Sumon Dey Tanhim Islam Sagor Sarker Mehadi Hasan Menon Kabir Hossain Bharathi Raja Chakravarthi Md. Azam Hossain Stefan Decker 30 77 0 28 Dec 2020
SG-Net: Syntax Guided Transformer for Language Representation Zhuosheng Zhang Yuwei Wu Junru Zhou Sufeng Duan Hai Zhao Rui Wang 51 36 0 27 Dec 2020
LOREN: Logic-Regularized Reasoning for Interpretable Fact Verification Jiangjie Chen Qiaoben Bao Changzhi Sun Xinbo Zhang Jiaze Chen Hao Zhou Yanghua Xiao Lei Li LRM 57 31 0 25 Dec 2020
Leveraging GPT-2 for Classifying Spam Reviews with Limited Labeled Data via Adversarial Training Athirai Aravazhi Irissappane Hanfei Yu Yankun Shen Anubha Agrawal Gray Stanton 19 9 0 24 Dec 2020
Co-GAT: A Co-Interactive Graph Attention Network for Joint Dialog Act Recognition and Sentiment Classification Libo Qin Zhouyang Li Wanxiang Che Minheng Ni Ting Liu 39 65 0 24 Dec 2020
Exploring Fluent Query Reformulations with Text-to-Text Transformers and Reinforcement Learning Jerry Zikun Chen S. Yu Haoran Wang 232 5 0 18 Dec 2020