XLNet: Generalized Autoregressive Pretraining for Language Understanding

19 June 2019

Papers citing "XLNet: Generalized Autoregressive Pretraining for Language Understanding"

50 / 1,335 papers shown

Title
Elementwise Language Representation Du-Yeong Kim Jeeeun Kim 36 0 0 27 Feb 2023
HULAT at SemEval-2023 Task 10: Data augmentation for pre-trained transformers applied to the detection of sexism in social media Isabel Segura-Bedmar ViT 37 1 0 24 Feb 2023
Hiding Data Helps: On the Benefits of Masking for Sparse Coding Muthuraman Chidambaram Chenwei Wu Yu Cheng Rong Ge 29 0 0 24 Feb 2023
VoxSRC 2022: The Fourth VoxCeleb Speaker Recognition Challenge Jaesung Huh A. Brown Jee-weon Jung Joon Son Chung Arsha Nagrani D. Garcia-Romero Andrew Zisserman 23 26 0 20 Feb 2023
Cluster-based Deep Ensemble Learning for Emotion Classification in Internet Memes Xiaoyu Guo Jing Ma A. Zubiaga 35 0 0 16 Feb 2023
Platform-Independent and Curriculum-Oriented Intelligent Assistant for Higher Education Ramteja Sajja Y. Sermet David M. Cwiertny Ibrahim Demir 30 62 0 15 Feb 2023
An Extended Sequence Tagging Vocabulary for Grammatical Error Correction Stuart Mesham Christopher Bryant Marek Rei Zheng Yuan 35 7 0 12 Feb 2023
TextDefense: Adversarial Text Detection based on Word Importance Entropy Lujia Shen Xuhong Zhang S. Ji Yuwen Pu Chunpeng Ge Xing Yang Yanghe Feng AAML 20 8 0 12 Feb 2023
A Reparameterized Discrete Diffusion Model for Text Generation Lin Zheng Jianbo Yuan Lei Yu Lingpeng Kong DiffM 41 57 0 11 Feb 2023
Zero-Shot Learning for Requirements Classification: An Exploratory Study Waad Alhoshan Alessio Ferrari Liping Zhao VLM 9 39 0 09 Feb 2023
Revisiting Offline Compression: Going Beyond Factorization-based Methods for Transformer Language Models Mohammadreza Banaei Klaudia Bałazy Artur Kasymov R. Lebret Jacek Tabor Karl Aberer OffRL 21 0 0 08 Feb 2023
Findings of the TSAR-2022 Shared Task on Multilingual Lexical Simplification Horacio Saggion S. vStajner Daniel Ferrés Kim Cheng Sheang Matthew Shardlow Kai North Marcos Zampieri 27 49 0 06 Feb 2023
Bioformer: an efficient transformer language model for biomedical text mining Li Fang Qingyu Chen Chih-Hsuan Wei Zhiyong Lu Kai Wang MedIm AI4CE 32 18 0 03 Feb 2023
Detecting Reddit Users with Depression Using a Hybrid Neural Network SBERT-CNN Ziyi Chen Ren Yang S. Fu Nansu Zong Hongfang Liu Ming Huang AI4MH 18 14 0 03 Feb 2023
A Survey of Deep Learning: From Activations to Transformers Johannes Schneider Michalis Vlachos ViT MedIm AI4TS AI4CE 50 10 0 01 Feb 2023
Towards Personalized Review Summarization by Modeling Historical Reviews from Customer and Product Separately Xin Cheng Shen Gao Yuchi Zhang Yongliang Wang Xiuying Chen Mingzhe Li Dongyan Zhao Rui Yan 29 10 0 27 Jan 2023
Open Problems in Applied Deep Learning M. Raissi AI4CE 42 2 0 26 Jan 2023
Characterizing the Entities in Harmful Memes: Who is the Hero, the Villain, the Victim? Shivam Sharma Atharva Kulkarni Tharun Suresh Himanshi Mathur Preslav Nakov Md. Shad Akhtar Tanmoy Chakraborty 38 15 0 26 Jan 2023
A benchmark for toxic comment classification on Civil Comments dataset Corentin Duchene Henri Jamet Pierre Guillaume Reda Dehak 27 8 0 26 Jan 2023
Out of Distribution Performance of State of Art Vision Model Salman Rahman W. Lee 40 2 0 25 Jan 2023
BDMMT: Backdoor Sample Detection for Language Models through Model Mutation Testing Jiali Wei Ming Fan Wenjing Jiao Wuxia Jin Ting Liu AAML 29 11 0 25 Jan 2023
SPEC5G: A Dataset for 5G Cellular Network Protocol Analysis Imtiaz Karim Kazi Samin Mubasshir Mirza Masfiqur Rahman Elisa Bertino 19 22 0 22 Jan 2023
REDAffectiveLM: Leveraging Affect Enriched Embedding and Transformer-based Neural Language Model for Readers' Emotion Detection Anoop Kadan Deepak P Manjary P.Gangan Savitha Sam Abraham L. LajishV. 21 1 0 21 Jan 2023
Ankh: Optimized Protein Language Model Unlocks General-Purpose Modelling Ahmed Elnaggar Hazem Essam Wafaa Salah-Eldin Walid Moustafa Mohamed Elkerdawy Charlotte Rochereau B. Rost 167 87 0 16 Jan 2023
Hawk: An Industrial-strength Multi-label Document Classifier Arshad Javeed 42 1 0 15 Jan 2023
Everyone's Voice Matters: Quantifying Annotation Disagreement Using Demographic Information Ruyuan Wan Jaehyung Kim Dongyeop Kang 17 36 0 12 Jan 2023
Topics in Contextualised Attention Embeddings Mozhgan Talebpour A. G. S. D. Herrera Shoaib Jameel 34 2 0 11 Jan 2023
CHRONOS: Time-Aware Zero-Shot Identification of Libraries from Vulnerability Reports Yu-zeng Lyu Thanh Le-Cong Hong Jin Kang Ratnadira Widyasari Zhipeng Zhao X. Le Ming Li David Lo 29 16 0 10 Jan 2023
Understanding the Complexity and Its Impact on Testing in ML-Enabled Systems Junming Cao Bihuan Chen Longjie Hu Jie Ying Gao Kaifeng Huang Xin Peng 26 3 0 10 Jan 2023
Does compressing activations help model parallel training? S. Bian Dacheng Li Hongyi Wang Eric P. Xing Shivaram Venkataraman 19 5 0 06 Jan 2023
Parameter-Efficient Fine-Tuning Design Spaces Jiaao Chen Aston Zhang Xingjian Shi Mu Li Alexander J. Smola Diyi Yang 42 59 0 04 Jan 2023
PIE-QG: Paraphrased Information Extraction for Unsupervised Question Generation from Small Corpora D. Nagumothu B. Ofoghi G. Huang Peter W. Eklund RALM 16 5 0 03 Jan 2023
Semi-Structured Object Sequence Encoders V. Rudramurthy Riyaz Ahmad Bhat Chulaka Gunasekara Siva Sankalp Patel H. Wan Tejas I. Dhamecha Danish Contractor Marina Danilevsky 61 0 0 03 Jan 2023
Relevance Classification of Flood-related Twitter Posts via Multiple Transformers Wisal Mukhtiar Waliiya Rizwan A. Habib Y. Afridi Laiq Hasan Kashif Ahmad 11 3 0 01 Jan 2023
Relational Local Explanations V. Borisov Gjergji Kasneci FAtt 22 0 0 23 Dec 2022
Text classification in shipping industry using unsupervised models and Transformer based supervised models Yingyi Xie Dongping Song 31 1 0 21 Dec 2022
A Length-Extrapolatable Transformer Yutao Sun Li Dong Barun Patra Shuming Ma Shaohan Huang Alon Benhaim Vishrav Chaudhary Xia Song Furu Wei 30 115 0 20 Dec 2022
Is GPT-3 a Good Data Annotator? Bosheng Ding Chengwei Qin Linlin Liu Yew Ken Chia Chenyu You Boyang Albert Li Lidong Bing 26 233 0 20 Dec 2022
GanLM: Encoder-Decoder Pre-training with an Auxiliary Discriminator Jian Yang Shuming Ma Li Dong Shaohan Huang Haoyang Huang Yuwei Yin Dongdong Zhang Liqun Yang Furu Wei Zhoujun Li SyDa AI4CE 32 25 0 20 Dec 2022
DIONYSUS: A Pre-trained Model for Low-Resource Dialogue Summarization Yu Li Baolin Peng Pengcheng He Michel Galley Zhou Yu Jianfeng Gao 24 7 0 20 Dec 2022
Memory-efficient NLLB-200: Language-specific Expert Pruning of a Massively Multilingual Machine Translation Model Yeskendir Koishekenov Alexandre Berard Vassilina Nikoulina MoE 35 29 0 19 Dec 2022
Injecting Domain Knowledge in Language Models for Task-Oriented Dialogue Systems Denis Emelin Daniele Bonadiman Sawsan Alqahtani Yi Zhang Saab Mansour 20 17 0 15 Dec 2022
The Effects of In-domain Corpus Size on pre-training BERT Chris Sanchez Zheyu Zhang AI4CE 16 4 0 15 Dec 2022
Towards mapping the contemporary art world with ArtLM: an art-specific NLP model Qinkai Chen Mohamed El-Mennaoui Antoine Fosset Amine Rebei Haoyang Cao Philine Bouscasse Christy Eóin O'Beirne Sasha Shevchenko Mathieu Rosenbaum KELM 19 1 0 14 Dec 2022
Paraphrase Identification with Deep Learning: A Review of Datasets and Methods Chao Zhou Cheng Qiu Daniel Ernesto Acuna 32 25 0 13 Dec 2022
Automated ICD Coding using Extreme Multi-label Long Text Transformer-based Models Leibo Liu O. Perez-Concha Anthony N. Nguyen Vicki Bennett Louisa R Jorm 38 18 0 12 Dec 2022
Ensembling Transformers for Cross-domain Automatic Term Extraction T. Hanh Matej Martinc Andraz Pelicon Antoine Doucet Senja Pollak 19 5 0 12 Dec 2022
Position Embedding Needs an Independent Layer Normalization Runyi Yu Zhennan Wang Yinhuai Wang Kehan Li Yian Zhao Jian Zhang Guoli Song Jie Chen 31 1 0 10 Dec 2022
All-to-key Attention for Arbitrary Style Transfer Mingrui Zhu Xiao He N. Wang Xiaoyu Wang Xinbo Gao 31 22 0 08 Dec 2022
QBERT: Generalist Model for Processing Questions Zhaozhen Xu N. Cristianini 22 1 0 05 Dec 2022