ALBERT: A Lite BERT for Self-supervised Learning of Language Representations

26 September 2019

Papers citing "ALBERT: A Lite BERT for Self-supervised Learning of Language Representations"

50 / 2,913 papers shown

Title
Transformer-Based Models for Automatic Identification of Argument Relations: A Cross-Domain Evaluation Ramon Ruiz-Dolz S. H. Barberá José Alemany A. García-Fornes 6 34 0 26 Nov 2020
Learning to Expand: Reinforced Pseudo-relevance Feedback Selection for Information-seeking Conversations Haojie Pan Cen Chen Chengyu Wang Minghui Qiu Liu Yang Feng Ji Jun Huang 17 4 0 25 Nov 2020
mForms : Multimodal Form-Filling with Question Answering Larry Heck S. Heck Anirudh S. Sundar 64 6 0 24 Nov 2020
Self-supervised transfer learning of physiological representations from free-living wearable data Dimitris Spathis I. Perez-Pozuelo S. Brage N. Wareham Cecilia Mascolo 23 40 0 18 Nov 2020
EasyTransfer -- A Simple and Scalable Deep Transfer Learning Platform for NLP Applications Minghui Qiu Peng Li Chengyu Wang Hanjie Pan Yaliang Li ... Jun Yang Yaliang Li Jun Huang Deng Cai Wei Lin VLM SyDa 39 20 0 18 Nov 2020
On the Transferability of Adversarial Attacksagainst Neural Text Classifier Liping Yuan Xiaoqing Zheng Yi Zhou Cho-Jui Hsieh Kai-Wei Chang SILM AAML 19 26 0 17 Nov 2020
MVP-BERT: Redesigning Vocabularies for Chinese BERT and Multi-Vocab Pretraining Wei-wei Zhu VLM 16 6 0 17 Nov 2020
Unsupervised Explanation Generation for Machine Reading Comprehension Yiming Cui Ting Liu Shijin Wang Guoping Hu LRM 21 3 0 13 Nov 2020
Hurricane Forecasting: A Novel Multimodal Machine Learning Framework L. Boussioux C. Zeng Théo Guénais Dimitris Bertsimas 18 38 0 11 Nov 2020
Don't Read Too Much into It: Adaptive Computation for Open-Domain Question Answering Yuxiang Wu Sebastian Riedel Pasquale Minervini Pontus Stenetorp 30 8 0 10 Nov 2020
Multimodal Pretraining for Dense Video Captioning Gabriel Huang Bo Pang Zhenhai Zhu Clara E. Rivera Radu Soricut 21 81 0 10 Nov 2020
Towards Preemptive Detection of Depression and Anxiety in Twitter David Owen Jose Camacho-Collados Luis Espinosa-Anke 12 24 0 10 Nov 2020
Natural Language Inference in Context -- Investigating Contextual Reasoning over Long Texts Hanmeng Liu Leyang Cui Jian Liu Yue Zhang ReLM LRM 33 42 0 10 Nov 2020
Multi-document Summarization via Deep Learning Techniques: A Survey Congbo Ma W. Zhang Mingyu Guo Hu Wang Quan Z. Sheng 18 126 0 10 Nov 2020
Learning Generalizable Physiological Representations from Large-scale Wearable Data Dimitris Spathis I. Perez-Pozuelo S. Brage N. Wareham Cecilia Mascolo SSL AI4TS 17 7 0 09 Nov 2020
Towards Domain-Agnostic Contrastive Learning Vikas Verma Minh-Thang Luong Kenji Kawaguchi Hieu H. Pham Quoc V. Le SSL 15 116 0 09 Nov 2020
Know What You Don't Need: Single-Shot Meta-Pruning for Attention Heads Zhengyan Zhang Fanchao Qi Zhiyuan Liu Qun Liu Maosong Sun VLM 46 30 0 07 Nov 2020
Underspecification Presents Challenges for Credibility in Modern Machine Learning Alexander DÁmour Katherine A. Heller D. Moldovan Ben Adlam B. Alipanahi ... Kellie Webster Steve Yadlowsky T. Yun Xiaohua Zhai D. Sculley OffRL 77 671 0 06 Nov 2020
Improving Machine Reading Comprehension with Single-choice Decision and Transfer Learning Yufan Jiang Shuangzhi Wu Jing Gong Yahui Cheng Peng Meng Weiliang Lin Zhibo Chen Mu Li FaML 24 11 0 06 Nov 2020
Alquist 3.0: Alexa Prize Bot Using Conversational Knowledge Graph Jan Pichl Petro Marek Jakub Konrád Petr Lorenc Van Duy Ta Jan Sedivý 27 15 0 06 Nov 2020
EXAMS: A Multi-Subject High School Examinations Dataset for Cross-Lingual and Multilingual Question Answering Momchil Hardalov Todor Mihaylov Dimitrina Zlatkova Yoan Dinkov Ivan Koychev Preslav Nakov AI4Ed ELM 43 50 0 05 Nov 2020
Language Model is All You Need: Natural Language Understanding as Question Answering Mahdi Namazifar Alexandros Papangelis Gokhan Tur Dilek Z. Hakkani-Tür 21 47 0 05 Nov 2020
Improving Commonsense Question Answering by Graph-based Iterative Retrieval over Multiple Knowledge Sources Qianglong Chen Feng Ji Haiqing Chen Yin Zhang KELM RALM 18 27 0 05 Nov 2020
Context-Aware Answer Extraction in Question Answering Yeon Seonwoo Ji-Hoon Kim Jung-Woo Ha Alice Oh 12 27 0 05 Nov 2020
Indic-Transformers: An Analysis of Transformer Language Models for Indian Languages Kushal Kumar Jain Adwait Deshpande Kumar Shridhar F. Laumann Ayushman Dash 51 51 0 04 Nov 2020
Analyzing Sustainability Reports Using Natural Language Processing A. Luccioni Emi Baylor N. Duchêne 35 48 0 03 Nov 2020
Finding Friends and Flipping Frenemies: Automatic Paraphrase Dataset Augmentation Using Graph Theory Hannah Chen Yangfeng Ji David Evans 6 15 0 03 Nov 2020
CharBERT: Character-aware Pre-trained Language Model Wentao Ma Yiming Cui Chenglei Si Ting Liu Shijin Wang Guoping Hu 31 104 0 03 Nov 2020
A Closer Look at Linguistic Knowledge in Masked Language Models: The Case of Relative Clauses in American English Marius Mosbach Stefania Degaetano-Ortlieb Marie-Pauline Krielke Badr M. Abdullah Dietrich Klakow 25 6 0 02 Nov 2020
COSMO: Conditional SEQ2SEQ-based Mixture Model for Zero-Shot Commonsense Question Answering Farhad Moghimifar Lizhen Qu Terry Yue Zhuo Mahsa Baktashmotlagh Gholamreza Haffari LRM 14 8 0 02 Nov 2020
I Know What You Asked: Graph Path Learning using AMR for Commonsense Reasoning J. Lim Dongsuk Oh Yoonna Jang Kisu Yang Heuiseok Lim ReLM GNN LRM 21 34 0 02 Nov 2020
Transformer-based Multi-Aspect Modeling for Multi-Aspect Multi-Sentiment Analysis Zhanghua Wu Chengcan Ying Xinyu Dai Shujian Huang Jiajun Chen 8 8 0 01 Nov 2020
Understanding Pre-trained BERT for Aspect-based Sentiment Analysis Hu Xu Lei Shu Philip S. Yu Bing-Quan Liu SSL 34 44 0 31 Oct 2020
SLM: Learning a Discourse Language Representation with Sentence Unshuffling Haejun Lee Drew A. Hudson Kangwook Lee Christopher D. Manning SSL 25 50 0 30 Oct 2020
A Comprehensive Survey on Word Representation Models: From Classical to State-Of-The-Art Word Representation Language Models Usman Naseem Imran Razzak S. Khan M. Prasad 16 156 0 28 Oct 2020
Unmasking Contextual Stereotypes: Measuring and Mitigating BERT's Gender Bias Marion Bartl Malvina Nissim Albert Gatt 33 123 0 27 Oct 2020
Probing Task-Oriented Dialogue Representation from Language Models Chien-Sheng Wu Caiming Xiong 21 20 0 26 Oct 2020
UPB at SemEval-2020 Task 12: Multilingual Offensive Language Detection on Social Media by Fine-tuning a Variety of BERT-based Models Mircea-Adrian Tanase Dumitru-Clementin Cercel Costin-Gabriel Chiru 6 15 0 26 Oct 2020
Accelerating Training of Transformer-Based Language Models with Progressive Layer Dropping Minjia Zhang Yuxiong He AI4CE 13 100 0 26 Oct 2020
Learning Contextualized Knowledge Structures for Commonsense Reasoning Jun Yan Mrigank Raman Aaron Chan Tianyu Zhang Ryan Rossi Handong Zhao Sungchul Kim Nedim Lipka Xiang Ren 231 36 0 24 Oct 2020
Rethinking embedding coupling in pre-trained language models Hyung Won Chung Thibault Févry Henry Tsai Melvin Johnson Sebastian Ruder 95 142 0 24 Oct 2020
A Frustratingly Easy Approach for Entity and Relation Extraction Zexuan Zhong Danqi Chen 162 108 0 24 Oct 2020
Pre-training Text-to-Text Transformers for Concept-centric Common Sense Wangchunshu Zhou Dong-Ho Lee Ravi Kiran Selvam Seyeon Lee Bill Yuchen Lin Xiang Ren LRM VLM 14 71 0 24 Oct 2020
Improving Multilingual Models with Language-Clustered Vocabularies Hyung Won Chung Dan Garrette Kiat Chuan Tan Jason Riesa VLM 79 65 0 24 Oct 2020
ANLIzing the Adversarial Natural Language Inference Dataset Adina Williams Tristan Thrush Douwe Kiela AAML 183 46 0 24 Oct 2020
Comparative analysis of word embeddings in assessing semantic similarity of complex sentences Dhivya Chandrasekaran Vijay K. Mago 14 8 0 23 Oct 2020
DICT-MLM: Improved Multilingual Pre-Training using Bilingual Dictionaries Aditi Chaudhary K. Raman Krishna Srinivasan Jiecao Chen 42 24 0 23 Oct 2020
GiBERT: Introducing Linguistic Knowledge into BERT through a Lightweight Gated Injection Method Nicole Peinelt Marek Rei Maria Liakata 30 2 0 23 Oct 2020
Generating Plausible Counterfactual Explanations for Deep Transformers in Financial Text Classification Linyi Yang Eoin M. Kenny T. L. J. Ng Yi Yang Barry Smyth Ruihai Dong 15 70 0 23 Oct 2020
Event-Driven Learning of Systematic Behaviours in Stock Markets Xianchao Wu AIFin 26 7 0 23 Oct 2020