v1v2v3v4v5v6 (latest)

ALBERT: A Lite BERT for Self-supervised Learning of Language Representations

26 September 2019

ArXiv (abs)PDF HTML Github (3271★)

Papers citing "ALBERT: A Lite BERT for Self-supervised Learning of Language Representations"

50 / 2,935 papers shown

Title
Semantics Altering Modifications for Evaluating Comprehension in Machine Reading Viktor Schlegel Goran Nenadic Riza Batista-Navarro 79 18 0 07 Dec 2020
Detecting Insincere Questions from Text: A Transfer Learning Approach Ashwin Rachha Gaurav Vanmane 22 4 0 07 Dec 2020
Reference Knowledgeable Network for Machine Reading Comprehension Yilin Zhao Zhuosheng Zhang Hai Zhao 61 5 0 07 Dec 2020
Self-supervised Deep Learning for Reading Activity Classification M. Islam Shuji Sakamoto Yoshihiro Yamada Andrew W. Vargo M. Iwata Masakazu Iwamura K. Kise 34 2 0 07 Dec 2020
An Empirical Survey of Unsupervised Text Representation Methods on Twitter Data Lili Wang Chongyang Gao Jason W. Wei Weicheng Ma Ruibo Liu Soroush Vosoughi 34 15 0 07 Dec 2020
Pre-training Protein Language Models with Label-Agnostic Binding Pairs Enhances Performance in Downstream Tasks Modestas Filipavicius Matteo Manica Joris Cadow María Rodríguez Martínez 153 14 0 05 Dec 2020
Playing Text-Based Games with Common Sense Sahith N. Dambekodi Spencer Frazier Prithviraj Ammanabrolu Mark O. Riedl LLMAG 64 25 0 04 Dec 2020
Pre-trained language models as knowledge bases for Automotive Complaint Analysis V. D. Viellieber Matthias Aßenmacher 18 2 0 04 Dec 2020
WeaQA: Weak Supervision via Captions for Visual Question Answering Pratyay Banerjee Tejas Gokhale Yezhou Yang Chitta Baral 110 36 0 04 Dec 2020
Federated Learning for Personalized Humor Recognition Xu Guo Han Yu Boyang Albert Li Hao Wang Pengwei Xing Siwei Feng Zaiqing Nie Chunyan Miao FedML 95 13 0 03 Dec 2020
Circles are like Ellipses, or Ellipses are like Circles? Measuring the Degree of Asymmetry of Static and Contextual Embeddings and the Implications to Representation Learning Wei Zhang Murray Campbell Yang Yu Yara Rizk 42 0 0 03 Dec 2020
Empirical Study on the Software Engineering Practices in Open Source ML Package Repositories Minke Xiu Ellis E. Eghan Zhen Ming Z. Jiang Bram Adams 21 0 0 02 Dec 2020
Classification of Multimodal Hate Speech -- The Winning Solution of Hateful Memes Challenge Xiayu Zhong 59 15 0 02 Dec 2020
Interactive Teaching for Conversational AI Q. Ping Fei Niu Govind Thattai Joel Chengottusseriyil Qiaozi Gao Aishwarya N. Reganti Prashanth Rajagopal Gokhan Tur Dilek Z. Hakkani-Tür Prem Nataraja 18 6 0 02 Dec 2020
ReMP: Rectified Metric Propagation for Few-Shot Learning Yang Zhao Chunyuan Li Ping Yu Changyou Chen 87 6 0 02 Dec 2020
CLIMATE-FEVER: A Dataset for Verification of Real-World Climate Claims Thomas Diggelmann Jordan L. Boyd-Graber Jannis Bulian Massimiliano Ciaramita Markus Leippold 101 206 0 01 Dec 2020
CPM: A Large-scale Generative Chinese Pre-trained Language Model Zhengyan Zhang Xu Han Hao Zhou Pei Ke Yuxian Gu ... Wentao Han Jie Tang Juan-Zi Li Xiaoyan Zhu Maosong Sun 74 119 0 01 Dec 2020
Modifying Memories in Transformer Models Chen Zhu A. S. Rawat Manzil Zaheer Srinadh Bhojanapalli Daliang Li Felix X. Yu Sanjiv Kumar KELM 123 203 0 01 Dec 2020
Intrinsic Knowledge Evaluation on Chinese Language Models Zhiruo Wang Renfen Hu KELM ELM 34 1 0 29 Nov 2020
EdgeBERT: Sentence-Level Energy Optimizations for Latency-Aware Multi-Task NLP Inference Thierry Tambe Coleman Hooper Lillian Pentecost Tianyu Jia En-Yu Yang ... Victor Sanh P. Whatmough Alexander M. Rush David Brooks Gu-Yeon Wei 98 126 0 28 Nov 2020
Progressively Stacking 2.0: A Multi-stage Layerwise Training Method for BERT Training Speedup Cheng Yang Shengnan Wang Chao Yang Yuechuan Li Ru He Jingqiao Zhang 85 25 0 27 Nov 2020
Two Stage Transformer Model for COVID-19 Fake News Detection and Fact Checking Rutvik Vijjali Prathyush Potluri S. Kumar Sundeep Teki MedIm 74 75 0 26 Nov 2020
Transformer-Based Models for Automatic Identification of Argument Relations: A Cross-Domain Evaluation Ramon Ruiz-Dolz S. H. Barberá José Alemany A. García-Fornes 42 37 0 26 Nov 2020
Learning to Expand: Reinforced Pseudo-relevance Feedback Selection for Information-seeking Conversations Haojie Pan Cen Chen Chengyu Wang Minghui Qiu Liu Yang Feng Ji Jun Huang 31 4 0 25 Nov 2020
mForms : Multimodal Form-Filling with Question Answering Larry Heck S. Heck Anirudh S. Sundar 124 6 0 24 Nov 2020
Self-supervised transfer learning of physiological representations from free-living wearable data Dimitris Spathis I. Perez-Pozuelo S. Brage N. Wareham Cecilia Mascolo 72 42 0 18 Nov 2020
EasyTransfer -- A Simple and Scalable Deep Transfer Learning Platform for NLP Applications Minghui Qiu Peng Li Chengyu Wang Hanjie Pan Yaliang Li ... Jun Yang Yaliang Li Jun Huang Deng Cai Wei Lin VLM SyDa 109 20 0 18 Nov 2020
On the Transferability of Adversarial Attacksagainst Neural Text Classifier Liping Yuan Xiaoqing Zheng Yi Zhou Cho-Jui Hsieh Kai-Wei Chang SILM AAML 71 26 0 17 Nov 2020
MVP-BERT: Redesigning Vocabularies for Chinese BERT and Multi-Vocab Pretraining Wei-wei Zhu VLM 32 6 0 17 Nov 2020
Unsupervised Explanation Generation for Machine Reading Comprehension Yiming Cui Ting Liu Shijin Wang Guoping Hu LRM 28 3 0 13 Nov 2020
Hurricane Forecasting: A Novel Multimodal Machine Learning Framework L. Boussioux C. Zeng Théo Guénais Dimitris Bertsimas 64 40 0 11 Nov 2020
Don't Read Too Much into It: Adaptive Computation for Open-Domain Question Answering Yuxiang Wu Sebastian Riedel Pasquale Minervini Pontus Stenetorp 55 8 0 10 Nov 2020
Multimodal Pretraining for Dense Video Captioning Gabriel Huang Bo Pang Zhenhai Zhu Clara E. Rivera Radu Soricut 96 87 0 10 Nov 2020
Towards Preemptive Detection of Depression and Anxiety in Twitter David Owen Jose Camacho-Collados Luis Espinosa-Anke 32 25 0 10 Nov 2020
Natural Language Inference in Context -- Investigating Contextual Reasoning over Long Texts Hanmeng Liu Leyang Cui Jian Liu Yue Zhang ReLM LRM 78 44 0 10 Nov 2020
Multi-document Summarization via Deep Learning Techniques: A Survey Congbo Ma W. Zhang Mingyu Guo Hu Wang Quan Z. Sheng 125 129 0 10 Nov 2020
Learning Generalizable Physiological Representations from Large-scale Wearable Data Dimitris Spathis I. Perez-Pozuelo S. Brage N. Wareham Cecilia Mascolo SSL AI4TS 53 7 0 09 Nov 2020
Towards Domain-Agnostic Contrastive Learning Vikas Verma Minh-Thang Luong Kenji Kawaguchi Hieu H. Pham Quoc V. Le SSL 86 119 0 09 Nov 2020
Know What You Don't Need: Single-Shot Meta-Pruning for Attention Heads Zhengyan Zhang Fanchao Qi Zhiyuan Liu Qun Liu Maosong Sun VLM 91 31 0 07 Nov 2020
Underspecification Presents Challenges for Credibility in Modern Machine Learning Alexander DÁmour Katherine A. Heller D. Moldovan Ben Adlam B. Alipanahi ... Kellie Webster Steve Yadlowsky T. Yun Xiaohua Zhai D. Sculley OffRL 174 688 0 06 Nov 2020
Improving Machine Reading Comprehension with Single-choice Decision and Transfer Learning Yufan Jiang Shuangzhi Wu Jing Gong Yahui Cheng Peng Meng Weiliang Lin Zhibo Chen Mu Li FaML 64 11 0 06 Nov 2020
Alquist 3.0: Alexa Prize Bot Using Conversational Knowledge Graph Jan Pichl Petro Marek Jakub Konrád Petr Lorenc Van Duy Ta Jan Sedivý 64 15 0 06 Nov 2020
EXAMS: A Multi-Subject High School Examinations Dataset for Cross-Lingual and Multilingual Question Answering Momchil Hardalov Todor Mihaylov Dimitrina Zlatkova Yoan Dinkov Ivan Koychev Preslav Nakov AI4Ed ELM 237 54 0 05 Nov 2020
Language Model is All You Need: Natural Language Understanding as Question Answering Mahdi Namazifar Alexandros Papangelis Gokhan Tur Dilek Z. Hakkani-Tür 48 49 0 05 Nov 2020
Improving Commonsense Question Answering by Graph-based Iterative Retrieval over Multiple Knowledge Sources Qianglong Chen Feng Ji Haiqing Chen Yin Zhang KELM RALM 65 29 0 05 Nov 2020
Context-Aware Answer Extraction in Question Answering Yeon Seonwoo Ji-Hoon Kim Jung-Woo Ha Alice Oh 76 29 0 05 Nov 2020
Indic-Transformers: An Analysis of Transformer Language Models for Indian Languages Kushal Kumar Jain Adwait Deshpande Kumar Shridhar F. Laumann Ayushman Dash 78 52 0 04 Nov 2020
Analyzing Sustainability Reports Using Natural Language Processing A. Luccioni Emi Baylor N. Duchêne 72 48 0 03 Nov 2020
Finding Friends and Flipping Frenemies: Automatic Paraphrase Dataset Augmentation Using Graph Theory Hannah Chen Yangfeng Ji David Evans 50 15 0 03 Nov 2020
CharBERT: Character-aware Pre-trained Language Model Wentao Ma Yiming Cui Chenglei Si Ting Liu Shijin Wang Guoping Hu 90 109 0 03 Nov 2020