v1v2v3v4v5v6 (latest)

ALBERT: A Lite BERT for Self-supervised Learning of Language Representations

26 September 2019

ArXiv (abs)PDF HTML Github (3271★)

Papers citing "ALBERT: A Lite BERT for Self-supervised Learning of Language Representations"

50 / 2,935 papers shown

Title
Towards Faithful Neural Table-to-Text Generation with Content-Matching Constraints Zhenyi Wang Xiaoyang Wang Bang An Dong Yu Changyou Chen LMTD 231 85 0 03 May 2020
Teaching Machine Comprehension with Compositional Explanations Qinyuan Ye Xiao Huang Elizabeth Boschee Xiang Ren LRM ReLM 96 34 0 02 May 2020
ForecastQA: A Question Answering Challenge for Event Forecasting with Temporal Text Data Woojeong Jin Rahul Khanna Suji Kim Dong-Ho Lee Fred Morstatter Aram Galstyan Xiang Ren AI4TS 61 39 0 02 May 2020
RICA: Evaluating Robust Inference Capabilities Based on Commonsense Axioms Pei Zhou Rahul Khanna Seyeon Lee Bill Yuchen Lin Daniel E. Ho Jay Pujara Xiang Ren ReLM 118 37 0 02 May 2020
AVA: an Automatic eValuation Approach to Question Answering Systems Thuy Vu Alessandro Moschitti 49 13 0 02 May 2020
UnifiedQA: Crossing Format Boundaries With a Single QA System Daniel Khashabi Sewon Min Tushar Khot Ashish Sabharwal Oyvind Tafjord Peter Clark Hannaneh Hajishirzi 206 743 0 02 May 2020
Connecting the Dots: A Knowledgeable Path Generator for Commonsense Question Answering Peifeng Wang Nanyun Peng Filip Ilievski Pedro A. Szekely Xiang Ren 74 92 0 02 May 2020
Scalable Multi-Hop Relational Reasoning for Knowledge-Aware Question Answering Yanlin Feng Xinyue Chen Bill Yuchen Lin Peifeng Wang Jun Yan Xiang Ren LRM KELM 73 246 0 01 May 2020
Probing Contextual Language Models for Common Ground with Visual Representations Gabriel Ilharco Rowan Zellers Ali Farhadi Hannaneh Hajishirzi 118 14 0 01 May 2020
When BERT Plays the Lottery, All Tickets Are Winning Sai Prasanna Anna Rogers Anna Rumshisky MILM 88 187 0 01 May 2020
Topological Sort for Sentence Ordering Shrimai Prabhumoye Ruslan Salakhutdinov A. Black 51 52 0 01 May 2020
Visuo-Linguistic Question Answering (VLQA) Challenge Shailaja Keyur Sampat Yezhou Yang Chitta Baral CoGe 24 1 0 01 May 2020
Self-supervised Knowledge Triplet Learning for Zero-shot Question Answering Pratyay Banerjee Chitta Baral 90 65 0 01 May 2020
HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-training Linjie Li Yen-Chun Chen Yu Cheng Zhe Gan Licheng Yu Jingjing Liu MLLM VLM OffRL AI4TS 133 506 0 01 May 2020
A Matter of Framing: The Impact of Linguistic Formalism on Probing Results Ilia Kuznetsov Iryna Gurevych 49 26 0 30 Apr 2020
Segatron: Segment-Aware Transformer for Language Modeling and Understanding Richard He Bai Peng Shi Jimmy J. Lin Yuqing Xie Luchen Tan Kun Xiong Wen Gao Ming Li 38 8 0 30 Apr 2020
MuSe 2020 -- The First International Multimodal Sentiment Analysis in Real-life Media Challenge and Workshop Lukas Stappen Alice Baird Georgios Rizos Panagiotis Tzirakis Xinchen Du ... Adria Mallol-Ragolta Björn W. Schuller I. Lefter Min Zhang Y. Kompatsiaris 40 13 0 30 Apr 2020
Enriched Pre-trained Transformers for Joint Slot Filling and Intent Detection Momchil Hardalov Ivan Koychev Preslav Nakov VLM 47 17 0 30 Apr 2020
Question Rewriting for Conversational Question Answering Svitlana Vakulenko Shayne Longpre Zhucheng Tu R. Anantha 92 180 0 30 Apr 2020
RikiNet: Reading Wikipedia Pages for Natural Question Answering Dayiheng Liu Yeyun Gong Jie Fu Yu Yan Jiusheng Chen Daxin Jiang Jiancheng Lv Nan Duan RALM 94 55 0 30 Apr 2020
WT5?! Training Text-to-Text Models to Explain their Predictions Sharan Narang Colin Raffel Katherine Lee Adam Roberts Noah Fiedel Karishma Malkan 82 201 0 30 Apr 2020
Asking without Telling: Exploring Latent Ontologies in Contextual Representations Julian Michael Jan A. Botha Ian Tenney 64 43 0 29 Apr 2020
What Happens To BERT Embeddings During Fine-tuning? Amil Merchant Elahe Rahimtoroghi Ellie Pavlick Ian Tenney 110 189 0 29 Apr 2020
General Purpose Text Embeddings from Pre-trained Language Models for Scalable Inference Jingfei Du Myle Ott Haoran Li Xing Zhou Veselin Stoyanov AI4CE 66 10 0 29 Apr 2020
Zero-Shot Learning and its Applications from Autonomous Vehicles to COVID-19 Diagnosis: A Review Mahdi Rezaei Mahsa Shahidi 111 55 0 29 Apr 2020
Benchmarking Robustness of Machine Reading Comprehension Models Chenglei Si Ziqing Yang Yiming Cui Wentao Ma Ting Liu Shijin Wang ELM AAML 112 42 0 29 Apr 2020
Knowledgeable Dialogue Reading Comprehension on Key Turns Junlong Li Zhuosheng Zhang Hai Zhao 71 1 0 29 Apr 2020
BURT: BERT-inspired Universal Representation from Twin Structure Yian Li Hai Zhao 37 0 0 29 Apr 2020
Revisiting Pre-Trained Models for Chinese Natural Language Processing Yiming Cui Wanxiang Che Ting Liu Bing Qin Shijin Wang Guoping Hu 104 703 0 29 Apr 2020
DomBERT: Domain-oriented Language Model for Aspect-based Sentiment Analysis Hu Xu Bing-Quan Liu Lei Shu Philip S. Yu 60 51 0 28 Apr 2020
ColBERT: Using BERT Sentence Embedding in Parallel Neural Networks for Computational Humor Issa Annamoradnejad Gohar Zoghi 83 26 0 27 Apr 2020
Recall and Learn: Fine-tuning Deep Pretrained Language Models with Less Forgetting Sanyuan Chen Yutai Hou Yiming Cui Wanxiang Che Ting Liu Xiangzhan Yu KELM CLL 140 226 0 27 Apr 2020
Cross-lingual Information Retrieval with BERT Zhuolin Jiang A. El-Jaroudi William Hartmann Damianos G. Karakos Lingjun Zhao 64 56 0 24 Apr 2020
Probabilistically Masked Language Model Capable of Autoregressive Generation in Arbitrary Word Order Yi-Lun Liao Xin Jiang Qun Liu 56 40 0 24 Apr 2020
UHH-LT at SemEval-2020 Task 12: Fine-Tuning of Pre-Trained Transformer Networks for Offensive Language Detection Gregor Wiedemann Seid Muhie Yimam Christian Biemann 97 28 0 23 Apr 2020
DuReader_robust: A Chinese Dataset Towards Evaluating Robustness and Generalization of Machine Reading Comprehension in Real-World Applications Hongxuan Tang Hongyu Li Jing Liu Yu Hong Hua Wu Haifeng Wang 54 18 0 23 Apr 2020
QURIOUS: Question Generation Pretraining for Text Generation Shashi Narayan Gonçalo Simães Ji Ma Hannah Craighead Ryan T. McDonald 83 15 0 23 Apr 2020
Experience Grounds Language Yonatan Bisk Ari Holtzman Jesse Thomason Jacob Andreas Yoshua Bengio ... Angeliki Lazaridou Jonathan May Aleksandr Nisnevich Nicolas Pinto Joseph P. Turian 112 360 0 21 Apr 2020
Attention is Not Only a Weight: Analyzing Transformers with Vector Norms Goro Kobayashi Tatsuki Kuribayashi Sho Yokoi Kentaro Inui 58 15 0 21 Apr 2020
A Generic Network Compression Framework for Sequential Recommender Systems Yang Sun Fajie Yuan Ming Yang Guoao Wei Zhou Zhao Duo Liu 81 55 0 21 Apr 2020
Investigating the Effectiveness of Representations Based on Pretrained Transformer-based Language Models in Active Learning for Labelling Text Datasets Jinghui Lu B. MacNamee 53 19 0 21 Apr 2020
Fine-tuning Multi-hop Question Answering with Hierarchical Graph Network Guanming Xiong 128 0 0 20 Apr 2020
The Cost of Training NLP Models: A Concise Overview Or Sharir Barak Peleg Y. Shoham 110 214 0 19 Apr 2020
ETC: Encoding Long and Structured Inputs in Transformers Joshua Ainslie Santiago Ontanon Chris Alberti Vaclav Cvicek Zachary Kenneth Fisher Philip Pham Anirudh Ravula Sumit Sanghai Qifan Wang Li Yang 86 55 0 17 Apr 2020
Highway Transformer: Self-Gating Enhanced Self-Attentive Networks Yekun Chai Jin Shuo Xinwen Hou 48 17 0 17 Apr 2020
Fast and Accurate Deep Bidirectional Language Representations for Unsupervised Learning Joongbo Shin Yoonhyung Lee Seunghyun Yoon Kyomin Jung OOD 68 12 0 17 Apr 2020
Transform and Tell: Entity-Aware News Image Captioning Alasdair Tran A. Mathews Lexing Xie VLM 60 97 0 17 Apr 2020
Training with Quantization Noise for Extreme Model Compression Angela Fan Pierre Stock Benjamin Graham Edouard Grave Remi Gribonval Hervé Jégou Armand Joulin MQ 111 246 0 15 Apr 2020
lamBERT: Language and Action Learning Using Multimodal BERT Kazuki Miyazawa Tatsuya Aoki Takato Horii Takayuki Nagai SSL LM&Ro 85 12 0 15 Apr 2020
TOD-BERT: Pre-trained Natural Language Understanding for Task-Oriented Dialogue Chien-Sheng Wu Guosheng Lin R. Socher Caiming Xiong 104 324 0 15 Apr 2020