ALBERT: A Lite BERT for Self-supervised Learning of Language Representations

26 September 2019

Papers citing "ALBERT: A Lite BERT for Self-supervised Learning of Language Representations"

50 / 2,913 papers shown

Title
FashionBERT: Text and Image Matching with Adaptive Loss for Cross-modal Retrieval D. Gao Linbo Jin Ben Chen Minghui Qiu Peng Li Yi Wei Yitao Hu Haozhe Jasper Wang OOD 25 133 0 20 May 2020
Normalized Attention Without Probability Cage Oliver Richter Roger Wattenhofer 14 21 0 19 May 2020
Sketch-BERT: Learning Sketch Bidirectional Encoder Representation from Transformers by Self-supervised Learning of Sketch Gestalt Hangyu Lin Yanwei Fu Yu-Gang Jiang Xiangyang Xue SSL 6 64 0 19 May 2020
Audio ALBERT: A Lite BERT for Self-supervised Learning of Audio Representation Po-Han Chi Pei-Hung Chung Tsung-Han Wu Chun-Cheng Hsieh Yen-Hao Chen Shang-Wen Li Hung-yi Lee SSL 9 147 0 18 May 2020
Spatio-Temporal Graph Transformer Networks for Pedestrian Trajectory Prediction Cunjun Yu Xiao Ma Jiawei Ren Haiyu Zhao Shuai Yi 26 459 0 18 May 2020
T-VSE: Transformer-Based Visual Semantic Embedding M. Bastan Arnau Ramisa Mehmet Tek ViT 24 7 0 17 May 2020
CS-NLP team at SemEval-2020 Task 4: Evaluation of State-of-the-art NLP Deep Learning Architectures on Commonsense Reasoning Task Sirwe Saeedi Ali (Aliakbar) Panahi Seyran Saeedi A. Fong ReLM ELM LRM 18 12 0 17 May 2020
Speech Recognition and Multi-Speaker Diarization of Long Conversations H. H. Mao Shuyang Li Julian McAuley G. Cottrell VLM 22 40 0 16 May 2020
CERT: Contrastive Self-supervised Learning for Language Understanding Hongchao Fang Sicheng Wang Meng Zhou Jiayuan Ding P. Xie ELM SSL 30 337 0 16 May 2020
COVID-Twitter-BERT: A Natural Language Processing Model to Analyse COVID-19 Content on Twitter Martin Müller M. Salathé P. Kummervold VLM MedIm AI4MH 35 355 0 15 May 2020
Spelling Error Correction with Soft-Masked BERT Shaohua Zhang Haoran Huang Jicong Liu Hang Li 11 206 0 15 May 2020
WG-WaveNet: Real-Time High-Fidelity Speech Synthesis without GPU Po-Chun Hsu Hung-yi Lee 9 16 0 15 May 2020
Machine Reading Comprehension: The Role of Contextualized Language Models and Beyond Zhuosheng Zhang Hai Zhao Rui Wang 18 62 0 13 May 2020
Automated Extraction of Socio-political Events from News (AESPEN): Workshop and Shared Task Report Ali Hürriyetoǧlu Vanni Zavarella Hristo Tanev E. Yoruk Ali Safaya Osman Mutlu 16 31 0 12 May 2020
A Report on the 2020 Sarcasm Detection Shared Task Debanjan Ghosh Avijit Vajpayee Smaranda Muresan 18 60 0 12 May 2020
SKEP: Sentiment Knowledge Enhanced Pre-training for Sentiment Analysis Hao Tian Can Gao Xinyan Xiao Hao Liu Bolei He Hua Wu Haifeng Wang Feng Wu 29 229 0 12 May 2020
How Context Affects Language Models' Factual Predictions Fabio Petroni Patrick Lewis Aleksandra Piktus Tim Rocktaschel Yuxiang Wu Alexander H. Miller Sebastian Riedel KELM 19 228 0 10 May 2020
schuBERT: Optimizing Elements of BERT A. Khetan Zohar Karnin 28 30 0 09 May 2020
Modeling Document Interactions for Learning to Rank with Regularized Self-Attention Shuo Sun Kevin Duh 18 4 0 08 May 2020
Detecting East Asian Prejudice on Social Media Bertie Vidgen Austin Botelho David A. Broniatowski E. Guest Matthew Hall Helen Z. Margetts Rebekah Tromble Zeerak Talat Scott A. Hale 16 97 0 08 May 2020
Distilling Knowledge from Pre-trained Language Models via Text Smoothing Xing Wu Y. Liu Xiangyang Zhou Dianhai Yu 20 6 0 08 May 2020
SUPERT: Towards New Frontiers in Unsupervised Evaluation Metrics for Multi-Document Summarization Yang Gao Wei-Ye Zhao Steffen Eger ELM 21 124 0 07 May 2020
The Cascade Transformer: an Application for Efficient Answer Sentence Selection Luca Soldaini Alessandro Moschitti 27 44 0 05 May 2020
ESG2Risk: A Deep Learning Framework from ESG News to Stock Volatility Prediction Tian Guo N. Jamet Valentin Betrix Louis-Alexandre Piquet E. Hauptmann AIFin 19 30 0 05 May 2020
Establishing Baselines for Text Classification in Low-Resource Languages Jan Christian Blaise Cruz C. Cheng 6 36 0 05 May 2020
ImpactCite: An XLNet-based method for Citation Impact Analysis Dominique Mercier Syed Tahseen Raza Rizvi Vikas Rajashekar Andreas Dengel Sheraz Ahmed 16 14 0 05 May 2020
CAiRE-COVID: A Question Answering and Query-focused Multi-Document Summarization System for COVID-19 Scholarly Information Management Dan Su Yan Xu Tiezheng Yu Farhad Bin Siddique Elham J. Barezi Pascale Fung RALM 16 31 0 04 May 2020
Physical reservoir computing -- An introductory perspective Kohei Nakajima 49 308 0 03 May 2020
Towards Faithful Neural Table-to-Text Generation with Content-Matching Constraints Zhenyi Wang Xiaoyang Wang Bang An Dong Yu Changyou Chen LMTD 168 84 0 03 May 2020
Teaching Machine Comprehension with Compositional Explanations Qinyuan Ye Xiao Huang Elizabeth Boschee Xiang Ren LRM ReLM 19 34 0 02 May 2020
ForecastQA: A Question Answering Challenge for Event Forecasting with Temporal Text Data Woojeong Jin Rahul Khanna Suji Kim Dong-Ho Lee Fred Morstatter Aram Galstyan Xiang Ren AI4TS 11 36 0 02 May 2020
RICA: Evaluating Robust Inference Capabilities Based on Commonsense Axioms Pei Zhou Rahul Khanna Seyeon Lee Bill Yuchen Lin Daniel E. Ho Jay Pujara Xiang Ren ReLM 19 36 0 02 May 2020
AVA: an Automatic eValuation Approach to Question Answering Systems Thuy Vu Alessandro Moschitti 33 13 0 02 May 2020
UnifiedQA: Crossing Format Boundaries With a Single QA System Daniel Khashabi Sewon Min Tushar Khot Ashish Sabharwal Oyvind Tafjord Peter Clark Hannaneh Hajishirzi 35 721 0 02 May 2020
Connecting the Dots: A Knowledgeable Path Generator for Commonsense Question Answering Peifeng Wang Nanyun Peng Filip Ilievski Pedro A. Szekely Xiang Ren 8 91 0 02 May 2020
Scalable Multi-Hop Relational Reasoning for Knowledge-Aware Question Answering Yanlin Feng Xinyue Chen Bill Yuchen Lin Peifeng Wang Jun Yan Xiang Ren LRM KELM 18 239 0 01 May 2020
Probing Contextual Language Models for Common Ground with Visual Representations Gabriel Ilharco Rowan Zellers Ali Farhadi Hannaneh Hajishirzi 30 14 0 01 May 2020
When BERT Plays the Lottery, All Tickets Are Winning Sai Prasanna Anna Rogers Anna Rumshisky MILM 16 185 0 01 May 2020
Topological Sort for Sentence Ordering Shrimai Prabhumoye Ruslan Salakhutdinov A. Black 10 51 0 01 May 2020
Visuo-Linguistic Question Answering (VLQA) Challenge Shailaja Keyur Sampat Yezhou Yang Chitta Baral CoGe 13 1 0 01 May 2020
Self-supervised Knowledge Triplet Learning for Zero-shot Question Answering Pratyay Banerjee Chitta Baral 13 63 0 01 May 2020
HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-training Linjie Li Yen-Chun Chen Yu Cheng Zhe Gan Licheng Yu Jingjing Liu MLLM VLM OffRL AI4TS 46 493 0 01 May 2020
A Matter of Framing: The Impact of Linguistic Formalism on Probing Results Ilia Kuznetsov Iryna Gurevych 17 26 0 30 Apr 2020
Segatron: Segment-Aware Transformer for Language Modeling and Understanding Richard He Bai Peng Shi Jimmy J. Lin Yuqing Xie Luchen Tan Kun Xiong Wen Gao Ming Li 24 8 0 30 Apr 2020
MuSe 2020 -- The First International Multimodal Sentiment Analysis in Real-life Media Challenge and Workshop Lukas Stappen Alice Baird Georgios Rizos Panagiotis Tzirakis Xinchen Du ... Adria Mallol-Ragolta Björn W. Schuller I. Lefter Min Zhang Y. Kompatsiaris 23 13 0 30 Apr 2020
Enriched Pre-trained Transformers for Joint Slot Filling and Intent Detection Momchil Hardalov Ivan Koychev Preslav Nakov VLM 20 17 0 30 Apr 2020
Question Rewriting for Conversational Question Answering Svitlana Vakulenko Shayne Longpre Zhucheng Tu R. Anantha 20 174 0 30 Apr 2020
RikiNet: Reading Wikipedia Pages for Natural Question Answering Dayiheng Liu Yeyun Gong Jie Fu Yu Yan Jiusheng Chen Daxin Jiang Jiancheng Lv Nan Duan RALM 30 55 0 30 Apr 2020
WT5?! Training Text-to-Text Models to Explain their Predictions Sharan Narang Colin Raffel Katherine Lee Adam Roberts Noah Fiedel Karishma Malkan 19 197 0 30 Apr 2020
Asking without Telling: Exploring Latent Ontologies in Contextual Representations Julian Michael Jan A. Botha Ian Tenney 31 42 0 29 Apr 2020