v1v2v3v4v5v6 (latest)

ALBERT: A Lite BERT for Self-supervised Learning of Language Representations

26 September 2019

ArXiv (abs)PDF HTML Github (3271★)

Papers citing "ALBERT: A Lite BERT for Self-supervised Learning of Language Representations"

50 / 2,935 papers shown

Title
Bootstrapping meaning through listening: Unsupervised learning of spoken sentence embeddings Jian Zhu Zuoyu Tian Yadong Liu Cong Zhang Chia-wen Lo SSL 82 2 0 23 Oct 2022
Data Augmentation for Automated Essay Scoring using Transformer Models Kshitij Gupta 85 4 0 23 Oct 2022
Realistic Data Augmentation Framework for Enhancing Tabular Reasoning D. K. Santhosh Kumar Vivek Gupta Soumya Sharma Shuo Zhang LMTD 75 4 0 23 Oct 2022
Span-based joint entity and relation extraction augmented with sequence tagging mechanism Bing Ji Shasha Li Hao Xu Jie Yu Jun Ma Bin Ji Jing Yang 79 4 0 23 Oct 2022
On the Transformation of Latent Space in Fine-Tuned NLP Models Nadir Durrani Hassan Sajjad Fahim Dalvi Firoj Alam 126 19 0 23 Oct 2022
Do Language Models Understand Measurements? Sungjin Park Seung-kook Ryu Edward Choi ReLM LRM 81 4 0 23 Oct 2022
Lexical Generalization Improves with Larger Models and Longer Training Elron Bandel Yoav Goldberg Yanai Elazar 94 7 0 23 Oct 2022
A BERT-based Deep Learning Approach for Reputation Analysis in Social Media Mohammad Wali Ur Rahman Sicong Shao Pratik Satam Salim Hariri Chris Padilla Zoe Taylor C. Nevarez 43 5 0 23 Oct 2022
A Visual Tour Of Current Challenges In Multimodal Language Models Shashank Sonkar Naiming Liu Richard G. Baraniuk DiffM 47 2 0 22 Oct 2022
Exploring The Landscape of Distributional Robustness for Question Answering Models Anas Awadalla Mitchell Wortsman Gabriel Ilharco Sewon Min Ian H. Magnusson Hannaneh Hajishirzi Ludwig Schmidt ELM OOD KELM 116 21 0 22 Oct 2022
DiscoSense: Commonsense Reasoning with Discourse Connectives Prajjwal Bhargava Vincent Ng LRM 335 4 0 22 Oct 2022
Leveraging Large Language Models for Multiple Choice Question Answering Joshua Robinson Christopher Rytting David Wingate ELM 244 200 0 22 Oct 2022
P $^3$ LM: Probabilistically Permuted Prophet Language Modeling for Generative Pre-Training Junwei Bao Yifan Wang Jiangyong Ying Yeyun Gong Jing Zhao Youzheng Wu Xiaodong He 70 1 0 22 Oct 2022
Salience Allocation as Guidance for Abstractive Summarization Fei Wang Kaiqiang Song Hongming Zhang Lifeng Jin Sangwoo Cho Wenlin Yao Xiaoyang Wang Muhao Chen Dong Yu 87 34 0 22 Oct 2022
SpaBERT: A Pretrained Language Model from Geographic Data for Geo-Entity Representation Zekun Li Jina Kim Yao-Yi Chiang Muhao Chen 133 31 0 21 Oct 2022
InforMask: Unsupervised Informative Masking for Language Model Pretraining Nafis Sadeq Canwen Xu Julian McAuley 95 13 0 21 Oct 2022
Transformer-based Entity Typing in Knowledge Graphs Zhiwei Hu Víctor Gutiérrez-Basulto Zhiliang Xiang Ru Li Jeff Z. Pan 75 19 0 20 Oct 2022
Apple of Sodom: Hidden Backdoors in Superior Sentence Embeddings via Contrastive Learning Xiaoyi Chen Baisong Xin Shengfang Zhai Shiqing Ma Qingni Shen Zhonghai Wu SILM 63 2 0 20 Oct 2022
QA Domain Adaptation using Hidden Space Augmentation and Self-Supervised Contrastive Adaptation Zhenrui Yue Huimin Zeng Bernhard Kratzwald Stefan Feuerriegel Dong Wang OOD 74 4 0 19 Oct 2022
Separating Grains from the Chaff: Using Data Filtering to Improve Multilingual Translation for Low-Resourced African Languages Idris Abdulmumin Michael Beukman Jesujoba Oluwadara Alabi Chris C. Emezue Everlyn Asiko ... Shamsuddeen Hassan Muhammad Mofetoluwa Adeyemi Oreen Yousuf Sahib Singh T. Gwadabe 105 9 0 19 Oct 2022
Attribution and Obfuscation of Neural Text Authorship: A Data Mining Perspective Adaku Uchendu Thai Le Dongwon Lee DeLMO 121 45 0 19 Oct 2022
Language Detoxification with Attribute-Discriminative Latent Space Jin Myung Kwak Minseon Kim Sung Ju Hwang 63 14 0 19 Oct 2022
Forging Multiple Training Objectives for Pre-trained Language Models via Meta-Learning Hongqiu Wu Ruixue Ding Haizhen Zhao Boli Chen Pengjun Xie Fei Huang Min Zhang MoMe 97 8 0 19 Oct 2022
Language Model Decomposition: Quantifying the Dependency and Correlation of Language Models Hao Zhang 29 0 0 19 Oct 2022
The Tail Wagging the Dog: Dataset Construction Biases of Social Bias Benchmarks Nikil Selvam Sunipa Dev Daniel Khashabi Tushar Khot Kai-Wei Chang ALM 74 26 0 18 Oct 2022
Post-hoc analysis of Arabic transformer models Ahmed Abdelali Nadir Durrani Fahim Dalvi Hassan Sajjad 36 1 0 18 Oct 2022
Tiny-Attention Adapter: Contexts Are More Important Than the Number of Parameters Hongyu Zhao Hao Tan Hongyuan Mei MoE 81 18 0 18 Oct 2022
On effects of Knowledge Distillation on Transfer Learning Sushil Thapa 35 1 0 18 Oct 2022
Less is More: A Lightweight and Robust Neural Architecture for Discourse Parsing Ming Li Ruihong Huang 59 2 0 18 Oct 2022
Deepfake Text Detection: Limitations and Opportunities Jiameng Pu Zain Sarwar Sifat Muhammad Abdullah A. Rehman Yoonjin Kim P. Bhattacharya M. Javed Bimal Viswanath AAML 68 57 0 17 Oct 2022
Learning Instructions with Unlabeled Data for Zero-Shot Cross-Task Generalization Yuxian Gu Pei Ke Xiaoyan Zhu Minlie Huang ALM 85 17 0 17 Oct 2022
Table-To-Text generation and pre-training with TabT5 Ewa Andrejczuk Julian Martin Eisenschlos Francesco Piccinno Syrine Krichene Yasemin Altun LMTD 66 31 0 17 Oct 2022
PeerDA: Data Augmentation via Modeling Peer Relation for Span Identification Tasks Weiwen Xu Xin Li Yang Deng W. Lam Lidong Bing 86 10 0 17 Oct 2022
ConReader: Exploring Implicit Relations in Contracts for Contract Clause Extraction Weiwen Xu Yang Deng Wenqiang Lei Wenlong Zhao Tat-Seng Chua W. Lam AILaw 63 6 0 17 Oct 2022
Zero-Shot Learners for Natural Language Understanding via a Unified Multiple Choice Perspective Ping Yang Junjie Wang Ruyi Gan Xinyu Zhu Lin Zhang Ziwei Wu Xinyu Gao Jiaxing Zhang Tetsuya Sakai BDL 71 26 0 16 Oct 2022
Knowledge Prompting in Pre-trained Language Model for Natural Language Understanding Jiadong Wang Wenkang Huang Qiuhui Shi Hongbin Wang Minghui Qiu Xiang Li Ming Gao KELM VLM 90 19 0 16 Oct 2022
Temporal Word Meaning Disambiguation using TimeLMs Mihir Godbole Parth Dandavate Aditya Kane 74 2 0 15 Oct 2022
Enabling Classifiers to Make Judgements Explicitly Aligned with Human Values Yejin Bang Tiezheng Yu Andrea Madotto Zhaojiang Lin Mona T. Diab Pascale Fung 74 13 0 14 Oct 2022
BERTScore is Unfair: On Social Bias in Language Model-Based Metrics for Text Generation Tianxiang Sun Junliang He Xipeng Qiu Xuanjing Huang 85 47 0 14 Oct 2022
Multitask Pre-training of Modular Prompt for Chinese Few-Shot Learning Tianxiang Sun Zhengfu He Qinen Zhu Xipeng Qiu Xuanjing Huang VLM VPVLM 38 21 0 14 Oct 2022
Can Language Representation Models Think in Bets? Zhi–Bin Tang Mayank Kejriwal 51 6 0 14 Oct 2022
Holistic Sentence Embeddings for Better Out-of-Distribution Detection Sishuo Chen Xiaohan Bi Rundong Gao Xu Sun OODD 82 4 0 14 Oct 2022
Predicting Fine-Tuning Performance with Probing Zining Zhu Soroosh Shahtalebi Frank Rudzicz 60 10 0 13 Oct 2022
Exploring Long-Sequence Masked Autoencoders Ronghang Hu Shoubhik Debnath Saining Xie Xinlei Chen 54 18 0 13 Oct 2022
Spontaneous Emerging Preference in Two-tower Language Model Zhengqi He Taro Toyoizumi LRM 50 1 0 13 Oct 2022
On the Evaluation of the Plausibility and Faithfulness of Sentiment Analysis Explanations Julia El Zini Mohamad Mansour Basel Mousi M. Awad 64 8 0 13 Oct 2022
Overview of BioASQ 2022: The tenth BioASQ challenge on Large-Scale Biomedical Semantic Indexing and Question Answering A. Nentidis Georgios Katsimpras Eirini Vandorou Anastasia Krithara Antonio Miranda-Escalada Luis Gasco Martin Krallinger George Giannakopoulos 61 13 0 13 Oct 2022
Decoding Visual Neural Representations by Multimodal Learning of Brain-Visual-Linguistic Features Changde Du Kaicheng Fu Jinpeng Li Huiguang He VLM 83 76 0 13 Oct 2022
Parameter-Efficient Masking Networks Yue Bai Huan Wang Xu Ma Yitian Zhang Zhiqiang Tao Yun Fu 67 10 0 13 Oct 2022
MiniALBERT: Model Distillation via Parameter-Efficient Recursive Transformers Mohammadmahdi Nouriborji Omid Rohanian Samaneh Kouchaki David Clifton 77 8 0 12 Oct 2022