v1v2v3 (latest)

SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems

2 May 2019

Amanpreet Singh

Papers citing "SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems"

50 / 1,500 papers shown

Title
Structural Adapters in Pretrained Language Models for AMR-to-text Generation Leonardo F. R. Ribeiro Yue Zhang Iryna Gurevych 96 72 0 16 Mar 2021
How Many Data Points is a Prompt Worth? Teven Le Scao Alexander M. Rush VLM 196 303 0 15 Mar 2021
CUAD: An Expert-Annotated NLP Dataset for Legal Contract Review Dan Hendrycks Collin Burns Anya Chen Spencer Ball ELM AILaw 67 195 0 10 Mar 2021
Measuring Mathematical Problem Solving With the MATH Dataset Dan Hendrycks Collin Burns Saurav Kadavath Akul Arora Steven Basart Eric Tang Basel Alomair Jacob Steinhardt ReLM FaML 224 2,414 0 05 Mar 2021
Vyākarana: A Colorless Green Benchmark for Syntactic Evaluation in Indic Languages Rajaswa Patil Jasleen Dhillon Siddhant Mahurkar Saumitra Kulkarni M. Malhotra V. Baths 62 1 0 01 Mar 2021
RuSentEval: Linguistic Source, Encoder Force! Vladislav Mikhailov Ekaterina Taktasheva Elina Sigdel Ekaterina Artemova VLM 36 6 0 28 Feb 2021
Automated essay scoring using efficient transformer-based language models C. Ormerod Akanksha Malhotra Amir Jafari 46 31 0 25 Feb 2021
Re-Evaluating GermEval17 Using German Pre-Trained Language Models Matthias Aßenmacher A. Corvonato C. Heumann VLM 57 6 0 24 Feb 2021
Do Transformer Modifications Transfer Across Implementations and Applications? Sharan Narang Hyung Won Chung Yi Tay W. Fedus Thibault Févry ... Wei Li Nan Ding Jake Marcus Adam Roberts Colin Raffel 100 127 0 23 Feb 2021
MixUp Training Leads to Reduced Overfitting and Improved Calibration for the Transformer Architecture Wancong Zhang Ieshan Vaidya 49 10 0 22 Feb 2021
Bilingual Language Modeling, A transfer learning technique for Roman Urdu Usama Khalid M. O. Beg Muhammad Umair Arshad 29 3 0 22 Feb 2021
Abstraction and Analogy-Making in Artificial Intelligence Melanie Mitchell 95 167 0 22 Feb 2021
Therapeutics Data Commons: Machine Learning Datasets and Tasks for Drug Discovery and Development Kexin Huang Tianfan Fu Wenhao Gao Yue Zhao Yusuf Roohani J. Leskovec Connor W. Coley Cao Xiao Jimeng Sun Marinka Zitnik OOD LM&MA 94 284 0 18 Feb 2021
Capturing Label Distribution: A Case Study in NLI Shujian Zhang Chengyue Gong Eunsol Choi 77 8 0 13 Feb 2021
A Metamodel and Framework for Artificial General Intelligence From Theory to Practice Hugo Latapie Özkan Kiliç Gaowen Liu Yan Yan Ramana Rao Kompella Pei Wang K. Thórisson Adam Lawrence Yuhong Sun Jayanth Srinivasa AI4CE 61 9 0 11 Feb 2021
The Singleton Fallacy: Why Current Critiques of Language Models Miss the Point Magnus Sahlgren F. Carlsson 55 28 0 08 Feb 2021
Bias Out-of-the-Box: An Empirical Analysis of Intersectional Occupational Biases in Popular Generative Language Models Hannah Rose Kirk Yennie Jun Haider Iqbal Elias Benussi Filippo Volpin F. Dreyer Aleksandar Shtedritski Yuki M. Asano 68 194 0 08 Feb 2021
The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics Sebastian Gehrmann Tosin Adewumi Karmanya Aggarwal Pawan Sasanka Ammanamanchi Aremu Anuoluwapo ... Nishant Subramani Wei Xu Diyi Yang Akhila Yerukola Jiawei Zhou VLM 319 285 0 02 Feb 2021
Scaling Laws for Transfer Danny Hernandez Jared Kaplan T. Henighan Sam McCandlish 97 251 0 02 Feb 2021
Explaining Natural Language Processing Classifiers with Occlusion and Language Modeling David Harbecke AAML 48 2 0 28 Jan 2021
Muppet: Massive Multi-task Representations with Pre-Finetuning Armen Aghajanyan Anchit Gupta Akshat Shrivastava Xilun Chen Luke Zettlemoyer Sonal Gupta 100 269 0 26 Jan 2021
Exploring Transitivity in Neural NLI Models through Veridicality Hitomi Yanaka K. Mineshima Kentaro Inui 82 23 0 26 Jan 2021
WangchanBERTa: Pretraining transformer-based Thai Language Models Lalita Lowphansirikul Charin Polpanumas Nawat Jantrakulchai Sarana Nutanong 53 76 0 24 Jan 2021
Robustness Gym: Unifying the NLP Evaluation Landscape Karan Goel Nazneen Rajani Jesse Vig Samson Tan Jason M. Wu Stephan Zheng Caiming Xiong Joey Tianyi Zhou Christopher Ré AAML OffRL OOD 196 140 0 13 Jan 2021
Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity W. Fedus Barret Zoph Noam M. Shazeer MoE 104 2,243 0 11 Jan 2021
WARP: Word-level Adversarial ReProgramming Karen Hambardzumyan Hrant Khachatrian Jonathan May AAML 339 354 0 01 Jan 2021
Moral Stories: Situated Reasoning about Norms, Intents, Actions, and their Consequences Denis Emelin Ronan Le Bras Jena D. Hwang Maxwell Forbes Yejin Choi LRM 118 135 0 31 Dec 2020
CoCoLM: COmplex COmmonsense Enhanced Language Model with Discourse Relations Changlong Yu Hongming Zhang Yangqiu Song Wilfred Ng 117 21 0 31 Dec 2020
Out of Order: How Important Is The Sequential Order of Words in a Sentence in Natural Language Understanding Tasks? Thang M. Pham Trung Bui Long Mai Anh Totti Nguyen 286 123 0 30 Dec 2020
ARBERT & MARBERT: Deep Bidirectional Transformers for Arabic Muhammad Abdul-Mageed AbdelRahim Elmadany El Moatez Billah Nagoudi VLM 129 465 0 27 Dec 2020
Seeing past words: Testing the cross-modal capabilities of pretrained V&L models on counting tasks Letitia Parcalabescu Albert Gatt Anette Frank Iacer Calixto LRM 91 49 0 22 Dec 2020
Narrative Incoherence Detection Deng Cai Yizhe Zhang Yichen Huang Wai Lam Bill Dolan 75 5 0 21 Dec 2020
Exploring Fluent Query Reformulations with Text-to-Text Transformers and Reinforcement Learning Jerry Zikun Chen S. Yu Haoran Wang 444 5 0 18 Dec 2020
Continual Lifelong Learning in Natural Language Processing: A Survey Magdalena Biesialska Katarzyna Biesialska Marta R. Costa-jussá KELM CLL 95 222 0 17 Dec 2020
Learning from Mistakes: Using Mis-predictions as Harm Alerts in Language Pre-Training Chen Xing Wenhao Liu Caiming Xiong 31 0 0 16 Dec 2020
WILDS: A Benchmark of in-the-Wild Distribution Shifts Pang Wei Koh Shiori Sagawa Henrik Marklund Sang Michael Xie Marvin Zhang ... A. Kundaje Emma Pierson Sergey Levine Chelsea Finn Percy Liang OOD 302 1,452 0 14 Dec 2020
ParsiNLU: A Suite of Language Understanding Challenges for Persian Daniel Khashabi Arman Cohan Siamak Shakeri Pedram Hosseini Pouya Pezeshkpour ... Niloofar Safi Samghabadi Mahsa Shafaei Saber Sheybani Ali Tazarv Yadollah Yaghoobzadeh 62 44 0 11 Dec 2020
Circles are like Ellipses, or Ellipses are like Circles? Measuring the Degree of Asymmetry of Static and Contextual Embeddings and the Implications to Representation Learning Wei Zhang Murray Campbell Yang Yu Yara Rizk 34 0 0 03 Dec 2020
Learning from others' mistakes: Avoiding dataset biases without modeling them Victor Sanh Thomas Wolf Yonatan Belinkov Alexander M. Rush 93 116 0 02 Dec 2020
Transformer Query-Target Knowledge Discovery (TEND): Drug Discovery from CORD-19 Leo K. Tam Xiaosong Wang Daguang Xu MedIm 36 2 0 28 Nov 2020
GLGE: A New General Language Generation Evaluation Benchmark Dayiheng Liu Yu Yan Yeyun Gong Weizhen Qi Hang Zhang ... Jiancheng Lv Ruofei Zhang Winnie Wu Ming Zhou Nan Duan ELM 111 66 0 24 Nov 2020
Learn to Bind and Grow Neural Structures Azhar Shaikh Nishant Sinha CLL 42 0 0 21 Nov 2020
When Do You Need Billions of Words of Pretraining Data? Yian Zhang Alex Warstadt Haau-Sing Li Samuel R. Bowman 62 141 0 10 Nov 2020
From Dataset Recycling to Multi-Property Extraction and Beyond Tomasz Dwojak Michal Pietruszka Łukasz Borchmann Jakub Chlkedowski Filip Graliñski 91 5 0 06 Nov 2020
Meta-Learning for Natural Language Understanding under Continual Learning Framework Jiacheng Wang Yang Fan Duo Jiang Shiqing Li CLL 8 0 0 03 Nov 2020
IndoLEM and IndoBERT: A Benchmark Dataset and Pre-trained Language Model for Indonesian NLP Fajri Koto Afshin Rahimi Jey Han Lau Timothy Baldwin 68 263 0 02 Nov 2020
RussianSuperGLUE: A Russian Language Understanding Evaluation Benchmark Tatiana Shavrina Alena Fenogenova Anton A. Emelyanov Denis Shevelev Ekaterina Artemova Valentin Malykh Vladislav Mikhailov Maria Tikhonova Andrey Chertok Andrey Evlampiev VLM ELM 89 82 0 29 Oct 2020
FastFormers: Highly Efficient Transformer Models for Natural Language Understanding Young Jin Kim Hany Awadalla AI4CE 100 44 0 26 Oct 2020
ReadOnce Transformers: Reusable Representations of Text for Transformers Shih-Ting Lin Ashish Sabharwal Tushar Khot 110 3 0 24 Oct 2020
Improving Classification through Weak Supervision in Context-specific Conversational Agent Development for Teacher Education Debajyoti Datta Maria Phillips Jennifer L. Chiu G. Watson J. Bywater Laura E. Barnes Donald E. Brown 54 7 0 23 Oct 2020