Diversify Your Datasets: Analyzing Generalization via Controlled Variance in Adversarial Datasets

21 October 2019

Papers citing "Diversify Your Datasets: Analyzing Generalization via Controlled Variance in Adversarial Datasets"

42 / 42 papers shown

Title
Investigating a Benchmark for Training-set free Evaluation of Linguistic Capabilities in Machine Reading Comprehension Viktor Schlegel Goran Nenadic Riza Batista-Navarro ELM 54 0 0 09 Aug 2024
Functionality learning through specification instructions Pedro Henrique Luz de Araujo Benjamin Roth ELM 62 0 0 14 Nov 2023
Inferring Capabilities from Task Performance with Bayesian Triangulation John Burden Konstantinos Voudouris Ryan Burnell Danaja Rutar Lucy G. Cheke José Hernández-Orallo 35 7 0 21 Sep 2023
InfoSync: Information Synchronization across Multilingual Semi-structured Tables Siddharth Khincha Chelsi Jain Vivek Gupta Tushar Kataria Shuo Zhang SyDa 65 2 0 06 Jul 2023
Cross-functional Analysis of Generalisation in Behavioural Learning Pedro Henrique Luz de Araujo Benjamin Roth 49 4 0 22 May 2023
Accelerating Batch Active Learning Using Continual Learning Techniques Arnav M. Das Gantavya Bhatt M. Bhalerao Vianne R. Gao Rui Yang J. Bilmes VLM CLL 49 10 0 10 May 2023
Can Transformers Reason in Fragments of Natural Language? Viktor Schlegel Kamen V. Pavlov Ian Pratt-Hartmann LRM ReLM 60 7 0 10 Nov 2022
Realistic Data Augmentation Framework for Enhancing Tabular Reasoning D. K. Santhosh Kumar Vivek Gupta Soumya Sharma Shuo Zhang LMTD 53 4 0 23 Oct 2022
State-of-the-art generalisation research in NLP: A taxonomy and review Dieuwke Hupkes Mario Giulianelli Verna Dankers Mikel Artetxe Yanai Elazar ... Leila Khalatbari Maria Ryskina Rita Frieske Ryan Cotterell Zhijing Jin 235 97 0 06 Oct 2022
Compositional Evaluation on Japanese Textual Entailment and Similarity Hitomi Yanaka K. Mineshima 58 24 0 09 Aug 2022
Logical Inference for Counting on Semi-structured Tables Tomoya Kurosawa Hitomi Yanaka LMTD 41 2 0 16 Apr 2022
Curriculum: A Broad-Coverage Benchmark for Linguistic Phenomena in Natural Language Understanding Zeming Chen Qiyue Gao ELM 50 4 0 13 Apr 2022
DeepA2: A Modular Framework for Deep Argument Analysis with Pretrained Neural Text2Text Language Models Gregor Betz Kyle Richardson 38 8 0 04 Oct 2021
Numerical reasoning in machine reading comprehension tasks: are we there yet? Hadeel Al-Negheimish Pranava Madhyastha A. Russo AIMat ReLM 51 13 0 16 Sep 2021
Avoiding Inference Heuristics in Few-shot Prompt-based Finetuning Prasetya Ajie Utama N. Moosavi Victor Sanh Iryna Gurevych AAML 80 36 0 09 Sep 2021
Teaching Autoregressive Language Models Complex Tasks By Demonstration Gabriel Recchia 55 22 0 05 Sep 2021
Turning Tables: Generating Examples from Semi-structured Tables for Endowing Language Models with Reasoning Skills Ori Yoran Alon Talmor Jonathan Berant ReLM LRM 222 54 0 15 Jul 2021
SyGNS: A Systematic Generalization Testbed Based on Natural Language Semantics Hitomi Yanaka K. Mineshima Kentaro Inui NAI AI4CE 85 11 0 02 Jun 2021
Dynabench: Rethinking Benchmarking in NLP Douwe Kiela Max Bartolo Yixin Nie Divyansh Kaushik Atticus Geiger ... Pontus Stenetorp Robin Jia Joey Tianyi Zhou Christopher Potts Adina Williams 198 407 0 07 Apr 2021
Exploring Transitivity in Neural NLI Models through Veridicality Hitomi Yanaka K. Mineshima Kentaro Inui 54 23 0 26 Jan 2021
ANLIzing the Adversarial Natural Language Inference Dataset Adina Williams Tristan Thrush Douwe Kiela AAML 214 47 0 24 Oct 2020
Do Neural Models Learn Systematicity of Monotonicity Inference in Natural Language? Hitomi Yanaka K. Mineshima D. Bekki Kentaro Inui NAI 42 51 0 30 Apr 2020
The Curse of Performance Instability in Analysis Datasets: Consequences, Source, and Suggestions Xiang Zhou Yixin Nie Hao Tan Joey Tianyi Zhou 70 40 0 28 Apr 2020
Injecting Numerical Reasoning Skills into Language Models Mor Geva Ankit Gupta Jonathan Berant AIMat LRM 64 226 0 09 Apr 2020
What Does My QA Model Know? Devising Controlled Probes using Expert Knowledge Kyle Richardson Ashish Sabharwal 48 46 0 31 Dec 2019
oLMpics -- On what Language Model Pre-training Captures Alon Talmor Yanai Elazar Yoav Goldberg Jonathan Berant LRM 98 304 0 31 Dec 2019
XLNet: Generalized Autoregressive Pretraining for Language Understanding Zhilin Yang Zihang Dai Yiming Yang J. Carbonell Ruslan Salakhutdinov Quoc V. Le AI4CE 227 8,424 0 19 Jun 2019
What do you learn from context? Probing for sentence structure in contextualized word representations Ian Tenney Patrick Xia Berlin Chen Alex Jinpeng Wang Adam Poliak ... Najoung Kim Benjamin Van Durme Samuel R. Bowman Dipanjan Das Ellie Pavlick 173 859 0 15 May 2019
Inoculation by Fine-Tuning: A Method for Analyzing Challenge Datasets Nelson F. Liu Roy Schwartz Noah A. Smith AAML 66 106 0 04 Apr 2019
Still a Pain in the Neck: Evaluating Text Representations on Lexical Composition Vered Shwartz Ido Dagan CoGe 48 79 0 27 Feb 2019
Multi-Task Deep Neural Networks for Natural Language Understanding Xiaodong Liu Pengcheng He Weizhu Chen Jianfeng Gao AI4CE 121 1,270 0 31 Jan 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.7K 94,729 0 11 Oct 2018
Stress Test Evaluation for Natural Language Inference Aakanksha Naik Abhilasha Ravichander Norman M. Sadeh Carolyn Rose Graham Neubig ELM 67 376 0 02 Jun 2018
Breaking NLI Systems with Sentences that Require Simple Lexical Inferences Max Glockner Vered Shwartz Yoav Goldberg NAI 72 366 0 06 May 2018
Scheduled Multi-Task Learning: From Syntax to Translation E. Kiperwasser Miguel Ballesteros 55 82 0 24 Apr 2018
Performance Impact Caused by Hidden Bias of Training Data for Recognizing Textual Entailment Masatoshi Tsuchiya 54 160 0 22 Apr 2018
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 1.1K 7,154 0 20 Apr 2018
Annotation Artifacts in Natural Language Inference Data Suchin Gururangan Swabha Swayamdipta Omer Levy Roy Schwartz Samuel R. Bowman Noah A. Smith 142 1,177 0 06 Mar 2018
Deep contextualized word representations Matthew E. Peters Mark Neumann Mohit Iyyer Matt Gardner Christopher Clark Kenton Lee Luke Zettlemoyer NAI 204 11,546 0 15 Feb 2018
A Broad-Coverage Challenge Corpus for Sentence Understanding through Inference Adina Williams Nikita Nangia Samuel R. Bowman 517 4,476 0 18 Apr 2017
A large annotated corpus for learning natural language inference Samuel R. Bowman Gabor Angeli Christopher Potts Christopher D. Manning 307 4,282 0 21 Aug 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 1.7K 150,006 0 22 Dec 2014