Structurally Diverse Sampling for Sample-Efficient Training and Comprehensive Evaluation

16 March 2022

Papers citing "Structurally Diverse Sampling for Sample-Efficient Training and Comprehensive Evaluation"

39 / 39 papers shown

Title
Active Learning Helps Pretrained Models Learn the Intended Task Alex Tamkin Dat Nguyen Salil Deshpande Jesse Mu Noah D. Goodman 54 38 0 18 Apr 2022
Unobserved Local Structures Make Compositional Generalization Hard Ben Bogin Shivanshu Gupta Jonathan Berant CoGe 63 33 0 15 Jan 2022
Improving Compositional Generalization with Latent Structure and Data Augmentation Linlu Qiu Peter Shaw Panupong Pasupat Pawel Krzysztof Nowak Tal Linzen Fei Sha Kristina Toutanova CoGe 81 57 0 14 Dec 2021
On The Ingredients of an Effective Zero-shot Semantic Parser Pengcheng Yin John Wieting Avirup Sil Graham Neubig 71 15 0 15 Oct 2021
COVR: A test-bed for Visually Grounded Compositional Generalization with real images Ben Bogin Shivanshu Gupta Matt Gardner Jonathan Berant CoGe 80 29 0 22 Sep 2021
Finding needles in a haystack: Sampling Structurally-diverse Training Sets from Synthetic Data for Compositional Generalization I. Oren Jonathan Herzig Jonathan Berant 58 31 0 06 Sep 2021
The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformers Róbert Csordás Kazuki Irie Jürgen Schmidhuber ViT 68 133 0 26 Aug 2021
Mind Your Outliers! Investigating the Negative Impact of Outliers on Active Learning for Visual Question Answering Siddharth Karamcheti Ranjay Krishna Li Fei-Fei Christopher D. Manning 85 92 0 06 Jul 2021
Meta-Learning to Compositionally Generalize Henry Conklin Bailin Wang Kenny Smith Ivan Titov OOD 99 75 0 08 Jun 2021
Learning to Synthesize Data for Semantic Parsing Bailin Wang Wenpeng Yin Xi Lin Caiming Xiong 42 51 0 12 Apr 2021
Dynabench: Rethinking Benchmarking in NLP Douwe Kiela Max Bartolo Yixin Nie Divyansh Kaushik Atticus Geiger ... Pontus Stenetorp Robin Jia Joey Tianyi Zhou Christopher Potts Adina Williams 198 407 0 07 Apr 2021
Revisiting Iterative Back-Translation from the Perspective of Compositional Generalization Yinuo Guo Hualei Zhu Zeqi Lin Bei Chen Jian-Guang Lou Dongmei Zhang BDL 220 27 0 08 Dec 2020
Sequence-Level Mixed Sample Data Augmentation Demi Guo Yoon Kim Alexander M. Rush 65 100 0 18 Nov 2020
Underspecification Presents Challenges for Credibility in Modern Machine Learning Alexander DÁmour Katherine A. Heller D. Moldovan Ben Adlam B. Alipanahi ... Kellie Webster Steve Yadlowsky T. Yun Xiaohua Zhai D. Sculley OffRL 115 686 0 06 Nov 2020
Compositional Generalization and Natural Language Variation: Can a Semantic Parsing Approach Handle Both? Peter Shaw Ming-Wei Chang Panupong Pasupat Kristina Toutanova CoGe 74 187 0 24 Oct 2020
Improving Compositional Generalization in Semantic Parsing I. Oren Jonathan Herzig Nitish Gupta Matt Gardner Jonathan Berant 67 63 0 12 Oct 2020
COGS: A Compositional Generalization Challenge Based on Semantic Interpretation Najoung Kim Tal Linzen CoGe 48 280 0 12 Oct 2020
Learning to Recombine and Resample Data for Compositional Generalization Ekin Akyürek Afra Feyza Akyürek Jacob Andreas 70 80 0 08 Oct 2020
Task-Oriented Dialogue as Dataflow Synthesis Semantic Machines Jacob Andreas J. Bufe David Burkett Charles C. Chen ... Izabela Witoszko Jason Wolfe A. Wray Yuchen Zhang Alexander Zotov AIFin 214 159 0 24 Sep 2020
Span-based Semantic Parsing for Compositional Generalization Jonathan Herzig Jonathan Berant ReLM LRM 56 102 0 13 Sep 2020
Compositional Generalization via Neural-Symbolic Stack Machines Xinyun Chen Chen Liang Adams Wei Yu D. Song Denny Zhou BDL 53 100 0 15 Aug 2020
Latent Compositional Representations Improve Systematic Generalization in Grounded Question Answering Ben Bogin Sanjay Subramanian Matt Gardner Jonathan Berant ReLM OOD BDL LRM 44 28 0 01 Jul 2020
Language Models are Few-Shot Learners Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan ... Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei BDL 762 42,055 0 28 May 2020
How Can We Accelerate Progress Towards Human-like Linguistic Generalization? Tal Linzen 272 194 0 03 May 2020
Zero-Shot Transfer Learning with Synthesized Data for Multi-Domain Dialogue State Tracking Giovanni Campagna Agata Foryciarz M. Moradshahi M. Lam 63 98 0 02 May 2020
Shortcut Learning in Deep Neural Networks Robert Geirhos J. Jacobsen Claudio Michaelis R. Zemel Wieland Brendel Matthias Bethge Felix Wichmann 206 2,052 0 16 Apr 2020
Adversarial Filters of Dataset Biases Ronan Le Bras Swabha Swayamdipta Chandra Bhagavatula Rowan Zellers Matthew E. Peters Ashish Sabharwal Yejin Choi 100 222 0 10 Feb 2020
Schema2QA: High-Quality and Low-Cost Q&A Agents for the Structured Web Silei Xu Giovanni Campagna Jian Li M. Lam 41 26 0 16 Jan 2020
Measuring Compositional Generalization: A Comprehensive Method on Realistic Data Daniel Keysers Nathanael Scharli Nathan Scales Hylke Buisman Daniel Furrer ... Tibor Tihon Dmitry Tsarkov Tianlin Li Marc van Zee Olivier Bousquet CoGe 66 353 0 20 Dec 2019
Adversarial NLI: A New Benchmark for Natural Language Understanding Yixin Nie Adina Williams Emily Dinan Joey Tianyi Zhou Jason Weston Douwe Kiela 123 1,006 0 31 Oct 2019
BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension M. Lewis Yinhan Liu Naman Goyal Marjan Ghazvininejad Abdel-rahman Mohamed Omer Levy Veselin Stoyanov Luke Zettlemoyer AIMat VLM 249 10,829 0 29 Oct 2019
Don't paraphrase, detect! Rapid and Effective Data Collection for Semantic Parsing Jonathan Herzig Jonathan Berant 46 40 0 26 Aug 2019
Compositional generalization through meta sequence-to-sequence learning Brenden M. Lake CoGe 83 199 0 12 Jun 2019
Good-Enough Compositional Data Augmentation Jacob Andreas 68 234 0 21 Apr 2019
Genie: A Generator of Natural Language Semantic Parsers for Virtual Assistant Commands Giovanni Campagna Silei Xu M. Moradshahi R. Socher M. Lam 30 70 0 18 Apr 2019
Rearranging the Familiar: Testing Compositional Generalization in Recurrent Networks J. Loula Marco Baroni Brenden M. Lake KELM CoGe 50 132 0 19 Jul 2018
Practical Obstacles to Deploying Active Learning David Lowell Zachary Chase Lipton Byron C. Wallace 82 111 0 12 Jul 2018
Improving Text-to-SQL Evaluation Methodology Catherine Finegan-Dollak Jonathan K. Kummerfeld Li Zhang Karthik Ramanathan Sesh Sadasivam Rui Zhang Dragomir R. Radev 81 279 0 23 Jun 2018
Deep Bayesian Active Learning with Image Data Y. Gal Riashat Islam Zoubin Ghahramani BDL UQCV 70 1,735 0 08 Mar 2017