Diverse Demonstrations Improve In-context Compositional Generalization

13 December 2022

Papers citing "Diverse Demonstrations Improve In-context Compositional Generalization"

49 / 49 papers shown

Title
Exploring the Role of Diversity in Example Selection for In-Context Learning Janak Kapuriya Manit Kaushik Debasis Ganguly S. Bhatia 85 0 0 03 May 2025
Problem-Solving Logic Guided Curriculum In-Context Learning for LLMs Complex Reasoning Xuetao Ma Wenbin Jiang Hua Huang LRM 81 3 0 21 Feb 2025
In-Context Learning with Iterative Demonstration Selection Chengwei Qin Aston Zhang Chong Chen Anirudh Dagar Wenming Ye LRM 108 46 0 31 Dec 2024
In-Context Learning Enables Robot Action Prediction in LLMs Yida Yin Zekai Wang Yuvan Sharma Dantong Niu Trevor Darrell Roei Herzig LM&Ro 154 4 0 16 Oct 2024
GraphIC: A Graph-Based In-Context Example Retrieval Model for Multi-Step Reasoning Jiale Fu Yaqing Wang Simeng Han Jiaming Fan Chen Si 65 1 0 03 Oct 2024
E-ICL: Enhancing Fine-Grained Emotion Recognition through the Lens of Prototype Theory Zhou Yang Zhou Yang Chenglong Ye Yufeng Wang Haizhou Sun Chao Chen Xiaofei Zhu Yunbing Wu Xiangwen Liao 109 1 0 04 Jun 2024
Lifelong Knowledge Editing for LLMs with Retrieval-Augmented Continuous Prompt Learning Qizhou Chen Taolin Zhang Xiaofeng He Dongyang Li Chengyu Wang Longtao Huang Hui Xue CLL KELM 75 11 0 06 May 2024
In-Context Learning with Long-Context Models: An In-Depth Exploration Amanda Bertsch Maor Ivgi Uri Alon Jonathan Berant Matthew R. Gormley Matthew R. Gormley Graham Neubig ReLM AIMat 128 74 0 30 Apr 2024
Specification Overfitting in Artificial Intelligence Benjamin Roth Pedro Henrique Luz de Araujo Yuxi Xia Saskia Kaltenbrunner Christoph Korab 117 1 0 13 Mar 2024
Diverse Multi-Answer Retrieval with Determinantal Point Processes Poojitha Nandigam Nikhil Rayaprolu Manish Shrivastava 42 1 0 29 Nov 2022
Complementary Explanations for Effective In-Context Learning Xi Ye Srini Iyer Asli Celikyilmaz Ves Stoyanov Greg Durrett Ramakanth Pasunuru ReLM LRM 45 89 0 25 Nov 2022
On the Compositional Generalization Gap of In-Context Learning Arian Hosseini Ankit Vani Dzmitry Bahdanau Alessandro Sordoni Rameswar Panda 41 25 0 15 Nov 2022
State-of-the-art generalisation research in NLP: A taxonomy and review Dieuwke Hupkes Mario Giulianelli Verna Dankers Mikel Artetxe Yanai Elazar ... Leila Khalatbari Maria Ryskina Rita Frieske Ryan Cotterell Zhijing Jin 182 95 0 06 Oct 2022
Complexity-Based Prompting for Multi-Step Reasoning Yao Fu Hao-Chun Peng Ashish Sabharwal Peter Clark Tushar Khot ReLM LRM 180 420 0 03 Oct 2022
Compositional Semantic Parsing with Large Language Models Andrew Drozdov Nathanael Scharli Ekin Akyuurek Nathan Scales Xinying Song Xinyun Chen Olivier Bousquet Denny Zhou ReLM LRM 234 92 0 29 Sep 2022
Generate-and-Retrieve: use your predictions to improve retrieval for semantic parsing Yury Zemlyanskiy Michiel de Jong Joshua Ainslie Panupong Pasupat Peter Shaw Linlu Qiu Sumit Sanghai Fei Sha RALM 150 17 0 29 Sep 2022
Selective Annotation Makes Language Models Better Few-Shot Learners Hongjin Su Jungo Kasai Chen Henry Wu Weijia Shi Tianlu Wang ... Rui Zhang Mari Ostendorf Luke Zettlemoyer Noah A. Smith Tao Yu 65 251 0 05 Sep 2022
Simplifying Semantic Annotations of SMCalFlow J. Meron 24 7 0 27 Jun 2022
Evaluating the Impact of Model Scale for Compositional Generalization in Semantic Parsing Linlu Qiu Peter Shaw Panupong Pasupat Tianze Shi Jonathan Herzig Emily Pitler Fei Sha Kristina Toutanova AI4CE LRM 59 52 0 24 May 2022
A Well-Composed Text is Half Done! Composition Sampling for Diverse Conditional Generation Shashi Narayan Gonccalo Simoes Yao-Min Zhao Joshua Maynez Dipanjan Das Michael Collins Mirella Lapata 53 30 0 28 Mar 2022
Structurally Diverse Sampling for Sample-Efficient Training and Comprehensive Evaluation Shivanshu Gupta Sameer Singh Matt Gardner 59 7 0 16 Mar 2022
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 670 12,525 0 04 Mar 2022
Submodlib: A Submodular Optimization Library Vishal Kaushal Ganesh Ramakrishnan Rishabh K. Iyer 59 12 0 22 Feb 2022
Unobserved Local Structures Make Compositional Generalization Hard Ben Bogin Shivanshu Gupta Jonathan Berant CoGe 49 33 0 15 Jan 2022
Learning To Retrieve Prompts for In-Context Learning Ohad Rubin Jonathan Herzig Jonathan Berant VPVLM RALM 43 679 0 16 Dec 2021
Improving Compositional Generalization with Latent Structure and Data Augmentation Linlu Qiu Peter Shaw Panupong Pasupat Pawel Krzysztof Nowak Tal Linzen Fei Sha Kristina Toutanova CoGe 44 57 0 14 Dec 2021
MetaICL: Learning to Learn In Context Sewon Min M. Lewis Luke Zettlemoyer Hannaneh Hajishirzi LRM 168 483 0 29 Oct 2021
Controllable Semantic Parsing via Retrieval Augmentation Panupong Pasupat Yuan Zhang Kelvin Guu 168 47 0 16 Oct 2021
Meta-learning via Language Model In-context Tuning Yanda Chen Ruiqi Zhong Sheng Zha George Karypis He He 273 160 0 15 Oct 2021
RETRONLU: Retrieval Augmented Task-Oriented Semantic Parsing Vivek Gupta Akshat Shrivastava Adithya Sagar Armen Aghajanyan Denis Savenkov RALM 60 21 0 21 Sep 2021
Finding needles in a haystack: Sampling Structurally-diverse Training Sets from Synthetic Data for Compositional Generalization I. Oren Jonathan Herzig Jonathan Berant 45 31 0 06 Sep 2021
Evaluating Large Language Models Trained on Code Mark Chen Jerry Tworek Heewoo Jun Qiming Yuan Henrique Pondé ... Bob McGrew Dario Amodei Sam McCandlish Ilya Sutskever Wojciech Zaremba ELM ALM 146 5,328 0 07 Jul 2021
Determinantal Beam Search Clara Meister Martina Forster Ryan Cotterell 29 13 0 14 Jun 2021
Meta-Learning to Compositionally Generalize Henry Conklin Bailin Wang Kenny Smith Ivan Titov OOD 72 74 0 08 Jun 2021
Joint Passage Ranking for Diverse Multi-Answer Retrieval Sewon Min Kenton Lee Ming-Wei Chang Kristina Toutanova Hannaneh Hajishirzi 62 39 0 17 Apr 2021
What Makes Good In-Context Examples for GPT- $3$ ? Jiachang Liu Dinghan Shen Yizhe Zhang Bill Dolan Lawrence Carin Weizhu Chen AAML RALM 324 1,343 0 17 Jan 2021
Compositional Generalization and Natural Language Variation: Can a Semantic Parsing Approach Handle Both? Peter Shaw Ming-Wei Chang Panupong Pasupat Kristina Toutanova CoGe 54 184 0 24 Oct 2020
Task-Oriented Dialogue as Dataflow Synthesis Semantic Machines Jacob Andreas J. Bufe David Burkett Charles C. Chen ... Izabela Witoszko Jason Wolfe A. Wray Yuchen Zhang Alexander Zotov AIFin 204 155 0 24 Sep 2020
Compositional Generalization in Semantic Parsing: Pre-training vs. Specialized Architectures Daniel Furrer Marc van Zee Nathan Scales Nathanael Scharli CoGe 56 114 0 17 Jul 2020
Language Models are Few-Shot Learners Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan ... Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei BDL 450 41,106 0 28 May 2020
Measuring Compositional Generalization: A Comprehensive Method on Realistic Data Daniel Keysers Nathanael Scharli Nathan Scales Hylke Buisman Daniel Furrer ... Tibor Tihon Dmitry Tsarkov Tianlin Li Marc van Zee Olivier Bousquet CoGe 50 350 0 20 Dec 2019
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer Colin Raffel Noam M. Shazeer Adam Roberts Katherine Lee Sharan Narang Michael Matena Yanqi Zhou Wei Li Peter J. Liu AIMat 254 19,824 0 23 Oct 2019
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks Nils Reimers Iryna Gurevych 545 11,979 0 27 Aug 2019
Don't paraphrase, detect! Rapid and Effective Data Collection for Semantic Parsing Jonathan Herzig Jonathan Berant 27 40 0 26 Aug 2019
Compositional generalization through meta sequence-to-sequence learning Brenden M. Lake CoGe 61 198 0 12 Jun 2019
Improving Text-to-SQL Evaluation Methodology Catherine Finegan-Dollak Jonathan K. Kummerfeld Li Zhang Karthik Ramanathan Sesh Sadasivam Rui Zhang Dragomir R. Radev 72 279 0 23 Jun 2018
AllenNLP: A Deep Semantic Natural Language Processing Platform Matt Gardner Joel Grus Mark Neumann Oyvind Tafjord Pradeep Dasigi Nelson F. Liu Matthew E. Peters Michael Schmitz Luke Zettlemoyer VLM 45 1,280 0 20 Mar 2018
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 752 11,793 0 09 Mar 2017
Determinantal point processes for machine learning Alex Kulesza B. Taskar 211 1,130 0 25 Jul 2012