Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?

25 February 2022

Luke Zettlemoyer

Papers citing "Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?"

50 / 977 papers shown

Title
Unifying Image Processing as Visual Prompting Question Answering Yihao Liu Xiangyu Chen Xianzheng Ma Xintao Wang Jiantao Zhou Yu Qiao Chao Dong MLLM 30 18 0 16 Oct 2023
Generative Calibration for In-context Learning Zhongtao Jiang Yuanzhe Zhang Cao Liu Jun Zhao Kang Liu 175 18 0 16 Oct 2023
Large Language Models Meet Open-World Intent Discovery and Recognition: An Evaluation of ChatGPT Xiaoshuai Song Keqing He Pei Wang Guanting Dong Yutao Mou Jingang Wang Yunsen Xian Xunliang Cai Weiran Xu LRM 42 14 0 16 Oct 2023
DemoNSF: A Multi-task Demonstration-based Generative Framework for Noisy Slot Filling Task Guanting Dong Tingfeng Hui Zhuoma Gongque Jinxu Zhao Daichi Guo Gang Zhao Keqing He Weiran Xu DiffM 11 7 0 16 Oct 2023
A Search for Prompts: Generating Structured Answers from Contracts Adam Roegiest Radha Chitta Jonathan Donnelly Maya Lash A. Vtyurina Franccois Longtin ELM AILaw 33 2 0 16 Oct 2023
Assessing the Reliability of Large Language Model Knowledge Weixuan Wang Barry Haddow Alexandra Birch Wei Peng KELM HILM 77 15 0 15 Oct 2023
Enhancing Conversational Search: Large Language Model-Aided Informative Query Rewriting Fanghua Ye Meng Fang Shenghui Li Emine Yilmaz KELM 54 45 0 15 Oct 2023
Configuration Validation with Large Language Models Xinyu Lian Yinfang Chen Runxiang Cheng Jie Huang Parth Thakkar Minjia Zhang Tianyin Xu 21 10 0 15 Oct 2023
Penetrative AI: Making LLMs Comprehend the Physical World Huatao Xu Liying Han Qirui Yang Mo Li Mani Srivastava 17 54 0 14 Oct 2023
Towards Informative Few-Shot Prompt with Maximum Information Gain for In-Context Learning Hongfu Liu Ye Wang 39 9 0 13 Oct 2023
Do pretrained Transformers Learn In-Context by Gradient Descent? Lingfeng Shen Aayush Mishra Daniel Khashabi 39 7 0 12 Oct 2023
Not All Demonstration Examples are Equally Beneficial: Reweighting Demonstration Examples for In-Context Learning Zhe Yang Damai Dai Peiyi Wang Zhifang Sui 42 9 0 12 Oct 2023
Is attention required for ICL? Exploring the Relationship Between Model Architecture and In-Context Learning Ability Ivan Lee Nan Jiang Taylor Berg-Kirkpatrick 48 12 0 12 Oct 2023
In-Context Unlearning: Language Models as Few Shot Unlearners Martin Pawelczyk Seth Neel Himabindu Lakkaraju MU 28 101 0 11 Oct 2023
Large Language Models can Learn Rules Zhaocheng Zhu Yuan Xue Xinyun Chen Denny Zhou Jian Tang Dale Schuurmans Hanjun Dai LRM ReLM 41 63 0 10 Oct 2023
The Limits of ChatGPT in Extracting Aspect-Category-Opinion-Sentiment Quadruples: A Comparative Analysis Xiancai Xu Jia-Dong Zhang Rongchang Xiao Lei Xiong 28 5 0 10 Oct 2023
Selective Demonstrations for Cross-domain Text-to-SQL Shuaichen Chang Eric Fosler-Lussier 20 19 0 10 Oct 2023
Towards Mitigating Hallucination in Large Language Models via Self-Reflection Ziwei Ji Tiezheng Yu Yan Xu Nayeon Lee Etsuko Ishii Pascale Fung HILM 11 57 0 10 Oct 2023
BYOC: Personalized Few-Shot Classification with Co-Authored Class Descriptions Arth Bohra Govert Verkes Artem Harutyunyan Pascal Weinberger Giovanni Campagna 27 5 0 09 Oct 2023
Rephrase, Augment, Reason: Visual Grounding of Questions for Vision-Language Models Archiki Prasad Elias Stengel-Eskin Mohit Bansal ReLM LRM 36 8 0 09 Oct 2023
XAL: EXplainable Active Learning Makes Classifiers Better Low-resource Learners Yun Luo Zhen Yang Fandong Meng Yingjie Li Fang Guo Qinglin Qi Jie Zhou Yue Zhang 26 1 0 09 Oct 2023
Parrot Mind: Towards Explaining the Complex Task Reasoning of Pretrained Large Language Models with Template-Content Structure Haotong Yang Fanxu Meng Zhouchen Lin Muhan Zhang LRM 31 2 0 09 Oct 2023
In-Context Convergence of Transformers Yu Huang Yuan Cheng Yingbin Liang MLT 40 60 0 08 Oct 2023
Resprompt: Residual Connection Prompting Advances Multi-Step Reasoning in Large Language Models Song Jiang Zahra Shakeri Aaron Chan Maziar Sanjabi Hamed Firooz ... Bugra Akyildiz Yizhou Sun Jinchao Li Qifan Wang Asli Celikyilmaz LRM ReLM 26 8 0 07 Oct 2023
DORIS-MAE: Scientific Document Retrieval using Multi-level Aspect-based Queries Jianyou Wang Kaicheng Wang Xiaoyue Wang Prudhviraj Naidu Leon Bergen R. Paturi 45 11 0 07 Oct 2023
Understanding In-Context Learning in Transformers and LLMs by Learning to Learn Discrete Functions S. Bhattamishra Arkil Patel Phil Blunsom Varun Kanade 27 43 0 04 Oct 2023
Ask Again, Then Fail: Large Language Models' Vacillations in Judgment Qiming Xie Zengzhi Wang Yi Feng Rui Xia AAML HILM 35 9 0 03 Oct 2023
PACIT: Unlocking the Power of Examples for Better In-Context Instruction Tuning Tianci Xue Ziqi Wang Yixia Li Yun-Nung Chen Guanhua Chen 26 2 0 02 Oct 2023
Understanding In-Context Learning from Repetitions Jianhao Yan Jin Xu Chiyu Song Chenming Wu Yafu Li Yue Zhang 30 20 0 30 Sep 2023
Batch Calibration: Rethinking Calibration for In-Context Learning and Prompt Engineering Han Zhou Xingchen Wan Lev Proleev Diana Mincu Jilin Chen Katherine A. Heller Subhrajit Roy UQLM 31 53 0 29 Sep 2023
Interpretable Long-Form Legal Question Answering with Retrieval-Augmented Large Language Models Antoine Louis Gijs van Dijck Gerasimos Spanakis ELM AILaw 30 35 0 29 Sep 2023
Stress Testing Chain-of-Thought Prompting for Large Language Models Aayush Mishra Jitin Singla LRM 8 2 0 28 Sep 2023
Identifying and Mitigating Privacy Risks Stemming from Language Models: A Survey Victoria Smith Ali Shahin Shamsabadi Carolyn Ashurst Adrian Weller PILM 32 24 0 27 Sep 2023
HyPoradise: An Open Baseline for Generative Speech Recognition with Large Language Models Cheng Chen Yuchen Hu Chao-Han Huck Yang Sabato Marco Siniscalchi Pin-Yu Chen Eng Siong Chng 32 42 0 27 Sep 2023
Generative Speech Recognition Error Correction with Large Language Models and Task-Activating Prompting Chao-Han Huck Yang Yile Gu Yi-Chieh Liu Shalini Ghosh I. Bulyko A. Stolcke KELM LRM 38 40 0 27 Sep 2023
Knowledgeable In-Context Tuning: Exploring and Exploiting Factual Knowledge for In-Context Learning Jie Wang Chengyu Wang Chuanqi Tan Jun Huang Ming Gao KELM 34 4 0 26 Sep 2023
Grounding Description-Driven Dialogue State Trackers with Knowledge-Seeking Turns Alexandru Coca Bo-Hsiang Tseng J. Chen Weizhe Lin Weixuan Zhang Tisha Anders Bill Byrne 23 0 0 23 Sep 2023
Prompt Tuned Embedding Classification for Multi-Label Industry Sector Allocation V. Buchner Lele Cao Jan-Christoph Kalo Vilhelm von Ehrenheim VLM 39 1 0 21 Sep 2023
Privacy-Preserving In-Context Learning with Differentially Private Few-Shot Generation Xinyu Tang Richard Shin Huseyin A. Inan Andre Manoel Fatemehsadat Mireshghallah Zinan Lin Sivakanth Gopi Janardhan Kulkarni Robert Sim 43 54 0 21 Sep 2023
In-Context Learning for Text Classification with Many Labels Aristides Milios Siva Reddy Dzmitry Bahdanau 22 34 0 19 Sep 2023
Toward Unified Controllable Text Generation via Regular Expression Instruction Xin Zheng Hongyu Lin Xianpei Han Le Sun 54 4 0 19 Sep 2023
Understanding Catastrophic Forgetting in Language Models via Implicit Inference Suhas Kotha Jacob Mitchell Springer Aditi Raghunathan CLL 42 59 0 18 Sep 2023
LLM4Jobs: Unsupervised occupation extraction and standardization leveraging Large Language Models Nan Li Bo Kang T. D. Bie 13 1 0 18 Sep 2023
An Empirical Evaluation of Prompting Strategies for Large Language Models in Zero-Shot Clinical Natural Language Processing Sonish Sivarajkumar Mark Kelley Alyssa Samolyk-Mazzanti Shyam Visweswaran Yanshan Wang LM&MA 46 27 0 14 Sep 2023
Ambiguity-Aware In-Context Learning with Large Language Models Lingyu Gao Aditi Chaudhary Krishna Srinivasan Kazuma Hashimoto K. Raman Michael Bendersky 21 7 0 14 Sep 2023
Are Large Language Model-based Evaluators the Solution to Scaling Up Multilingual Evaluation? Rishav Hada Varun Gumma Adrian de Wynter Harshita Diddee Mohamed Ahmed Monojit Choudhury Kalika Bali Sunayana Sitaram ALM LM&MA ELM 35 63 0 14 Sep 2023
Can Whisper perform speech-based in-context learning? Siyin Wang Chao-Han Huck Yang Ji Wu Chao Zhang 32 25 0 13 Sep 2023
Sensitivity, Performance, Robustness: Deconstructing the Effect of Sociodemographic Prompting Tilman Beck Hendrik Schuff Anne Lauscher Iryna Gurevych 43 33 0 13 Sep 2023
DP-Forward: Fine-tuning and Inference on Language Models with Differential Privacy in Forward Pass Minxin Du Xiang Yue Sherman S. M. Chow Tianhao Wang Chenyu Huang Huan Sun SILM 32 59 0 13 Sep 2023
Query-Dependent Prompt Evaluation and Optimization with Offline Inverse RL Hao Sun Alihan Huyuk M. Schaar OffRL LRM 23 28 0 13 Sep 2023