Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?

25 February 2022

Luke Zettlemoyer

Papers citing "Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?"

50 / 977 papers shown

Title
Gen-Z: Generative Zero-Shot Text Classification with Contextualized Label Descriptions Sachin Kumar Chan Young Park Yulia Tsvetkov VLM 30 2 0 13 Nov 2023
Explain-then-Translate: An Analysis on Improving Program Translation with Self-generated Explanations Zilu Tang Mayank Agarwal Alex Shypula Bailin Wang Derry Wijaya Jie Chen Yoon Kim LRM 37 15 0 13 Nov 2023
Prompt have evil twins Rimon Melamed Lucas H. McCabe T. Wakhare Yejin Kim H. H. Huang Enric Boix-Adsera 36 3 0 13 Nov 2023
Large Language Models are In-context Teachers for Knowledge Reasoning Jiachen Zhao Zonghai Yao Zhichao Yang Hong-ye Yu ReLM LRM 32 1 0 12 Nov 2023
In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space Steering Sheng Liu Haotian Ye Lei Xing James Y. Zou 26 86 0 11 Nov 2023
Chain of Thought with Explicit Evidence Reasoning for Few-shot Relation Extraction Xilai Ma Jing Li Min Zhang ReLM LRM 37 18 0 10 Nov 2023
Interpreting Pretrained Language Models via Concept Bottlenecks Zhen Tan Lu Cheng Song Wang Yuan Bo Wenlin Yao Huan Liu LRM 37 20 0 08 Nov 2023
In-Context Exemplars as Clues to Retrieving from Large Associative Memory Jiachen Zhao 18 7 0 06 Nov 2023
The language of prompting: What linguistic properties make a prompt successful? Alina Leidinger R. Rooij Ekaterina Shutova 41 43 0 03 Nov 2023
Hint-enhanced In-Context Learning wakes Large Language Models up for knowledge-intensive tasks Yifan Wang Qingyan Guo Xinzhe Ni Chufan Shi Lemao Liu Haiyun Jiang Yujiu Yang ReLM RALM 25 8 0 03 Nov 2023
In-Context Prompt Editing For Conditional Audio Generation Ernie Chang Pin-Jie Lin Yang Li Sidd Srinivasan Gaël Le Lan David Kant Yangyang Shi Forrest N. Iandola Vikas Chandra DiffM 30 4 0 01 Nov 2023
Active Instruction Tuning: Improving Cross-Task Generalization by Training on Prompt Sensitive Tasks Po-Nien Kung Fan Yin Di Wu Kai-Wei Chang Nanyun Peng 77 40 0 01 Nov 2023
The Mystery of In-Context Learning: A Comprehensive Survey on Interpretation and Analysis Yuxiang Zhou Jiazheng Li Yanzheng Xiang Hanqi Yan Lin Gui Yulan He 24 14 0 01 Nov 2023
Transformers are Provably Optimal In-context Estimators for Wireless Communications Vishnu Teja Kunde Vicram Rajagopalan Chandra Shekhara Kaushik Valmeekam Krishna R. Narayanan S. Shakkottai D. Kalathil J. Chamberland 37 4 0 01 Nov 2023
Defining a New NLP Playground Sha Li Chi Han Pengfei Yu Carl Edwards Manling Li ... Yi R. Fung Charles Yu Joel R. Tetreault Eduard H. Hovy Heng Ji 41 5 0 31 Oct 2023
Unlearn What You Want to Forget: Efficient Unlearning for LLMs Jiaao Chen Diyi Yang MU 30 137 0 31 Oct 2023
Which Examples to Annotate for In-Context Learning? Towards Effective and Efficient Selection Costas Mavromatis Balasubramaniam Srinivasan Zhengyuan Shen Jiani Zhang Huzefa Rangwala Christos Faloutsos George Karypis 21 21 0 30 Oct 2023
Improving Input-label Mapping with Demonstration Replay for In-context Learning Zhuocheng Gong Jiahao Liu Qifan Wang Jingang Wang Xunliang Cai Dongyan Zhao Rui Yan 26 1 0 30 Oct 2023
MILL: Mutual Verification with Large Language Models for Zero-Shot Query Expansion Pengyue Jia Yiding Liu Xiangyu Zhao Xiaopeng Li Changying Hao Shuaiqiang Wang Dawei Yin 29 16 0 29 Oct 2023
GPT-4 Vision on Medical Image Classification -- A Case Study on COVID-19 Dataset Ruibo Chen Tianyi Xiong Yihan Wu Guodong Liu Zhengmian Hu Lichang Chen Yanshuo Chen Chenxi Liu Heng-Chiao Huang 35 7 0 27 Oct 2023
In-Context Learning Dynamics with Random Binary Sequences Eric J. Bigelow Ekdeep Singh Lubana Robert P. Dick Hidenori Tanaka T. Ullman 34 4 0 26 Oct 2023
Unpacking the Ethical Value Alignment in Big Models Xiaoyuan Yi Jing Yao Xiting Wang Xing Xie 24 11 0 26 Oct 2023
Deja Vu: Contextual Sparsity for Efficient LLMs at Inference Time Zichang Liu Jue Wang Tri Dao Dinesh Manocha Binhang Yuan ... Anshumali Shrivastava Ce Zhang Yuandong Tian Christopher Ré Beidi Chen BDL 25 192 0 26 Oct 2023
Exploring Question Decomposition for Zero-Shot VQA Zaid Khan B. Vijaykumar S. Schulter Manmohan Chandraker Yun Fu ReLM 17 10 0 25 Oct 2023
R $^3$ Prompting: Review, Rephrase and Resolve for Chain-of-Thought Reasoning in Large Language Models under Noisy Context Qingyuan Tian Hanlun Zhu Lei Wang Yang Li Yunshi Lan LRM ReLM 21 7 0 25 Oct 2023
CycleAlign: Iterative Distillation from Black-box LLM to White-box Models for Better Human Alignment Jixiang Hong Quan Tu C. Chen Xing Gao Ji Zhang Rui Yan ALM 34 11 0 25 Oct 2023
Ignore This Title and HackAPrompt: Exposing Systemic Vulnerabilities of LLMs through a Global Scale Prompt Hacking Competition Sander Schulhoff Jeremy Pinto Anaum Khan Louis-Franccois Bouchard Chenglei Si Svetlina Anati Valen Tagliabue Anson Liu Kost Christopher Carnahan Jordan L. Boyd-Graber SILM 39 41 0 24 Oct 2023
Dissecting In-Context Learning of Translations in GPTs Vikas Raunak Hany Awadalla Arul Menezes 50 1 0 24 Oct 2023
Function Vectors in Large Language Models Eric Todd Millicent Li Arnab Sen Sharma Aaron Mueller Byron C. Wallace David Bau 14 102 0 23 Oct 2023
LLM-in-the-loop: Leveraging Large Language Model for Thematic Analysis Shih-Chieh Dai Aiping Xiong Lun-Wei Ku 27 64 0 23 Oct 2023
Statistical Depth for Ranking and Characterizing Transformer-Based Text Embeddings Parker Seegmiller S. Preum 36 3 0 23 Oct 2023
ALCUNA: Large Language Models Meet New Knowledge Xunjian Yin Baizhou Huang Xiaojun Wan 15 24 0 23 Oct 2023
MCC-KD: Multi-CoT Consistent Knowledge Distillation Hongzhan Chen Siyue Wu Xiaojun Quan Rui Wang Ming Yan Ji Zhang LRM 19 17 0 23 Oct 2023
Confronting LLMs with Traditional ML: Rethinking the Fairness of Large Language Models in Tabular Classifications Yanchen Liu Srishti Gautam Jiaqi Ma Himabindu Lakkaraju LMTD 24 12 0 23 Oct 2023
NormDial: A Comparable Bilingual Synthetic Dialog Dataset for Modeling Social Norm Adherence and Violation Aochong Li Mallika Subramanian Arkadiy Saakyan Sky CH-Wang Smaranda Muresan 32 13 0 23 Oct 2023
Transductive Learning for Textual Few-Shot Classification in API-based Embedding Models Pierre Colombo Victor Pellegrain Malik Boudiaf Victor Storchan Myriam Tami Ismail Ben Ayed C´eline Hudelot Pablo Piantanida 38 8 0 21 Oct 2023
Evoke: Evoking Critical Thinking Abilities in LLMs via Reviewer-Author Prompt Editing Xinyu Hu Pengfei Tang Simiao Zuo Zihan Wang Bowen Song Qiang Lou Jian Jiao Denis Xavier Charles LRM 40 7 0 20 Oct 2023
Mind the instructions: a holistic evaluation of consistency and interactions in prompt-based learning Lucas Weber Elia Bruni Dieuwke Hupkes 32 25 0 20 Oct 2023
Steering Large Language Models for Machine Translation with Finetuning and In-Context Learning Duarte M. Alves Nuno M. Guerreiro Joao Alves José P. Pombal Ricardo Rei José G. C. de Souza Pierre Colombo André F.T. Martins 47 49 0 20 Oct 2023
Are Structural Concepts Universal in Transformer Language Models? Towards Interpretable Cross-Lingual Generalization Ningyu Xu Qi Zhang Jingting Ye Menghan Zhang Xuanjing Huang 41 4 0 19 Oct 2023
Large Language Model for Multi-objective Evolutionary Optimization Fei Liu Xi Lin Zhenkun Wang Shunyu Yao Xialiang Tong Mingxuan Yuan Qingfu Zhang 24 39 0 19 Oct 2023
Reliable Academic Conference Question Answering: A Study Based on Large Language Model Zhiwei Huang Long Jin Junjie Wang Mingchen Tu Yin Hua Zhiqiang Liu Jiawei Meng Hua-zeng Chen Wen Zhang 34 0 0 19 Oct 2023
GraphGPT: Graph Instruction Tuning for Large Language Models Jiabin Tang Yuhao Yang Wei Wei Lei Shi Lixin Su Suqi Cheng Dawei Yin Chao Huang 34 123 0 19 Oct 2023
Exploring In-Context Learning of Textless Speech Language Model for Speech Classification Tasks Ming-Hao Hsu Kai-Wei Chang Shang-Wen Li Hung-yi Lee 34 8 0 19 Oct 2023
MusicAgent: An AI Agent for Music Understanding and Generation with Large Language Models Dingyao Yu Kaitao Song Peiling Lu Tianyu He Xu Tan Wei Ye Shikun Zhang Jiang Bian LLMAG 27 16 0 18 Oct 2023
Multi-stage Large Language Model Correction for Speech Recognition Jie Pu Thai-Son Nguyen Sebastian Stüker LRM 35 6 0 17 Oct 2023
Document-Level In-Context Few-Shot Relation Extraction via Pre-Trained Language Models Yilmazcan Ozyurt Stefan Feuerriegel Ce Zhang 26 1 0 17 Oct 2023
IDEAL: Influence-Driven Selective Annotations Empower In-Context Learners in Large Language Models Shaokun Zhang Xiaobo Xia Zhaoqing Wang Ling-Hao Chen Jiale Liu Qingyun Wu Tongliang Liu 42 20 0 16 Oct 2023
How Do Transformers Learn In-Context Beyond Simple Functions? A Case Study on Learning with Representations Tianyu Guo Wei Hu Song Mei Huan Wang Caiming Xiong Silvio Savarese Yu Bai 27 48 0 16 Oct 2023
Demonstrations Are All You Need: Advancing Offensive Content Paraphrasing using In-Context Learning Anirudh Som Karan Sikka Helen Gent Ajay Divakaran A. Kathol D. Vergyri 24 4 0 16 Oct 2023