Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?

25 February 2022

Luke Zettlemoyer

Papers citing "Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?"

50 / 973 papers shown

Title
Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Prompting Miles Turpin Julian Michael Ethan Perez Sam Bowman ReLM LRM 27 383 0 07 May 2023
In-context Learning as Maintaining Coherency: A Study of On-the-fly Machine Translation Using Large Language Models Suzanna Sia Kevin Duh LRM 21 17 0 05 May 2023
GPT-RE: In-context Learning for Relation Extraction using Large Language Models Michele Focchi Fei Cheng Zhuoyuan Mao Qianying Liu Haiyue Song Jiwei Li Sadao Kurohashi LRM 41 90 0 03 May 2023
Few-shot In-context Learning for Knowledge Base Question Answering Tianle Li Xueguang Ma Alex Zhuang Yu Gu Yu-Chuan Su Wenhu Chen 96 76 0 02 May 2023
Don't Stop Pretraining? Make Prompt-based Fine-tuning Powerful Learner Zhengxiang Shi Aldo Lipani VLM CLL 37 21 0 02 May 2023
Privacy-Preserving In-Context Learning for Large Language Models Tong Wu Ashwinee Panda Jiachen T. Wang Prateek Mittal 51 29 0 02 May 2023
From Words to Code: Harnessing Data for Program Synthesis from Natural Language Anirudh Khatry Joyce Cahoon Jordan Henkel Shaleen Deep Venkatesh Emani ... Vu Le Mohammad Raza Sherry Shi Mukul Singh A. Tiwari 39 12 0 02 May 2023
In-Context Learning Unlocked for Diffusion Models Zhendong Wang Yi Ding Yadong Lu Yelong Shen Pengcheng He Weizhu Chen Zhangyang Wang Mingyuan Zhou VLM DiffM 94 68 0 01 May 2023
MLCopilot: Unleashing the Power of Large Language Models in Solving Machine Learning Tasks Lei Zhang Yuge Zhang Kan Ren Dongsheng Li Yuqing Yang LLMAG 25 35 0 28 Apr 2023
Large Language Models are Strong Zero-Shot Retriever Tao Shen Guodong Long Xiubo Geng Chongyang Tao Dinesh Manocha Daxin Jiang RALM KELM 50 34 0 27 Apr 2023
Transferring Procedural Knowledge across Commonsense Tasks Yifan Jiang Filip Ilievski Kaixin Ma 31 2 0 26 Apr 2023
A Latent Space Theory for Emergent Abilities in Large Language Models Hui Jiang LRM 25 35 0 19 Apr 2023
BIM-GPT: a Prompt-Based Virtual Assistant Framework for BIM Information Retrieval Junwen Zheng M. Fischer 24 13 0 18 Apr 2023
In ChatGPT We Trust? Measuring and Characterizing the Reliability of ChatGPT Xinyue Shen Z. Chen Michael Backes Yang Zhang 24 55 0 18 Apr 2023
Towards Robust Prompts on Vision-Language Models Jindong Gu Ahmad Beirami Xuezhi Wang Alex Beutel Philip H. S. Torr Yao Qin VLM VPVLM 35 8 0 17 Apr 2023
Low-code LLM: Graphical User Interface over Large Language Models Yuzhe Cai Shaoguang Mao Wenshan Wu Zehua Wang Yaobo Liang ... Ting Song Yan Xia Jonathan Tien Nan Duan Furu Wei 26 13 0 17 Apr 2023
Exploring Effective Factors for Improving Visual In-Context Learning Yanpeng Sun Qiang Chen Jian Wang Jingdong Wang Zechao Li LRM VLM 48 24 0 10 Apr 2023
Multilingual Machine Translation with Large Language Models: Empirical Results and Analysis Wenhao Zhu Hongyi Liu Qingxiu Dong Jingjing Xu Shujian Huang Lingpeng Kong Jiajun Chen Lei Li LRM 29 140 0 10 Apr 2023
ParroT: Translating during Chat using Large Language Models tuned with Human Translation and Feedback Wenxiang Jiao Jen-tse Huang Wenxuan Wang Zhiwei He Tian Liang Xing Wang Shuming Shi Zhaopeng Tu ALM 46 44 0 05 Apr 2023
HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Face Yongliang Shen Kaitao Song Xu Tan Dongsheng Li Weiming Lu Y. Zhuang MLLM 20 844 0 30 Mar 2023
DERA: Enhancing Large Language Model Completions with Dialog-Enabled Resolving Agents Varun Nair Elliot Schumacher Geoffrey Tso Anitha Kannan VLM 19 62 0 30 Mar 2023
ChatGPT4PCG Competition: Character-like Level Generation for Science Birds Pittawat Taveekitworachai Febri Abdullah Mury F. Dewantoro R. Thawonmas Julian Togelius Jochen Renz 23 17 0 28 Mar 2023
Unified Text Structuralization with Instruction-tuned Language Models Xuanfan Ni Piji Li Huayang Li 36 13 0 27 Mar 2023
GPT is becoming a Turing machine: Here are some ways to program it A. Jojic Zhen Wang Nebojsa Jojic LRM 55 17 0 25 Mar 2023
Scaling Expert Language Models with Unsupervised Domain Discovery Suchin Gururangan Margaret Li M. Lewis Weijia Shi Tim Althoff Noah A. Smith Luke Zettlemoyer MoE 25 46 0 24 Mar 2023
Can we trust the evaluation on ChatGPT? Rachith Aiyappa Jisun An Haewoon Kwak Yong-Yeol Ahn ELM ALM LLMAG AI4MH LRM 120 87 0 22 Mar 2023
Language Model Behavior: A Comprehensive Survey Tyler A. Chang Benjamin Bergen VLM LRM LM&MA 27 103 0 20 Mar 2023
Large Language Model Instruction Following: A Survey of Progresses and Challenges Renze Lou Kai Zhang Wenpeng Yin ALM LRM 29 20 0 18 Mar 2023
How Many Demonstrations Do You Need for In-context Learning? Jiuhai Chen Lichang Chen Chen Zhu Dinesh Manocha LRM 24 39 0 14 Mar 2023
A Theory of Emergent In-Context Learning as Implicit Structure Induction Michael Hahn Navin Goyal LRM 8 74 0 14 Mar 2023
The Learnability of In-Context Learning Noam Wies Yoav Levine Amnon Shashua 122 91 0 14 Mar 2023
The Life Cycle of Knowledge in Big Language Models: A Survey Boxi Cao Hongyu Lin Xianpei Han Le Sun KELM 33 27 0 14 Mar 2023
From Visual Prompt Learning to Zero-Shot Transfer: Mapping Is All You Need Ziqing Yang Zeyang Sha Michael Backes Yang Zhang VPVLM VLM 37 3 0 09 Mar 2023
Larger language models do in-context learning differently Jerry W. Wei Jason W. Wei Yi Tay Dustin Tran Albert Webson ... Xinyun Chen Hanxiao Liu Da Huang Denny Zhou Tengyu Ma ReLM LRM 31 353 0 07 Mar 2023
Mixture of Soft Prompts for Controllable Data Generation Derek Chen Celine Lee Yunan Lu Domenic Rosati Zhou Yu 114 22 0 02 Mar 2023
EvoPrompting: Language Models for Code-Level Neural Architecture Search Angelica Chen David Dohan David R. So VLM LRM 26 83 0 28 Feb 2023
Investigating the Effectiveness of Task-Agnostic Prefix Prompt for Instruction Following Seonghyeon Ye Hyeonbin Hwang Sohee Yang Hyeongu Yun Yireun Kim Minjoon Seo LRM 32 34 0 28 Feb 2023
Zero-Shot Cross-Lingual Summarization via Large Language Models Jiaan Wang Yunlong Liang Fandong Meng Beiqi Zou Zhixu Li Jianfeng Qu Jie Zhou ELM 26 28 0 28 Feb 2023
Finding Support Examples for In-Context Learning Xiaonan Li Xipeng Qiu 22 87 0 27 Feb 2023
Pre-Finetuning for Few-Shot Emotional Speech Recognition Maximillian Chen Zhou Yu 29 3 0 24 Feb 2023
On the Robustness of ChatGPT: An Adversarial and Out-of-distribution Perspective Jindong Wang Xixu Hu Wenxin Hou Hao Chen Runkai Zheng ... Weirong Ye Xiubo Geng Binxing Jiao Yue Zhang Xingxu Xie AI4MH 52 220 0 22 Feb 2023
In-context Example Selection with Influences Nguyen Tai Eric Wong 13 48 0 21 Feb 2023
Few-shot Multimodal Multitask Multilingual Learning Aman Chadha Vinija Jain 50 0 0 19 Feb 2023
How Good Are GPT Models at Machine Translation? A Comprehensive Evaluation Amr Hendy M. Abdelrehim Amr Sharaf Vikas Raunak Mohamed Gabr Hitokazu Matsushita Young Jin Kim Mohamed Afify Hany Awadalla ELM LM&MA AI4CE 31 413 0 18 Feb 2023
Bounding the Capabilities of Large Language Models in Open Text Generation with Prompt Constraints Albert Lu Hongxin Zhang Yanzhe Zhang Xuezhi Wang Diyi Yang LRM 32 28 0 17 Feb 2023
Complex QA and language models hybrid architectures, Survey Xavier Daull P. Bellot Emmanuel Bruno Vincent Martin Elisabeth Murisasco ELM 28 15 0 17 Feb 2023
Auditing large language models: a three-layered approach Jakob Mokander Jonas Schuett Hannah Rose Kirk Luciano Floridi AILaw MLAU 48 194 0 16 Feb 2023
Augmented Language Models: a Survey Grégoire Mialon Roberto Dessì Maria Lomeli Christoforos Nalmpantis Ramakanth Pasunuru ... Jane Dwivedi-Yu Asli Celikyilmaz Edouard Grave Yann LeCun Thomas Scialom LRM KELM 47 367 0 15 Feb 2023
ScatterShot: Interactive In-context Example Curation for Text Transformation Tongshuang Wu Hua Shen Daniel S. Weld Jeffrey Heer Marco Tulio Ribeiro 19 24 0 14 Feb 2023
Gradient-Based Automated Iterative Recovery for Parameter-Efficient Tuning Maximilian Mozes Tolga Bolukbasi Ann Yuan Frederick Liu Nithum Thain Lucas Dixon 40 4 0 13 Feb 2023