Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?

25 February 2022

Luke Zettlemoyer

Papers citing "Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?"

50 / 977 papers shown

Title
Text Encoders Lack Knowledge: Leveraging Generative LLMs for Domain-Specific Semantic Textual Similarity Joseph Gatto Omar Sharif Parker Seegmiller Philip Bohlman S. Preum 22 8 0 12 Sep 2023
Breaking through the learning plateaus of in-context learning in Transformer Jingwen Fu Tao Yang Yuwang Wang Yan Lu Nanning Zheng 30 1 0 12 Sep 2023
Uncovering mesa-optimization algorithms in Transformers J. Oswald Eyvind Niklasson Maximilian Schlegel Seijin Kobayashi Nicolas Zucchet ... Mark Sandler Blaise Agüera y Arcas Max Vladymyrov Razvan Pascanu João Sacramento 32 54 0 11 Sep 2023
Leveraging Large Language Models for Exploiting ASR Uncertainty Pranay Dighe Yi Su Shangshang Zheng Yunshu Liu Vineet Garg Xiaochuan Niu Ahmed H. Tewfik 13 12 0 09 Sep 2023
EPA: Easy Prompt Augmentation on Large Language Models via Multiple Sources and Multiple Targets Hongyuan Lu Wai Lam 26 1 0 09 Sep 2023
Matching Table Metadata with Business Glossaries Using Large Language Models Elita Lobo Oktie Hassanzadeh Nhan Pham Nandana Mihindukulasooriya D. Subramanian Horst Samulowitz 16 3 0 08 Sep 2023
Gender-specific Machine Translation with Large Language Models Eduardo Sánchez Pierre Yves Andrews Pontus Stenetorp Mikel Artetxe Marta R. Costa-jussá 35 2 0 06 Sep 2023
Business Process Text Sketch Automation Generation Using Large Language Model Rui Zhu Quanzhou Hu Wenxin Li Honghao Xiao Chaogang Wang Zixin Zhou 21 1 0 03 Sep 2023
Use of LLMs for Illicit Purposes: Threats, Prevention Measures, and Vulnerabilities Maximilian Mozes Xuanli He Bennett Kleinberg Lewis D. Griffin 39 78 0 24 Aug 2023
GPTEval: A Survey on Assessments of ChatGPT and GPT-4 Rui Mao Guanyi Chen Xulang Zhang Frank Guerin Min Zhang ELM LM&MA 38 101 0 24 Aug 2023
Prompt2Model: Generating Deployable Models from Natural Language Instructions Vijay Viswanathan Chenyang Zhao Amanda Bertsch Tongshuang Wu Graham Neubig 33 36 0 23 Aug 2023
Efficient Benchmarking of Language Models Yotam Perlitz Elron Bandel Ariel Gera Ofir Arviv L. Ein-Dor Eyal Shnarch Noam Slonim Michal Shmueli-Scheuer Leshem Choshen ALM 24 24 0 22 Aug 2023
CharacterChat: Learning towards Conversational AI with Personalized Social Support Quan Tu Chuanqi Chen Jinpeng Li Yanran Li Shuo Shang Dongyan Zhao R. Wang Rui Yan 21 51 0 20 Aug 2023
HICL: Hashtag-Driven In-Context Learning for Social Media Natural Language Understanding Hanzhuo Tan Chunpu Xu Jing Li Yuqun Zhang Zeyang Fang Zeyu Chen Baohua Lai 16 0 0 19 Aug 2023
Characterizing Information Seeking Events in Health-Related Social Discourse Omar Sharif Madhusudan Basak Tanzia Parvin Ava Scharfstein Alphonso Bradham J. Borodovsky S. Lord S. Preum 29 7 0 17 Aug 2023
Exploring Demonstration Ensembling for In-context Learning Muhammad Khalifa Lajanugen Logeswaran Moontae Lee Honglak Lee Lu Wang AIMat 36 7 0 17 Aug 2023
DiagGPT: An LLM-based and Multi-agent Dialogue System with Automatic Topic Management for Flexible Task-Oriented Dialogue Lang Cao LM&MA LLMAG 38 3 0 15 Aug 2023
Link-Context Learning for Multimodal LLMs Yan Tai Weichen Fan Zhao Zhang Feng Zhu Rui Zhao Ziwei Liu ReLM LRM 26 17 0 15 Aug 2023
Robustness Over Time: Understanding Adversarial Examples' Effectiveness on Longitudinal Versions of Large Language Models Yugeng Liu Tianshuo Cong Zhengyu Zhao Michael Backes Yun Shen Yang Zhang AAML 41 6 0 15 Aug 2023
Interpretable Online Log Analysis Using Large Language Models with Prompt Strategies Yilun Liu Shimin Tao Weibin Meng Jingyu Wang Wenbing Ma Yanqing Zhao Yuhang Chen Hao Yang Yanfei Jiang Xun Chen 45 24 0 15 Aug 2023
Dialogue for Prompting: a Policy-Gradient-Based Discrete Prompt Generation for Few-shot Learning Chengzhengxu Li Xiaoming Liu Yichen Wang Duyi Li Y. Lan Chao Shen 34 5 0 14 Aug 2023
CausalLM is not optimal for in-context learning Nan Ding Tomer Levinboim Jialin Wu Sebastian Goodman Radu Soricut 24 24 0 14 Aug 2023
Dynamic Planning with a LLM Gautier Dagan Frank Keller A. Lascarides LLMAG 92 35 0 11 Aug 2023
LayoutLLM-T2I: Eliciting Layout Guidance from LLM for Text-to-Image Generation Leigang Qu Shengqiong Wu Hao Fei Liqiang Nie Tat-Seng Chua LM&Ro DiffM MLLM 35 88 0 09 Aug 2023
Collective Human Opinions in Semantic Textual Similarity Yuxia Wang Shimin Tao Ning Xie Hao Yang Timothy Baldwin Karin Verspoor 29 4 0 08 Aug 2023
"Do Anything Now": Characterizing and Evaluating In-The-Wild Jailbreak Prompts on Large Language Models Xinyue Shen Zhenpeng Chen Michael Backes Yun Shen Yang Zhang SILM 40 249 0 07 Aug 2023
Mondrian: Prompt Abstraction Attack Against Large Language Models for Cheaper API Pricing Waiman Si Michael Backes Yang Zhang 30 5 0 07 Aug 2023
Pre-Trained Large Language Models for Industrial Control Lei Song Chuheng Zhang Li Zhao Jiang Bian LM&Ro AI4CE 32 12 0 06 Aug 2023
Text2KGBench: A Benchmark for Ontology-Driven Knowledge Graph Generation from Text Nandana Mihindukulasooriya Sanju Tiwari Carlos F. Enguix K. Lata 31 53 0 04 Aug 2023
Does Correction Remain A Problem For Large Language Models? Xiaowu Zhang Xiaotian Zhang Cheng Yang Hang Yan Xipeng Qiu LRM KELM 14 5 0 03 Aug 2023
Is GPT-4 a reliable rater? Evaluating Consistency in GPT-4 Text Ratings Veronika Hackl Alexandra Elena Müller Michael Granitzer Maximilian Sailer ALM 17 44 0 03 Aug 2023
Evaluating Instruction-Tuned Large Language Models on Code Comprehension and Generation Zhiqiang Yuan Junwei Liu Qiancheng Zi Mingwei Liu Xin Peng Yiling Lou ALM ELM LRM 17 73 0 02 Aug 2023
Instructed to Bias: Instruction-Tuned Language Models Exhibit Emergent Cognitive Bias Itay Itzhak Gabriel Stanovsky Nir Rosenfeld Yonatan Belinkov 27 20 0 01 Aug 2023
Alpha-GPT: Human-AI Interactive Alpha Mining for Quantitative Investment Sai Wang Hang Yuan Leon Zhou L. Ni H. Shum Jian Guo 36 20 0 31 Jul 2023
On the Trustworthiness Landscape of State-of-the-art Generative Models: A Survey and Outlook Mingyuan Fan Chengyu Wang Cen Chen Yang Liu Jun Huang HILM 39 3 0 31 Jul 2023
When Large Language Models Meet Personalization: Perspectives of Challenges and Opportunities Jin Chen Zheng Liu Xunpeng Huang Chenwang Wu Qi Liu ... Yuxuan Lei Xiaolong Chen Xingmei Wang Defu Lian Enhong Chen ALM 35 111 0 31 Jul 2023
Investigating the Learning Behaviour of In-context Learning: A Comparison with Supervised Learning Xindi Wang Yufei Wang Can Xu Xiubo Geng Bowen Zhang Chongyang Tao Frank Rudzicz Robert E. Mercer Daxin Jiang 33 11 0 28 Jul 2023
In-Context Learning Learns Label Relationships but Is Not Conventional Learning Jannik Kossen Y. Gal Tom Rainforth 40 28 0 23 Jul 2023
Instruction-following Evaluation through Verbalizer Manipulation Shiyang Li Jun Yan Hai Wang Zheng Tang Xiang Ren Vijay Srinivasan Hongxia Jin 36 25 0 20 Jul 2023
Overthinking the Truth: Understanding how Language Models Process False Demonstrations Danny Halawi Jean-Stanislas Denain Jacob Steinhardt 33 54 0 18 Jul 2023
Language Conditioned Traffic Generation Shuhan Tan Boris Ivanovic Xinshuo Weng Marco Pavone Philipp Kraehenbuehl 30 48 0 16 Jul 2023
SINC: Self-Supervised In-Context Learning for Vision-Language Tasks Yi-Syuan Chen Yun-Zhu Song Cheng Yu Yeo Bei Liu Jianlong Fu Hong-Han Shuai VLM LRM 26 4 0 15 Jul 2023
C3: Zero-shot Text-to-SQL with ChatGPT Xuemei Dong C. Zhang Yuhang Ge Yuren Mao Yunjun Gao Lu Chen Jinshu Lin Dongfang Lou 14 127 0 14 Jul 2023
Learning to Retrieve In-Context Examples for Large Language Models Liang Wang Nan Yang Furu Wei RALM 36 38 0 14 Jul 2023
Retrieval-augmented GPT-3.5-based Text-to-SQL Framework with Sample-aware Prompting and Dynamic Revision Chain Chunxi Guo Zhiliang Tian Jintao Tang Shasha Li Zhihua Wen Kaixuan Wang Ting Wang RALM 26 17 0 11 Jul 2023
Towards Understanding In-Context Learning with Contrastive Demonstrations and Saliency Maps Fuxiao Liu Paiheng Xu Zongxi Li Yue Feng Hyemi Song 21 31 0 11 Jul 2023
Large Language Models as General Pattern Machines Suvir Mirchandani F. Xia Peter R. Florence Brian Ichter Danny Driess Montse Gonzalez Arenas Kanishka Rao Dorsa Sadigh Andy Zeng LLMAG 57 185 0 10 Jul 2023
One Step of Gradient Descent is Provably the Optimal In-Context Learner with One Layer of Linear Self-Attention Arvind V. Mahankali Tatsunori B. Hashimoto Tengyu Ma MLT 18 80 0 07 Jul 2023
Teaching Arithmetic to Small Transformers Nayoung Lee Kartik K. Sreenivasan Jason D. Lee Kangwook Lee Dimitris Papailiopoulos LRM 32 81 0 07 Jul 2023
Scaling In-Context Demonstrations with Structured Attention Tianle Cai Kaixuan Huang Jason D. Lee Mengdi Wang LRM 33 8 0 05 Jul 2023