Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?

25 February 2022

Luke Zettlemoyer

Papers citing "Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?"

50 / 973 papers shown

Title
FactFlow: Automatic Fact Sheet Generation and Customization from Tabular Dataset via AI Chain Design & Implementation Minh Duc Vu Jieshan Chen Zhenchang Xing Qinghua Lu Xiwei Xu Qian Fu 81 0 0 25 Feb 2025
Can Large Language Models Extract Customer Needs as well as Professional Analysts? Artem Timoshenko Chengfeng Mao J. Hauser ELM 52 0 0 25 Feb 2025
In-context learning of evolving data streams with tabular foundational models Afonso Lourenço João Gama Eric P. Xing Goreti Marreiros 61 0 0 24 Feb 2025
Representation Engineering for Large-Language Models: Survey and Research Challenges Lukasz Bartoszcze Sarthak Munshi Bryan Sukidi Jennifer Yen Zejia Yang David Williams-King Linh Le Kosi Asuzu Carsten Maple 102 0 0 24 Feb 2025
Vector-ICL: In-context Learning with Continuous Vector Representations Yufan Zhuang Chandan Singh Liyuan Liu Jingbo Shang Jianfeng Gao 52 3 0 21 Feb 2025
BMIKE-53: Investigating Cross-Lingual Knowledge Editing with In-Context Learning Ercong Nie Bo Shao Zifeng Ding Mingyang Wang Helmut Schmid Hinrich Schütze KELM 129 7 0 21 Feb 2025
Looped ReLU MLPs May Be All You Need as Practical Programmable Computers Yingyu Liang Zhizhou Sha Zhenmei Shi Zhao-quan Song Yufa Zhou 96 18 0 21 Feb 2025
Blessing of Multilinguality: A Systematic Analysis of Multilingual In-Context Learning Yilei Tu Andrew Xue Freda Shi 49 0 0 17 Feb 2025
TimeCAP: Learning to Contextualize, Augment, and Predict Time Series Events with Large Language Model Agents Geon Lee Wenchao Yu Kijung Shin Wei Cheng Haifeng Chen AI4TS LLMAG 56 6 0 17 Feb 2025
MathGAP: Out-of-Distribution Evaluation on Problems with Arbitrarily Complex Proofs Andreas Opedal Haruki Shirakami Bernhard Schölkopf Abulhair Saparov Mrinmaya Sachan LRM 57 1 0 17 Feb 2025
RIDE: Enhancing Large Language Model Alignment through Restyled In-Context Learning Demonstration Exemplars Yuncheng Hua Lizhen Qu Zhuang Li Hao Xue Flora D. Salim Gholamreza Haffari ALM 132 0 0 17 Feb 2025
LogiDynamics: Unraveling the Dynamics of Logical Inference in Large Language Model Reasoning Tianshi Zheng Jiayang Cheng Chunyang Li Haochen Shi ziqi wang Jiaxin Bai Yangqiu Song Ginny Wong Simon See LRM 46 2 0 16 Feb 2025
Lost in the Passage: Passage-level In-context Learning Does Not Necessarily Need a "Passage" Hao Sun Chenming Tang Gengyang Li Yunfang Wu AIMat 47 0 0 15 Feb 2025
KIMAs: A Configurable Knowledge Integrated Multi-Agent System Zitao Li Fei Wei Yuexiang Xie Dawei Gao Weirui Kuang Zhijian Ma Bingchen Qian Yaliang Li Bolin Ding 60 0 0 13 Feb 2025
Don't Just Demo, Teach Me the Principles: A Principle-Based Multi-Agent Prompting Strategy for Text Classification Peipei Wei Dimitris Dimitriadis Yan Xu Mingwei Shen 55 1 0 11 Feb 2025
In-Context Learning (and Unlearning) of Length Biases S. Schoch Yangfeng Ji 95 0 0 10 Feb 2025
Learning Task Representations from In-Context Learning Baturay Saglam Zhuoran Yang Dionysis Kalogerias Amin Karbasi 55 0 0 08 Feb 2025
Enhancing Knowledge Graph Construction: Evaluating with Emphasis on Hallucination, Omission, and Graph Similarity Metrics Hussam Ghanem C. Cruz 58 0 0 07 Feb 2025
BLoB: Bayesian Low-Rank Adaptation by Backpropagation for Large Language Models Yibin Wang Haochen Shi Ligong Han Dimitris N. Metaxas Hao Wang BDL UQLM 113 6 0 28 Jan 2025
A Survey of Large Language Models for Healthcare: from Data, Technology, and Applications to Accountability and Ethics Kai He Rui Mao Qika Lin Yucheng Ruan Xiang Lan Mengling Feng Erik Cambria LM&MA AILaw 93 154 0 28 Jan 2025
Are Transformers Able to Reason by Connecting Separated Knowledge in Training Data? Yutong Yin Zhaoran Wang LRM ReLM 143 0 0 27 Jan 2025
What Matters for In-Context Learning: A Balancing Act of Look-up and In-Weight Learning Jelena Bratulić Sudhanshu Mittal Christian Rupprecht Thomas Brox 41 1 0 09 Jan 2025
Semantic Captioning: Benchmark Dataset and Graph-Aware Few-Shot In-Context Learning for SQL2Text Ali Al-Lawati Jason Lucas Prasenjit Mitra LMTD 43 0 0 06 Jan 2025
Out-of-distribution generalization via composition: a lens through induction heads in Transformers Jiajun Song Zhuoyan Xu Yiqiao Zhong 85 4 0 31 Dec 2024
In-Context Learning with Iterative Demonstration Selection Chengwei Qin Aston Zhang Cheng Chen Anirudh Dagar Wenming Ye LRM 68 38 0 31 Dec 2024
Brain Ageing Prediction using Isolation Forest Technique and Residual Neural Network (ResNet) Saadat Behzadi Danial Sharifrazi R. Alizadehsani Mojtaba Lotfaliany Mohammadreza Mohebbi 29 0 0 26 Dec 2024
Malware Classification using a Hybrid Hidden Markov Model-Convolutional Neural Network Ritik Mehta Olha Jurecková Mark Stamp 59 0 0 25 Dec 2024
Revisiting In-Context Learning with Long Context Language Models Jinheon Baek Sun Jae Lee Prakhar Gupta Geunseob Oh Siddharth Dalmia 182 1 0 22 Dec 2024
Enriching Social Science Research via Survey Item Linking Tornike Tsereteli Daniel Ruffinelli Simone Paolo Ponzetto LRM 70 0 0 20 Dec 2024
Can Input Attributions Interpret the Inductive Reasoning Process Elicited in In-Context Learning? Mengyu Ye Tatsuki Kuribayashi Goro Kobayashi Jun Suzuki LRM 92 0 0 20 Dec 2024
On the Role of Model Prior in Real-World Inductive Reasoning Zhuo Liu Ding Yu Hangfeng He LRM 79 0 0 18 Dec 2024
PICLe: Pseudo-Annotations for In-Context Learning in Low-Resource Named Entity Detection Sepideh Mamooler Syrielle Montariol Alexander Mathis Antoine Bosselut 90 1 0 16 Dec 2024
Dual-Schedule Inversion: Training- and Tuning-Free Inversion for Real Image Editing Jiancheng Huang Yi Huang Jianzhuang Liu Donghao Zhou Y. Liu Shifeng Chen DiffM 98 0 0 15 Dec 2024
No Free Lunch for Defending Against Prefilling Attack by In-Context Learning Zhiyu Xue Guangliang Liu Bocheng Chen K. Johnson Ramtin Pedarsani AAML 68 0 0 13 Dec 2024
Training-Free Bayesianization for Low-Rank Adapters of Large Language Models Haochen Shi Yibin Wang Ligong Han H. M. Zhang Hao Wang UQCV 83 0 0 07 Dec 2024
Evolutionary Pre-Prompt Optimization for Mathematical Reasoning Mathurin Videau Alessandro Leite Marc Schoenauer O. Teytaud ReLM LRM 79 0 0 05 Dec 2024
Scene Co-pilot: Procedural Text to Video Generation with Human in the Loop Zhaofang Qian Abolfazl Sharifi Tucker Carroll Ser-Nam Lim VGen 74 0 0 26 Nov 2024
LaB-RAG: Label Boosted Retrieval Augmented Generation for Radiology Report Generation Steven Song Anirudh Subramanyam Irene Madejski Robert L. Grossman MedIm VLM 102 0 0 25 Nov 2024
Can a Large Language Model Learn Matrix Functions In Context? Paimon Goulart Evangelos E. Papalexakis 65 0 0 24 Nov 2024
Instruct or Interact? Exploring and Eliciting LLMs' Capability in Code Snippet Adaptation Through Prompt Engineering Tanghaoran Zhang Yue Yu Xinjun Mao Shangwen Wang Kang Yang Yao Lu Zhang Zhang Yuxin Zhao 71 1 0 23 Nov 2024
GRL-Prompt: Towards Knowledge Graph based Prompt Optimization via Reinforcement Learning Yuze Liu Tingjie Liu Tiehua Zhang Youhua Xia Jinze Wang Zhishu Shen Jiong Jin Fei Richard Yu 75 0 0 19 Nov 2024
SPICA: Retrieving Scenarios for Pluralistic In-Context Alignment Quan Ze Chen K. J. Kevin Feng Chan Young Park Amy X. Zhang 26 0 0 16 Nov 2024
One-Layer Transformer Provably Learns One-Nearest Neighbor In Context Zihao Li Yuan Cao Cheng Gao Yihan He Han Liu Jason M. Klusowski Jianqing Fan Mengdi Wang MLT 52 6 0 16 Nov 2024
Clustering Algorithms and RAG Enhancing Semi-Supervised Text Classification with Large LLMs Shan Zhong Jiahao Zeng Yongxin Yu Bohong Lin 34 1 0 09 Nov 2024
Medical Adaptation of Large Language and Vision-Language Models: Are We Making Progress? Daniel P. Jeong Saurabh Garg Zachary Chase Lipton Michael Oberst LM&MA VLM ELM 37 9 0 06 Nov 2024
Bio-xLSTM: Generative modeling, representation and in-context learning of biological and chemical sequences Niklas Schmidinger Lisa Schneckenreiter Philipp Seidl Johannes Schimunek Pieter-Jan Hoedt Johannes Brandstetter Andreas Mayr Sohvi Luukkonen Sepp Hochreiter G. Klambauer MedIm 61 4 0 06 Nov 2024
Can Custom Models Learn In-Context? An Exploration of Hybrid Architecture Performance on In-Context Learning Tasks Ryan Campbell Nelson Lojo Kesava Viswanadha Christoffer Grondal Tryggestad Derrick Han Sun Sriteja Vijapurapu August Rolfsen Anant Sahai 31 0 0 06 Nov 2024
Mixtures of In-Context Learners Giwon Hong Emile van Krieken E. Ponti Nikolay Malkin Pasquale Minervini 38 0 0 05 Nov 2024
Defining and Evaluating Physical Safety for Large Language Models Yung-Chen Tang Pin-Yu Chen Tsung-Yi Ho ELM 32 2 0 04 Nov 2024
Investigating Large Language Models for Complex Word Identification in Multilingual and Multidomain Setups Razvan-Alexandru Smadu David-Gabriel Ion Dumitru-Clementin Cercel Florin-Catalin Pop Mihaela-Claudia Cercel 34 1 0 03 Nov 2024