v1v2v3v4v5v6 (latest)

An Explanation of In-context Learning as Implicit Bayesian Inference

3 November 2021

Papers citing "An Explanation of In-context Learning as Implicit Bayesian Inference"

50 / 562 papers shown

Title
Next-Token Prediction Should be Ambiguity-Sensitive: A Meta-Learning Perspective Léo Gagnon Eric Elmoznino Sarthak Mittal Tom Marty Tejas Kasetty Dhanya Sridhar Guillaume Lajoie 10 0 0 19 Jun 2025
When and How Unlabeled Data Provably Improve In-Context Learning Yingcong Li Xiangyu Chang Muti Kara Xiaofeng Liu Amit K. Roy-Chowdhury Samet Oymak 15 0 0 18 Jun 2025
In-Context Learning for Gradient-Free Receiver Adaptation: Principles, Applications, and Theory Matteo Zecchin Tomer Raviv D. Kalathil Krishna R. Narayanan Nir Shlezinger Osvaldo Simeone 12 0 0 18 Jun 2025
Revisiting Chain-of-Thought Prompting: Zero-shot Can Be Stronger than Few-shot Xiang Cheng Chengyan Pan Minjun Zhao Deyang Li Fangchao Liu Xinyu Zhang Xiao Zhang Yong Liu ReLM LRM 42 0 0 17 Jun 2025
AI-Facilitated Analysis of Abstracts and Conclusions: Flagging Unsubstantiated Claims and Ambiguous Pronouns Evgeny Markhasin 20 0 0 16 Jun 2025
Distinct Computations Emerge From Compositional Curricula in In-Context Learning Jin Hwa Lee Andrew Kyle Lampinen Aaditya K. Singh Andrew Saxe 23 0 0 16 Jun 2025
Brewing Knowledge in Context: Distillation Perspectives on In-Context Learning Chengye Li Haiyun Liu Yuanxi Li 15 0 0 13 Jun 2025
ReconMOST: Multi-Layer Sea Temperature Reconstruction with Observations-Guided Diffusion Yuanyi Song Pumeng Lyu Ben Fei Fenghua Ling Wanli Ouyang Lei Bai DiffM AI4Cl AI4CE 111 0 0 12 Jun 2025
Provably Learning from Language Feedback Wanqiao Xu Allen Nie Ruijie Zheng Aditya Modi Adith Swaminathan Ching-An Cheng 137 0 0 12 Jun 2025
Understanding Task Vectors in In-Context Learning: Emergence, Functionality, and Limitations Yuxin Dong Jiachen Jiang Zhihui Zhu Xia Ning 23 0 0 10 Jun 2025
CausalPFN: Amortized Causal Effect Estimation via In-Context Learning Vahid Balazadeh Hamidreza Kamkari Valentin Thomas Benson Li Junwei Ma Jesse C. Cresswell Rahul G. Krishnan CML 22 0 0 09 Jun 2025
Federated In-Context Learning: Iterative Refinement for Improved Answer Quality Ruhan Wang Zhiyong Wang Chengkai Huang Rui Wang Tong Yu Lina Yao John C. S. Lui Dongruo Zhou 15 0 0 09 Jun 2025
Eliciting Fine-Tuned Transformer Capabilities via Inference-Time Techniques Asankhaya Sharma 25 0 0 09 Jun 2025
Pre-trained Large Language Models Learn Hidden Markov Models In-context Yijia Dai Zhaolin Gao Yahya Sattar Sarah Dean Jennifer J. Sun 22 0 0 08 Jun 2025
Counterfactual reasoning: an analysis of in-context emergence Moritz Miller Bernhard Schölkopf Siyuan Guo ReLM LRM 164 0 0 05 Jun 2025
Neural Network Reprogrammability: A Unified Theme on Model Reprogramming, Prompt Tuning, and Prompt Instruction Zesheng Ye C. Cai Ruijiang Dong Jianzhong Qi Lei Feng Pin-Yu Chen Feng Liu 203 0 0 05 Jun 2025
A Generative Adaptive Replay Continual Learning Model for Temporal Knowledge Graph Reasoning Zhiyu Zhang Wei Chen Youfang Lin Huaiyu Wan OffRL CLL 111 0 0 04 Jun 2025
Transformers as Multi-task Learners: Decoupling Features in Hidden Markov Models Yifan Hao Chenlu Ye Chi Han Tong Zhang 53 0 0 02 Jun 2025
The Unified Cognitive Consciousness Theory for Language Models: Anchoring Semantics, Thresholds of Activation, and Emergent Reasoning Edward Y. Chang LRM 14 0 0 02 Jun 2025
Neither Stochastic Parroting nor AGI: LLMs Solve Tasks through Context-Directed Extrapolation from Training Data Priors Harish Tayyar Madabushi Melissa Torgbi C. Bonial 64 0 0 29 May 2025
Simplifying Bayesian Optimization Via In-Context Direct Optimum Sampling Gustavo Sutter Pessurno de Carvalho Mohammed Abdulrahman Hao Wang Sriram Ganapathi Subramanian Marc St-Aubin Sharon O'Sullivan Lawrence Wan Luis Ricardez-Sandoval Pascal Poupart Agustinus Kristiadi 27 0 0 29 May 2025
The Role of Diversity in In-Context Learning for Large Language Models Wenyang Xiao Haoyu Zhao Lingxiao Huang 90 0 0 26 May 2025
Deciphering Trajectory-Aided LLM Reasoning: An Optimization Perspective Junnan Liu Hongwei Liu Linchen Xiao Shudong Liu Taolin Zhang Zihan Ma Songyang Zhang Kai Chen LRM 120 0 0 26 May 2025
Leveraging Importance Sampling to Detach Alignment Modules from Large Language Models Yi Liu Dianqing Liu Mingye Zhu Junbo Guo Yongdong Zhang Zhendong Mao 102 0 0 26 May 2025
Learning to Select In-Context Demonstration Preferred by Large Language Model Zheng Zhang Shaocheng Lan Lei Song Jiang Bian Yexin Li Kan Ren 27 0 0 26 May 2025
AI-Driven Climate Policy Scenario Generation for Sub-Saharan Africa Rafiu Adekoya Badekale Adewale Akinfaderin 43 0 0 24 May 2025
Are Large Language Models Reliable AI Scientists? Assessing Reverse-Engineering of Black-Box Systems Jiayi Geng Howard Chen Dilip Arumugam Thomas L. Griffiths 107 0 0 23 May 2025
Understanding Prompt Tuning and In-Context Learning via Meta-Learning Tim Genewein Kevin Wenliang Li Jordi Grau-Moya Anian Ruoss Laurent Orseau Marcus Hutter VPVLM 82 1 0 22 May 2025
Beyond Induction Heads: In-Context Meta Learning Induces Multi-Phase Circuit Emergence Gouki Minegishi Hiroki Furuta Shohei Taniguchi Yusuke Iwasawa Yutaka Matsuo 81 0 0 22 May 2025
From Compression to Expansion: A Layerwise Analysis of In-Context Learning Jiachen Jiang Yuxin Dong Jinxin Zhou Zhihui Zhu 63 0 0 22 May 2025
Boosting In-Context Learning in LLMs Through the Lens of Classical Supervised Learning Korel Gundem Juncheng Dong Dennis Zhang Vahid Tarokh Zhengling Qi 15 0 0 22 May 2025
CAMA: Enhancing Multimodal In-Context Learning with Context-Aware Modulated Attention Yanshu Li JianJiang Yang Bozheng Li Ruixiang Tang 66 2 0 21 May 2025
$$\texttt{LLINBO}$: Trustworthy LLM-in-the-Loop Bayesian Optimization$ $\texttt{LLINBO}$ : Trustworthy LLM-in-the-Loop Bayesian Optimization Chih-Yu Chang Milad Azvar Chinedum Okwudire Raed Al Kontar UQCV 83 0 0 20 May 2025
True Zero-Shot Inference of Dynamical Systems Preserving Long-Term Statistics Christoph Jürgen Hemmer Daniel Durstewitz AI4TS SyDa AI4CE 297 1 0 19 May 2025
Do different prompting methods yield a common task representation in language models? Guy Davidson Todd M. Gureckis Brenden M. Lake Adina Williams 58 2 0 17 May 2025
Creating General User Models from Computer Use Omar Shaikh Shardul Sapkota Shan Rizvi Eric Horvitz Joon Sung Park Diyi Yang Michael S. Bernstein HAI 134 0 0 16 May 2025
Illusion or Algorithm? Investigating Memorization, Emergence, and Symbolic Processing in In-Context Learning Jingcheng Niu Subhabrata Dutta Ahmed Elshabrawy Harish Tayyar Madabushi Iryna Gurevych 148 1 0 16 May 2025
Rethinking Invariance in In-context Learning Lizhe Fang Yifei Wang Khashayar Gatmiry Lei Fang Yun Wang 104 6 0 08 May 2025
On the generalization of language models from in-context learning and finetuning: a controlled study Andrew Kyle Lampinen Arslan Chaudhry Stephanie Chan Cody Wild Diane Wan Alex Ku Jorg Bornschein Razvan Pascanu Murray Shanahan James L. McClelland 169 5 0 01 May 2025
Toward Efficient Exploration by Large Language Model Agents Dilip Arumugam Thomas L. Griffiths LLMAG 212 4 0 29 Apr 2025
ICL CIPHERS: Quantifying "Learning'' in In-Context Learning via Substitution Ciphers Zhouxiang Fang Aayush Mishra Muhan Gao Anqi Liu Daniel Khashabi 160 0 0 28 Apr 2025
Toward Generalizable Evaluation in the LLM Era: A Survey Beyond Benchmarks Yixin Cao Shibo Hong Xuzhao Li Jiahao Ying Yubo Ma ... Juanzi Li Aixin Sun Xuanjing Huang Tat-Seng Chua Tianwei Zhang ALM ELM 253 7 0 26 Apr 2025
Reflexive Prompt Engineering: A Framework for Responsible Prompt Engineering and Interaction Design Christian Djeffal 109 0 0 22 Apr 2025
How Private is Your Attention? Bridging Privacy with In-Context Learning Soham Bonnerjee Zhen Wei Yeon Anna Asch Sagnik Nandy Promit Ghosal 105 0 0 22 Apr 2025
Scaling sparse feature circuit finding for in-context learning Dmitrii Kharlapenko Shivalika Singh Fazl Barez Arthur Conmy Neel Nanda 90 0 0 18 Apr 2025
Exact Learning Dynamics of In-Context Learning in Linear Transformers and Its Application to Non-Linear Transformers Nischal Mainali Lucas Teixeira 55 0 0 17 Apr 2025
A Theoretical Framework for OOD Robustness in Transformers using Gevrey Classes Yu Wang Fu-Chieh Chang Pei-Yuan Wu OODD ReLM LRM 78 0 0 17 Apr 2025
Position: An Empirically Grounded Identifiability Theory Will Accelerate Self-Supervised Learning Research Patrik Reizinger Randall Balestriero David Klindt Wieland Brendel 199 1 0 17 Apr 2025
When is Task Vector Provably Effective for Model Editing? A Generalization Analysis of Nonlinear Transformers Hongkang Li Yihua Zhang Shuai Zhang Ming Wang Sijia Liu Pin-Yu Chen MoMe 256 10 0 15 Apr 2025
Classifying the Unknown: In-Context Learning for Open-Vocabulary Text and Symbol Recognition Tom Simon William Mocaer Pierrick Tranouez Clément Chatelain Thierry Paquet MLLM VLM 92 0 0 09 Apr 2025