An Explanation of In-context Learning as Implicit Bayesian Inference

3 November 2021

Papers citing "An Explanation of In-context Learning as Implicit Bayesian Inference"

50 / 535 papers shown

Title
QuantAgent: Seeking Holy Grail in Trading by Self-Improving Large Language Model Sai Wang Hang Yuan Lionel M. Ni Jian Guo LLMAG AIFin 21 11 0 06 Feb 2024
How do Large Language Models Learn In-Context? Query and Key Matrices of In-Context Heads are Two Towers for Metric Learning Zeping Yu Sophia Ananiadou 50 9 0 05 Feb 2024
Data Poisoning for In-context Learning Pengfei He Han Xu Yue Xing Hui Liu Makoto Yamada Jiliang Tang AAML SILM 30 10 0 03 Feb 2024
Self-attention Networks Localize When QK-eigenspectrum Concentrates Han Bao Ryuichiro Hataya Ryo Karakida 18 5 0 03 Feb 2024
Can MLLMs Perform Text-to-Image In-Context Learning? Yuchen Zeng Wonjun Kang Yicong Chen Hyung Il Koo Kangwook Lee MLLM 36 9 0 02 Feb 2024
Position: Bayesian Deep Learning is Needed in the Age of Large-Scale AI Theodore Papamarkou Maria Skoularidou Konstantina Palla Laurence Aitchison Julyan Arbel ... David Rügamer Yee Whye Teh Max Welling Andrew Gordon Wilson Ruqi Zhang UQCV BDL 47 27 0 01 Feb 2024
Incoherent Probability Judgments in Large Language Models Jian-Qiao Zhu Thomas Griffiths 83 6 0 30 Jan 2024
An Information-Theoretic Analysis of In-Context Learning Hong Jun Jeon Jason D. Lee Qi Lei Benjamin Van Roy 32 19 0 28 Jan 2024
Learning Universal Predictors Jordi Grau-Moya Tim Genewein Marcus Hutter Laurent Orseau Grégoire Delétang ... Anian Ruoss Wenliang Kevin Li Christopher Mattern Matthew Aitchison J. Veness 29 11 0 26 Jan 2024
Demystifying Chains, Trees, and Graphs of Thoughts Maciej Besta Florim Memedi Zhenyu Zhang Robert Gerstenberger Guangyuan Piao ... Aleš Kubíček H. Niewiadomski Aidan O'Mahony Onur Mutlu Torsten Hoefler AI4CE LRM 75 27 0 25 Jan 2024
In-Context Language Learning: Architectures and Algorithms Ekin Akyürek Bailin Wang Yoon Kim Jacob Andreas LRM ReLM 48 44 0 23 Jan 2024
Benchmarking LLMs via Uncertainty Quantification Fanghua Ye Mingming Yang Jianhui Pang Longyue Wang Derek F. Wong Emine Yilmaz Shuming Shi Zhaopeng Tu ELM 23 47 0 23 Jan 2024
Enhancing In-context Learning via Linear Probe Calibration Momin Abbas Yi Zhou Parikshit Ram Nathalie Baracaldo Horst Samulowitz Theodoros Salonidis Tianyi Chen 76 11 0 22 Jan 2024
In-context Learning with Retrieved Demonstrations for Language Models: A Survey an Luo Xin Xu Yue Liu Panupong Pasupat Mehran Kazemi RALM 34 55 0 21 Jan 2024
PizzaCommonSense: Learning to Model Commonsense Reasoning about Intermediate Steps in Cooking Recipes Aissatou Diallo Antonis Bikakis Luke Dickens Anthony Hunter Rob Miller LRM 26 2 0 12 Jan 2024
Mind Your Format: Towards Consistent Evaluation of In-Context Learning Improvements Anton Voronov Lena Wolf Max Ryabinin 30 47 0 12 Jan 2024
Batch-ICL: Effective, Efficient, and Order-Agnostic In-Context Learning Kaiyi Zhang Ang Lv Yuhan Chen Hansen Ha Tao Xu Rui Yan 20 19 0 12 Jan 2024
Universal Vulnerabilities in Large Language Models: Backdoor Attacks for In-context Learning Shuai Zhao Meihuizi Jia Anh Tuan Luu Fengjun Pan Jinming Wen AAML 31 37 0 11 Jan 2024
Learning Cognitive Maps from Transformer Representations for Efficient Planning in Partially Observed Environments Antoine Dedieu Wolfgang Lehrach Guangyao Zhou Dileep George Miguel Lazaro-Gredilla 40 2 0 11 Jan 2024
Grimoire is All You Need for Enhancing Large Language Models Ding Chen Shichao Song Qingchen Yu Zhiyu Li Wenjin Wang Zhiyu Li Simin Niu 25 4 0 07 Jan 2024
Large Language Models for Social Networks: Applications, Challenges, and Solutions Jingying Zeng Richard Huang Waleed Malik Langxuan Yin Bojan Babic Danny Shacham Xiao Yan Jaewon Yang Qi He 22 7 0 04 Jan 2024
Is Knowledge All Large Language Models Needed for Causal Reasoning? Hengrui Cai Shengjie Liu Rui Song LRM ELM 28 10 0 30 Dec 2023
Improving In-context Learning via Bidirectional Alignment Chengwei Qin Wenhan Xia Fangkai Jiao Chen Chen Yuchen Hu Bosheng Ding Chenyu You 43 7 0 28 Dec 2023
Supervised Knowledge Makes Large Language Models Better In-context Learners Linyi Yang Shuibai Zhang Zhuohao Yu Guangsheng Bao Yidong Wang ... Ruochen Xu Weirong Ye Xing Xie Weizhu Chen Yue Zhang 24 15 0 26 Dec 2023
Deep de Finetti: Recovering Topic Distributions from Large Language Models Liyi Zhang R. Thomas McCoy T. Sumers Jian-Qiao Zhu Thomas Griffiths BDL 54 6 0 21 Dec 2023
Emergence of In-Context Reinforcement Learning from Noise Distillation Ilya Zisman Vladislav Kurenkov Alexander Nikulin Viacheslav Sinii Sergey Kolesnikov OffRL 33 10 0 19 Dec 2023
Let AI Entertain You: Increasing User Engagement with Generative AI and Rejection Sampling Jingying Zeng Jaewon Yang Waleed Malik Xiao Yan Richard Huang Qi He 30 1 0 16 Dec 2023
ProTIP: Progressive Tool Retrieval Improves Planning R. Anantha Bortik Bandyopadhyay Anirudh Kashi Sayantan Mahinder Andrew W Hill Srinivas Chappidi 24 6 0 16 Dec 2023
DeceptPrompt: Exploiting LLM-driven Code Generation via Adversarial Natural Language Instructions Fangzhou Wu Xiaogeng Liu Chaowei Xiao AAML SILM 34 26 0 07 Dec 2023
Latent Skill Discovery for Chain-of-Thought Reasoning Zifan Xu Haozhu Wang Dmitriy Bespalov Peter Stone Yanjun Qi ReLM LRM 59 2 0 07 Dec 2023
Analyzing the Inherent Response Tendency of LLMs: Real-World Instructions-Driven Jailbreak Yanrui Du Sendong Zhao Ming Ma Yuhan Chen Bing Qin 26 15 0 07 Dec 2023
A Study on the Calibration of In-context Learning Hanlin Zhang Yi-Fan Zhang Yaodong Yu Dhruv Madeka Dean Phillips Foster Eric Xing Hima Lakkaraju Sham Kakade 34 7 0 07 Dec 2023
Generalization to New Sequential Decision Making Tasks with In-Context Learning Sharath Chandra Raparthy Eric Hambro Robert Kirk Mikael Henaff Roberta Raileanu OffRL 111 21 0 06 Dec 2023
IMProv: Inpainting-based Multimodal Prompting for Computer Vision Tasks Jiarui Xu Yossi Gandelsman Amir Bar Jianwei Yang Jianfeng Gao Trevor Darrell Xiaolong Wang VLM 28 3 0 04 Dec 2023
The mechanistic basis of data dependence and abrupt learning in an in-context classification task Gautam Reddy 27 52 0 03 Dec 2023
Exploring and Improving the Spatial Reasoning Abilities of Large Language Models Manasi Sharma LRM 22 8 0 02 Dec 2023
MEDITRON-70B: Scaling Medical Pretraining for Large Language Models Zeming Chen Alejandro Hernández Cano Angelika Romanou Antoine Bonnet Kyle Matoba ... Axel Marmet Syrielle Montariol Mary-Anne Hartley Martin Jaggi Antoine Bosselut LM&MA AI4MH MedIm 53 179 0 27 Nov 2023
SEGIC: Unleashing the Emergent Correspondence for In-Context Segmentation Lingchen Meng Shiyi Lan Hengduo Li Jose M. Alvarez Zuxuan Wu Yu-Gang Jiang VLM ISeg MLLM 28 6 0 24 Nov 2023
Looped Transformers are Better at Learning Learning Algorithms Liu Yang Kangwook Lee Robert D. Nowak Dimitris Papailiopoulos 29 24 0 21 Nov 2023
Igniting Language Intelligence: The Hitchhiker's Guide From Chain-of-Thought Reasoning to Language Agents Zhuosheng Zhang Yao Yao Aston Zhang Xiangru Tang Xinbei Ma ... Yiming Wang Mark B. Gerstein Rui Wang Gongshen Liu Hai Zhao LLMAG LM&Ro LRM 42 53 0 20 Nov 2023
Adapt in Contexts: Retrieval-Augmented Domain Adaptation via In-Context Learning Quanyu Long Wenya Wang Sinno Jialin Pan 39 13 0 20 Nov 2023
A Principled Framework for Knowledge-enhanced Large Language Model Sai Wang Zhihan Liu Zhaoran Wang Jian Guo LRM 30 1 0 18 Nov 2023
Scaling TabPFN: Sketching and Feature Selection for Tabular Prior-Data Fitted Networks Ben Feuer Chinmay Hegde Niv Cohen 37 10 0 17 Nov 2023
Exploring the Relationship between In-Context Learning and Instruction Tuning Hanyu Duan Yixuan Tang Yi Yang Ahmed Abbasi Kar Yan Tam 37 11 0 17 Nov 2023
Predictive Minds: LLMs As Atypical Active Inference Agents Jan Kulveit Clem von Stengel Roman Leventov LLMAG KELM LRM 44 1 0 16 Nov 2023
Hijacking Large Language Models via Adversarial In-Context Learning Yao Qiang Xiangyu Zhou Dongxiao Zhu 32 32 0 16 Nov 2023
Enhancing Machine Translation through Advanced In-Context Learning: A Methodological Strategy for GPT-4 Improvement Yufeng Chen 23 3 0 15 Nov 2023
Can Large Language Models Follow Concept Annotation Guidelines? A Case Study on Scientific and Financial Domains Marcio Fonseca Shay B. Cohen ALM 27 6 0 15 Nov 2023
The Transient Nature of Emergent In-Context Learning in Transformers Aaditya K. Singh Stephanie C. Y. Chan Ted Moskovitz Erin Grant Andrew M. Saxe Felix Hill 70 33 0 14 Nov 2023
Anti-LM Decoding for Zero-shot In-context Machine Translation Suzanna Sia Alexandra DeLucia Kevin Duh 41 2 0 14 Nov 2023