An Explanation of In-context Learning as Implicit Bayesian Inference

3 November 2021

Papers citing "An Explanation of In-context Learning as Implicit Bayesian Inference"

50 / 535 papers shown

Title
Democratizing LLMs for Low-Resource Languages by Leveraging their English Dominant Abilities with Linguistically-Diverse Prompts Xuan-Phi Nguyen Sharifah Mahani Aljunied Chenyu You Lidong Bing 23 32 0 20 Jun 2023
Trained Transformers Learn Linear Models In-Context Ruiqi Zhang Spencer Frei Peter L. Bartlett 34 176 0 16 Jun 2023
Pushing the Limits of ChatGPT on NLP Tasks Xiaofei Sun Linfeng Dong Xiaoya Li Zhen Wan Shuhe Wang ... Jiwei Li Fei Cheng Lingjuan Lyu Fei Wu Guoyin Wang AI4MH LRM 44 29 0 16 Jun 2023
Schema-learning and rebinding as mechanisms of in-context learning and emergence Siva K. Swaminathan Antoine Dedieu Rajkumar Vasudeva Raju Murray Shanahan Miguel Lazaro-Gredilla Dileep George 36 9 0 16 Jun 2023
WebGLM: Towards An Efficient Web-Enhanced Question Answering System with Human Preferences Xiao Liu Hanyu Lai Hao Yu Yifan Xu Aohan Zeng Zhengxiao Du Peng Zhang Yuxiao Dong Jie Tang 17 97 0 13 Jun 2023
TART: A plug-and-play Transformer module for task-agnostic reasoning Kush S. Bhatia A. Narayan Chris De Sa Christopher Ré LRM ReLM VLM 36 14 0 13 Jun 2023
In-Context Learning through the Bayesian Prism Madhuri Panwar Kabir Ahuja Navin Goyal BDL 42 39 0 08 Jun 2023
Multi-modal Latent Diffusion Mustapha Bounoua Giulio Franzese Pietro Michiardi DiffM 24 13 0 07 Jun 2023
Birth of a Transformer: A Memory Viewpoint A. Bietti Vivien A. Cabannes Diane Bouchacourt Hervé Jégou Léon Bottou 35 83 0 01 Jun 2023
On Masked Pre-training and the Marginal Likelihood Pablo Moreno-Muñoz Pol G. Recasens Søren Hauberg SSL 30 5 0 01 Jun 2023
Transformers learn to implement preconditioned gradient descent for in-context learning Kwangjun Ahn Xiang Cheng Hadi Daneshmand S. Sra ODL 28 147 0 01 Jun 2023
What and How does In-Context Learning Learn? Bayesian Model Averaging, Parameterization, and Generalization Yufeng Zhang Fengzhuo Zhang Zhuoran Yang Zhaoran Wang BDL 36 63 0 30 May 2023
Contextual Vision Transformers for Robust Representation Learning Yu Bao Theofanis Karaletsos ViT 26 13 0 30 May 2023
Dissecting Chain-of-Thought: Compositionality through In-Context Filtering and Learning Yingcong Li Kartik K. Sreenivasan Angeliki Giannou Dimitris Papailiopoulos Samet Oymak LRM 18 16 0 30 May 2023
ChatGPT-powered Conversational Drug Editing Using Retrieval and Domain Feedback Shengchao Liu Jiong Wang Yijin Yang Chengpeng Wang Ling Liu Hongyu Guo Chaowei Xiao LM&MA KELM AI4MH 36 39 0 29 May 2023
Beyond Positive Scaling: How Negation Impacts Scaling Trends of Language Models Yuhui Zhang Michihiro Yasunaga Zhengping Zhou Jeff Z. HaoChen James Zou Percy Liang Serena Yeung 47 7 0 27 May 2023
Im-Promptu: In-Context Composition from Image Prompts Bhishma Dedhia Michael Chang Jake C. Snell Thomas Griffiths N. Jha LRM MLLM 32 1 0 26 May 2023
A Mechanism for Sample-Efficient In-Context Learning for Sparse Retrieval Tasks Jacob D. Abernethy Alekh Agarwal T. V. Marinov Manfred K. Warmuth 28 18 0 26 May 2023
A Closer Look at In-Context Learning under Distribution Shifts Kartik Ahuja David Lopez-Paz 40 15 0 26 May 2023
Towards Revealing the Mystery behind Chain of Thought: A Theoretical Perspective Guhao Feng Bohang Zhang Yuntian Gu Haotian Ye Di He Liwei Wang LRM 47 221 0 24 May 2023
Testing the General Deductive Reasoning Capacity of Large Language Models Using OOD Examples Abulhair Saparov Richard Yuanzhe Pang Vishakh Padmakumar Nitish Joshi Seyed Mehran Kazemi Najoung Kim He He ELM LRM 24 87 0 24 May 2023
Prompt Evolution for Generative AI: A Classifier-Guided Approach Melvin Wong Yew-Soon Ong Abhishek Gupta K. Bali Caishun Chen 31 14 0 24 May 2023
Self-ICL: Zero-Shot In-Context Learning with Self-Generated Demonstrations Wei-Lin Chen Cheng-Kuang Wu Yun-Nung Chen Hsin-Hsi Chen 29 27 0 24 May 2023
OverPrompt: Enhancing ChatGPT through Efficient In-Context Learning Jiazheng Li Runcong Zhao Yongxin Yang Yulan He Lin Gui 41 8 0 24 May 2023
Adversarial Demonstration Attacks on Large Language Models Jiong Wang Zi-yang Liu Keun Hee Park Zhuojun Jiang Zhaoheng Zheng Zhuofeng Wu Muhao Chen Chaowei Xiao SILM 42 52 0 24 May 2023
In-Context Impersonation Reveals Large Language Models' Strengths and Biases Leonard Salewski Stephan Alaniz Isabel Rio-Torto Eric Schulz Zeynep Akata 44 151 0 24 May 2023
Large Language Models are In-Context Semantic Reasoners rather than Symbolic Reasoners Xiaojuan Tang Zilong Zheng Jiaqi Li Fanxu Meng Song-Chun Zhu Yitao Liang Muhan Zhang ReLM LRM 37 55 0 24 May 2023
Active Learning Principles for In-Context Learning with Large Language Models Katerina Margatina Timo Schick Nikolaos Aletras Jane Dwivedi-Yu 32 39 0 23 May 2023
Label Words are Anchors: An Information Flow Perspective for Understanding In-Context Learning Lean Wang Lei Li Damai Dai Deli Chen Hao Zhou Fandong Meng Jie Zhou Xu Sun 42 173 0 23 May 2023
Dr.ICL: Demonstration-Retrieved In-context Learning Man Luo Xin Xu Zhuyun Dai Panupong Pasupat Mehran Kazemi Chitta Baral Vaiva Imbrasaite Vincent Zhao RALM 26 48 0 23 May 2023
Concept-aware Training Improves In-context Learning Ability of Language Models Michal Štefánik Marek Kadlcík KELM LRM 41 0 0 23 May 2023
Discrete Prompt Optimization via Constrained Generation for Zero-shot Re-ranker Sukmin Cho Soyeong Jeong Jeongyeon Seo Jong C. Park OffRL 65 23 0 23 May 2023
Measuring Inductive Biases of In-Context Learning with Underspecified Demonstrations Chenglei Si Dan Friedman Nitish Joshi Shi Feng Danqi Chen He He 13 42 0 22 May 2023
Iterative Forward Tuning Boosts In-Context Learning in Language Models Jiaxi Yang Binyuan Hui Min Yang Bailin Wang Bowen Li Binhua Li Fei Huang Yongbin Li 41 16 0 22 May 2023
Meta-in-context learning in large language models Julian Coda-Forno Marcel Binz Zeynep Akata M. Botvinick Jane X. Wang Eric Schulz LRM 205 35 0 22 May 2023
Explaining Emergent In-Context Learning as Kernel Regression Chi Han Ziqi Wang Haiying Zhao Heng Ji LRM 35 12 0 22 May 2023
MolXPT: Wrapping Molecules with Text for Generative Pre-training Zequn Liu Wei Zhang Yingce Xia Lijun Wu Shufang Xie Tao Qin M. Zhang Tie-Yan Liu 28 67 0 18 May 2023
Temporal Knowledge Graph Forecasting Without Knowledge Using In-Context Learning Dong-Ho Lee Kian Ahrabian Woojeong Jin Fred Morstatter Jay Pujara 30 32 0 17 May 2023
Compress, Then Prompt: Improving Accuracy-Efficiency Trade-off of LLM Inference with Transferable Prompt Zhaozhuo Xu Zirui Liu Beidi Chen Yuxin Tang Jue Wang Kaixiong Zhou Xia Hu Anshumali Shrivastava MQ 32 29 0 17 May 2023
M3KE: A Massive Multi-Level Multi-Subject Knowledge Evaluation Benchmark for Chinese Large Language Models Chuang Liu Renren Jin Yuqi Ren Linhao Yu Tianyu Dong ... Peiyi Zhang Qingqing Lyu Xiaowen Su Qun Liu Deyi Xiong ELM ALM 16 24 0 17 May 2023
What In-Context Learning "Learns" In-Context: Disentangling Task Recognition and Task Learning Jane Pan Tianyu Gao Howard Chen Danqi Chen 28 109 0 16 May 2023
Pre-Training to Learn in Context Yuxian Gu Li Dong Furu Wei Minlie Huang CLIP LRM ReLM 116 37 0 16 May 2023
Small Models are Valuable Plug-ins for Large Language Models Canwen Xu Yichong Xu Shuohang Wang Yang Liu Chenguang Zhu Julian McAuley LLMAG 44 45 0 15 May 2023
Exploring In-Context Learning Capabilities of Foundation Models for Generating Knowledge Graphs from Text H. Khorashadizadeh Nandana Mihindukulasooriya Sanju Tiwari Jinghua Groppe Sven Groppe 27 22 0 15 May 2023
Text Classification via Large Language Models Xiaofei Sun Xiaoya Li Jiwei Li Fei Wu Shangwei Guo Tianwei Zhang Guoyin Wang RALM LRM 40 138 0 15 May 2023
Multilingual LLMs are Better Cross-lingual In-context Learners with Alignment Eshaan Tanwar Subhabrata Dutta Manish Borthakur Tanmoy Chakraborty 27 52 0 10 May 2023
A Taxonomy of Foundation Model based Systems through the Lens of Software Architecture Qinghua Lu Liming Zhu Xiwei Xu Yue Liu Zhenchang Xing Jon Whittle 28 11 0 09 May 2023
CAT: A Contextualized Conceptualization and Instantiation Framework for Commonsense Reasoning Weiqi Wang Tianqing Fang Baixuan Xu Chun Yi Louis Bo Yangqiu Song Lei Chen ReLM LRM 25 34 0 08 May 2023
In-context Learning as Maintaining Coherency: A Study of On-the-fly Machine Translation Using Large Language Models Suzanna Sia Kevin Duh LRM 23 17 0 05 May 2023
AutoML-GPT: Automatic Machine Learning with GPT Shujian Zhang Chengyue Gong Lemeng Wu Xingchao Liu Mi Zhou LLMAG 67 60 0 04 May 2023