v1v2v3v4v5v6 (latest)

An Explanation of In-context Learning as Implicit Bayesian Inference

3 November 2021

Papers citing "An Explanation of In-context Learning as Implicit Bayesian Inference"

50 / 562 papers shown

Title
Rich Semantic Knowledge Enhanced Large Language Models for Few-shot Chinese Spell Checking Ming Dong Yujing Chen Miao Zhang Hao Sun Tingting He 83 8 0 13 Mar 2024
Mechanics of Next Token Prediction with Self-Attention Yingcong Li Yixiao Huang M. E. Ildiz A. S. Rawat Samet Oymak 66 31 0 12 Mar 2024
Knowledge Graph Large Language Model (KG-LLM) for Link Prediction Dong Shu Tianle Chen Mingyu Jin Chong Zhang Jundong Li Yongfeng Zhang 120 36 0 12 Mar 2024
Concept-aware Data Construction Improves In-context Learning of Language Models Michal Štefánik Marek Kadlcík Petr Sojka 92 1 0 08 Mar 2024
Where does In-context Translation Happen in Large Language Models Suzanna Sia David Mueller Kevin Duh LRM 84 0 0 07 Mar 2024
DEEP-ICL: Definition-Enriched Experts for Language Model In-Context Learning Xingwei Qu Yiming Liang Yucheng Wang Tianyu Zheng Tommy Yue ... Jiajun Zhang Wenhu Chen Chenghua Lin Jie Fu Ge Zhang 62 2 0 07 Mar 2024
On the Essence and Prospect: An Investigation of Alignment Approaches for Big Models Xinpeng Wang Shitong Duan Xiaoyuan Yi Jing Yao Shanlin Zhou Zhihua Wei Peng Zhang Dongkuan Xu Maosong Sun Xing Xie OffRL 120 17 0 07 Mar 2024
Causal Prompting: Debiasing Large Language Model Prompting based on Front-Door Adjustment Congzhi Zhang Linhai Zhang Jialong Wu Deyu Zhou Guoqiang Xu CML AI4CE LRM 107 21 0 05 Mar 2024
RoCoIns: Enhancing Robustness of Large Language Models through Code-Style Instructions Yuan Zhang Xiao Wang Zhiheng Xi Han Xia Tao Gui Qi Zhang Xuanjing Huang 93 4 0 26 Feb 2024
The Good and The Bad: Exploring Privacy Issues in Retrieval-Augmented Generation (RAG) Shenglai Zeng Jiankun Zhang Pengfei He Yue Xing Yiding Liu ... Jie Ren Shuaiqiang Wang Dawei Yin Yi Chang Jiliang Tang SILM 101 84 0 23 Feb 2024
Prompting a Pretrained Transformer Can Be a Universal Approximator Aleksandar Petrov Philip Torr Adel Bibi 74 12 0 22 Feb 2024
From Self-Attention to Markov Models: Unveiling the Dynamics of Generative Transformers M. E. Ildiz Yixiao Huang Yingcong Li A. S. Rawat Samet Oymak 90 23 0 21 Feb 2024
A Simple but Effective Approach to Improve Structured Language Model Output for Information Extraction Yinghao Li R. Ramprasad Chao Zhang 173 14 0 20 Feb 2024
The Impact of Demonstrations on Multilingual In-Context Learning: A Multidimensional Analysis Miaoran Zhang Vagrant Gautam Mingyang Wang Jesujoba Oluwadara Alabi Xiaoyu Shen Dietrich Klakow Marius Mosbach 101 12 0 20 Feb 2024
Parallel Structures in Pre-training Data Yield In-Context Learning Yanda Chen Chen Zhao Zhou Yu Kathleen McKeown He He 78 16 0 19 Feb 2024
In-Context Learning Demonstration Selection via Influence Analysis Vinay M.S. Minh-Hao Van Xintao Wu 93 6 0 19 Feb 2024
GNNavi: Navigating the Information Flow in Large Language Models by Graph Neural Network Shuzhou Yuan Ercong Nie Michael Farber Helmut Schmid Hinrich Schütze 85 3 0 18 Feb 2024
Visual In-Context Learning for Large Vision-Language Models Yucheng Zhou Xiang Li Qianning Wang Jianbing Shen MLLM 84 63 0 18 Feb 2024
In-Context Example Ordering Guided by Label Distributions Zhichao Xu Daniel Cohen Bei Wang Vivek Srikumar 80 8 0 18 Feb 2024
TuneTables: Context Optimization for Scalable Prior-Data Fitted Networks Ben Feuer R. Schirrmeister Valeriia Cherepanova Chinmay Hegde Frank Hutter Micah Goldblum Niv Cohen Colin White 97 20 0 17 Feb 2024
The Evolution of Statistical Induction Heads: In-Context Learning Markov Chains Benjamin L. Edelman Ezra Edelman Surbhi Goel Eran Malach Nikolaos Tsilivis BDL 91 56 0 16 Feb 2024
Understanding In-Context Learning with a Pelican Soup Framework Ting-Rui Chiang Dani Yogatama 48 3 0 16 Feb 2024
Uncertainty Quantification for In-Context Learning of Large Language Models Chen Ling Xujiang Zhao Xuchao Zhang Wei Cheng Yanchi Liu ... Katsushi Matsuda Jie Ji Guangji Bai Liang Zhao Haifeng Chen 101 20 0 15 Feb 2024
Rec-GPT4V: Multimodal Recommendation with Large Vision-Language Models Yuqing Liu Yu Wang Lichao Sun Philip S. Yu 92 10 0 13 Feb 2024
Large Language Models as Agents in Two-Player Games Yang Liu Peng Sun Hang Li LLMAG 73 4 0 12 Feb 2024
GenTranslate: Large Language Models are Generative Multilingual Speech and Machine Translators Yuchen Hu Chen Chen Chao-Han Huck Yang Ruizhe Li Dong Zhang Zhehuai Chen Eng Siong Chng 91 21 0 10 Feb 2024
Scalable Interactive Machine Learning for Future Command and Control Anna Madison Ellen R. Novoseller Vinicius G. Goecks Benjamin T. Files Nicholas R. Waytowich Alfred Yu Vernon J. Lawhern Steven Thurman Christopher Kelshaw Kaleb McDowell 70 4 0 09 Feb 2024
Towards Understanding Inductive Bias in Transformers: A View From Infinity Itay Lavie Guy Gur-Ari Zohar Ringel 70 1 0 07 Feb 2024
Can Mamba Learn How to Learn? A Comparative Study on In-Context Learning Tasks Jongho Park Jaeseung Park Zheyang Xiong Nayoung Lee Jaewoong Cho Samet Oymak Kangwook Lee Dimitris Papailiopoulos 103 75 0 06 Feb 2024
Attention with Markov: A Framework for Principled Analysis of Transformers via Markov Chains Ashok Vardhan Makkuva Marco Bondaschi Adway Girish Alliot Nagle Martin Jaggi Hyeji Kim Michael C. Gastpar OffRL 71 26 0 06 Feb 2024
In-context learning agents are asymmetric belief updaters Johannes A. Schubert Akshay K. Jagadish Marcel Binz Eric Schulz LLMAG 77 10 0 06 Feb 2024
Large Language Models to Enhance Bayesian Optimization Tennison Liu Nicolás Astorga Nabeel Seedat M. Schaar 156 59 0 06 Feb 2024
QuantAgent: Seeking Holy Grail in Trading by Self-Improving Large Language Model Saizhuo Wang Hang Yuan Lionel M. Ni Jian Guo LLMAG AIFin 49 14 0 06 Feb 2024
How do Large Language Models Learn In-Context? Query and Key Matrices of In-Context Heads are Two Towers for Metric Learning Zeping Yu Sophia Ananiadou 102 12 0 05 Feb 2024
Self-attention Networks Localize When QK-eigenspectrum Concentrates Han Bao Ryuichiro Hataya Ryo Karakida 49 5 0 03 Feb 2024
Data Poisoning for In-context Learning Pengfei He Han Xu Yue Xing Hui Liu Makoto Yamada Jiliang Tang SILM AAML 100 13 0 03 Feb 2024
Can MLLMs Perform Text-to-Image In-Context Learning? Yuchen Zeng Wonjun Kang Yicong Chen Hyung Il Koo Kangwook Lee MLLM 88 11 0 02 Feb 2024
Position: Bayesian Deep Learning is Needed in the Age of Large-Scale AI Theodore Papamarkou Maria Skoularidou Konstantina Palla Laurence Aitchison Julyan Arbel ... David Rügamer Yee Whye Teh Max Welling Andrew Gordon Wilson Ruqi Zhang UQCV BDL 139 35 0 01 Feb 2024
Incoherent Probability Judgments in Large Language Models Jian-Qiao Zhu Thomas Griffiths 166 8 0 30 Jan 2024
An Information-Theoretic Analysis of In-Context Learning Hong Jun Jeon Jason D. Lee Qi Lei Benjamin Van Roy 122 24 0 28 Jan 2024
Learning Universal Predictors Jordi Grau-Moya Tim Genewein Marcus Hutter Laurent Orseau Grégoire Delétang ... Anian Ruoss Wenliang Kevin Li Christopher Mattern Matthew Aitchison J. Veness 89 16 0 26 Jan 2024
Demystifying Chains, Trees, and Graphs of Thoughts Maciej Besta Florim Memedi Zhenyu Zhang Robert Gerstenberger Guangyuan Piao ... Aleš Kubíček H. Niewiadomski Aidan O'Mahony Onur Mutlu Torsten Hoefler AI4CE LRM 364 33 0 25 Jan 2024
In-Context Language Learning: Architectures and Algorithms Ekin Akyürek Bailin Wang Yoon Kim Jacob Andreas LRM ReLM 131 56 0 23 Jan 2024
Benchmarking LLMs via Uncertainty Quantification Fanghua Ye Mingming Yang Jianhui Pang Longyue Wang Derek F. Wong Emine Yilmaz Shuming Shi Zhaopeng Tu ELM 247 59 0 23 Jan 2024
Enhancing In-context Learning via Linear Probe Calibration Momin Abbas Yi Zhou Parikshit Ram Nathalie Baracaldo Horst Samulowitz Theodoros Salonidis Tianyi Chen 114 14 0 22 Jan 2024
In-context Learning with Retrieved Demonstrations for Language Models: A Survey an Luo Xin Xu Yue Liu Panupong Pasupat Mehran Kazemi RALM 138 70 0 21 Jan 2024
PizzaCommonSense: Learning to Model Commonsense Reasoning about Intermediate Steps in Cooking Recipes Aissatou Diallo Antonis Bikakis Luke Dickens Anthony Hunter Rob Miller LRM 60 3 0 12 Jan 2024
Mind Your Format: Towards Consistent Evaluation of In-Context Learning Improvements Anton Voronov Lena Wolf Max Ryabinin 78 52 0 12 Jan 2024
Batch-ICL: Effective, Efficient, and Order-Agnostic In-Context Learning Kaiyi Zhang Ang Lv Yuhan Chen Hansen Ha Tao Xu Rui Yan 101 21 0 12 Jan 2024
Universal Vulnerabilities in Large Language Models: Backdoor Attacks for In-context Learning Shuai Zhao Meihuizi Jia Anh Tuan Luu Fengjun Pan Jinming Wen AAML 113 48 0 11 Jan 2024