In-context Learning and Gradient Descent Revisited

v1v2v3v4 (latest)

In-context Learning and Gradient Descent Revisited

13 November 2023

Tomer Bar Natan

ArXiv (abs)PDF HTML

Papers citing "In-context Learning and Gradient Descent Revisited"

6 / 6 papers shown

Title
Brewing Knowledge in Context: Distillation Perspectives on In-Context Learning Chengye Li Haiyun Liu Yuanxi Li 17 0 0 13 Jun 2025
Understanding Task Vectors in In-Context Learning: Emergence, Functionality, and Limitations Yuxin Dong Jiachen Jiang Zhihui Zhu Xia Ning 23 0 0 10 Jun 2025
Counterfactual reasoning: an analysis of in-context emergence Moritz Miller Bernhard Schölkopf Siyuan Guo ReLM LRM 166 0 0 05 Jun 2025
The Role of Diversity in In-Context Learning for Large Language Models Wenyang Xiao Haoyu Zhao Lingxiao Huang 90 0 0 26 May 2025
Data Whisperer: Efficient Data Selection for Task-Specific LLM Fine-Tuning via Few-Shot In-Context Learning Shaobo Wang Xiangqi Jin Ziming Wang Jinqiao Wang Jingyun Zhang ... Zichen Wen Zhong Li Zeang Sheng Xuming Hu Linfeng Zhang SyDa 114 3 0 18 May 2025
Illusion or Algorithm? Investigating Memorization, Emergence, and Symbolic Processing in In-Context Learning Jingcheng Niu Subhabrata Dutta Ahmed Elshabrawy Harish Tayyar Madabushi Iryna Gurevych 153 1 0 16 May 2025