Focused Large Language Models are Stable Many-Shot Learners

Focused Large Language Models are Stable Many-Shot Learners

26 August 2024

Xinglin Wang

ArXiv (abs)PDF HTML

Papers citing "Focused Large Language Models are Stable Many-Shot Learners"

16 / 16 papers shown

Title
Poor-Supervised Evaluation for SuperLLM via Mutual Consistency Peiwen Yuan Shaoxiong Feng Yiwei Li Xinglin Wang Boyuan Pan Heda Wang Yao Hu Kan Li 63 1 0 25 Aug 2024
Integrate the Essence and Eliminate the Dross: Fine-Grained Self-Consistency for Free-Form Language Generation Xinglin Wang Yiwei Li Shaoxiong Feng Peiwen Yuan Boyuan Pan Heda Wang Yao Hu Kan Li 87 11 0 02 Jul 2024
In-Context Learning with Long-Context Models: An In-Depth Exploration Amanda Bertsch Maor Ivgi Uri Alon Jonathan Berant Matthew R. Gormley Matthew R. Gormley Graham Neubig ReLM AIMat 183 80 0 30 Apr 2024
Exploring the Relationship between In-Context Learning and Instruction Tuning Hanyu Duan Yixuan Tang Yi Yang Ahmed Abbasi Kar Yan Tam 85 11 0 17 Nov 2023
Dynamic Demonstrations Controller for In-Context Learning Fei Zhao Taotian Pang Zhen Wu Zheng Ma Shujian Huang Xinyu Dai 49 5 0 30 Sep 2023
Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena Lianmin Zheng Wei-Lin Chiang Ying Sheng Siyuan Zhuang Zhanghao Wu ... Dacheng Li Eric Xing Haotong Zhang Joseph E. Gonzalez Ion Stoica ALM OSLM ELM 458 4,444 0 09 Jun 2023
Transformers learn in-context by gradient descent J. Oswald Eyvind Niklasson E. Randazzo João Sacramento A. Mordvintsev A. Zhmoginov Max Vladymyrov MLT 116 496 0 15 Dec 2022
Towards Diverse, Relevant and Coherent Open-Domain Dialogue Generation via Hybrid Latent Variables Bin Sun Yitong Li Fei Mi Weichao Wang Yiwei Li Kan Li BDL 58 6 0 02 Dec 2022
Diversifying Neural Dialogue Generation via Negative Distillation Yiwei Li Shaoxiong Feng Bin Sun Kan Li 57 10 0 05 May 2022
The Dual Form of Neural Networks Revisited: Connecting Test Time Predictions to Training Patterns via Spotlights of Attention Kazuki Irie Róbert Csordás Jürgen Schmidhuber 71 44 0 11 Feb 2022
Learning To Retrieve Prompts for In-Context Learning Ohad Rubin Jonathan Herzig Jonathan Berant VPVLM RALM 88 709 0 16 Dec 2021
Training Verifiers to Solve Math Word Problems K. Cobbe V. Kosaraju Mohammad Bavarian Mark Chen Heewoo Jun ... Jerry Tworek Jacob Hilton Reiichiro Nakano Christopher Hesse John Schulman ReLM OffRL LRM 365 4,598 0 27 Oct 2021
Scaling Laws for Transfer Danny Hernandez Jared Kaplan T. Henighan Sam McCandlish 95 251 0 02 Feb 2021
Language Models are Few-Shot Learners Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan ... Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei BDL 904 42,520 0 28 May 2020
PIQA: Reasoning about Physical Commonsense in Natural Language Yonatan Bisk Rowan Zellers Ronan Le Bras Jianfeng Gao Yejin Choi OOD LRM 192 1,847 0 26 Nov 2019
CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledge Alon Talmor Jonathan Herzig Nicholas Lourie Jonathan Berant RALM 146 1,754 0 02 Nov 2018

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.