Incoherent Probability Judgments in Large Language Models

30 January 2024

Papers citing "Incoherent Probability Judgments in Large Language Models"

18 / 18 papers shown

Title
Are Large Language Models Reliable AI Scientists? Assessing Reverse-Engineering of Black-Box Systems Jiayi Geng Howard Chen Dilip Arumugam Thomas L. Griffiths 85 0 0 23 May 2025
Identifying and Mitigating the Influence of the Prior Distribution in Large Language Models Liyi Zhang Veniamin Veselovsky R. Thomas McCoy Thomas Griffiths 78 0 0 17 Apr 2025
Using the Tools of Cognitive Science to Understand Large Language Models at Different Levels of Analysis Alexander Ku Declan Campbell Xuechunzi Bai Jiayi Geng Ryan Liu ... Ilia Sucholutsky Veniamin Veselovsky Liyi Zhang Jian-Qiao Zhu Thomas L. Griffiths ELM 132 4 0 17 Mar 2025
LLM Agents Display Human Biases but Exhibit Distinct Learning Patterns Idan Horowitz Ori Plonsky 97 0 0 13 Mar 2025
Mind Your Step (by Step): Chain-of-Thought can Reduce Performance on Tasks where Thinking Makes Humans Worse Ryan Liu Jiayi Geng Addison J. Wu Ilia Sucholutsky Tania Lombrozo Thomas Griffiths ReLM LRM 106 32 0 27 Oct 2024
Language Models Trained to do Arithmetic Predict Human Risky and Intertemporal Choice Jian-Qiao Zhu Haijiang Yan Thomas Griffiths 111 2 0 29 May 2024
Deep de Finetti: Recovering Topic Distributions from Large Language Models Liyi Zhang R. Thomas McCoy T. Sumers Jian-Qiao Zhu Thomas Griffiths BDL 66 7 0 21 Dec 2023
Bayes in the age of intelligent machines Thomas Griffiths Jian-Qiao Zhu Erin Grant R. Thomas McCoy AI4CE 65 19 0 16 Nov 2023
Llamas Know What GPTs Don't Show: Surrogate Models for Confidence Estimation Vaishnavi Shrivastava Percy Liang Ananya Kumar 71 30 0 15 Nov 2023
Embers of Autoregression: Understanding Large Language Models Through the Problem They are Trained to Solve R. Thomas McCoy Shunyu Yao Dan Friedman Matthew Hardy Thomas Griffiths 49 156 0 24 Sep 2023
Llama 2: Open Foundation and Fine-Tuned Chat Models Hugo Touvron Louis Martin Kevin R. Stone Peter Albert Amjad Almahairi ... Sharan Narang Aurelien Rodriguez Robert Stojnic Sergey Edunov Thomas Scialom AI4MH ALM 296 11,858 0 18 Jul 2023
GPT-4 Technical Report OpenAI OpenAI OpenAI Josh Achiam Steven Adler Sandhini Agarwal Lama Ahmad ... Shengjia Zhao Tianhao Zheng Juntang Zhuang William Zhuk Barret Zoph LLMAG MLLM 1.4K 14,359 0 15 Mar 2023
Using cognitive psychology to understand GPT-3 Marcel Binz Eric Schulz ELM LLMAG 331 477 0 21 Jun 2022
An Explanation of In-context Learning as Implicit Bayesian Inference Sang Michael Xie Aditi Raghunathan Percy Liang Tengyu Ma ReLM BDL VPVLM LRM 195 751 0 03 Nov 2021
Verified Uncertainty Calibration Ananya Kumar Percy Liang Tengyu Ma 164 356 0 23 Sep 2019
BRUNO: A Deep Recurrent Model for Exchangeable Data I. Korshunova Jonas Degrave Ferenc Huszár Y. Gal Arthur Gretton J. Dambre BDL 47 33 0 21 Feb 2018
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 701 131,652 0 12 Jun 2017
Surprisingly Rational: Probability theory plus noise explains biases in judgment F. Costello P. Watts 56 120 0 01 Nov 2012