Self-Assessment Tests are Unreliable Measures of LLM Personality

Self-Assessment Tests are Unreliable Measures of LLM Personality

15 September 2023

Akshat Gupta

Gopala Anumanchipalli

Papers citing "Self-Assessment Tests are Unreliable Measures of LLM Personality"

14 / 14 papers shown

Title
Humanizing LLMs: A Survey of Psychological Measurements with Tools, Datasets, and Human-Agent Applications Wenhan Dong Yuemeng Zhao Zhen Sun Yule Liu Zifan Peng ... Jun Wu Ruiming Wang Shengmin Xu Xinyi Huang Xinlei He LLMAG 82 1 0 30 Apr 2025
Beyond Self-Reports: Multi-Observer Agents for Personality Assessment in Large Language Models Yin Jou Huang Rafik Hadfi LLMAG 40 0 0 11 Apr 2025
The Mind in the Machine: A Survey of Incorporating Psychological Theories in LLMs Zizhou Liu Ziwei Gong Lin Ai Zheng Hui Run Chen Colin Wayne Leach Michelle R. Greene Julia Hirschberg LLMAG 243 0 0 28 Mar 2025
I'm Sorry Dave: How the old world of personnel security can inform the new world of AI insider risk Paul Martin Sarah Mercer 285 0 0 26 Mar 2025
We're Different, We're the Same: Creative Homogeneity Across LLMs Emily Wenger Yoed Kenett 95 5 0 31 Jan 2025
Rediscovering the Latent Dimensions of Personality with Large Language Models as Trait Descriptors Joseph Suh Suhong Moon Minwoo Kang David M. Chan 38 1 0 16 Sep 2024
Personality Alignment of Large Language Models Minjun Zhu Linyi Yang Yue Zhang Yue Zhang ALM 67 6 0 21 Aug 2024
Self-assessment, Exhibition, and Recognition: a Review of Personality in Large Language Models Zhiyuan Wen Yu Yang Jiannong Cao Haoming Sun Ruosong Yang Shuaiqi Liu 57 5 0 25 Jun 2024
Towards Region-aware Bias Evaluation Metrics Angana Borah Aparna Garimella Rada Mihalcea 31 0 0 23 Jun 2024
Do LLMs Have Distinct and Consistent Personality? TRAIT: Personality Testset designed for LLMs with Psychometrics Seungbeen Lee Seungwon Lim Seungju Han Giyeong Oh Hyungjoo Chae ... Beong-woo Kwak Yeonsoo Lee Dongha Lee Jinyoung Yeo Youngjae Yu 44 8 0 20 Jun 2024
Towards Measuring and Modeling "Culture" in LLMs: A Survey Muhammad Farid Adilazuarda Sagnik Mukherjee Pradhyumna Lavania Siddhant Singh Alham Fikri Aji Jacki OÑeill Ashutosh Modi Monojit Choudhury 67 56 0 05 Mar 2024
Revisiting the Reliability of Psychological Scales on Large Language Models Jen-tse Huang Wenxuan Wang Man Ho Lam E. Li Wenxiang Jiao Michael R. Lyu 45 21 0 31 May 2023
Leveraging Large Language Models for Multiple Choice Question Answering Joshua Robinson Christopher Rytting David Wingate ELM 148 187 0 22 Oct 2022
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 439 12,150 0 04 Mar 2022