LLM Generated Persona is a Promise with a Catch

LLM Generated Persona is a Promise with a Catch

18 March 2025

Hongseok Namkoong

ArXiv (abs)PDF HTML

Papers citing "LLM Generated Persona is a Promise with a Catch"

18 / 18 papers shown

Title
Leveraging Interview-Informed LLMs to Model Survey Responses: Comparative Insights from AI-Generated and Human Data Jihong Zhang Xinya Liang Anqi Deng Nicole Bonge Lin Tan Ling Zhang Nicole Zarrett 32 0 0 28 May 2025
Twin-2K-500: A dataset for building digital twins of over 2,000 people based on their answers to over 500 questions Olivier Toubia George Gui Tianyi Peng Daniel J. Merlau Ang Li Haozhe Chen 57 1 0 23 May 2025
LLM-Evaluation Tropes: Perspectives on the Validity of LLM-Evaluations Laura Dietz Oleg Zendel P. Bailey Charles L. A. Clarke Ellese Cotterill Jeff Dalton Faegheh Hasibi Mark Sanderson Nick Craswell ELM 102 4 0 27 Apr 2025
Generative Agent Simulations of 1,000 People Joon Sung Park Carolyn Q. Zou Aaron Shaw Benjamin Mako Hill Carrie J. Cai Meredith Ringel Morris Robb Willer Percy Liang Michael S. Bernstein SyDa VGen LM&Ro AI4CE 59 103 0 15 Nov 2024
LLMs generate structurally realistic social networks but overestimate political homophily Serina Chang Alicja Chaszczewicz Emma Wang Maya Josifovska Emma Pierson J. Leskovec 108 8 0 29 Aug 2024
Representation Bias in Political Sample Simulations with Large Language Models Weihong Qi Hanjia Lyu Jiebo Luo 65 5 0 16 Jul 2024
Scaling Synthetic Data Creation with 1,000,000,000 Personas Tao Ge Xin Chan Dian Yu Haitao Mi Dong Yu Dong Yu SyDa 182 150 0 28 Jun 2024
RoleLLM: Benchmarking, Eliciting, and Enhancing Role-Playing Abilities of Large Language Models Zekun Wang Zhongyuan Peng Haoran Que Jiaheng Liu Wangchunshu Zhou ... Wanli Ouyang Ke Xu Wenhu Chen Jie Fu Junran Peng LLMAG 74 94 0 01 Oct 2023
Sensitivity, Performance, Robustness: Deconstructing the Effect of Sociodemographic Prompting Tilman Beck Hendrik Schuff Anne Lauscher Iryna Gurevych 72 37 0 13 Sep 2023
ExpertPrompting: Instructing Large Language Models to be Distinguished Experts Benfeng Xu An Yang Junyang Lin Quang Wang Chang Zhou Yongdong Zhang Zhendong Mao ALM 101 142 0 24 May 2023
Should ChatGPT be Biased? Challenges and Risks of Bias in Large Language Models Emilio Ferrara SILM 99 256 0 07 Apr 2023
Whose Opinions Do Language Models Reflect? Shibani Santurkar Esin Durmus Faisal Ladhak Cinoo Lee Percy Liang Tatsunori Hashimoto 81 442 0 30 Mar 2023
Out of One, Many: Using Language Models to Simulate Human Samples Lisa P. Argyle Ethan C. Busby Nancy Fulda Joshua R Gubler Christopher Rytting David Wingate SyDa 89 598 0 14 Sep 2022
Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject Studies Gati Aher RosaI. Arriaga Adam Tauman Kalai 124 399 0 18 Aug 2022
UnQovering Stereotyping Biases via Underspecified Questions Tao Li Tushar Khot Daniel Khashabi Ashish Sabharwal Vivek Srikumar 69 137 0 06 Oct 2020
SYNC: A Copula based Framework for Generating Synthetic Data from Aggregated Sources Zheng Li Yue Zhao Jia-lin Fu SyDa 54 29 0 20 Sep 2020
Language (Technology) is Power: A Critical Survey of "Bias" in NLP Su Lin Blodgett Solon Barocas Hal Daumé Hanna M. Wallach 155 1,248 0 28 May 2020
Gender Bias in Neural Natural Language Processing Kaiji Lu Piotr (Peter) Mardziel Fangjing Wu Preetam Amancharla Anupam Datta 117 356 0 31 Jul 2018