Whose Opinions Do Language Models Reflect?

30 March 2023

Esin Durmus

Tatsunori Hashimoto

Papers citing "Whose Opinions Do Language Models Reflect?"

50 / 276 papers shown

Title
Empirically evaluating commonsense intelligence in large language models with large-scale human judgments Tuan Dung Nguyen Duncan J. Watts Mark E. Whiting ELM 24 0 0 15 May 2025
Value Portrait: Understanding Values of LLMs with Human-aligned Benchmark Jongwook Han Dongmin Choi Woojung Song Eun-Ju Lee Yohan Jo PILM 60 0 0 02 May 2025
HyPerAlign: Hypotheses-driven Personalized Alignment Cristina Garbacea Chenhao Tan 55 0 0 29 Apr 2025
Generative Product Recommendations for Implicit Superlative Queries Kaustubh D. Dhole Nikhita Vedula Saar Kuzi Giuseppe Castellucci Eugene Agichtein S. Malmasi 52 0 0 26 Apr 2025
Improving LLM Personas via Rationalization with Psychological Scaffolds Brihi Joshi Xiang Ren Swabha Swayamdipta Rik Koncel-Kedziorski Tim Paek 73 0 0 25 Apr 2025
Steering the CensorShip: Uncovering Representation Vectors for LLM "Thought" Control Hannah Cyberey David E. Evans LLMSV 76 0 0 23 Apr 2025
Do Words Reflect Beliefs? Evaluating Belief Depth in Large Language Models Shariar Kabir Kevin Esterling Yue Dong 32 0 0 23 Apr 2025
Implementing Rational Choice Functions with LLMs and Measuring their Alignment with User Preferences Anna Karnysheva Christian Drescher Dietrich Klakow 29 0 0 22 Apr 2025
Values in the Wild: Discovering and Analyzing Values in Real-World Language Model Interactions Saffron Huang Esin Durmus Miles McCain Kunal Handa Alex Tamkin Jerry Hong Michael Stern Arushi Somani Xiuruo Zhang Deep Ganguli VLM 51 1 0 21 Apr 2025
Know Me, Respond to Me: Benchmarking LLMs for Dynamic User Profiling and Personalized Responses at Scale Bowen Jiang Zhuoqun Hao Y. Cho B. Li Yuan Yuan Sihao Chen Lyle Ungar Camillo J Taylor Dan Roth 44 0 0 19 Apr 2025
Towards Characterizing Subjectivity of Individuals through Modeling Value Conflicts and Trade-offs Younghun Lee Dan Goldwasser LLMAG 172 0 0 17 Apr 2025
Evaluating the Diversity and Quality of LLM Generated Content Alexander Shypula Shuo Li Botong Zhang Vishakh Padmakumar Kayo Yin Osbert Bastani 47 1 0 16 Apr 2025
CLASH: Evaluating Language Models on Judging High-Stakes Dilemmas from Multiple Perspectives Ayoung Lee Ryan Sungmo Kwon Peter Railton Lu Wang ELM 51 0 0 15 Apr 2025
A Survey of Personalization: From RAG to Agent Xiaopeng Li Pengyue Jia Derong Xu Yi Wen Yingyi Zhang ... X. Li Y. Liu Huifeng Guo Ruiming Tang Xiangyu Zhao 3DV AI4TS AI4CE 44 0 0 14 Apr 2025
An Evaluation of Cultural Value Alignment in LLM Nicholas Sukiennik Chen Gao Fengli Xu Yongqian Li 29 0 0 11 Apr 2025
Talking Point based Ideological Discourse Analysis in News Events Nishanth Nakshatri Nikhil Mehta Siyi Liu Sihao Chen Daniel J. Hopkins Dan Roth Dan Goldwasser 34 0 0 10 Apr 2025
Navigating the Rabbit Hole: Emergent Biases in LLM-Generated Attack Narratives Targeting Mental Health Groups Rijul Magu Arka Dutta Sean Kim Ashiqur R. KhudaBukhsh Munmun De Choudhury 24 0 0 08 Apr 2025
NoveltyBench: Evaluating Language Models for Humanlike Diversity Yiming Zhang Harshita Diddee Susan Holm Hanchen Liu Xinyue Liu Vinay Samuel Barry Wang Daphne Ippolito 31 1 0 07 Apr 2025
Arti-"fickle" Intelligence: Using LLMs as a Tool for Inference in the Political and Social Sciences Lisa P. Argyle Ethan C. Busby Joshua R Gubler Bryce Hepner Alex Lyman David Wingate LLMAG 53 0 0 04 Apr 2025
LLM Social Simulations Are a Promising Research Method Jacy Reese Anthis Ryan Liu Sean M. Richardson Austin C. Kozlowski Bernard Koch James A. Evans Erik Brynjolfsson Michael S. Bernstein ALM 51 5 0 03 Apr 2025
Can Large Language Models Predict Associations Among Human Attitudes? Ana Ma Derek Powell 34 0 0 26 Mar 2025
AgentRxiv: Towards Collaborative Autonomous Research Samuel Schmidgall Michael Moor 65 3 0 23 Mar 2025
A Survey on Personalized Alignment -- The Missing Piece for Large Language Models in Real-World Applications Jian-Yu Guan Jian Wu J. Li Chuanqi Cheng Wei Yu Wu LM&MA 74 0 0 21 Mar 2025
Only a Little to the Left: A Theory-grounded Measure of Political Bias in Large Language Models Mats Faulborn Indira Sen Max Pellert Andreas Spitz David Garcia ELM 45 0 0 20 Mar 2025
Cultural Alignment in Large Language Models Using Soft Prompt Tuning Reem I. Masoud Martin Ferianc Philip C. Treleaven Miguel R. D. Rodrigues ALM 49 0 0 20 Mar 2025
The Empty Chair: Using LLMs to Raise Missing Perspectives in Policy Deliberations S. Fulay Deb Roy 60 0 0 18 Mar 2025
LLM Generated Persona is a Promise with a Catch Ang Li Haozhe Chen Hongseok Namkoong Tianyi Peng 57 1 0 18 Mar 2025
Investigating Human-Aligned Large Language Model Uncertainty Kyle Moore Jesse Roberts Daryl Watson Pamela Wisniewski 58 0 0 16 Mar 2025
LLMs' Leaning in European Elections Federico Ricciuti 51 0 0 16 Mar 2025
RESPONSE: Benchmarking the Ability of Language Models to Undertake Commonsense Reasoning in Crisis Situation Aissatou Diallo Antonis Bikakis Luke Dickens Anthony Hunter Rob Miller ReLM LRM 55 0 0 14 Mar 2025
Strategyproof Reinforcement Learning from Human Feedback Thomas Kleine Buening Jiarui Gan Debmalya Mandal Marta Z. Kwiatkowska 52 0 0 13 Mar 2025
Llms, Virtual Users, and Bias: Predicting Any Survey Question Without Human Data Enzo Sinacola Arnault Pachot Thierry Petit 39 0 0 11 Mar 2025
Sometimes the Model doth Preach: Quantifying Religious Bias in Open LLMs through Demographic Analysis in Asian Nations Hari Shankar Vedanta S P Tejas Cavale Ponnurangam Kumaraguru Abhijnan Chakraborty 58 0 0 10 Mar 2025
Personalized Generation In Large Model Era: A Survey Yiyan Xu Jinghao Zhang Alireza Salemi Xinting Hu Luu Anh Tuan Fuli Feng Hamed Zamani Xiangnan He Tat-Seng Chua 3DV 79 2 0 04 Mar 2025
Linear Representations of Political Perspective Emerge in Large Language Models Junsol Kim James Evans Aaron Schein 77 2 0 03 Mar 2025
Embracing Diversity: A Multi-Perspective Approach with Soft Labels Benedetta Muscato Praveen Bushipaka Gizem Gezici Lucia Passaro F. Giannotti Tommaso Cucinotta 39 0 0 01 Mar 2025
An Empirical Analysis of LLMs for Countering Misinformation A. Proma Neeley Pate James Druckman Gourab Ghoshal Hangfeng He Ehsan Hoque 39 0 0 28 Feb 2025
Beyond Demographics: Fine-tuning Large Language Models to Predict Individuals' Subjective Text Perceptions Matthias Orlikowski Jiaxin Pei Paul Röttger Philipp Cimiano David Jurgens Dirk Hovy 59 1 0 28 Feb 2025
When Personalization Meets Reality: A Multi-Faceted Analysis of Personalized Preference Learning Yijiang River Dong Tiancheng Hu Yinhong Liu Ahmet Üstün Nigel Collier 80 1 0 26 Feb 2025
Do LLMs exhibit demographic parity in responses to queries about Human Rights? Rafiya Javed Jackie Kay David Yanni Abdullah Zaini Anushe Sheikh Maribeth Rauh Iason Gabriel Laura Weidinger 59 0 0 26 Feb 2025
Provocations from the Humanities for Generative AI Research Lauren F. Klein Meredith Martin André Brock Maria Antoniak Melanie Walsh Jessica Marie Johnson Lauren Tilton David M. Mimno VLM 71 1 0 26 Feb 2025
Better Aligned with Survey Respondents or Training Data? Unveiling Political Leanings of LLMs on U.S. Supreme Court Cases Shanshan Xu T. Y. S. S. Santosh Yanai Elazar Quirin Vogel Barbara Plank Matthias Grabmair AILaw 83 0 0 25 Feb 2025
Language Model Fine-Tuning on Scaled Survey Data for Predicting Distributions of Public Opinions Joseph Suh Erfan Jahanparast Suhong Moon Minwoo Kang Serina Chang ALM LM&MA 55 1 0 24 Feb 2025
Human Preferences in Large Language Model Latent Space: A Technical Analysis on the Reliability of Synthetic Data in Voting Outcome Prediction Sarah Ball Simeon Allmendinger Frauke Kreuter Niklas Kühl 57 0 0 22 Feb 2025
C3AI: Crafting and Evaluating Constitutions for Constitutional AI Yara Kyrychenko Ke Zhou Edyta Bogucka Daniele Quercia ELM 45 3 0 21 Feb 2025
Task-driven Layerwise Additive Activation Intervention Hieu Trung Nguyen Bao Nguyen Binh Nguyen V. Nguyen KELM 51 0 0 10 Feb 2025
The Battling Influencers Game: Nash Equilibria Structure of a Potential Game and Implications to Value Alignment Young Wu Yancheng Zhu Jin-Yi Cai Xiaojin Zhu 96 0 0 03 Feb 2025
Diverse Preference Optimization Jack Lanchantin Angelica Chen S. Dhuliawala Ping Yu Jason Weston Sainbayar Sukhbaatar Ilia Kulikov 93 4 0 30 Jan 2025
Addressing Bias in Generative AI: Challenges and Research Opportunities in Information Management Xiahua Wei Naveen Kumar Han Zhang 68 5 0 22 Jan 2025
LLMs as Workers in Human-Computational Algorithms? Replicating Crowdsourcing Pipelines with LLMs Tongshuang Wu Haiyi Zhu Maya Albayrak Alexis Axon Amanda Bertsch ... Ying-Jui Tseng Patricia Vaidos Zhijin Wu Wei Yu Wu Chenyang Yang 86 30 0 10 Jan 2025