Whose Opinions Do Language Models Reflect?

30 March 2023

Esin Durmus

Tatsunori Hashimoto

Papers citing "Whose Opinions Do Language Models Reflect?"

50 / 277 papers shown

Title
From Bytes to Biases: Investigating the Cultural Self-Perception of Large Language Models Wolfgang Messner Tatum Greene Josephine Matalone 30 4 0 21 Dec 2023
Measurement in the Age of LLMs: An Application to Ideological Scaling Sean O'Hagan Aaron Schein 48 9 0 14 Dec 2023
Generative agent-based modeling with actions grounded in physical, social, or digital space using Concordia A. Vezhnevets J. Agapiou Avia Aharon Ron Ziv Jayd Matyas Edgar A. Duénez-Guzmán William A. Cunningham Simon Osindero Danny Karmon Joel Z Leibo LLMAG LM&Ro AI4CE 40 41 0 06 Dec 2023
Case Repositories: Towards Case-Based Reasoning for AI Alignment K. J. Kevin Feng Quan Ze Chen Inyoung Cheong King Xia Amy X. Zhang 30 10 0 18 Nov 2023
You don't need a personality test to know these models are unreliable: Assessing the Reliability of Large Language Models on Psychometric Instruments Bangzhao Shu Lechen Zhang Minje Choi Lavinia Dunagan Lajanugen Logeswaran Moontae Lee Dallas Card David Jurgens 24 33 0 16 Nov 2023
Simulating Opinion Dynamics with Networks of LLM-based Agents Yun-Shiuan Chuang Agam Goyal Nikunj Harlalka Siddharth Suresh Robert Hawkins Sijia Yang Dhavan Shah Junjie Hu Timothy T. Rogers AI4CE 19 57 0 16 Nov 2023
Fair Abstractive Summarization of Diverse Perspectives Yusen Zhang Nan Zhang Yixin Liu Alexander R. Fabbri Junru Liu ... Caiming Xiong Jieyu Zhao Dragomir R. Radev Kathleen McKeown Rui Zhang 33 8 0 14 Nov 2023
Challenging the Validity of Personality Tests for Large Language Models Tom Sühr Florian E. Dorner Samira Samadi Augustin Kelava 16 9 0 09 Nov 2023
GRASP: A Disagreement Analysis Framework to Assess Group Associations in Perspectives Vinodkumar Prabhakaran Christopher Homan Lora Aroyo Aida Mostafazadeh Davani Alicia Parrish Alex S. Taylor Mark Díaz Ding Wang Greg Serapio-García 39 9 0 09 Nov 2023
On the steerability of large language models toward data-driven personas Junyi Li Ninareh Mehrabi Charith Peris Palash Goyal Kai-Wei Chang Aram Galstyan Richard Zemel Rahul Gupta 31 30 0 08 Nov 2023
Do LLMs exhibit human-like response biases? A case study in survey design Lindia Tjuatja Valerie Chen Sherry Tongshuang Wu Ameet Talwalkar Graham Neubig 32 80 0 07 Nov 2023
Improving Interpersonal Communication by Simulating Audiences with Language Models Ryan Liu Howard Yen Raja Marjieh Thomas L. Griffiths Ranjay Krishna 15 12 0 01 Nov 2023
Can Large Language Models Capture Public Opinion about Global Warming? An Empirical Assessment of Algorithmic Fidelity and Bias S. Lee T. Peng M. H. Goldberg S. A. Rosenthal J. Kotcher E. W. Maibach A. Leiserowitz AI4CE 23 16 0 01 Nov 2023
DELPHI: Data for Evaluating LLMs' Performance in Handling Controversial Issues David Q. Sun Artem Abzaliev Hadas Kotek Zidi Xiu Christopher Klein Jason D. Williams 24 9 0 27 Oct 2023
''Fifty Shades of Bias'': Normative Ratings of Gender Bias in GPT Generated English Text Rishav Hada Agrima Seth Harshita Diddee Kalika Bali 24 13 0 26 Oct 2023
Prevalence and prevention of large language model use in crowd work V. Veselovsky Manoel Horta Ribeiro Philip Cozzolino Andrew Gordon David Rothschild Robert West 31 0 0 24 Oct 2023
What Makes it Ok to Set a Fire? Iterative Self-distillation of Contexts and Rationales for Disambiguating Defeasible Social and Moral Situations Kavel Rao Liwei Jiang Valentina Pyatkin Yuling Gu Niket Tandon Nouha Dziri Faeze Brahman Yejin Choi 26 15 0 24 Oct 2023
Self-Consistency of Large Language Models under Ambiguity Henning Bartsch Ole Jorgensen Domenic Rosati Jason Hoelscher-Obermaier Jacob Pfau HILM 33 4 0 20 Oct 2023
Not All Countries Celebrate Thanksgiving: On the Cultural Dominance in Large Language Models Wenxuan Wang Wenxiang Jiao Jingyuan Huang Ruyi Dai Jen-tse Huang Zhaopeng Tu Michael R. Lyu 54 27 0 19 Oct 2023
Personalized Soups: Personalized Large Language Model Alignment via Post-hoc Parameter Merging Joel Jang Seungone Kim Bill Yuchen Lin Yizhong Wang Jack Hessel Luke Zettlemoyer Hannaneh Hajishirzi Yejin Choi Prithviraj Ammanabrolu MoMe 57 133 0 17 Oct 2023
Group Preference Optimization: Few-Shot Alignment of Large Language Models Siyan Zhao John Dang Aditya Grover 30 29 0 17 Oct 2023
CoMPosT: Characterizing and Evaluating Caricature in LLM Simulations Myra Cheng Tiziano Piccardi Diyi Yang LLMAG 18 67 0 17 Oct 2023
Compositional preference models for aligning LMs Dongyoung Go Tomasz Korbak Germán Kruszewski Jos Rozen Marc Dymetman 29 15 0 17 Oct 2023
Who Said That? Benchmarking Social Media AI Detection Wanyun Cui Linqiu Zhang Qianle Wang Shuyang Cai DeLMO 30 9 0 12 Oct 2023
Generating and Evaluating Tests for K-12 Students with Language Model Simulations: A Case Study on Sentence Reading Efficiency E. Zelikman Wanjing Anya Ma Jasmine E. Tran Diyi Yang Jason D. Yeatman Nick Haber AI4Ed 32 9 0 10 Oct 2023
Simulating Social Media Using Large Language Models to Evaluate Alternative News Feed Algorithms Petter Törnberg D. Valeeva J. Uitermark Christopher Bail LLMAG 44 43 0 05 Oct 2023
Language Models as a Service: Overview of a New Paradigm and its Challenges Emanuele La Malfa Aleksandar Petrov Simon Frieder Christoph Weinhuber Ryan Burnell Raza Nazar Anthony Cohn Nigel Shadbolt Michael Wooldridge ALM ELM 35 3 0 28 Sep 2023
Beyond Reverse KL: Generalizing Direct Preference Optimization with Diverse Divergence Constraints Chaoqi Wang Yibo Jiang Yuguang Yang Han Liu Yuxin Chen 42 82 0 28 Sep 2023
EvalLM: Interactive Evaluation of Large Language Model Prompts on User-Defined Criteria Tae Soo Kim Yoonjoo Lee Jamin Shin Young-Ho Kim Juho Kim 34 69 0 24 Sep 2023
Sensitivity, Performance, Robustness: Deconstructing the Effect of Sociodemographic Prompting Tilman Beck Hendrik Schuff Anne Lauscher Iryna Gurevych 43 33 0 13 Sep 2023
Large Language Models Can Infer Psychological Dispositions of Social Media Users Heinrich Peters S. C. Matz 11 29 0 13 Sep 2023
Does Writing with Language Models Reduce Content Diversity? Vishakh Padmakumar He He 33 81 0 11 Sep 2023
Framework-Based Qualitative Analysis of Free Responses of Large Language Models: Algorithmic Fidelity A. Amirova T. Fteropoulli Nafiso Ahmed Martin R. Cowie Joel Z Leibo 26 5 0 06 Sep 2023
Generative Social Choice Sara Fish Paul Gölz David C. Parkes Ariel D. Procaccia Gili Rusak Itai Shapira Manuel Wüthrich 33 26 0 03 Sep 2023
Value Kaleidoscope: Engaging AI with Pluralistic Human Values, Rights, and Duties Taylor Sorensen Liwei Jiang Jena D. Hwang Sydney Levine Valentina Pyatkin ... Kavel Rao Chandra Bhagavatula Maarten Sap J. Tasioulas Yejin Choi SLR 24 51 0 02 Sep 2023
Cultural Alignment in Large Language Models: An Explanatory Analysis Based on Hofstede's Cultural Dimensions Reem I. Masoud Ziquan Liu Martin Ferianc Philip C. Treleaven Miguel R. D. Rodrigues 27 50 0 25 Aug 2023
Contrasting Linguistic Patterns in Human and LLM-Generated Text Alberto Muñoz-Ortiz Carlos Gómez-Rodríguez David Vilares DeLMO 30 32 0 17 Aug 2023
Human-centered NLP Fact-checking: Co-Designing with Fact-checkers using Matchmaking for AI Houjiang Liu Anubrata Das Alexander Boltz Didi Zhou Daisy Pinaroc Matthew Lease Min Kyung Lee HAI 25 16 0 14 Aug 2023
ZYN: Zero-Shot Reward Models with Yes-No Questions for RLAIF Víctor Gallego SyDa 51 4 0 11 Aug 2023
Revisiting Prompt Engineering via Declarative Crowdsourcing Aditya G. Parameswaran Shreya Shankar Parth Asawa Naman Jain Yujie Wang 38 21 0 07 Aug 2023
Backdooring Instruction-Tuned Large Language Models with Virtual Prompt Injection Jun Yan Vikas Yadav Shiyang Li Lichang Chen Zheng Tang Hai Wang Vijay Srinivasan Xiang Ren Hongxia Jin SILM 25 82 0 31 Jul 2023
Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedback Stephen Casper Xander Davies Claudia Shi T. Gilbert Jérémy Scheurer ... Erdem Biyik Anca Dragan David M. Krueger Dorsa Sadigh Dylan Hadfield-Menell ALM OffRL 52 473 0 27 Jul 2023
Evaluating the Moral Beliefs Encoded in LLMs Nino Scherrer Claudia Shi Amir Feder David M. Blei 33 117 0 26 Jul 2023
Embedding Democratic Values into Social Media AIs via Societal Objective Functions Chenyan Jia Michelle S. Lam Minh Chau Mai Jeffrey T. Hancock Michael S. Bernstein 23 27 0 26 Jul 2023
How is ChatGPT's behavior changing over time? Lingjiao Chen Matei A. Zaharia James Zou ELM KELM AI4MH 44 414 0 18 Jul 2023
Evade ChatGPT Detectors via A Single Space Shuyang Cai Wanyun Cui DeLMO 41 15 0 05 Jul 2023
Scaling Laws Do Not Scale Fernando Diaz Michael A. Madaio 23 8 0 05 Jul 2023
Towards Measuring the Representation of Subjective Global Opinions in Language Models Esin Durmus Karina Nyugen Thomas I. Liao Nicholas Schiefer Amanda Askell ... Alex Tamkin Janel Thamkul Jared Kaplan Jack Clark Deep Ganguli 35 209 0 28 Jun 2023
Next Steps for Human-Centered Generative AI: A Technical Perspective Xiang Ánthony' Chen Jeff Burke Andrea Colaço Matthew K. Hong Jennifer Jacobs ... Dingzeyu Li Nanyun Peng Karl D. D. Willis Chien-Sheng Wu Bolei Zhou LLMAG 29 33 0 27 Jun 2023
Opportunities and Risks of LLMs for Scalable Deliberation with Polis Christopher T. Small Ivan Vendrov Esin Durmus Hadjar Homaei Elizabeth Barry Julien Cornebise Ted Suzman Deep Ganguli Colin Megill 32 27 0 20 Jun 2023