Whose Opinions Do Language Models Reflect?

30 March 2023

Esin Durmus

Tatsunori Hashimoto

Papers citing "Whose Opinions Do Language Models Reflect?"

50 / 277 papers shown

Title
Perceptions of Linguistic Uncertainty by Language Models and Humans Catarina G Belém Markelle Kelly M. Steyvers Sameer Singh Padhraic Smyth 43 3 0 22 Jul 2024
Psychometric Alignment: Capturing Human Knowledge Distributions via Language Models Joy He-Yueya Wanjing Anya Ma Kanishk Gandhi Benjamin W. Domingue Emma Brunskill Noah D. Goodman ALM 36 3 0 22 Jul 2024
The Oscars of AI Theater: A Survey on Role-Playing with Language Models Nuo Chen Yan Wang Yang Deng Jia Li 35 15 0 16 Jul 2024
Thorns and Algorithms: Navigating Generative AI Challenges Inspired by Giraffes and Acacias Waqar Hussain 43 0 0 16 Jul 2024
Large Language Models for Integrating Social Determinant of Health Data: A Case Study on Heart Failure 30-Day Readmission Prediction Chase M. Fensore Rodrigo Carrillo-Larco Shivani Patel Alanna A. Morris Joyce C. Ho 43 0 0 12 Jul 2024
Investigating LLMs as Voting Assistants via Contextual Augmentation: A Case Study on the European Parliament Elections 2024 Ilias Chalkidis 37 2 0 11 Jul 2024
Grounding and Evaluation for Large Language Models: Practical Challenges and Lessons Learned (Survey) K. Kenthapadi M. Sameki Ankur Taly HILM ELM AILaw 39 12 0 10 Jul 2024
ChatGPT Doesn't Trust Chargers Fans: Guardrail Sensitivity in Context Victoria R. Li Yida Chen Naomi Saphra 43 3 0 09 Jul 2024
Virtual Personas for Language Models via an Anthology of Backstories Suhong Moon Marwa Abdulhai Minwoo Kang Joseph Suh Widyadewi Soedarmadji Eran Kohen Behar David M. Chan 49 11 0 09 Jul 2024
When LLMs Play the Telephone Game: Cumulative Changes and Attractors in Iterated Cultural Transmissions Jérémy Perez Corentin Léger Grgur Kovač Cédric Colas Gaia Molinaro Maxime Derex Pierre-Yves Oudeyer Clément Moulin-Frier 38 6 0 05 Jul 2024
Generative Monoculture in Large Language Models Fan Wu Emily Black Varun Chandrasekaran SyDa 35 3 0 02 Jul 2024
Jump Starting Bandits with LLM-Generated Prior Knowledge P. A. Alamdari Yanshuai Cao Kevin H. Wilson 46 1 0 27 Jun 2024
Revealing Fine-Grained Values and Opinions in Large Language Models Dustin Wright Arnav Arora Nadav Borenstein Srishti Yadav Serge J. Belongie Isabelle Augenstein 41 1 0 27 Jun 2024
Fairness and Bias in Multimodal AI: A Survey Tosin P. Adewumi Lama Alkhaled Namrata Gurung G. V. Boven Irene Pagliai 58 9 0 27 Jun 2024
Learning to Correct for QA Reasoning with Black-box LLMs Jaehyung Kim Dongyoung Kim Yiming Yang LRM 48 3 0 26 Jun 2024
Few-shot Personalization of LLMs with Mis-aligned Responses Jaehyung Kim Yiming Yang 50 7 0 26 Jun 2024
CoSafe: Evaluating Large Language Model Safety in Multi-Turn Dialogue Coreference Erxin Yu Jing Li Ming Liao Siqi Wang Zuchen Gao Fei Mi Lanqing Hong ELM LRM 33 9 0 25 Jun 2024
Beyond Demographics: Aligning Role-playing LLM-based Agents Using Human Belief Networks Yun-Shiuan Chuang Zach Studdiford Krirk Nirunwiroj Agam Goyal Vincent V. Frigo Sijia Yang Dhavan Shah Junjie Hu Timothy T. Rogers AI4CE 37 12 0 25 Jun 2024
LABOR-LLM: Language-Based Occupational Representations with Large Language Models Tianyu Du Ayush Kanodia Herman Brunborg Keyon Vafa Susan Athey 37 3 0 25 Jun 2024
From Distributional to Overton Pluralism: Investigating Large Language Model Alignment Thom Lake Eunsol Choi Greg Durrett 46 9 0 25 Jun 2024
Does Cross-Cultural Alignment Change the Commonsense Morality of Language Models? Yuu Jinnai 49 1 0 24 Jun 2024
Pareto-Optimal Learning from Preferences with Hidden Context Ryan Boldi Li Ding Lee Spector S. Niekum 70 6 0 21 Jun 2024
Prompt Injection Attacks in Defended Systems Daniil Khomsky Narek Maloyan Bulat Nutfullin AAML SILM 30 3 0 20 Jun 2024
Exploring Changes in Nation Perception with Nationality-Assigned Personas in LLMs M. Kamruzzaman Gene Louis Kim 37 4 0 20 Jun 2024
COMMUNITY-CROSS-INSTRUCT: Unsupervised Instruction Generation for Aligning Large Language Models to Online Communities Zihao He Rebecca Dorn Siyi Guo Minh Duc Hoang Chu Kristina Lerman 44 6 0 17 Jun 2024
Can LLM be a Personalized Judge? Yijiang River Dong Tiancheng Hu Nigel Collier ELM 45 35 0 17 Jun 2024
The Potential and Challenges of Evaluating Attitudes, Opinions, and Values in Large Language Models Bolei Ma Xinpeng Wang Tiancheng Hu Anna Haensch Michael A. Hedderich Barbara Plank Frauke Kreuter ALM 37 2 0 16 Jun 2024
PAL: Pluralistic Alignment Framework for Learning from Heterogeneous Preferences Daiwei Chen Yi Chen Aniket Rege Ramya Korlakai Vinayak 46 17 0 12 Jun 2024
It Takes Two: On the Seamlessness between Reward and Policy Model in RLHF Taiming Lu Lingfeng Shen Xinyu Yang Weiting Tan Beidi Chen Huaxiu Yao 63 2 0 12 Jun 2024
Collective Constitutional AI: Aligning a Language Model with Public Input Saffron Huang Divya Siddarth Liane Lovitt Thomas I. Liao Esin Durmus Alex Tamkin Deep Ganguli ELM 64 72 0 12 Jun 2024
A Synthetic Dataset for Personal Attribute Inference Hanna Yukhymenko Robin Staab Mark Vero Martin Vechev SyDa 54 6 0 11 Jun 2024
Language Models are Alignable Decision-Makers: Dataset and Application to the Medical Triage Domain Brian Hu Bill Ray Alice Leung Amy Summerville David Joy Christopher Funk Arslan Basharat 25 2 0 10 Jun 2024
Annotation alignment: Comparing LLM and human annotations of conversational safety Rajiv Movva Pang Wei Koh Emma Pierson ALM 39 3 0 10 Jun 2024
Whose Preferences? Differences in Fairness Preferences and Their Impact on the Fairness of AI Utilizing Human Feedback Emilia Agis Lerner Florian E. Dorner Elliott Ash Naman Goel 38 1 0 09 Jun 2024
Culturally Aware and Adapted NLP: A Taxonomy and a Survey of the State of the Art Chen Cecilia Liu Iryna Gurevych Anna Korhonen 33 5 0 06 Jun 2024
HYDRA: Model Factorization Framework for Black-Box LLM Personalization Yuchen Zhuang Haotian Sun Yue Yu Rushi Qiang Qifan Wang Chao Zhang Bo Dai AAML 51 15 0 05 Jun 2024
Aligning Language Models with Demonstrated Feedback Omar Shaikh Michelle S. Lam Joey Hejna Yijia Shao Michael S. Bernstein Michael S. Bernstein Diyi Yang ALM 31 24 0 02 Jun 2024
A Robot Walks into a Bar: Can Language Models Serve as Creativity Support Tools for Comedy? An Evaluation of LLMs' Humour Alignment with Comedians Piotr Wojciech Mirowski Juliette Love K. Mathewson Shakir Mohamed 32 20 0 31 May 2024
Evaluating Large Language Model Biases in Persona-Steered Generation Andy Liu Mona Diab Daniel Fried 44 22 0 30 May 2024
On the Algorithmic Bias of Aligning Large Language Models with RLHF: Preference Collapse and Matching Regularization Jiancong Xiao Ziniu Li Xingyu Xie E. Getzen Cong Fang Qi Long Weijie J. Su 43 13 0 26 May 2024
Promoting Constructive Deliberation: Reframing for Receptiveness Gauri Kambhatla Matthew Lease Ashwin Rajadesingan 40 2 0 23 May 2024
CIVICS: Building a Dataset for Examining Culturally-Informed Values in Large Language Models Giada Pistilli Alina Leidinger Yacine Jernite Atoosa Kasirzadeh A. Luccioni Margaret Mitchell 26 2 0 22 May 2024
Annotation-Efficient Preference Optimization for Language Model Alignment Yuu Jinnai Ukyo Honda 42 0 0 22 May 2024
Large Language Models Can Infer Personality from Free-Form User Interactions Heinrich Peters Moran Cerf S. C. Matz 44 7 0 19 May 2024
Tailoring Vaccine Messaging with Common-Ground Opinions Rickard Stureborg Sanxing Chen Ruoyu Xie Aayushi Patel Christopher Li Chloe Qinyu Zhu Tingnan Hu Jun Yang Bhuwan Dhingra 42 0 0 17 May 2024
Facilitating Opinion Diversity through Hybrid NLP Approaches Michiel van der Meer 47 0 0 15 May 2024
Large Language Models (LLMs) as Agents for Augmented Democracy Jairo Gudiño-Rosero Umberto Grandi César A. Hidalgo LLMAG 37 127 0 06 May 2024
The Effectiveness of LLMs as Annotators: A Comparative Overview and Empirical Analysis of Direct Representation Maja Pavlovic Massimo Poesio 42 17 0 02 May 2024
GRAMMAR: Grounded and Modular Methodology for Assessment of Closed-Domain Retrieval-Augmented Language Model Xinzhe Li Ming Liu Shang Gao RALM 40 0 0 30 Apr 2024
From Persona to Personalization: A Survey on Role-Playing Language Agents Jiangjie Chen Xintao Wang Rui Xu Siyu Yuan Yikai Zhang ... Caiyu Hu Siye Wu Scott Ren Ziquan Fu Yanghua Xiao 62 79 0 28 Apr 2024