v1v2 (latest)

Can Language Models Reason about Individualistic Human Values and Preferences?

4 October 2024

Papers citing "Can Language Models Reason about Individualistic Human Values and Preferences?"

44 / 44 papers shown

Title
From Surveys to Narratives: Rethinking Cultural Value Adaptation in LLMs Muhammad Farid Adilazuarda Chen Cecilia Liu Iryna Gurevych Alham Fikri Aji 196 0 0 22 May 2025
Reinforcement Learning from Human Feedback Nathan Lambert OffRL AI4CE 101 20 0 16 Apr 2025
CLASH: Evaluating Language Models on Judging High-Stakes Dilemmas from Multiple Perspectives Ayoung Lee Ryan Sungmo Kwon Peter Railton Lu Wang ELM 128 0 0 15 Apr 2025
BLEnD: A Benchmark for LLMs on Everyday Knowledge in Diverse Cultures and Languages Junho Myung Nayeon Lee Yi Zhou Jiho Jin Rifki Afina Putri ... Seid Muhie Yimam Mohammad Taher Pilehvar N. Ousidhoum Jose Camacho-Collados Alice Oh 155 55 0 17 Jan 2025
CulturalBench: A Robust, Diverse, and Challenging Cultural Benchmark by Human-AI CulturalTeaming Yu Ying Chiu Liwei Jiang Bill Yuchen Lin Chan Young Park Shuyue Stella Li ... Mehar Bhatia Maria Antoniak Yulia Tsvetkov Vered Shwartz Yejin Choi ELM ALM 107 0 0 03 Oct 2024
Personality Alignment of Large Language Models Minjun Zhu Linyi Yang Yue Zhang Yue Zhang ALM 117 8 0 21 Aug 2024
Personalizing Reinforcement Learning from Human Feedback with Variational Preference Learning S. Poddar Yanming Wan Hamish Ivison Abhishek Gupta Natasha Jaques 75 50 0 19 Aug 2024
Evaluating Cultural Adaptability of a Large Language Model via Simulation of Synthetic Personas Louis Kwok Michal Bravansky Lewis D. Griffin 83 15 0 13 Aug 2024
On the Pros and Cons of Active Learning for Moral Preference Elicitation Vijay Keswani Vincent Conitzer Hoda Heidari Jana Schaich Borg Walter Sinnott-Armstrong 71 2 0 26 Jul 2024
Virtual Personas for Language Models via an Anthology of Backstories Suhong Moon Marwa Abdulhai Minwoo Kang Joseph Suh Widyadewi Soedarmadji Eran Kohen Behar David M. Chan 69 15 0 09 Jul 2024
Scaling Synthetic Data Creation with 1,000,000,000 Personas Tao Ge Xin Chan Dian Yu Haitao Mi Dong Yu Dong Yu SyDa 201 150 0 28 Jun 2024
From Distributional to Overton Pluralism: Investigating Large Language Model Alignment Thom Lake Eunsol Choi Greg Durrett 96 13 0 25 Jun 2024
PAL: Pluralistic Alignment Framework for Learning from Heterogeneous Preferences Daiwei Chen Yi Chen Aniket Rege Ramya Korlakai Vinayak 96 23 0 12 Jun 2024
Self-Exploring Language Models: Active Preference Elicitation for Online Alignment Shenao Zhang Donghan Yu Hiteshi Sharma Ziyi Yang Shuohang Wang Hany Hassan Zhaoran Wang LRM 88 38 0 29 May 2024
Aligning to Thousands of Preferences via System Message Generalization Seongyun Lee Sue Hyun Park Seungone Kim Minjoon Seo ALM 95 49 0 28 May 2024
AI Alignment with Changing and Influenceable Reward Functions Micah Carroll Davis Foote Anand Siththaranjan Stuart J. Russell Anca Dragan 66 24 0 28 May 2024
Value Augmented Sampling for Language Model Alignment and Personalization Seungwook Han Idan Shenfeld Akash Srivastava Yoon Kim Pulkit Agrawal OffRL 71 29 0 10 May 2024
Replacing Judges with Juries: Evaluating LLM Generations with a Panel of Diverse Models Pat Verga Sebastian Hofstatter Sophia Althammer Yixuan Su Aleksandra Piktus Arkady Arkhangorodsky Minjie Xu Naomi White Patrick Lewis ALM ELM 104 104 0 29 Apr 2024
WorldValuesBench: A Large-Scale Benchmark Dataset for Multi-Cultural Value Awareness of Language Models Wenlong Zhao Debanjan Mondal Niket Tandon Danica Dillion Kurt Gray Yuling Gu VLM 105 16 0 25 Apr 2024
CultureBank: An Online Community-Driven Knowledge Base Towards Culturally Aware Language Technologies Weiyan Shi Ryan Li Yutong Zhang Caleb Ziems Chunhua yu R. Horesh Rogerio Abreu de Paula Diyi Yang 90 36 0 23 Apr 2024
CulturalTeaming: AI-Assisted Interactive Red-Teaming for Challenging LLMs' (Lack of) Multicultural Knowledge Yu Ying Chiu Amirhossein Ajalloeian Maria Antoniak Chan Young Park Shuyue Stella Li Mehar Bhatia Sahithya Ravi Yulia Tsvetkov Vered Shwartz Yejin Choi 85 23 0 10 Apr 2024
Unintended Impacts of LLM Alignment on Global Representation Michael Joseph Ryan William B. Held Diyi Yang 105 42 0 22 Feb 2024
Persona-DB: Efficient Large Language Model Personalization for Response Prediction with Collaborative Data Refinement Chenkai Sun Ke Yang R. Reddy Yi R. Fung Hou Pong Chan Chengxiang Zhai ChengXiang Zhai Heng Ji 81 25 0 16 Feb 2024
Massively Multi-Cultural Knowledge Acquisition & LM Benchmarking Yi R. Fung Ruining Zhao Jae Doo Chenkai Sun Heng Ji 56 33 0 14 Feb 2024
Reinforcement Learning from Human Feedback with Active Queries Kaixuan Ji Jiafan He Quanquan Gu 90 19 0 14 Feb 2024
Active Preference Learning for Large Language Models William Muldrew Peter Hayes Mingtian Zhang David Barber 78 24 0 12 Feb 2024
CultureLLM: Incorporating Cultural Differences into Large Language Models Cheng-rong Li Mengzhou Chen Jindong Wang Sunayana Sitaram Xing Xie VLM 101 21 0 09 Feb 2024
Active Preference Inference using Language Models and Probabilistic Reasoning Wasu Top Piriyakulkij Volodymyr Kuleshov Kevin Ellis LRM 67 15 0 19 Dec 2023
The Unlocking Spell on Base LLMs: Rethinking Alignment via In-Context Learning Bill Yuchen Lin Abhilasha Ravichander Ximing Lu Nouha Dziri Melanie Sclar Khyathi Chandu Chandra Bhagavatula Yejin Choi 59 196 0 04 Dec 2023
Sample Efficient Preference Alignment in LLMs via Active Exploration Viraj Mehta Vikramjeet Das Ojash Neopane Yijia Dai Ilija Bogunovic Ilija Bogunovic Willie Neiswanger Stefano Ermon Jeff Schneider Willie Neiswanger OffRL 95 9 0 01 Dec 2023
PEARL: Personalizing Large Language Model Writing Assistants with Generation-Calibrated Retrievers Sheshera Mysore Zhuoran Lu Mengting Wan Longqi Yang Steve Menezes Tina Baghaee Emmanuel Barajas Gonzalez Jennifer Neville Tara Safavi RALM 117 43 0 15 Nov 2023
On the steerability of large language models toward data-driven personas Junyi Li Ninareh Mehrabi Charith Peris Palash Goyal Kai-Wei Chang Aram Galstyan Richard Zemel Rahul Gupta 130 37 0 08 Nov 2023
Personalized Soups: Personalized Large Language Model Alignment via Post-hoc Parameter Merging Joel Jang Seungone Kim Bill Yuchen Lin Yizhong Wang Jack Hessel Luke Zettlemoyer Hannaneh Hajishirzi Yejin Choi Prithviraj Ammanabrolu MoMe 116 153 0 17 Oct 2023
ReConcile: Round-Table Conference Improves Reasoning via Consensus among Diverse LLMs Justin Chih-Yao Chen Swarnadeep Saha Joey Tianyi Zhou LLMAG LRM 99 141 0 22 Sep 2023
Towards Measuring the Representation of Subjective Global Opinions in Language Models Esin Durmus Karina Nyugen Thomas I. Liao Nicholas Schiefer Amanda Askell ... Alex Tamkin Janel Thamkul Jared Kaplan Jack Clark Deep Ganguli 100 244 0 28 Jun 2023
Direct Preference Optimization: Your Language Model is Secretly a Reward Model Rafael Rafailov Archit Sharma E. Mitchell Stefano Ermon Christopher D. Manning Chelsea Finn ALM 389 4,139 0 29 May 2023
Whose Opinions Do Language Models Reflect? Shibani Santurkar Esin Durmus Faisal Ladhak Cinoo Lee Percy Liang Tatsunori Hashimoto 83 442 0 30 Mar 2023
Social Simulacra: Creating Populated Prototypes for Social Computing Systems J. Park Lindsay Popowski Carrie J. Cai Meredith Ringel Morris Percy Liang Michael S. Bernstein 75 293 0 08 Aug 2022
Evaluating and Inducing Personality in Pre-trained Language Models Guangyuan Jiang Manjie Xu Song-Chun Zhu Wenjuan Han Chi Zhang Yixin Zhu 86 86 0 20 May 2022
Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback Yuntao Bai Andy Jones Kamal Ndousse Amanda Askell Anna Chen ... Jack Clark Sam McCandlish C. Olah Benjamin Mann Jared Kaplan 256 2,611 0 12 Apr 2022
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 886 13,176 0 04 Mar 2022
Beyond Goldfish Memory: Long-Term Open-Domain Conversation Jing Xu Arthur Szlam Jason Weston RALM 62 255 0 15 Jul 2021
Predicting Demographics, Moral Foundations, and Human Values from Digital Behaviors Kyriaki Kalimeri Mariano G. Beiró M. Delfino R. Raleigh C. Cattuto 71 60 0 05 Dec 2017
Proximal Policy Optimization Algorithms John Schulman Filip Wolski Prafulla Dhariwal Alec Radford Oleg Klimov OffRL 541 19,265 0 20 Jul 2017