Evaluating LLM Adaptation to Sociodemographic Factors: User Profile vs. Dialogue History

27 May 2025

ArXiv (abs)PDF HTML

Papers citing "Evaluating LLM Adaptation to Sociodemographic Factors: User Profile vs. Dialogue History"

10 / 10 papers shown

Title
An Evaluation of Cultural Value Alignment in LLM Nicholas Sukiennik Chen Gao Fengli Xu Yongqian Li 60 2 0 11 Apr 2025
Can LLMs Grasp Implicit Cultural Values? Benchmarking LLMs' Metacognitive Cultural Intelligence with CQ-Bench Ziyi Liu Priyanka Dey Zhenyu Zhao Jen-tse Huang Rahul Gupta Yang Liu Jieyu Zhao 74 2 0 01 Apr 2025
WorldValuesBench: A Large-Scale Benchmark Dataset for Multi-Cultural Value Awareness of Language Models Wenlong Zhao Debanjan Mondal Niket Tandon Danica Dillion Kurt Gray Yuling Gu VLM 110 16 0 25 Apr 2024
LiveChat: A Large-Scale Personalized Dialogue Dataset Automatically Constructed from Live Streaming Jingsheng Gao Yixin Lian Ziyi Zhou Yuzhuo Fu Baoyuan Wang 80 19 0 14 Jun 2023
Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena Lianmin Zheng Wei-Lin Chiang Ying Sheng Siyuan Zhuang Zhanghao Wu ... Dacheng Li Eric Xing Haotong Zhang Joseph E. Gonzalez Ion Stoica ALM OSLM ELM 450 4,444 0 09 Jun 2023
Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them Mirac Suzgun Nathan Scales Nathanael Scharli Sebastian Gehrmann Yi Tay ... Aakanksha Chowdhery Quoc V. Le Ed H. Chi Denny Zhou Jason W. Wei ALM ELM LRM ReLM 271 1,139 0 17 Oct 2022
Pchatbot: A Large-Scale Dataset for Personalized Chatbot Hongjin Qian Xiaohe Li Hanxun Zhong Yu Guo Yueyuan Ma Yutao Zhu Zhanliang Liu Zhanliang Liu Ji-Rong Wen 119 46 0 28 Sep 2020
On a generalization of the Jensen-Shannon divergence Frank Nielsen 76 112 0 02 Dec 2019
Personalizing Dialogue Agents: I have a dog, do you have pets too? Saizheng Zhang Emily Dinan Jack Urbanek Arthur Szlam Douwe Kiela Jason Weston 127 1,465 0 22 Jan 2018
A Broad-Coverage Challenge Corpus for Sentence Understanding through Inference Adina Williams Nikita Nangia Samuel R. Bowman 524 4,497 0 18 Apr 2017