How Well Can LLMs Echo Us? Evaluating AI Chatbots' Role-Play Ability
with ECHO

How Well Can LLMs Echo Us? Evaluating AI Chatbots' Role-Play Ability with ECHO

22 April 2024

Michael R. Lyu

Papers citing "How Well Can LLMs Echo Us? Evaluating AI Chatbots' Role-Play Ability with ECHO"

6 / 6 papers shown

Title
PingPong: A Benchmark for Role-Playing Language Models with User Emulation and Multi-Model Evaluation Ilya Gusev LLMAG 58 3 0 10 Sep 2024
MMRole: A Comprehensive Framework for Developing and Evaluating Multimodal Role-Playing Agents Yanqi Dai Huanran Hu Lei Wang Shengjie Jin X. Chen Zhiwu Lu LLMAG 58 7 0 08 Aug 2024
How Far Are We on the Decision-Making of LLMs? Evaluating LLMs' Gaming Ability in Multi-Agent Environments Jen-tse Huang E. Li Man Ho Lam Tian Liang Wenxuan Wang Youliang Yuan Wenxiang Jiao Xing Wang Zhaopeng Tu Michael R. Lyu ELM LLMAG 88 33 0 18 Mar 2024
Humans or LLMs as the Judge? A Study on Judgement Biases Guiming Hardy Chen Shunian Chen Ziche Liu Feng Jiang Benyou Wang 82 93 0 16 Feb 2024
A & B == B & A: Triggering Logical Reasoning Failures in Large Language Models Yuxuan Wan Wenxuan Wang Yiliu Yang Youliang Yuan Jen-tse Huang Pinjia He Wenxiang Jiao Michael R. Lyu ELM LRM 109 13 0 01 Jan 2024
CharacterGLM: Customizing Chinese Conversational AI Characters with Large Language Models Jinfeng Zhou Zhuang Chen Dazhen Wan Bosi Wen Yi Song ... Wenjing Hou Yijia Zhang Yuxiao Dong Jie Tang Minlie Huang LLMAG AI4CE OSLM 98 24 0 28 Nov 2023