Unveiling the Achilles' Heel of NLG Evaluators: A Unified Adversarial
Framework Driven by Large Language Models

Unveiling the Achilles' Heel of NLG Evaluators: A Unified Adversarial Framework Driven by Large Language Models

23 May 2024

Yiming Chen

Chen Zhang

Haizhou Li

Papers citing "Unveiling the Achilles' Heel of NLG Evaluators: A Unified Adversarial Framework Driven by Large Language Models"

8 / 8 papers shown

Title
Cheating Automatic LLM Benchmarks: Null Models Achieve High Win Rates Xiaosen Zheng Tianyu Pang Chao Du Qian Liu Jing Jiang Min-Bin Lin 41 8 0 09 Oct 2024
An LLM Feature-based Framework for Dialogue Constructiveness Assessment Lexin Zhou Youmna Farag Andreas Vlachos 44 2 0 20 Jun 2024
Can Large Language Models Be an Alternative to Human Evaluations? Cheng-Han Chiang Hung-yi Lee ALM LM&MA 224 572 0 03 May 2023
ProGen: Progressive Zero-shot Dataset Generation via In-context Feedback Jiacheng Ye Jiahui Gao Jiangtao Feng Zhiyong Wu Tao Yu Lingpeng Kong SyDa VLM 76 72 0 22 Oct 2022
Phrase-level Textual Adversarial Attack with Label Preservation Yibin Lei Yu Cao Dianqi Li Dinesh Manocha Meng Fang Mykola Pechenizkiy AAML 37 24 0 22 May 2022
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 313 11,953 0 04 Mar 2022
Measure and Improve Robustness in NLP Models: A Survey Xuezhi Wang Haohan Wang Diyi Yang 139 130 0 15 Dec 2021
Perturbation CheckLists for Evaluating NLG Evaluation Metrics Ananya B. Sai Tanay Dixit D. Y. Sheth S. Mohan Mitesh M. Khapra AAML 110 57 0 13 Sep 2021