v1v2 (latest)

All That's 'Human' Is Not Gold: Evaluating Human Evaluation of Generated Text

30 June 2021

Papers citing "All That's 'Human' Is Not Gold: Evaluating Human Evaluation of Generated Text"

50 / 224 papers shown

Title
Watermarks in the Sand: Impossibility of Strong Watermarking for Generative Models Hanlin Zhang Benjamin L. Edelman Danilo Francati Daniele Venturi G. Ateniese Boaz Barak WaLM 263 64 0 07 Nov 2023
How well can machine-generated texts be identified and can language models be trained to avoid identification? Sinclair Schneider Florian Steuber João A. G. Schneider Gabi Dreo Rodosek DeLMO 33 1 0 25 Oct 2023
HANSEN: Human and AI Spoken Text Benchmark for Authorship Analysis Nafis Irtiza Tripto Adaku Uchendu Thai V. Le Mattia Setzu F. Giannotti Dongwon Lee DeLMO 58 7 0 25 Oct 2023
Do Stochastic Parrots have Feelings Too? Improving Neural Detection of Synthetic Text via Emotion Recognition Alan Cowap Yvette Graham Jennifer Foster DeLMO 56 0 0 24 Oct 2023
Counting the Bugs in ChatGPT's Wugs: A Multilingual Investigation into the Morphological Capabilities of a Large Language Model Leonie Weissweiler Valentin Hofmann Anjali Kantharuban Anna Cai Ritam Dutt ... Abhishek Vijayakumar Haofei Yu Hinrich Schütze Kemal Oflazer David R. Mortensen 103 10 0 23 Oct 2023
A Survey on LLM-Generated Text Detection: Necessity, Methods, and Future Directions Junchao Wu Shu Yang Runzhe Zhan Yulin Yuan Derek F. Wong Lidia S. Chao DeLMO 103 33 0 23 Oct 2023
Embarrassingly Simple Text Watermarks Ryoma Sato Yuki Takezawa Han Bao Kenta Niwa Makoto Yamada WaLM 105 17 0 13 Oct 2023
A Confederacy of Models: a Comprehensive Evaluation of LLMs on Creative Writing Carlos Gómez-Rodríguez Paul Williams 88 82 0 12 Oct 2023
Synthetic Data Generation with Large Language Models for Text Classification: Potential and Limitations Zhuoyan Li Hangxiao Zhu Zhuoran Lu Ming Yin SyDa 120 80 0 11 Oct 2023
Towards Verifiable Generation: A Benchmark for Knowledge-aware Language Model Attribution Xinze Li Yixin Cao2 Liangming Pan Yubo Ma Aixin Sun HILM 33 21 0 09 Oct 2023
A Survey of GPT-3 Family Large Language Models Including ChatGPT and GPT-4 Katikapalli Subramanyam Kalyan LM&MA AI4CE LRM AILaw ELM 131 248 0 04 Oct 2023
Human Feedback is not Gold Standard Tom Hosking Phil Blunsom Max Bartolo ALM 124 55 0 28 Sep 2023
Art or Artifice? Large Language Models and the False Promise of Creativity Tuhin Chakrabarty Philippe Laban Divyansh Agarwal Smaranda Muresan Chien-Sheng Wu 94 136 0 25 Sep 2023
Can LLM-Generated Misinformation Be Detected? Canyu Chen Kai Shu DeLMO 191 182 0 25 Sep 2023
EvalLM: Interactive Evaluation of Large Language Model Prompts on User-Defined Criteria Tae Soo Kim Yoonjoo Lee Jamin Shin Young-Ho Kim Juho Kim 98 72 0 24 Sep 2023
Can LLMs Augment Low-Resource Reading Comprehension Datasets? Opportunities and Challenges Vinay Samuel Houda Aynaou Arijit Ghosh Chowdhury Karthik Venkat Ramanan Aman Chadha SyDa 105 11 0 21 Sep 2023
Text Style Transfer Evaluation Using Large Language Models Phil Ostheimer Mayank Nagda Marius Kloft Sophie Fellenz 128 10 0 25 Aug 2023
Never-ending Learning of User Interfaces Jason Wu Rebecca Krosnick E. Schoop Amanda Swearngin Jeffrey P. Bigham Jeffrey Nichols VLM HAI 39 16 0 17 Aug 2023
Thresh: A Unified, Customizable and Deployable Platform for Fine-Grained Text Evaluation David Heineman Yao Dou Wei Xu 76 7 0 14 Aug 2023
Automatically Correcting Large Language Models: Surveying the landscape of diverse self-correction strategies Liangming Pan Michael Stephen Saxon Wenda Xu Deepak Nathani Xinyi Wang William Yang Wang KELM LRM 116 216 0 06 Aug 2023
Fighting Fire with Fire: Can ChatGPT Detect AI-generated Text? Amrita Bhattacharjee Huang Liu DeLMO 88 64 0 02 Aug 2023
Anatomy of an AI-powered malicious social botnet Kai-Cheng Yang Filippo Menczer DeLMO 82 74 0 30 Jul 2023
Towards Automatic Boundary Detection for Human-AI Collaborative Hybrid Essay in Education Zijie Zeng Lele Sha Yuheng Li Kaixun Yang D. Gašević Guanliang Chen DeLMO 124 17 0 23 Jul 2023
Llama 2: Open Foundation and Fine-Tuned Chat Models Hugo Touvron Louis Martin Kevin R. Stone Peter Albert Amjad Almahairi ... Sharan Narang Aurelien Rodriguez Robert Stojnic Sergey Edunov Thomas Scialom AI4MH ALM 510 12,128 0 18 Jul 2023
Does Collaborative Human-LM Dialogue Generation Help Information Extraction from Human Dialogues? Bo-Ru Lu Nikita Haduong Chia-Hsuan Lee Zeqiu Wu Hao Cheng Paul Koester J. Utke Tao Yu Noah A. Smith Mari Ostendorf SyDa 96 2 0 13 Jul 2023
Designing Mixed-Initiative Video Games Daijin Yang 16 0 0 08 Jul 2023
On the Efficacy of Sampling Adapters Clara Meister Tiago Pimentel Luca Malagutti Ethan Gotlieb Wilcox Ryan Cotterell 122 14 0 07 Jul 2023
Style Over Substance: Evaluation Biases for Large Language Models Minghao Wu Alham Fikri Aji ALM ELM 143 47 0 06 Jul 2023
LLM-based Smart Reply (LSR): Enhancing Collaborative Performance with ChatGPT-mediated Smart Reply System Ashish Bastola Hongya Wang Judsen Hembree Pooja Yadav Zihao Gong Emma Dixon Abolfazl Razi Nathan J. Mcneese AI4MH 95 14 0 21 Jun 2023
Beyond Generating Code: Evaluating GPT on a Data Visualization Course Zhutian Chen Chenyang Zhang Qianwen Wang J. Troidl Simon Warchol Johanna Beyer Nils Gehlenborg Hanspeter Pfister 143 31 0 05 Jun 2023
COBRA Frames: Contextual Reasoning about Effects and Harms of Offensive Statements Xuhui Zhou Haojie Zhu Akhila Yerukola Thomas Davidson Jena D. Hwang Swabha Swayamdipta Maarten Sap 93 37 0 03 Jun 2023
AI Transparency in the Age of LLMs: A Human-Centered Research Roadmap Q. V. Liao J. Vaughan 145 168 0 02 Jun 2023
The ethical ambiguity of AI data enrichment: Measuring gaps in research ethics norms and practices Will Hawkins Brent Mittelstadt 104 10 0 01 Jun 2023
Rethinking Model Evaluation as Narrowing the Socio-Technical Gap Q. V. Liao Ziang Xiao ALM ELM 144 32 0 01 Jun 2023
Game of Tones: Faculty detection of GPT-4 generated content in university assessments Mike Perkins Jasper Roe Darius Postma James McGaughran James Cook University Singapore DeLMO 46 84 0 29 May 2023
On Degrees of Freedom in Defining and Testing Natural Language Understanding Saku Sugawara S. Tsugita ELM 79 1 0 24 May 2023
M4: Multi-generator, Multi-domain, and Multi-lingual Black-Box Machine-Generated Text Detection Yuxia Wang Jonibek Mansurov Petar Ivanov Jinyan Su Artem Shelmanov ... Thomas Arnold Alham Fikri Aji Nizar Habash Iryna Gurevych Preslav Nakov DeLMO 92 127 0 24 May 2023
Evaluating Evaluation Metrics: A Framework for Analyzing NLG Evaluation Metrics using Measurement Theory Ziang Xiao Susu Zhang Vivian Lai Q. V. Liao ELM 115 30 0 24 May 2023
A Question Answering Framework for Decontextualizing User-facing Snippets from Scientific Documents Benjamin Newman Luca Soldaini Raymond Fok Arman Cohan Kyle Lo RALM 55 18 0 24 May 2023
UniChart: A Universal Vision-language Pretrained Model for Chart Comprehension and Reasoning Ahmed Masry P. Kavehzadeh Do Xuan Long Enamul Hoque Shafiq Joty LRM 95 113 0 24 May 2023
Don't Take This Out of Context! On the Need for Contextual Models and Evaluations for Stylistic Rewriting Akhila Yerukola Xuhui Zhou Elizabeth Clark Maarten Sap 69 7 0 24 May 2023
DecipherPref: Analyzing Influential Factors in Human Preference Judgments via GPT-4 Ye Hu Kaiqiang Song Sangwoo Cho Xiaoyang Wang H. Foroosh Fei Liu 99 13 0 24 May 2023
On the Risk of Misinformation Pollution with Large Language Models Yikang Pan Liangming Pan Wenhu Chen Preslav Nakov Min-Yen Kan Wenjie Wang DeLMO 260 127 0 23 May 2023
APPLS: Evaluating Evaluation Metrics for Plain Language Summarization Yue Guo Tal August Gondy Leroy T. Cohen Lucy Lu Wang 173 9 0 23 May 2023
Album Storytelling with Iterative Story-aware Captioning and Large Language Models Munan Ning Yujia Xie Dongdong Chen Zeyin Song Lu Yuan Yonghong Tian QiXiang Ye Liuliang Yuan 71 8 0 22 May 2023
Dual Use Concerns of Generative AI and Large Language Models A. Grinbaum Laurynas Adomaitis MedIm AI4CE 66 16 0 13 May 2023
Can Large Language Models Be an Alternative to Human Evaluations? Cheng-Han Chiang Hung-yi Lee ALM LM&MA 300 633 0 03 May 2023
Why So Gullible? Enhancing the Robustness of Retrieval-Augmented Models against Counterfactual Noise Giwon Hong Jeonghwan Kim Junmo Kang Sung-Hyon Myaeng Joyce Jiyoung Whang RALM AAML 96 25 0 02 May 2023
Bridging the Gap: A Survey on Integrating (Human) Feedback for Natural Language Generation Patrick Fernandes Aman Madaan Emmy Liu António Farinhas Pedro Henrique Martins ... José G. C. de Souza Shuyan Zhou Tongshuang Wu Graham Neubig André F. T. Martins ALM 192 59 0 01 May 2023
ArguGPT: evaluating, understanding and identifying argumentative essays generated by GPT models Yikang Liu Ziyin Zhang Wanyang Zhang Shisen Yue Xiaojing Zhao Xinyuan Cheng Yiwen Zhang Hai Hu DeLMO 103 54 0 16 Apr 2023