Is GPT-3 Text Indistinguishable from Human Text? Scarecrow: A Framework for Scrutinizing Machine Text

2 July 2021

Yao Dou

Maxwell Forbes

Rik Koncel-Kedziorski

Noah A. Smith

Yejin Choi

DeLMO

ArXiv PDF HTML

Papers citing "Is GPT-3 Text Indistinguishable from Human Text? Scarecrow: A Framework for Scrutinizing Machine Text"

50 / 77 papers shown

Title
Identifying and Mitigating the Influence of the Prior Distribution in Large Language Models Liyi Zhang Veniamin Veselovsky R. Thomas McCoy Thomas L. Griffiths 56 0 0 17 Apr 2025
REPA: Russian Error Types Annotation for Evaluating Text Generation and Judgment Capabilities Alexander Pugachev Alena Fenogenova Vladislav Mikhailov Ekaterina Artemova 34 0 0 17 Mar 2025
Toward Lightweight and Fast Decoders for Diffusion Models in Image and Video Generation Alexey Buzovkin Evgeny Shilov VGen 41 0 0 06 Mar 2025
Improving Your Model Ranking on Chatbot Arena by Vote Rigging Rui Min Tianyu Pang Chao Du Qian Liu Minhao Cheng Min-Bin Lin AAML 57 3 0 29 Jan 2025
AGENT-CQ: Automatic Generation and Evaluation of Clarifying Questions for Conversational Search with LLMs Clemencia Siro Yifei Yuan Mohammad Aliannejadi Maarten de Rijke ELM 25 3 0 25 Oct 2024
How Does the Disclosure of AI Assistance Affect the Perceptions of Writing? Zhuoyan Li Chen Liang Jing Peng Ming Yin 20 1 0 06 Oct 2024
Generative AI and Perceptual Harms: Who's Suspected of using LLMs? Kowe Kadoma D. Metaxa Mor Naaman 37 3 0 01 Oct 2024
Engineering Conversational Search Systems: A Review of Applications, Architectures, and Functional Components Phillip Schneider Wessel Poelman Michael Rovatsos Florian Matthes 29 2 0 01 Jul 2024
Detection and Measurement of Syntactic Templates in Generated Text Chantal Shaib Yanai Elazar Junyi Jessy Li Byron C. Wallace 46 13 0 28 Jun 2024
Text Generation: A Systematic Literature Review of Tasks, Evaluation, and Challenges Jonas Becker Jan Philip Wahle Bela Gipp Terry Ruas 28 9 0 24 May 2024
Do Language Models Enjoy Their Own Stories? Prompting Large Language Models for Automatic Story Evaluation Cyril Chhun Fabian M. Suchanek Chloé Clavel LRM 42 13 0 22 May 2024
MAiDE-up: Multilingual Deception Detection of GPT-generated Hotel Reviews Oana Ignat Xiaomeng Xu Rada Mihalcea DeLMO 32 6 0 19 Apr 2024
Interpreting Predictive Probabilities: Model Confidence or Human Label Variation? Joris Baan Raquel Fernández Barbara Plank Wilker Aziz 43 10 0 25 Feb 2024
Detecting Machine-Generated Texts by Multi-Population Aware Optimization for Maximum Mean Discrepancy Shuhai Zhang Yiliao Song Jiahao Yang Yuanqing Li Bo Han Mingkui Tan DeLMO 29 5 0 25 Feb 2024
Stumbling Blocks: Stress Testing the Robustness of Machine-Generated Text Detectors Under Attacks Yichen Wang Shangbin Feng Abe Bohan Hou Xiao Pu Chao Shen Xiaoming Liu Yulia Tsvetkov Tianxing He DeLMO 45 17 0 18 Feb 2024
Threads of Subtlety: Detecting Machine-Generated Texts Through Discourse Motifs Zae Myung Kim Kwang Hee Lee Preston Zhu Vipul Raheja Dongyeop Kang DeLMO 32 8 0 16 Feb 2024
Sentinels of the Stream: Unleashing Large Language Models for Dynamic Packet Classification in Software Defined Networks -- Position Paper Shariq Murtuza 26 1 0 10 Feb 2024
A Comparative Analysis of Conversational Large Language Models in Knowledge-Based Text Generation Phillip Schneider Manuel Klettner Elena Simperl Florian Matthes 16 6 0 02 Feb 2024
Raidar: geneRative AI Detection viA Rewriting Chengzhi Mao Carl Vondrick Hao Wang Junfeng Yang DeLMO 31 23 0 23 Jan 2024
Advancing GUI for Generative AI: Charting the Design Space of Human-AI Interactions through Task Creativity and Complexity Zijian Ding LLMAG 34 4 0 04 Jan 2024
Deep dive into language traits of AI-generated Abstracts Vikas Kumar Amisha Bharti Devanshu Verma Vasudha Bhatnagar DeLMO 6 1 0 17 Dec 2023
Reducing Privacy Risks in Online Self-Disclosures with Language Models Yao Dou Isadora Krsek Tarek Naous Anubha Kabra Sauvik Das Alan Ritter Wei-ping Xu 30 21 0 16 Nov 2023
A Survey on LLM-Generated Text Detection: Necessity, Methods, and Future Directions Junchao Wu Shu Yang Runzhe Zhan Yulin Yuan Derek F. Wong Lidia S. Chao DeLMO 24 23 0 23 Oct 2023
Synthetic Data Generation with Large Language Models for Text Classification: Potential and Limitations Zhuoyan Li Hangxiao Zhu Zhuoran Lu Ming Yin SyDa 69 67 0 11 Oct 2023
Task-Adaptive Tokenization: Enhancing Long-Form Text Generation Efficacy in Mental Health and Beyond Siyang Liu Naihao Deng Sahand Sabour Yilin Jia Minlie Huang Rada Mihalcea 30 18 0 09 Oct 2023
Language Model Decoding as Direct Metrics Optimization Haozhe Ji Pei Ke Hongning Wang Minlie Huang 11 7 0 02 Oct 2023
BooookScore: A systematic exploration of book-length summarization in the era of LLMs Yapei Chang Kyle Lo Tanya Goyal Mohit Iyyer ALM 21 106 0 01 Oct 2023
Can LLM-Generated Misinformation Be Detected? Canyu Chen Kai Shu DeLMO 31 158 0 25 Sep 2023
EvalLM: Interactive Evaluation of Large Language Model Prompts on User-Defined Criteria Tae Soo Kim Yoonjoo Lee Jamin Shin Young-Ho Kim Juho Kim 26 69 0 24 Sep 2023
From Text to Source: Results in Detecting Large Language Model-Generated Content Wissam Antoun Benoît Sagot Djamé Seddah DeLMO 25 11 0 23 Sep 2023
Donkii: Can Annotation Error Detection Methods Find Errors in Instruction-Tuning Datasets? Leon Weber-Genzel Robert Litschko Ekaterina Artemova Barbara Plank 16 2 0 04 Sep 2023
Thresh: A Unified, Customizable and Deployable Platform for Fine-Grained Text Evaluation David Heineman Yao Dou Wei-ping Xu 26 7 0 14 Aug 2023
Does Collaborative Human-LM Dialogue Generation Help Information Extraction from Human Dialogues? Bo-Ru Lu Nikita Haduong Chia-Hsuan Lee Zeqiu Wu Hao Cheng Paul Koester J. Utke Tao Yu Noah A. Smith Mari Ostendorf SyDa 49 2 0 13 Jul 2023
A Comprehensive Survey of Deep Transfer Learning for Anomaly Detection in Industrial Time Series: Methods, Applications, and Directions Peng Yan Ahmed Abdulkadir Paul-Philipp Luley Matthias Rosenthal Gerrit A. Schatte Benjamin Grewe Thilo Stadelmann AI4TS 36 57 0 11 Jul 2023
Mitigating the Learning Bias towards Repetition by Self-Contrastive Training for Open-Ended Generation Jian-Yu Guan Minlie Huang 26 0 0 04 Jul 2023
MISMATCH: Fine-grained Evaluation of Machine-generated Text with Mismatch Error Types K. Murugesan Sarathkrishna Swaminathan Soham Dan Subhajit Chaudhury Chulaka Gunasekara ... Ibrahim Abdelaziz Achille Fokoue Pavan Kapanipathi Salim Roukos Alexander G. Gray 37 5 0 18 Jun 2023
Reliability Check: An Analysis of GPT-3's Response to Sensitive Topics and Prompt Wording Aisha Khatun Daniel Brown KELM 10 12 0 09 Jun 2023
Fine-Grained Human Feedback Gives Better Rewards for Language Model Training Zeqiu Wu Yushi Hu Weijia Shi Nouha Dziri Alane Suhr Prithviraj Ammanabrolu Noah A. Smith Mari Ostendorf Hannaneh Hajishirzi ALM 30 304 0 02 Jun 2023
Evaluating GPT-3 Generated Explanations for Hateful Content Moderation H. Wang Ming Shan Hee Rabiul Awal K. T. W. Choo Roy Ka-Wei Lee 16 42 0 28 May 2023
Ghostbuster: Detecting Text Ghostwritten by Large Language Models Vivek Verma Eve Fleisig Nicholas Tomlin Dan Klein DeLMO 11 51 0 24 May 2023
Using Natural Language Explanations to Rescale Human Judgments Manya Wadhwa Jifan Chen Junyi Jessy Li Greg Durrett 38 8 0 24 May 2023
Dancing Between Success and Failure: Edit-level Simplification Evaluation using SALSA David Heineman Yao Dou Mounica Maddela Wei-ping Xu 23 15 0 23 May 2023
HumBEL: A Human-in-the-Loop Approach for Evaluating Demographic Factors of Language Models in Human-Machine Conversations Anthony Sicilia Jennifer C. Gates Malihe Alikhani 11 4 0 23 May 2023
Directed Acyclic Transformer Pre-training for High-quality Non-autoregressive Text Generation Fei Huang Pei Ke Minlie Huang AI4CE 35 8 0 24 Apr 2023
ArguGPT: evaluating, understanding and identifying argumentative essays generated by GPT models Yikang Liu Ziyin Zhang Wanyang Zhang Shisen Yue Xiaojing Zhao Xinyuan Cheng Yiwen Zhang Hai Hu DeLMO 14 49 0 16 Apr 2023
Towards an Understanding and Explanation for Mixed-Initiative Artificial Scientific Text Detection Luoxuan Weng Minfeng Zhu Kamkwai Wong Siyi Liu Jiashun Sun Hang Zhu Dongming Han Wei-Neng Chen DeLMO 24 8 0 11 Apr 2023
How to Design Translation Prompts for ChatGPT: An Empirical Study Yuan Gao Ruili Wang Feng Hou 13 41 0 05 Apr 2023
Does Human Collaboration Enhance the Accuracy of Identifying LLM-Generated Deepfake Texts? Adaku Uchendu Jooyoung Lee Hua Shen Thai Le Ting-Hao 'Kenneth' Huang Dongwon Lee DeLMO 36 31 0 03 Apr 2023
Paraphrase Detection: Human vs. Machine Content Jonas Becker Jan Philip Wahle Terry Ruas Bela Gipp DeLMO 27 13 0 24 Mar 2023
Language Model Behavior: A Comprehensive Survey Tyler A. Chang Benjamin Bergen VLM LRM LM&MA 27 103 0 20 Mar 2023