A Categorical Archive of ChatGPT Failures

6 February 2023

Papers citing "A Categorical Archive of ChatGPT Failures"

36 / 36 papers shown

Title
Information Retrieval in the Age of Generative AI: The RGB Model M. Garetto Alessandro Cornacchia Franco Galante Emilio Leonardi A. Nordio A. Tarable 131 0 0 29 Apr 2025
Are LLMs Good Annotators for Discourse-level Event Relation Extraction? Kangda Wei Aayush Gautam Ruihong Huang 32 4 0 28 Jul 2024
Unipa-GPT: Large Language Models for university-oriented QA in Italian Irene Siragusa Roberto Pirrone 28 1 0 19 Jul 2024
Satyrn: A Platform for Analytics Augmented Generation Marko Sterbentz Cameron Barrie Shubham Shahi Abhratanu Dutta Donna Hooshmand Harper Pack Kristian J. Hammond 36 0 0 17 Jun 2024
Unlearning Climate Misinformation in Large Language Models Michael Fore Simranjit Singh Chaehong Lee Amritanshu Pandey Antonios Anastasopoulos Dimitrios Stamoulis MU 54 1 0 29 May 2024
Attributions toward Artificial Agents in a modified Moral Turing Test Eyal Aharoni Sharlene Fernandes Daniel J Brady Caelan Alexander Michael Criner Kara Queen Javier Rando Eddy Nahmias Victor Crespo ELM 40 12 0 03 Apr 2024
Should We Fear Large Language Models? A Structural Analysis of the Human Reasoning System for Elucidating LLM Capabilities and Risks Through the Lens of Heidegger's Philosophy Jianqiiu Zhang ELM 35 1 0 05 Mar 2024
What Generative Artificial Intelligence Means for Terminological Definitions Antonio San Martín 35 1 0 25 Feb 2024
Leak, Cheat, Repeat: Data Contamination and Evaluation Malpractices in Closed-Source LLMs Simone Balloccu Patrícia Schmidtová Mateusz Lango Ondrej Dusek SILM ELM PILM 21 156 0 06 Feb 2024
Stability Analysis of ChatGPT-based Sentiment Analysis in AI Quality Assurance Tinghui Ouyang AprilPyone Maungmaung Koichi Konishi Yoshiki Seo Isao Echizen AI4MH 21 5 0 15 Jan 2024
Re-Temp: Relation-Aware Temporal Representation Learning for Temporal Knowledge Graph Completion Kunze Wang S. Han Josiah Poon 13 3 0 24 Oct 2023
ChatGPT & Mechanical Engineering: Examining performance on the FE Mechanical Engineering and Undergraduate Exams Matthew Frenkel Hebah Emara 26 2 0 26 Sep 2023
Towards LLM-based Autograding for Short Textual Answers Johannes Schneider Bernd Schenk Christina Niklaus AI4Ed 19 32 0 09 Sep 2023
RaLLe: A Framework for Developing and Evaluating Retrieval-Augmented Large Language Models Yasuto Hoshi Daisuke Miyashita Youyang Ng Kento Tatsuno Yasuhiro Morioka Osamu Torii J. Deguchi LRM 32 12 0 21 Aug 2023
Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback Viet Dac Lai Chien Van Nguyen Nghia Trung Ngo Thuat Nguyen Franck Dernoncourt Ryan A. Rossi Thien Huu Nguyen ALM 42 130 0 29 Jul 2023
Testing the Depth of ChatGPT's Comprehension via Cross-Modal Tasks Based on ASCII-Art: GPT3.5's Abilities in Regard to Recognizing and Generating ASCII-Art Are Not Totally Lacking David Bayani MLLM 33 5 0 28 Jul 2023
ChatGPT in the Age of Generative AI and Large Language Models: A Concise Survey S. Mohamadi G. Mujtaba Ngan Le Gianfranco Doretto Don Adjeroh LM&MA AI4MH 23 21 0 09 Jul 2023
Tricking LLMs into Disobedience: Formalizing, Analyzing, and Detecting Jailbreaks Abhinav Rao S. Vashistha Atharva Naik Somak Aditya Monojit Choudhury 30 17 0 24 May 2023
Does ChatGPT have Theory of Mind? B. Holterman Kees van Deemter LRM AI4CE 29 22 0 23 May 2023
A Survey of Safety and Trustworthiness of Large Language Models through the Lens of Verification and Validation Xiaowei Huang Wenjie Ruan Wei Huang Gao Jin Yizhen Dong ... Sihao Wu Peipei Xu Dengyu Wu André Freitas Mustafa A. Mustafa ALM 34 82 0 19 May 2023
Why Does ChatGPT Fall Short in Providing Truthful Answers? Shen Zheng Jie Huang Kevin Chen-Chuan Chang HILM AI4MH 19 51 0 20 Apr 2023
VISAR: A Human-AI Argumentative Writing Assistant with Visual Programming and Rapid Draft Prototyping Zheng Zhang Jie Ying Gao Ranjodh Singh Dhaliwal Toby Jia-Jun Li 30 86 0 16 Apr 2023
Zero-shot Temporal Relation Extraction with ChatGPT Chenhan Yuan Qianqian Xie Sophia Ananiadou 29 75 0 11 Apr 2023
Qualitative Failures of Image Generation Models and Their Application in Detecting Deepfakes Ali Borji 28 28 0 29 Mar 2023
Sparks of Artificial General Intelligence: Early experiments with GPT-4 Sébastien Bubeck Varun Chandrasekaran Ronen Eldan J. Gehrke Eric Horvitz ... Scott M. Lundberg Harsha Nori Hamid Palangi Marco Tulio Ribeiro Yi Zhang ELM AI4MH AI4CE ALM 289 2,232 0 22 Mar 2023
ChatGPT for Programming Numerical Methods Ali Kashefi T. Mukerji ALM 11 62 0 21 Mar 2023
A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPT Yihan Cao Siyu Li Yixin Liu Zhiling Yan Yutong Dai Philip S. Yu Lichao Sun 29 506 0 07 Mar 2023
ChatGPT: Jack of all trades, master of none Jan Kocoñ Igor Cichecki Oliwier Kaszyca Mateusz Kochanek Dominika Szydło ... Maciej Piasecki Lukasz Radliñski Konrad Wojtasik Stanislaw Wo'zniak Przemyslaw Kazienko AI4MH 20 526 0 21 Feb 2023
How Generative AI models such as ChatGPT can be (Mis)Used in SPC Practice, Education, and Research? An Exploratory Study F. Megahed Ying-Ju Chen Joshua A. Ferris S. Knoth L. A. Jones‐Farmer 47 117 0 17 Feb 2023
Auditing large language models: a three-layered approach Jakob Mokander Jonas Schuett Hannah Rose Kirk Luciano Floridi AILaw MLAU 42 194 0 16 Feb 2023
Language Models Are Greedy Reasoners: A Systematic Formal Analysis of Chain-of-Thought Abulhair Saparov He He ELM LRM ReLM 121 275 0 03 Oct 2022
Large Language Models are Zero-Shot Reasoners Takeshi Kojima S. Gu Machel Reid Yutaka Matsuo Yusuke Iwasawa ReLM LRM 316 4,077 0 24 May 2022
A Systematic Evaluation of Large Language Models of Code Frank F. Xu Uri Alon Graham Neubig Vincent J. Hellendoorn ELM ALM 204 631 0 26 Feb 2022
Challenges in Detoxifying Language Models Johannes Welbl Amelia Glaese J. Uesato Sumanth Dathathri John F. J. Mellor Lisa Anne Hendricks Kirsty Anderson Pushmeet Kohli Ben Coppin Po-Sen Huang LM&MA 250 193 0 15 Sep 2021
Extracting Training Data from Large Language Models Nicholas Carlini Florian Tramèr Eric Wallace Matthew Jagielski Ariel Herbert-Voss ... Tom B. Brown D. Song Ulfar Erlingsson Alina Oprea Colin Raffel MLAU SILM 290 1,814 0 14 Dec 2020
Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism M. Shoeybi M. Patwary Raul Puri P. LeGresley Jared Casper Bryan Catanzaro MoE 245 1,821 0 17 Sep 2019