Evaluating ChatGPT's Information Extraction Capabilities: An Assessment of Performance, Explainability, Calibration, and Faithfulness

23 April 2023

Papers citing "Evaluating ChatGPT's Information Extraction Capabilities: An Assessment of Performance, Explainability, Calibration, and Faithfulness"

31 / 31 papers shown

Title
How to Mitigate Information Loss in Knowledge Graphs for GraphRAG: Leveraging Triple Context Restoration and Query-Driven Feedback Manzong Huang Chenyang Bu Yi He Xindong Wu 65 0 0 28 Jan 2025
What External Knowledge is Preferred by LLMs? Characterizing and Exploring Chain of Evidence in Imperfect Context Zhiyuan Chang Mingyang Li Xiaojun Jia Junjie Wang Yuekai Huang Qing Wang Yihao Huang Yang Liu 144 0 0 17 Dec 2024
MAVEN-Fact: A Large-scale Event Factuality Detection Dataset Chunyang Li Hao Peng Xiaozhi Wang Y. Qi Lei Hou Bin Xu Juanzi Li HILM 35 1 0 22 Jul 2024
Cascading Large Language Models for Salient Event Graph Generation Xingwei Tan Yuxiang Zhou Gabriele Pergola Yulan He 66 0 0 26 Jun 2024
Beyond Boundaries: Learning a Universal Entity Taxonomy across Datasets and Languages for Open Named Entity Recognition Yuming Yang Wantong Zhao Caishuang Huang Junjie Ye Xiao Wang ... Kaixin Huang Yunke Zhang Tao Gui Qi Zhang Xuanjing Huang 41 3 0 17 Jun 2024
PGA-SciRE: Harnessing LLM on Data Augmentation for Enhancing Scientific Relation Extraction Yang Zhou Shimin Shan Hongkui Wei Zhehuan Zhao Wenshuo Feng 41 1 0 30 May 2024
5W1H Extraction With Large Language Models Yang Cao Yangsong Lan Feiyan Zhai Piji Li 65 1 0 25 May 2024
Automating Creativity Ming-Hui Huang R. Rust 44 0 0 11 May 2024
ADELIE: Aligning Large Language Models on Information Extraction Y. Qi Hao Peng Xiaozhi Wang Bin Xu Lei Hou Juanzi Li 36 7 0 08 May 2024
Influence of Solution Efficiency and Valence of Instruction on Additive and Subtractive Solution Strategies in Humans and GPT-4 Lydia Uhler Verena Jordan Jürgen Buder Markus Huff F. Papenmeier 40 0 0 25 Apr 2024
HINTs: Sensemaking on large collections of documents with Hypergraph visualization and INTelligent agents Sam Yu-Te Lee Kwan-Liu Ma 43 2 0 05 Mar 2024
Adversarial Testing for Visual Grounding via Image-Aware Property Reduction Zhiyuan Chang Mingyang Li Junjie Wang Cheng Li Boyu Wu Fanjiang Xu Qing Wang AAML 36 0 0 02 Mar 2024
Rethinking Negative Instances for Generative Named Entity Recognition Yuyang Ding Juntao Li Pinzheng Wang Zecheng Tang Bowen Yan Min Zhang 47 10 0 26 Feb 2024
Leak, Cheat, Repeat: Data Contamination and Evaluation Malpractices in Closed-Source LLMs Simone Balloccu Patrícia Schmidtová Mateusz Lango Ondrej Dusek SILM ELM PILM 21 156 0 06 Feb 2024
Enhancing the Rationale-Input Alignment for Self-explaining Rationalization Wei Liu Yining Qi Jun Wang Zhiying Deng Yuankai Zhang Chengwei Wang Ruixuan Li 35 9 0 07 Dec 2023
MOKA: Moral Knowledge Augmentation for Moral Event Extraction Xinliang Frederick Zhang Winston Wu Nick Beauchamp Lu Wang 35 7 0 16 Nov 2023
TextEE: Benchmark, Reevaluation, Reflections, and Future Challenges in Event Extraction Kuan-Hao Huang I-Hung Hsu Tanmay Parekh Zhiyu Xie Zixuan Zhang Premkumar Natarajan Kai-Wei Chang Nanyun Peng Heng Ji 29 16 0 16 Nov 2023
When does In-context Learning Fall Short and Why? A Study on Specification-Heavy Tasks Hao Peng Xiaozhi Wang Jianhui Chen Weikai Li Y. Qi ... Zhili Wu Kaisheng Zeng Bin Xu Lei Hou Juanzi Li 31 28 0 15 Nov 2023
Primacy Effect of ChatGPT Yiwei Wang Yujun Cai Muhao Chen Yuxuan Liang Bryan Hooi ALM AI4MH LRM 33 13 0 20 Oct 2023
Empirical Study of Zero-Shot NER with ChatGPT Tingyu Xie Qi Li Jian Zhang Yan Zhang Zuozhu Liu Hongwei Wang LRM ReLM 24 63 0 16 Oct 2023
UniversalNER: Targeted Distillation from Large Language Models for Open Named Entity Recognition Wenxuan Zhou Sheng Zhang Yu Gu Muhao Chen Hoifung Poon 24 59 0 07 Aug 2023
Foundational Models Defining a New Era in Vision: A Survey and Outlook Muhammad Awais Muzammal Naseer Salman Khan Rao Muhammad Anwer Hisham Cholakkal M. Shah Ming Yang F. Khan VLM 38 118 0 25 Jul 2023
Predicting the Quality of Revisions in Argumentative Writing Zhexiong Liu Diane Litman E. Wang L. Matsumura Richard Correnti 30 5 0 01 Jun 2023
EvEval: A Comprehensive Evaluation of Event Semantics for Large Language Models Zhengwei Tao Zhi Jin Xiaoying Bai Haiyan Zhao Yanlin Feng Jia Li Wenpeng Hu 31 4 0 24 May 2023
Rethinking with Retrieval: Faithful Large Language Model Inference Hangfeng He Hongming Zhang Dan Roth KELM LRM 141 157 0 31 Dec 2022
ChatGPT Makes Medicine Easy to Swallow: An Exploratory Case Study on Simplified Radiology Reports Katharina Jeblick B. Schachtner Jakob Dexl Andreas Mittermeier Anna Theresa Stüber ... Tobias Weber Philipp Wesp B. Sabel J. Ricke Michael Ingrisch LM&MA MedIm 120 373 0 30 Dec 2022
A Survey on Open Information Extraction from Rule-based Model to Large Language Model Pai Liu Wenya Gao Wenjie Dong Lin Ai Wen Dong Songfang Huang Zongsheng Li Ehsan Hoque Julia Hirschberg Yue Zhang 37 2 0 18 Aug 2022
Large Language Models are Zero-Shot Reasoners Takeshi Kojima S. Gu Machel Reid Yutaka Matsuo Yusuke Iwasawa ReLM LRM 328 4,077 0 24 May 2022
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 313 11,953 0 04 Mar 2022
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models Jason W. Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Brian Ichter F. Xia Ed H. Chi Quoc Le Denny Zhou LM&Ro LRM AI4CE ReLM 367 8,495 0 28 Jan 2022
Packed Levitated Marker for Entity and Relation Extraction Deming Ye Yankai Lin Peng Li Maosong Sun 141 106 0 13 Sep 2021