How to Detect and Defeat Molecular Mirage: A Metric-Driven Benchmark for Hallucination in LLM-based Molecular Comprehension

How to Detect and Defeat Molecular Mirage: A Metric-Driven Benchmark for Hallucination in LLM-based Molecular Comprehension

10 April 2025

Papers citing "How to Detect and Defeat Molecular Mirage: A Metric-Driven Benchmark for Hallucination in LLM-based Molecular Comprehension"

18 / 18 papers shown

Title
Uni-Retrieval: A Multi-Style Retrieval Framework for STEM's Education Yanhao Jia Xinyi Wu Hao Li Qinglin Zhang Yuxiao Hu Shuai Zhao Wenqi Fan 149 4 0 09 Feb 2025
AE-NeRF: Augmenting Event-Based Neural Radiance Fields for Non-ideal Conditions and Larger Scene Chaoran Feng Wangbo Yu Xinhua Cheng Zhenyu Tang Junwu Zhang Li Yuan Yonghong Tian 74 10 0 08 Jan 2025
EvaGaussians: Event Stream Assisted Gaussian Splatting from Blurry Images Wangbo Yu Chaoran Feng Jiye Tang Xu Jia Li-ming Yuan Yonghong Tian 96 31 0 29 May 2024
Can multiple-choice questions really be useful in detecting the abilities of LLMs? Wangyue Li Liangzhi Li Tong Xiang Xiao Liu Wei Deng Noa Garcia ELM 82 34 0 26 Mar 2024
MoleculeQA: A Dataset to Evaluate Factual Accuracy in Molecular Comprehension Xingyu Lu He Cao Zijing Liu Shengyuan Bai Leqing Chen Yuan Yao Hai-Tao Zheng Yu-Feng Li HILM 59 10 0 13 Mar 2024
MolCA: Molecular Graph-Language Modeling with Cross-Modal Projector and Uni-Modal Adapter Zhiyuan Liu Changhao Nai Yancheng Luo Hao Fei Yixin Cao Kenji Kawaguchi Xiang Wang Tat-Seng Chua 70 91 0 19 Oct 2023
A Stitch in Time Saves Nine: Detecting and Mitigating Hallucinations of LLMs by Validating Low-Confidence Generation Neeraj Varshney Wenlin Yao Hongming Zhang Jianshu Chen Dong Yu HILM 109 170 0 08 Jul 2023
FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation Sewon Min Kalpesh Krishna Xinxi Lyu M. Lewis Wen-tau Yih Pang Wei Koh Mohit Iyyer Luke Zettlemoyer Hannaneh Hajishirzi HILM ALM 128 684 0 23 May 2023
A Molecular Multimodal Foundation Model Associating Molecule Graphs with Natural Language Fuchun Sun Dazhao Du Zhao-Qing Yang Yujie Zhou Jiangmeng Li Anyi Rao Haoran Sun Zhiwu Lu Ji-Rong Wen 120 112 0 12 Sep 2022
Keeping it Simple: Language Models can learn Complex Molecular Distributions Daniel Flam-Shepherd Kevin Zhu A. Aspuru‐Guzik 207 148 0 06 Dec 2021
Pre-training Molecular Graph Representation with 3D Geometry Shengchao Liu Hanchen Wang Weiyang Liu Joan Lasenby Hongyu Guo Jian Tang 172 317 0 07 Oct 2021
Deduplicating Training Data Makes Language Models Better Katherine Lee Daphne Ippolito A. Nystrom Chiyuan Zhang Douglas Eck Chris Callison-Burch Nicholas Carlini SyDa 360 631 0 14 Jul 2021
Neural Path Hunter: Reducing Hallucination in Dialogue Systems via Path Grounding Nouha Dziri Andrea Madotto Osmar Zaiane A. Bose HILM 76 135 0 17 Apr 2021
ToTTo: A Controlled Table-To-Text Generation Dataset Ankur P. Parikh Xuezhi Wang Sebastian Gehrmann Manaal Faruqui Bhuwan Dhingra Diyi Yang Dipanjan Das LMTD 95 367 0 29 Apr 2020
Modeling Fluency and Faithfulness for Diverse Neural Machine Translation Yang Feng Wanying Xie Shuhao Gu Chenze Shao Wen Zhang Zhengxin Yang Dong Yu 62 25 0 30 Nov 2019
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer Colin Raffel Noam M. Shazeer Adam Roberts Katherine Lee Sharan Narang Michael Matena Yanqi Zhou Wei Li Peter J. Liu AIMat 427 20,181 0 23 Oct 2019
Handling Divergent Reference Texts when Evaluating Table-to-Text Generation Bhuwan Dhingra Manaal Faruqui Ankur P. Parikh Ming-Wei Chang Dipanjan Das William W. Cohen 93 196 0 03 Jun 2019
A Call for Clarity in Reporting BLEU Scores Matt Post 157 2,988 0 23 Apr 2018