Handling Divergent Reference Texts when Evaluating Table-to-Text Generation

3 June 2019

Papers citing "Handling Divergent Reference Texts when Evaluating Table-to-Text Generation"

50 / 125 papers shown

Title
How to Detect and Defeat Molecular Mirage: A Metric-Driven Benchmark for Hallucination in LLM-based Molecular Comprehension Hao Li Liuzhenghao Lv He Cao Zijing Liu Zhiyuan Yan Yu Wang Yonghong Tian Yuan Li Li Yuan 32 0 0 10 Apr 2025
The Challenge of Achieving Attributability in Multilingual Table-to-Text Generation with Question-Answer Blueprints Aden Haussmann LMTD 59 0 0 29 Mar 2025
DETQUS: Decomposition-Enhanced Transformers for QUery-focused Summarization Yasir Khan Xinlei Wu Sangpil Youm Justin Ho Aryaan Shaikh Jairo Garciga Rohan Sharma Bonnie J. Dorr LMTD 85 0 0 07 Mar 2025
Curriculum Learning for Cross-Lingual Data-to-Text Generation With Noisy Data Kancharla Aditya Hari Manish Gupta Vasudeva Varma 67 0 0 18 Dec 2024
An Extensive Evaluation of Factual Consistency in Large Language Models for Data-to-Text Generation Joy Mahapatra Utpal Garain HILM ALM 69 1 0 28 Nov 2024
Tree-of-Table: Unleashing the Power of LLMs for Enhanced Large-Scale Table Understanding Deyi Ji Lanyun Zhu Siqi Gao Peng Xu Hongtao Lu Jieping Ye Feng Zhao PINN LMTD 52 3 0 13 Nov 2024
Probing Omissions and Distortions in Transformer-based RDF-to-Text Models J. Faille Albert Gatt Claire Gardent 34 0 0 25 Sep 2024
Table-to-Text Generation with Pretrained Diffusion Models Aleksei S. Krylov Oleg D. Somov 40 1 0 10 Sep 2024
Automatic Metrics in Natural Language Generation: A Survey of Current Evaluation Practices Patrícia Schmidtová Saad Mahamood Simone Balloccu Ondřej Dušek Albert Gatt Dimitra Gkatzia David M. Howcroft Ondřej Plátek Adarsa Sivaprasad 45 3 0 17 Aug 2024
Impact of Model Size on Fine-tuned LLM Performance in Data-to-Text Generation: A State-of-the-Art Investigation Joy Mahapatra Utpal Garain 39 9 0 19 Jul 2024
ANHALTEN: Cross-Lingual Transfer for German Token-Level Reference-Free Hallucination Detection Janek Herrlein Chia-Chien Hung Goran Glavavs HILM 41 1 0 18 Jul 2024
Hallucination Detection: Robustly Discerning Reliable Answers in Large Language Models Yuyan Chen Qiang Fu Yichen Yuan Zhihao Wen Ge Fan Dayiheng Liu Dongmei Zhang Zhixu Li Yanghua Xiao HILM 49 69 0 04 Jul 2024
Facts-and-Feelings: Capturing both Objectivity and Subjectivity in Table-to-Text Generation Tathagata Dey Pushpak Bhattacharyya 30 0 0 15 Jun 2024
Uncovering Limitations of Large Language Models in Information Seeking from Tables Chaoxu Pang Yixuan Cao Chunhao Yang Ping Luo RALM LMTD 41 3 0 06 Jun 2024
Faithful Chart Summarization with ChaTS-Pi Syrine Krichene Francesco Piccinno Fangyu Liu Julian Martin Eisenschlos 37 1 0 29 May 2024
SPOR: A Comprehensive and Practical Evaluation Method for Compositional Generalization in Data-to-Text Generation Ziyao Xu Houfeng Wang 23 2 0 17 May 2024
COBias and Debias: Balancing Class Accuracies for Language Models in Inference Time via Nonlinear Integer Programming Ruixi Lin Yang You 35 0 0 13 May 2024
QFMTS: Generating Query-Focused Summaries over Multi-Table Inputs Weijia Zhang Vaishali Pal Jia-Hong Huang Evangelos Kanoulas Maarten de Rijke LMTD 37 6 0 08 May 2024
Best Practices and Lessons Learned on Synthetic Data for Language Models Ruibo Liu Jerry W. Wei Fangyu Liu Chenglei Si Yanzhe Zhang ... Steven Zheng Daiyi Peng Diyi Yang Denny Zhou Andrew M. Dai SyDa EgoV 43 86 0 11 Apr 2024
PoLLMgraph: Unraveling Hallucinations in Large Language Models via State Transition Dynamics Derui Zhu Dingfan Chen Qing Li Zongxiong Chen Lei Ma Jens Grossklags Mario Fritz HILM 35 9 0 06 Apr 2024
Improving Factual Accuracy of Neural Table-to-Text Output by Addressing Input Problems in ToTTo Barkavi Sundararajan S. Sripada Ehud Reiter LMTD 37 1 0 05 Apr 2024
Fakes of Varying Shades: How Warning Affects Human Perception and Engagement Regarding LLM Hallucinations Mahjabin Nahar Haeseung Seo Eun-Ju Lee Aiping Xiong Dongwon Lee HILM 37 11 0 04 Apr 2024
ALOHa: A New Measure for Hallucination in Captioning Models Suzanne Petryk David M. Chan Anish Kachinthaya Haodi Zou John F. Canny Joseph E. Gonzalez Trevor Darrell HILM 39 11 0 03 Apr 2024
ChatGPT Incorrectness Detection in Software Reviews M. Tanzil Junaed Younus Khan Gias Uddin 19 4 0 25 Mar 2024
Detecting Hallucination and Coverage Errors in Retrieval Augmented Generation for Controversial Topics Tyler A. Chang Katrin Tomanek Jessica Hoffmann Nithum Thain Erin van Liemt Kathleen Meier-Hellstern Lucas Dixon 41 7 0 13 Mar 2024
Strong hallucinations from negation and how to fix them Nicholas Asher Swarnadeep Bhar ReLM LRM 40 4 0 16 Feb 2024
A Systematic Review of Data-to-Text NLG Chinonso Osuji Thiago Castro Ferreira Brian Davis 40 1 0 13 Feb 2024
Large Language Models: A Survey Shervin Minaee Tomáš Mikolov Narjes Nikzad M. Asgari-Chenaghlu R. Socher Xavier Amatriain Jianfeng Gao ALM LM&MA ELM 134 371 0 09 Feb 2024
Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems Tianyu Cui Yanling Wang Chuanpu Fu Yong Xiao Sijia Li ... Junwu Xiong Xinyu Kong Zujie Wen Ke Xu Qi Li 60 56 0 11 Jan 2024
Chain-of-Table: Evolving Tables in the Reasoning Chain for Table Understanding Zilong Wang Hao Zhang Chun-Liang Li Julian Martin Eisenschlos Vincent Perot ... Lesly Miculicich Yasuhisa Fujii Jingbo Shang Chen-Yu Lee Tomas Pfister ReLM LMTD LRM 46 92 0 09 Jan 2024
Unifying Structured Data as Graph for Data-to-Text Pre-Training Shujie Li Liang Li Ruiying Geng Min Yang Binhua Li ... Wanwei He Shao Yuan Can Ma Fei Huang Yongbin Li LMTD 38 13 0 02 Jan 2024
Compositional Generalization for Data-to-Text Generation Xinnuo Xu Ivan Titov Mirella Lapata 29 2 0 05 Dec 2023
PixT3: Pixel-based Table-To-Text Generation Iñigo Alonso Eneko Agirre Mirella Lapata LMTD 27 5 0 16 Nov 2023
FaMeSumm: Investigating and Improving Faithfulness of Medical Summarization Nan Zhang Yusen Zhang Wu Guo P. Mitra Rui Zhang HILM 37 4 0 03 Nov 2023
Automatic Evaluation of Generative Models with Instruction Tuning Shuhaib Mehri Vered Shwartz ELM ALM 16 1 0 30 Oct 2023
Sequence-Level Certainty Reduces Hallucination In Knowledge-Grounded Dialogue Generation Yixin Wan Fanyou Wu Weijie Xu Srinivasan H. Sengamedu HILM 24 5 0 28 Oct 2023
ASPIRO: Any-shot Structured Parsing-error-Induced ReprOmpting for Consistent Data-to-Text Generation Martin Vejvar Yasutaka Fujimoto 38 1 0 27 Oct 2023
Correction with Backtracking Reduces Hallucination in Summarization Zhenzhen Liu Chao-gang Wan Varsha Kishore Jin Peng Zhou Minmin Chen Kilian Q. Weinberger HILM 26 3 0 24 Oct 2023
SoK: Memorization in General-Purpose Large Language Models Valentin Hartmann Anshuman Suri Vincent Bindschaedler David E. Evans Shruti Tople Robert West KELM LLMAG 21 20 0 24 Oct 2023
Language Models Hallucinate, but May Excel at Fact Verification Jian Guan Jesse Dodge David Wadden Minlie Huang Hao Peng LRM HILM 34 28 0 23 Oct 2023
FactCHD: Benchmarking Fact-Conflicting Hallucination Detection Xiang Chen Duanzheng Song Honghao Gui Chengxi Wang Ningyu Zhang Jiang Yong Yan Zhang Chengfei Lv Dan Zhang Huajun Chen HILM 35 14 0 18 Oct 2023
Calibrating Likelihoods towards Consistency in Summarization Models Polina Zablotskaia Misha Khalman Rishabh Joshi Livio Baldini Soares Shoshana Jakobovits Joshua Maynez Shashi Narayan 31 3 0 12 Oct 2023
Localize, Retrieve and Fuse: A Generalized Framework for Free-Form Question Answering over Tables Wenting Zhao Ye Liu Yao Wan Yibo Wang Zhongfen Deng Philip S. Yu RALM LMTD 27 7 0 20 Sep 2023
Few-Shot Data-to-Text Generation via Unified Representation and Multi-Source Learning A. Li Mingyue Shang Evangelia Spiliopoulou Jie Ma Patrick K. L. Ng ... William Yang Wang Kathleen McKeown Vittorio Castelli Dan Roth Bing Xiang 38 2 0 10 Aug 2023
A Stitch in Time Saves Nine: Detecting and Mitigating Hallucinations of LLMs by Validating Low-Confidence Generation Neeraj Varshney Wenlin Yao Hongming Zhang Jianshu Chen Dong Yu HILM 42 155 0 08 Jul 2023
PatternGPT :A Pattern-Driven Framework for Large Language Model Text Generation Le Xiao Xin Shan 23 5 0 02 Jul 2023
HAUSER: Towards Holistic and Automatic Evaluation of Simile Generation Qi He Yikai Zhang Jiaqing Liang Yuncheng Huang Yanghua Xiao Yunwen Chen 49 4 0 13 Jun 2023
EEL: Efficiently Encoding Lattices for Reranking Prasann Singhal Jiacheng Xu Xi Ye Greg Durrett 22 3 0 01 Jun 2023
Exposing Attention Glitches with Flip-Flop Language Modeling Bingbin Liu Jordan T. Ash Surbhi Goel A. Krishnamurthy Cyril Zhang LRM 27 46 0 01 Jun 2023
Faithful Low-Resource Data-to-Text Generation through Cycle Training Zhuoer Wang Marcus D. Collins Nikhita Vedula Simone Filice S. Malmasi Oleg Rokhlenko 47 10 0 24 May 2023