Open Domain Multi-document Summarization: A Comprehensive Study of Model Brittleness under Retrieval

20 December 2022

Luca Soldaini

Kyle Lo

Arman Cohan

Papers citing "Open Domain Multi-document Summarization: A Comprehensive Study of Model Brittleness under Retrieval"

20 / 20 papers shown

Title
A Unified Retrieval Framework with Document Ranking and EDU Filtering for Multi-document Summarization Shiyin Tan Jaeeon Park Dongyuan Li Renhe Jiang Manabu Okumura RALM 43 0 0 23 Apr 2025
PreSumm: Predicting Summarization Performance Without Summarizing Steven Koniaev Ori Ernst Jackie Chi Kit Cheung 33 0 0 07 Apr 2025
Beyond Prompting: An Efficient Embedding Framework for Open-Domain Question Answering Zhanghao Hu Hanqi Yan Qingling Zhu Zhenyi Shen Yulan He Lin Gui RALM 44 0 0 03 Mar 2025
Multi2: Multi-Agent Test-Time Scalable Framework for Multi-Document Processing Juntai Cao Xiang Zhang Raymond Li Chuyuan Li Chenyu You Shafiq Joty Giuseppe Carenini 59 1 0 27 Feb 2025
MDCure: A Scalable Pipeline for Multi-Document Instruction-Following Gabrielle Kaili-May Liu Bowen Shi Avi Caciularu Idan Szpektor Arman Cohan 72 4 0 30 Oct 2024
E2LLM: Encoder Elongated Large Language Models for Long-Context Understanding and Reasoning Zihan Liao Jun Wang Hang Yu Lingxiao Wei Jianguo Li Jun Wang Wei Zhang 24 2 0 10 Sep 2024
TopicTag: Automatic Annotation of NMF Topic Models Using Chain of Thought and Prompt Tuning with LLMs Selma Wanna Ryan Barron N. Solovyev M. Eren Manish Bhattarai Kim Ø. Rasmussen Boian S. Alexandrov 22 3 0 29 Jul 2024
LightPAL: Lightweight Passage Retrieval for Open Domain Multi-Document Summarization Masafumi Enomoto Kunihiro Takeoka Kosuke Akimoto Kiril Gashteovski Masafumi Oyamada RALM 32 1 0 18 Jun 2024
TOPICAL: TOPIC Pages AutomagicaLly John Giorgi Amanpreet Singh Doug Downey Sergey Feldman Lucy Lu Wang MedIm 42 0 0 03 May 2024
On the Evaluation of Machine-Generated Reports James Mayfield Eugene Yang Dawn J Lawrie Sean MacAvaney Paul McNamee ... Orion Weller Efsun Kayi Kate Sanders Marc Mason Noah Hibbler ALM 106 12 0 02 May 2024
Characterizing LLM Abstention Behavior in Science QA with Context Perturbations Bingbing Wen Bill Howe Lucy Lu Wang 31 8 0 18 Apr 2024
SuRe: Summarizing Retrievals using Answer Candidates for Open-domain QA of LLMs Jaehyung Kim Jaehyun Nam Sangwoo Mo Jongjin Park Sang-Woo Lee Minjoon Seo Jung-Woo Ha Jinwoo Shin AIFin RALM ELM 40 35 0 17 Apr 2024
SportsMetrics: Blending Text and Numerical Data to Understand Information Fusion in LLMs Yebowen Hu Kaiqiang Song Sangwoo Cho Xiaoyang Wang H. Foroosh Dong Yu Fei Liu 25 8 0 15 Feb 2024
ODSum: New Benchmarks for Open Domain Multi-Document Summarization Yijie Zhou Kejian Shi Wencai Zhang Yixin Liu Yilun Zhao Arman Cohan RALM 37 2 0 16 Sep 2023
Revisiting Sentence Union Generation as a Testbed for Text Consolidation Eran Hirsch Valentina Pyatkin Ruben Wolhandler Avi Caciularu Asi Shefer Ido Dagan MoMe 26 6 0 24 May 2023
LSG Attention: Extrapolation of pretrained Transformers to long sequences Charles Condevaux S. Harispe 38 24 0 13 Oct 2022
Deduplicating Training Data Makes Language Models Better Katherine Lee Daphne Ippolito A. Nystrom Chiyuan Zhang Douglas Eck Chris Callison-Burch Nicholas Carlini SyDa 242 595 0 14 Jul 2021
BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models Nandan Thakur Nils Reimers Andreas Rucklé Abhishek Srivastava Iryna Gurevych VLM 264 975 0 17 Apr 2021
Mitigating the Position Bias of Transformer Models in Passage Re-Ranking Sebastian Hofstatter Aldo Lipani Sophia Althammer Markus Zlabinger Allan Hanbury 55 15 0 18 Jan 2021
The Expando-Mono-Duo Design Pattern for Text Ranking with Pretrained Sequence-to-Sequence Models Ronak Pradeep Rodrigo Nogueira Jimmy J. Lin MoE 67 166 0 14 Jan 2021