DisastIR: A Comprehensive Information Retrieval Benchmark for Disaster Management

DisastIR: A Comprehensive Information Retrieval Benchmark for Disaster Management

20 May 2025

ArXiv (abs)PDF HTML

Papers citing "DisastIR: A Comprehensive Information Retrieval Benchmark for Disaster Management"

17 / 17 papers shown

Title
Enhancing Negation Awareness in Universal Text Embeddings: A Data-efficient and Computational-efficient Approach Hongliu Cao 109 1 0 01 Apr 2025
Judging the Judges: A Collection of LLM-Generated Relevance Judgements Hossein A. Rahmani Clemencia Siro Mohammad Aliannejadi Nick Craswell Charles L. A. Clarke Guglielmo Faggioli Bhaskar Mitra Paul Thomas Emine Yilmaz ELM 95 1 0 20 Feb 2025
Can Generative LLMs Create Query Variants for Test Collections? An Exploratory Study Marwah Alaofi Luke Gallagher Mark Sanderson Falk Scholer Paul Thomas 88 38 0 29 Jan 2025
SynDL: A Large-Scale Synthetic Test Collection for Passage Retrieval Hossein A. Rahmani Xi Wang Emine Yilmaz Nick Craswell Bhaskar Mitra Paul Thomas 124 7 0 28 Jan 2025
CrisisSense-LLM: Instruction Fine-Tuned Large Language Model for Multi-label Social Media Text Classification in Disaster Informatics Kai Yin Chengkai Liu Ali Mostafavi Helen Zhou 103 12 0 17 Jan 2025
Harnessing Large Language Models for Disaster Management: A Survey Zhenyu Lei Yushun Dong Weiyu Li Rong Ding Qi Wang Jundong Li AI4CE 109 7 0 12 Jan 2025
Best in Tau@LLMJudge: Criteria-Based Relevance Evaluation with Llama3 Naghmeh Farzi Laura Dietz ELM 51 5 0 17 Oct 2024
Embedding And Clustering Your Data Can Improve Contrastive Pretraining Luke Merrick 57 5 0 26 Jul 2024
NV-Embed: Improved Techniques for Training LLMs as Generalist Embedding Models Chankyu Lee Rajarshi Roy Mengyao Xu Jonathan Raiman Mohammad Shoeybi Bryan Catanzaro Ming-Yu Liu RALM 282 205 0 27 May 2024
Text Embeddings by Weakly-Supervised Contrastive Pre-training Liang Wang Nan Yang Xiaolong Huang Binxing Jiao Linjun Yang Daxin Jiang Rangan Majumder Furu Wei VLM 249 623 0 07 Dec 2022
GooAQ: Open Question Answering with Diverse Answer Types Daniel Khashabi Amos Ng Tushar Khot Ashish Sabharwal Hannaneh Hajishirzi Chris Callison-Burch 73 54 0 18 Apr 2021
BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models Nandan Thakur Nils Reimers Andreas Rucklé Abhishek Srivastava Iryna Gurevych VLM 425 1,057 0 17 Apr 2021
CLIMATE-FEVER: A Dataset for Verification of Real-World Climate Claims Thomas Diggelmann Jordan L. Boyd-Graber Jannis Bulian Massimiliano Ciaramita Markus Leippold 81 206 0 01 Dec 2020
Synthetic QA Corpora Generation with Roundtrip Consistency Chris Alberti D. Andor Emily Pitler Jacob Devlin Michael Collins SyDa 75 249 0 12 Jun 2019
SemEval-2017 Task 1: Semantic Textual Similarity - Multilingual and Cross-lingual Focused Evaluation Daniel Cer Mona T. Diab Eneko Agirre I. Lopez-Gazpio Lucia Specia 448 1,891 0 31 Jul 2017
TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehension Mandar Joshi Eunsol Choi Daniel S. Weld Luke Zettlemoyer RALM 242 2,692 0 09 May 2017
Detection and Resolution of Rumours in Social Media: A Survey A. Zubiaga Ahmet Aker Kalina Bontcheva Maria Liakata Rob Procter 80 809 0 03 Apr 2017