We introduce EASG-Bench, a question-answering benchmark for egocentric videos where the question-answering pairs are created from spatio-temporally grounded dynamic scene graphs capturing intricate relationships among actors, actions, and objects. We propose a systematic evaluation framework and evaluate several language-only and video large language models (video-LLMs) on this benchmark. We observe a performance gap in language-only and video-LLMs, especially on questions focusing on temporal ordering, thus identifying a research gap in the area of long-context video understanding. To promote the reproducibility of our findings and facilitate further research, the benchmark and accompanying code are available at the following GitHub page:this https URL.
View on arXiv@article{rodin2025_2506.05787,
title={ EASG-Bench: Video Q&A Benchmark with Egocentric Action Scene Graphs },
author={ Ivan Rodin and Tz-Ying Wu and Kyle Min and Sharath Nittur Sridhar and Antonino Furnari and Subarna Tripathi and Giovanni Maria Farinella },
journal={arXiv preprint arXiv:2506.05787},
year={ 2025 }
}