Generating Image Descriptions via Sequential Cross-Modal Alignment
Guided by Human Gaze

Generating Image Descriptions via Sequential Cross-Modal Alignment Guided by Human Gaze

9 November 2020

Sandro Pezzelle

Raquel Fernández

Papers citing "Generating Image Descriptions via Sequential Cross-Modal Alignment Guided by Human Gaze"

14 / 14 papers shown

Title
Human-Centric NLP or AI-Centric Illusion?: A Critical Investigation Piyapath T Spencer 80 0 0 14 Dec 2024
Surveying the Landscape of Image Captioning Evaluation: A Comprehensive Taxonomy, Trends and Metrics Analysis Uri Berger Gabriel Stanovsky Omri Abend Lea Frermann 35 0 0 09 Aug 2024
A look under the hood of the Interactive Deep Learning Enterprise (No-IDLE) Daniel Sonntag Michael Barz Thiago S. Gouvêa VLM 49 4 0 27 Jun 2024
PoTeC: A German Naturalistic Eye-tracking-while-reading Corpus Deborah N. Jakobi Thomas Kern D. R. Reich Patrick Haller Lena A. Jäger 22 3 0 01 Mar 2024
Trends, Applications, and Challenges in Human Attention Modelling Giuseppe Cartella Marcella Cornia Vittorio Cuculo Alessandro D’Amelio Dario Zanca Giuseppe Boccignone Rita Cucchiara 40 6 0 28 Feb 2024
$Describing Images $\textit{Fast and Slow}$: Quantifying and Predicting the Variation in Human Signals during Visuo-Linguistic Processes$ Describing Images $\textit{Fast and Slow}$ : Quantifying and Predicting the Variation in Human Signals during Visuo-Linguistic Processes Ece Takmaz Sandro Pezzelle Raquel Fernández 24 1 0 02 Feb 2024
DocTrack: A Visually-Rich Document Dataset Really Aligned with Human Eye Movement for Machine Reading Hao Wang Qingxuan Wang Yue Li Changqing Wang Chenhui Chu Rui-cang Wang VGen 21 3 0 23 Oct 2023
Pre-Trained Language Models Augmented with Synthetic Scanpaths for Natural Language Understanding Shuwen Deng Paul Prasse D. R. Reich Tobias Scheffer Lena A. Jäger 43 5 0 23 Oct 2023
Eyettention: An Attention-based Dual-Sequence Model for Predicting Human Scanpaths during Reading Shuwen Deng D. R. Reich Paul Prasse Patrick Haller Tobias Scheffer Lena A. Jäger 26 17 0 21 Apr 2023
Neglected Free Lunch -- Learning Image Classifiers Using Annotation Byproducts Dongyoon Han Junsuk Choe Dante Chun John Joon Young Chung Minsuk Chang Sangdoo Yun Jean Y. Song Seong Joon Oh OOD 437 4 1 30 Mar 2023
The Copenhagen Corpus of Eye Tracking Recordings from Natural Reading of Danish Texts Nora Hollenstein Maria Barrett Marina Bjornsdóttir 20 14 0 28 Apr 2022
CogAlign: Learning to Align Textual Neural Representations to Cognitive Language Processing Signals Yuqi Ren Deyi Xiong 24 16 0 10 Jun 2021
Relative Importance in Sentence Processing Nora Hollenstein Lisa Beinborn FAtt 11 29 0 07 Jun 2021
Multilingual Language Models Predict Human Reading Behavior Nora Hollenstein Federico Pirovano Ce Zhang Lena Jäger Lisa Beinborn VLM 36 45 0 12 Apr 2021