VIAssist: Adapting Multi-modal Large Language Models for Users with
Visual Impairments

VIAssist: Adapting Multi-modal Large Language Models for Users with Visual Impairments

3 April 2024

Papers citing "VIAssist: Adapting Multi-modal Large Language Models for Users with Visual Impairments"

10 / 10 papers shown

Title
A Light and Smart Wearable Platform with Multimodal Foundation Model for Enhanced Spatial Reasoning in People with Blindness and Low Vision Alexey Magay Dhurba Tripathi Yu Hao Yi Fang 14 0 0 16 May 2025
REVEAL: Multi-turn Evaluation of Image-Input Harms for Vision LLM Madhur Jindal Saurabh Deshpande AAML 45 0 0 07 May 2025
An LLM-Empowered Low-Resolution Vision System for On-Device Human Behavior Understanding Siyang Jiang Bufang Yang Lilin Xu Mu Yuan Yeerzhati Abudunuer ... Liekang Zeng Hongkai Chen Zhenyu Yan Xiaofan Jiang Guoliang Xing VLM 92 0 0 03 May 2025
Evaluating Multimodal Language Models as Visual Assistants for Visually Impaired Users Antonia Karamolegkou Malvina Nikandrou Georgios Pantazopoulos Danae Sanchez Villegas Phillip Rust Ruchira Dhar Daniel Hershcovich Anders Søgaard 39 0 0 28 Mar 2025
LLM-Glasses: GenAI-driven Glasses with Haptic Feedback for Navigation of Visually Impaired People Issatay Tokmurziyev Miguel Altamirano Cabrera Muhammad Haris Khan Yara Mahmoud Luis Moreno Dzmitry Tsetserukou 36 0 0 04 Mar 2025
Can LVLMs and Automatic Metrics Capture Underlying Preferences of Blind and Low-Vision Individuals for Navigational Aid? Na Min An Eunki Kim Wan Ju Kang Sangryul Kim Hyunjung Shim James Thorne 41 0 0 15 Feb 2025
Emerging Practices for Large Multimodal Model (LMM) Assistance for People with Visual Impairments: Implications for Design Jingyi Xie Rui Yu He Zhang Sooyeon Lee Syed Masum Billah John M. Carroll 40 10 0 11 Jul 2024
DrHouse: An LLM-empowered Diagnostic Reasoning System through Harnessing Outcomes from Sensor Data and Expert Knowledge Bufang Yang Siyang Jiang Lilin Xu Kaiwei Liu Hai Li Guoliang Xing Hongkai Chen Xiaofan Jiang Zhenyu Yan LM&MA 45 15 0 21 May 2024
EdgeFM: Leveraging Foundation Model for Open-set Learning on the Edge Bufang Yang Lixing He Neiwen Ling Zhenyu Yan Guoliang Xing Xian Shuai Xiaozhe Ren Xin Jiang 45 20 0 18 Nov 2023
ProtoSound: A Personalized and Scalable Sound Recognition System for Deaf and Hard-of-Hearing Users D. Jain Khoa Nguyen Steven M. Goodman Rachel Grossman-Kahn Hung Ngo Aditya Kusupati Ruofei Du A. Olwal Leah Findlater Jon E. Froehlich 34 30 0 22 Feb 2022