Multi-Granularity Cross-modal Alignment for Generalized Medical Visual Representation Learning

12 October 2022

Papers citing "Multi-Granularity Cross-modal Alignment for Generalized Medical Visual Representation Learning"

50 / 98 papers shown

Title
Endo-CLIP: Progressive Self-Supervised Pre-training on Raw Colonoscopy Records Yili He Yan Zhu Peiyao Fu Ruijie Yang Tianyi Chen Zhihua Wang Quanlin Li Pinghong Zhou Xiaoyu Yang Shuo Wang MedIm VLM 28 0 0 14 May 2025
Semantic-Space-Intervened Diffusive Alignment for Visual Classification Zixuan Li Lei Meng Guoqing Chao Wei Wu Xiaoshuo Yan Yimeng Yang Zhuang Qi X. Meng DiffM 42 0 0 09 May 2025
RadZero: Similarity-Based Cross-Attention for Explainable Vision-Language Alignment in Radiology with Zero-Shot Multi-Task Capability Jonggwon Park Soobum Kim Byungmu Yoon Kyoyun Choi MedIm 38 0 0 10 Apr 2025
A Reality Check of Vision-Language Pre-training in Radiology: Have We Progressed Using Text? Julio Silva-Rodríguez Jose Dolz Ismail ben Ayed VLM MedIm 38 0 0 07 Apr 2025
DALIP: Distribution Alignment-based Language-Image Pre-Training for Domain-Specific Data Junjie Wu Jiangtao Xie Zhaolin Zhang Qilong Wang Q. Hu P. Li Sen Xu VLM 43 0 0 02 Apr 2025
FDCT: Frequency-Aware Decomposition and Cross-Modal Token-Alignment for Multi-Sensor Target Classification S. Sami Md Golam Moula Mehedi Hasan Nasser M. Nasrabadi Raghuveer Rao 50 0 0 12 Mar 2025
Anatomy-Aware Conditional Image-Text Retrieval Meng Zheng Jiajin Zhang Benjamin Planche Zhongpai Gao Terrence Chen Ziyan Wu MedIm 54 0 0 10 Mar 2025
MedUnifier: Unifying Vision-and-Language Pre-training on Medical Data with Vision Generation Task using Discrete Visual Representations Ziyang Zhang Yang Yu Yucheng Chen Xulei Yang S. Yeo MedIm 56 1 0 02 Mar 2025
Enhanced Contrastive Learning with Multi-view Longitudinal Data for Chest X-ray Report Generation Kang Liu Zhuoqi Ma Xiaolu Kang Yunan Li Kun Xie Zhicheng Jiao Qiguang Miao 36 3 0 27 Feb 2025
Progressive Local Alignment for Medical Multimodal Pre-training Huimin Yan Xian Yang Liang Bai Jiye Liang 72 0 0 25 Feb 2025
Language-guided Medical Image Segmentation with Target-informed Multi-level Contrastive Alignments Mingjian Li Mingyuan Meng Shuchang Ye David Dagan Feng Lei Bi Jinman Kim 84 0 0 18 Dec 2024
DuSSS: Dual Semantic Similarity-Supervised Vision-Language Model for Semi-Supervised Medical Image Segmentation Qingtao Pan Wenhao Qiao Jingjiao Lou Bing Ji Shuo Li VLM 80 0 0 17 Dec 2024
Uni-Mlip: Unified Self-supervision for Medical Vision Language Pre-training Ameera Bawazir Kebin Wu Wenbin Li CLIP 77 1 0 20 Nov 2024
Tumor Location-weighted MRI-Report Contrastive Learning: A Framework for Improving the Explainability of Pediatric Brain Tumor Diagnosis Sara Ketabi Matthias W. Wagner C. Hawkins U. Tabori B. Ertl-Wagner Farzad Khalvati 43 1 0 01 Nov 2024
BenchX: A Unified Benchmark Framework for Medical Vision-Language Pretraining on Chest X-Rays Yang Zhou Tan Li Hui Faith Yanyu Xu Sicong Leng Xinxing Xu Yong Liu Rick Siow Mong Goh SSL VLM LM&MA MedIm 40 0 0 29 Oct 2024
Image-aware Evaluation of Generated Medical Reports Gefen Dawidowicz Elad Hirsch A. Tal 32 1 0 22 Oct 2024
Can Medical Vision-Language Pre-training Succeed with Purely Synthetic Data? Che Liu Zhongwei Wan Haozhe Wang Yinda Chen T. Qaiser Chen Jin Fariba Yousefi Nikolay Burlutskiy Rossella Arcucci VLM SyDa LM&MA MedIm 69 2 0 17 Oct 2024
Multi-modal Vision Pre-training for Medical Image Analysis Shaohao Rui Lingzhi Chen Zhenyu Tang Lilong Wang M. Liu S. Zhang Xiaosong Wang 32 0 0 14 Oct 2024
A foundation model for generalizable disease diagnosis in chest X-ray images Lijian Xu Ziyu Ni Hao Sun Hongsheng Li Shaoting Zhang LM&MA MedIm 28 1 0 11 Oct 2024
Advancing Medical Radiograph Representation Learning: A Hybrid Pre-training Paradigm with Multilevel Semantic Granularity Hanqi Jiang Xixuan Hao Yuzhou Huang Chong Ma Jiaxun Zhang Yi Pan Ruimao Zhang MedIm 37 0 0 01 Oct 2024
Survival Prediction in Lung Cancer through Multi-Modal Representation Learning Aiman Farooq Deepak Mishra S. Chaudhury 34 1 0 30 Sep 2024
Multi-sensor Learning Enables Information Transfer across Different Sensory Data and Augments Multi-modality Imaging Lingting Zhu Yizheng Chen Lianli Liu Lei Xing Lequan Yu 31 1 0 28 Sep 2024
ZALM3: Zero-Shot Enhancement of Vision-Language Alignment via In-Context Information in Multi-Turn Multimodal Medical Dialogue Zhangpu Li Changhong Zou Suxue Ma Zhicheng Yang Chen Du ... Xingzhi Sun Jing Xiao Kai Zhang Mei Han Mei Han LM&MA 46 1 0 26 Sep 2024
Multi-View and Multi-Scale Alignment for Contrastive Language-Image Pre-training in Mammography Yuexi Du John Onofrey Nicha Dvornek VLM 50 1 0 26 Sep 2024
EEG-Language Modeling for Pathology Detection Sam Gijsen Kerstin Ritter 44 0 0 02 Sep 2024
Self-Supervised Learning for Building Robust Pediatric Chest X-ray Classification Models Sheng Cheng Zbigniew A. Starosolski Devika Subramanian SSL 31 0 0 30 Aug 2024
Brant-X: A Unified Physiological Signal Alignment Framework Daoze Zhang Zhizhang Yuan Junru Chen Kerui Chen Yang Yang 27 7 0 28 Aug 2024
Has Multimodal Learning Delivered Universal Intelligence in Healthcare? A Comprehensive Survey Qika Lin Yifan Zhu Xin Mei Ling Huang Jingying Ma Kai He Zhen Peng Erik Cambria Mengling Feng 42 18 0 23 Aug 2024
HYDEN: Hyperbolic Density Representations for Medical Images and Reports Zhi Qiao Linbin Han Xiantong Zhen Jia-Hong Gao Zhen Qian 49 0 0 19 Aug 2024
CLEFT: Language-Image Contrastive Learning with Efficient Large Language Model and Prompt Fine-Tuning Yuexi Du Brian Chang Nicha Dvornek MedIm VLM 40 2 0 30 Jul 2024
Unifying Visual and Semantic Feature Spaces with Diffusion Models for Enhanced Cross-Modal Alignment Yuze Zheng Zixuan Li Xiangxian Li Jinxing Liu Yuqing Wang Xiangxu Meng Lei Meng DiffM 47 2 0 26 Jul 2024
HERGen: Elevating Radiology Report Generation with Longitudinal Data Fuying Wang Shenghui Du Lequan Yu MedIm 40 5 0 21 Jul 2024
LiteGPT: Large Vision-Language Model for Joint Chest X-ray Localization and Classification Task Khai Le-Duc Ryan Zhang Ngoc Son Nguyen Tan-Hanh Pham Anh Dao Ba Hung Ngo Anh Totti Nguyen Truong Son-Hy MedIm LM&MA 40 3 0 16 Jul 2024
Extracting and Encoding: Leveraging Large Language Models and Medical Knowledge to Enhance Radiological Text Representation Pablo Messina René Vidal Denis Parra Álvaro Soto Vladimir Araujo MedIm 56 2 0 02 Jul 2024
A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific Discovery Yu Zhang Xiusi Chen Bowen Jin Sheng Wang Shuiwang Ji Wei Wang Jiawei Han 44 27 0 16 Jun 2024
Unlocking the Power of Spatial and Temporal Information in Medical Multimodal Pre-training Jinxia Yang Bing-Huang Su Wayne Xin Zhao Ji-Rong Wen 37 2 0 30 May 2024
Structural Entities Extraction and Patient Indications Incorporation for Chest X-ray Report Generation Kang Liu Zhuoqi Ma Xiaolu Kang Zhusi Zhong Zhicheng Jiao Grayson Baird Harrison X. Bai Qiguang Miao 41 4 0 23 May 2024
Factual Serialization Enhancement: A Key Innovation for Chest X-ray Report Generation Kang Liu Zhuoqi Ma Mengmeng Liu Zhicheng Jiao Xiaolu Kang Qiguang Miao Kun Xie MedIm 42 6 0 15 May 2024
Self-supervised vision-langage alignment of deep learning representations for bone X-rays analysis A. Englebert Anne-Sophie Collin O. Cornu Christophe De Vleeschouwer 34 1 0 14 May 2024
EVA-X: A Foundation Model for General Chest X-ray Analysis with Self-supervised Learning Jingfeng Yao Xinggang Wang Yuehao Song Huangxuan Zhao Jun Ma Yajie Chen Wenyu Liu Bo Wang ViT 36 5 0 08 May 2024
Pre-training on High Definition X-ray Images: An Experimental Study Tianlin Li Yuehang Li Wentao Wu Jiandong Jin Yao Rong Bowei Jiang Chuanfu Li Jin Tang MedIm ViT LM&MA 41 3 0 27 Apr 2024
ChEX: Interactive Localization and Region Description in Chest X-rays Philip Muller Georgios Kaissis Daniel Rueckert 35 5 0 24 Apr 2024
PairAug: What Can Augmented Image-Text Pairs Do for Radiology? Yutong Xie Qi Chen Sinuo Wang Minh Nguyen Nhat To Iris Lee Ee Win Khoo Kerolos Hendy Daniel Koh Yong-quan Xia Qi Wu MedIm LM&MA 37 6 0 07 Apr 2024
Foundation Model for Advancing Healthcare: Challenges, Opportunities, and Future Directions Yuting He Fuxiang Huang Xinrui Jiang Yuxiang Nie Minghao Wang Jiguang Wang Hao Chen LM&MA AI4CE 71 27 0 04 Apr 2024
Design as Desired: Utilizing Visual Question Answering for Multimodal Pre-training Tongkun Su Jun Li Xi Zhang Haibo Jin Hao Chen Qiong Wang Faqin Lv Baoliang Zhao Yin Hu 34 0 0 30 Mar 2024
Eye-gaze Guided Multi-modal Alignment for Medical Representation Learning Chong Ma Hanqi Jiang Wenting Chen Yiwei Li Zihao Wu ... Dajiang Zhu Tuo Zhang Dinggang Shen Tianming Liu Xiang Li 23 0 0 19 Mar 2024
Anatomical Structure-Guided Medical Vision-Language Pre-training Qingqiu Li Xiaohan Yan Jilan Xu Runtian Yuan Yuejie Zhang Rui Feng Quanli Shen Xiaobo Zhang Shujun Wang 42 5 0 14 Mar 2024
Decomposing Disease Descriptions for Enhanced Pathology Detection: A Multi-Aspect Vision-Language Pre-training Framework Vu Minh Hieu Phan Yutong Xie Yuankai Qi Lingqiao Liu Liyang Liu Bowen Zhang Zhibin Liao Qi Wu Minh Nguyen Nhat To Johan W. Verjans 62 11 0 12 Mar 2024
CARZero: Cross-Attention Alignment for Radiology Zero-Shot Classification Haoran Lai Qingsong Yao Zihang Jiang Rongsheng Wang Zhiyang He Xiaodong Tao S. Kevin Zhou MedIm 38 12 0 27 Feb 2024
Weakly Supervised Anomaly Detection via Knowledge-Data Alignment Haihong Zhao Chenyi Zi Yang Liu Chen Zhang Yan Zhou Jia Li 36 7 0 06 Feb 2024