MedCLIP: Contrastive Learning from Unpaired Medical Images and Text

18 October 2022

Jimeng Sun

Papers citing "MedCLIP: Contrastive Learning from Unpaired Medical Images and Text"

50 / 244 papers shown

Title
Can Rule-Based Insights Enhance LLMs for Radiology Report Classification? Introducing the RadPrompt Methodology Panagiotis Fytas Anna Breger Ian Selby Simon Baker Shahab Shahipasand Anna Korhonen 26 0 0 07 Aug 2024
Prompting Medical Large Vision-Language Models to Diagnose Pathologies by Visual Question Answering Danfeng Guo Sumitaka Honji LRM 62 0 0 31 Jul 2024
CLEFT: Language-Image Contrastive Learning with Efficient Large Language Model and Prompt Fine-Tuning Yuexi Du Brian Chang Nicha Dvornek MedIm VLM 40 2 0 30 Jul 2024
Assessing Graphical Perception of Image Embedding Models using Channel Effectiveness S. Lee Minsuk Chang Seokhyeon Park Jinwook Seo 31 2 0 30 Jul 2024
MMCLIP: Cross-modal Attention Masked Modelling for Medical Language-Image Pre-Training Biao Wu Yutong Xie Zeyu Zhang Minh Hieu Phan Qi Chen Ling-Hao Chen Qi Wu LM&MA 37 0 0 28 Jul 2024
HERGen: Elevating Radiology Report Generation with Longitudinal Data Fuying Wang Shenghui Du Lequan Yu MedIm 40 5 0 21 Jul 2024
Fact-Aware Multimodal Retrieval Augmentation for Accurate Medical Radiology Report Generation Liwen Sun James Zhao Megan Han Chenyan Xiong MedIm 58 8 0 21 Jul 2024
DiffuX2CT: Diffusion Learning to Reconstruct CT Images from Biplanar X-Rays Xuhui Liu Zhi Qiao Runkun Liu Hong Li Juan Zhang Xiantong Zhen Zhen Qian Baochang Zhang MedIm 42 2 0 18 Jul 2024
Mask-Free Neuron Concept Annotation for Interpreting Neural Networks in Medical Domain Hyeon Bae Kim Yong Hyun Ahn Seong Tae Kim 47 1 0 16 Jul 2024
Leveraging Task-Specific Knowledge from LLM for Semi-Supervised 3D Medical Image Segmentation Suruchi Kumari Aryan Das S. K. Roy Indu Joshi Pravendra Singh 37 3 0 06 Jul 2024
A Survey on Trustworthiness in Foundation Models for Medical Image Analysis Congzhen Shi Ryan Rezai Jiaxi Yang Qi Dou Xiaoxiao Li MedIm 31 4 0 03 Jul 2024
FairMedFM: Fairness Benchmarking for Medical Imaging Foundation Models Ruinan Jin Zikang Xu Yuan Zhong Qiongsong Yao Qi Dou S. Kevin Zhou Xiaoxiao Li VLM 32 12 0 01 Jul 2024
PathGen-1.6M: 1.6 Million Pathology Image-text Pairs Generation through Multi-agent Collaboration Yuxuan Sun Yunlong Zhang Yixuan Si Chenglu Zhu Zhongyi Shui Kai Zhang Jingxiong Li Xingheng Lyu Tao Lin Lin Yang LM&MA VLM MedIm 41 11 0 28 Jun 2024
A Refer-and-Ground Multimodal Large Language Model for Biomedicine Xiaoshuang Huang Haifeng Huang Lingdong Shen Yehui Yang Fangxin Shang Junwei Liu Jia Liu LM&MA 52 7 0 26 Jun 2024
MolFusion: Multimodal Fusion Learning for Molecular Representations via Multi-granularity Views Muzhen Cai Sendong Zhao Haochun Wang Yanrui Du Zewen Qiang Bing Qin Ting Liu 37 0 0 26 Jun 2024
X-ray Made Simple: Lay Radiology Report Generation and Robust Evaluation Kun Zhao Chenghao Xiao Chen Tang Bohao Yang Kai Ye Noura Al Moubayed Liang Zhan Chenghua Lin 45 0 0 25 Jun 2024
A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific Discovery Yu Zhang Xiusi Chen Bowen Jin Sheng Wang Shuiwang Ji Wei Wang Jiawei Han 44 27 0 16 Jun 2024
Merlin: A Vision Language Foundation Model for 3D Computed Tomography Louis Blankemeier Joseph Paul Cohen Ashwin Kumar Dave Van Veen Syed Jamal Safdar Gardezi ... Andrew L. Wentland C. Langlotz Jason Hom S. Gatidis Akshay S. Chaudhari LM&MA MedIm 49 31 0 10 Jun 2024
Gentle-CLIP: Exploring Aligned Semantic In Low-Quality Multimodal Data With Soft Alignment Zijia Song Z. Zang Yelin Wang Guozheng Yang Jiangbin Zheng Kaicheng Yu Wanyu Chen Stan Z. Li 33 0 0 09 Jun 2024
Quality Sentinel: Estimating Label Quality and Errors in Medical Segmentation Datasets Yixiong Chen Zongwei Zhou Alan L. Yuille 40 1 0 01 Jun 2024
Unlocking the Power of Spatial and Temporal Information in Medical Multimodal Pre-training Jinxia Yang Bing-Huang Su Wayne Xin Zhao Ji-Rong Wen 40 2 0 30 May 2024
I Bet You Did Not Mean That: Testing Semantic Importance via Betting Jacopo Teneggi Jeremias Sulam FAtt 36 1 0 29 May 2024
Universal and Extensible Language-Vision Models for Organ Segmentation and Tumor Detection from Abdominal Computed Tomography Jie Liu Yixiao Zhang Kang Wang Mehmet Can Yavuz Xiaoxi Chen ... Haoliang Li Yang Yang Alan L. Yuille Yucheng Tang Zongwei Zhou MedIm VLM 40 16 0 28 May 2024
TokenUnify: Scalable Autoregressive Visual Pre-training with Mixture Token Prediction Yinda Chen Haoyuan Shi Xiaoyu Liu Te Shi Ruobing Zhang Dong Liu Zhiwei Xiong Feng Wu 42 9 0 27 May 2024
Composed Image Retrieval for Remote Sensing Bill Psomas Ioannis Kakogeorgiou Nikos Efthymiadis Giorgos Tolias Ondřej Chum Yannis Avrithis Konstantinos Karantzalos 48 4 0 24 May 2024
A Textbook Remedy for Domain Shifts: Knowledge Priors for Medical Image Analysis Yue Yang Mona Gandhi Yufei Wang Yifan Wu Michael S. Yao Christopher Callison-Burch James C. Gee Mark Yatskar 58 3 0 23 May 2024
Boosting Medical Image-based Cancer Detection via Text-guided Supervision from Reports Guangyu Guo Jiawen Yao Yingda Xia Tony C. W. Mok Zhilin Zheng Junwei Han Le Lu Dingwen Zhang Jian Zhou Ling Zhang 37 1 0 23 May 2024
RET-CLIP: A Retinal Image Foundation Model Pre-trained with Clinical Diagnostic Reports Jiawei Du Jia Guo Weihang Zhang Shengzhu Yang Hanruo Liu Huiqi Li Ningli Wang MedIm VLM 33 4 0 23 May 2024
Mammo-CLIP: A Vision Language Foundation Model to Enhance Data Efficiency and Robustness in Mammography Shantanu Ghosh Clare B. Poynton Shyam Visweswaran Kayhan Batmanghelich VLM 37 10 0 20 May 2024
Transcriptomics-guided Slide Representation Learning in Computational Pathology Guillaume Jaume Lukas Oldenburg Anurag J. Vaidya Richard J. Chen Drew F. K. Williamson Thomas Peeters Andrew H. Song Faisal Mahmood 47 25 0 19 May 2024
MediCLIP: Adapting CLIP for Few-shot Medical Image Anomaly Detection Ximiao Zhang Min Xu Dehui Qiu Ruixin Yan Ning Lang Xiuzhuang Zhou VLM MedIm 26 6 0 18 May 2024
MoVL:Exploring Fusion Strategies for the Domain-Adaptive Application of Pretrained Models in Medical Imaging Tasks Haijiang Tian Jingkun Yue Xiaohong Liu Guoxing Yang Zeyu Jiang Guangyu Wang VLM MedIm 52 0 0 13 May 2024
Open Challenges and Opportunities in Federated Foundation Models Towards Biomedical Healthcare Xingyu Li Lu Peng Yuping Wang Weihua Zhang AI4CE MedIm LM&MA 71 5 0 10 May 2024
Pseudo-Prompt Generating in Pre-trained Vision-Language Models for Multi-Label Medical Image Classification Yaoqin Ye Junjie Zhang Hongwei Shi MedIm VLM 49 0 0 10 May 2024
ChEX: Interactive Localization and Region Description in Chest X-rays Philip Muller Georgios Kaissis Daniel Rueckert 35 5 0 24 Apr 2024
CT-GLIP: 3D Grounded Language-Image Pretraining with CT Scans and Radiology Reports for Full-Body Scenarios Jingyang Lin Yingda Xia Jianpeng Zhang Ke Yan Le Lu Jiebo Luo Ling Zhang VLM LM&MA MedIm 37 3 0 23 Apr 2024
A Large-scale Medical Visual Task Adaptation Benchmark Shentong Mo Xufang Luo Yansen Wang Dongsheng Li MedIm 32 1 0 19 Apr 2024
Global Contrastive Training for Multimodal Electronic Health Records with Language Supervision Yingbo Ma Suraj Kolla Zhenhong Hu Dhruv Kaliraman Victoria Nolan ... Jeremy A. Balch Tyler J. Loftus Parisa Rashidi A. Bihorac B. Shickel AI4TS 25 1 0 10 Apr 2024
Test-Time Adaptation with SaLIP: A Cascade of SAM and CLIP for Zero shot Medical Image Segmentation Sidra Aleem Fangyijie Wang Mayug Maniparambil Eric Arazo J. Dietlmeier Guénolé Silvestre Kathleen M. Curran Noel E. O'Connor Suzanne Little VLM MedIm 32 12 0 09 Apr 2024
Transductive Zero-Shot and Few-Shot CLIP Ségolène Martin Yunshi Huang Fereshteh Shakeri J. Pesquet Ismail Ben Ayed BDL VLM 35 13 0 08 Apr 2024
PairAug: What Can Augmented Image-Text Pairs Do for Radiology? Yutong Xie Qi Chen Sinuo Wang Minh Nguyen Nhat To Iris Lee Ee Win Khoo Kerolos Hendy Daniel Koh Yong-quan Xia Qi Wu MedIm LM&MA 37 6 0 07 Apr 2024
Bootstrapping Chest CT Image Understanding by Distilling Knowledge from X-ray Expert Models Weiwei Cao Jianpeng Zhang Yingda Xia Tony C. W. Mok Zi Li X. Ye Le Lu Jian Zheng Yuxing Tang Ling Zhang 29 1 0 07 Apr 2024
Foundation Model for Advancing Healthcare: Challenges, Opportunities, and Future Directions Yuting He Fuxiang Huang Xinrui Jiang Yuxiang Nie Minghao Wang Jiguang Wang Hao Chen LM&MA AI4CE 71 27 0 04 Apr 2024
Fashion Style Editing with Generative Human Prior Chaerin Kong Seungyong Lee Soohyeok Im Wonsuk Yang 43 0 0 02 Apr 2024
Memory-based Cross-modal Semantic Alignment Network for Radiology Report Generation Yitian Tao Liyan Ma Jing Yu Han Zhang MedIm 34 6 0 31 Mar 2024
Design as Desired: Utilizing Visual Question Answering for Multimodal Pre-training Tongkun Su Jun Li Xi Zhang Haibo Jin Hao Chen Qiong Wang Faqin Lv Baoliang Zhao Yin Hu 34 0 0 30 Mar 2024
Revolutionizing Disease Diagnosis with simultaneous functional PET/MR and Deeply Integrated Brain Metabolic, Hemodynamic, and Perfusion Networks Luoyu Wang Yitian Tao Qing Yang Yan Liang Siwei Liu Hongcheng Shi Dinggang Shen Han Zhang MedIm 27 0 0 29 Mar 2024
FairCLIP: Harnessing Fairness in Vision-Language Learning Yan Luo Minfei Shi Muhammad Osama Khan Muhammad Muneeb Afzal Hao Huang ... Luo Song Ava Kouhana T. Elze Yi Fang Mengyu Wang VLM 40 31 0 29 Mar 2024
Envisioning MedCLIP: A Deep Dive into Explainability for Medical Vision-Language Models Anees Ur Rehman Hashmi Dwarikanath Mahapatra Mohammad Yaqub VLM MedIm 23 2 0 27 Mar 2024
BIMCV-R: A Landmark Dataset for 3D CT Text-Image Retrieval Yinda Chen Che Liu Xiaoyu Liu Rossella Arcucci Zhiwei Xiong 58 14 0 24 Mar 2024