MedCLIP: Contrastive Learning from Unpaired Medical Images and Text

18 October 2022

Jimeng Sun

Papers citing "MedCLIP: Contrastive Learning from Unpaired Medical Images and Text"

44 / 244 papers shown

Title
Fine-tuning can cripple your foundation model; preserving features may be the solution Jishnu Mukhoti Y. Gal Philip H. S. Torr P. Dokania CLL 35 31 0 25 Aug 2023
A Foundation Language-Image Model of the Retina (FLAIR): Encoding Expert Knowledge in Text Supervision Julio Silva-Rodríguez H. Chakor Riadh Kobbi Jose Dolz Ismail Ben Ayed VLM MedIm 72 33 0 15 Aug 2023
Exploring Transfer Learning in Medical Image Segmentation using Vision-Language Models K. Poudel Manish Dhakal Prasiddha Bhandari Rabin Adhikari Safal Thapaliya Bishesh Khanal VLM 30 17 0 15 Aug 2023
AdaptiveSAM: Towards Efficient Tuning of SAM for Surgical Scene Segmentation Jay N. Paranjape Nithin Gopalakrishnan Nair S. Sikder S. Vedula Vishal M. Patel MedIm 23 38 0 07 Aug 2023
PerceptionCLIP: Visual Classification by Inferring and Conditioning on Contexts Bang An Sicheng Zhu Michael-Andrei Panaitescu-Liess Chaithanya Kumar Mummadi Furong Huang VLM 30 7 0 02 Aug 2023
Towards a Visual-Language Foundation Model for Computational Pathology Ming Y. Lu Bowen Chen Drew F. K. Williamson Richard J. Chen Ivy Liang ... Andrew Zhang L. Le Georg Gerber Anil V. Parwani Faisal Mahmood VLM MedIm 40 46 0 24 Jul 2023
Identifying Interpretable Subspaces in Image Representations N. Kalibhat S. Bhardwaj Bayan Bruss Hamed Firooz Maziar Sanjabi S. Feizi FAtt 42 26 0 20 Jul 2023
A scoping review on multimodal deep learning in biomedical images and texts Zhaoyi Sun Mingquan Lin Qingqing Zhu Qianqian Xie Fei-Yue Wang Zhiyong Lu Yifan Peng 28 18 0 14 Jul 2023
Knowledge Boosting: Rethinking Medical Contrastive Vision-Language Pre-Training Xiaofei Chen Yuting He Cheng Xue Rongjun Ge Shuo Li Guanyu Yang VLM MedIm 29 13 0 14 Jul 2023
Unified Medical Image-Text-Label Contrastive Learning With Continuous Prompt Yuhao Wang VLM MedIm 28 1 0 12 Jul 2023
A ChatGPT Aided Explainable Framework for Zero-Shot Medical Image Diagnosis Jiaxiang Liu Tianxiang Hu Yan Zhang Xiaotang Gai Yang Feng Zuozhu Liu LM&MA MedIm 34 32 0 05 Jul 2023
Minimum Levels of Interpretability for Artificial Moral Agents Avish Vijayaraghavan C. Badea AI4CE 27 5 0 02 Jul 2023
Relating tSNE and UMAP to Classical Dimensionality Reduction Andrew Draganov Simon Dohn FAtt 25 4 0 20 Jun 2023
RemoteCLIP: A Vision Language Foundation Model for Remote Sensing F. Liu Delong Chen Zhan-Rong Guan Xiaocong Zhou Jiale Zhu Qiaolin Ye Liyong Fu Jun Zhou VLM 71 192 0 19 Jun 2023
Visual Language Pretrained Multiple Instance Zero-Shot Transfer for Histopathology Images Ming Y. Lu Bowen Chen Andrew Zhang Drew F. K. Williamson Richard J. Chen Tong Ding L. Le Yung-Sung Chuang Faisal Mahmood VLM MedIm 25 99 0 13 Jun 2023
Artificial General Intelligence for Medical Imaging Xiang Li Lu Zhang Zihao Wu Zheng Liu Lin Zhao ... Pingkuan Yan Quanzheng Li Wei Liu Tianming Liu Dinggang Shen LM&MA AI4CE 19 40 0 08 Jun 2023
Bi-level Contrastive Learning for Knowledge-Enhanced Molecule Representations Pengcheng Jiang Cao Xiao Tianfan Fu Jimeng Sun 37 3 0 02 Jun 2023
BiomedGPT: A Unified and Generalist Biomedical Generative Pre-trained Transformer for Vision, Language, and Multimodal Tasks Kai Zhang Jun Yu Eashan Adhikarla Rong-Er Zhou Zhilin Yan ... Xun Chen Yong Chen Quanzheng Li Hongfang Liu Lichao Sun LM&MA MedIm 31 157 0 26 May 2023
S4M: Generating Radiology Reports by A Single Model for Multiple Body Parts Qi Chen Yutong Xie Biao Wu Minh Nguyen Nhat To James Ang Qi Wu 9 1 0 26 May 2023
S-CLIP: Semi-supervised Vision-Language Learning using Few Specialist Captions Sangwoo Mo Minkyu Kim Kyungmin Lee Jinwoo Shin VLM CLIP 44 21 0 23 May 2023
MedBLIP: Bootstrapping Language-Image Pre-training from 3D Medical Images and Texts Qiuhui Chen Xinyue Hu Zirui Wang Yi Hong LM&MA MedIm 14 34 0 18 May 2023
Multi-task Paired Masking with Alignment Modeling for Medical Vision-Language Pre-training Kecheng Zhang Jing Zhang Jun Yu Han Jiang Jianping Fan Qing-An Huang Weidong Han MedIm 30 29 0 13 May 2023
Zero-shot performance of the Segment Anything Model (SAM) in 2D medical imaging: A comprehensive evaluation and practical guidelines C. M. Oliveira L. V. Moura R. Ravazio L. S. Kupssinskü Otávio Parraga Marcelo Mussi Delucis Rodrigo C. Barros VLM MedIm 73 26 0 28 Apr 2023
Towards Medical Artificial General Intelligence via Knowledge-Enhanced Multimodal Pretraining Bingqian Lin Zicong Chen Mingjie Li Haokun Lin Hang Xu ... Ling-Hao Chen Xiaojun Chang Yi Yang L. Xing Xiaodan Liang LM&MA MedIm AI4CE 40 14 0 26 Apr 2023
Learning Sample Difficulty from Pre-trained Models for Reliable Prediction Peng Cui Dan Zhang Zhijie Deng Yinpeng Dong Junyi Zhu 21 12 0 20 Apr 2023
Multimodal Representation Learning of Cardiovascular Magnetic Resonance Imaging Jielin Qiu Peide Huang Makiya Nakashima Jae-Hyeok Lee Jiacheng Zhu ... Byung-Hak Kim Debbie Kwon Douglas Weber Ding Zhao David Chen SSL 19 5 0 16 Apr 2023
ELVIS: Empowering Locality of Vision Language Pre-training with Intra-modal Similarity Sumin Seo Jaewoong Shin Jaewoo Kang Tae Soo Kim Thijs Kooi 29 1 0 11 Apr 2023
Self-Supervised Multimodal Learning: A Survey Yongshuo Zong Oisin Mac Aodha Timothy M. Hospedales SSL 24 43 0 31 Mar 2023
Local Contrastive Learning for Medical Image Recognition S. A. Rizvi Ruixiang Tang X. Jiang X. Ma X. Hu 27 6 0 24 Mar 2023
Xplainer: From X-Ray Observations to Explainable Zero-Shot Diagnosis Chantal Pellegrini Matthias Keicher Ege Ozsoy Petra Jirásková R. Braren Nassir Navab MedIm 15 20 0 23 Mar 2023
Frozen Language Model Helps ECG Zero-Shot Learning Jun Yu Li Che Liu Sibo Cheng Rossella Arcucci linda Qiao 18 59 0 22 Mar 2023
LIMITR: Leveraging Local Information for Medical Image-Text Representation Gefen Dawidowicz Elad Hirsch A. Tal 28 15 0 21 Mar 2023
Large AI Models in Health Informatics: Applications, Challenges, and the Future Jianing Qiu Lin Li Jiankai Sun Jiachuan Peng Peilun Shi ... Bo Xiao Wu Yuan Ningli Wang Dong Xu Benny Lo AI4MH LM&MA 42 127 0 21 Mar 2023
Towards Unifying Medical Vision-and-Language Pre-training via Soft Prompts Zhihong Chen Shizhe Diao Benyou Wang Guanbin Li Xiang Wan MedIm 22 29 0 17 Feb 2023
MedKLIP: Medical Knowledge Enhanced Language-Image Pre-Training in Radiology Chaoyi Wu Xiaoman Zhang Ya-Qin Zhang Yanfeng Wang Weidi Xie LM&MA VLM 30 109 0 05 Jan 2023
CLIP-Driven Universal Model for Organ Segmentation and Tumor Detection Jie Liu Yixiao Zhang Jieneng Chen Junfei Xiao Yongyi Lu Bennett A. Landman Yixuan Yuan Alan Yuille Yucheng Tang Zongwei Zhou VLM MedIm 39 194 0 02 Jan 2023
Significantly Improving Zero-Shot X-ray Pathology Classification via Fine-tuning Pre-trained Image-Text Encoders Jongseong Jang Daeun Kyung Seunghyeon Kim Honglak Lee Kyunghoon Bae E. Choi LM&MA MedIm 32 10 0 14 Dec 2022
TIER: Text-Image Entropy Regularization for CLIP-style models Anil Palepu Andrew L. Beam MedIm 18 6 0 13 Dec 2022
Federated Adaptive Prompt Tuning for Multi-Domain Collaborative Learning Shangchao Su Min Yang Bin Li Xiangyang Xue VLM FedML 35 18 0 15 Nov 2022
Trial2Vec: Zero-Shot Clinical Trial Document Similarity Search using Self-Supervision Zifeng Wang Jimeng Sun 21 23 0 29 Jun 2022
FlexR: Few-shot Classification with Language Embeddings for Structured Reporting of Chest X-rays Matthias Keicher Kamilia Zaripova Tobias Czempiel Kristina Mach Ashkan Khakzar Nassir Navab MedIm 22 11 0 29 Mar 2022
BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation Junnan Li Dongxu Li Caiming Xiong S. Hoi MLLM BDL VLM CLIP 392 4,137 0 28 Jan 2022
Pre-trained Language Models in Biomedical Domain: A Systematic Survey Benyou Wang Qianqian Xie Jiahuan Pei Zhihong Chen Prayag Tiwari Zhao Li Jie Fu LM&MA AI4CE 37 163 0 11 Oct 2021
Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision Chao Jia Yinfei Yang Ye Xia Yi-Ting Chen Zarana Parekh Hieu H. Pham Quoc V. Le Yun-hsuan Sung Zhen Li Tom Duerig VLM CLIP 301 3,708 0 11 Feb 2021