v1v2 (latest)

BiomedCoOp: Learning to Prompt for Biomedical Vision-Language Models

21 November 2024

Taha Koleilat

Hojat Asgariandehkordi

Papers citing "BiomedCoOp: Learning to Prompt for Biomedical Vision-Language Models"

33 / 33 papers shown

Title
Interpreting Biomedical VLMs on High-Imbalance Out-of-Distributions: An Insight into BiomedCLIP on Radiology Nafiz Sadman Farhana Zulkernine Benjamin Kwan 27 0 0 17 Jun 2025
BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairs Sheng Zhang Yanbo Xu Naoto Usuyama Hanwen Xu J. Bagga ... Carlo Bifulco M. Lungren Tristan Naumann Sheng Wang Hoifung Poon LM&MA MedIm 246 235 0 10 Jan 2025
MedCLIP-SAMv2: Towards Universal Text-Driven Medical Image Segmentation Taha Koleilat Hojat Asgariandehkordi H. Rivaz Yiming Xiao MedIm VLM 132 9 0 28 Sep 2024
Aligning Medical Images with General Knowledge from Large Language Models X. B. Fang Yi Lin Dong Zhang Kwang-Ting Cheng Hao Chen LM&MA VLM 106 4 0 31 Aug 2024
CLEFT: Language-Image Contrastive Learning with Efficient Large Language Model and Prompt Fine-Tuning Yuexi Du Brian Chang Nicha Dvornek MedIm VLM 79 3 0 30 Jul 2024
Prompt engineering paradigms for medical applications: scoping review and recommendations for better practices Jamil Zaghir Marco Naguib Mina Bjelogrlic Aurélie Névéol Xavier Tannier Christian Lovis AI4CE LM&MA 83 6 0 02 May 2024
LP++: A Surprisingly Strong Linear Probe for Few-Shot CLIP Yunshi Huang Fereshteh Shakeri Jose Dolz Malik Boudiaf Houda Bahig Ismail Ben Ayed 92 23 0 02 Apr 2024
MedCLIP-SAM: Bridging Text and Image Towards Universal Medical Image Segmentation Taha Koleilat Hojat Asgariandehkordi H. Rivaz Yiming Xiao VLM MedIm 124 13 0 29 Mar 2024
XCoOp: Explainable Prompt Learning for Computer-Aided Diagnosis via Concept-guided Context Optimization Yequan Bie Luyang Luo Zhixuan Chen Hao Chen 76 7 0 14 Mar 2024
Learning to Prompt with Text Only Supervision for Vision-Language Models Muhammad Uzair Khattak Muhammad Ferjad Naeem Muzammal Naseer Luc Van Gool F. Tombari VLM VPVLM 94 22 0 04 Jan 2024
A Closer Look at the Few-Shot Adaptation of Large Vision-Language Models Julio Silva-Rodríguez Sina Hajimiri Ismail Ben Ayed Jose Dolz VLM 71 34 0 20 Dec 2023
CLIP in Medical Imaging: A Comprehensive Survey Zihao Zhao Yuxiao Liu Han Wu Yonghao Li Sheng Wang L. Teng Disheng Liu Zhiming Cui Qian Wang Dinggang Shen CLIP MedIm LM&MA VLM 156 43 0 12 Dec 2023
Domain-Controlled Prompt Learning Qinglong Cao Zhengqin Xu Yuantian Chen Chao Ma Xiaokang Yang VLM 98 18 0 30 Sep 2023
PREFER: Prompt Ensemble Learning via Feedback-Reflect-Refine Chenrui Zhang Lina Liu Jinpeng Wang Chuyuan Wang Xiaodi Sun Hongyu Wang Mingchen Cai LLMAG 80 25 0 23 Aug 2023
Self-regulating Prompts: Foundational Model Adaptation without Forgetting Muhammad Uzair Khattak Syed Talal Wasim Muzammal Naseer Salman Khan Ming-Hsuan Yang Fahad Shahbaz Khan VLM 93 189 0 13 Jul 2023
A ChatGPT Aided Explainable Framework for Zero-Shot Medical Image Diagnosis Jiaxiang Liu Tianxiang Hu Yan Zhang Xiaotang Gai Yang Feng Zuozhu Liu LM&MA MedIm 79 35 0 05 Jul 2023
Visual-Language Prompt Tuning with Knowledge-guided Context Optimization Hantao Yao Rui Zhang Changsheng Xu VLM VPVLM 204 227 0 23 Mar 2023
GPT-4 Technical Report OpenAI OpenAI OpenAI Josh Achiam Steven Adler Sandhini Agarwal Lama Ahmad ... Shengjia Zhao Tianhao Zheng Juntang Zhuang William Zhuk Barret Zoph LLMAG MLLM 1.6K 14,852 0 15 Mar 2023
MaPLe: Multi-modal Prompt Learning Muhammad Uzair Khattak H. Rasheed Muhammad Maaz Salman Khan Fahad Shahbaz Khan VPVLM VLM 297 574 0 06 Oct 2022
Prompt-aligned Gradient for Prompt Tuning Beier Zhu Yulei Niu Yucheng Han Yuehua Wu Hanwang Zhang VLM 325 294 0 30 May 2022
Making the Most of Text Semantics to Improve Biomedical Vision--Language Processing Benedikt Boecking Naoto Usuyama Shruthi Bannur Daniel Coelho De Castro Anton Schwaighofer ... Tristan Naumann A. Nori Javier Alvarez-Valle Hoifung Poon Ozan Oktay 89 247 0 21 Apr 2022
Conditional Prompt Learning for Vision-Language Models Kaiyang Zhou Jingkang Yang Chen Change Loy Ziwei Liu VLM CLIP VPVLM 163 1,365 0 10 Mar 2022
Does CLIP Benefit Visual Question Answering in the Medical Domain as Much as it Does in the General Domain? Sedigheh Eslami Gerard de Melo Christoph Meinel CLIP MedIm 84 121 0 27 Dec 2021
Tip-Adapter: Training-free CLIP-Adapter for Better Vision-Language Modeling Renrui Zhang Rongyao Fang Wei Zhang Peng Gao Kunchang Li Jifeng Dai Yu Qiao Hongsheng Li VLM 292 404 0 06 Nov 2021
CLIP-Adapter: Better Vision-Language Models with Feature Adapters Peng Gao Shijie Geng Renrui Zhang Teli Ma Rongyao Fang Yongfeng Zhang Hongsheng Li Yu Qiao VLM CLIP 352 1,065 0 09 Oct 2021
Learning to Prompt for Vision-Language Models Kaiyang Zhou Jingkang Yang Chen Change Loy Ziwei Liu VPVLM CLIP VLM 552 2,447 0 02 Sep 2021
COVID-19 Infection Localization and Severity Grading from Chest X-ray Images Anas Tahir M. Chowdhury Amith Khandakar Tawsifur Rahman Yazan Qiblawey ... Somaya Al-Madeed K. Hameed Tahir Hamid S. Mahmud Maymouna Ezeddin 109 147 0 14 Mar 2021
Learning Transferable Visual Models From Natural Language Supervision Alec Radford Jong Wook Kim Chris Hallacy Aditya A. Ramesh Gabriel Goh ... Amanda Askell Pamela Mishkin Jack Clark Gretchen Krueger Ilya Sutskever CLIP VLM 1.1K 30,092 0 26 Feb 2021
Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision Chao Jia Yinfei Yang Ye Xia Yi-Ting Chen Zarana Parekh Hieu H. Pham Quoc V. Le Yun-hsuan Sung Zhen Li Tom Duerig VLM CLIP 543 3,913 0 11 Feb 2021
BCN20000: Dermoscopic Lesions in the Wild Marc Combalia Noel Codella V. Rotemberg Brian Helba Verónica Vilaplana ... Cristina Carrera Alicia Barreiro Allan Halpern S. Puig J. Malvehy 70 450 0 06 Aug 2019
Skin Lesion Analysis Toward Melanoma Detection 2018: A Challenge Hosted by the International Skin Imaging Collaboration (ISIC) Noel Codella V. Rotemberg P. Tschandl M. E. Celebi Stephen W. Dusza ... Aadi Kalloo Konstantinos Liopyris Michael Marchetti Harald Kittler Allan Halpern 117 1,198 0 09 Feb 2019
Parameter-Efficient Transfer Learning for NLP N. Houlsby A. Giurgiu Stanislaw Jastrzebski Bruna Morrone Quentin de Laroussilhe Andrea Gesmundo Mona Attariyan Sylvain Gelly 240 4,553 0 02 Feb 2019
Skin Lesion Analysis Toward Melanoma Detection: A Challenge at the 2017 International Symposium on Biomedical Imaging (ISBI), Hosted by the International Skin Imaging Collaboration (ISIC) Noel Codella D. Gutman M. E. Celebi Brian Helba Michael Marchetti ... Aadi Kalloo Konstantinos Liopyris N. Mishra Harald Kittler Allan Halpern 113 2,093 0 13 Oct 2017