Towards Foundation Models and Few-Shot Parameter-Efficient Fine-Tuning for Volumetric Organ Segmentation

29 March 2023

Papers citing "Towards Foundation Models and Few-Shot Parameter-Efficient Fine-Tuning for Volumetric Organ Segmentation"

50 / 74 papers shown

Title
A Reality Check of Vision-Language Pre-training in Radiology: Have We Progressed Using Text? Julio Silva-Rodríguez Jose Dolz Ismail ben Ayed VLM MedIm 70 0 0 07 Apr 2025
Zero-shot Domain Generalization of Foundational Models for 3D Medical Image Segmentation: An Experimental Study Soumitri Chattopadhyay Basar Demir Marc Niethammer VLM 124 0 0 28 Mar 2025
Towards Universal Text-driven CT Image Segmentation Yuheng Li Yuxiang Lai Maria Thor Deborah Marshall Zachary Buchwald D. Yu Xiaofeng Yang MedIm VLM 80 3 0 08 Mar 2025
A Comprehensive Survey of Foundation Models in Medicine Wasif Khan Seowung Leem Kyle B. See Joshua K. Wong Shaoting Zhang R. Fang AI4CE LM&MA VLM 269 26 0 17 Jan 2025
Universal and Extensible Language-Vision Models for Organ Segmentation and Tumor Detection from Abdominal Computed Tomography Jie Liu Yixiao Zhang Kang Wang Mehmet Can Yavuz Xiaoxi Chen ... Haoliang Li Yang Yang Alan Yuille Yucheng Tang Zongwei Zhou MedIm VLM 87 19 0 28 May 2024
No "Zero-Shot" Without Exponential Data: Pretraining Concept Frequency Determines Multimodal Model Performance Vishaal Udandarao Ameya Prabhu Adhiraj Ghosh Yash Sharma Philip Torr Adel Bibi Samuel Albanie Matthias Bethge VLM 151 53 0 04 Apr 2024
Active Few-Shot Fine-Tuning Jonas Hübotter Bhavya Sukhija Lenart Treven Yarden As Andreas Krause 68 1 0 13 Feb 2024
Exploring the Transferability of a Foundation Model for Fundus Images: Application to Hypertensive Retinopathy Julio Silva-Rodríguez Jihed Chelbi Waziha Kabir H. Chakor Jose Dolz Ismail Ben Ayed Riadh Kobbi MedIm 104 1 0 27 Jan 2024
A Closer Look at the Few-Shot Adaptation of Large Vision-Language Models Julio Silva-Rodríguez Sina Hajimiri Ismail Ben Ayed Jose Dolz VLM 56 34 0 20 Dec 2023
Transductive Learning for Textual Few-Shot Classification in API-based Embedding Models Pierre Colombo Victor Pellegrain Malik Boudiaf Victor Storchan Myriam Tami Ismail Ben Ayed C´eline Hudelot Pablo Piantanida 75 8 0 21 Oct 2023
A Foundation Language-Image Model of the Retina (FLAIR): Encoding Expert Knowledge in Text Supervision Julio Silva-Rodríguez H. Chakor Riadh Kobbi Jose Dolz Ismail Ben Ayed VLM MedIm 209 43 0 15 Aug 2023
SAM-Path: A Segment Anything Model for Semantic Segmentation in Digital Pathology Jingwei Zhang Ke Ma S. Kapse Joel H. Saltz Maria Vakalopoulou Prateek Prasanna Dimitris Samaras VLM MedIm 71 36 0 12 Jul 2023
Foundation Model for Endoscopy Video Analysis via Large-scale Self-supervised Pre-train Zhao Wang Chang Liu Shaoting Zhang Qi Dou MedIm 79 65 0 29 Jun 2023
Parameter-Efficient Fine-Tuning for Medical Image Analysis: The Missed Opportunity Raman Dutt Linus Ericsson Pedro Sanchez Sotirios A. Tsaftaris Timothy M. Hospedales MedIm 89 53 0 14 May 2023
Med-Tuning: A New Parameter-Efficient Tuning Framework for Medical Volumetric Segmentation Jiachen Shen Wenxuan Wang Chen Chen Jianbo Jiao Jing Liu Yan Zhang Shanshan Song Jiangyun Li 68 1 0 21 Apr 2023
Segment Anything Model for Medical Image Analysis: an Experimental Study Maciej A. Mazurowski Haoyu Dong Han Gu Jichen Yang Nicholas Konz Yixin Zhang MedIm VLM 98 479 0 20 Apr 2023
UniverSeg: Universal Medical Image Segmentation V. Butoi Jose Javier Gonzalez Ortiz Tianyu Ma M. Sabuncu John Guttag Adrian Dalca 70 83 0 12 Apr 2023
UniSeg: A Prompt-driven Universal Segmentation Model as well as A Strong Representation Learner Yiwen Ye Yutong Xie Jianpeng Zhang Ziyang Chen Yong-quan Xia SSL 79 43 0 07 Apr 2023
Strong Baselines for Parameter Efficient Few-Shot Fine-tuning S. Basu Daniela Massiceti S. Hu Soheil Feizi VLM 73 33 0 04 Apr 2023
MultiTalent: A Multi-Dataset Approach to Medical Image Segmentation Constantin Ulrich Fabian Isensee Tassilo Wald M. Zenk Michael Baumgartner Klaus H. Maier-Hein 59 39 0 25 Mar 2023
Knowledge-enhanced Visual-Language Pre-training on Chest Radiology Images Xiaoman Zhang Chaoyi Wu Ya Zhang Yanfeng Wang Weidi Xie MedIm 69 133 0 27 Feb 2023
CLIP-Driven Universal Model for Organ Segmentation and Tumor Detection Jie Liu Yixiao Zhang Jieneng Chen Junfei Xiao Yongyi Lu Bennett A. Landman Yixuan Yuan Alan Yuille Yucheng Tang Zongwei Zhou VLM MedIm 85 209 0 02 Jan 2023
Few-shot Medical Image Segmentation with Cycle-resemblance Attention Hao Ding Changchang Sun Hao Tang Dawen Cai Yan Yan 65 48 0 07 Dec 2022
Multi-Granularity Cross-modal Alignment for Generalized Medical Visual Representation Learning Fuying Wang Yuyin Zhou Shujun Wang V. Vardhanabhuti Lequan Yu 84 145 0 12 Oct 2022
AMOS: A Large-Scale Abdominal Multi-Organ Benchmark for Versatile Medical Image Segmentation Yuanfeng Ji Haotian Bai Jie Yang Chongjian Ge Ye Zhu ... Zhuguo Li Lingyan Zhang Wanling Ma Xiang Wan Ping Luo OOD 73 315 0 16 Jun 2022
AdaptFormer: Adapting Vision Transformers for Scalable Visual Recognition Shoufa Chen Chongjian Ge Zhan Tong Jiangliu Wang Yibing Song Jue Wang Ping Luo 203 683 0 26 May 2022
Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distribution Ananya Kumar Aditi Raghunathan Robbie Jones Tengyu Ma Percy Liang OODD 117 674 0 21 Feb 2022
Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Images Ali Hatamizadeh V. Nath Yucheng Tang Dong Yang H. Roth Daguang Xu ViT MedIm 120 1,125 0 04 Jan 2022
UniMiSS: Universal Medical Self-Supervised Learning via Breaking Dimensionality Barrier Yutong Xie Jianpeng Zhang Yong-quan Xia Qi Wu MedIm 119 64 0 17 Dec 2021
Revisiting the Transferability of Supervised Pretraining: an MLP Perspective Yizhou Wang Shixiang Tang Feng Zhu Lei Bai Rui Zhao Donglian Qi Wanli Ouyang 75 52 0 01 Dec 2021
Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysis Yucheng Tang Dong Yang Wenqi Li H. Roth Bennett Landman Daguang Xu V. Nath Ali Hatamizadeh ViT MedIm 108 533 0 29 Nov 2021
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 460 7,757 0 11 Nov 2021
Tip-Adapter: Training-free CLIP-Adapter for Better Vision-Language Modeling Renrui Zhang Rongyao Fang Wei Zhang Peng Gao Kunchang Li Jifeng Dai Yu Qiao Hongsheng Li VLM 265 400 0 06 Nov 2021
WORD: A large scale dataset, benchmark and clinical applicable study for abdominal organ segmentation from CT image Xiangde Luo Wenjun Liao Jianghong Xiao Jieneng Chen Tao Song Xiaofan Zhang Kang Li Dimitris N. Metaxas Guotai Wang Shaoting Zhang 51 131 0 03 Nov 2021
CLIP-Adapter: Better Vision-Language Models with Feature Adapters Peng Gao Shijie Geng Renrui Zhang Teli Ma Rongyao Fang Yongfeng Zhang Hongsheng Li Yu Qiao VLM CLIP 284 1,042 0 09 Oct 2021
Towards a Unified View of Parameter-Efficient Transfer Learning Junxian He Chunting Zhou Xuezhe Ma Taylor Berg-Kirkpatrick Graham Neubig AAML 129 935 0 08 Oct 2021
Learning to Prompt for Vision-Language Models Kaiyang Zhou Jingkang Yang Chen Change Loy Ziwei Liu VPVLM CLIP VLM 492 2,399 0 02 Sep 2021
Recurrent Mask Refinement for Few-Shot Medical Image Segmentation Hao Tang Xingwei Liu Shanlin Sun Xiangyi Yan Xiaohui Xie 58 101 0 02 Aug 2021
BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models Elad Ben-Zaken Shauli Ravfogel Yoav Goldberg 165 1,223 0 18 Jun 2021
The Medical Segmentation Decathlon Michela Antonelli Annika Reinke Spyridon Bakas Keyvan Farahani AnnetteKopp-Schneider ... Zhanwei Xu Yefeng Zheng Amber L. Simpson Lena Maier-Hein M. Jorge Cardoso OOD 106 983 0 10 Jun 2021
Compacter: Efficient Low-Rank Hypercomplex Adapter Layers Rabeeh Karimi Mahabadi James Henderson Sebastian Ruder MoE 103 485 0 08 Jun 2021
Recent advances and clinical applications of deep learning in medical image analysis Xuxin Chen Ximing Wang Kecheng Zhang K. Fung T. Thai K. Moore Robert S. Mannel Hong Liu B. Zheng Y. Qiu OOD 58 599 0 27 May 2021
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 685 6,079 0 29 Apr 2021
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows Ze Liu Yutong Lin Yue Cao Han Hu Yixuan Wei Zheng Zhang Stephen Lin B. Guo ViT 447 21,418 0 25 Mar 2021
UNETR: Transformers for 3D Medical Image Segmentation Ali Hatamizadeh Yucheng Tang Vishwesh Nath Dong Yang Andriy Myronenko Bennett Landman H. Roth Daguang Xu ViT MedIm 173 1,607 0 18 Mar 2021
Learning Transferable Visual Models From Natural Language Supervision Alec Radford Jong Wook Kim Chris Hallacy Aditya A. Ramesh Gabriel Goh ... Amanda Askell Pamela Mishkin Jack Clark Gretchen Krueger Ilya Sutskever CLIP VLM 925 29,436 0 26 Feb 2021
AbdomenCT-1K: Is Abdominal Organ Segmentation A Solved Problem? Jun Ma Yao Zhang Song Gu Cheng Zhu Cheng Ge ... Shangqing Liu Yunpeng Wang Yuhui Li Jian He Xiaoping Yang SSeg OOD 86 344 0 28 Oct 2020
Language Models are Few-Shot Learners Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan ... Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei BDL 761 42,055 0 28 May 2020
Models Genesis Zongwei Zhou V. Sodha Jiaxuan Pang Michael B. Gotway Jianming Liang MedIm 51 31 0 09 Apr 2020
Training BatchNorm and Only BatchNorm: On the Expressive Power of Random Features in CNNs Jonathan Frankle D. Schwab Ari S. Morcos 75 143 0 29 Feb 2020