Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysis

29 November 2021

Wenqi Li

Bennett Landman

Papers citing "Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysis"

50 / 251 papers shown

Title
SwinVFTR: A Novel Volumetric Feature-learning Transformer for 3D OCT Fluid Segmentation Sharif Amit Kamran Khondker Fariha Hossain Alireza Tavakkoli Salah A. Baker S. Zuckerbrod ViT MedIm 23 1 0 16 Mar 2023
Token Sparsification for Faster Medical Image Segmentation Lei Zhou Huidong Liu Joseph Bae Junjun He Dimitris Samaras Prateek Prasanna MedIm 30 3 0 11 Mar 2023
Scaling Up 3D Kernels with Bayesian Frequency Re-parameterization for Medical Image Segmentation Ho Hin Lee Quan Liu Shunxing Bao Qi Yang Xin Yu L. Cai Thomas Z. Li Yuankai Huo X. Koutsoukos Bennett A. Landman 23 13 0 10 Mar 2023
Self-Supervised CSF Inpainting with Synthetic Atrophy for Improved Accuracy Validation of Cortical Surface Analyses Jiacheng Wang Kathleen E. Larson I. Oguz MedIm 28 0 0 10 Mar 2023
Multi-site, Multi-domain Airway Tree Modeling (ATM'22): A Public Benchmark for Pulmonary Airway Segmentation Minghui Zhang Yang Wu Hanxiao Zhang Yulei Qin Hao Zheng ... Raúl San José Estépar C. Espinosa Jiayuan Sun Guang-Zhong Yang Yun Gu 15 12 0 10 Mar 2023
SSL^2: Self-Supervised Learning meets Semi-Supervised Learning: Multiple Sclerosis Segmentation in 7T-MRI from large-scale 3T-MRI Jiacheng Wang Hao Li Han Liu Dewei Hu Daiwei Lu K. Yoon Kelsey M. Barter F. Bagnato I. Oguz 21 2 0 09 Mar 2023
AMIGO: Sparse Multi-Modal Graph Transformer with Shared-Context Processing for Representation Learning of Giga-pixel Images Ramin Nakhli Puria Azadi Moghadam Haoyang Mi H. Farahani Alexander S. Baras B. Gilks A. Bashashati MedIm ViT 29 17 0 01 Mar 2023
A residual dense vision transformer for medical image super-resolution with segmentation-based perceptual loss fine-tuning Jin Zhu Guang Yang Pietro Lio' ViT MedIm 32 5 0 22 Feb 2023
Soft Error Reliability Analysis of Vision Transformers Xing-xiong Xue Cheng Liu Ying Wang Bing Yang Tao Luo L. Zhang Huawei Li Xiaowei Li 34 14 0 21 Feb 2023
Anatomical Invariance Modeling and Semantic Alignment for Self-supervised Learning in 3D Medical Image Analysis Yankai Jiang Ming Sun Heng Guo Xiaoyu Bai K. Yan Le Lu Minfeng Xu MedIm 29 20 0 11 Feb 2023
Enhancing Modality-Agnostic Representations via Meta-Learning for Brain Tumor Segmentation Aishik Konwer Xiaoling Hu Joseph Bae Xuanang Xu Chaoyu Chen Prateek Prasanna 26 16 0 08 Feb 2023
AIROGS: Artificial Intelligence for RObust Glaucoma Screening Challenge Coen de Vente Koen A. Vermeer Nicolas Jaccard He Wang Hongyi Sun ... Abdul Qayyum Imran Razzak Bram van Ginneken H. Lemij Clara I. Sánchez 21 55 0 03 Feb 2023
CLIP-Driven Universal Model for Organ Segmentation and Tumor Detection Jie Liu Yixiao Zhang Jieneng Chen Junfei Xiao Yongyi Lu Bennett A. Landman Yixuan Yuan Alan Yuille Yucheng Tang Zongwei Zhou VLM MedIm 39 194 0 02 Jan 2023
MagicNet: Semi-Supervised Multi-Organ Segmentation via Magic-Cube Partition and Recovery Duowen Chen Yunhao Bai Wei Shen Qingli Li Lequan Yu Yan Wang 15 24 0 29 Dec 2022
Med-Query: Steerable Parsing of 9-DoF Medical Anatomies with Query Embedding Heng Guo Jianfeng Zhang K. Yan Le Lu Minfeng Xu MedIm 19 2 0 05 Dec 2022
Joint Self-Supervised Image-Volume Representation Learning with Intra-Inter Contrastive Clustering D. M. Nguyen Hoangvu Nguyen M. T. N. Truong T. Cao Binh Duc Nguyen Nhat Ho Paul Swoboda Shadi Albarqouni P. Xie Daniel Sonntag SSL 24 21 0 04 Dec 2022
Vision Transformers in Medical Imaging: A Review Emerald U. Henry Onyeka Emebob C. Omonhinmin ViT MedIm 22 34 0 18 Nov 2022
Prompt Tuning for Parameter-efficient Medical Image Segmentation Marc Fischer Alexander Bartler Bin Yang SSeg 19 18 0 16 Nov 2022
Medical Diffusion: Denoising Diffusion Probabilistic Models for 3D Medical Image Generation Firas Khader Gustav Mueller-Franzes Soroosh Tayebi Arasteh T. Han Christoph Haarburger ... Johannes Stegmaier Christiane Kuhl S. Nebelung Jakob Nikolas Kather Daniel Truhn DiffM MedIm 14 65 0 07 Nov 2022
RGMIM: Region-Guided Masked Image Modeling for Learning Meaningful Representation from X-Ray Images Guang Li Ren Togo Takahiro Ogawa Miki Haseyama 16 0 0 01 Nov 2022
Synthetic Tumors Make AI Segment Tumors Better Qixing Hu Junfei Xiao Yixiong Chen Shuwen Sun Jieneng Chen Alan Yuille Zongwei Zhou MedIm 25 11 0 26 Oct 2022
Super-Resolution Based Patch-Free 3D Image Segmentation with High-Frequency Guidance Hongyi Wang Lanfen Lin Hongjie Hu Qingqing Chen Yinhao Li Yutaro Iwamoto X. Han Yen-Wei Chen Ruofeng Tong 3DV 33 0 0 26 Oct 2022
Delving into Masked Autoencoders for Multi-Label Thorax Disease Classification Junfei Xiao Yutong Bai Alan Yuille Zongwei Zhou MedIm ViT 37 59 0 23 Oct 2022
SSiT: Saliency-guided Self-supervised Image Transformer for Diabetic Retinopathy Grading Yijin Huang Junyan Lyu Pujin Cheng Roger Tam Xiaoying Tang ViT MedIm 19 19 0 20 Oct 2022
FocalUNETR: A Focal Transformer for Boundary-aware Segmentation of CT Images Chengyin Li Yao Qiang Vikram Goddla H. Bagher-Ebadian Prashant Khanduri I. Chetty D. Zhu ViT MedIm 44 9 0 06 Oct 2022
3D UX-Net: A Large Kernel Volumetric ConvNet Modernizing Hierarchical Transformer for Medical Image Segmentation Ho Hin Lee Shunxing Bao Yuankai Huo Bennett A. Landman OOD MedIm 54 133 0 29 Sep 2022
UNesT: Local Spatial Representation Learning with Hierarchical Transformer for Efficient Medical Segmentation Xin Yu Qi Yang Yinchi Zhou L. Cai Riqiang Gao ... R. Abramson Zizhao Zhang Yuankai Huo Bennett A. Landman Yucheng Tang ViT MedIm 39 0 0 28 Sep 2022
Attentive Symmetric Autoencoder for Brain MRI Segmentation Junjia Huang Haofeng Li Guanbin Li Xiang Wan MedIm 27 17 0 19 Sep 2022
$Warm Start Active Learning with Proxy Labels \& Selection via Semi-Supervised Fine-Tuning$ Warm Start Active Learning with Proxy Labels \& Selection via Semi-Supervised Fine-Tuning V. Nath Dong Yang H. Roth Daguang Xu 38 25 0 13 Sep 2022
Automatic fetal fat quantification from MRI Netanell Avisdris A. Rabinowich Daniel W Fridkin A. Zilberman Sapir Lazar ... Daphna Link-Sourani L. Ben‐Sira L. Hiersch D. Ben Bashat Leo Joskowicz 28 3 0 08 Sep 2022
PARSE challenge 2022: Pulmonary Arteries Segmentation using Swin U-Net Transformer(Swin UNETR) and U-Net Akansh Maurya K. D. Patil Rohan Padhy Kalluri Ramakrishna Ganapathy Krishnamurthi MedIm 27 3 0 20 Aug 2022
TransNorm: Transformer Provides a Strong Spatial Normalization Mechanism for a Deep Segmentation Model Reza Azad Mohammad T. Al-Antary Moein Heidari Dorit Merhof ViT MedIm 28 72 0 27 Jul 2022
Self-supervised contrastive learning of echocardiogram videos enables label-efficient cardiac disease diagnosis G. Holste Evangelos K. Oikonomou Bobak J. Mortazavi Zhangyang Wang Rohan Khera 19 9 0 23 Jul 2022
HOME: High-Order Mixed-Moment-based Embedding for Representation Learning Chuang Niu Ge Wang SSL 15 4 0 15 Jul 2022
MSP-Former: Multi-Scale Projection Transformer for Single Image Desnowing Sixiang Chen Tian-Chun Ye Yun-Peng Liu Taodong Liao Y. Ye Erkang Chen Peng Chen ViT 22 51 0 12 Jul 2022
Brain-Aware Replacements for Supervised Contrastive Learning in Detection of Alzheimer's Disease Mehmet Saygin Seyfiouglu Zixuan Liu Pranav Kamath Sadjyot Gangolli Sheng Wang T. Grabowski Linda G. Shapiro MedIm 21 14 0 11 Jul 2022
COVID Detection and Severity Prediction with 3D-ConvNeXt and Custom Pretrainings Daniel Kienzle Julian Lorenz Robin Schon K. Ludwig Rainer Lienhart 3DPC 27 14 0 30 Jun 2022
Transforming medical imaging with Transformers? A comparative review of key properties, current progresses, and future perspectives Jun Li Junyu Chen Yucheng Tang Ce Wang Bennett A. Landman S. K. Zhou ViT OOD MedIm 21 20 0 02 Jun 2022
Dynamic Linear Transformer for 3D Biomedical Image Segmentation Zheyu Zhang Ulas Bagci ViT MedIm 19 12 0 01 Jun 2022
A survey on attention mechanisms for medical applications: are we moving towards better algorithms? Tiago Gonçalves Isabel Rio-Torto Luís F. Teixeira J. S. Cardoso OOD MedIm 24 36 0 26 Apr 2022
Masked Image Modeling Advances 3D Medical Image Analysis Zekai Chen Devansh Agarwal Kshitij Aggarwal Wiem Safta Samit Hirawat V. Sethuraman Mariann Micsinai Balan Kevin Brown 33 69 0 25 Apr 2022
Surface Vision Transformers: Flexible Attention-Based Modelling of Biomedical Surfaces Simon Dahan Hao Xu Logan Z. J. Williams Abdulah Fawaz Chunhui Yang ... A. Edwards M. Glasser Alistair Young Daniel Rueckert E. C. Robinson ViT MedIm 24 0 0 07 Apr 2022
A Dempster-Shafer approach to trustworthy AI with application to fetal brain MRI segmentation Lucas Fidon Michael Aertsen Florian Kofler A. Bink A. David ... Marlene Stuempflen Esther Van Elslander Sébastien Ourselin Jan Deprest Tom Kamiel Magda Vercauteren 31 16 0 05 Apr 2022
Characterizing Renal Structures with 3D Block Aggregate Transformers Xin Yu Yucheng Tang Yinchi Zhou Riqiang Gao Qi Yang ... Yuankai Huo Zhoubing Xu Thomas A. Lasko R. Abramson Bennett A. Landman MedIm ViT 29 3 0 04 Mar 2022
Transformers in Medical Imaging: A Survey Fahad Shamshad Salman Khan Syed Waqas Zamir Muhammad Haris Khan Munawar Hayat F. Khan Huazhu Fu ViT LM&MA MedIm 111 663 0 24 Jan 2022
Advancing 3D Medical Image Analysis with Variable Dimension Transform based Supervised 3D Pre-training Shu Zhen Zhang Zihao Li Hong-Yu Zhou Jiechao Ma Yizhou Yu 32 11 0 05 Jan 2022
Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Images Ali Hatamizadeh V. Nath Yucheng Tang Dong Yang H. Roth Daguang Xu ViT MedIm 17 1,058 0 04 Jan 2022
Incremental Cross-view Mutual Distillation for Self-supervised Medical CT Synthesis Chaowei Fang Liang Wang Dingwen Zhang Jun Xu Yixuan Yuan Junwei Han OOD 28 13 0 20 Dec 2021
Semi-Supervised Medical Image Segmentation via Cross Teaching between CNN and Transformer Xiangde Luo Minhao Hu Tao Song Guotai Wang Shaoting Zhang ViT MedIm 27 203 0 09 Dec 2021
nnFormer: Interleaved Transformer for Volumetric Segmentation Hong-Yu Zhou J. Guo Yinghao Zhang Lequan Yu Liansheng Wang Yizhou Yu ViT MedIm 27 307 0 07 Sep 2021