Compute-Efficient Medical Image Classification with Softmax-Free
Transformers and Sequence Normalization

Compute-Efficient Medical Image Classification with Softmax-Free Transformers and Sequence Normalization

3 June 2024

Omar S. M. El Nahhas

Gustav Muller-Franzes

Jakob Nikolas Kather

Daniel Truhn

ArXiv (abs)PDF HTML

Papers citing "Compute-Efficient Medical Image Classification with Softmax-Free Transformers and Sequence Normalization"

9 / 9 papers shown

Title
AIROGS: Artificial Intelligence for RObust Glaucoma Screening Challenge Coen de Vente Koen A. Vermeer Nicolas Jaccard He Wang Hongyi Sun ... Abdul Qayyum Imran Razzak Bram van Ginneken H. Lemij Clara I. Sánchez 112 57 0 03 Feb 2023
SimA: Simple Softmax-free Attention for Vision Transformers Soroush Abbasi Koohpayegani Hamed Pirsiavash 85 26 0 17 Jun 2022
cosFormer: Rethinking Softmax in Attention Zhen Qin Weixuan Sun Huicai Deng Dongxu Li Yunshen Wei Baohong Lv Junjie Yan Lingpeng Kong Yiran Zhong 73 222 0 17 Feb 2022
SOFT: Softmax-free Transformer with Linear Complexity Jiachen Lu Jinghan Yao Junge Zhang Martin Danelljan Hang Xu Weiguo Gao Chunjing Xu Thomas B. Schon Li Zhang 65 166 0 22 Oct 2021
Rethinking Attention with Performers K. Choromanski Valerii Likhosherstov David Dohan Xingyou Song Andreea Gane ... Afroz Mohiuddin Lukasz Kaiser David Belanger Lucy J. Colwell Adrian Weller 186 1,597 0 30 Sep 2020
A Patient-Centric Dataset of Images and Metadata for Identifying Melanomas Using Clinical Context V. Rotemberg N. Kurtansky B. Betz‐Stablein L. Caffery E. Chousakos ... George Shih A. Stratigos P. Tschandl Jochen Weber H. Soyer 54 409 0 07 Aug 2020
Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention Angelos Katharopoulos Apoorv Vyas Nikolaos Pappas Franccois Fleuret 201 1,786 0 29 Jun 2020
Instance Normalization: The Missing Ingredient for Fast Stylization Dmitry Ulyanov Andrea Vedaldi Victor Lempitsky OOD 177 3,711 0 27 Jul 2016
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift Sergey Ioffe Christian Szegedy OOD 463 43,328 0 11 Feb 2015

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.