Vision Transformer for Small-Size Datasets

27 December 2021

Papers citing "Vision Transformer for Small-Size Datasets"

50 / 109 papers shown

Title
Mixture of Group Experts for Learning Invariant Representations Lei Kang Jia Li Mi Tian Hua Huang MoE 33 0 0 12 Apr 2025
Heart Failure Prediction using Modal Decomposition and Masked Autoencoders for Scarce Echocardiography Databases Andrés Bell-Navas M. Villalba-Orero Enrique Lara Pezzi J. Garicano-Mena S. L. Clainche 53 0 0 10 Apr 2025
Prompt-Guided Attention Head Selection for Focus-Oriented Image Retrieval Yuji Nozawa Yu Lin Kazumoto Nakamura Youyang Ng 38 0 0 02 Apr 2025
Geometric Median Matching for Robust k-Subset Selection from Noisy Data Anish Acharya Sujay Sanghavi Alexandros G. Dimakis Inderjit S Dhillon AAML 57 0 0 01 Apr 2025
Striving for Simplicity: Simple Yet Effective Prior-Aware Pseudo-Labeling for Semi-Supervised Ultrasound Image Segmentation Yaxiong Chen Yujie Wang Zixuan Zheng Jingliang Hu Yilei Shi Shengwu Xiong Xiao Xiang Zhu Lichao Mou 54 0 0 18 Mar 2025
Breaking Down the Hierarchy: A New Approach to Leukemia Classification I. Hamdi Hosam El-Gendy Ahmed Sharshar M. Saeed Muhammad Ridzuan ... Naveed Syed Imran Mirza Shakir Hussain Amira Mahmoud Abdalla Mohammad Yaqub 138 0 0 15 Feb 2025
Protego: Detecting Adversarial Examples for Vision Transformers via Intrinsic Capabilities Jialin Wu Kaikai Pan Yanjiao Chen Jiangyi Deng Shengyuan Pang Wenyuan Xu ViT AAML 43 0 0 13 Jan 2025
iRadar: Synthesizing Millimeter-Waves from Wearable Inertial Inputs for Human Gesture Sensing Huanqi Yang Mingda Han Xinyue Li Di Duan Tianxing Li Weitao Xu 69 0 0 20 Dec 2024
Spatio-temporal Transformers for Action Unit Classification with Event Cameras Luca Cultrera Federico Becattini Lorenzo Berlincioni Claudio Ferrari A. Bimbo 33 1 0 29 Oct 2024
Geometric Inductive Biases of Deep Networks: The Role of Data and Architecture Sajad Movahedi Antonio Orvieto Seyed-Mohsen Moosavi-Dezfooli AAML AI4CE 136 0 0 15 Oct 2024
Towards virtual painting recolouring using Vision Transformer on X-Ray Fluorescence datacubes A. Bombini Fernando García-Avello Bofías Francesca Giambi Chiara Ruberto 21 0 0 11 Oct 2024
S2HPruner: Soft-to-Hard Distillation Bridges the Discretization Gap in Pruning Weihao Lin Shengji Tang Chong Yu Peng Ye Tao Chen 18 0 0 09 Oct 2024
Improving Image Clustering with Artifacts Attenuation via Inference-Time Attention Engineering Kazumoto Nakamura Yuji Nozawa Yu-Chieh Lin K. Nakata Youyang Ng ViT 35 1 0 07 Oct 2024
Self-supervised Auxiliary Learning for Texture and Model-based Hybrid Robust and Fair Featuring in Face Analysis Shukesh Reddy Nishit Poddar Srijan Das Abhijit Das CVBM 30 0 0 29 Sep 2024
Zorro: A Flexible and Differentiable Parametric Family of Activation Functions That Extends ReLU and GELU Matias Roodschild Jorge Gotay-Sardiñas V. Jimenez A. Will 22 0 0 28 Sep 2024
Sparks of Artificial General Intelligence(AGI) in Semiconductor Material Science: Early Explorations into the Next Frontier of Generative AI-Assisted Electron Micrograph Analysis Sakhinana Sagar Srinivas Geethan Sannidhi Sreeja Gangasani Chidaksh Ravuru Venkataramana Runkana 33 0 0 17 Sep 2024
Convergence of Sharpness-Aware Minimization Algorithms using Increasing Batch Size and Decaying Learning Rate Hinata Harada Hideaki Iiduka 30 1 0 16 Sep 2024
TBConvL-Net: A Hybrid Deep Learning Architecture for Robust Medical Image Segmentation Shahzaib Iqbal Tariq M. Khan Syed S. Naqvi Asim Naveed Erik H. W. Meijering MedIm 50 6 0 05 Sep 2024
Onboard Satellite Image Classification for Earth Observation: A Comparative Study of ViT Models Thanh-Dung Le Vu Nguyen Ha T. Nguyen G. Eappen P. Thiruvasagam ... J. L. González-Rios Luis M. Garces-Socarras Symeon Chatzinotas Juan Carlos Merlano-Duncan Symeon Chatzinotas 33 4 0 05 Sep 2024
Parameter-Efficient Quantized Mixture-of-Experts Meets Vision-Language Instruction Tuning for Semiconductor Electron Micrograph Analysis Sakhinana Sagar Srinivas Chidaksh Ravuru Geethan Sannidhi Venkataramana Runkana 43 0 0 27 Aug 2024
Multi-Modal Instruction-Tuning Small-Scale Language-and-Vision Assistant for Semiconductor Electron Micrograph Analysis Sakhinana Sagar Srinivas Geethan Sannidhi Venkataramana Runkana 38 1 0 27 Aug 2024
GenFormer -- Generated Images are All You Need to Improve Robustness of Transformers on Small Datasets Sven Oehri Nikolas Ebert Ahmed Abdullah Didier Stricker Oliver Wasenmüller ViT 26 5 0 26 Aug 2024
Hierarchical Network Fusion for Multi-Modal Electron Micrograph Representation Learning with Foundational Large Language Models Sakhinana Sagar Srinivas Geethan Sannidhi Venkataramana Runkana 35 0 0 24 Aug 2024
Preliminary Investigations of a Multi-Faceted Robust and Synergistic Approach in Semiconductor Electron Micrograph Analysis: Integrating Vision Transformers with Large Language and Multimodal Models Sakhinana Sagar Srinivas Geethan Sannidhi Sreeja Gangasani Chidaksh Ravuru Venkataramana Runkana 32 0 0 24 Aug 2024
Foundational Model for Electron Micrograph Analysis: Instruction-Tuning Small-Scale Language-and-Vision Assistant for Enterprise Adoption Sakhinana Sagar Srinivas Chidaksh Ravuru Geethan Sannidhi Venkataramana Runkana 38 0 0 23 Aug 2024
Vision HgNN: An Electron-Micrograph is Worth Hypergraph of Hypernodes Sakhinana Sagar Srinivas Rajat Kumar Sarkar Sreeja Gangasani Venkataramana Runkana 35 2 0 21 Aug 2024
EMCNet : Graph-Nets for Electron Micrographs Classification Sakhinana Sagar Srinivas Rajat Kumar Sarkar Venkataramana Runkana 34 0 0 21 Aug 2024
Towards Aligned Data Removal via Twin Machine Unlearning Haoxuan Ji Zheng Lin Yuyao Sun Rong Jin Yuhang Wang Haichang Gao Zhenxing Niu MU 30 0 0 21 Aug 2024
DuoFormer: Leveraging Hierarchical Visual Representations by Local and Global Attention Xiaoya Tang Bodong Zhang Beatrice S. Knudsen Tolga Tasdizen ViT MedIm 47 1 0 18 Jul 2024
4-bit Shampoo for Memory-Efficient Network Training Sike Wang Jia Li Pan Zhou Hua Huang MQ 31 5 0 28 May 2024
RMT-BVQA: Recurrent Memory Transformer-based Blind Video Quality Assessment for Enhanced Video Content Tianhao Peng Chen Feng Duolikun Danier Fan Zhang David Bull 36 2 0 14 May 2024
Automatic Cardiac Pathology Recognition in Echocardiography Images Using Higher Order Dynamic Mode Decomposition and a Vision Transformer for Small Datasets Andrés Bell-Navas N. Groun M. Villalba-Orero Enrique Lara Pezzi J. Garicano-Mena S. L. Clainche ViT 22 3 0 30 Apr 2024
Weight Copy and Low-Rank Adaptation for Few-Shot Distillation of Vision Transformers Diana-Nicoleta Grigore Mariana-Iuliana Georgescu J. A. Justo T. Johansen Andreea-Iuliana Ionescu Radu Tudor Ionescu 31 0 0 14 Apr 2024
VTR: An Optimized Vision Transformer for SAR ATR Acceleration on FPGA S. Wickramasinghe Dhruv Parikh Bingyi Zhang Rajgopal Kannan Viktor Prasanna Carl E. Busart 22 1 0 06 Apr 2024
Structured Initialization for Attention in Vision Transformers Jianqiao Zheng Xueqian Li Simon Lucey ViT 23 1 0 01 Apr 2024
Robust Ensemble Person Re-Identification via Orthogonal Fusion with Occlusion Handling Syeda Nyma Ferdous Xin Li 41 0 0 29 Mar 2024
Homogeneous Tokenizer Matters: Homogeneous Visual Tokenizer for Remote Sensing Image Understanding Run Shao Zhaoyang Zhang Chao Tao Yunsheng Zhang Chengli Peng Haifeng Li VLM 35 5 0 27 Mar 2024
Improving Forward Compatibility in Class Incremental Learning by Increasing Representation Rank and Feature Richness Jaeill Kim Wonseok Lee Moonjung Eo Wonjong Rhee CLL 39 0 0 22 Mar 2024
Frozen Feature Augmentation for Few-Shot Image Classification Andreas Bär N. Houlsby Mostafa Dehghani Manoj Kumar VLM 29 4 0 15 Mar 2024
Enhanced Sparsification via Stimulative Training Shengji Tang Weihao Lin Hancheng Ye Peng Ye Chong Yu Baopu Li Tao Chen 40 2 0 11 Mar 2024
Vision Transformers with Natural Language Semantics Young-Kyung Kim Matías Di Martino Guillermo Sapiro ViT 23 5 0 27 Feb 2024
Implicit Bias and Fast Convergence Rates for Self-attention Bhavya Vasudeva Puneesh Deora Christos Thrampoulidis 34 13 0 08 Feb 2024
DFML: Decentralized Federated Mutual Learning Yasser H. Khalil A. Estiri Mahdi Beitollahi Nader Asadi S. Hemati Xu Li Guojun Zhang Xi Chen 19 1 0 02 Feb 2024
A Single Graph Convolution Is All You Need: Efficient Grayscale Image Classification Jacob Fein-Ashley S. Wickramasinghe Bingyi Zhang Rajgopal Kannan Viktor Prasanna 21 4 0 01 Feb 2024
Convolutional Initialization for Data-Efficient Vision Transformers Jianqiao Zheng Xueqian Li Simon Lucey 43 2 0 23 Jan 2024
GTA: Guided Transfer of Spatial Attention from Object-Centric Representations SeokHyun Seo Jinwoo Hong Jungwoo Chae Kyungyul Kim Sangheum Hwang 32 0 0 05 Jan 2024
Masked Modeling for Self-supervised Representation Learning on Vision and Beyond Siyuan Li Luyuan Zhang Zedong Wang Di Wu Lirong Wu ... Jun-Xiong Xia Cheng Tan Yang Liu Baigui Sun Stan Z. Li SSL 36 14 0 31 Dec 2023
Benchmarking Deep Learning Classifiers for SAR Automatic Target Recognition Jacob Fein-Ashley Tian Ye Rajgopal Kannan Viktor Prasanna Carl E. Busart 11 4 0 12 Dec 2023
TULIP: Transformer for Upsampling of LiDAR Point Clouds Bin Yang Patrick Pfreundschuh Roland Siegwart Marco Hutter Peyman Moghadam Vaishakh Patil 3DPC 20 6 0 11 Dec 2023
Critical Influence of Overparameterization on Sharpness-aware Minimization Sungbin Shin Dongyeop Lee Maksym Andriushchenko Namhoon Lee AAML 44 1 0 29 Nov 2023