Bridging the Gap Between Vision Transformers and Convolutional Neural Networks on Small Datasets

12 October 2022

Papers citing "Bridging the Gap Between Vision Transformers and Convolutional Neural Networks on Small Datasets"

26 / 26 papers shown

Title
Noise Augmented Fine Tuning for Mitigating Hallucinations in Large Language Models Afshin Khadangi Amir Sartipi Igor Tchappi Ramin Bahmani 35 1 0 04 Apr 2025
HGFormer: Topology-Aware Vision Transformer with HyperGraph Learning Hao Wang Shuo Zhang Biao Leng ViT 82 0 0 03 Apr 2025
The Overfocusing Bias of Convolutional Neural Networks: A Saliency-Guided Regularization Approach David Bertoin Eduardo Hugo Sanchez Mehdi Zouitine Emmanuel Rachelson 28 0 0 25 Sep 2024
TCNFormer: Temporal Convolutional Network Former for Short-Term Wind Speed Forecasting Abid Hasan Zim Aquib Iqbal Asad Malik Zhicheng Dong Hanzhou Wu AI4TS 25 1 0 27 Aug 2024
GenFormer -- Generated Images are All You Need to Improve Robustness of Transformers on Small Datasets Sven Oehri Nikolas Ebert Ahmed Abdullah Didier Stricker Oliver Wasenmüller ViT 26 5 0 26 Aug 2024
Depth-Wise Convolutions in Vision Transformers for Efficient Training on Small Datasets Tianxiao Zhang Wenju Xu Bo Luo Guanghui Wang ViT MDE 40 7 0 28 Jul 2024
Probing the Efficacy of Federated Parameter-Efficient Fine-Tuning of Vision Transformers for Medical Image Classification Naif Alkhunaizi Faris Almalik Rouqaiah Al-Refai Muzammal Naseer Karthik Nandakumar MedIm 71 2 0 16 Jul 2024
Structural Attention: Rethinking Transformer for Unpaired Medical Image Synthesis Vu Minh Hieu Phan Yutong Xie Bowen Zhang Yuankai Qi Zhibin Liao Antonios Perperidis S. L. Phung Johan W. Verjans Minh Nguyen Nhat To MedIm 37 4 0 27 Jun 2024
Temporal-Channel Modeling in Multi-head Self-Attention for Synthetic Speech Detection Duc-Tuan Truong Ruijie Tao Tuan Nguyen Hieu-Thi Luong Kong Aik Lee Eng Siong Chng 62 5 0 25 Jun 2024
LookHere: Vision Transformers with Directed Attention Generalize and Extrapolate A. Fuller Daniel G. Kyrollos Yousef Yassin James R. Green 46 2 0 22 May 2024
Stereo-Knowledge Distillation from dpMV to Dual Pixels for Light Field Video Reconstruction Aryan Garg Raghav Mallampali Akshat Joshi Shrisudhan Govindarajan Kaushik Mitra 31 0 0 20 May 2024
GvT: A Graph-based Vision Transformer with Talking-Heads Utilizing Sparsity, Trained from Scratch on Small Datasets Dongjing Shan guiqiang chen ViT 37 0 0 07 Apr 2024
Equipping Computational Pathology Systems with Artifact Processing Pipelines: A Showcase for Computation and Performance Trade-offs Neel Kanwal Farbod Khoraminia Umay Kiraz Andrés Mosquera-Zamudio Carlos Monteagudo Emiel A. M. Janssen T. Zuiverloon Chunmig Rong K. Engan MoE 33 4 0 12 Mar 2024
Structured Inverse-Free Natural Gradient: Memory-Efficient & Numerically-Stable KFAC Wu Lin Felix Dangel Runa Eschenhagen Kirill Neklyudov Agustinus Kristiadi Richard E. Turner Alireza Makhzani 22 3 0 09 Dec 2023
IndoHerb: Indonesia Medicinal Plants Recognition using Transfer Learning and Deep Learning Muhammad Salman Ikrar Musyaffa N. Yudistira Muhammad Arif Rahman Jati Batoro 12 2 0 03 Aug 2023
GSB: Group Superposition Binarization for Vision Transformer with Limited Training Samples T. Gao Chengzhong Xu Le Zhang Hui Kong 25 4 0 13 May 2023
Resolving Task Confusion in Dynamic Expansion Architectures for Class Incremental Learning Bin Huang Zhineng Chen Peng Zhou Jiayin Chen Zuxuan Wu CLL 12 22 0 29 Dec 2022
Pruning Self-attentions into Convolutional Layers in Single Path Haoyu He Jianfei Cai Jing Liu Zizheng Pan Jing Zhang Dacheng Tao Bohan Zhuang ViT 31 40 0 23 Nov 2021
CMT: Convolutional Neural Networks Meet Vision Transformers Jianyuan Guo Kai Han Han Wu Yehui Tang Chunjing Xu Yunhe Wang Chang Xu ViT 349 500 0 13 Jul 2021
Visformer: The Vision-friendly Transformer Zhengsu Chen Lingxi Xie Jianwei Niu Xuefeng Liu Longhui Wei Qi Tian ViT 111 209 0 26 Apr 2021
Transformer in Transformer Kai Han An Xiao Enhua Wu Jianyuan Guo Chunjing Xu Yunhe Wang ViT 284 1,524 0 27 Feb 2021
Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutions Wenhai Wang Enze Xie Xiang Li Deng-Ping Fan Kaitao Song Ding Liang Tong Lu Ping Luo Ling Shao ViT 277 3,622 0 24 Feb 2021
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications Andrew G. Howard Menglong Zhu Bo Chen Dmitry Kalenichenko Weijun Wang Tobias Weyand M. Andreetto Hartwig Adam 3DH 950 20,561 0 17 Apr 2017
Aggregated Residual Transformations for Deep Neural Networks Saining Xie Ross B. Girshick Piotr Dollár Z. Tu Kaiming He 297 10,216 0 16 Nov 2016
Densely Connected Convolutional Networks Gao Huang Zhuang Liu L. V. D. van der Maaten Kilian Q. Weinberger PINN 3DV 249 36,362 0 25 Aug 2016
ImageNet Large Scale Visual Recognition Challenge Olga Russakovsky Jia Deng Hao Su J. Krause S. Satheesh ... A. Karpathy A. Khosla Michael S. Bernstein Alexander C. Berg Li Fei-Fei VLM ObjD 296 39,194 0 01 Sep 2014