Escaping the Big Data Paradigm with Compact Transformers

12 April 2021

Papers citing "Escaping the Big Data Paradigm with Compact Transformers"

50 / 216 papers shown

Title
D3Former: Debiased Dual Distilled Transformer for Incremental Learning Abdel-rahman Mohamed Rushali Grandhe KJ Joseph Salman Khan Fahad Shahbaz Khan CLL 28 9 0 25 Jul 2022
Online Continual Learning with Contrastive Vision Transformer Zhen Wang Liu Liu Yajing Kong Jiaxian Guo Dacheng Tao CLL 21 36 0 24 Jul 2022
Locality Guidance for Improving Vision Transformers on Tiny Datasets Kehan Li Runyi Yu Zhennan Wang Li-ming Yuan Guoli Song Jie Chen ViT 32 44 0 20 Jul 2022
Multi-manifold Attention for Vision Transformers D. Konstantinidis Ilias Papastratis K. Dimitropoulos P. Daras ViT 27 16 0 18 Jul 2022
Big Learning Yulai Cong Miaoyun Zhao AI4CE 32 0 0 08 Jul 2022
Learning Sequential Descriptors for Sequence-based Visual Place Recognition R. Mereu Gabriele Trivigno Gabriele Berton Carlo Masone Barbara Caputo 21 30 0 08 Jul 2022
Vision Transformers: State of the Art and Research Challenges Bo-Kai Ruan Hong-Han Shuai Wen-Huang Cheng ViT 30 17 0 07 Jul 2022
Accurate and fast identification of minimally prepared bacteria phenotypes using Raman spectroscopy assisted by machine learning B. L. Thomsen J. Christensen O. Rodenko I. Usenov R. B. Grønnemose T. Andersen M. Lassen 16 22 0 27 Jun 2022
Quantization Robust Federated Learning for Efficient Inference on Heterogeneous Devices Kartik Gupta Marios Fournarakis M. Reisser Christos Louizos Markus Nagel FedML 22 15 0 22 Jun 2022
EfficientFormer: Vision Transformers at MobileNet Speed Yanyu Li Geng Yuan Yang Wen Eric Hu Georgios Evangelidis Sergey Tulyakov Yanzhi Wang Jian Ren ViT 23 347 0 02 Jun 2022
The Fully Convolutional Transformer for Medical Image Segmentation Athanasios Tragakis Chaitanya Kaul Roderick Murray-Smith D. Husmeier ViT MedIm 25 56 0 01 Jun 2022
Few-Shot Diffusion Models Giorgio Giannone Didrik Nielsen Ole Winther DiffM 186 49 0 30 May 2022
WaveMix: A Resource-efficient Neural Network for Image Analysis Pranav Jeevan Kavitha Viswanathan S. AnanduA A. Sethi 23 20 0 28 May 2022
On the Symmetries of Deep Learning Models and their Internal Representations Charles Godfrey Davis Brown Tegan H. Emerson Henry Kvinge 28 40 0 27 May 2022
FedBR: Improving Federated Learning on Heterogeneous Data via Local Learning Bias Reduction Yongxin Guo Xiaoying Tang Tao R. Lin FedML 57 27 0 26 May 2022
Eye-gaze-guided Vision Transformer for Rectifying Shortcut Learning Chong Ma Lin Zhao Yuzhong Chen Lu Zhang Zhe Xiao ... Tuo Zhang Qian Wang Dinggang Shen Dajiang Zhu Tianming Liu ViT MedIm 42 30 0 25 May 2022
One-Pixel Shortcut: on the Learning Preference of Deep Neural Networks Shutong Wu Sizhe Chen Cihang Xie X. Huang AAML 48 27 0 24 May 2022
Test-Time Robust Personalization for Federated Learning Liang Jiang Tao R. Lin FedML OOD TTA 82 43 0 22 May 2022
Mask-guided Vision Transformer (MG-ViT) for Few-Shot Learning Yuzhong Chen Zhe Xiao Lin Zhao Lu Zhang Haixing Dai ... Tuo Zhang Changying Li Dajiang Zhu Tianming Liu Xi Jiang 44 18 0 20 May 2022
ImageSig: A signature transform for ultra-lightweight image recognition Mohamed Ramzy Ibrahim Terry Lyons VLM 19 7 0 13 May 2022
CV4Code: Sourcecode Understanding via Visual Code Representations Ruibo Shi Lili Tao Rohan Saphal Fran Silavong Sean J. Moran 29 0 0 11 May 2022
Synthesized Speech Detection Using Convolutional Transformer-Based Spectrogram Analysis Emily R. Bartusiak Edward J. Delp ViT 28 18 0 03 May 2022
Adaptive Split-Fusion Transformer Zixuan Su Hao Zhang Jingjing Chen Lei Pang Chong-Wah Ngo Yu-Gang Jiang ViT 27 7 0 26 Apr 2022
Deeper Insights into the Robustness of ViTs towards Common Corruptions Rui Tian Zuxuan Wu Qi Dai Han Hu Yu-Gang Jiang ViT AAML 21 4 0 26 Apr 2022
Neighborhood Attention Transformer Ali Hassani Steven Walton Jiacheng Li Shengjia Li Humphrey Shi ViT AI4TS 36 254 0 14 Apr 2022
Malceiver: Perceiver with Hierarchical and Multi-modal Features for Android Malware Detection Niall McLaughlin 30 2 0 12 Apr 2022
Deep Visual Geo-localization Benchmark Gabriele Berton R. Mereu Gabriele Trivigno Carlo Masone G. Csurka Torsten Sattler Barbara Caputo ObjD 39 87 0 07 Apr 2022
Low-Dose CT Denoising via Sinogram Inner-Structure Transformer Liutao Yang Zhongnian Li Rongjun Ge Junyong Zhao Haipeng Si Daoqiang Zhang MedIm 25 52 0 07 Apr 2022
Rethinking Visual Geo-localization for Large-Scale Applications Gabriele Berton Carlo Masone Barbara Caputo ObjD 24 153 0 05 Apr 2022
Revisiting a kNN-based Image Classification System with High-capacity Storage K. Nakata Youyang Ng Daisuke Miyashita A. Maki Yu Lin J. Deguchi 29 26 0 03 Apr 2022
Brain-inspired Multilayer Perceptron with Spiking Neurons Wenshuo Li Hanting Chen Jianyuan Guo Ziyang Zhang Yunhe Wang 30 35 0 28 Mar 2022
WaveMix: Resource-efficient Token Mixing for Images Pranav Jeevan A. Sethi 17 10 0 07 Mar 2022
ViT-P: Rethinking Data-efficient Vision Transformers from Locality Bin Chen Ran A. Wang Di Ming Xin Feng ViT 18 7 0 04 Mar 2022
Auto-scaling Vision Transformers without Training Wuyang Chen Wei Huang Xianzhi Du Xiaodan Song Zhangyang Wang Denny Zhou ViT 32 23 0 24 Feb 2022
RadioTransformer: A Cascaded Global-Focal Transformer for Visual Attention-guided Disease Classification Moinak Bhattacharya Shubham Jain Prateek Prasanna ViT MedIm 22 33 0 23 Feb 2022
Convolutional Xformers for Vision Pranav Jeevan Amit Sethi ViT 55 12 0 25 Jan 2022
SeMask: Semantically Masked Transformers for Semantic Segmentation Jitesh Jain Anukriti Singh Nikita Orlov Zilong Huang Jiachen Li Steven Walton Humphrey Shi ViT 29 92 0 23 Dec 2021
Understanding Memorization from the Perspective of Optimization via Efficient Influence Estimation Futong Liu Tao R. Lin Martin Jaggi TDI 20 8 0 16 Dec 2021
Couplformer:Rethinking Vision Transformer with Coupling Attention Map Hai Lan Xihao Wang Xian Wei ViT 34 3 0 10 Dec 2021
Non-Intrusive Binaural Speech Intelligibility Prediction from Discrete Latent Representations Alex F. McKinney Benjamin Cauchi 15 3 0 24 Nov 2021
CpT: Convolutional Point Transformer for 3D Point Cloud Processing Chaitanya Kaul Joshua Mitton H. Dai Roderick Murray-Smith 3DPC 30 6 0 21 Nov 2021
Full-attention based Neural Architecture Search using Context Auto-regression Yuan Zhou Haiyang Wang Shuwei Huo Boyu Wang 30 3 0 13 Nov 2021
Hybrid BYOL-ViT: Efficient approach to deal with small datasets Safwen Naimi Rien van Leeuwen W. Souidène S. B. Saoud SSL ViT 25 2 0 08 Nov 2021
Noisy Feature Mixup S. H. Lim N. Benjamin Erichson Francisco Utrera Winnie Xu Michael W. Mahoney AAML 12 37 0 05 Oct 2021
ResNet strikes back: An improved training procedure in timm Ross Wightman Hugo Touvron Hervé Jégou AI4TS 212 487 0 01 Oct 2021
UFO-ViT: High Performance Linear Vision Transformer without Softmax Jeonggeun Song ViT 114 20 0 29 Sep 2021
Audiomer: A Convolutional Transformer For Keyword Spotting Surya Kant Sahu Sai Mitheran Juhi Kamdar Meet Gandhi 40 8 0 21 Sep 2021
ConvMLP: Hierarchical Convolutional MLPs for Vision Jiachen Li Ali Hassani Steven Walton Humphrey Shi 43 55 0 09 Sep 2021
Learning the Physics of Particle Transport via Transformers O. Pastor-Serrano Zoltán Perkó MedIm 21 13 0 08 Sep 2021
Reiterative Domain Aware Multi-Target Adaptation Sudipan Saha Shan Zhao Nasrullah Sheikh Xiao Xiang Zhu 24 1 0 26 Aug 2021