EfficientNetV2: Smaller Models and Faster Training

1 April 2021

Mingxing Tan

Papers citing "EfficientNetV2: Smaller Models and Faster Training"

38 / 288 papers shown

Title
Google Landmark Retrieval 2021 Competition Third Place Solution Qishen Ha Bo Liu Hongwei Zhang 3DV 3DPC 29 2 0 09 Oct 2021
UniNet: Unified Architecture Search with Convolution, Transformer, and MLP Jihao Liu Hongsheng Li Guanglu Song Xin Huang Yu Liu ViT 37 35 0 08 Oct 2021
3rd Place Solution to Google Landmark Recognition Competition 2021 Chengfeng Xu Weimin Wang Shuai Liu Yong Wang Yuxiang Tang Tianling Bian Yanyu Yan Qi She Cheng Yang 3DPC 3DV 38 6 0 06 Oct 2021
ResNet strikes back: An improved training procedure in timm Ross Wightman Hugo Touvron Hervé Jégou AI4TS 212 487 0 01 Oct 2021
PhiNets: a scalable backbone for low-power AI at the edge Francesco Paissan Alberto Ancilotto Elisabetta Farella 34 32 0 01 Oct 2021
Reduced-Lead ECG Classifier Model Trained with DivideMix and Model Ensemble Hiroshi Seki Takashi Nakano Koshiro Ikeda S. Hirooka Takaaki Kawasaki Mitsutomo Yamada Shumpei Saito T. Yamakawa Shimpei Ogawa 20 3 0 24 Sep 2021
DEM Super-Resolution with EfficientNetV2 B. Demiray M. Sit Ibrahim Demir 51 20 0 20 Sep 2021
Compute and Energy Consumption Trends in Deep Learning Inference Radosvet Desislavov Fernando Martínez-Plumed José Hernández-Orallo 35 113 0 12 Sep 2021
Architecture Aware Latency Constrained Sparse Neural Networks Tianli Zhao Qinghao Hu Xiangyu He Weixiang Xu Jiaxing Wang Cong Leng Jian Cheng 39 0 0 01 Sep 2021
A Battle of Network Structures: An Empirical Study of CNN, Transformer, and MLP Yucheng Zhao Guangting Wang Chuanxin Tang Chong Luo Wenjun Zeng Zhengjun Zha 35 69 0 30 Aug 2021
DKM: Differentiable K-Means Clustering Layer for Neural Network Compression Minsik Cho Keivan Alizadeh Vahid Saurabh N. Adya Mohammad Rastegari 42 34 0 28 Aug 2021
RaftMLP: How Much Can Be Done Without Attention and with Less Spatial Locality? Yuki Tatsunami Masato Taki 42 12 0 09 Aug 2021
Automated Human Cell Classification in Sparse Datasets using Few-Shot Learning Reece Walsh Mohamed H. Abdelpakey M. Shehata Mostafa M. Mohamed 3DH 30 21 0 27 Jul 2021
Self-Correcting Neural Networks For Safe Classification Klas Leino Aymeric Fromherz Ravi Mangal Matt Fredrikson Bryan Parno C. Păsăreanu 34 4 0 23 Jul 2021
AS-MLP: An Axial Shifted MLP Architecture for Vision Dongze Lian Zehao Yu Xing Sun Shenghua Gao 30 189 0 18 Jul 2021
Recognizing bird species in diverse soundscapes under weak supervision Christof Henkel Pascal Pfeiffer Philipp Singer 35 14 0 16 Jul 2021
Early Convolutions Help Transformers See Better Tete Xiao Mannat Singh Eric Mintun Trevor Darrell Piotr Dollár Ross B. Girshick 20 755 0 28 Jun 2021
VOLO: Vision Outlooker for Visual Recognition Li-xin Yuan Qibin Hou Zihang Jiang Jiashi Feng Shuicheng Yan ViT 52 315 0 24 Jun 2021
Teacher's pet: understanding and mitigating biases in distillation Michal Lukasik Srinadh Bhojanapalli A. Menon Sanjiv Kumar 18 25 0 19 Jun 2021
How to train your ViT? Data, Augmentation, and Regularization in Vision Transformers Andreas Steiner Alexander Kolesnikov Xiaohua Zhai Ross Wightman Jakob Uszkoreit Lucas Beyer ViT 66 618 0 18 Jun 2021
Evaluating the Robustness of Trigger Set-Based Watermarks Embedded in Deep Neural Networks Suyoung Lee Wonho Song Suman Jana M. Cha Sooel Son AAML 27 13 0 18 Jun 2021
A Winning Hand: Compressing Deep Networks Can Improve Out-Of-Distribution Robustness James Diffenderfer Brian Bartoldson Shreya Chaganti Jize Zhang B. Kailkhura OOD 31 69 0 16 Jun 2021
CoAtNet: Marrying Convolution and Attention for All Data Sizes Zihang Dai Hanxiao Liu Quoc V. Le Mingxing Tan ViT 49 1,172 0 09 Jun 2021
Scaling Vision Transformers Xiaohua Zhai Alexander Kolesnikov N. Houlsby Lucas Beyer ViT 85 1,064 0 08 Jun 2021
On the Connection between Local Attention and Dynamic Depth-wise Convolution Qi Han Zejia Fan Qi Dai Lei-huan Sun Ming-Ming Cheng Jiaying Liu Jingdong Wang ViT 29 105 0 08 Jun 2021
Pay Attention to MLPs Hanxiao Liu Zihang Dai David R. So Quoc V. Le AI4CE 57 654 0 17 May 2021
Vision Transformers are Robust Learners Sayak Paul Pin-Yu Chen ViT 28 309 0 17 May 2021
Waste detection in Pomerania: non-profit project for detecting waste in environment Sylwia Majchrowska Agnieszka Mikołajczyk M. Ferlin Zuzanna Klawikowska Marta A. Plantykow Arkadiusz Kwasigroch K. Majek 30 125 0 12 May 2021
Vision Transformers with Patch Diversification Chengyue Gong Dilin Wang Meng Li Vikas Chandra Qiang Liu ViT 45 62 0 26 Apr 2021
LeViT: a Vision Transformer in ConvNet's Clothing for Faster Inference Ben Graham Alaaeldin El-Nouby Hugo Touvron Pierre Stock Armand Joulin Hervé Jégou Matthijs Douze ViT 22 775 0 02 Apr 2021
Danish Fungi 2020 -- Not Just Another Image Recognition Dataset Lukás Picek Milan Šulc Jirí Matas J. Heilmann‐Clausen T. Jeppesen T. Læssøe T. Frøslev 30 54 0 18 Mar 2021
LambdaNetworks: Modeling Long-Range Interactions Without Attention Irwan Bello 281 179 0 17 Feb 2021
High-Performance Large-Scale Image Recognition Without Normalization Andrew Brock Soham De Samuel L. Smith Karen Simonyan VLM 226 513 0 11 Feb 2021
Bottleneck Transformers for Visual Recognition A. Srinivas Nayeon Lee Niki Parmar Jonathon Shlens Pieter Abbeel Ashish Vaswani SLR 290 981 0 27 Jan 2021
A Survey on Ensemble Learning under the Era of Deep Learning Yongquan Yang Haijun Lv Ning Chen OOD 72 182 0 21 Jan 2021
Shortformer: Better Language Modeling using Shorter Inputs Ofir Press Noah A. Smith M. Lewis 230 89 0 31 Dec 2020
Teacher-Class Network: A Neural Network Compression Mechanism Shaiq Munir Malik Muhammad Umair Haider Fnu Mohbat Musab Rasheed M. Taj 22 5 0 07 Apr 2020
Fixing the train-test resolution discrepancy: FixEfficientNet Hugo Touvron Andrea Vedaldi Matthijs Douze Hervé Jégou AAML 196 110 0 18 Mar 2020