v1v2v3 (latest)

EfficientNetV2: Smaller Models and Faster Training

1 April 2021

Mingxing Tan

Quoc V. Le

EgoV

ArXiv (abs)PDF HTML Github (6372★)

Papers citing "EfficientNetV2: Smaller Models and Faster Training"

50 / 767 papers shown

Title
NoFADE: Analyzing Diminishing Returns on CO2 Investment André Fu Justin Tran Andy Xie Jonathan Spraggett Elisa Ding Chang Won Lee Kanav Singla Mahdi S. Hosseini Konstantinos N. Plataniotis 127 0 0 28 Nov 2021
Adaptive Image Transformations for Transfer-based Adversarial Attack Zheng Yuan Jie Zhang Shiguang Shan OOD 100 27 0 27 Nov 2021
GPR1200: A Benchmark for General-Purpose Content-Based Image Retrieval Konstantin Schall Kai Uwe Barthel Nico Hezel Klaus Jung VLM 61 20 0 25 Nov 2021
Self-slimmed Vision Transformer Zhuofan Zong Kunchang Li Guanglu Song Yali Wang Yu Qiao B. Leng Yu Liu ViT 122 32 0 24 Nov 2021
Combined Scaling for Zero-shot Transfer Learning Hieu H. Pham Zihang Dai Golnaz Ghiasi Kenji Kawaguchi Hanxiao Liu ... Yi-Ting Chen Minh-Thang Luong Yonghui Wu Mingxing Tan Quoc V. Le VLM 148 202 0 19 Nov 2021
Rethinking Dilated Convolution for Real-time Semantic Segmentation Roland Gao SSeg 78 45 0 18 Nov 2021
INTERN: A New Learning Paradigm Towards General Vision Jing Shao Siyu Chen Yangguang Li Kun Wang Zhen-fei Yin ... F. Yu Junjie Yan Dahua Lin Xiaogang Wang Yu Qiao 110 34 0 16 Nov 2021
Improved Robustness of Vision Transformer via PreLayerNorm in Patch Embedding Bum Jun Kim Hyeyeon Choi Hyeonah Jang Dong Gu Lee Wonseok Jeong Sang Woo Kim ViT 57 10 0 16 Nov 2021
The self-supervised spectral-spatial attention-based transformer network for automated, accurate prediction of crop nitrogen status from UAV imagery Xin Zhang Liangxiu Han Tam Sobeih Lewis Lappin Mark A. Lee Andew Howard A. Kisdi ViT 34 1 0 12 Nov 2021
AnalogNets: ML-HW Co-Design of Noise-robust TinyML Models and Always-On Analog Compute-in-Memory Accelerator Chuteng Zhou F. García-Redondo Julian Büchel I. Boybat Xavier Timoneda Comas S. Nandakumar Shidhartha Das Abu Sebastian Manuel Le Gallo P. Whatmough 78 16 0 10 Nov 2021
Phantom: A High-Performance Computational Core for Sparse Convolutional Neural Networks Mahmood Azhar Qureshi Arslan Munir 86 0 0 09 Nov 2021
Are we ready for a new paradigm shift? A Survey on Visual Deep MLP Ruiyang Liu Hai-Tao Zheng Li Tao Dun Liang Haitao Zheng 219 100 0 07 Nov 2021
RMNet: Equivalently Removing Residual Connection from Networks Fanxu Meng Hao Cheng Jia-Xin Zhuang Ke Li Xing Sun 55 11 0 01 Nov 2021
LAE : Long-tailed Age Estimation Zenghao Bao Marc Rigter Paul Duckworth Jun Wan Xibo Ma Zhen Lei G. Guo CVBM 53 5 0 25 Oct 2021
Investigating Transfer Learning Capabilities of Vision Transformers and CNNs by Fine-Tuning a Single Trainable Block Durvesh Malpure Onkar Litake Rajesh S. Ingle ViT 46 5 0 11 Oct 2021
Google Landmark Retrieval 2021 Competition Third Place Solution Qishen Ha Bo Liu Hongwei Zhang 3DV 3DPC 55 2 0 09 Oct 2021
UniNet: Unified Architecture Search with Convolution, Transformer, and MLP Jihao Liu Hongsheng Li Guanglu Song Xin Huang Yu Liu ViT 104 36 0 08 Oct 2021
PEAF: Learnable Power Efficient Analog Acoustic Features for Audio Recognition Boris Bergsma Minhao Yang Milos Cernak 60 4 0 07 Oct 2021
3rd Place Solution to Google Landmark Recognition Competition 2021 Chengfeng Xu Weimin Wang Shuai Liu Yong Wang Yuxiang Tang Tianling Bian Yanyu Yan Qi She Cheng Yang 3DPC 3DV 80 6 0 06 Oct 2021
ResNet strikes back: An improved training procedure in timm Ross Wightman Hugo Touvron Hervé Jégou AI4TS 308 500 0 01 Oct 2021
PhiNets: a scalable backbone for low-power AI at the edge Francesco Paissan Alberto Ancilotto Elisabetta Farella 88 34 0 01 Oct 2021
Reduced-Lead ECG Classifier Model Trained with DivideMix and Model Ensemble Hiroshi Seki Takashi Nakano Koshiro Ikeda S. Hirooka Takaaki Kawasaki Mitsutomo Yamada Shumpei Saito T. Yamakawa Shimpei Ogawa 32 3 0 24 Sep 2021
DEM Super-Resolution with EfficientNetV2 B. Demiray M. Sit Ibrahim Demir 98 20 0 20 Sep 2021
A Medical Pre-Diagnosis System for Histopathological Image of Breast Cancer Shiyu Fan Runhai Xu Zhaohang Yan 37 4 0 16 Sep 2021
Dense Pruning of Pointwise Convolutions in the Frequency Domain Mark Buckler Neil Adit Yuwei Hu Zhiru Zhang Adrian Sampson 3DPC 53 2 0 16 Sep 2021
Compute and Energy Consumption Trends in Deep Learning Inference Radosvet Desislavov Fernando Martínez-Plumed José Hernández-Orallo 77 119 0 12 Sep 2021
Architecture Aware Latency Constrained Sparse Neural Networks Tianli Zhao Qinghao Hu Xiangyu He Weixiang Xu Jiaxing Wang Cong Leng Jian Cheng 74 0 0 01 Sep 2021
Exploring and Improving Mobile Level Vision Transformers Pengguang Chen Yixin Chen Shu Liu Ming-Hsuan Yang Jiaya Jia ViT 109 4 0 30 Aug 2021
A Battle of Network Structures: An Empirical Study of CNN, Transformer, and MLP Yucheng Zhao Guangting Wang Chuanxin Tang Chong Luo Wenjun Zeng Zhengjun Zha 83 69 0 30 Aug 2021
DKM: Differentiable K-Means Clustering Layer for Neural Network Compression Minsik Cho Keivan Alizadeh Vahid Saurabh N. Adya Mohammad Rastegari 105 34 0 28 Aug 2021
RaftMLP: How Much Can Be Done Without Attention and with Less Spatial Locality? Yuki Tatsunami Masato Taki 93 12 0 09 Aug 2021
Greedy Network Enlarging Chuanjian Liu Kai Han An Xiao Yiping Deng Wei Zhang Chunjing Xu Yunhe Wang 49 3 0 31 Jul 2021
Automated Human Cell Classification in Sparse Datasets using Few-Shot Learning Reece Walsh Mohamed H. Abdelpakey M. Shehata Mostafa M. Mohamed 3DH 128 21 0 27 Jul 2021
Self-Correcting Neural Networks For Safe Classification Klas Leino Aymeric Fromherz Ravi Mangal Matt Fredrikson Bryan Parno C. Păsăreanu 72 6 0 23 Jul 2021
AS-MLP: An Axial Shifted MLP Architecture for Vision Dongze Lian Zehao Yu Xing Sun Shenghua Gao 133 192 0 18 Jul 2021
Recognizing bird species in diverse soundscapes under weak supervision Christof Henkel Pascal Pfeiffer Philipp Singer 51 14 0 16 Jul 2021
LANA: Latency Aware Network Acceleration Pavlo Molchanov Jimmy Hall Hongxu Yin Jan Kautz Nicolò Fusi Arash Vahdat 139 10 0 12 Jul 2021
ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generation Yu Sun Shuohuan Wang Shikun Feng Siyu Ding Chao Pang ... Ouyang Xuan Dianhai Yu Hao Tian Hua Wu Haifeng Wang 125 475 0 05 Jul 2021
Early Convolutions Help Transformers See Better Tete Xiao Mannat Singh Eric Mintun Trevor Darrell Piotr Dollár Ross B. Girshick 114 778 0 28 Jun 2021
ViTAS: Vision Transformer Architecture Search Xiu Su Shan You Jiyang Xie Mingkai Zheng Fei Wang Chao Qian Changshui Zhang Xiaogang Wang Chang Xu ViT 104 55 0 25 Jun 2021
VOLO: Vision Outlooker for Visual Recognition Li-xin Yuan Qibin Hou Zihang Jiang Jiashi Feng Shuicheng Yan ViT 141 328 0 24 Jun 2021
Should You Go Deeper? Optimizing Convolutional Neural Network Architectures without Training by Receptive Field Analysis Mats L. Richter Julius Schöning Anna Wiedenroth U. Krumnack 41 16 0 23 Jun 2021
Solution for Large-scale Long-tailed Recognition with Noisy Labels Yuqiao Xian Jiafan Zhuang Fufu Yu 29 1 0 20 Jun 2021
Teacher's pet: understanding and mitigating biases in distillation Michal Lukasik Srinadh Bhojanapalli A. Menon Sanjiv Kumar 80 25 0 19 Jun 2021
How to train your ViT? Data, Augmentation, and Regularization in Vision Transformers Andreas Steiner Alexander Kolesnikov Xiaohua Zhai Ross Wightman Jakob Uszkoreit Lucas Beyer ViT 176 639 0 18 Jun 2021
Evaluating the Robustness of Trigger Set-Based Watermarks Embedded in Deep Neural Networks Suyoung Lee Wonho Song Suman Jana M. Cha Sooel Son AAML 93 15 0 18 Jun 2021
Feature and Parameter Selection in Stochastic Linear Bandits Ahmadreza Moradipari Berkay Turan Yasin Abbasi-Yadkori M. Alizadeh Mohammad Ghavamzadeh 166 5 0 09 Jun 2021
CoAtNet: Marrying Convolution and Attention for All Data Sizes Zihang Dai Hanxiao Liu Quoc V. Le Mingxing Tan ViT 157 1,223 0 09 Jun 2021
Scaling Vision Transformers Xiaohua Zhai Alexander Kolesnikov N. Houlsby Lucas Beyer ViT 181 1,099 0 08 Jun 2021
On the Connection between Local Attention and Dynamic Depth-wise Convolution Qi Han Zejia Fan Qi Dai Lei-huan Sun Ming-Ming Cheng Jiaying Liu Jingdong Wang ViT 136 112 0 08 Jun 2021