Title
RobustART: Benchmarking Robustness on Architecture Design and Training Techniques Shiyu Tang Ruihao Gong Yan Wang Aishan Liu Jiakai Wang ... Xianglong Liu Basel Alomair Alan Yuille Philip Torr Dacheng Tao VLM AAML 88 108 0 11 Sep 2021
ConvMLP: Hierarchical Convolutional MLPs for Vision Jiachen Li Ali Hassani Steven Walton Humphrey Shi 77 68 0 09 Sep 2021
Axial multi-layer perceptron architecture for automatic segmentation of choroid plexus in multiple sclerosis Marius Schmidt-Mengin Vito A G Ricigliano B. Bodini E. Morena A. Colombi Mariem Hamzaoui Arya Yazdan Panah B. Stankoff O. Colliot 33 15 0 08 Sep 2021
Cross-token Modeling with Conditional Computation Yuxuan Lou Fuzhao Xue Zangwei Zheng Yang You MoE 70 21 0 05 Sep 2021
CrypTen: Secure Multi-Party Computation Meets Machine Learning Brian Knott Shobha Venkataraman Awni Y. Hannun Shubho Sengupta Mark Ibrahim Laurens van der Maaten 110 364 0 02 Sep 2021
SANSformers: Self-Supervised Forecasting in Electronic Health Records with Attention-Free Models Yogesh Kumar Alexander Ilin H. Salo S. Kulathinal M. Leinonen Pekka Marttinen AI4TS MedIm 30 0 0 31 Aug 2021
Hire-MLP: Vision MLP via Hierarchical Rearrangement Jianyuan Guo Yehui Tang Kai Han Xinghao Chen Han Wu Chao Xu Chang Xu Yunhe Wang 79 105 0 30 Aug 2021
A Battle of Network Structures: An Empirical Study of CNN, Transformer, and MLP Yucheng Zhao Guangting Wang Chuanxin Tang Chong Luo Wenjun Zeng Zhengjun Zha 77 69 0 30 Aug 2021
SERF: Towards better training of deep neural networks using log-Softplus ERror activation Function Sayan Nag Mayukh Bhattacharyya LLMSV 41 22 0 21 Aug 2021
PatchCleanser: Certifiably Robust Defense against Adversarial Patches for Any Image Classifier Chong Xiang Saeed Mahloujifar Prateek Mittal VLM AAML 93 77 0 20 Aug 2021
Do Vision Transformers See Like Convolutional Neural Networks? M. Raghu Thomas Unterthiner Simon Kornblith Chiyuan Zhang Alexey Dosovitskiy ViT 143 966 0 19 Aug 2021
Modulating Language Models with Emotions Ruibo Liu Jason W. Wei Chenyan Jia Soroush Vosoughi 57 22 0 17 Aug 2021
MOI-Mixer: Improving MLP-Mixer with Multi Order Interactions in Sequential Recommendation Hojoon Lee Dongyoon Hwang Sunghwan Hong Changyeon Kim Seungryong Kim Jaegul Choo 90 11 0 17 Aug 2021
3D High-Fidelity Mask Face Presentation Attack Detection Challenge Ajian Liu Chenxu Zhao Zitong Yu Anyang Su Xing Liu ... Jun Wan Sergio Escalera Hugo Jair Escalante Zhen Lei G. Guo CVBM 83 34 0 16 Aug 2021
Mobile-Former: Bridging MobileNet and Transformer Yinpeng Chen Xiyang Dai Dongdong Chen Mengchen Liu Xiaoyi Dong Lu Yuan Zicheng Liu ViT 268 493 0 12 Aug 2021
RaftMLP: How Much Can Be Done Without Attention and with Less Spatial Locality? Yuki Tatsunami Masato Taki 84 12 0 09 Aug 2021
Understanding the computational demands underlying visual reasoning Mohit Vaishnav Rémi Cadène A. Alamia Drew Linsley Rufin VanRullen Thomas Serre GNN CoGe 77 17 0 08 Aug 2021
Large-Scale Differentially Private BERT Rohan Anil Badih Ghazi Vineet Gupta Ravi Kumar Pasin Manurangsi 90 138 0 03 Aug 2021
Evo-ViT: Slow-Fast Token Evolution for Dynamic Vision Transformer Yifan Xu Zhijie Zhang Mengdan Zhang Kekai Sheng Ke Li Weiming Dong Liqing Zhang Changsheng Xu Xing Sun ViT 94 215 0 03 Aug 2021
S $^2$ -MLPv2: Improved Spatial-Shift MLP Architecture for Vision Tan Yu Xu Li Yunfeng Cai Mingming Sun Ping Li 75 54 0 02 Aug 2021
Structure and Performance of Fully Connected Neural Networks: Emerging Complex Network Properties Leonardo F. S. Scabini Odemir M. Bruno GNN 38 57 0 29 Jul 2021
Experiments on Properties of Hidden Structures of Sparse Neural Networks Julian Stier Harsh Darji Michael Granitzer 35 2 0 27 Jul 2021
Pointer Value Retrieval: A new benchmark for understanding the limits of neural network generalization Chiyuan Zhang M. Raghu Jon M. Kleinberg Samy Bengio OOD 111 32 0 27 Jul 2021
CycleMLP: A MLP-like Architecture for Dense Prediction Shoufa Chen Enze Xie Chongjian Ge Runjian Chen Ding Liang Ping Luo 135 235 0 21 Jul 2021
Deep learning for temporal data representation in electronic health records: A systematic review of challenges and methodologies F. Xie Han Yuan Yilin Ning M. Ong Mengling Feng Wynne Hsu B. Chakraborty Nan Liu 97 89 0 21 Jul 2021
AS-MLP: An Axial Shifted MLP Architecture for Vision Dongze Lian Zehao Yu Xing Sun Shenghua Gao 122 192 0 18 Jul 2021
SA-GD: Improved Gradient Descent Learning Strategy with Simulated Annealing Zhicheng Cai 83 4 0 15 Jul 2021
Hierarchical Associative Memory Dmitry Krotov BDL 163 34 0 14 Jul 2021
The Brownian motion in the transformer model Yingshi Chen 111 1 0 12 Jul 2021
ViTGAN: Training GANs with Vision Transformers Kwonjoon Lee Huiwen Chang Lu Jiang Han Zhang Zhuowen Tu Ce Liu ViT 97 186 0 09 Jul 2021
Vision Xformers: Efficient Attention for Image Classification Pranav Jeevan Amit Sethi ViT 37 13 0 05 Jul 2021
What Makes for Hierarchical Vision Transformer? Yuxin Fang Xinggang Wang Rui Wu Wenyu Liu ViT 49 9 0 05 Jul 2021
Global Filter Networks for Image Classification Yongming Rao Wenliang Zhao Zheng Zhu Jiwen Lu Jie Zhou ViT 74 473 0 01 Jul 2021
ResViT: Residual vision transformers for multi-modal medical image synthesis Onat Dalmaz Mahmut Yurt Tolga Çukur ViT MedIm 101 352 0 30 Jun 2021
Multi-Exit Vision Transformer for Dynamic Inference Arian Bakhtiarnia Qi Zhang Alexandros Iosifidis 103 28 0 29 Jun 2021
Rethinking Token-Mixing MLP for MLP-based Vision Backbone Tan Yu Xu Li Yunfeng Cai Mingming Sun Ping Li 88 26 0 28 Jun 2021
Exploring Corruption Robustness: Inductive Biases in Vision Transformers and MLP-Mixers Katelyn Morrison B. Gilby Colton Lipchak Adam Mattioli Adriana Kovashka ViT 80 17 0 24 Jun 2021
Mix and Mask Actor-Critic Methods Dom Huh 29 1 0 24 Jun 2021
Co-advise: Cross Inductive Bias Distillation Sucheng Ren Zhengqi Gao Tianyu Hua Zihui Xue Yonglong Tian Shengfeng He Hang Zhao 91 52 0 23 Jun 2021
Vision Permutator: A Permutable MLP-Like Architecture for Visual Recognition Qibin Hou Zihang Jiang Li-xin Yuan Mingg-Ming Cheng Shuicheng Yan Jiashi Feng ViT MLLM 134 208 0 23 Jun 2021
Towards Biologically Plausible Convolutional Networks Roman Pogodin Yash Mehta Timothy Lillicrap P. Latham 109 22 0 22 Jun 2021
TokenLearner: What Can 8 Learned Tokens Do for Images and Videos? Michael S. Ryoo A. Piergiovanni Anurag Arnab Mostafa Dehghani A. Angelova ViT 137 129 0 21 Jun 2021
How to train your ViT? Data, Augmentation, and Regularization in Vision Transformers Andreas Steiner Alexander Kolesnikov Xiaohua Zhai Ross Wightman Jakob Uszkoreit Lucas Beyer ViT 131 638 0 18 Jun 2021
Efficient Self-supervised Vision Transformers for Representation Learning Chunyuan Li Jianwei Yang Pengchuan Zhang Mei Gao Bin Xiao Xiyang Dai Lu Yuan Jianfeng Gao ViT 108 214 0 17 Jun 2021
XCiT: Cross-Covariance Image Transformers Alaaeldin El-Nouby Hugo Touvron Mathilde Caron Piotr Bojanowski Matthijs Douze ... Ivan Laptev Natalia Neverova Gabriel Synnaeve Jakob Verbeek Hervé Jégou ViT 151 514 0 17 Jun 2021
Revisiting the Calibration of Modern Neural Networks Matthias Minderer Josip Djolonga Rob Romijnders F. Hubis Xiaohua Zhai N. Houlsby Dustin Tran Mario Lucic UQCV 110 367 0 15 Jun 2021
MLP Singer: Towards Rapid Parallel Korean Singing Voice Synthesis Jaesung Tae Hyeongju Kim Younggun Lee 57 14 0 15 Jun 2021
Improved Transformer for High-Resolution GANs Long Zhao Zizhao Zhang Ting Chen Dimitris N. Metaxas Han Zhang ViT 124 96 0 14 Jun 2021
S $^2$ -MLP: Spatial-Shift MLP Architecture for Vision Tan Yu Xu Li Yunfeng Cai Mingming Sun Ping Li 93 190 0 14 Jun 2021
Styleformer: Transformer based Generative Adversarial Networks with Style Vector Jeeseung Park Younggeun Kim ViT 117 49 0 13 Jun 2021