The Unreasonable Effectiveness of Fully-Connected Layers for Low-Data
Regimes

The Unreasonable Effectiveness of Fully-Connected Layers for Low-Data Regimes

11 October 2022

Peter Súkeník

Matthias Nießner

Laura Leal-Taixé

Papers citing "The Unreasonable Effectiveness of Fully-Connected Layers for Low-Data Regimes"

10 / 10 papers shown

Title
A BERT-Based Summarization approach for depression detection Hossein Salahshoor Gavalan Mohmmad Naim Rastgoo Bahareh Nakisa 33 1 0 13 Sep 2024
A Scalable Quantum Non-local Neural Network for Image Classification Sparsh Gupta Debanjan Konar Vaneet Aggarwal 30 0 0 26 Jul 2024
Setting the Record Straight on Transformer Oversmoothing G. Dovonon M. Bronstein Matt J. Kusner 28 5 0 09 Jan 2024
Learning to Skip for Language Modeling Dewen Zeng Nan Du Tao Wang Yuanzhong Xu Tao Lei Zhifeng Chen Claire Cui 25 11 0 26 Nov 2023
Patches Are All You Need? Asher Trockman J. Zico Kolter ViT 225 402 0 24 Jan 2022
MLP-Mixer: An all-MLP Architecture for Vision Ilya O. Tolstikhin N. Houlsby Alexander Kolesnikov Lucas Beyer Xiaohua Zhai ... Andreas Steiner Daniel Keysers Jakob Uszkoreit Mario Lucic Alexey Dosovitskiy 283 2,606 0 04 May 2021
Large scale distributed neural network training through online distillation Rohan Anil Gabriel Pereyra Alexandre Passos Róbert Ormándi George E. Dahl Geoffrey E. Hinton FedML 278 404 0 09 Apr 2018
Aggregated Residual Transformations for Deep Neural Networks Saining Xie Ross B. Girshick Piotr Dollár Zhuowen Tu Kaiming He 297 10,225 0 16 Nov 2016
Densely Connected Convolutional Networks Gao Huang Zhuang Liu L. V. D. van der Maaten Kilian Q. Weinberger PINN 3DV 315 36,381 0 25 Aug 2016
ImageNet Large Scale Visual Recognition Challenge Olga Russakovsky Jia Deng Hao Su J. Krause S. Satheesh ... A. Karpathy A. Khosla Michael S. Bernstein Alexander C. Berg Li Fei-Fei VLM ObjD 298 39,217 0 01 Sep 2014