Local Learning on Transformers via Feature Reconstruction

Local Learning on Transformers via Feature Reconstruction

29 December 2022

Dimitris Samaras

Papers citing "Local Learning on Transformers via Feature Reconstruction"

12 / 12 papers shown

Title
Gigapixel Whole-Slide Images Classification using Locally Supervised Learning Jingwei Zhang Xin Zhang Ke Ma Rajarsi R. Gupta Joel H. Saltz Maria Vakalopoulou Dimitris Samaras 65 24 0 17 Jul 2022
BackLink: Supervised Local Training with Backward Links Wenzhe Guo M. Fouda A. Eltawil K. Salama 31 2 0 14 May 2022
Efficient Attribute Unlearning: Towards Selective Removal of Input Attributes from Feature Representations Tao Guo Song Guo Jiewei Zhang Wenchao Xu Junxiao Wang MU 47 18 0 27 Feb 2022
Server-Side Local Gradient Averaging and Learning Rate Acceleration for Scalable Split Learning Shraman Pal Mansi Uniyal Jihong Park Praneeth Vepakomma Ramesh Raskar M. Bennis M. Jeon Jinho Choi FedML 64 30 0 11 Dec 2021
Swin Transformer V2: Scaling Up Capacity and Resolution Ze Liu Han Hu Yutong Lin Zhuliang Yao Zhenda Xie ... Yue Cao Zheng Zhang Li Dong Furu Wei B. Guo ViT 203 1,801 0 18 Nov 2021
Efficient Training of Visual Transformers with Small Datasets Yahui Liu E. Sangineto Wei Bi N. Sebe Bruno Lepri Marco De Nadai ViT 62 171 0 07 Jun 2021
CvT: Introducing Convolutions to Vision Transformers Haiping Wu Bin Xiao Noel Codella Mengchen Liu Xiyang Dai Lu Yuan Lei Zhang ViT 128 1,901 0 29 Mar 2021
Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutions Wenhai Wang Enze Xie Xiang Li Deng-Ping Fan Kaitao Song Ding Liang Tong Lu Ping Luo Ling Shao ViT 481 3,699 0 24 Feb 2021
Decoupled Greedy Learning of CNNs Eugene Belilovsky Michael Eickenberg Edouard Oyallon 46 116 0 23 Jan 2019
Training Neural Networks with Local Error Signals Arild Nøkland L. Eidnes 73 227 0 20 Jan 2019
Learning Deep ResNet Blocks Sequentially using Boosting Theory Furong Huang Jordan T. Ash John Langford Robert Schapire 58 111 0 15 Jun 2017
Decoupled Neural Interfaces using Synthetic Gradients Max Jaderberg Wojciech M. Czarnecki Simon Osindero Oriol Vinyals Alex Graves David Silver Koray Kavukcuoglu 75 356 0 18 Aug 2016