Stimulative Training of Residual Networks: A Social Psychology Perspective of Loafing

9 October 2022

Peng Ye

Shengji Tang

Baopu Li

Tao Chen

Wanli Ouyang

ArXiv (abs)PDF HTML Github (11★)

Papers citing "Stimulative Training of Residual Networks: A Social Psychology Perspective of Loafing"

26 / 26 papers shown

Title
Efficient Joint-Dimensional Search with Solution Space Regularization for Real-Time Semantic Segmentation Peng Ye Baopu Li Tao Chen Jiayuan Fan Zhen Mei Chen-Fu Lin Chongyan Zuo Qinghua Chi Wanli Ouyan 3DV 66 12 0 10 Aug 2022
$β$ -DARTS: Beta-Decay Regularization for Differentiable Architecture Search Peng Ye Baopu Li Yikang Li Tao Chen Jiayuan Fan Wanli Ouyang 59 104 0 03 Mar 2022
BN-NAS: Neural Architecture Search with Batch Normalization Boyu Chen Peixia Li Baopu Li Chen Lin Chuming Li Ming Sun Junjie Yan Wanli Ouyang 73 31 0 16 Aug 2021
CompOFA: Compound Once-For-All Networks for Faster Multi-Platform Deployment Manas Sahni S. Varshini Alind Khare Alexey Tumanov 38 33 0 26 Apr 2021
BigNAS: Scaling Up Neural Architecture Search with Big Single-Stage Models Jiahui Yu Pengchong Jin Hanxiao Liu Gabriel Bender Pieter-Jan Kindermans Mingxing Tan Thomas Huang Xiaodan Song Ruoming Pang Quoc V. Le 86 304 0 24 Mar 2020
Improving One-shot NAS by Suppressing the Posterior Fading Xiang Li Chen Lin Chuming Li Ming Sun Wei Wu Junjie Yan Wanli Ouyang 54 78 0 06 Oct 2019
Once-for-All: Train One Network and Specialize it for Efficient Deployment Han Cai Chuang Gan Tianzhe Wang Zhekai Zhang Song Han OOD 113 1,283 0 26 Aug 2019
Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillation Linfeng Zhang Jiebo Song Anni Gao Jingwei Chen Chenglong Bao Kaisheng Ma FedML 76 865 0 17 May 2019
Searching for MobileNetV3 Andrew G. Howard Mark Sandler Grace Chu Liang-Chieh Chen Bo Chen ... Yukun Zhu Ruoming Pang Vijay Vasudevan Quoc V. Le Hartwig Adam 359 6,804 0 06 May 2019
Universally Slimmable Networks and Improved Training Techniques Jiahui Yu Thomas Huang 76 386 0 12 Mar 2019
Improved Knowledge Distillation via Teacher Assistant Seyed Iman Mirzadeh Mehrdad Farajtabar Ang Li Nir Levine Akihiro Matsukawa H. Ghasemzadeh 100 1,081 0 09 Feb 2019
Knowledge Transfer via Distillation of Activation Boundaries Formed by Hidden Neurons Byeongho Heo Minsik Lee Sangdoo Yun J. Choi 55 527 0 08 Nov 2018
DropBlock: A regularization method for convolutional networks Golnaz Ghiasi Nayeon Lee Quoc V. Le 115 914 0 30 Oct 2018
Neural Ordinary Differential Equations T. Chen Yulia Rubanova J. Bettencourt David Duvenaud AI4CE 437 5,157 0 19 Jun 2018
Polynomial Regression As an Alternative to Neural Nets Xi Cheng B. Khomtchouk N. Matloff Pete Mohanty 34 82 0 13 Jun 2018
PAD-Net: Multi-Tasks Guided Prediction-and-Distillation Network for Simultaneous Depth Estimation and Scene Parsing Dan Xu Wanli Ouyang Xiaogang Wang N. Sebe MoE 59 479 0 11 May 2018
Paraphrasing Complex Network: Network Compression via Factor Transfer Jangho Kim Seonguk Park Nojun Kwak 77 551 0 14 Feb 2018
Deep Mutual Learning Ying Zhang Tao Xiang Timothy M. Hospedales Huchuan Lu FedML 153 1,654 0 01 Jun 2017
The Shattered Gradients Problem: If resnets are the answer, then what is the question? David Balduzzi Marcus Frean Lennox Leary J. P. Lewis Kurt Wan-Duo Ma Brian McWilliams ODL 73 406 0 28 Feb 2017
Densely Connected Convolutional Networks Gao Huang Zhuang Liu Laurens van der Maaten Kilian Q. Weinberger PINN 3DV 796 36,881 0 25 Aug 2016
Deep Networks with Stochastic Depth Gao Huang Yu Sun Zhuang Liu Daniel Sedra Kilian Q. Weinberger 215 2,362 0 30 Mar 2016
Identity Mappings in Deep Residual Networks Kaiming He Xinming Zhang Shaoqing Ren Jian Sun 354 10,196 0 16 Mar 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.2K 194,426 0 10 Dec 2015
Distilling the Knowledge in a Neural Network Geoffrey E. Hinton Oriol Vinyals J. Dean FedML 367 19,733 0 09 Mar 2015
FitNets: Hints for Thin Deep Nets Adriana Romero Nicolas Ballas Samira Ebrahimi Kahou Antoine Chassang C. Gatta Yoshua Bengio FedML 319 3,899 0 19 Dec 2014
Going Deeper with Convolutions Christian Szegedy Wei Liu Yangqing Jia P. Sermanet Scott E. Reed Dragomir Anguelov D. Erhan Vincent Vanhoucke Andrew Rabinovich 491 43,698 0 17 Sep 2014