Neural Rejuvenation: Improving Deep Network Training by Enhancing
Computational Resource Utilization

Neural Rejuvenation: Improving Deep Network Training by Enhancing Computational Resource Utilization

2 December 2018

Siyuan Qiao

Papers citing "Neural Rejuvenation: Improving Deep Network Training by Enhancing Computational Resource Utilization"

12 / 12 papers shown

Title
Synaptic Stripping: How Pruning Can Bring Dead Neurons Back To Life Tim Whitaker L. D. Whitley CVBM 33 2 0 11 Feb 2023
Weight Evolution: Improving Deep Neural Networks Training through Evolving Inferior Weight Values Zhenquan Lin K. Guo Xiaofen Xing Xiangmin Xu ODL 24 1 0 09 Oct 2021
Training Deep Spiking Auto-encoders without Bursting or Dying Neurons through Regularization Justus F. Hübotter Pablo Lanillos Jakub M. Tomczak 18 3 0 22 Sep 2021
Piggyback GAN: Efficient Lifelong Learning for Image Conditioned Generation Mengyao Zhai Lei Chen Jiawei He Megha Nawhal Frederick Tung Greg Mori CLL 38 28 0 24 Apr 2021
Knowledge Evolution in Neural Networks Ahmed Taha Abhinav Shrivastava L. Davis 49 21 0 09 Mar 2021
Rethinking the Value of Transformer Components Wenxuan Wang Zhaopeng Tu 27 38 0 07 Nov 2020
SemifreddoNets: Partially Frozen Neural Networks for Efficient Computer Vision Systems Leo F. Isikdogan Bhavin V. Nayak Chyuan-Tyng Wu Joao Peralta Moreira R. Sushma G. Michael 23 7 0 12 Jun 2020
MMA Regularization: Decorrelating Weights of Neural Networks by Maximizing the Minimal Angles Zhennan Wang Canqun Xiang Wenbin Zou Chen Xu 17 19 0 06 Jun 2020
A Multigrid Method for Efficiently Training Video Models Chaoxia Wu Ross B. Girshick Kaiming He Christoph Feichtenhofer Philipp Krahenbuhl 32 94 0 02 Dec 2019
Differentiable Mask for Pruning Convolutional and Recurrent Networks R. Ramakrishnan Eyyub Sari V. Nia VLM 40 15 0 10 Sep 2019
Understanding the Effects of Pre-Training for Object Detectors via Eigenspectrum Yosuke Shinya E. Simo-Serra Taiji Suzuki 19 12 0 09 Sep 2019
Neural Architecture Search with Reinforcement Learning Barret Zoph Quoc V. Le 274 5,331 0 05 Nov 2016