ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 1511.05641
  4. Cited By
Net2Net: Accelerating Learning via Knowledge Transfer
v1v2v3v4 (latest)

Net2Net: Accelerating Learning via Knowledge Transfer

18 November 2015
Tianqi Chen
Ian Goodfellow
Jonathon Shlens
ArXiv (abs)PDFHTML

Papers citing "Net2Net: Accelerating Learning via Knowledge Transfer"

50 / 343 papers shown
Title
Fast Neural Network Adaptation via Parameter Remapping and Architecture
  Search
Fast Neural Network Adaptation via Parameter Remapping and Architecture Search
Jiemin Fang
Yuzhu Sun
Kangjian Peng
Qian Zhang
Yuan Li
Wenyu Liu
Xinggang Wang
SSeg
55
34
0
08 Jan 2020
NAS-Bench-201: Extending the Scope of Reproducible Neural Architecture
  Search
NAS-Bench-201: Extending the Scope of Reproducible Neural Architecture Search
Xuanyi Dong
Yi Yang
152
718
0
02 Jan 2020
Dreaming to Distill: Data-free Knowledge Transfer via DeepInversion
Dreaming to Distill: Data-free Knowledge Transfer via DeepInversion
Hongxu Yin
Pavlo Molchanov
Zhizhong Li
J. Álvarez
Arun Mallya
Derek Hoiem
N. Jha
Jan Kautz
150
570
0
18 Dec 2019
Neural Network Surgery with Sets
Neural Network Surgery with Sets
Jonathan Raiman
Susan Zhang
Christy Dennison
58
4
0
13 Dec 2019
Dota 2 with Large Scale Deep Reinforcement Learning
Dota 2 with Large Scale Deep Reinforcement Learning
OpenAI OpenAI
:
Christopher Berner
Greg Brockman
Brooke Chan
...
Szymon Sidor
Ilya Sutskever
Jie Tang
Filip Wolski
Susan Zhang
GNNVLMCLLAI4CELRM
181
1,840
0
13 Dec 2019
An Improving Framework of regularization for Network Compression
An Improving Framework of regularization for Network Compression
E. Zhenqian
Weiguo Gao
AI4CE
38
0
0
11 Dec 2019
Reducing Catastrophic Forgetting in Modular Neural Networks by Dynamic
  Information Balancing
Reducing Catastrophic Forgetting in Modular Neural Networks by Dynamic Information Balancing
Mohammed Amer
Tomás Maul
47
6
0
10 Dec 2019
Towards Oracle Knowledge Distillation with Neural Architecture Search
Towards Oracle Knowledge Distillation with Neural Architecture Search
Minsoo Kang
Jonghwan Mun
Bohyung Han
FedML
111
44
0
29 Nov 2019
A novel method for identifying the deep neural network model with the
  Serial Number
A novel method for identifying the deep neural network model with the Serial Number
Xiangrui Xu
Yaqin Li
Cao Yuan
AAML
41
8
0
19 Nov 2019
ImmuNeCS: Neural Committee Search by an Artificial Immune System
ImmuNeCS: Neural Committee Search by an Artificial Immune System
L. Frachon
Wei Pang
George Macleod Coghill
37
9
0
18 Nov 2019
Knowledge Representing: Efficient, Sparse Representation of Prior
  Knowledge for Knowledge Distillation
Knowledge Representing: Efficient, Sparse Representation of Prior Knowledge for Knowledge Distillation
Junjie Liu
Dongchao Wen
Hongxing Gao
Wei Tao
Tse-Wei Chen
Kinya Osa
Masami Kato
81
21
0
13 Nov 2019
Collaborative Distillation for Top-N Recommendation
Collaborative Distillation for Top-N Recommendation
Jae-woong Lee
Minjin Choi
Jongwuk Lee
Hyunjung Shim
76
51
0
13 Nov 2019
NAT: Neural Architecture Transformer for Accurate and Compact
  Architectures
NAT: Neural Architecture Transformer for Accurate and Compact Architectures
Yong Guo
Yin Zheng
Mingkui Tan
Qi Chen
Jian Chen
P. Zhao
Junzhou Huang
159
85
0
31 Oct 2019
Distilling Pixel-Wise Feature Similarities for Semantic Segmentation
Distilling Pixel-Wise Feature Similarities for Semantic Segmentation
Yuhu Shan
47
7
0
31 Oct 2019
MOD: A Deep Mixture Model with Online Knowledge Distillation for Large
  Scale Video Temporal Concept Localization
MOD: A Deep Mixture Model with Online Knowledge Distillation for Large Scale Video Temporal Concept Localization
Rongcheng Lin
Jing Xiao
Jianping Fan
21
4
0
27 Oct 2019
How can AI Automate End-to-End Data Science?
How can AI Automate End-to-End Data Science?
Charu C. Aggarwal
Djallel Bouneffouf
Horst Samulowitz
Beat Buesser
T. Hoang
...
Tejaswini Pedapati
Parikshit Ram
Ambrish Rawat
Martin Wistuba
Alexander G. Gray
170
14
0
22 Oct 2019
Training CNNs faster with Dynamic Input and Kernel Downsampling
Training CNNs faster with Dynamic Input and Kernel Downsampling
Zissis Poulos
A. Nouri
Andreas Moshovos
28
0
0
15 Oct 2019
Splitting Steepest Descent for Growing Neural Architectures
Splitting Steepest Descent for Growing Neural Architectures
Qiang Liu
Lemeng Wu
Dilin Wang
113
63
0
06 Oct 2019
AntMan: Sparse Low-Rank Compression to Accelerate RNN inference
AntMan: Sparse Low-Rank Compression to Accelerate RNN inference
Samyam Rajbhandari
H. Shrivastava
J. Rho
MQ
57
8
0
02 Oct 2019
Automated design of error-resilient and hardware-efficient deep neural
  networks
Automated design of error-resilient and hardware-efficient deep neural networks
Christoph Schorn
T. Elsken
Sebastian Vogel
Armin Runge
A. Guntoro
G. Ascheid
AAML
47
32
0
30 Sep 2019
Blessing of dimensionality at the edge
Blessing of dimensionality at the edge
I. Tyukin
Alexander N. Gorban
A. McEwan
Sepehr Meshkinfamfard
Lixin Tang
52
8
0
30 Sep 2019
Neural Architecture Search for Class-incremental Learning
Neural Architecture Search for Class-incremental Learning
Shenyang Huang
Vincent François-Lavet
Guillaume Rabusseau
CLL
46
16
0
14 Sep 2019
Efficient Continual Learning in Neural Networks with Embedding
  Regularization
Efficient Continual Learning in Neural Networks with Embedding Regularization
Jary Pomponi
Simone Scardapane
Vincenzo Lomonaco
A. Uncini
CLL
87
42
0
09 Sep 2019
LAMOL: LAnguage MOdeling for Lifelong Language Learning
LAMOL: LAnguage MOdeling for Lifelong Language Learning
Fan-Keng Sun
Cheng-Hao Ho
Hung-yi Lee
CLLKELM
97
213
0
07 Sep 2019
Rethinking the Number of Channels for the Convolutional Neural Network
Rethinking the Number of Channels for the Convolutional Neural Network
Hui Zhu
Zhulin An
Chuanguang Yang
Xiaolong Hu
Kaiqiang Xu
Yongjun Xu
OOD
38
3
0
04 Sep 2019
Unsupervised Deep Feature Transfer for Low Resolution Image
  Classification
Unsupervised Deep Feature Transfer for Low Resolution Image Classification
Yuanwei Wu
Ziming Zhang
Guanghui Wang
71
22
0
27 Aug 2019
Patient Knowledge Distillation for BERT Model Compression
Patient Knowledge Distillation for BERT Model Compression
S. Sun
Yu Cheng
Zhe Gan
Jingjing Liu
151
843
0
25 Aug 2019
Adversarial-Based Knowledge Distillation for Multi-Model Ensemble and
  Noisy Data Refinement
Adversarial-Based Knowledge Distillation for Multi-Model Ensemble and Noisy Data Refinement
Zhiqiang Shen
Zhankui He
Wanyun Cui
Jiahui Yu
Yutong Zheng
Chenchen Zhu
Marios Savvides
AAML
36
5
0
22 Aug 2019
SCARLET-NAS: Bridging the Gap between Stability and Scalability in
  Weight-sharing Neural Architecture Search
SCARLET-NAS: Bridging the Gap between Stability and Scalability in Weight-sharing Neural Architecture Search
Xiangxiang Chu
Bo Zhang
Qingyuan Li
Ruijun Xu
Xudong Li
86
24
0
16 Aug 2019
Semi-Supervised Self-Growing Generative Adversarial Networks for Image
  Recognition
Semi-Supervised Self-Growing Generative Adversarial Networks for Image Recognition
Haoqian Wang
Zhiwei Xu
Jun Xu
Wangpeng An
Lei Zhang
Qionghai Dai
GAN
52
8
0
11 Aug 2019
AutoML: A Survey of the State-of-the-Art
AutoML: A Survey of the State-of-the-Art
Xin He
Kaiyong Zhao
Xiaowen Chu
194
1,480
0
02 Aug 2019
Techniques for Automated Machine Learning
Techniques for Automated Machine Learning
Yi-Wei Chen
Qingquan Song
Helen Zhou
67
50
0
21 Jul 2019
Exploiting Prunability for Person Re-Identification
Exploiting Prunability for Person Re-Identification
Hugo Masson
Amran Bhuiyan
Le Thanh Nguyen-Meidine
Mehrsan Javan
P. Siva
Ismail Ben Ayed
Eric Granger
67
9
0
04 Jul 2019
NetTailor: Tuning the Architecture, Not Just the Weights
NetTailor: Tuning the Architecture, Not Just the Weights
Pedro Morgado
Nuno Vasconcelos
MQ
56
29
0
29 Jun 2019
Prune and Replace NAS
Prune and Replace NAS
Kevin Laube
A. Zell
66
13
0
18 Jun 2019
Finding the Needle in the Haystack with Convolutions: on the benefits of
  architectural bias
Finding the Needle in the Haystack with Convolutions: on the benefits of architectural bias
Stéphane dÁscoli
Levent Sagun
Joan Bruna
Giulio Biroli
95
37
0
16 Jun 2019
AutoGrow: Automatic Layer Growing in Deep Convolutional Networks
AutoGrow: Automatic Layer Growing in Deep Convolutional Networks
W. Wen
Feng Yan
Yiran Chen
H. Li
83
40
0
07 Jun 2019
OpenEI: An Open Framework for Edge Intelligence
OpenEI: An Open Framework for Edge Intelligence
Xingzhou Zhang
Yifan Wang
Sidi Lu
Liangkai Liu
Lanyu Xu
Weisong Shi
82
101
0
05 Jun 2019
Deep Face Recognition Model Compression via Knowledge Transfer and
  Distillation
Deep Face Recognition Model Compression via Knowledge Transfer and Distillation
J. Karlekar
Jiashi Feng
Zi Sian Wong
Sugiri Pranata
CVBM
43
13
0
03 Jun 2019
Representation Learning for Dynamic Graphs: A Survey
Representation Learning for Dynamic Graphs: A Survey
Seyed Mehran Kazemi
Rishab Goel
Kshitij Jain
I. Kobyzev
Akshay Sethi
Peter Forsyth
Pascal Poupart
AI4TSAI4CEGNN
105
464
0
27 May 2019
Incremental Learning Using a Grow-and-Prune Paradigm with Efficient
  Neural Networks
Incremental Learning Using a Grow-and-Prune Paradigm with Efficient Neural Networks
Xiaoliang Dai
Hongxu Yin
N. Jha
88
32
0
27 May 2019
Network Pruning via Transformable Architecture Search
Network Pruning via Transformable Architecture Search
Xuanyi Dong
Yi Yang
3DPC
81
243
0
23 May 2019
EENA: Efficient Evolution of Neural Architecture
EENA: Efficient Evolution of Neural Architecture
Hui Zhu
Zhulin An
Chuanguang Yang
Kaiqiang Xu
Erhu Zhao
Yongjun Xu
3DV
101
39
0
10 May 2019
A Survey on Neural Architecture Search
A Survey on Neural Architecture Search
Martin Wistuba
Ambrish Rawat
Tejaswini Pedapati
AI4CE
103
259
0
04 May 2019
Improving Multi-Task Deep Neural Networks via Knowledge Distillation for
  Natural Language Understanding
Improving Multi-Task Deep Neural Networks via Knowledge Distillation for Natural Language Understanding
Xiaodong Liu
Pengcheng He
Weizhu Chen
Jianfeng Gao
FedML
92
183
0
20 Apr 2019
Language Models with Transformers
Language Models with Transformers
Chenguang Wang
Mu Li
Alex Smola
100
122
0
20 Apr 2019
Intra-Ensemble in Neural Networks
Intra-Ensemble in Neural Networks
Yuan Gao
Zixiang Cai
Chen Sun
FedMLUQCV
47
5
0
09 Apr 2019
AlphaX: eXploring Neural Architectures with Deep Neural Networks and
  Monte Carlo Tree Search
AlphaX: eXploring Neural Architectures with Deep Neural Networks and Monte Carlo Tree Search
Linnan Wang
Yiyang Zhao
Yuu Jinnai
Yuandong Tian
Rodrigo Fonseca
BDL
89
96
0
26 Mar 2019
Regularize, Expand and Compress: Multi-task based Lifelong Learning via
  NonExpansive AutoML
Regularize, Expand and Compress: Multi-task based Lifelong Learning via NonExpansive AutoML
Jie Zhang
Junting Zhang
Shalini Ghosh
Dawei Li
Jingwen Zhu
Heming Zhang
Yalin Wang
CLL
27
2
0
20 Mar 2019
Universally Slimmable Networks and Improved Training Techniques
Universally Slimmable Networks and Improved Training Techniques
Jiahui Yu
Thomas Huang
99
389
0
12 Mar 2019
Previous
1234567
Next