v1v2v3v4 (latest)

Net2Net: Accelerating Learning via Knowledge Transfer

18 November 2015

Papers citing "Net2Net: Accelerating Learning via Knowledge Transfer"

50 / 343 papers shown

Title
3DG-STFM: 3D Geometric Guided Student-Teacher Feature Matching Runyu Mao Chen Bai Yatong An Fengqing Zhu Cheng Lu 3DV 3DH 67 20 0 06 Jul 2022
Anomaly Detection and Inter-Sensor Transfer Learning on Smart Manufacturing Datasets Mustafa Abdallah B. Joung Wo Jae Lee C. Mousoulis J. Sutherland S. Bagchi 42 22 0 13 Jun 2022
Reincarnating Reinforcement Learning: Reusing Prior Computation to Accelerate Progress Rishabh Agarwal Max Schwarzer Pablo Samuel Castro Rameswar Panda Marc G. Bellemare OffRL OnRL 126 66 0 03 Jun 2022
A Survey on Computationally Efficient Neural Architecture Search Shiqing Liu Haoyu Zhang Yaochu Jin 100 44 0 03 Jun 2022
An Evolutionary Approach to Dynamic Introduction of Tasks in Large-scale Multitask Learning Systems Andrea Gesmundo J. Dean 167 24 0 25 May 2022
A Comprehensive Survey on Model Quantization for Deep Neural Networks in Image Classification Babak Rokh A. Azarpeyvand Alireza Khanteymoori MQ 127 103 0 14 May 2022
Online Deep Learning from Doubly-Streaming Data H. Lian John Scovil Atwood Bo-Jian Hou Jian Wu Yi He 55 11 0 25 Apr 2022
Does Interference Exist When Training a Once-For-All Network? Jordan Shipard Arnold Wiliem Clinton Fookes 36 0 0 20 Apr 2022
Efficient Architecture Search for Diverse Tasks Jun Shen M. Khodak Ameet Talwalkar 64 32 0 15 Apr 2022
Automated Progressive Learning for Efficient Training of Vision Transformers Changlin Li Bohan Zhuang Guangrun Wang Xiaodan Liang Xiaojun Chang Yi Yang 106 46 0 28 Mar 2022
Staged Training for Transformer Language Models Sheng Shen Pete Walsh Kurt Keutzer Jesse Dodge Matthew E. Peters Iz Beltagy 68 37 0 11 Mar 2022
Lifelong Adaptive Machine Learning for Sensor-based Human Activity Recognition Using Prototypical Networks Rebecca Adaimi Edison Thomaz CLL 59 15 0 11 Mar 2022
Update Compression for Deep Neural Networks on the Edge Bo Chen A. Bakhshi Gustavo E. A. P. A. Batista Brian Ng Tat-Jun Chin 55 18 0 09 Mar 2022
Consistent Representation Learning for Continual Relation Extraction Kang Zhao Hua Xu Jian Yang Kai Gao CLL 78 57 0 05 Mar 2022
Continual Few-shot Relation Learning via Embedding Space Regularization and Data Augmentation Chengwei Qin Shafiq Joty BDL CLL 76 38 0 04 Mar 2022
DC and SA: Robust and Efficient Hyperparameter Optimization of Multi-subnetwork Deep Learning Models A. Treacher A. Montillo 44 0 0 24 Feb 2022
General Cyclical Training of Neural Networks L. Smith 90 6 0 17 Feb 2022
When, where, and how to add new neurons to ANNs Kaitlin Maile Emmanuel Rachelson H. Luga Dennis G. Wilson 70 16 0 17 Feb 2022
Not All Patches are What You Need: Expediting Vision Transformers via Token Reorganizations Youwei Liang Chongjian Ge Zhan Tong Yibing Song Jue Wang P. Xie ViT 81 255 0 16 Feb 2022
An Automated Question-Answering Framework Based on Evolution Algorithm Sinan Tan Hui Xue Qiyu Ren Huaping Liu Jing Bai 47 0 0 26 Jan 2022
Bilevel Online Deep Learning in Non-stationary Environment Ya-nan Han Jian Liu Bing-biao Xiao Xin-Tan Wang Xiong-lin Luo 126 3 0 25 Jan 2022
Growing Neural Network with Shared Parameter Ruilin Tong FedML 24 0 0 17 Jan 2022
GradMax: Growing Neural Networks using Gradient Information Utku Evci B. V. Merrienboer Thomas Unterthiner Max Vladymyrov Fabian Pedregosa 85 57 0 13 Jan 2022
Automated Deep Learning: Neural Architecture Search Is Not the End Xuanyi Dong D. Kedziora Katarzyna Musial Bogdan Gabrys 126 27 0 16 Dec 2021
CoMPS: Continual Meta Policy Search Glen Berseth Zhiwei Zhang Grace Zhang Chelsea Finn Sergey Levine CLL OffRL 94 15 0 08 Dec 2021
Manas: Mining Software Repositories to Assist AutoML Giang Nguyen Johir Islam Rangeet Pan Hridesh Rajan 63 15 0 06 Dec 2021
Stacked BNAS: Rethinking Broad Convolutional Neural Network for Neural Architecture Search Zixiang Ding Yaran Chen Nannan Li Dong Zhao C. L. Philip Chen 51 9 0 15 Nov 2021
On Transferability of Prompt Tuning for Natural Language Processing Yusheng Su Xiaozhi Wang Yujia Qin Chi-Min Chan Yankai Lin ... Peng Li Juanzi Li Lei Hou Maosong Sun Jie Zhou AAML VLM 83 106 0 12 Nov 2021
On Cross-Layer Alignment for Model Fusion of Heterogeneous Neural Networks Dang Nguyen T. Nguyen Khai Nguyen D.Q. Phung Hung Bui Nhat Ho MoMe 59 11 0 29 Oct 2021
LFPT5: A Unified Framework for Lifelong Few-shot Language Learning Based on Prompt Tuning of T5 Chengwei Qin Shafiq Joty CLL 216 104 0 14 Oct 2021
bert2BERT: Towards Reusable Pretrained Language Models Cheng Chen Yichun Yin Lifeng Shang Xin Jiang Yujia Qin Fengyu Wang Zhi Wang Xiao Chen Zhiyuan Liu Qun Liu VLM 85 64 0 14 Oct 2021
CONetV2: Efficient Auto-Channel Size Optimization for CNNs Yi Ru Wang Samir Khaki Weihang Zheng Mahdi S. Hosseini Konstantinos N. Plataniotis 107 6 0 13 Oct 2021
Speeding up Deep Model Training by Sharing Weights and Then Unsharing Shuo Yang Le Hou Xiaodan Song Qiang Liu Denny Zhou 150 9 0 08 Oct 2021
PINNup: Robust neural network wavefield solutions using frequency upscaling and neuron splitting Xinquan Huang T. Alkhalifah 86 47 0 29 Sep 2021
DynG2G: An Efficient Stochastic Graph Embedding Method for Temporal Graphs Mengjia Xu Apoorva Vikram Singh George Karniadakis AI4CE 102 9 0 28 Sep 2021
Knowledge Transfer based Evolutionary Deep Neural Network for Intelligent Fault Diagnosis Arun K. Sharma N. Verma 117 2 0 28 Sep 2021
Recent Advances of Continual Learning in Computer Vision: An Overview Haoxuan Qu Hossein Rahmani Li Xu Bryan M. Williams Jun Liu VLM CLL 136 78 0 23 Sep 2021
A Studious Approach to Semi-Supervised Learning Sahil Khose Shruti Jain V. Manushree 30 0 0 18 Sep 2021
Greedy Network Enlarging Chuanjian Liu Kai Han An Xiao Yiping Deng Wei Zhang Chunjing Xu Yunhe Wang 47 3 0 31 Jul 2021
Training multi-objective/multi-task collocation physics-informed neural network with student/teachers transfer learnings B. Bahmani WaiChing Sun PINN AI4CE 98 18 0 24 Jul 2021
DeepScale: Online Frame Size Adaptation for Multi-object Tracking on Smart Cameras and Edge Servers Keivan Nalaie Renjie Xu Rong Zheng VOT 66 9 0 22 Jul 2021
NeurObfuscator: A Full-stack Obfuscation Tool to Mitigate Neural Architecture Stealing Jingtao Li Zhezhi He Adnan Siraj Rakin Deliang Fan C. Chakrabarti 60 26 0 20 Jul 2021
Joint Matrix Decomposition for Deep Convolutional Neural Networks Compression Shaowu Chen Jihao Zhou Weize Sun Lei Huang 45 21 0 09 Jul 2021
Distributed Deep Learning in Open Collaborations Michael Diskin Alexey Bukhtiyarov Max Ryabinin Lucile Saulnier Quentin Lhoest ... Denis Mazur Ilia Kobelev Yacine Jernite Thomas Wolf Gennady Pekhimenko FedML 131 59 0 18 Jun 2021
Redefining Neural Architecture Search of Heterogeneous Multi-Network Models by Characterizing Variation Operators and Model Components Unai Garciarena Roberto Santana A. Mendiburu 41 3 0 16 Jun 2021
Input Invex Neural Network Suman Sapkota Binod Bhattarai 50 4 0 16 Jun 2021
Differentiable Neural Architecture Search with Morphism-based Transformable Backbone Architectures Renlong Jie Junbin Gao 47 0 0 14 Jun 2021
Energy-efficient Knowledge Distillation for Spiking Neural Networks Dongjin Lee Seongsik Park Jongwan Kim Wuhyeong Doh Sungroh Yoon 54 12 0 14 Jun 2021
Bag of Baselines for Multi-objective Joint Neural Architecture Search and Hyperparameter Optimization Julia Guerrero-Viu Sven Hauns Sergio Izquierdo Guilherme Miotto Simon Schrodi André Biedenkapp T. Elsken Difan Deng Marius Lindauer Frank Hutter AI4CE 81 27 0 03 May 2021
Continual Learning in Sensor-based Human Activity Recognition: an Empirical Benchmark Analysis Saurav Jha Martin Schiemer F. Zambonelli Juan Ye 60 51 0 19 Apr 2021