v1v2v3v4 (latest)

Net2Net: Accelerating Learning via Knowledge Transfer

18 November 2015

Papers citing "Net2Net: Accelerating Learning via Knowledge Transfer"

50 / 343 papers shown

Title
Towards Self-Adaptive Metric Learning On the Fly Y. Gao Yifan Li Swarup Chandra Latifur Khan B. Thuraisingham 53 22 0 03 Apr 2021
The Elastic Lottery Ticket Hypothesis Xiaohan Chen Yu Cheng Shuohang Wang Zhe Gan Jingjing Liu Zhangyang Wang OOD 90 34 0 30 Mar 2021
Differentiable Network Adaption with Elastic Search Space Shaopeng Guo Yujie Wang Kun Yuan Quanquan Li 23 1 0 30 Mar 2021
Quick Learning Mechanism with Cross-Domain Adaptation for Intelligent Fault Diagnosis A. Sharma N. Verma OOD AI4CE 44 15 0 16 Mar 2021
Continual Learning for Recurrent Neural Networks: an Empirical Evaluation Andrea Cossu Antonio Carta Vincenzo Lomonaco D. Bacciu CLL 104 111 0 12 Mar 2021
Efficient Model Performance Estimation via Feature Histories Shengcao Cao Xiaofang Wang Kris Kitani 120 1 0 07 Mar 2021
Towards Accurate and Compact Architectures via Neural Architecture Transformer Yong Guo Yin Zheng Mingkui Tan Qi Chen Zhipeng Li Jian Chen P. Zhao Junzhou Huang ViT MQ 57 38 0 20 Feb 2021
Firefly Neural Architecture Descent: a General Approach for Growing Neural Networks Lemeng Wu Bo Liu Peter Stone Qiang Liu 107 55 0 17 Feb 2021
Anomaly Detection through Transfer Learning in Agriculture and Manufacturing IoT Systems Mustafa Abdallah Wo Jae Lee N. Raghunathan C. Mousoulis J. Sutherland S. Bagchi 335 15 0 11 Feb 2021
Online Continual Learning in Image Classification: An Empirical Survey Zheda Mai Ruiwen Li Jihwan Jeong David Quispe Hyunwoo J. Kim Scott Sanner VLM CLL 140 422 0 25 Jan 2021
Cross Chest Graph for Disease Diagnosis with Structural Relational Reasoning Gangming Zhao Ba Qi Jinpeng Li 42 7 0 22 Jan 2021
Beyond Fine-tuning: Classifying High Resolution Mammograms using Function-Preserving Transformations Tao Wei Angelica I Aviles-Rivero Shuo Wang Yuan Huang F. Gilbert Carola-Bibiane Schönlieb Chen Chen MedIm 55 18 0 20 Jan 2021
Transfer Learning Between Different Architectures Via Weights Injection Maciej A. Czyzewski 38 2 0 07 Jan 2021
Curriculum-Meta Learning for Order-Robust Continual Relation Extraction Tongtong Wu Xuekai Li Yuan-Fang Li Reza Haffari Guilin Qi Yujin Zhu Guoqiang Xu CLL 126 70 0 06 Jan 2021
Practical Blind Membership Inference Attack via Differential Comparisons Bo Hui Yuchen Yang Haolin Yuan Philippe Burlina Neil Zhenqiang Gong Yinzhi Cao MIACV 194 124 0 05 Jan 2021
BinaryBERT: Pushing the Limit of BERT Quantization Haoli Bai Wei Zhang Lu Hou Lifeng Shang Jing Jin Xin Jiang Qun Liu Michael Lyu Irwin King MQ 230 227 0 31 Dec 2020
StackRec: Efficient Training of Very Deep Sequential Recommender Models by Iterative Stacking Jiachun Wang Fajie Yuan Jian Chen Qingyao Wu Min Yang Yang Sun Guoxiao Zhang BDL 99 26 0 14 Dec 2020
LRC-BERT: Latent-representation Contrastive Knowledge Distillation for Natural Language Understanding Hao Fu Shaojun Zhou Qihong Yang Junjie Tang Guiquan Liu Kaikui Liu Xiaolong Li 119 60 0 14 Dec 2020
Overcoming Catastrophic Forgetting in Graph Neural Networks Huihui Liu Yiding Yang Xinchao Wang 229 120 0 10 Dec 2020
Class-incremental learning: survey and performance evaluation on image classification Marc Masana Xialei Liu Bartlomiej Twardowski Mikel Menta Andrew D. Bagdanov Joost van de Weijer CLL 85 701 0 28 Oct 2020
Hyperparameter Transfer Across Developer Adjustments Daniel Stoll Jörg Franke Diane Wagner Simon Selg Frank Hutter 87 12 0 25 Oct 2020
On the Transformer Growth for Progressive BERT Training Xiaotao Gu Liyuan Liu Hongkun Yu Jing Li Chong Chen Jiawei Han VLM 122 54 0 23 Oct 2020
Refining Semantic Segmentation with Superpixel by Transparent Initialization and Sparse Encoder Zhiwei Xu Thalaiyasingam Ajanthan Leonid Sigal 65 1 0 09 Oct 2020
Learning Realistic Patterns from Unrealistic Stimuli: Generalization and Data Anonymization K. Nikolaidis Stein Kristiansen T. Plagemann V. Goebel Knut Liestøl ... G. Traaen Britt Overland Harriet Akre L. Aakerøy S. Steinshamn 25 4 0 21 Sep 2020
Meta-Learning with Sparse Experience Replay for Lifelong Language Learning Nithin Holla Pushkar Mishra H. Yannakoudakis Ekaterina Shutova KELM CLL 81 22 0 10 Sep 2020
A Wholistic View of Continual Learning with Deep Neural Networks: Forgotten Lessons and the Bridge to Active and Open World Learning Martin Mundt Yongjun Hong Iuliia Pliushch Visvanathan Ramesh CLL 144 153 0 03 Sep 2020
NATS-Bench: Benchmarking NAS Algorithms for Architecture Topology and Size Xuanyi Dong Lu Liu Katarzyna Musial Bogdan Gabrys 101 165 0 28 Aug 2020
Knowledge Transfer via Dense Cross-Layer Mutual-Distillation Anbang Yao Dawei Sun 62 55 0 18 Aug 2020
AIPerf: Automated machine learning as an AI-HPC benchmark Zhixiang Ren Yongheng Liu Tianhui Shi Lei Xie Yue Zhou Jidong Zhai Youhui Zhang Yunquan Zhang Wenguang Chen 69 23 0 17 Aug 2020
Weight-Sharing Neural Architecture Search: A Battle to Shrink the Optimization Gap Lingxi Xie Xin Chen Kaifeng Bi Longhui Wei Yuhui Xu ... Lanfei Wang Anxiang Xiao Jianlong Chang Xiaopeng Zhang Qi Tian ViT 101 111 0 04 Aug 2020
Multiple Expert Brainstorming for Domain Adaptive Person Re-identification Yunpeng Zhai QiXiang Ye Shijian Lu Mengxi Jia Rongrong Ji Yonghong Tian 70 164 0 03 Jul 2020
Dynamic Sampling Networks for Efficient Action Recognition in Videos Yin-Dong Zheng Zhaoyang Liu Tong Lu Limin Wang 77 77 0 28 Jun 2020
Post-hoc Calibration of Neural Networks by g-Layers Amir M. Rahimi Thomas Mensink Kartik Gupta Thalaiyasingam Ajanthan C. Sminchisescu Leonid Sigal 64 6 0 23 Jun 2020
Continual Learning in Recurrent Neural Networks Benjamin Ehret Christian Henning Maria R. Cervera Alexander Meulemans J. Oswald Benjamin Grewe CLL 83 9 0 22 Jun 2020
FNA++: Fast Network Adaptation via Parameter Remapping and Architecture Search Jiemin Fang Yuzhu Sun Qian Zhang Kangjian Peng Yuan Li Wenyu Liu Xinggang Wang SSeg 118 34 0 21 Jun 2020
DrNAS: Dirichlet Neural Architecture Search Xiangning Chen Ruochen Wang Minhao Cheng Xiaocheng Tang Cho-Jui Hsieh OOD 107 103 0 18 Jun 2020
BI-MAML: Balanced Incremental Approach for Meta Learning Yang Zheng Jinlin Xiang Kun Su Eli Shlizerman CLL 48 10 0 12 Jun 2020
Knowledge Distillation: A Survey Jianping Gou B. Yu Stephen J. Maybank Dacheng Tao VLM 314 3,026 0 09 Jun 2020
A Comprehensive Survey of Neural Architecture Search: Challenges and Solutions Pengzhen Ren Yun Xiao Xiaojun Chang Po-Yao (Bernie) Huang Zhihui Li Xiaojiang Chen Xin Wang AI4CE 149 684 0 01 Jun 2020
Foundations and modelling of dynamic networks using Dynamic Graph Neural Networks: A survey Joakim Skarding Bogdan Gabrys Katarzyna Musial AI4CE 122 240 0 13 May 2020
Noisy Differentiable Architecture Search Xiangxiang Chu Bo Zhang 44 43 0 07 May 2020
Stage-Wise Neural Architecture Search Artur Jordão Fernando Akio M. Lie William Robson Schwartz 29 0 0 23 Apr 2020
Multiresolution Convolutional Autoencoders Yuying Liu Colin Ponce Steven L. Brunton J. Nathan Kutz SyDa 52 31 0 10 Apr 2020
Circumventing Outliers of AutoAugment with Knowledge Distillation Longhui Wei Anxiang Xiao Lingxi Xie Xin Chen Xiaopeng Zhang Qi Tian 80 62 0 25 Mar 2020
Distilling Knowledge from Graph Convolutional Networks Yiding Yang Jiayan Qiu Xiuming Zhang Dacheng Tao Xinchao Wang 239 233 0 23 Mar 2020
Steepest Descent Neural Architecture Optimization: Escaping Local Optimum with Signed Neural Splitting Lemeng Wu Mao Ye Qi Lei Jason D. Lee Qiang Liu 88 15 0 23 Mar 2020
Energy-efficient and Robust Cumulative Training with Net2Net Transformation Aosong Feng Priyadarshini Panda 87 1 0 02 Mar 2020
Neural Inheritance Relation Guided One-Shot Layer Assignment Search Rang Meng Weijie Chen Di Xie Yuan Zhang Shiliang Pu 33 6 0 28 Feb 2020
Residual Knowledge Distillation Mengya Gao Yujun Shen Quanquan Li Chen Change Loy 93 29 0 21 Feb 2020
Progressive Local Filter Pruning for Image Retrieval Acceleration Xiaodong Wang Zhedong Zheng Yang He Fei Yan Zhi-qiang Zeng Yi Yang 85 36 0 24 Jan 2020