DNAD: Differentiable Neural Architecture Distillation

25 April 2025

Papers citing "DNAD: Differentiable Neural Architecture Distillation"

32 / 32 papers shown

Title
FX-DARTS: Designing Topology-unconstrained Architectures with Differentiable Architecture Search and Entropy-based Super-network Shrinking Xuan Rao Bo Zhao Derong Liu Cesare Alippi 206 0 0 25 Apr 2025
Curriculum Temperature for Knowledge Distillation Zheng Li Xiang Li Lingfeng Yang Borui Zhao Renjie Song Lei Luo Jun Yu Li Jian Yang 64 143 0 29 Nov 2022
Cross-Image Relational Knowledge Distillation for Semantic Segmentation Chuanguang Yang Helong Zhou Zhulin An Xue Jiang Yong Xu Qian Zhang 126 177 0 14 Apr 2022
LoRA: Low-Rank Adaptation of Large Language Models J. E. Hu Yelong Shen Phillip Wallis Zeyuan Allen-Zhu Yuanzhi Li Shean Wang Lu Wang Weizhu Chen OffRL AI4TS AI4CE ALM AIMat 502 10,526 0 17 Jun 2021
Cross-Layer Distillation with Semantic Calibration Defang Chen Jian-Ping Mei Yuan Zhang Can Wang Yan Feng Chun-Yen Chen FedML 99 299 0 06 Dec 2020
DOTS: Decoupling Operation and Topology in Differentiable Architecture Search Yuchao Gu Li-Juan Wang Yun-Hai Liu Yi Yang Yu-Huan Wu Shao-Ping Lu Ming-Ming Cheng 83 48 0 02 Oct 2020
GOLD-NAS: Gradual, One-Level, Differentiable Kaifeng Bi Lingxi Xie Xin Chen Longhui Wei Qi Tian OOD AI4CE 54 42 0 07 Jul 2020
Discretization-Aware Architecture Search Yunjie Tian Chang-rui Liu Lingxi Xie Jianbin Jiao QiXiang Ye 42 32 0 07 Jul 2020
Cyclic Differentiable Architecture Search Hongyuan Yu Houwen Peng Yan Huang Jianlong Fu Hao Du Liang Wang Haibin Ling 3DPC 61 48 0 18 Jun 2020
Heterogeneous Knowledge Distillation using Information Flow Modeling Nikolaos Passalis Maria Tzelepi Anastasios Tefas 75 139 0 02 May 2020
MiLeNAS: Efficient Neural Architecture Search via Mixed-Level Reformulation Chaoyang He Haishan Ye Li Shen Tong Zhang 77 129 0 27 Mar 2020
Progressive DARTS: Bridging the Optimization Gap for NAS in the Wild Xin Chen Lingxi Xie Jun Wu Qi Tian 135 96 0 23 Dec 2019
Blockwisely Supervised Neural Architecture Search with Knowledge Distillation Changlin Li Jiefeng Peng Liuchun Yuan Guangrun Wang Xiaodan Liang Liang Lin Xiaojun Chang 113 182 0 29 Nov 2019
Towards Oracle Knowledge Distillation with Neural Architecture Search Minsoo Kang Jonghwan Mun Bohyung Han FedML 100 44 0 29 Nov 2019
Exploiting Operation Importance for Differentiable Neural Architecture Search Xukai Xie Yuan Zhou S. Kung 60 35 0 24 Nov 2019
Quantization Networks Jiwei Yang Xu Shen Jun Xing Xinmei Tian Houqiang Li Bing Deng Jianqiang Huang Xiansheng Hua MQ 81 350 0 21 Nov 2019
Searching for A Robust Neural Architecture in Four GPU Hours Xuanyi Dong Yezhou Yang 138 656 0 10 Oct 2019
AutoML: A Survey of the State-of-the-Art Xin He Kaiyong Zhao Xiaowen Chu 150 1,463 0 02 Aug 2019
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks Mingxing Tan Quoc V. Le 3DV MedIm 172 18,193 0 28 May 2019
Conditional Teacher-Student Learning Zhong Meng Jinyu Li Yong Zhao Jiawei Liu 62 91 0 28 Apr 2019
Relational Knowledge Distillation Wonpyo Park Dongju Kim Yan Lu Minsu Cho 87 1,425 0 10 Apr 2019
A Comprehensive Overhaul of Feature Distillation Byeongho Heo Jeesoo Kim Sangdoo Yun Hyojin Park Nojun Kwak J. Choi 89 585 0 03 Apr 2019
Neural Architecture Optimization Renqian Luo Fei Tian Tao Qin Enhong Chen Tie-Yan Liu 3DV 102 655 0 22 Aug 2018
Neural Architecture Search with Bayesian Optimisation and Optimal Transport Kirthevasan Kandasamy Willie Neiswanger J. Schneider Barnabás Póczós Eric Xing 103 609 0 11 Feb 2018
Visualizing the Loss Landscape of Neural Nets Hao Li Zheng Xu Gavin Taylor Christoph Studer Tom Goldstein 266 1,901 0 28 Dec 2017
Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference Benoit Jacob S. Kligys Bo Chen Menglong Zhu Matthew Tang Andrew G. Howard Hartwig Adam Dmitry Kalenichenko MQ 167 3,143 0 15 Dec 2017
Learning Transferable Architectures for Scalable Image Recognition Barret Zoph Vijay Vasudevan Jonathon Shlens Quoc V. Le 208 5,612 0 21 Jul 2017
Channel Pruning for Accelerating Very Deep Neural Networks Yihui He Xiangyu Zhang Jian Sun 210 2,531 0 19 Jul 2017
Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfer Sergey Zagoruyko N. Komodakis 147 2,586 0 12 Dec 2016
Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization Ramprasaath R. Selvaraju Michael Cogswell Abhishek Das Ramakrishna Vedantam Devi Parikh Dhruv Batra FAtt 335 20,110 0 07 Oct 2016
Learning Structured Sparsity in Deep Neural Networks W. Wen Chunpeng Wu Yandan Wang Yiran Chen Hai Helen Li 189 2,341 0 12 Aug 2016
FitNets: Hints for Thin Deep Nets Adriana Romero Nicolas Ballas Samira Ebrahimi Kahou Antoine Chassang C. Gatta Yoshua Bengio FedML 326 3,906 0 19 Dec 2014