Distilling Optimal Neural Networks: Rapid Search in Diverse Spaces

Distilling Optimal Neural Networks: Rapid Search in Diverse Spaces

16 December 2020

Tijmen Blankevoort

Papers citing "Distilling Optimal Neural Networks: Rapid Search in Diverse Spaces"

12 / 12 papers shown

Title
Puzzle: Distillation-Based NAS for Inference-Optimized LLMs Akhiad Bercovich Tomer Ronen Talor Abramovich Nir Ailon Nave Assaf ... Ido Shahaf Oren Tropp Omer Ullman Argov Ran Zilberstein Ran El-Yaniv 77 1 0 28 Nov 2024
DONNAv2 -- Lightweight Neural Architecture Search for Vision tasks Sweta Priyadarshi Tianyu Jiang Hsin-Pai Cheng S. Rama Krishna Viswanath Ganapathy C. Patel 41 0 0 26 Sep 2023
ZiCo-BC: A Bias Corrected Zero-Shot NAS for Vision Tasks Kartikeya Bhardwaj Hsin-Pai Cheng Sweta Priyadarshi Zhuojing Li 21 1 0 26 Sep 2023
ZiCo: Zero-shot NAS via Inverse Coefficient of Variation on Gradients Guihong Li Yuedong Yang Kartikeya Bhardwaj R. Marculescu 36 60 0 26 Jan 2023
BLOX: Macro Neural Architecture Search Benchmark and Algorithms Thomas C. P. Chau L. Dudziak Hongkai Wen Nicholas D. Lane Mohamed S. Abdelfattah 27 13 0 13 Oct 2022
Design Automation for Fast, Lightweight, and Effective Deep Learning Models: A Survey Dalin Zhang Kaixuan Chen Yan Zhao B. Yang Li-Ping Yao Christian S. Jensen 43 3 0 22 Aug 2022
Simple and Efficient Architectures for Semantic Segmentation Dushyant Mehta Andrii Skliar H. Yahia Shubhankar Borse Fatih Porikli A. Habibian Tijmen Blankevoort SSeg 16 13 0 16 Jun 2022
X-Distill: Improving Self-Supervised Monocular Depth via Cross-Task Distillation H. Cai J. Matai Shubhankar Borse Yizhe Zhang Amin Ansari Fatih Porikli FedML VLM MDE 52 21 0 24 Oct 2021
A White Paper on Neural Network Quantization Markus Nagel Marios Fournarakis Rana Ali Amjad Yelysei Bondarenko M. V. Baalen Tijmen Blankevoort MQ 19 503 0 15 Jun 2021
BossNAS: Exploring Hybrid CNN-transformers with Block-wisely Self-supervised Neural Architecture Search Changlin Li Tao Tang Guangrun Wang Jiefeng Peng Bing Wang Xiaodan Liang Xiaojun Chang ViT 46 105 0 23 Mar 2021
AlphaNet: Improved Training of Supernets with Alpha-Divergence Dilin Wang Chengyue Gong Meng Li Qiang Liu Vikas Chandra 152 44 0 16 Feb 2021
Neural Architecture Search with Reinforcement Learning Barret Zoph Quoc V. Le 271 5,329 0 05 Nov 2016