Efficient Neural Architecture Search via Parameter Sharing

9 February 2018

Papers citing "Efficient Neural Architecture Search via Parameter Sharing"

50 / 550 papers shown

Title
The Values Encoded in Machine Learning Research Abeba Birhane Pratyusha Kalluri Dallas Card William Agnew Ravit Dotan Michelle Bao 41 274 0 29 Jun 2021
BFTrainer: Low-Cost Training of Neural Networks on Unfillable Supercomputer Nodes Zhengchun Liu R. Kettimuthu M. Papka Ian Foster 34 3 0 22 Jun 2021
GAIA: A Transfer Learning System of Object Detection that Fits Your Needs Xingyuan Bu Junran Peng Junjie Yan Tieniu Tan Zhaoxiang Zhang ObjD VLM 31 53 0 21 Jun 2021
iDARTS: Differentiable Architecture Search with Stochastic Implicit Gradients Miao Zhang Steven W. Su Shirui Pan Xiaojun Chang Ehsan Abbasnejad Reza Haffari 26 68 0 21 Jun 2021
Efficient Deep Learning: A Survey on Making Deep Learning Models Smaller, Faster, and Better Gaurav Menghani VLM MedIm 23 366 0 16 Jun 2021
HELP: Hardware-Adaptive Efficient Latency Prediction for NAS via Meta-Learning Hayeon Lee Sewoong Lee Song Chong Sung Ju Hwang 21 26 0 16 Jun 2021
AutoLoss: Automated Loss Function Search in Recommendations Xiangyu Zhao Haochen Liu Wenqi Fan Hui Liu Jiliang Tang Chong Wang 30 60 0 12 Jun 2021
Accelerating Neural Architecture Search via Proxy Data Byunggook Na J. Mok Hyeokjun Choe Sungroh Yoon 16 18 0 09 Jun 2021
Federated Hyperparameter Tuning: Challenges, Baselines, and Connections to Weight-Sharing M. Khodak Renbo Tu Tian Li Liam Li Maria-Florina Balcan Virginia Smith Ameet Talwalkar FedML 43 78 0 08 Jun 2021
FEAR: A Simple Lightweight Method to Rank Architectures Debadeepta Dey Shital C. Shah Sébastien Bubeck OOD 30 4 0 07 Jun 2021
Scalable Transformers for Neural Machine Translation Peng Gao Shijie Geng Ping Luo Xiaogang Wang Jifeng Dai Hongsheng Li 31 13 0 04 Jun 2021
Memory-Efficient Differentiable Transformer Architecture Search Yuekai Zhao Li Dong Yelong Shen Zhihua Zhang Furu Wei Weizhu Chen ViT 32 17 0 31 May 2021
AutoReCon: Neural Architecture Search-based Reconstruction for Data-free Compression Baozhou Zhu P. Hofstee J. Peltenburg Jinho Lee Zaid Al-Ars 24 22 0 25 May 2021
Bag of Baselines for Multi-objective Joint Neural Architecture Search and Hyperparameter Optimization Julia Guerrero-Viu Sven Hauns Sergio Izquierdo Guilherme Miotto Simon Schrodi André Biedenkapp T. Elsken Difan Deng Marius Lindauer Frank Hutter AI4CE 17 25 0 03 May 2021
LightTrack: Finding Lightweight Neural Networks for Object Tracking via One-Shot Architecture Search B. Yan Houwen Peng Kan Wu Dong Wang Jianlong Fu Huchuan Lu 36 165 0 29 Apr 2021
Generalization Guarantees for Neural Architecture Search with Train-Validation Split Samet Oymak Mingchen Li Mahdi Soltanolkotabi AI4CE OOD 36 13 0 29 Apr 2021
HAO: Hardware-aware neural Architecture Optimization for Efficient Inference Zhen Dong Yizhao Gao Qijing Huang J. Wawrzynek Hayden Kwok-Hay So Kurt Keutzer 19 34 0 26 Apr 2021
CompOFA: Compound Once-For-All Networks for Faster Multi-Platform Deployment Manas Sahni S. Varshini Alind Khare Alexey Tumanov 23 31 0 26 Apr 2021
Compact CNN Structure Learning by Knowledge Distillation Waqar Ahmed Andrea Zunino Pietro Morerio Vittorio Murino 38 5 0 19 Apr 2021
End-to-end Keyword Spotting using Neural Architecture Search and Quantization David Peter Wolfgang Roth Franz Pernkopf MQ 27 14 0 14 Apr 2021
ExplainaBoard: An Explainable Leaderboard for NLP Pengfei Liu Jinlan Fu Yanghua Xiao Weizhe Yuan Shuaichen Chang Junqi Dai Yixin Liu Zihuiwen Ye Zi-Yi Dou Graham Neubig XAI LRM ELM 28 54 0 13 Apr 2021
ENOS: Energy-Aware Network Operator Search for Hybrid Digital and Compute-in-Memory DNN Accelerators Shamma Nasrin A. Shylendra Yuti Kadakia N. Iliev Wilfred Gomes Theja Tulabandhula A. R. Trivedi MQ 13 2 0 12 Apr 2021
Neural Feature Search for RGB-Infrared Person Re-Identification Yehansen Chen Lin Wan Zhihang Li Qianyan Jing Zongyuan Sun 47 138 0 06 Apr 2021
How Powerful are Performance Predictors in Neural Architecture Search? Colin White Arber Zela Binxin Ru Yang Liu Frank Hutter 22 126 0 02 Apr 2021
Rethinking Neural Operations for Diverse Tasks Nicholas Roberts M. Khodak Tri Dao Liam Li Christopher Ré Ameet Talwalkar AI4CE 38 22 0 29 Mar 2021
Ensemble-in-One: Learning Ensemble within Random Gated Networks for Enhanced Adversarial Robustness Yi Cai Xuefei Ning Huazhong Yang Yu Wang AAML 27 4 0 27 Mar 2021
Fisher Task Distance and Its Application in Neural Architecture Search Cat P. Le Mohammadreza Soltani Juncheng Dong Vahid Tarokh FedML 24 8 0 23 Mar 2021
BossNAS: Exploring Hybrid CNN-transformers with Block-wisely Self-supervised Neural Architecture Search Changlin Li Tao Tang Guangrun Wang Jiefeng Peng Bing Wang Xiaodan Liang Xiaojun Chang ViT 48 105 0 23 Mar 2021
AutoSpace: Neural Architecture Search with Less Human Interference Daquan Zhou Xiaojie Jin Xiaochen Lian Linjie Yang Yujing Xue Qibin Hou Jiashi Feng 26 10 0 22 Mar 2021
Accelerating GMRES with Deep Learning in Real-Time Kevin Luna Katherine Klymko Johannes P. Blaschke AI4CE 41 13 0 19 Mar 2021
HSCoNAS: Hardware-Software Co-Design of Efficient DNNs via Neural Architecture Search Xiangzhong Luo Di Liu Shuo Huai Weichen Liu 20 6 0 11 Mar 2021
Involution: Inverting the Inherence of Convolution for Visual Recognition Duo Li Jie Hu Changhu Wang Xiangtai Li Qi She Lei Zhu Tong Zhang Qifeng Chen BDL 19 304 0 10 Mar 2021
Towards Accurate and Compact Architectures via Neural Architecture Transformer Yong Guo Yin Zheng Mingkui Tan Qi Chen Zhipeng Li Jian Chen P. Zhao Junzhou Huang ViT MQ 16 38 0 20 Feb 2021
Rethinking Co-design of Neural Architectures and Hardware Accelerators Yanqi Zhou Xuanyi Dong Berkin Akin Mingxing Tan Daiyi Peng Tianjian Meng Amir Yazdanbakhsh Da Huang Ravi Narayanaswami James Laudon 66 26 0 17 Feb 2021
AlphaNet: Improved Training of Supernets with Alpha-Divergence Dilin Wang Chengyue Gong Meng Li Qiang Liu Vikas Chandra 155 44 0 16 Feb 2021
CATE: Computation-aware Neural Architecture Encoding with Transformers Shen Yan Kaiqiang Song Z. Feng Mi Zhang 22 24 0 14 Feb 2021
COVID-19 identification from volumetric chest CT scans using a progressively resized 3D-CNN incorporating segmentation, augmentation, and class-rebalancing Md. Kamrul Hasan Md. Tasnim Jawad Kazi N. Hasan Sajal Basak Partha Md. Masum Al Masba Shumit Saha 29 21 0 11 Feb 2021
Searching for Fast Model Families on Datacenter Accelerators Sheng Li Mingxing Tan Ruoming Pang Andrew Li Liqun Cheng Quoc V. Le N. Jouppi 34 34 0 10 Feb 2021
Investigating Bi-Level Optimization for Learning and Vision from a Unified Perspective: A Survey and Beyond Risheng Liu Jiaxin Gao Jin Zhang Deyu Meng Zhouchen Lin AI4CE 62 223 0 27 Jan 2021
A Comprehensive Survey on Hardware-Aware Neural Architecture Search Hadjer Benmeziane Kaoutar El Maghraoui Hamza Ouarnoughi Smail Niar Martin Wistuba Naigang Wang 34 96 0 22 Jan 2021
Unchain the Search Space with Hierarchical Differentiable Architecture Search Guanting Liu Yujie Zhong Sheng Guo Matthew R. Scott Weilin Huang AI4CE 26 2 0 11 Jan 2021
Evolving Reinforcement Learning Algorithms John D. Co-Reyes Yingjie Miao Daiyi Peng Esteban Real Sergey Levine Quoc V. Le Honglak Lee Aleksandra Faust 46 73 0 08 Jan 2021
AutoDropout: Learning Dropout Patterns to Regularize Deep Networks Hieu H. Pham Quoc V. Le 76 56 0 05 Jan 2021
Transformers in Vision: A Survey Salman Khan Muzammal Naseer Munawar Hayat Syed Waqas Zamir Fahad Shahbaz Khan M. Shah ViT 227 2,434 0 04 Jan 2021
Inception Convolution with Efficient Dilation Search Jie Liu Chuming Li Feng Liang Chen Lin Ming Sun Junjie Yan Wanli Ouyang Dong Xu 39 27 0 25 Dec 2020
Auto-Agent-Distiller: Towards Efficient Deep Reinforcement Learning Agents via Neural Architecture Search Y. Fu Zhongzhi Yu Yongan Zhang Yingyan Lin 22 4 0 24 Dec 2020
Hardware and Software Optimizations for Accelerating Deep Neural Networks: Survey of Current Trends, Challenges, and the Road Ahead Maurizio Capra Beatrice Bussolino Alberto Marchisio Guido Masera Maurizio Martina Muhammad Shafique BDL 59 140 0 21 Dec 2020
AutoCaption: Image Captioning with Neural Architecture Search Xinxin Zhu Weining Wang Longteng Guo Jing Liu 32 9 0 16 Dec 2020
A Comprehensive Study of Deep Video Action Recognition Yi Zhu Xinyu Li Chunhui Liu Mohammadreza Zolfaghari Yuanjun Xiong Chongruo Wu Zhi-Li Zhang Joseph Tighe R. Manmatha Mu Li VLM AI4TS 38 185 0 11 Dec 2020
DSRNA: Differentiable Search of Robust Neural Architectures Ramtin Hosseini Xingyi Yang P. Xie OOD AAML 29 50 0 11 Dec 2020