CATE: Computation-aware Neural Architecture Encoding with Transformers

14 February 2021

Papers citing "CATE: Computation-aware Neural Architecture Encoding with Transformers"

50 / 64 papers shown

Title
Pretraining Neural Architecture Search Controllers with Locality-based Self-Supervised Learning Kwanghee Choi Minyoung Choe Hyelee Lee SSL AI4CE 32 1 0 15 Mar 2021
Contrastive Embeddings for Neural Architectures Daniel Hesslow Iacopo Poli 47 4 0 08 Feb 2021
Self-supervised Representation Learning for Evolutionary Neural Architecture Search Chen Wei Yiping Tang Chuang Niu Haihong Hu Yue Wang Jimin Liang 31 21 0 31 Oct 2020
Cream of the Crop: Distilling Prioritized Paths For One-Shot Neural Architecture Search Houwen Peng Hao Du Hongyuan Yu Qi Li Jing Liao Jianlong Fu 31 67 0 29 Oct 2020
AutoBSS: An Efficient Algorithm for Block Stacking Style Search Yikang Zhang Jian Zhang Zhaobai Zhong 34 3 0 20 Oct 2020
Smooth Variational Graph Embeddings for Efficient Neural Architecture Search Jovita Lukasik David Friede Arber Zela Frank Hutter Margret Keuper 50 19 0 09 Oct 2020
Can weight sharing outperform random architecture search? An investigation with TuNAS Gabriel Bender Hanxiao Liu Bo Chen Grace Chu Shuyang Cheng Pieter-Jan Kindermans Quoc V. Le OOD 46 121 0 13 Aug 2020
Weight-Sharing Neural Architecture Search: A Battle to Shrink the Optimization Gap Lingxi Xie Xin Chen Kaifeng Bi Longhui Wei Yuhui Xu ... Lanfei Wang Anxiang Xiao Jianlong Chang Xiaopeng Zhang Qi Tian ViT 64 110 0 04 Aug 2020
NSGANetV2: Evolutionary Multi-Objective Surrogate-Assisted Neural Architecture Search Zhichao Lu Kalyanmoy Deb E. Goodman W. Banzhaf Vishnu Boddeti 47 145 0 20 Jul 2020
Graph Structure of Neural Networks Jiaxuan You J. Leskovec Kaiming He Saining Xie GNN 47 139 0 13 Jul 2020
A Study on Encodings for Neural Architecture Search Colin White Willie Neiswanger Sam Nolen Yash Savani AI4CE 18 74 0 09 Jul 2020
Does Unsupervised Architecture Representation Learning Help Neural Architecture Search? Shen Yan Yu Zheng Wei Ao Xiao Zeng Mi Zhang SSL AI4CE 46 101 0 12 Jun 2020
A Semi-Supervised Assessor of Neural Architectures Yehui Tang Yunhe Wang Yixing Xu Hanting Chen Chunjing Xu Boxin Shi Chao Xu Qi Tian Chang Xu 41 67 0 14 May 2020
Local Search is a Remarkably Strong Baseline for Neural Architecture Search T. D. Ottelander A. Dushatskiy M. Virgolin Peter A. N. Bosman OOD 40 38 0 20 Apr 2020
A Generic Graph-based Neural Architecture Encoding Scheme for Predictor-based NAS Xuefei Ning Yin Zheng Tianchen Zhao Yu Wang Huazhong Yang AI4CE 50 100 0 04 Apr 2020
Neural Architecture Generator Optimization Binxin Ru P. Esperança Fabio Maria Carlucci 34 40 0 03 Apr 2020
Designing Network Design Spaces Ilija Radosavovic Raj Prateek Kosaraju Ross B. Girshick Kaiming He Piotr Dollár GNN 68 1,672 0 30 Mar 2020
GreedyNAS: Towards Fast One-Shot NAS with Greedy Supernet Shan You Tao Huang Mingmin Yang Fei Wang Chao Qian Changshui Zhang 47 143 0 25 Mar 2020
Semi-Supervised Neural Architecture Search Renqian Luo Xu Tan Rui Wang Tao Qin Enhong Chen Tie-Yan Liu 20 88 0 24 Feb 2020
Decision-Making with Auto-Encoding Variational Bayes Romain Lopez Pierre Boyeau Nir Yosef Michael I. Jordan Jeffrey Regier BDL 109 10,591 0 17 Feb 2020
Stabilizing Differentiable Architecture Search via Perturbation-based Regularization Xiangning Chen Cho-Jui Hsieh 52 203 0 12 Feb 2020
NAS-Bench-201: Extending the Scope of Reproducible Neural Architecture Search Xuanyi Dong Yi Yang 115 703 0 02 Jan 2020
Neural Predictor for Neural Architecture Search W. Wen Hanxiao Liu H. Li Yiran Chen Gabriel Bender Pieter-Jan Kindermans 61 196 0 02 Dec 2019
BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension M. Lewis Yinhan Liu Naman Goyal Marjan Ghazvininejad Abdel-rahman Mohamed Omer Levy Veselin Stoyanov Luke Zettlemoyer AIMat VLM 81 10,720 0 29 Oct 2019
BANANAS: Bayesian Optimization with Neural Architectures for Neural Architecture Search Colin White Willie Neiswanger Yash Savani BDL 66 317 0 25 Oct 2019
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer Colin Raffel Noam M. Shazeer Adam Roberts Katherine Lee Sharan Narang Michael Matena Yanqi Zhou Wei Li Peter J. Liu AIMat 189 19,824 0 23 Oct 2019
Searching for A Robust Neural Architecture in Four GPU Hours Xuanyi Dong Yezhou Yang 90 649 0 10 Oct 2019
Understanding and Robustifying Differentiable Architecture Search Arber Zela T. Elsken Tonmoy Saikia Yassine Marrakchi Thomas Brox Frank Hutter OOD AAML 109 369 0 20 Sep 2019
HM-NAS: Efficient Neural Architecture Search via Hierarchical Masking Shen Yan Biyi Fang Faen Zhang Yu Zheng Xiao Zeng Hui Xu Mi Zhang 16 22 0 31 Aug 2019
BOAH: A Tool Suite for Multi-Fidelity Bayesian Optimization & Analysis of Hyperparameters Marius Lindauer Katharina Eggensperger Matthias Feurer André Biedenkapp Joshua Marben Philip Muller Frank Hutter 13 40 0 16 Aug 2019
RoBERTa: A Robustly Optimized BERT Pretraining Approach Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy M. Lewis Luke Zettlemoyer Veselin Stoyanov AIMat 327 24,160 0 26 Jul 2019
FairNAS: Rethinking Evaluation Fairness of Weight Sharing Neural Architecture Search Xiangxiang Chu Bo Zhang Ruijun Xu 38 331 0 03 Jul 2019
XLNet: Generalized Autoregressive Pretraining for Language Understanding Zhilin Yang Zihang Dai Yiming Yang J. Carbonell Ruslan Salakhutdinov Quoc V. Le AI4CE 152 8,386 0 19 Jun 2019
Sample-Efficient Neural Architecture Search by Learning Action Space Linnan Wang Saining Xie Teng Li Rodrigo Fonseca Yuandong Tian 23 45 0 17 Jun 2019
BayesNAS: A Bayesian Approach for Neural Architecture Search Hongpeng Zhou Minghao Yang Jun Wang Wei Pan BDL 37 197 0 13 May 2019
Unified Language Model Pre-training for Natural Language Understanding and Generation Li Dong Nan Yang Wenhui Wang Furu Wei Xiaodong Liu Yu Wang Jianfeng Gao M. Zhou H. Hon ELM AI4CE 106 1,553 0 08 May 2019
D-VAE: A Variational Autoencoder for Directed Acyclic Graphs Muhan Zhang Shali Jiang Zhicheng Cui Roman Garnett Yixin Chen GNN BDL CML 51 199 0 24 Apr 2019
Exploring Randomly Wired Neural Networks for Image Recognition Saining Xie Alexander Kirillov Ross B. Girshick Kaiming He 44 365 0 02 Apr 2019
AlphaX: eXploring Neural Architectures with Deep Neural Networks and Monte Carlo Tree Search Linnan Wang Yiyang Zhao Yuu Jinnai Yuandong Tian Rodrigo Fonseca BDL 29 95 0 26 Mar 2019
NAS-Bench-101: Towards Reproducible Neural Architecture Search Chris Ying Aaron Klein Esteban Real Eric Christiansen Kevin Patrick Murphy Frank Hutter 37 678 0 25 Feb 2019
Random Search and Reproducibility for Neural Architecture Search Liam Li Ameet Talwalkar OOD 45 719 0 20 Feb 2019
SNAS: Stochastic Neural Architecture Search Sirui Xie Hehui Zheng Chunxiao Liu Liang Lin 45 932 0 24 Dec 2018
ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardware Han Cai Ligeng Zhu Song Han 46 1,865 0 02 Dec 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 660 93,936 0 11 Oct 2018
How Powerful are Graph Neural Networks? Keyulu Xu Weihua Hu J. Leskovec Stefanie Jegelka GNN 106 7,554 0 01 Oct 2018
Neural Architecture Optimization Renqian Luo Fei Tian Tao Qin Enhong Chen Tie-Yan Liu 3DV 53 651 0 22 Aug 2018
MnasNet: Platform-Aware Neural Architecture Search for Mobile Mingxing Tan Bo Chen Ruoming Pang Vijay Vasudevan Mark Sandler Andrew G. Howard Quoc V. Le MQ 69 2,995 0 31 Jul 2018
BOHB: Robust and Efficient Hyperparameter Optimization at Scale Stefan Falkner Aaron Klein Frank Hutter BDL 105 1,077 0 04 Jul 2018
DARTS: Differentiable Architecture Search Hanxiao Liu Karen Simonyan Yiming Yang 140 4,326 0 24 Jun 2018
Deep contextualized word representations Matthew E. Peters Mark Neumann Mohit Iyyer Matt Gardner Christopher Clark Kenton Lee Luke Zettlemoyer NAI 60 11,520 0 15 Feb 2018