v1v2 (latest)

Rethinking Neural Operations for Diverse Tasks

29 March 2021

Papers citing "Rethinking Neural Operations for Diverse Tasks"

40 / 40 papers shown

Title
Specialized Foundation Models Struggle to Beat Supervised Baselines Zongzhe Xu Ritvik Gupta Wenduo Cheng Alexander Shen Junhong Shen Ameet Talwalkar M. Khodak AI4CE 101 8 0 05 Nov 2024
Kaleidoscope: An Efficient, Learnable Representation For All Structured Linear Maps Tri Dao N. Sohoni Albert Gu Matthew Eichhorn Amit Blonder Megan Leszczynski Atri Rudra Christopher Ré 62 49 0 29 Dec 2020
Fourier Neural Operator for Parametric Partial Differential Equations Zong-Yi Li Nikola B. Kovachki Kamyar Azizzadenesheli Burigede Liu K. Bhattacharya Andrew M. Stuart Anima Anandkumar AI4CE 500 2,414 0 18 Oct 2020
HiPPO: Recurrent Memory with Optimal Polynomial Projections Albert Gu Tri Dao Stefano Ermon Atri Rudra Christopher Ré 117 519 0 17 Aug 2020
Sparse Linear Networks with a Fixed Butterfly Structure: Theory and Practice Nir Ailon Omer Leibovitch Vineet Nair 47 15 0 17 Jul 2020
Geometry-Aware Gradient Algorithms for Neural Architecture Search Liam Li M. Khodak Maria-Florina Balcan Ameet Talwalkar 71 67 0 16 Apr 2020
AutoML-Zero: Evolving Machine Learning Algorithms From Scratch Esteban Real Chen Liang David R. So Quoc V. Le 77 225 0 06 Mar 2020
NAS-Bench-1Shot1: Benchmarking and Dissecting One-shot Neural Architecture Search Arber Zela Julien N. Siems Frank Hutter 125 148 0 28 Jan 2020
NAS-Bench-201: Extending the Scope of Reproducible Neural Architecture Search Xuanyi Dong Yi Yang 139 711 0 02 Jan 2020
NAS evaluation is frustratingly hard Antoine Yang P. Esperança Fabio Maria Carlucci 70 168 0 28 Dec 2019
TextNAS: A Neural Architecture Search Space tailored for Text Representation Yujing Wang Yaming Yang Yiren Chen Jing Bai Ce Zhang Guinan Su Xiaoyu Kou Yunhai Tong Mao Yang Lidong Zhou 60 57 0 23 Dec 2019
AtomNAS: Fine-Grained End-to-End Neural Architecture Search Jieru Mei Yingwei Li Xiaochen Lian Xiaojie Jin Linjie Yang Alan Yuille Jianchao Yang 55 107 0 20 Dec 2019
Neural Machine Translation: A Review and Survey Felix Stahlberg 3DV AI4TS MedIm 73 328 0 04 Dec 2019
Once-for-All: Train One Network and Specialize it for Efficient Deployment Han Cai Chuang Gan Tianzhe Wang Zhekai Zhang Song Han OOD 105 1,281 0 26 Aug 2019
PC-DARTS: Partial Channel Connections for Memory-Efficient Architecture Search Yuhui Xu Lingxi Xie Xiaopeng Zhang Xin Chen Guo-Jun Qi Qi Tian H. Xiong 83 609 0 12 Jul 2019
R-Transformer: Recurrent Neural Network Enhanced Transformer Z. Wang Yao Ma Zitao Liu Jiliang Tang ViT 68 106 0 12 Jul 2019
Densely Connected Search Space for More Flexible Neural Architecture Search Jiemin Fang Yuzhu Sun Qian Zhang Yuan Li Wenyu Liu Xinggang Wang 75 124 0 23 Jun 2019
Butterfly Transform: An Efficient FFT Based Neural Architecture Design Keivan Alizadeh-Vahid Anish K. Prabhu Ali Farhadi Mohammad Rastegari 91 50 0 05 Jun 2019
Learning Fast Algorithms for Linear Transforms Using Butterfly Factorizations Tri Dao Albert Gu Matthew Eichhorn Atri Rudra Christopher Ré 106 108 0 14 Mar 2019
NAS-Bench-101: Towards Reproducible Neural Architecture Search Chris Ying Aaron Klein Esteban Real Eric Christiansen Kevin Patrick Murphy Frank Hutter 80 683 0 25 Feb 2019
Random Search and Reproducibility for Neural Architecture Search Liam Li Ameet Talwalkar OOD 78 725 0 20 Feb 2019
Auto-DeepLab: Hierarchical Neural Architecture Search for Semantic Image Segmentation Chenxi Liu Liang-Chieh Chen Florian Schroff Hartwig Adam Wei Hua Alan Yuille Li Fei-Fei SSeg 115 981 0 10 Jan 2019
Fast Neural Architecture Search of Compact Semantic Segmentation Models via Auxiliary Cells Vladimir Nekrasov Hao Chen Chunhua Shen Ian Reid SSeg 57 149 0 25 Oct 2018
Trellis Networks for Sequence Modeling Shaojie Bai J. Zico Kolter V. Koltun 64 146 0 15 Oct 2018
DARTS: Differentiable Architecture Search Hanxiao Liu Karen Simonyan Yiming Yang 199 4,355 0 24 Jun 2018
An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling Shaojie Bai J. Zico Kolter V. Koltun DRL 95 4,815 0 04 Mar 2018
Efficient Neural Architecture Search via Parameter Sharing Hieu H. Pham M. Guan Barret Zoph Quoc V. Le J. Dean 110 2,764 0 09 Feb 2018
DGM: A deep learning algorithm for solving partial differential equations Justin A. Sirignano K. Spiliopoulos AI4CE 91 2,063 0 24 Aug 2017
Learning Transferable Architectures for Scalable Image Recognition Barret Zoph Vijay Vasudevan Jonathon Shlens Quoc V. Le 177 5,605 0 21 Jul 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 704 131,652 0 12 Jun 2017
Semi-Supervised Classification with Graph Convolutional Networks Thomas Kipf Max Welling GNN SSL 644 29,076 0 09 Sep 2016
SQuAD: 100,000+ Questions for Machine Comprehension of Text Pranav Rajpurkar Jian Zhang Konstantin Lopyrev Percy Liang RALM 286 8,134 0 16 Jun 2016
Wide Residual Networks Sergey Zagoruyko N. Komodakis 346 7,985 0 23 May 2016
Hyperband: A Novel Bandit-Based Approach to Hyperparameter Optimization Lisha Li Kevin Jamieson Giulia DeSalvo Afshin Rostamizadeh Ameet Talwalkar 225 2,329 0 21 Mar 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.2K 194,020 0 10 Dec 2015
ACDC: A Structured Efficient Linear Layer Marcin Moczulski Misha Denil J. Appleyard Nando de Freitas 74 98 0 18 Nov 2015
U-Net: Convolutional Networks for Biomedical Image Segmentation Olaf Ronneberger Philipp Fischer Thomas Brox SSeg 3DV 1.8K 77,196 0 18 May 2015
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift Sergey Ioffe Christian Szegedy OOD 463 43,305 0 11 Feb 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 1.9K 150,115 0 22 Dec 2014
ImageNet Large Scale Visual Recognition Challenge Olga Russakovsky Jia Deng Hao Su J. Krause S. Satheesh ... A. Karpathy A. Khosla Michael S. Bernstein Alexander C. Berg Li Fei-Fei VLM ObjD 1.7K 39,547 0 01 Sep 2014