Searching for Activation Functions

16 October 2017

Papers citing "Searching for Activation Functions"

49 / 99 papers shown

Title
Adaptive and Multiple Time-scale Eligibility Traces for Online Deep Reinforcement Learning Taisuke Kobayashi OffRL 18 7 0 23 Aug 2020
Can weight sharing outperform random architecture search? An investigation with TuNAS Gabriel Bender Hanxiao Liu Bo Chen Grace Chu Shuyang Cheng Pieter-Jan Kindermans Quoc V. Le OOD 18 121 0 13 Aug 2020
Unnormalized Variational Bayes Saeed Saremi BDL 86 1 0 29 Jul 2020
Perpetual Motion: Generating Unbounded Human Motion Yan Zhang Michael J. Black Siyu Tang 3DH 49 47 0 27 Jul 2020
End-to-End Differentiable Learning to HDR Image Synthesis for Multi-exposure Images J. H. Kim Siyeong Lee Suk-ju Kang 16 36 0 29 Jun 2020
Supermasks in Superposition Mitchell Wortsman Vivek Ramanujan Rosanne Liu Aniruddha Kembhavi Mohammad Rastegari J. Yosinski Ali Farhadi SSL CLL 33 279 0 26 Jun 2020
Deep Polynomial Neural Networks Grigorios G. Chrysos Stylianos Moschoglou Giorgos Bouritsas Jiankang Deng Yannis Panagakis S. Zafeiriou 29 92 0 20 Jun 2020
SPLASH: Learnable Activation Functions for Improving Accuracy and Adversarial Robustness Mohammadamin Tavakoli Forest Agostinelli Pierre Baldi AAML FAtt 36 39 0 16 Jun 2020
BS-Net: learning COVID-19 pneumonia severity on a large Chest X-Ray dataset A. Signoroni Mattia Savardi Sergio Benini Nicola Adami R. Leonardi ... F. Vaccher M. Ravanelli A. Borghesi R. Maroldi D. Farina 19 37 0 08 Jun 2020
Modeling the Distribution of Normal Data in Pre-Trained Deep Features for Anomaly Detection Oliver Rippel Patrick Mertens Dorit Merhof 27 236 0 28 May 2020
Learning and Inference in Imaginary Noise Models Saeed Saremi BDL DRL 11 2 0 18 May 2020
Conformer: Convolution-augmented Transformer for Speech Recognition Anmol Gulati James Qin Chung-Cheng Chiu Niki Parmar Yu Zhang ... Wei Han Shibo Wang Zhengdong Zhang Yonghui Wu Ruoming Pang 77 3,031 0 16 May 2020
Context-aware Dynamics Model for Generalization in Model-Based Reinforcement Learning Kimin Lee Younggyo Seo Seunghyun Lee Honglak Lee Jinwoo Shin 43 124 0 14 May 2020
Angle-based Search Space Shrinking for Neural Architecture Search Yiming Hu Yuding Liang Zichao Guo Ruosi Wan Xinming Zhang Yichen Wei Qingyi Gu Jian Sun 24 62 0 28 Apr 2020
A Perspective on Deep Learning for Molecular Modeling and Simulations Jun Zhang Yao-Kun Lei Zhen Zhang Junhan Chang Maodong Li Xu Han Lijiang Yang Yuqing Yang Y. Gao AI4CE 37 8 0 25 Apr 2020
YOLOv4: Optimal Speed and Accuracy of Object Detection Alexey Bochkovskiy Chien-Yao Wang H. Liao VLM ObjD 63 12,055 0 23 Apr 2020
Symmetry & critical points for a model shallow neural network Yossi Arjevani M. Field 34 13 0 23 Mar 2020
$Π-$ nets: Deep Polynomial Neural Networks Grigorios G. Chrysos Stylianos Moschoglou Giorgos Bouritsas Yannis Panagakis Jiankang Deng S. Zafeiriou 29 59 0 08 Mar 2020
Generalizing Convolutional Neural Networks for Equivariance to Lie Groups on Arbitrary Continuous Data Marc Finzi Samuel Stanton Pavel Izmailov A. Wilson 30 316 0 25 Feb 2020
A Neural Network Based on First Principles P. Baggenstoss 13 7 0 18 Feb 2020
Evolutionary Optimization of Deep Learning Activation Functions G. Bingham William Macke Risto Miikkulainen ODL 19 50 0 17 Feb 2020
GLU Variants Improve Transformer Noam M. Shazeer 69 924 0 12 Feb 2020
Explaining Explanations: Axiomatic Feature Interactions for Deep Networks Joseph D. Janizek Pascal Sturmfels Su-In Lee FAtt 30 143 0 10 Feb 2020
Deep Learning for Financial Applications : A Survey A. Ozbayoglu M. U. Gudelek Omer Berat Sezer AIFin AI4CE 42 385 0 09 Feb 2020
A Derivative-Free Method for Solving Elliptic Partial Differential Equations with Deep Neural Networks Jihun Han Mihai Nica A. Stinchcombe 22 49 0 17 Jan 2020
Towards GAN Benchmarks Which Require Generalization Ishaan Gulrajani Colin Raffel Luke Metz 24 57 0 10 Jan 2020
FDFtNet: Facing Off Fake Images using Fake Detection Fine-tuning Network Hyeonseong Jeon Youngoh Bang Simon S. Woo 16 54 0 05 Jan 2020
BETANAS: BalancEd TrAining and selective drop for Neural Architecture Search Muyuan Fang Qiang-qiang Wang Zhaobai Zhong OOD 30 9 0 24 Dec 2019
Implicit Generative Modeling for Efficient Exploration Neale Ratzlaff Qinxun Bai Fuxin Li Wenyuan Xu 22 12 0 19 Nov 2019
Symmetrical Gaussian Error Linear Units (SGELUs) Chao Yu Zhiguo Su 8 11 0 10 Nov 2019
Zero-shot Imitation Learning from Demonstrations for Legged Robot Visual Navigation Xinlei Pan Tingnan Zhang Brian Ichter Aleksandra Faust Jie Tan Sehoon Ha 57 25 0 27 Sep 2019
AutoML: A Survey of the State-of-the-Art Xin He Kaiyong Zhao X. Chu 20 1,420 0 02 Aug 2019
Deep Learning for CSI Feedback Based on Superimposed Coding Chaojin Qing Bin Cai Qingyao Yang Jiafan Wang Chuan Huang 11 42 0 27 Jul 2019
Universal Approximation with Deep Narrow Networks Patrick Kidger Terry Lyons 40 327 0 21 May 2019
Improving Discrete Latent Representations With Differentiable Approximation Bridges Jason Ramapuram Russ Webb DRL 19 9 0 09 May 2019
Interpreting Neural Networks Using Flip Points Roozbeh Yousefzadeh D. O’Leary AAML FAtt 22 17 0 21 Mar 2019
Neural Empirical Bayes Saeed Saremi Aapo Hyvarinen 12 65 0 06 Mar 2019
Adaptive Estimators Show Information Compression in Deep Neural Networks Ivan Chelombiev Conor J. Houghton Cian O’Donnell 30 34 0 24 Feb 2019
A Survey of the Recent Architectures of Deep Convolutional Neural Networks Asifullah Khan A. Sohail Umme Zahoora Aqsa Saeed Qureshi OOD 59 2,268 0 17 Jan 2019
Prototype-based Neural Network Layers: Incorporating Vector Quantization S. Saralajew Lars Holdijk Maike Rees T. Villmann MQ 22 15 0 04 Dec 2018
Faster CryptoNets: Leveraging Sparsity for Real-World Encrypted Inference Edward Chou Josh Beal Daniel Levy Serena Yeung Albert Haque Li Fei-Fei 26 198 0 25 Nov 2018
One-Shot Hierarchical Imitation Learning of Compound Visuomotor Tasks Tianhe Yu Pieter Abbeel Sergey Levine Chelsea Finn 13 68 0 25 Oct 2018
Weighted Sigmoid Gate Unit for an Activation Function of Deep Neural Network Masayuki Tanaka 33 54 0 03 Oct 2018
SUNLayer: Stable denoising with generative networks D. Mixon Soledad Villar 25 21 0 25 Mar 2018
Automated design of collective variables using supervised machine learning Mohammad M. Sultan Vijay S. Pande 14 121 0 28 Feb 2018
Complex-valued Neural Networks with Non-parametric Activation Functions Simone Scardapane S. Van Vaerenbergh Amir Hussain A. Uncini 23 81 0 22 Feb 2018
Rethinking Spatiotemporal Feature Learning: Speed-Accuracy Trade-offs in Video Classification Saining Xie Chen Sun Jonathan Huang Z. Tu Kevin Patrick Murphy 3DH 43 1,308 0 13 Dec 2017
Neural Architecture Search with Reinforcement Learning Barret Zoph Quoc V. Le 271 5,327 0 05 Nov 2016
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 308 2,890 0 15 Sep 2016