v1v2 (latest)

Understanding and Improving Convolutional Neural Networks via Concatenated Rectified Linear Units

16 March 2016

Papers citing "Understanding and Improving Convolutional Neural Networks via Concatenated Rectified Linear Units"

50 / 171 papers shown

Title
AdaTerm: Adaptive T-Distribution Estimated Robust Moments for Noise-Robust Stochastic Gradient Optimization Wendyam Eric Lionel Ilboudo Taisuke Kobayashi Takamitsu Matsubara 87 13 0 18 Jan 2022
CDLNet: Noise-Adaptive Convolutional Dictionary Learning Network for Blind Denoising and Demosaicing Nikola Janjušević Amirhossein Khalilian-Gourtani Yao Wang 13 14 0 02 Dec 2021
First Power Linear Unit with Sign Boxi Duan 26 0 0 29 Nov 2021
Why KDAC? A general activation function for knowledge discovery Zhenhua Wang Dong Gao Haozhe Liu Fanglin Liu 26 11 0 27 Nov 2021
RMNet: Equivalently Removing Residual Connection from Networks Fanxu Meng Hao Cheng Jia-Xin Zhuang Ke Li Xing Sun 48 11 0 01 Nov 2021
NeRV: Neural Representations for Videos Hao Chen Bo He Hanyu Wang Yixuan Ren Ser-Nam Lim Abhinav Shrivastava 62 256 0 26 Oct 2021
Improving the efficacy of Deep Learning models for Heart Beat detection on heterogeneous datasets A. Bizzego G. Gabrieli M. Neoh G. Esposito 19 4 0 26 Oct 2021
Channel redundancy and overlap in convolutional neural networks with channel-wise NNK graphs David Bonet Antonio Ortega Javier Ruiz-Hidalgo Sarath Shekkizhar GNN 77 7 0 18 Oct 2021
Phase Collapse in Neural Networks Florentin Guth J. Zarka S. Mallat 55 7 0 11 Oct 2021
Activation Functions in Deep Learning: A Comprehensive Survey and Benchmark S. Dubey S. Singh B. B. Chaudhuri 124 690 0 29 Sep 2021
Real Time Monocular Vehicle Velocity Estimation using Synthetic Data Robert McCraith Lukás Neumann Andrea Vedaldi 33 3 0 16 Sep 2021
Existence, Stability and Scalability of Orthogonal Convolutional Neural Networks El Mehdi Achour Franccois Malgouyres Franck Mamalet 62 21 0 12 Aug 2021
Piecewise Linear Units Improve Deep Neural Networks Jordan Inturrisi Suiyang Khoo Abbas Kouzani Riccardo M. Pagliarella 23 4 0 02 Aug 2021
Sisyphus: A Cautionary Tale of Using Low-Degree Polynomial Activations in Privacy-Preserving Deep Learning Karthik Garimella N. Jha Brandon Reagen 92 19 0 26 Jul 2021
Shortest-Path Constrained Reinforcement Learning for Sparse Reward Tasks Sungryull Sohn Sungtae Lee Jongwook Choi H. V. Seijen Mehdi Fatemi Honglak Lee 321 5 0 13 Jul 2021
Trustworthy AI: A Computational Perspective Haochen Liu Yiqi Wang Wenqi Fan Xiaorui Liu Yaxin Li Shaili Jain Yunhao Liu Anil K. Jain Jiliang Tang FaML 192 212 0 12 Jul 2021
Reborn Mechanism: Rethinking the Negative Phase Information Flow in Convolutional Neural Network Zhicheng Cai Kaizhu Huang Chenglei Peng 26 0 0 13 Jun 2021
MLP-Mixer: An all-MLP Architecture for Vision Ilya O. Tolstikhin N. Houlsby Alexander Kolesnikov Lucas Beyer Xiaohua Zhai ... Andreas Steiner Daniel Keysers Jakob Uszkoreit Mario Lucic Alexey Dosovitskiy 521 2,716 0 04 May 2021
Fitbeat: COVID-19 Estimation based on Wristband Heart Rate Shuo Liu Jing Han Estela Laporta Puyal S. Kontaxis Shaoxiong Sun ... N. Cummins V. A. Narayan Matthew Hotopf Giancarlo Comi Björn Schuller 65 0 0 19 Apr 2021
A-FMI: Learning Attributions from Deep Networks via Feature Map Importance An Zhang Xiang Wang Chengfang Fang Jie Shi Tat-Seng Chua Zehua Chen FAtt 37 3 0 12 Apr 2021
Initializing ReLU networks in an expressive subspace of weights Dayal Singh J. SreejithG 22 4 0 23 Mar 2021
Learning with Hyperspherical Uniformity Weiyang Liu Rongmei Lin Zhen Liu Li Xiong Bernhard Schölkopf Adrian Weller 121 36 0 02 Mar 2021
Adaptive Rational Activations to Boost Deep Reinforcement Learning Quentin Delfosse P. Schramowski Martin Mundt Alejandro Molina Kristian Kersting 139 15 0 18 Feb 2021
Invertible DenseNets with Concatenated LipSwish Yura Perugachi-Diaz Jakub M. Tomczak Sandjai Bhulai 133 20 0 04 Feb 2021
GAN Inversion: A Survey Weihao Xia Yulun Zhang Yujiu Yang Jing-Hao Xue Bolei Zhou Ming-Hsuan Yang DiffM 251 520 0 14 Jan 2021
Exploring Emotion Features and Fusion Strategies for Audio-Video Emotion Recognition Hengshun Zhou Debin Meng Yuanyuan Zhang Xiaojiang Peng Jun Du Kai Wang Yu Qiao 63 65 0 27 Dec 2020
Why Convolutional Networks Learn Oriented Bandpass Filters: Theory and Empirical Support Isma Hadji Richard P. Wildes 23 2 0 30 Nov 2020
Online Ensemble Model Compression using Knowledge Distillation Devesh Walawalkar Zhiqiang Shen Marios Savvides 62 51 0 15 Nov 2020
QReLU and m-QReLU: Two novel quantum activation functions to aid medical diagnostics Luca Parisi D. Neagu R. Ma F. Campean MedIm 37 53 0 15 Oct 2020
On Convergence of Nearest Neighbor Classifiers over Feature Transformations Luka Rimanic Cédric Renggli Yue Liu Ce Zhang 118 15 0 15 Oct 2020
Unknown Presentation Attack Detection against Rational Attackers Ali Khodabakhsh Zahid Akhtar AAML 74 4 0 04 Oct 2020
Review: Deep Learning in Electron Microscopy Jeffrey M. Ede 197 80 0 17 Sep 2020
The Advantage Regret-Matching Actor-Critic A. Gruslys Marc Lanctot Rémi Munos Finbarr Timbers Martin Schmid ... Jean-Baptiste Lespiau John Schultz M. G. Azar Michael Bowling K. Tuyls OffRL 73 28 0 27 Aug 2020
Towards Modality Transferable Visual Information Representation with Optimal Model Compression Rongqun Lin Linwei Zhu Shiqi Wang Sam Kwong 63 2 0 13 Aug 2020
The VISIONE Video Search System: Exploiting Off-the-Shelf Text Search Engines for Large-Scale Video Retrieval Giuseppe Amato Paolo Bolettieri F. Carrara Franca Debole Fabrizio Falchi Claudio Gennaro Lucia Vadicamo Claudio Vairo 78 17 0 06 Aug 2020
On Connections between Regularizations for Improving DNN Robustness Yiwen Guo Long Chen Yurong Chen Changshui Zhang AAML 51 14 0 04 Jul 2020
MOSQUITO-NET: A deep learning based CADx system for malaria diagnosis along with model interpretation using GradCam and class activation maps Aayush Kumar Sanat B Singh S. Satapathy M. Rout 18 16 0 17 Jun 2020
On sparse connectivity, adversarial robustness, and a novel model of the artificial neuron Sergey Bochkanov AAML 66 0 0 16 Jun 2020
Channel Relationship Prediction with Forget-Update Module for Few-shot Classification Minglei Yuan Cunhao Cai Tong Lu ViT 14 0 0 16 Jun 2020
MMA Regularization: Decorrelating Weights of Neural Networks by Maximizing the Minimal Angles Zhennan Wang Canqun Xiang Wenbin Zou Chen Xu 100 19 0 06 Jun 2020
Rethinking Depthwise Separable Convolutions: How Intra-Kernel Correlations Lead to Improved MobileNets D. Haase Manuel Amthor 64 136 0 30 Mar 2020
Soft-Root-Sign Activation Function Yuan Zhou Dandan Li Shuwei Huo S. Kung ODL 62 25 0 01 Mar 2020
TAdam: A Robust Stochastic Gradient Optimizer Wendyam Eric Lionel Ilboudo Taisuke Kobayashi Kenji Sugimoto ODL 70 12 0 29 Feb 2020
Neural Network Compression Framework for fast model inference Alexander Kozlov Ivan Lazarevich Vasily Shamporov N. Lyalyushkin Yury Gorbachev 93 36 0 20 Feb 2020
A Generalized and Robust Method Towards Practical Gaze Estimation on Smart Phone Tianchu Guo Yongchao Liu Hui Zhang Xiabing Liu Youngjun Kwak ByungIn Yoo Jae-Joon Han Changkyu Choi 65 38 0 16 Oct 2019
Large Deviation Analysis of Function Sensitivity in Random Deep Neural Networks Bo Li D. Saad 64 12 0 13 Oct 2019
Orchestrating the Development Lifecycle of Machine Learning-Based IoT Applications: A Taxonomy and Survey Bin Qian Jie Su Z. Wen D. N. Jha Yinhao Li ... Albert Y. Zomaya Omer F. Rana Lizhe Wang Maciej Koutny R. Ranjan 71 4 0 11 Oct 2019
PolSAR Image Classification Based on Dilated Convolution and Pixel-Refining Parallel Mapping network in the Complex Domain Dongling Xiao Chang Liu Liu Chang Chao Wang Xin Zhang 32 9 0 24 Sep 2019
Natural-Logarithm-Rectified Activation Function in Convolutional Neural Networks Yang Liu Jianpeng Zhang Chao Gao Jinghua Qu Lixin Ji FAtt 56 23 0 10 Aug 2019
Recent Advances in Deep Learning for Object Detection Xiongwei Wu Doyen Sahoo Guosheng Lin VLM ObjD 131 824 0 10 Aug 2019