ResearchTrend.AI
Understanding and Improving Convolutional Neural Networks via Concatenated Rectified Linear Units
v1v2 (latest)

Understanding and Improving Convolutional Neural Networks via Concatenated Rectified Linear Units

Wenling Shang
Kihyuk Sohn
Diogo Almeida
Honglak Lee
ArXiv (abs)PDFHTML

Papers citing "Understanding and Improving Convolutional Neural Networks via Concatenated Rectified Linear Units"

50 / 171 papers shown
Title
Deep Actor-Critics with Tight Risk Certificates
Deep Actor-Critics with Tight Risk Certificates
Bahareh Tasdighi
Manuel Haussmann
Yi-Shan Wu
A. Masegosa
M. Kandemir
UQCV
88
0
0
26 May 2025
VeLU: Variance-enhanced Learning Unit for Deep Neural Networks
VeLU: Variance-enhanced Learning Unit for Deep Neural Networks
Ashkan Shakarami
Yousef Yeganeh
Azade Farshad
Lorenzo Nicolè
Stefano Ghidoni
Nassir Navab
92
0
0
21 Apr 2025
Experience Replay Addresses Loss of Plasticity in Continual Learning
Experience Replay Addresses Loss of Plasticity in Continual Learning
Jiuqi Wang
Rohan Chandra
Shangtong Zhang
CLLKELM
168
0
0
25 Mar 2025
Parseval Regularization for Continual Reinforcement Learning
Parseval Regularization for Continual Reinforcement Learning
Wesley Chung
Lynn Cherif
David Meger
Doina Precup
CLL
123
5
0
10 Dec 2024
Lightweight Gaze Estimation Model Via Fusion Global Information
Lightweight Gaze Estimation Model Via Fusion Global Information
Zhang Cheng
Yanxia Wang
174
0
0
27 Nov 2024
DASH: Warm-Starting Neural Network Training in Stationary Settings without Loss of Plasticity
DASH: Warm-Starting Neural Network Training in Stationary Settings without Loss of Plasticity
Baekrok Shin
Junsoo Oh
Hanseul Cho
Chulhee Yun
AI4CE
104
1
0
30 Oct 2024
Plastic Learning with Deep Fourier Features
Plastic Learning with Deep Fourier Features
Alex Lewandowski
Dale Schuurmans
Marlos C. Machado
CLL
102
3
0
27 Oct 2024
Analytic Convolutional Layer: A Step to Analytic Neural Network
Analytic Convolutional Layer: A Step to Analytic Neural Network
Jingmao Cui
Donglai Tao
Linmi Tao
Ruiyang Liu
Yu Cheng
49
0
0
03 Jul 2024
Learning Continually by Spectral Regularization
Learning Continually by Spectral Regularization
Alex Lewandowski
Saurabh Kumar
Dale Schuurmans
András Gyorgy
Marlos C. Machado
CLL
89
6
0
10 Jun 2024
ConPCO: Preserving Phoneme Characteristics for Automatic Pronunciation Assessment Leveraging Contrastive Ordinal Regularization
ConPCO: Preserving Phoneme Characteristics for Automatic Pronunciation Assessment Leveraging Contrastive Ordinal Regularization
Bi-Cheng Yan
Wei-Cheng Chao
Jiun-Ting Li
Yi-Cheng Wang
Hsin-Wei Wang
Meng-Shin Lin
Berlin Chen
57
0
0
05 Jun 2024
Fast TRAC: A Parameter-Free Optimizer for Lifelong Reinforcement Learning
Fast TRAC: A Parameter-Free Optimizer for Lifelong Reinforcement Learning
Aneesh Muppidi
Zhiyu Zhang
Heng Yang
78
6
0
26 May 2024
Hidden Synergy: $L_1$ Weight Normalization and 1-Path-Norm Regularization
Hidden Synergy: L1L_1 Weight Normalization and 1-Path-Norm Regularization
Aditya Biswas
81
1
0
29 Apr 2024
3D-aware Image Generation and Editing with Multi-modal Conditions
3D-aware Image Generation and Editing with Multi-modal Conditions
Bo Li
Yike Li
Zhien He
Bin Liu
Yu-Kun Lai
67
2
0
11 Mar 2024
A Case for Validation Buffer in Pessimistic Actor-Critic
A Case for Validation Buffer in Pessimistic Actor-Critic
Michal Nauman
M. Ostaszewski
Marek Cygan
68
0
0
01 Mar 2024
BERT4FCA: A Method for Bipartite Link Prediction using Formal Concept Analysis and BERT
BERT4FCA: A Method for Bipartite Link Prediction using Formal Concept Analysis and BERT
Siqi Peng
Hongyuan Yang
Akihiro Yamamoto
37
3
0
13 Feb 2024
City Scene Super-Resolution via Geometric Error Minimization
City Scene Super-Resolution via Geometric Error Minimization
Zhengyang Lu
Feng Wang
44
2
0
14 Jan 2024
From Data to Insights: A Comprehensive Survey on Advanced Applications in Thyroid Cancer Research
From Data to Insights: A Comprehensive Survey on Advanced Applications in Thyroid Cancer Research
Xinyu Zhang
Vincent C. S. Lee
Feng Liu
49
3
0
08 Jan 2024
Directions of Curvature as an Explanation for Loss of Plasticity
Directions of Curvature as an Explanation for Loss of Plasticity
Alex Lewandowski
Haruto Tanaka
Dale Schuurmans
Marlos C. Machado
110
7
0
30 Nov 2023
Invariance Measures for Neural Networks
Invariance Measures for Neural Networks
F. Quiroga
J. Torrents-Barrena
Laura Lanzarini
Domenec Puig-Valls
31
4
0
26 Oct 2023
Revisiting Plasticity in Visual Reinforcement Learning: Data, Modules and Training Stages
Revisiting Plasticity in Visual Reinforcement Learning: Data, Modules and Training Stages
Guozheng Ma
Lu Li
Sen Zhang
Zixuan Liu
Zhen Wang
Yixin Chen
Li Shen
Xueqian Wang
Dacheng Tao
OffRL
97
21
0
11 Oct 2023
Are GATs Out of Balance?
Are GATs Out of Balance?
Nimrah Mustafa
Aleksandar Bojchevski
R. Burkholz
130
5
0
11 Oct 2023
Generalized Activation via Multivariate Projection
Generalized Activation via Multivariate Projection
Jiayun Li
Yuxiao Cheng
Yiwen Lu
Zhuofan Xia
Yilin Mo
Gao Huang
LLMSV
37
0
0
29 Sep 2023
On the Efficacy of Multi-scale Data Samplers for Vision Applications
On the Efficacy of Multi-scale Data Samplers for Vision Applications
Elvis Nunez
Thomas Merth
Anish K. Prabhu
Mehrdad Farajtabar
Mohammad Rastegari
Sachin Mehta
Maxwell Horton
50
1
0
08 Sep 2023
Maintaining Plasticity in Continual Learning via Regenerative Regularization
Maintaining Plasticity in Continual Learning via Regenerative Regularization
Saurabh Kumar
Henrik Marklund
Benjamin Van Roy
CLLKELM
128
23
0
23 Aug 2023
PLASTIC: Improving Input and Label Plasticity for Sample Efficient Reinforcement Learning
PLASTIC: Improving Input and Label Plasticity for Sample Efficient Reinforcement Learning
Hojoon Lee
Hanseul Cho
Hyunseung Kim
Daehoon Gwak
Joonkee Kim
Jaegul Choo
Se-Young Yun
Chulhee Yun
OffRL
157
30
0
19 Jun 2023
Learn to Enhance the Negative Information in Convolutional Neural Network
Learn to Enhance the Negative Information in Convolutional Neural Network
Zhicheng Cai
Chenglei Peng
Qiu Shen
45
0
0
18 Jun 2023
Bringing regularized optimal transport to lightspeed: a splitting method adapted for GPUs
Bringing regularized optimal transport to lightspeed: a splitting method adapted for GPUs
Jacob Lindbäck
Zesen Wang
Mikael Johansson
OT
98
1
0
29 May 2023
A Comparative Study of Face Detection Algorithms for Masked Face Detection
A Comparative Study of Face Detection Algorithms for Masked Face Detection
Sahel Mohammad Iqbal
Danush Shekar
Subhankar Mishra
CVBM
73
0
0
18 May 2023
Loss of Plasticity in Continual Deep Reinforcement Learning
Loss of Plasticity in Continual Deep Reinforcement Learning
Zaheer Abbas
Rosie Zhao
Joseph Modayil
Adam White
Marlos C. Machado
CLLOffRL
118
85
0
13 Mar 2023
Densely Connected $G$-invariant Deep Neural Networks with Signed Permutation Representations
Densely Connected GG-invariant Deep Neural Networks with Signed Permutation Representations
Devanshu Agrawal
James Ostrowski
AI4CE
70
0
0
08 Mar 2023
Towards NeuroAI: Introducing Neuronal Diversity into Artificial Neural Networks
Towards NeuroAI: Introducing Neuronal Diversity into Artificial Neural Networks
Fenglei Fan
Yingxin Li
Hanchuan Peng
T. Zeng
Fei Wang
65
6
0
23 Jan 2023
Deep Diversity-Enhanced Feature Representation of Hyperspectral Images
Deep Diversity-Enhanced Feature Representation of Hyperspectral Images
Jinhui Hou
Zhiyu Zhu
Junhui Hou
Hui Liu
Huanqiang Zeng
Deyu Meng
114
6
0
15 Jan 2023
Learnable Heterogeneous Convolution: Learning both topology and strength
Learnable Heterogeneous Convolution: Learning both topology and strength
Rongzhen Zhao
Zhenzhi Wu
Qikun Zhang
80
6
0
13 Jan 2023
Increasing biases can be more efficient than increasing weights
Increasing biases can be more efficient than increasing weights
C. Metta
M. Fantozzi
Andrea Papini
G. Amato
Matteo Bergamaschi
S. Galfrè
Alessandro Marchetti
Michelangelo Vegliò
Maurizio Parton
F. Morandin
56
4
0
03 Jan 2023
Pushing the Efficiency Limit Using Structured Sparse Convolutions
Pushing the Efficiency Limit Using Structured Sparse Convolutions
Vinay Kumar Verma
Nikhil Mehta
Shijing Si
Ricardo Henao
Lawrence Carin
50
3
0
23 Oct 2022
Retinex Image Enhancement Based on Sequential Decomposition With a Plug-and-Play Framework
Retinex Image Enhancement Based on Sequential Decomposition With a Plug-and-Play Framework
Tingting Wu
Wei Wu
Ying Yang
Fenglei Fan
T. Zeng
105
10
0
11 Oct 2022
Dynamical Isometry for Residual Networks
Dynamical Isometry for Residual Networks
Advait Gadhikar
R. Burkholz
ODLAI4CE
81
2
0
05 Oct 2022
FaceTopoNet: Facial Expression Recognition using Face Topology Learning
FaceTopoNet: Facial Expression Recognition using Face Topology Learning
Mojtaba Kolahdouzi
Alireza Sepas-Moghaddam
Ali Etemad
3DHCVBM
55
9
0
13 Sep 2022
How important are activation functions in regression and classification? A survey, performance comparison, and future directions
How important are activation functions in regression and classification? A survey, performance comparison, and future directions
Ameya Dilip Jagtap
George Karniadakis
AI4CE
121
74
0
06 Sep 2022
Piecewise Linear Neural Networks and Deep Learning
Piecewise Linear Neural Networks and Deep Learning
Qinghua Tao
Li Li
Xiaolin Huang
Xiangming Xi
Shuning Wang
Johan A. K. Suykens
43
30
0
18 Jun 2022
On the Number of Regions of Piecewise Linear Neural Networks
On the Number of Regions of Piecewise Linear Neural Networks
Alexis Goujon
Arian Etemadi
M. Unser
116
15
0
17 Jun 2022
Constrained Monotonic Neural Networks
Constrained Monotonic Neural Networks
D. Runje
Sharath M. Shankaranarayana
64
20
0
24 May 2022
Most Activation Functions Can Win the Lottery Without Excessive Depth
Most Activation Functions Can Win the Lottery Without Excessive Depth
R. Burkholz
MLT
115
18
0
04 May 2022
Out of Distribution Detection, Generalization, and Robustness Triangle with Maximum Probability Theorem
Out of Distribution Detection, Generalization, and Robustness Triangle with Maximum Probability Theorem
Amir Emad Marvasti
Ehsan Emad Marvasti
Ulas Bagci
OOD
43
0
0
23 Mar 2022
Adversarial Parameter Attack on Deep Neural Networks
Adversarial Parameter Attack on Deep Neural Networks
Lijia Yu
Yihan Wang
Xiao-Shan Gao
AAML
76
8
0
20 Mar 2022
Update Compression for Deep Neural Networks on the Edge
Update Compression for Deep Neural Networks on the Edge
Bo Chen
A. Bakhshi
Gustavo E. A. P. A. Batista
Brian Ng
Tat-Jun Chin
55
18
0
09 Mar 2022
Activation Functions: Dive into an optimal activation function
Activation Functions: Dive into an optimal activation function
V. Bansal
FAtt
57
2
0
24 Feb 2022
Graph-adaptive Rectified Linear Unit for Graph Neural Networks
Graph-adaptive Rectified Linear Unit for Graph Neural Networks
Yifei Zhang
Hao Zhu
Ziqiao Meng
Piotr Koniusz
Irwin King
92
32
0
13 Feb 2022
Combining Intra-Risk and Contagion Risk for Enterprise Bankruptcy Prediction Using Graph Neural Networks
Combining Intra-Risk and Contagion Risk for Enterprise Bankruptcy Prediction Using Graph Neural Networks
Yu Zhao
Shaopeng Wei
Yu-Meng Guo
Qing Yang
Xingyan Chen
Qing Li
Fuzhen Zhuang
Ji Liu
Gang Kou
72
21
0
01 Feb 2022
Training Thinner and Deeper Neural Networks: Jumpstart Regularization
Training Thinner and Deeper Neural Networks: Jumpstart Regularization
Carles Roger Riera Molina
Camilo Rey
Thiago Serra
Eloi Puertas
O. Pujol
68
4
0
30 Jan 2022

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.