Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification

6 February 2015

Papers citing "Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification"

50 / 184 papers shown

Title
Pushing the Limits of Sparsity: A Bag of Tricks for Extreme Pruning Andy Li A. Durrant Milan Markovic Lu Yin Georgios Leontidis Tianlong Chen Lu Yin Georgios Leontidis 121 0 0 20 Nov 2024
Hysteresis Activation Function for Efficient Inference Moshe Kimhi Idan Kashani A. Mendelson Chaim Baskin LLMSV 79 0 0 15 Nov 2024
Untrained Perceptual Loss for image denoising of line-like structures in MR images Elisabeth Pfaehler Daniel Pflugfelder Hanno Scharr 43 0 0 08 Nov 2024
Theoretical characterisation of the Gauss-Newton conditioning in Neural Networks Jim Zhao Sidak Pal Singh Aurelien Lucchi AI4CE 90 0 0 04 Nov 2024
LSEAttention is All You Need for Time Series Forecasting Dizhen Liang AI4TS 49 0 0 31 Oct 2024
Fourier Head: Helping Large Language Models Learn Complex Probability Distributions Nate Gillman Daksh Aggarwal Michael Freeman Saurabh Singh Chen Sun AI4TS 73 3 0 29 Oct 2024
EoRA: Fine-tuning-free Compensation for Compressed LLM with Eigenspace Low-Rank Approximation Shih-yang Liu Huck Yang Nai Chit Fung Charbel Sakr Hongxu Yin ... Jan Kautz Yu-Chun Wang Pavlo Molchanov Min-Hung Chen Min-Hung Chen MQ 67 0 0 28 Oct 2024
A Probabilistic Model for Skill Acquisition with Switching Latent Feedback Controllers Juyan Zhang Dana Kulic Michael Burke 54 0 0 18 Oct 2024
HSR-Enhanced Sparse Attention Acceleration Bo Chen Yingyu Liang Zhizhou Sha Zhenmei Shi Zhao Song 193 21 0 14 Oct 2024
Improving Colorectal Cancer Screening and Risk Assessment through Predictive Modeling on Medical Images and Records Shuai Jiang Christina Robinson Joseph Anderson William Hisey Lynn Butterly A. Suriawinata Saeed Hassanpour 48 0 0 13 Oct 2024
MTL-LoRA: Low-Rank Adaptation for Multi-Task Learning Yaming Yang Dilxat Muhtar Yelong Shen Yuefeng Zhan Jianfeng Liu ... Denvy Deng Feng Sun Qi Zhang Weizhu Chen Yunhai Tong MoE MoMe 107 2 0 12 Oct 2024
JPEG Inspired Deep Learning Ahmed H. Salamah Kaixiang Zheng Yiwen Liu En-Hui Yang 55 0 0 09 Oct 2024
Fast Training of Sinusoidal Neural Fields via Scaling Initialization Taesun Yeom Sangyoon Lee Jaeho Lee 83 3 0 07 Oct 2024
Associative memory and dead neurons V. Fanaskov Ivan Oseledets 75 1 0 02 Oct 2024
Deep activity propagation via weight initialization in spiking neural networks Aurora Micheli Olaf Booij Jan van Gemert Nergis Tömen 69 0 0 01 Oct 2024
Cauchy activation function and XNet Xin Li Zhihong Xia Hongkun Zhang 169 6 0 28 Sep 2024
Unconditional stability of a recurrent neural circuit implementing divisive normalization Shivang Rawat David J. Heeger Stefano Martiniani 164 1 0 27 Sep 2024
Equivariant Machine Learning Decoder for 3D Toric Codes Oliver Weissl Evgenii Egorov 49 0 0 06 Sep 2024
Subspace Representation Learning for Sparse Linear Arrays to Localize More Sources than Sensors: A Deep Learning Methodology Kuan-Lin Chen Bhaskar D. Rao 46 1 0 29 Aug 2024
Amortized Bayesian Multilevel Models Daniel Habermann Marvin Schmitt Lars Kühmichel Andreas Bulling Stefan T. Radev Paul-Christian Bürkner 180 4 0 23 Aug 2024
Controlled Learning of Pointwise Nonlinearities in Neural-Network-Like Architectures Michael Unser Alexis Goujon Stanislas Ducotterd 75 2 0 23 Aug 2024
Practical Aspects on Solving Differential Equations Using Deep Learning: A Primer Georgios Is. Detorakis 86 0 0 21 Aug 2024
Oja's plasticity rule overcomes several challenges of training neural networks under biological constraints Navid Shervani-Tabar Marzieh Alireza Mirhoseini Robert Rosenbaum AAML AI4CE 96 0 0 15 Aug 2024
A new approach for encoding code and assisting code understanding Mengdan Fan Changde Du Haiyan Zhao Zhi Jin 109 0 0 01 Aug 2024
Bias of Stochastic Gradient Descent or the Architecture: Disentangling the Effects of Overparameterization of Neural Networks Amit Peleg Matthias Hein 49 0 0 04 Jul 2024
Neural Networks Trained by Weight Permutation are Universal Approximators Yongqiang Cai Gaohang Chen Zhonghua Qiao 143 1 0 01 Jul 2024
Enhancing Monotonic Modeling with Spatio-Temporal Adaptive Awareness in Diverse Marketing Bin Li Jiayan Pei Feiyang Xiao Yifan Zhao Zhixing Zhang Diwei Liu Hengxu He Jia Jia 49 0 0 20 Jun 2024
Loss Gradient Gaussian Width based Generalization and Optimization Guarantees A. Banerjee Qiaobo Li Yingxue Zhou 102 0 0 11 Jun 2024
Equivariant Neural Tangent Kernels Philipp Misof Pan Kessel Jan E. Gerken 166 0 0 10 Jun 2024
CTBENCH: A Library and Benchmark for Certified Training Yuhao Mao Stefan Balauca Martin Vechev OOD 81 5 0 07 Jun 2024
CorDA: Context-Oriented Decomposition Adaptation of Large Language Models for Task-Aware Parameter-Efficient Fine-tuning Yibo Yang Xiaojie Li Zhongzhu Zhou Shuaiwen Leon Song Jianlong Wu Liqiang Nie Guohao Li 71 12 0 07 Jun 2024
Fusion-PSRO: Nash Policy Fusion for Policy Space Response Oracles Jiesong Lian Yucong Huang Chengdong Ma Mingzhi Wang Ying Wen Long Hu Yixue Hao 79 1 0 31 May 2024
Semiring Activation in Neural Networks B. Smets Peter D. Donker Jim W. Portegies LLMSV 49 0 0 29 May 2024
From Learning to Optimize to Learning Optimization Algorithms Camille Castera Peter Ochs 137 1 0 28 May 2024
Pretraining with Random Noise for Fast and Robust Learning without Weight Transport Jeonghwan Cheon Sang Wan Lee Se-Bum Paik OOD 344 2 0 27 May 2024
When does compositional structure yield compositional generalization? A kernel theory Samuel Lippl Kim Stachenfeld NAI CoGe 200 9 0 26 May 2024
Unsupervised Meta-Learning via In-Context Learning Anna Vettoruzzo Lorenzo Braccaioli Joaquin Vanschoren M. Nowaczyk SSL 93 1 0 25 May 2024
Tighter Privacy Auditing of DP-SGD in the Hidden State Threat Model Tudor Cebere A. Bellet Nicolas Papernot 75 10 0 23 May 2024
A Multi-Modal Explainability Approach for Human-Aware Robots in Multi-Party Conversation Iveta Becková Stefan Pócos Giulia Belgiovine Marco Matarese A. Sciutti Carlo Mazzola Carlo Mazzola 80 0 0 20 May 2024
Efficient Deep Learning with Decorrelated Backpropagation Sander Dalm Joshua Offergeld Nasir Ahmad Marcel van Gerven 146 5 0 03 May 2024
ATOM: Attention Mixer for Efficient Dataset Distillation Samir Khaki A. Sajedi Kai Wang Lucy Z. Liu Y. Lawryshyn Konstantinos N. Plataniotis 106 3 0 02 May 2024
NIR-Assisted Image Denoising: A Selective Fusion Approach and A Real-World Benchmark Dataset Rongjian Xu Zhilu Zhang Ren-Rong Wu Wangmeng Zuo 58 2 0 12 Apr 2024
Variational Stochastic Gradient Descent for Deep Neural Networks Haotian Chen Anna Kuzina Babak Esmaeili Jakub M. Tomczak 62 0 0 09 Apr 2024
PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Models Fanxu Meng Zhaohui Wang Muhan Zhang VLM 114 95 0 03 Apr 2024
Nonlinearity Enhanced Adaptive Activation Functions David Yevick 54 1 0 29 Mar 2024
Cross-domain Fiber Cluster Shape Analysis for Language Performance Cognitive Score Prediction Yui Lo Yuqian Chen Dongnan Liu Wan Liu L. Zekelman ... Yogesh Rathi N. Makris A. Golby Weidong Cai L. O’Donnell 78 6 0 27 Mar 2024
HyperFusion: A Hypernetwork Approach to Multimodal Integration of Tabular and Medical Imaging Data for Predictive Modeling Daniel Duenias Brennan Nichyporuk Tal Arbel Tammy Riklin-Raviv 73 4 0 20 Mar 2024
Explainable Machine Learning-Based Security and Privacy Protection Framework for Internet of Medical Things Systems Ayoub Si-Ahmed M. Al-garadi Boustia Narhimene 78 4 0 14 Mar 2024
Directional Smoothness and Gradient Methods: Convergence and Adaptivity Aaron Mishkin Ahmed Khaled Yuanhao Wang Aaron Defazio Robert Mansel Gower 77 9 0 06 Mar 2024
Uncertainty quantification in fine-tuned LLMs using LoRA ensembles Oleksandr Balabanov Hampus Linander UQCV 88 18 0 19 Feb 2024