A disciplined approach to neural network hyper-parameters: Part 1 -- learning rate, batch size, momentum, and weight decay

26 March 2018

Papers citing "A disciplined approach to neural network hyper-parameters: Part 1 -- learning rate, batch size, momentum, and weight decay"

36 / 86 papers shown

Title
Image Classification with Classic and Deep Learning Techniques Oscar Lorente Ian Riera A. Rana VLM 14 33 0 11 May 2021
ImageNet-21K Pretraining for the Masses T. Ridnik Emanuel Ben-Baruch Asaf Noy Lihi Zelnik-Manor SSeg VLM CLIP 176 686 0 22 Apr 2021
More Than Meets The Eye: Semi-supervised Learning Under Non-IID Data Saul Calderon-Ramirez Luis Oala 25 5 0 20 Apr 2021
Perceptual Loss for Robust Unsupervised Homography Estimation Daniel Koguciuk Elahe Arani Bahram Zonooz 21 28 0 20 Apr 2021
Predicting brain-age from raw T 1 -weighted Magnetic Resonance Imaging data using 3D Convolutional Neural Networks L. Fisch J. Ernsting N. Winter V. Holstein Ramona Leenings ... T. Kircher Benjamin Risse U. Dannlowski Klaus Berger Tim Hahn MedIm 23 12 0 22 Mar 2021
MBAPose: Mask and Bounding-Box Aware Pose Estimation of Surgical Instruments with Photorealistic Domain Randomization Masakazu Yoshimura M. M. Marinho K. Harada M. Mitsuishi 25 5 0 15 Mar 2021
Symmetry meets AI G. Barenboim J. Hirn V. Sanz 17 21 0 10 Mar 2021
Toward a Next Generation Particle Precipitation Model: Mesoscale Prediction Through Machine Learning (a Case Study and Framework for Progress) R. McGranaghan Jack L. Ziegler T. Bloch S. Hatch E. Camporeale K. Lynch M. Owens J. Gjerloev Binzheng Zhang S. Skone 22 19 0 19 Nov 2020
(Un)Masked COVID-19 Trends from Social Media A. Singh Paras Mehan Divyanshu Sharma Rohan Pandey Tavpritesh Sethi Ponnurangam Kumaraguru 24 1 0 30 Oct 2020
Hybrid Backpropagation Parallel Reservoir Networks Matthew Evanusa Snehesh Shrestha M. Girvan Cornelia Fermuller Yiannis Aloimonos AI4TS 27 0 0 27 Oct 2020
Sequence-to-sequence Singing Voice Synthesis with Perceptual Entropy Loss Jiatong Shi Shuai Guo Nan Huo Yuekai Zhang Qin Jin 15 27 0 22 Oct 2020
Towards a Flexible Embedding Learning Framework Chin-Chia Michael Yeh Dhruv Gelda Zhongfang Zhuang Yan Zheng Liang Gou Wei Zhang 20 9 0 23 Sep 2020
InfoFocus: 3D Object Detection for Autonomous Driving with Dynamic Information Modeling Jun Wang Shiyi Lan M. Gao L. Davis 3DPC 19 65 0 16 Jul 2020
Deep Learning for Abstract Argumentation Semantics Dennis Craandijk Floris Bex SSeg 18 30 0 15 Jul 2020
Influence Functions in Deep Learning Are Fragile S. Basu Phillip E. Pope S. Feizi TDI 13 219 0 25 Jun 2020
Road surface detection and differentiation considering surface damages Thiago Rateke A. V. Wangenheim 12 56 0 23 Jun 2020
NTIRE 2020 Challenge on Spectral Reconstruction from an RGB Image Boaz Arad Radu Timofte Ohad Ben-Shahar Yi-Tun Lin G. Finlayson Shai Givati Mohamed H. Sedky 49 122 0 07 May 2020
BlackBox: Generalizable Reconstruction of Extremal Values from Incomplete Spatio-Temporal Data T. Ivek Domagoj Vlah 38 4 0 30 Apr 2020
MXR-U-Nets for Real Time Hyperspectral Reconstruction Atmadeep Banerjee Akash Palrecha SupR 17 11 0 15 Apr 2020
CRYSPNet: Crystal Structure Predictions via Neural Network Haotong Liang V. Stanev A. Kusne Ichiro Takeuchi 11 37 0 31 Mar 2020
TResNet: High Performance GPU-Dedicated Architecture T. Ridnik Hussam Lawen Asaf Noy Emanuel Ben-Baruch Gilad Sharir Itamar Friedman OOD 20 211 0 30 Mar 2020
Learning Architectures for Binary Networks Dahyun Kim Kunal Pratap Singh Jonghyun Choi MQ 25 44 0 17 Feb 2020
Improving Polyphonic Music Models with Feature-Rich Encoding Omar Peracha 28 12 0 26 Nov 2019
Demon: Improved Neural Network Training with Momentum Decay John Chen Cameron R. Wolfe Zhaoqi Li Anastasios Kyrillidis ODL 8 15 0 11 Oct 2019
The merits of Universal Language Model Fine-tuning for Small Datasets -- a case with Dutch book reviews Benjamin van der Burgh Suzan Verberne VLM 19 22 0 02 Oct 2019
Frustratingly Easy Natural Question Answering Lin Pan Rishav Chakravarti Anthony Ferritto Michael R. Glass A. Gliozzo Salim Roukos Radu Florian Avirup Sil 13 14 0 11 Sep 2019
Span Selection Pre-training for Question Answering Michael R. Glass A. Gliozzo Rishav Chakravarti Anthony Ferritto Lin Pan G P Shrivatsa Bhargav Dinesh Garg Avirup Sil RALM 30 70 0 09 Sep 2019
Bidirectional Context-Aware Hierarchical Attention Network for Document Understanding Jean-Baptiste Remy A. Tixier Michalis Vazirgiannis 27 5 0 16 Aug 2019
Adversarial Attack Generation Empowered by Min-Max Optimization Jingkang Wang Tianyun Zhang Sijia Liu Pin-Yu Chen Jiacen Xu M. Fardad B. Li AAML 23 35 0 09 Jun 2019
Embedded hyper-parameter tuning by Simulated Annealing M. Fischetti Matteo Stringher 11 14 0 04 Jun 2019
Accurate Visual Localization for Automotive Applications Eli Brosh Matan Friedmann I. Kadar Lev Yitzhak Lavy Elad Levi S. Rippa Y. Lempert Bruno Fernandez-Ruiz Roei Herzig Trevor Darrell 28 24 0 01 May 2019
ResUNet-a: a deep learning framework for semantic segmentation of remotely sensed data F. Diakogiannis F. Waldner P. Caccetta Chen Wu SSeg 13 1,275 0 01 Apr 2019
Skin Lesions Classification Using Convolutional Neural Networks in Clinical Images Danilo Barros Mendes Nilton Correia da Silva MedIm 16 46 0 06 Dec 2018
3D Human Pose Estimation with 2D Marginal Heatmaps Aiden Nibali Zhen He Stuart Morgan L. Prendergast 3DH 24 94 0 05 Jun 2018
Understanding Batch Normalization Johan Bjorck Carla P. Gomes B. Selman Kilian Q. Weinberger 11 592 0 01 Jun 2018
Regularization Learning Networks: Deep Learning for Tabular Datasets Ira Shavitt E. Segal AI4CE 13 20 0 16 May 2018