Super-Convergence: Very Fast Training of Neural Networks Using Large Learning Rates

23 August 2017

Papers citing "Super-Convergence: Very Fast Training of Neural Networks Using Large Learning Rates"

50 / 119 papers shown

Title
TimePFN: Effective Multivariate Time Series Forecasting with Synthetic Data Ege Onur Taga M. E. Ildiz Samet Oymak AI4TS 57 2 0 22 Feb 2025
BIOSCAN-5M: A Multimodal Dataset for Insect Biodiversity Zahra Gharaee Scott C. Lowe ZeMing Gong Pablo Millán Arias Nicholas Pellegrino ... Lila Kari Dirk Steinke Graham W. Taylor Paul Fieguth Angel X. Chang 56 8 0 28 Jan 2025
Many Perception Tasks are Highly Redundant Functions of their Input Data Rahul Ramesh Anthony Bisulco Ronald W. DiTullio Linran Wei Vijay Balasubramanian Kostas Daniilidis Pratik Chaudhari 44 2 0 18 Jul 2024
RoadRunner - Learning Traversability Estimation for Autonomous Off-road Driving Jonas Frey Shehryar Khattak Manthan Patel Deegan Atha Julian Nubert Curtis Padgett Marco Hutter Patrick Spieler 48 24 0 29 Feb 2024
Instance-aware 3D Semantic Segmentation powered by Shape Generators and Classifiers Bo Sun Qixing Huang Xiangru Huang 3DV 3DPC 38 0 0 21 Nov 2023
Point Neighborhood Embeddings Pedro Hermosilla 3DPC 27 0 0 03 Oct 2023
LISTER: Neighbor Decoding for Length-Insensitive Scene Text Recognition Changxu Cheng Peng Wang Cheng Da Qi Zheng Cong Yao 40 15 0 24 Aug 2023
On the Weight Dynamics of Deep Normalized Networks Christian H. X. Ali Mehmeti-Göpel Michael Wand 38 1 0 01 Jun 2023
MotifRetro: Exploring the Combinability-Consistency Trade-offs in retrosynthesis via Dynamic Motif Editing Zhangyang Gao Xingran Chen Cheng Tan Stan Z. Li 33 1 0 20 May 2023
The MiniPile Challenge for Data-Efficient Language Models Jean Kaddour MoE ALM 26 40 0 17 Apr 2023
Scale-Equivariant UNet for Histopathology Image Segmentation Yi-Lun Yang S. Dasmahapatra S. Mahmoodi 28 12 0 10 Apr 2023
ADS_UNet: A Nested UNet for Histopathology Image Segmentation Yi-Lun Yang S. Dasmahapatra S. Mahmoodi MedIm SSeg 34 16 0 10 Apr 2023
On Efficient Training of Large-Scale Deep Learning Models: A Literature Review Li Shen Yan Sun Zhiyuan Yu Liang Ding Xinmei Tian Dacheng Tao VLM 30 41 0 07 Apr 2023
Knowledge Distillation from Single to Multi Labels: an Empirical Study Youcai Zhang Yuzhuo Qin Heng-Ye Liu Yanhao Zhang Yaqian Li X. Gu VLM 53 2 0 15 Mar 2023
Comparing 3D deformations between longitudinal daily CBCT acquisitions using CNN for head and neck radiotherapy toxicity prediction W. Le C. Bang Philippine Cordelle D. Markel P. Nguyen-Tan Houda Bahig Samuel Kadoury 42 2 0 07 Mar 2023
Searching for Effective Neural Network Architectures for Heart Murmur Detection from Phonocardiogram Hao Wen Ji-Su Kang 24 7 0 06 Mar 2023
TAME: Attention Mechanism Based Feature Fusion for Generating Explanation Maps of Convolutional Neural Networks Mariano V. Ntrougkas Nikolaos Gkalelis Vasileios Mezaris FAtt 19 8 0 18 Jan 2023
Fine-Tuning Is All You Need to Mitigate Backdoor Attacks Zeyang Sha Xinlei He Pascal Berrang Mathias Humbert Yang Zhang AAML 13 33 0 18 Dec 2022
AirfRANS: High Fidelity Computational Fluid Dynamics Dataset for Approximating Reynolds-Averaged Navier-Stokes Solutions F. Bonnet Jocelyn Ahmed Mazari Paola Cinnella Patrick Gallinari AI4CE 33 54 0 15 Dec 2022
End-to-end Wind Turbine Wake Modelling with Deep Graph Representation Learning Siyi Li Mingrui Zhang M. Piggott 20 28 0 24 Nov 2022
Indian Commercial Truck License Plate Detection and Recognition for Weighbridge Automation Siddharth Agrawal Keyur D. Joshi 35 4 0 23 Nov 2022
Context-Matched Collage Generation for Underwater Invertebrate Detection R. McEver Bowen Zhang B. S. Manjunath 28 0 0 15 Nov 2022
Federated Averaging Langevin Dynamics: Toward a unified theory and new algorithms Vincent Plassier Alain Durmus Eric Moulines FedML 21 6 0 31 Oct 2022
PSA-Det3D: Pillar Set Abstraction for 3D object Detection Zhicong Huang Jingwen Zhao Zhijie Zheng Dihu Chen Haoxing Hu 3DPC 31 8 0 20 Oct 2022
Transformer Meets Boundary Value Inverse Problems Ruchi Guo Shuhao Cao Long Chen MedIm 38 21 0 29 Sep 2022
Periodic Graph Transformers for Crystal Material Property Prediction Keqiang Yan Yi Liu Yu-Ching Lin Shuiwang Ji AI4TS 88 84 0 23 Sep 2022
SEFormer: Structure Embedding Transformer for 3D Object Detection Xiaoyu Feng Heming Du Yueqi Duan Yong-Jin Liu Hehe Fan 3DPC ViT 35 10 0 05 Sep 2022
DUQIM-Net: Probabilistic Object Hierarchy Representation for Multi-View Manipulation Vladimir Tchuiev Yakov Miron Dotan Di Castro 27 6 0 19 Jul 2022
COO: Comic Onomatopoeia Dataset for Recognizing Arbitrary or Truncated Texts Jeonghun Baek Yusuke Matsui Kiyoharu Aizawa 42 13 0 11 Jul 2022
An extensible Benchmarking Graph-Mesh dataset for studying Steady-State Incompressible Navier-Stokes Equations F. Bonnet Jocelyn Ahmed Mazari T. Munzer P. Yser Patrick Gallinari AI4CE 66 10 0 29 Jun 2022
Robust SAR ATR on MSTAR with Deep Learning Models trained on Full Synthetic MOCEM data Benjamin Camus C. Barbu Eric Monteux 25 4 0 15 Jun 2022
Fully Convolutional One-Stage 3D Object Detection on LiDAR Range Images Zhi Tian Xiangxiang Chu Xiaoming Wang Xiaolin K. Wei Chunhua Shen 3DPC 25 97 0 27 May 2022
Transformer for Partial Differential Equations' Operator Learning Zijie Li Kazem Meidani A. Farimani 42 144 0 26 May 2022
Impact of Learning Rate on Noise Resistant Property of Deep Learning Models Omobayode Fagbohungbe Lijun Qian 32 3 0 08 May 2022
PTFlash : A deep learning framework for isothermal two-phase equilibrium calculations J. Qu T. Faney J. D. Hemptinne Soleiman Yousef Patrick Gallinari 18 0 0 06 May 2022
IMU Based Deep Stride Length Estimation With Self-Supervised Learning Jien-De Sui Tian-Sheuan Chang SSL 16 13 0 06 May 2022
Cross-view Transformers for real-time Map-view Semantic Segmentation Brady Zhou Philipp Krahenbuhl ViT 33 271 0 05 May 2022
Gradient Descent, Stochastic Optimization, and Other Tales Jun Lu 16 8 0 02 May 2022
RangeSeg: Range-Aware Real Time Segmentation of 3D LiDAR Point Clouds Tzu-Hsuan Chen T. Chang 3DPC 27 46 0 02 May 2022
Solving ImageNet: a Unified Scheme for Training any Backbone to Top Results T. Ridnik Hussam Lawen Emanuel Ben-Baruch Asaf Noy 38 11 0 07 Apr 2022
DIP: Deep Inverse Patchmatch for High-Resolution Optical Flow Zihua Zheng Ni Nie Zhi Ling Pengfei Xiong Jiangyu Liu Hongya Wang Jiankun Li MDE 34 44 0 01 Apr 2022
Locomotion Policy Guided Traversability Learning using Volumetric Representations of Complex Environments Jonas Frey David Hoeller Shehryar Khattak Marco Hutter 26 53 0 29 Mar 2022
Robust Speaker Recognition with Transformers Using wav2vec 2.0 Sergey Novoselov G. Lavrentyeva Anastasia Avdeeva V. Volokhov Aleksei Gusev ViT 21 18 0 28 Mar 2022
AudioTagging Done Right: 2nd comparison of deep learning methods for environmental sound classification Juncheng Billy Li Shuhui Qu Po-Yao (Bernie) Huang Florian Metze VLM 36 9 0 25 Mar 2022
Self-supervised Video-centralised Transformer for Video Face Clustering Yujiang Wang Mingzhi Dong Jie Shen Yi-Si Luo Yiming Lin Pingchuan Ma Stavros Petridis M. Pantic ViT 28 3 0 24 Mar 2022
Not All Points Are Equal: Learning Highly Efficient Point-based Detectors for 3D LiDAR Point Clouds Yifan Zhang Qingyong Hu Guoquan Xu Yanxin Ma Jia-Hui Wan Yulan Guo 3DPC 39 265 0 21 Mar 2022
DXQ-Net: Differentiable LiDAR-Camera Extrinsic Calibration Using Quality-aware Flow Xin Jing X. Ding R. Xiong Huanjun Deng Yue Wang 3DPC 19 24 0 17 Mar 2022
CUE Vectors: Modular Training of Language Models Conditioned on Diverse Contextual Signals Scott Novotney Sreeparna Mukherjee Zeeshan Ahmed A. Stolcke 27 5 0 16 Mar 2022
DetFlowTrack: 3D Multi-object Tracking based on Simultaneous Optimization of Object Detection and Scene Flow Estimation Yueling Shen Guangming Wang Hesheng Wang VOT 3DPC 16 2 0 04 Mar 2022
Light Robust Monocular Depth Estimation For Outdoor Environment Via Monochrome And Color Camera Fusion Hyeonsoo Jang Yeongmin Ko Younkwan Lee M. Jeon MDE 25 1 0 24 Feb 2022