Simulated Annealing in Early Layers Leads to Better Generalization

Simulated Annealing in Early Layers Leads to Better Generalization

10 April 2023

Zahra Karimpour

Muawiz Chaudhary

Mirco Ravanelli

Eugene Belilovsky

ArXiv (abs)PDF HTML

Papers citing "Simulated Annealing in Early Layers Leads to Better Generalization"

19 / 19 papers shown

Title
Gradient-Guided Annealing for Domain Generalization Aristotelis Ballas Christos Diou OOD 599 1 0 27 Feb 2025
Sample Selection via Contrastive Fragmentation for Noisy Label Regression C. Kim Sangwoo Moon Jihwan Moon Dongyeon Woo Gunhee Kim NoLa 175 0 0 25 Feb 2025
Fortuitous Forgetting in Connectionist Networks Hattie Zhou Ankit Vani Hugo Larochelle Aaron Courville CLL 68 45 0 01 Feb 2022
Deep Learning Through the Lens of Example Difficulty R. Baldock Hartmut Maennel Behnam Neyshabur 85 161 0 17 Jun 2021
Self-training for Few-shot Transfer Across Extreme Task Differences Cheng Perng Phoo B. Hariharan SSL 117 108 0 15 Oct 2020
Sharpness-Aware Minimization for Efficiently Improving Generalization Pierre Foret Ariel Kleiner H. Mobahi Behnam Neyshabur AAML 199 1,359 0 03 Oct 2020
When Does Label Smoothing Help? Rafael Müller Simon Kornblith Geoffrey E. Hinton UQCV 212 1,955 0 06 Jun 2019
Deconstructing Lottery Tickets: Zeros, Signs, and the Supermask Hattie Zhou Janice Lan Rosanne Liu J. Yosinski UQCV 65 389 0 03 May 2019
Skin Lesion Analysis Toward Melanoma Detection 2018: A Challenge Hosted by the International Skin Imaging Collaboration (ISIC) Noel Codella V. Rotemberg P. Tschandl M. E. Celebi Stephen W. Dusza ... Aadi Kalloo Konstantinos Liopyris Michael Marchetti Harald Kittler Allan Halpern 113 1,193 0 09 Feb 2019
Knowledge Distillation in Generations: More Tolerant Teachers Educate Better Students Chenglin Yang Lingxi Xie Siyuan Qiao Alan Yuille 80 136 0 15 May 2018
The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks Jonathan Frankle Michael Carbin 274 3,488 0 09 Mar 2018
Learning to Compare: Relation Network for Few-Shot Learning Flood Sung Yongxin Yang Li Zhang Tao Xiang Philip Torr Timothy M. Hospedales 314 4,054 0 16 Nov 2017
EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classification P. Helber B. Bischke Andreas Dengel Damian Borth 158 1,834 0 31 Aug 2017
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 833 11,952 0 09 Mar 2017
SGDR: Stochastic Gradient Descent with Warm Restarts I. Loshchilov Frank Hutter ODL 350 8,179 0 13 Aug 2016
Matching Networks for One Shot Learning Oriol Vinyals Charles Blundell Timothy Lillicrap Koray Kavukcuoglu Daan Wierstra VLM 378 7,343 0 13 Jun 2016
Using Deep Learning for Image-Based Plant Disease Detection Sharada Mohanty David P. Hughes M. Salathé 45 3,132 0 11 Apr 2016
Rethinking the Inception Architecture for Computer Vision Christian Szegedy Vincent Vanhoucke Sergey Ioffe Jonathon Shlens Z. Wojna 3DV BDL 886 27,427 0 02 Dec 2015
Fine-Grained Visual Classification of Aircraft Subhransu Maji Esa Rahtu Arno Solin Matthew Blaschko Andrea Vedaldi 126 2,272 0 21 Jun 2013

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.