Escaping Saddle Points for Effective Generalization on Class-Imbalanced Data

28 December 2022

Papers citing "Escaping Saddle Points for Effective Generalization on Class-Imbalanced Data"

49 / 49 papers shown

Title
Balanced Contrastive Learning for Long-Tailed Visual Recognition Jianggang Zhu Ziyi Wang Jingjing Chen Yi-Ping Phoebe Chen Yueping Jiang 62 174 0 19 Jul 2022
A Closer Look at Smoothness in Domain Adversarial Training Harsh Rangwani Sumukh K Aithal Mayank Mishra Arihant Jain R. Venkatesh Babu 92 121 0 16 Jun 2022
Sharp-MAML: Sharpness-Aware Model-Agnostic Meta Learning Momin Abbas Quan-Wu Xiao Lisha Chen Pin-Yu Chen Tianyi Chen 55 80 0 08 Jun 2022
Surrogate Gap Minimization Improves Sharpness-Aware Training Juntang Zhuang Boqing Gong Liangzhe Yuan Huayu Chen Hartwig Adam Nicha Dvornek S. Tatikonda James Duncan Ting Liu 59 154 0 15 Mar 2022
Low-Pass Filtering SGD for Recovering Flat Optima in the Deep Learning Optimization Landscape Devansh Bisla Jing Wang A. Choromańska 64 36 0 20 Jan 2022
Sharpness-Aware Minimization Improves Language Model Generalization Dara Bahri H. Mobahi Yi Tay 152 103 0 16 Oct 2021
A Loss Curvature Perspective on Training Instability in Deep Learning Justin Gilmer Behrooz Ghorbani Ankush Garg Sneha Kudugunta Behnam Neyshabur David E. Cardoze George E. Dahl Zachary Nado Orhan Firat ODL 59 35 0 08 Oct 2021
Influence-Balanced Loss for Imbalanced Visual Classification Seulki Park Jongin Lim Younghan Jeon J. Choi CVBM 112 136 0 06 Oct 2021
Self Supervision to Distillation for Long-Tailed Visual Recognition Tianhao Li Limin Wang Gangshan Wu 69 103 0 09 Sep 2021
Parametric Contrastive Learning Jiequan Cui Zhisheng Zhong Shu Liu Bei Yu Jiaya Jia 82 275 0 26 Jul 2021
Distributional Robustness Loss for Long-tail Learning Dvir Samuel Gal Chechik OOD 64 100 0 07 Apr 2021
Improving Calibration for Long-Tailed Recognition Zhisheng Zhong Jiequan Cui Shu Liu Jiaya Jia 99 297 0 01 Apr 2021
Distilling Virtual Examples for Long-tailed Recognition Yingying He Jianxin Wu Xiu-Shen Wei 66 102 0 28 Mar 2021
Label-Imbalanced and Group-Sensitive Classification under Overparameterization Ganesh Ramachandra Kini Orestis Paraskevas Samet Oymak Christos Thrampoulidis 66 96 0 02 Mar 2021
Long-tailed Recognition by Routing Diverse Distribution-Aware Experts Xudong Wang Long Lian Zhongqi Miao Ziwei Liu Stella X. Yu 105 388 0 05 Oct 2020
Sharpness-Aware Minimization for Efficiently Improving Generalization Pierre Foret Ariel Kleiner H. Mobahi Behnam Neyshabur AAML 184 1,342 0 03 Oct 2020
Long-tail learning via logit adjustment A. Menon Sadeep Jayasumana A. S. Rawat Himanshu Jain Andreas Veit Sanjiv Kumar 109 706 0 14 Jul 2020
Rethinking the Value of Labels for Improving Class-Imbalanced Learning Yuzhe Yang Zhi Xu SSL 119 407 0 13 Jun 2020
Supervised Contrastive Learning Prannay Khosla Piotr Teterwak Chen Wang Aaron Sarna Yonglong Tian Phillip Isola Aaron Maschinot Ce Liu Dilip Krishnan SSL 139 4,520 0 23 Apr 2020
Equalization Loss for Long-Tailed Object Recognition Jingru Tan Changbao Wang Buyu Li Quanquan Li Wanli Ouyang Changqing Yin Junjie Yan 312 462 0 11 Mar 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 323 18,686 0 13 Feb 2020
Identifying and Compensating for Feature Deviation in Imbalanced Deep Learning Han-Jia Ye Hong-You Chen De-Chuan Zhan Wei-Lun Chao 61 101 0 06 Jan 2020
PyHessian: Neural Networks Through the Lens of the Hessian Z. Yao A. Gholami Kurt Keutzer Michael W. Mahoney ODL 48 302 0 16 Dec 2019
PyTorch: An Imperative Style, High-Performance Deep Learning Library Adam Paszke Sam Gross Francisco Massa Adam Lerer James Bradbury ... Sasank Chilamkurthy Benoit Steiner Lu Fang Junjie Bai Soumith Chintala ODL 359 42,299 0 03 Dec 2019
Decoupling Representation and Classifier for Long-Tailed Recognition Bingyi Kang Saining Xie Marcus Rohrbach Zhicheng Yan Albert Gordo Jiashi Feng Yannis Kalantidis OODD 172 1,213 0 21 Oct 2019
Hessian based analysis of SGD for Deep Nets: Dynamics and Generalization Xinyan Li Qilong Gu Yingxue Zhou Tiancong Chen A. Banerjee ODL 69 52 0 24 Jul 2019
Learning Imbalanced Datasets with Label-Distribution-Aware Margin Loss Kaidi Cao Colin Wei Adrien Gaidon Nikos Arechiga Tengyu Ma 107 1,594 0 18 Jun 2019
Empirical study of extreme overfitting points of neural networks D. Merkulov Ivan Oseledets 3DPC 34 7 0 14 Jun 2019
Large-Scale Long-Tailed Recognition in an Open World Ziwei Liu Zhongqi Miao Xiaohang Zhan Jiayun Wang Boqing Gong Stella X. Yu 142 1,156 0 10 Apr 2019
On Nonconvex Optimization for Machine Learning: Gradients, Stochasticity, and Saddle Points Chi Jin Praneeth Netrapalli Rong Ge Sham Kakade Michael I. Jordan 72 61 0 13 Feb 2019
Negative eigenvalues of the Hessian in deep neural networks Guillaume Alain Nicolas Le Roux Pierre-Antoine Manzagol 42 43 0 06 Feb 2019
An Investigation into Neural Net Optimization via Hessian Eigenvalue Density Behrooz Ghorbani Shankar Krishnan Ying Xiao ODL 60 323 0 29 Jan 2019
Class-Balanced Loss Based on Effective Number of Samples Huayu Chen Menglin Jia Nayeon Lee Yang Song Serge J. Belongie 183 2,271 0 16 Jan 2019
What is the Effect of Importance Weighting in Deep Learning? Jonathon Byrd Zachary Chase Lipton 87 459 0 08 Dec 2018
Training Well-Generalizing Classifiers for Fairness Metrics and Other Data-Dependent Constraints Andrew Cotter Maya R. Gupta Heinrich Jiang Nathan Srebro Karthik Sridharan S. Wang Blake E. Woodworth Seungil You FaML 41 105 0 29 Jun 2018
Escaping Saddles with Stochastic Gradients Hadi Daneshmand Jonas Köhler Aurelien Lucchi Thomas Hofmann 53 162 0 15 Mar 2018
Visualizing the Loss Landscape of Neural Nets Hao Li Zheng Xu Gavin Taylor Christoph Studer Tom Goldstein 240 1,885 0 28 Dec 2017
A systematic study of the class imbalance problem in convolutional neural networks Mateusz Buda A. Maki Maciej A. Mazurowski 189 2,352 0 15 Oct 2017
The Devil is in the Tails: Fine-grained Classification in the Wild Grant Van Horn Pietro Perona VLM 70 206 0 05 Sep 2017
Empirical Analysis of the Hessian of Over-Parametrized Neural Networks Levent Sagun Utku Evci V. U. Güney Yann N. Dauphin Léon Bottou 54 418 0 14 Jun 2017
How to Escape Saddle Points Efficiently Chi Jin Rong Ge Praneeth Netrapalli Sham Kakade Michael I. Jordan ODL 195 835 0 02 Mar 2017
Entropy-SGD: Biasing Gradient Descent Into Wide Valleys Pratik Chaudhari A. Choromańska Stefano Soatto Yann LeCun Carlo Baldassi C. Borgs J. Chayes Levent Sagun R. Zecchina ODL 94 773 0 06 Nov 2016
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 394 2,934 0 15 Sep 2016
Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations Ranjay Krishna Yuke Zhu Oliver Groth Justin Johnson Kenji Hata ... Yannis Kalantidis Li Li David A. Shamma Michael S. Bernstein Fei-Fei Li 194 5,726 0 23 Feb 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 1.9K 193,426 0 10 Dec 2015
Escaping From Saddle Points --- Online Stochastic Gradient for Tensor Decomposition Rong Ge Furong Huang Chi Jin Yang Yuan 132 1,058 0 06 Mar 2015
ImageNet Large Scale Visual Recognition Challenge Olga Russakovsky Jia Deng Hao Su J. Krause S. Satheesh ... A. Karpathy A. Khosla Michael S. Bernstein Alexander C. Berg Li Fei-Fei VLM ObjD 1.4K 39,472 0 01 Sep 2014
Identifying and attacking the saddle point problem in high-dimensional non-convex optimization Yann N. Dauphin Razvan Pascanu Çağlar Gülçehre Kyunghyun Cho Surya Ganguli Yoshua Bengio ODL 123 1,383 0 10 Jun 2014
SMOTE: Synthetic Minority Over-sampling Technique Nitesh Chawla Kevin W. Bowyer Lawrence Hall W. Kegelmeyer AI4TS 329 25,569 0 09 Jun 2011