Attentional-Biased Stochastic Gradient Descent

13 December 2020

Papers citing "Attentional-Biased Stochastic Gradient Descent"

49 / 49 papers shown

Title
Improving Identity-Robustness for Face Models Q. Qi Shervin Ardeshir CVBM OOD 42 3 0 07 Apr 2023
Stochastic Constrained DRO with a Complexity Independent of Sample Size Q. Qi Jiameng Lyu Kung-Sik Chan E. Bai Tianbao Yang 63 15 0 11 Oct 2022
Patches Are All You Need? Asher Trockman J. Zico Kolter ViT 242 405 0 24 Jan 2022
Constrained Instance and Class Reweighting for Robust Learning under Label Noise Abhishek Kumar Ehsan Amid NoLa 45 19 0 09 Nov 2021
Non-convex Distributionally Robust Optimization: Non-asymptotic Analysis Jikai Jin Samir Bhatt Haiyang Wang Liwei Wang 45 49 0 24 Oct 2021
Exponentiated Gradient Reweighting for Robust Training Under Label Noise and Beyond Negin Majidi Ehsan Amid Hossein Talebi Manfred K. Warmuth NoLa 16 17 0 03 Apr 2021
Multiplicative Reweighting for Robust Neural Network Optimization Noga Bar Tomer Koren Raja Giryes OOD NoLa 45 9 0 24 Feb 2021
Large-Scale Methods for Distributionally Robust Optimization Daniel Levy Y. Carmon John C. Duchi Aaron Sidford 56 212 0 12 Oct 2020
Solving Stochastic Compositional Optimization is Nearly as Easy as Solving Stochastic Optimization Tianyi Chen Yuejiao Sun W. Yin 93 81 0 25 Aug 2020
Rethinking Class-Balanced Methods for Long-Tailed Visual Recognition from a Domain Adaptation Perspective Muhammad Abdullah Jamal Matthew A. Brown Ming-Hsuan Yang Liqiang Wang Boqing Gong 69 262 0 24 Mar 2020
A Simple and Effective Framework for Pairwise Deep Metric Learning Qi Qi Yan Yan Xiaoyu Wang Tianbao Yang 85 26 0 24 Dec 2019
Decoupling Representation and Classifier for Long-Tailed Recognition Bingyi Kang Saining Xie Marcus Rohrbach Zhicheng Yan Albert Gordo Jiashi Feng Yannis Kalantidis OODD 159 1,203 0 21 Oct 2019
Symmetric Cross Entropy for Robust Learning with Noisy Labels Yisen Wang Xingjun Ma Zaiyi Chen Yuan Luo Jinfeng Yi James Bailey NoLa 63 888 0 16 Aug 2019
Learning Imbalanced Datasets with Label-Distribution-Aware Margin Loss Kaidi Cao Colin Wei Adrien Gaidon Nikos Arechiga Tengyu Ma 82 1,583 0 18 Jun 2019
Robust Bi-Tempered Logistic Loss Based on Bregman Divergences Ehsan Amid Manfred K. Warmuth Rohan Anil Tomer Koren NoLa 30 128 0 08 Jun 2019
Large-Scale Long-Tailed Recognition in an Open World Ziwei Liu Zhongqi Miao Xiaohang Zhan Jiayun Wang Boqing Gong Stella X. Yu 118 1,148 0 10 Apr 2019
Application of Decision Rules for Handling Class Imbalance in Semantic Segmentation Robin Shing Moon Chan Matthias Rottmann Fabian Hüger Peter Schlicht Hanno Gottschalk SSeg 43 40 0 24 Jan 2019
Class-Balanced Loss Based on Effective Number of Samples Huayu Chen Menglin Jia Nayeon Lee Yang Song Serge J. Belongie 149 2,253 0 16 Jan 2019
Learning Models with Uniform Performance via Distributionally Robust Optimization John C. Duchi Hongseok Namkoong OOD 46 413 0 20 Oct 2018
Generalized Cross Entropy Loss for Training Deep Neural Networks with Noisy Labels Zhilu Zhang M. Sabuncu NoLa 60 2,580 0 20 May 2018
Iterative Learning with Open-set Noisy Labels Yisen Wang Weiyang Liu Xingjun Ma James Bailey H. Zha Le Song Shutao Xia NoLa 58 326 0 31 Mar 2018
Light Gated Recurrent Units for Speech Recognition Mirco Ravanelli Philemon Brakel M. Omologo Yoshua Bengio 25 313 0 26 Mar 2018
Learning to Reweight Examples for Robust Deep Learning Mengye Ren Wenyuan Zeng Binh Yang R. Urtasun OOD NoLa 125 1,419 0 24 Mar 2018
Tensor2Tensor for Neural Machine Translation Ashish Vaswani Samy Bengio E. Brevdo François Chollet Aidan Gomez ... Nal Kalchbrenner Niki Parmar Ryan Sepassi Noam M. Shazeer Jakob Uszkoreit 81 528 0 16 Mar 2018
CleanNet: Transfer Learning for Scalable Image Classifier Training with Label Noise Kuang-Huei Lee Xiaodong He Lei Zhang Linjun Yang NoLa 56 454 0 20 Nov 2017
A systematic study of the class imbalance problem in convolutional neural networks Mateusz Buda A. Maki Maciej A. Mazurowski 114 2,335 0 15 Oct 2017
Toward Robustness against Label Noise in Training Deep Discriminative Neural Networks Arash Vahdat NoLa 62 297 0 31 May 2017
Learning From Noisy Large-Scale Datasets With Minimal Supervision Andreas Veit N. Alldrin Gal Chechik Ivan Krasin Abhinav Gupta Serge J. Belongie 82 476 0 06 Jan 2017
Range Loss for Deep Face Recognition with Long-tail Xiao Zhang Zhiyuan Fang Yandong Wen Zhifeng Li Yu Qiao CVBM 295 448 0 28 Nov 2016
Understanding deep learning requires rethinking generalization Chiyuan Zhang Samy Bengio Moritz Hardt Benjamin Recht Oriol Vinyals HAI 264 4,620 0 10 Nov 2016
Variance-based regularization with convex objectives John C. Duchi Hongseok Namkoong 57 348 0 08 Oct 2016
An overview of gradient descent optimization algorithms Sebastian Ruder ODL 177 6,170 0 15 Sep 2016
Making Deep Neural Networks Robust to Label Noise: a Loss Correction Approach Giorgio Patrini A. Rozza A. Menon Richard Nock Zhuang Li NoLa 83 1,447 0 13 Sep 2016
SGDR: Stochastic Gradient Descent with Warm Restarts I. Loshchilov Frank Hutter ODL 229 8,030 0 13 Aug 2016
Minimizing the Maximal Loss: How and Why? Shai Shalev-Shwartz Y. Wexler 32 81 0 04 Feb 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 1.4K 192,638 0 10 Dec 2015
Effective Approaches to Attention-based Neural Machine Translation Thang Luong Hieu H. Pham Christopher D. Manning 313 7,951 0 17 Aug 2015
Optimizing Non-decomposable Performance Measures: A Tale of Two Classes Harikrishna Narasimhan Purushottam Kar Prateek Jain 43 45 0 26 May 2015
FaceNet: A Unified Embedding for Face Recognition and Clustering Florian Schroff Dmitry Kalenichenko James Philbin 3DH 272 13,079 0 12 Mar 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 808 149,474 0 22 Dec 2014
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling Junyoung Chung Çağlar Gülçehre Kyunghyun Cho Yoshua Bengio 283 12,662 0 11 Dec 2014
Stochastic Compositional Gradient Descent: Algorithms for Minimizing Compositions of Expected-Value Functions Mengdi Wang Ethan X. Fang Han Liu 71 261 0 14 Nov 2014
Sequence to Sequence Learning with Neural Networks Ilya Sutskever Oriol Vinyals Quoc V. Le AIMat 280 20,491 0 10 Sep 2014
Neural Machine Translation by Jointly Learning to Align and Translate Dzmitry Bahdanau Kyunghyun Cho Yoshua Bengio AIMat 388 27,205 0 01 Sep 2014
Convolutional Neural Networks for Sentence Classification Yoon Kim AILaw VLM 554 13,395 0 25 Aug 2014
Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation Kyunghyun Cho B. V. Merrienboer Çağlar Gülçehre Dzmitry Bahdanau Fethi Bougares Holger Schwenk Yoshua Bengio AIMat 629 23,235 0 03 Jun 2014
Generating Sequences With Recurrent Neural Networks Alex Graves GAN 104 4,025 0 04 Aug 2013
Speech Recognition with Deep Recurrent Neural Networks Alex Graves Abdel-rahman Mohamed Geoffrey E. Hinton 154 8,503 0 22 Mar 2013
SMOTE: Synthetic Minority Over-sampling Technique Nitesh Chawla Kevin W. Bowyer Lawrence Hall W. Kegelmeyer AI4TS 265 25,443 0 09 Jun 2011