v1v2v3v4v5 (latest)

Improved Sample Complexities for Deep Networks and Robust Classification via an All-Layer Margin

9 October 2019

Papers citing "Improved Sample Complexities for Deep Networks and Robust Classification via an All-Layer Margin"

45 / 45 papers shown

Title
Multiplicative Logit Adjustment Approximates Neural-Collapse-Aware Decision Boundary Adjustment Naoya Hasegawa Issei Sato 124 0 0 26 Sep 2024
Adjusting Logit in Gaussian Form for Long-Tailed Visual Recognition Mengke Li Y. Cheung Yang Lu Zhikai Hu Weichao Lan Hui Huang 101 8 0 18 May 2023
How Does Sharpness-Aware Minimization Minimize Sharpness? Kaiyue Wen Tengyu Ma Zhiyuan Li AAML 85 50 0 10 Nov 2022
Same Pre-training Loss, Better Downstream: Implicit Bias Matters for Language Models Hong Liu Sang Michael Xie Zhiyuan Li Tengyu Ma AI4CE 135 55 0 25 Oct 2022
A PAC-Bayesian Generalization Bound for Equivariant Networks Arash Behboodi Gabriele Cesa Taco S. Cohen 88 19 0 24 Oct 2022
Information FOMO: The unhealthy fear of missing out on information. A method for removing misleading data for healthier models Ethan Pickering T. Sapsis 68 6 0 27 Aug 2022
Density-Aware Personalized Training for Risk Prediction in Imbalanced Medical Data Zepeng Huo Xiaoning Qian Shuai Huang Zhangyang Wang Bobak J. Mortazavi OOD 61 3 0 23 Jul 2022
Aug-NeRF: Training Stronger Neural Radiance Fields with Triple-Level Physically-Grounded Augmentations Tianlong Chen Peihao Wang Zhiwen Fan Zhangyang Wang 106 55 0 04 Jul 2022
On the Role of Generalization in Transferability of Adversarial Examples Yilin Wang Farzan Farnia AAML 83 11 0 18 Jun 2022
Max-Margin Works while Large Margin Fails: Generalization without Uniform Convergence Margalit Glasgow Colin Wei Mary Wootters Tengyu Ma 94 5 0 16 Jun 2022
Regularization Penalty Optimization for Addressing Data Quality Variance in OoD Algorithms Runpeng Yu Hong Zhu Kaican Li Lanqing Hong Rui Zhang Nan Ye Shao-Lun Huang Xiuqiang He 65 6 0 12 Jun 2022
What is a Good Metric to Study Generalization of Minimax Learners? Asuman Ozdaglar S. Pattathil Jiawei Zhang Kai Zhang 71 14 0 09 Jun 2022
A Communication-efficient Algorithm with Linear Convergence for Federated Minimax Learning Zhenyu Sun Ermin Wei FedML 115 14 0 02 Jun 2022
On the Optimization of Margin Distribution Meng-Zhang Qian Zheng Ai Teng Zhang Wei Gao 25 1 0 29 Apr 2022
Adversarial robustness of sparse local Lipschitz predictors Ramchandran Muthukumar Jeremias Sulam AAML 92 13 0 26 Feb 2022
Improved Regularization and Robustness for Fine-tuning in Neural Networks Dongyue Li Hongyang R. Zhang NoLa 98 56 0 08 Nov 2021
Noisy Feature Mixup Soon Hoe Lim N. Benjamin Erichson Francisco Utrera Winnie Xu Michael W. Mahoney AAML 101 38 0 05 Oct 2021
A Scaling Law for Synthetic-to-Real Transfer: How Much Is Your Pre-training Effective? Hiroaki Mikami Kenji Fukumizu Shogo Murai Shuji Suzuki Yuta Kikuchi Taiji Suzuki S. Maeda Kohei Hayashi 92 12 0 25 Aug 2021
Minimum sharpness: Scale-invariant parameter-robustness of neural networks Hikaru Ibayashi Takuo Hamaguchi Masaaki Imaizumi 64 5 0 23 Jun 2021
Compression Implies Generalization Allan Grønlund M. Hogsgaard Lior Kamma Kasper Green Larsen MLT AI4CE 23 0 0 15 Jun 2021
Label Noise SGD Provably Prefers Flat Global Minimizers Alexandru Damian Tengyu Ma Jason D. Lee NoLa 142 120 0 11 Jun 2021
Measuring Generalization with Optimal Transport Ching-Yao Chuang Youssef Mroueh Kristjan Greenewald Antonio Torralba Stefanie Jegelka OT 90 27 0 07 Jun 2021
Neural Collapse Under MSE Loss: Proximity to and Dynamics on the Central Path X. Y. Han Vardan Papyan D. Donoho AAML 134 144 0 03 Jun 2021
On the effectiveness of adversarial training against common corruptions Klim Kireev Maksym Andriushchenko Nicolas Flammarion AAML 72 103 0 03 Mar 2021
Data-Efficient GAN Training Beyond (Just) Augmentations: A Lottery Ticket Perspective Tianlong Chen Yu Cheng Zhe Gan Jingjing Liu Zhangyang Wang 82 52 0 28 Feb 2021
A Theory of Label Propagation for Subpopulation Shift Tianle Cai Ruiqi Gao Jason D. Lee Qi Lei 83 50 0 22 Feb 2021
Generalization bounds for deep learning Guillermo Valle Pérez A. Louis BDL 82 45 0 07 Dec 2020
Train simultaneously, generalize better: Stability of gradient-based minimax learners Farzan Farnia Asuman Ozdaglar 73 48 0 23 Oct 2020
The Deep Bootstrap Framework: Good Online Learners are Good Offline Generalizers Preetum Nakkiran Behnam Neyshabur Hanie Sedghi OffRL 97 11 0 16 Oct 2020
Theoretical Analysis of Self-Training with Deep Networks on Unlabeled Data Colin Wei Kendrick Shen Yining Chen Tengyu Ma SSL 117 232 0 07 Oct 2020
Sharpness-Aware Minimization for Efficiently Improving Generalization Pierre Foret Ariel Kleiner H. Mobahi Behnam Neyshabur AAML 236 1,361 0 03 Oct 2020
Composed Fine-Tuning: Freezing Pre-Trained Denoising Autoencoders for Improved Generalization Sang Michael Xie Tengyu Ma Percy Liang 133 15 0 29 Jun 2020
Heteroskedastic and Imbalanced Deep Learning with Adaptive Regularization Kaidi Cao Yining Chen Junwei Lu Nikos Arechiga Adrien Gaidon Tengyu Ma 98 68 0 29 Jun 2020
MOPO: Model-based Offline Policy Optimization Tianhe Yu G. Thomas Lantao Yu Stefano Ermon James Zou Sergey Levine Chelsea Finn Tengyu Ma OffRL 103 775 0 27 May 2020
Adversarial Learning Guarantees for Linear Hypotheses and Neural Networks Pranjal Awasthi Natalie Frank M. Mohri AAML 90 58 0 28 Apr 2020
Optimal Regularization Can Mitigate Double Descent Preetum Nakkiran Prayaag Venkat Sham Kakade Tengyu Ma 85 133 0 04 Mar 2020
The Implicit and Explicit Regularization Effects of Dropout Colin Wei Sham Kakade Tengyu Ma 121 118 0 28 Feb 2020
The Curious Case of Adversarially Robust Models: More Data Can Help, Double Descend, or Hurt Generalization Yifei Min Lin Chen Amin Karbasi AAML 103 69 0 25 Feb 2020
CAT: Customized Adversarial Training for Improved Robustness Minhao Cheng Qi Lei Pin-Yu Chen Inderjit Dhillon Cho-Jui Hsieh OOD AAML 99 117 0 17 Feb 2020
Angular Visual Hardness Beidi Chen Weiyang Liu Zhiding Yu Jan Kautz Anshumali Shrivastava Animesh Garg Anima Anandkumar AAML 139 52 0 04 Dec 2019
Fantastic Generalization Measures and Where to Find Them Yiding Jiang Behnam Neyshabur H. Mobahi Dilip Krishnan Samy Bengio AI4CE 152 612 0 04 Dec 2019
Learning Imbalanced Datasets with Label-Distribution-Aware Margin Loss Kaidi Cao Colin Wei Adrien Gaidon Nikos Arechiga Tengyu Ma 137 1,614 0 18 Jun 2019
Gradient Descent Maximizes the Margin of Homogeneous Neural Networks Kaifeng Lyu Jian Li 114 336 0 13 Jun 2019
Generalization bounds for deep convolutional neural networks Philip M. Long Hanie Sedghi MLT 136 90 0 29 May 2019
Data-dependent Sample Complexity of Deep Neural Networks via Lipschitz Augmentation Colin Wei Tengyu Ma 87 110 0 09 May 2019