Visualizing the Loss Landscape of Neural Nets

28 December 2017

Hao Li

Papers citing "Visualizing the Loss Landscape of Neural Nets"

50 / 1,040 papers shown

Title
Simulation and Prediction of Countercurrent Spontaneous Imbibition at Early and Late Times Using Physics-Informed Neural Networks J. Abbasi P. Andersen PINN 32 4 0 06 May 2023
Equivariant Neural Networks for Spin Dynamics Simulations of Itinerant Magnets Y. Miyazaki 11 4 0 05 May 2023
Towards Effective Collaborative Learning in Long-Tailed Recognition Zhengzhuo Xu Zenghao Chai Chengying Xu Chun Yuan Haiqin Yang 29 4 0 05 May 2023
PGrad: Learning Principal Gradients For Domain Generalization Zhe Wang J. E. Grigsby Yanjun Qi OOD 29 10 0 02 May 2023
Model-agnostic Measure of Generalization Difficulty Akhilan Boopathy Kevin Liu Jaedong Hwang Shu Ge Asaad Mohammedsaleh Ila Fiete 80 4 0 01 May 2023
Towards the Flatter Landscape and Better Generalization in Federated Learning under Client-level Differential Privacy Yi Shi Kang Wei Li Shen Yingqi Liu Xueqian Wang Bo Yuan Dacheng Tao FedML 41 2 0 01 May 2023
Meat Freshness Prediction Bhargav Sagiraju Nathan Casanova Lam Ivan Chuen Chun Manan Lohia Toshinori Yoshiyasu 19 1 0 01 May 2023
Typical and atypical solutions in non-convex neural networks with discrete and continuous weights Carlo Baldassi Enrico M. Malatesta Gabriele Perugini R. Zecchina MQ 47 11 0 26 Apr 2023
Room dimensions and absorption inference from room transfer function via machine learning Yuanxin Xia C. Jeong 21 2 0 25 Apr 2023
Hierarchical Weight Averaging for Deep Neural Networks Xiaozhe Gu Zixun Zhang Yuncheng Jiang Tao Luo Ruimao Zhang Shuguang Cui Zhuguo Li 27 5 0 23 Apr 2023
Multi-module based CVAE to predict HVCM faults in the SNS accelerator Yasir Alanazi M. Schram Kishansingh Rajput S. Goldenberg Lasitha Vidyaratne C. Pappas M. Radaideh Dawei Lu Pradeep Ramuhalli Sarah Cousineau 31 2 0 20 Apr 2023
DeepReShape: Redesigning Neural Networks for Efficient Private Inference N. Jha Brandon Reagen 36 10 0 20 Apr 2023
Byzantine-Resilient Learning Beyond Gradients: Distributing Evolutionary Search Andrei Kucharavy M. Monti R. Guerraoui Ljiljana Dolamic 40 1 0 20 Apr 2023
Magnitude Invariant Parametrizations Improve Hypernetwork Learning Jose Javier Gonzalez Ortiz John Guttag Adrian Dalca 34 7 0 15 Apr 2023
Rethinking Evaluation Protocols of Visual Representations Learned via Self-supervised Learning Jaehoon Lee Doyoung Yoon Byeongmoon Ji Kyungyul Kim Sangheum Hwang SSL 57 3 0 07 Apr 2023
MGMT promoter methylation status prediction using MRI scans? An extensive experimental evaluation of deep learning models Numan Saeed Muhammad Ridzuan Hussain Alasmawi I. Sobirov Mohammad Yaqub 13 17 0 03 Apr 2023
Are Neural Architecture Search Benchmarks Well Designed? A Deeper Look Into Operation Importance Vasco Lopes Bruno Degardin L. A. Alexandre 30 5 0 29 Mar 2023
Improving robustness of jet tagging algorithms with adversarial training: exploring the loss surface Annika Stein AAML OOD 11 1 0 25 Mar 2023
PIAT: Parameter Interpolation based Adversarial Training for Image Classification Kun He Xin Liu Yichen Yang Zhou Qin Weigao Wen Hui Xue J. Hopcroft AAML 30 0 0 24 Mar 2023
An Efficient Knowledge Transfer Strategy for Spiking Neural Networks from Static to Event Domain Xiang He Dongcheng Zhao Yang Li Guobin Shen Qingqun Kong Yi Zeng 50 5 0 23 Mar 2023
Decentralized Adversarial Training over Graphs Ying Cao Elsa Rizk Stefan Vlaski Ali H. Sayed AAML 43 1 0 23 Mar 2023
Boosting Verified Training for Robust Image Classifications via Abstraction Zhaodi Zhang Zhiyi Xue Yang Chen Si Liu Yueling Zhang Qingbin Liu Min Zhang 51 4 0 21 Mar 2023
PRISE: Demystifying Deep Lucas-Kanade with Strongly Star-Convex Constraints for Multimodel Image Alignment Yiqing Zhang Xinming Huang Ziming Zhang 36 4 0 21 Mar 2023
Make Landscape Flatter in Differentially Private Federated Learning Yi Shi Yingqi Liu Kang Wei Li Shen Xueqian Wang Dacheng Tao FedML 25 55 0 20 Mar 2023
No Fear of Classifier Biases: Neural Collapse Inspired Federated Learning with Synthetic and Fixed Classifier Zexi Li Xinyi Shang Rui He Tao R. Lin Chao Wu FedML 51 55 0 17 Mar 2023
Cross-Dimensional Refined Learning for Real-Time 3D Visual Perception from Monocular Video Ziyang Hong C. Yue 3DPC 27 3 0 16 Mar 2023
Rethinking Model Ensemble in Transfer-based Adversarial Attacks Huanran Chen Yichi Zhang Yinpeng Dong Xiao Yang Hang Su Junyi Zhu AAML 28 56 0 16 Mar 2023
Adapting U-Net for linear elastic stress estimation in polycrystal Zr microstructures J. D. Langcaster D. Balint M. Wenman 13 1 0 15 Mar 2023
Generalizing and Decoupling Neural Collapse via Hyperspherical Uniformity Gap Weiyang Liu L. Yu Adrian Weller Bernhard Schölkopf 37 18 0 11 Mar 2023
Scalable Stochastic Gradient Riemannian Langevin Dynamics in Non-Diagonal Metrics Hanlin Yu M. Hartmann Bernardo Williams Arto Klami BDL 22 5 0 09 Mar 2023
Text-Visual Prompting for Efficient 2D Temporal Video Grounding Yimeng Zhang Xin Chen Jinghan Jia Sijia Liu Ke Ding 23 25 0 09 Mar 2023
Loss-Curvature Matching for Dataset Selection and Condensation Seung-Jae Shin Heesun Bae DongHyeok Shin Weonyoung Joo Il-Chul Moon DD 49 25 0 08 Mar 2023
Revisiting the Noise Model of Stochastic Gradient Descent Barak Battash Ofir Lindenbaum 27 9 0 05 Mar 2023
What Is Missing in IRM Training and Evaluation? Challenges and Solutions Yihua Zhang Pranay Sharma Parikshit Ram Min-Fong Hong Kush R. Varshney Sijia Liu 34 11 0 04 Mar 2023
Gradient Norm Aware Minimization Seeks First-Order Flatness and Improves Generalization Xingxuan Zhang Renzhe Xu Han Yu Hao Zou Peng Cui 24 39 0 03 Mar 2023
Evolutionary Augmentation Policy Optimization for Self-supervised Learning Noah Barrett Zahra Sadeghi Stan Matwin 30 3 0 02 Mar 2023
Dropout Reduces Underfitting Zhuang Liu Zhi-Qin John Xu Joseph Jin Zhiqiang Shen Trevor Darrell 45 36 0 02 Mar 2023
Understanding plasticity in neural networks Clare Lyle Zeyu Zheng Evgenii Nikishin Bernardo Avila-Pires Razvan Pascanu Will Dabney AI4CE 42 98 0 02 Mar 2023
Over-training with Mixup May Hurt Generalization Zixuan Liu Ziqiao Wang Hongyu Guo Yongyi Mao NoLa 34 11 0 02 Mar 2023
Rethinking the Effect of Data Augmentation in Adversarial Contrastive Learning Rundong Luo Yifei Wang Yisen Wang 34 25 0 02 Mar 2023
Average of Pruning: Improving Performance and Stability of Out-of-Distribution Detection Zhen Cheng Fei Zhu Xu-Yao Zhang Cheng-Lin Liu MoMe OODD 40 11 0 02 Mar 2023
How to DP-fy ML: A Practical Guide to Machine Learning with Differential Privacy Natalia Ponomareva Hussein Hazimeh Alexey Kurakin Zheng Xu Carson E. Denison H. B. McMahan Sergei Vassilvitskii Steve Chien Abhradeep Thakurta 99 167 0 01 Mar 2023
AdaSAM: Boosting Sharpness-Aware Minimization with Adaptive Learning Rate and Momentum for Training Deep Neural Networks Hao Sun Li Shen Qihuang Zhong Liang Ding Shi-Yong Chen Jingwei Sun Jing Li Guangzhong Sun Dacheng Tao 49 31 0 01 Mar 2023
ASP: Learn a Universal Neural Solver! Chenguang Wang Zhouliang Yu Stephen Marcus McAleer Tianshu Yu Yao-Chun Yang AAML 32 24 0 01 Mar 2023
Towards Stable Test-Time Adaptation in Dynamic Wild World Shuaicheng Niu Jiaxiang Wu Yifan Zhang Z. Wen Yaofo Chen P. Zhao Mingkui Tan TTA 40 251 0 24 Feb 2023
Random Teachers are Good Teachers Felix Sarnthein Gregor Bachmann Sotiris Anagnostidis Thomas Hofmann 21 4 0 23 Feb 2023
Do We Really Need Complicated Model Architectures For Temporal Networks? Weilin Cong Si Zhang Jian Kang Baichuan Yuan Hao Wu Xin Zhou Hanghang Tong Mehrdad Mahdavi GNN AI4TS 31 115 0 22 Feb 2023
Stress and Adaptation: Applying Anna Karenina Principle in Deep Learning for Image Classification Nesma Mahmoud Hanna Antson Jaesik Choi O. Shimmi K. Roy 17 1 0 22 Feb 2023
Transfer Learning Enhanced Full Waveform Inversion Stefan Kollmannsberger Divya Singh L. Herrmann 23 5 0 22 Feb 2023
Stationary Point Losses for Robust Model Weiwei Gao Dazhi Zhang Yao Li Zhichang Guo Ovanes Petrosian OOD 29 0 0 19 Feb 2023