Visualizing the Loss Landscape of Neural Nets

28 December 2017

Hao Li

Papers citing "Visualizing the Loss Landscape of Neural Nets"

50 / 1,046 papers shown

Title
Towards Stable Test-Time Adaptation in Dynamic Wild World Shuaicheng Niu Jiaxiang Wu Yifan Zhang Z. Wen Yaofo Chen P. Zhao Mingkui Tan TTA 40 251 0 24 Feb 2023
Random Teachers are Good Teachers Felix Sarnthein Gregor Bachmann Sotiris Anagnostidis Thomas Hofmann 23 4 0 23 Feb 2023
Do We Really Need Complicated Model Architectures For Temporal Networks? Weilin Cong Si Zhang Jian Kang Baichuan Yuan Hao Wu Xin Zhou Hanghang Tong Mehrdad Mahdavi GNN AI4TS 31 115 0 22 Feb 2023
Stress and Adaptation: Applying Anna Karenina Principle in Deep Learning for Image Classification Nesma Mahmoud Hanna Antson Jaesik Choi O. Shimmi K. Roy 17 1 0 22 Feb 2023
Transfer Learning Enhanced Full Waveform Inversion Stefan Kollmannsberger Divya Singh L. Herrmann 28 5 0 22 Feb 2023
Stationary Point Losses for Robust Model Weiwei Gao Dazhi Zhang Yao Li Zhichang Guo Ovanes Petrosian OOD 29 0 0 19 Feb 2023
Approximately Bayes-Optimal Pseudo Label Selection Julian Rodemann Jann Goschenhofer Emilio Dorigatti T. Nagler Thomas Augustin 21 8 0 17 Feb 2023
AutoFed: Heterogeneity-Aware Federated Multimodal Learning for Robust Autonomous Driving Tianyue Zheng Ang Li Zhe Chen Hao Wang Jun Luo 32 48 0 17 Feb 2023
A Modern Look at the Relationship between Sharpness and Generalization Maksym Andriushchenko Francesco Croce Maximilian Müller Matthias Hein Nicolas Flammarion 3DH 24 56 0 14 Feb 2023
Revisiting Weighted Aggregation in Federated Learning with Neural Networks Zexi Li Tao R. Lin Xinyi Shang Chao-Xiang Wu FedML 50 61 0 14 Feb 2023
Data efficiency and extrapolation trends in neural network interatomic potentials Joshua A Vita Daniel Schwalbe-Koda 42 17 0 12 Feb 2023
Improving the Model Consistency of Decentralized Federated Learning Yi Shi Li Shen Kang Wei Yan Sun Bo Yuan Xueqian Wang Dacheng Tao FedML 41 51 0 08 Feb 2023
On a continuous time model of gradient descent dynamics and instability in deep learning Mihaela Rosca Yan Wu Chongli Qin Benoit Dherin 33 7 0 03 Feb 2023
MOSAIC, acomparison framework for machine learning models Mattéo Papin Yann Beaujeault-Taudiere F. Magniette VLM 21 0 0 30 Jan 2023
ForkMerge: Mitigating Negative Transfer in Auxiliary-Task Learning Junguang Jiang Baixu Chen Junwei Pan Ximei Wang Liu Dapeng Jie Jiang Mingsheng Long MoMe 34 20 0 30 Jan 2023
Exploiting High Performance Spiking Neural Networks with Efficient Spiking Patterns Guobin Shen Dongcheng Zhao Yi Zeng 43 11 0 29 Jan 2023
CyclicFL: A Cyclic Model Pre-Training Approach to Efficient Federated Learning Peng Zhang Yingbo Zhou Ming Hu Xin Fu Xian Wei Mingsong Chen FedML 32 1 0 28 Jan 2023
Exploring the Effect of Multi-step Ascent in Sharpness-Aware Minimization Hoki Kim Jinseong Park Yujin Choi Woojin Lee Jaewook Lee 25 9 0 27 Jan 2023
Out-of-distributional risk bounds for neural operators with applications to the Helmholtz equation Jose Antonio Lara Benitez Takashi Furuya F. Faucher Anastasis Kratsios X. Tricoche Maarten V. de Hoop 45 16 0 27 Jan 2023
ZiCo: Zero-shot NAS via Inverse Coefficient of Variation on Gradients Guihong Li Yuedong Yang Kartikeya Bhardwaj R. Marculescu 38 61 0 26 Jan 2023
Promises and pitfalls of deep neural networks in neuroimaging-based psychiatric research Fabian Eitel Marc-Andre Schulz Moritz Seiler Henrik Walter K. Ritter AI4CE 19 42 0 20 Jan 2023
Revisiting Estimation Bias in Policy Gradients for Deep Reinforcement Learning Haoxuan Pan Deheng Ye Xiaoming Duan Qiang Fu Wei Yang Jianping He Mingfei Sun OffRL 25 2 0 20 Jan 2023
A Multi-Resolution Framework for U-Nets with Applications to Hierarchical VAEs Fabian Falck Christopher Williams D. Danks George Deligiannidis C. Yau Chris Holmes Arnaud Doucet M. Willetts 41 8 0 19 Jan 2023
Getting Away with More Network Pruning: From Sparsity to Geometry and Linear Regions Junyang Cai Khai-Nguyen Nguyen Nishant Shrestha Aidan Good Ruisen Tu Xin Yu Shandian Zhe Thiago Serra MLT 40 7 0 19 Jan 2023
TAME: Attention Mechanism Based Feature Fusion for Generating Explanation Maps of Convolutional Neural Networks Mariano V. Ntrougkas Nikolaos Gkalelis Vasileios Mezaris FAtt 19 8 0 18 Jan 2023
Tailor: Altering Skip Connections for Resource-Efficient Inference Olivia Weng Gabriel Marcano Vladimir Loncar Alireza Khodamoradi Nojan Sheybani Andres Meza F. Koushanfar K. Denolf Javier Mauricio Duarte Ryan Kastner 46 12 0 18 Jan 2023
Stability Analysis of Sharpness-Aware Minimization Hoki Kim Jinseong Park Yujin Choi Jaewook Lee 44 12 0 16 Jan 2023
A Comprehensive Survey of Dataset Distillation Shiye Lei Dacheng Tao DD 51 88 0 13 Jan 2023
Sparse neural networks with skip-connections for identification of aluminum electrolysis cell E. Lundby Haakon Robinson Adil Rasheed I. Halvorsen J. Gravdahl 30 2 0 02 Jan 2023
FlatENN: Train Flat for Enhanced Fault Tolerance of Quantized Deep Neural Networks Akul Malhotra S. Gupta 26 0 0 29 Dec 2022
Escaping Saddle Points for Effective Generalization on Class-Imbalanced Data Harsh Rangwani Sumukh K Aithal Mayank Mishra R. Venkatesh Babu 31 29 0 28 Dec 2022
Re-basin via implicit Sinkhorn differentiation F. Guerrero-Peña H. R. Medeiros Thomas Dubail Masih Aminbeidokhti Eric Granger M. Pedersoli MoMe 26 44 0 22 Dec 2022
Renormalization in the neural network-quantum field theory correspondence Harold Erbin Vincent Lahoche D. O. Samary 47 7 0 22 Dec 2022
Improving Generalization of Pre-trained Language Models via Stochastic Weight Averaging Peng Lu I. Kobyzev Mehdi Rezagholizadeh Ahmad Rashid A. Ghodsi Philippe Langlais MoMe 41 11 0 12 Dec 2022
Accelerating Dataset Distillation via Model Augmentation Lei Zhang Jie M. Zhang Bowen Lei Subhabrata Mukherjee Xiang Pan Bo Zhao Caiwen Ding Heng Chang Dongkuan Xu DD 47 62 0 12 Dec 2022
Editing Models with Task Arithmetic Gabriel Ilharco Marco Tulio Ribeiro Mitchell Wortsman Suchin Gururangan Ludwig Schmidt Hannaneh Hajishirzi Ali Farhadi KELM MoMe MU 77 443 0 08 Dec 2022
Pivotal Role of Language Modeling in Recommender Systems: Enriching Task-specific and Task-agnostic Representation Learning Kyuyong Shin Hanock Kwak Wonjae Kim Jisu Jeong Seungjae Jung KyungHyun Kim Jung-Woo Ha Sang-Woo Lee 27 4 0 07 Dec 2022
FedALA: Adaptive Local Aggregation for Personalized Federated Learning Jianqing Zhang Yang Hua Hao Wang Tao Song Zhengui Xue Ruhui Ma Haibing Guan FedML 40 198 0 02 Dec 2022
Which Shortcut Solution Do Question Answering Models Prefer to Learn? Kazutoshi Shinoda Saku Sugawara Akiko Aizawa 35 6 0 29 Nov 2022
The Vanishing Decision Boundary Complexity and the Strong First Component Hengshuai Yao UQCV 38 0 0 25 Nov 2022
Improving Multi-task Learning via Seeking Task-based Flat Regions Hoang Phan Lam C. Tran Ngoc N. Tran Nhat Ho Dinh Q. Phung Trung Le 38 11 0 24 Nov 2022
Join the High Accuracy Club on ImageNet with A Binary Neural Network Ticket Nianhui Guo Joseph Bethge Christoph Meinel Haojin Yang MQ 39 20 0 23 Nov 2022
VBLC: Visibility Boosting and Logit-Constraint Learning for Domain Adaptive Semantic Segmentation under Adverse Conditions Mingjiang Li Binhui Xie Shuang Li Chi Harold Liu Xinjing Cheng 41 12 0 22 Nov 2022
CLAWSAT: Towards Both Robust and Accurate Code Models Jinghan Jia Shashank Srikant Tamara Mitrovska Chuang Gan Shiyu Chang Sijia Liu Una-May O’Reilly AAML 15 11 0 21 Nov 2022
Efficient Generalization Improvement Guided by Random Weight Perturbation Tao Li Wei Yan Zehao Lei Yingwen Wu Kun Fang Ming Yang Xiaolin Huang AAML 43 6 0 21 Nov 2022
Unveiling the Tapestry: the Interplay of Generalization and Forgetting in Continual Learning Zenglin Shi Jing Jie Ying Sun J. Lim Mengmi Zhang CLL 44 1 0 21 Nov 2022
Minimizing the Accumulated Trajectory Error to Improve Dataset Distillation Jiawei Du Yiding Jiang Vincent Y. F. Tan Qiufeng Wang Haizhou Li DD 43 112 0 20 Nov 2022
Accuracy Booster: Enabling 4-bit Fixed-point Arithmetic for DNN Training Simla Burcu Harma Canberk Sonmez Nicholas Sperry Babak Falsafi Martin Jaggi Yunho Oh MQ 41 4 0 19 Nov 2022
REPAIR: REnormalizing Permuted Activations for Interpolation Repair Keller Jordan Hanie Sedghi O. Saukh R. Entezari Behnam Neyshabur MoMe 46 94 0 15 Nov 2022
MEAL: Stable and Active Learning for Few-Shot Prompting Abdullatif Köksal Timo Schick Hinrich Schütze 27 25 0 15 Nov 2022