Visualizing the Loss Landscape of Neural Nets

28 December 2017

Hao Li

Papers citing "Visualizing the Loss Landscape of Neural Nets"

50 / 1,046 papers shown

Title
Artificial intelligence approaches for materials-by-design of energetic materials: state-of-the-art, challenges, and future directions Joseph B. Choi Phong C. H. Nguyen O. Sen H. Udaykumar Stephen Seung-Yeob Baek PINN AI4CE 29 11 0 15 Nov 2022
Application of Graph Neural Networks and graph descriptors for graph classification J. Adamczyk FaML 39 5 0 07 Nov 2022
QuACK: Accelerating Gradient-Based Quantum Optimization with Koopman Operator Learning Di Luo Jiayu Shen Rumen Dangovski Marin Soljacic 37 5 0 02 Nov 2022
Class Interference of Deep Neural Networks Dongcui Diao Hengshuai Yao Bei Jiang 31 1 0 31 Oct 2022
Physics-Informed CNNs for Super-Resolution of Sparse Observations on Dynamical Systems Daniel Kelshaw Georgios Rigas Luca Magri AI4CE 42 17 0 31 Oct 2022
A picture of the space of typical learnable tasks Rahul Ramesh Jialin Mao Itay Griniasty Rubing Yang H. Teoh Mark K. Transtrum James P. Sethna Pratik Chaudhari SSL DRL 41 5 0 31 Oct 2022
WaveBound: Dynamic Error Bounds for Stable Time Series Forecasting Youngin Cho Daejin Kim Dongmin Kim Mohammad Azam Khan Jaegul Choo AI4TS 34 3 0 25 Oct 2022
Stable Deep MRI Reconstruction using Generative Priors Martin Zach Florian Knoll Thomas Pock OOD MedIm DiffM 33 17 0 25 Oct 2022
Boosting vision transformers for image retrieval Chull Hwan Song Jooyoung Yoon Shunghyun Choi Yannis Avrithis ViT 39 32 0 21 Oct 2022
$LOT: Layer-wise Orthogonal Training on Improving $\ell_2$ Certified Robustness$ LOT: Layer-wise Orthogonal Training on Improving $\ell_2$ Certified Robustness Xiaojun Xu Linyi Li Bo-wen Li OOD AAML 41 34 0 20 Oct 2022
Similarity of Neural Architectures using Adversarial Attack Transferability Jaehui Hwang Dongyoon Han Byeongho Heo Song Park Sanghyuk Chun Jong-Seok Lee AAML 37 1 0 20 Oct 2022
lo-fi: distributed fine-tuning without communication Mitchell Wortsman Suchin Gururangan Shen Li Ali Farhadi Ludwig Schmidt Michael G. Rabbat Ari S. Morcos 34 24 0 19 Oct 2022
Learning Transferable Adversarial Robust Representations via Multi-view Consistency Minseon Kim Hyeonjeong Ha Dong Bok Lee Sung Ju Hwang 35 0 0 19 Oct 2022
Catch-22s of reservoir computing Yuanzhao Zhang Sean P. Cornelius 21 11 0 18 Oct 2022
On effects of Knowledge Distillation on Transfer Learning Sushil Thapa 24 1 0 18 Oct 2022
ROSE: Robust Selective Fine-tuning for Pre-trained Language Models Lan Jiang Hao Zhou Yankai Lin Peng Li Jie Zhou R. Jiang AAML 42 8 0 18 Oct 2022
Extensible Proxy for Efficient NAS Yuhong Li Jiajie Li Cong Han P. Li Jinjun Xiong De-huai Chen 20 1 0 17 Oct 2022
RoS-KD: A Robust Stochastic Knowledge Distillation Approach for Noisy Medical Imaging A. Jaiswal Kumar Ashutosh Justin F. Rousseau Yifan Peng Zhangyang Wang Ying Ding 20 9 0 15 Oct 2022
Where to Begin? On the Impact of Pre-Training and Initialization in Federated Learning John Nguyen Jianyu Wang Kshitiz Malik Maziar Sanjabi Michael G. Rabbat FedML AI4CE 18 69 0 14 Oct 2022
TiDAL: Learning Training Dynamics for Active Learning Seong Min Kye Kwanghee Choi Hyeongmin Byun Buru Chang 34 13 0 13 Oct 2022
Wasserstein Barycenter-based Model Fusion and Linear Mode Connectivity of Neural Networks A. K. Akash Sixu Li Nicolas García Trillos 34 12 0 13 Oct 2022
How Much Data Are Augmentations Worth? An Investigation into Scaling Laws, Invariance, and Implicit Regularization Jonas Geiping Micah Goldblum Gowthami Somepalli Ravid Shwartz-Ziv Tom Goldstein A. Wilson 31 35 0 12 Oct 2022
Reinforcement Learning with Automated Auxiliary Loss Search Tairan He Yuge Zhang Kan Ren Minghuan Liu Che Wang Weinan Zhang Yuqing Yang Dongsheng Li 38 16 0 12 Oct 2022
Boosting the Transferability of Adversarial Attacks with Reverse Adversarial Perturbation Zeyu Qin Yanbo Fan Yi Liu Li Shen Yong Zhang Jue Wang Baoyuan Wu AAML SILM 29 81 0 12 Oct 2022
Improving Sharpness-Aware Minimization with Fisher Mask for Better Generalization on Language Models Qihuang Zhong Liang Ding Li Shen Peng Mi Juhua Liu Bo Du Dacheng Tao AAML 40 50 0 11 Oct 2022
Stable and Efficient Adversarial Training through Local Linearization Zhuorong Li Daiwei Yu AAML 30 0 0 11 Oct 2022
Meta-Learning with Self-Improving Momentum Target Jihoon Tack Jongjin Park Hankook Lee Jaeho Lee Jinwoo Shin LRM 68 12 0 11 Oct 2022
Make Sharpness-Aware Minimization Stronger: A Sparsified Perturbation Approach Peng Mi Li Shen Tianhe Ren Yiyi Zhou Xiaoshuai Sun Rongrong Ji Dacheng Tao AAML 43 69 0 11 Oct 2022
SML:Enhance the Network Smoothness with Skip Meta Logit for CTR Prediction Wenlong Deng Lang Lang Zichen Liu B. Liu 26 0 0 09 Oct 2022
GRANITE: A Graph Neural Network Model for Basic Block Throughput Estimation O. Sýkora P. Phothilimthana Charith Mendis Amir Yazdanbakhsh GNN 50 21 0 08 Oct 2022
Benchmarking Learnt Radio Localisation under Distribution Shift Maximilian Arnold Mohammed Alloulah 44 2 0 04 Oct 2022
Invariant Aggregator for Defending against Federated Backdoor Attacks Xiaoya Wang Dimitrios Dimitriadis Oluwasanmi Koyejo Shruti Tople FedML 44 1 0 04 Oct 2022
Homotopy-based training of NeuralODEs for accurate dynamics discovery Joon-Hyuk Ko Hankyul Koh Nojun Park W. Jhe 51 9 0 04 Oct 2022
Benign Autoencoders Semyon Malamud Teng Andrea Xu Antoine Didisheim DRL AI4CE 19 0 0 02 Oct 2022
MLPInit: Embarrassingly Simple GNN Training Acceleration with MLP Initialization Xiaotian Han Tong Zhao Yozen Liu Xia Hu Neil Shah GNN 66 36 0 30 Sep 2022
Slimmable Networks for Contrastive Self-supervised Learning Shuai Zhao Xiaohan Wang Linchao Zhu Yi Yang 40 1 0 30 Sep 2022
Scale-invariant Bayesian Neural Networks with Connectivity Tangent Kernel Sungyub Kim Si-hun Park Kyungsu Kim Eunho Yang BDL 32 4 0 30 Sep 2022
Multiple Modes for Continual Learning Siddhartha Datta N. Shadbolt CLL MoMe 45 2 0 29 Sep 2022
Batch Normalization Explained Randall Balestriero Richard G. Baraniuk AAML 36 16 0 29 Sep 2022
Model Zoos: A Dataset of Diverse Populations of Neural Network Models Konstantin Schurholt Diyar Taskiran Boris Knyazev Xavier Giró-i-Nieto Damian Borth 60 29 0 29 Sep 2022
Exploring the Relationship between Architecture and Adversarially Robust Generalization Aishan Liu Shiyu Tang Siyuan Liang Ruihao Gong Boxi Wu Xianglong Liu Dacheng Tao AAML 34 18 0 28 Sep 2022
On Physics-Informed Neural Networks for Quantum Computers Stefano Markidis PINN 32 18 0 28 Sep 2022
Why neural networks find simple solutions: the many regularizers of geometric complexity Benoit Dherin Michael Munn M. Rosca David Barrett 60 31 0 27 Sep 2022
Learning to Learn with Generative Models of Neural Network Checkpoints William S. Peebles Ilija Radosavovic Tim Brooks Alexei A. Efros Jitendra Malik UQCV 75 65 0 26 Sep 2022
Strong Transferable Adversarial Attacks via Ensembled Asymptotically Normal Distribution Learning Zhengwei Fang Rui Wang Tao Huang L. Jing AAML 40 5 0 24 Sep 2022
Revisiting Discrete Soft Actor-Critic Haibin Zhou Zichuan Lin Junyou Li Qiang Fu Wei Yang Deheng Ye 51 12 0 21 Sep 2022
Investigating and Mitigating Failure Modes in Physics-informed Neural Networks (PINNs) S. Basir PINN AI4CE 31 21 0 20 Sep 2022
Learning Symbolic Model-Agnostic Loss Functions via Meta-Learning Christian Raymond Qi Chen Bing Xue Mengjie Zhang FedML 33 11 0 19 Sep 2022
Bootstrap Generalization Ability from Loss Landscape Perspective Huanran Chen Shitong Shao Ziyi Wang Zirui Shang Jin Chen Xiaofeng Ji Xinxiao Wu OOD 63 17 0 18 Sep 2022
Towards Bridging the Performance Gaps of Joint Energy-based Models Xiulong Yang Qing Su Shihao Ji VLM 18 12 0 16 Sep 2022