Visualizing the Loss Landscape of Neural Nets

28 December 2017

Hao Li

Papers citing "Visualizing the Loss Landscape of Neural Nets"

50 / 1,046 papers shown

Title
Learning Deep Optimal Embeddings with Sinkhorn Divergences S. Roy Yan Han Mehrtash Harandi L. Petersson 25 0 0 14 Sep 2022
OpenMixup: A Comprehensive Mixup Benchmark for Visual Classification Siyuan Li Zedong Wang Zicheng Liu Di Wu Cheng Tan Weiyang Jin Stan Z. Li VLM 43 31 0 11 Sep 2022
Git Re-Basin: Merging Models modulo Permutation Symmetries Samuel K. Ainsworth J. Hayase S. Srinivasa MoMe 255 318 0 11 Sep 2022
On the Privacy Risks of Cell-Based NAS Architectures Haiping Huang Zhikun Zhang Yun Shen Michael Backes Qi Li Yang Zhang 33 7 0 04 Sep 2022
Super-model ecosystem: A domain-adaptation perspective Fengxiang He Dacheng Tao DiffM 35 1 0 30 Aug 2022
Visualizing high-dimensional loss landscapes with Hessian directions Lucas Böttcher Gregory R. Wheeler 37 13 0 28 Aug 2022
A Study on Broadcast Networks for Music Genre Classification Ahmed Heakl A. Abdelgawad Victor Parque 19 6 0 25 Aug 2022
Improving the Trainability of Deep Neural Networks through Layerwise Batch-Entropy Regularization David Peer Bart Keulen Sebastian Stabinger J. Piater A. Rodríguez-Sánchez 42 6 0 01 Aug 2022
Biologically Plausible Training of Deep Neural Networks Using a Top-down Credit Assignment Network Jian-Hui Chen Cheng-Lin Liu Zuoren Wang 28 0 0 01 Aug 2022
Learning Hyper Label Model for Programmatic Weak Supervision Renzhi Wu Sheng Chen Jieyu Zhang Xu Chu 26 16 0 27 Jul 2022
Efficient One Pass Self-distillation with Zipf's Label Smoothing Jiajun Liang Linze Li Z. Bing Borui Zhao Yao Tang Bo Lin Haoqiang Fan 28 19 0 26 Jul 2022
Trainability Preserving Neural Pruning Huan Wang Yun Fu AAML 22 17 0 25 Jul 2022
Deep Laparoscopic Stereo Matching with Transformers Xuelian Cheng Yiran Zhong Mehrtash Harandi Tom Drummond Zhiyong Wang Zongyuan Ge ViT MedIm 41 14 0 25 Jul 2022
Deep Learning of Radiative Atmospheric Transfer with an Autoencoder Abigail Basener Bill Basener AI4CE 11 1 0 21 Jul 2022
Streamable Neural Fields Junwoo Cho Seungtae Nam Daniel Rho J. Ko Eunbyung Park AI4TS 40 17 0 20 Jul 2022
Adversarial Pixel Restoration as a Pretext Task for Transferable Perturbations H. Malik Shahina Kunhimon Muzammal Naseer Salman Khan Fahad Shahbaz Khan AAML 33 8 0 18 Jul 2022
PointNorm: Dual Normalization is All You Need for Point Cloud Analysis Shen Zheng Jinqian Pan Chang-Tien Lu Gaurav Gupta 3DPC 43 7 0 13 Jul 2022
Implicit regularization of dropout Zhongwang Zhang Zhi-Qin John Xu 29 21 0 13 Jul 2022
Zero-shot Cross-lingual Transfer is Under-specified Optimization Shijie Wu Benjamin Van Durme Mark Dredze 33 6 0 12 Jul 2022
On the Subspace Structure of Gradient-Based Meta-Learning Gustaf Tegnér Alfredo Reichlin Hang Yin Mårten Björkman Danica Kragic 37 0 0 08 Jul 2022
An Empirical Study of Implicit Regularization in Deep Offline RL Çağlar Gülçehre Srivatsan Srinivasan Jakub Sygnowski Georg Ostrovski Mehrdad Farajtabar Matt Hoffman Razvan Pascanu Arnaud Doucet OffRL 22 17 0 05 Jul 2022
Federated Self-supervised Learning for Video Understanding Yasar Abbas Ur Rehman Yan Gao Jiajun Shen Pedro Porto Buarque de Gusmão Nicholas D. Lane FedML 39 15 0 05 Jul 2022
Understanding and Improving Group Normalization Agus Gunawan Xu Yin Kang Zhang 15 3 0 05 Jul 2022
PoF: Post-Training of Feature Extractor for Improving Generalization Ikuro Sato Ryota Yamada Masayuki Tanaka Nakamasa Inoue Rei Kawakami 21 2 0 05 Jul 2022
Aug-NeRF: Training Stronger Neural Radiance Fields with Triple-Level Physically-Grounded Augmentations Tianlong Chen Peihao Wang Zhiwen Fan Zhangyang Wang 38 55 0 04 Jul 2022
Stabilizing Off-Policy Deep Reinforcement Learning from Pixels Edoardo Cetin Philip J. Ball Steve Roberts Oya Celiktutan 40 36 0 03 Jul 2022
On Leave-One-Out Conditional Mutual Information For Generalization Mohamad Rida Rammal Alessandro Achille Aditya Golatkar Suhas Diggavi Stefano Soatto VLM 41 6 0 01 Jul 2022
Where to Begin? On the Impact of Pre-Training and Initialization in Federated Learning John Nguyen Jianyu Wang Kshitiz Malik Maziar Sanjabi Michael G. Rabbat FedML AI4CE 34 21 0 30 Jun 2022
Training Your Sparse Neural Network Better with Any Mask Ajay Jaiswal Haoyu Ma Tianlong Chen Ying Ding Zhangyang Wang CVBM 34 35 0 26 Jun 2022
On the Importance and Applicability of Pre-Training for Federated Learning Hong-You Chen Cheng-Hao Tu Zi-hua Li Hang Shen Wei-Lun Chao FedML 29 79 0 23 Jun 2022
Near-optimal control of dynamical systems with neural ordinary differential equations Lucas Böttcher Thomas Asikis AI4CE 24 19 0 22 Jun 2022
Few-Max: Few-Shot Domain Adaptation for Unsupervised Contrastive Representation Learning Ali Lotfi-Rezaabad Sidharth Kumar S. Vishwanath Jonathan I. Tamir SSL 22 1 0 21 Jun 2022
Critical Investigation of Failure Modes in Physics-informed Neural Networks S. Basir Inanc Senocak PINN AI4CE 12 18 0 20 Jun 2022
Characterizing and Mitigating the Difficulty in Training Physics-informed Artificial Neural Networks under Pointwise Constraints S. Basir Inanc Senocak AI4CE 32 1 0 19 Jun 2022
Sparse Double Descent: Where Network Pruning Aggravates Overfitting Zhengqi He Zeke Xie Quanzhi Zhu Zengchang Qin 86 27 0 17 Jun 2022
Revisiting Self-Distillation M. Pham Minsu Cho Ameya Joshi C. Hegde 26 22 0 17 Jun 2022
Understanding the Generalization Benefit of Normalization Layers: Sharpness Reduction Kaifeng Lyu Zhiyuan Li Sanjeev Arora FAtt 52 71 0 14 Jun 2022
Modeling the Machine Learning Multiverse Samuel J. Bell Onno P. Kampman Jesse Dodge Neil D. Lawrence 31 17 0 13 Jun 2022
Fisher SAM: Information Geometry and Sharpness Aware Minimisation Minyoung Kim Da Li S. Hu Timothy M. Hospedales AAML 30 70 0 10 Jun 2022
Data-Efficient Double-Win Lottery Tickets from Robust Pre-training Tianlong Chen Zhenyu Zhang Sijia Liu Yang Zhang Shiyu Chang Zhangyang Wang AAML 24 8 0 09 Jun 2022
AttX: Attentive Cross-Connections for Fusion of Wearable Signals in Emotion Recognition Anubha Bhatti Behnam Behinaein Paul Hungler Ali Etemad EgoV 4 13 0 09 Jun 2022
SDQ: Stochastic Differentiable Quantization with Mixed Precision Xijie Huang Zhiqiang Shen Shichao Li Zechun Liu Xianghong Hu Jeffry Wicaksana Eric P. Xing Kwang-Ting Cheng MQ 32 33 0 09 Jun 2022
Sharp-MAML: Sharpness-Aware Model-Agnostic Meta Learning Momin Abbas Quan-Wu Xiao Lisha Chen Pin-Yu Chen Tianyi Chen 26 78 0 08 Jun 2022
Diffusion Curvature for Estimating Local Curvature in High Dimensional Data Dhananjay Bhaskar Kincaid MacDonald O. Fasina Dawson Thomas Bastian Rieck Ian M. Adelstein Smita Krishnaswamy DiffM 25 7 0 08 Jun 2022
Enhancing Strong PUF Security with Non-monotonic Response Quantization Kleber Stangherlin Zhuanhao Wu Hiren J. Patel M. Sachdev 20 4 0 07 Jun 2022
Explaining the physics of transfer learning a data-driven subgrid-scale closure to a different turbulent flow Adam Subel Yifei Guan Ashesh Chattopadhyay Pedram Hassanzadeh AI4CE 37 41 0 07 Jun 2022
Recall Distortion in Neural Network Pruning and the Undecayed Pruning Algorithm Aidan Good Jia-Huei Lin Hannah Sieg Mikey Ferguson Xin Yu Shandian Zhe J. Wieczorek Thiago Serra 42 11 0 07 Jun 2022
Generalized Federated Learning via Sharpness Aware Minimization Zhe Qu Xingyu Li Rui Duan Yaojiang Liu Bo Tang Zhuo Lu FedML 50 132 0 06 Jun 2022
Safety Certification for Stochastic Systems via Neural Barrier Functions Frederik Baymler Mathiesen S. Calvert Luca Laurenti 31 35 0 03 Jun 2022
Transforming medical imaging with Transformers? A comparative review of key properties, current progresses, and future perspectives Jun Li Junyu Chen Yucheng Tang Ce Wang Bennett A. Landman S. K. Zhou ViT OOD MedIm 25 24 0 02 Jun 2022