v1v2v3 (latest)

Visualizing the Loss Landscape of Neural Nets

28 December 2017

Hao Li

Papers citing "Visualizing the Loss Landscape of Neural Nets"

50 / 1,068 papers shown

Title
Understanding Decoupled and Early Weight Decay Johan Bjorck Kilian Q. Weinberger Carla P. Gomes 61 25 0 27 Dec 2020
Data optimization for large batch distributed training of deep neural networks Shubhankar Gahlot Junqi Yin Mallikarjun Shankar 23 1 0 16 Dec 2020
Amata: An Annealing Mechanism for Adversarial Training Acceleration Nanyang Ye Qianxiao Li Xiao-Yun Zhou Zhanxing Zhu AAML 90 15 0 15 Dec 2020
Concept Generalization in Visual Representation Learning Mert Bulent Sariyildiz Yannis Kalantidis Diane Larlus Alahari Karteek SSL 109 50 0 10 Dec 2020
A Deeper Look at the Hessian Eigenspectrum of Deep Neural Networks and its Applications to Regularization Adepu Ravi Sankar Yash Khasbage Rahul Vigneswaran V. Balasubramanian 89 44 0 07 Dec 2020
Exploration-Exploitation in Multi-Agent Learning: Catastrophe Theory Meets Game Theory Stefanos Leonardos Georgios Piliouras 57 45 0 05 Dec 2020
Fine-tuning BERT for Low-Resource Natural Language Understanding via Active Learning Daniel Grießhaber J. Maucher Ngoc Thang Vu 74 46 0 04 Dec 2020
DeepVideoMVS: Multi-View Stereo on Video with Recurrent Spatio-Temporal Fusion Arda Duzcceker S. Galliani Christoph Vogel Pablo Speciale Mihai Dusmanu Marc Pollefeys MDE 96 97 0 03 Dec 2020
Temporal Representation Learning on Monocular Videos for 3D Human Pose Estimation S. Honari Victor Constantin Helge Rhodin Mathieu Salzmann Pascal Fua 3DH 89 10 0 02 Dec 2020
Neural Teleportation M. Armenta Thierry Judge Nathan Painchaud Youssef Skandarani Carl Lemaire Gabriel Gibeau Sanchez Philippe Spino Pierre-Marc Jodoin 66 17 0 02 Dec 2020
To Boldly Show What No One Has Seen Before: A Dashboard for Visualizing Multi-objective Landscapes Lennart Schäpermeier C. Grimme P. Kerschke 53 11 0 29 Nov 2020
Is Support Set Diversity Necessary for Meta-Learning? Amrith Rajagopal Setlur Oscar Li Virginia Smith 104 16 0 28 Nov 2020
GENNI: Visualising the Geometry of Equivalences for Neural Network Identifiability Daniel Lengyel Janith C. Petangoda Isak Falk Kate Highnam Michalis Lazarou A. Kolbeinsson M. Deisenroth N. Jennings 66 5 0 14 Nov 2020
SALR: Sharpness-aware Learning Rate Scheduler for Improved Generalization Xubo Yue Maher Nouiehed Raed Al Kontar ODL 36 4 0 10 Nov 2020
Improving Neural Network Training in Low Dimensional Random Bases Frithjof Gressmann Zach Eaton-Rosen Carlo Luschi 78 28 0 09 Nov 2020
Matthews Correlation Coefficient Loss for Deep Convolutional Networks: Application to Skin Lesion Segmentation Kumar Abhishek Ghassan Hamarneh 45 32 0 26 Oct 2020
Deep Neural Mobile Networking Chaoyun Zhang 65 1 0 23 Oct 2020
Characterizing Deep Gaussian Processes via Nonlinear Recurrence Systems Anh Tong Jaesik Choi 46 2 0 19 Oct 2020
Towards Theoretically Understanding Why SGD Generalizes Better Than ADAM in Deep Learning Pan Zhou Jiashi Feng Chao Ma Caiming Xiong Guosheng Lin E. Weinan 101 235 0 12 Oct 2020
Towards Hardware-Agnostic Gaze-Trackers Jatin Sharma Jon Campbell P. Ansell Jay Beavers Christopher O'Dowd 14 2 0 11 Oct 2020
Regularizing Neural Networks via Adversarial Model Perturbation Yaowei Zheng Richong Zhang Yongyi Mao AAML 107 99 0 10 Oct 2020
Reconciling Modern Deep Learning with Traditional Optimization Analyses: The Intrinsic Learning Rate Zhiyuan Li Kaifeng Lyu Sanjeev Arora 112 75 0 06 Oct 2020
Deep kernel processes Laurence Aitchison Adam X. Yang Sebastian W. Ober BDL 96 42 0 04 Oct 2020
Sharpness-Aware Minimization for Efficiently Improving Generalization Pierre Foret Ariel Kleiner H. Mobahi Behnam Neyshabur AAML 203 1,360 0 03 Oct 2020
Unsupervised Point Cloud Pre-Training via Occlusion Completion Hanchen Wang Qi Liu Xiangyu Yue Joan Lasenby Matt J. Kusner 3DPC 111 253 0 02 Oct 2020
Accelerating Convergence of Replica Exchange Stochastic Gradient MCMC via Variance Reduction Wei Deng Qi Feng G. Karagiannis Guang Lin F. Liang 72 9 0 02 Oct 2020
Effective Regularization Through Loss-Function Metalearning Santiago Gonzalez Xin Qiu Risto Miikkulainen 126 5 0 02 Oct 2020
Implicit Gradient Regularization David Barrett Benoit Dherin 95 152 0 23 Sep 2020
Towards a Mathematical Understanding of Neural Network-Based Machine Learning: what we know and what we don't E. Weinan Chao Ma Stephan Wojtowytsch Lei Wu AI4CE 125 134 0 22 Sep 2020
Anomalous diffusion dynamics of learning in deep neural networks Guozhang Chen Chengqing Qu P. Gong 127 22 0 22 Sep 2020
Learning Task-Agnostic Action Spaces for Movement Optimization Amin Babadi M. van de Panne Caren Liu Perttu Hämäläinen 35 2 0 22 Sep 2020
Kernel-Based Smoothness Analysis of Residual Networks Tom Tirer Joan Bruna Raja Giryes 82 20 0 21 Sep 2020
Review: Deep Learning in Electron Microscopy Jeffrey M. Ede 191 80 0 17 Sep 2020
Effective Federated Adaptive Gradient Methods with Non-IID Decentralized Data Qianqian Tong Guannan Liang J. Bi FedML 101 28 0 14 Sep 2020
Deforming the Loss Surface to Affect the Behaviour of the Optimizer Liangming Chen Long Jin Xiujuan Du Shuai Li Mei Liu ODL 21 2 0 14 Sep 2020
On the Orthogonality of Knowledge Distillation with Other Techniques: From an Ensemble Perspective Seonguk Park Kiyoon Yoo Nojun Kwak FedML 40 3 0 09 Sep 2020
Going deeper with brain morphometry using neural networks Rodrigo Santa Cruz Leo Lebrat Pierrick Bourgeat Vincent Doré Jason Dowling Jurgen Fripp Clinton Fookes Olivier Salvado 3DV MedIm 31 6 0 07 Sep 2020
S-SGD: Symmetrical Stochastic Gradient Descent with Weight Noise Injection for Reaching Flat Minima Wonyong Sung Iksoo Choi Jinhwan Park Seokhyun Choi Sungho Shin ODL 56 7 0 05 Sep 2020
Visualizing the Loss Landscape of Actor Critic Methods with Applications in Inventory Optimization Recep Yusuf Bekci M. Gümüş 29 4 0 04 Sep 2020
DARTS-: Robustly Stepping out of Performance Collapse Without Indicators Xiangxiang Chu Xiaoxing Wang Bo Zhang Shun Lu Xiaolin K. Wei Junchi Yan 62 168 0 02 Sep 2020
A Primer on Motion Capture with Deep Learning: Principles, Pitfalls and Perspectives Alexander Mathis Steffen Schneider Jessy Lauer Mackenzie W. Mathis 105 166 0 01 Sep 2020
Adversarially Robust Learning via Entropic Regularization Gauri Jagatap Ameya Joshi A. B. Chowdhury S. Garg Chinmay Hegde OOD 121 11 0 27 Aug 2020
Likelihood Landscapes: A Unifying Principle Behind Many Adversarial Defenses Fu-Huei Lin Rohit Mittapalli Prithvijit Chattopadhyay Daniel Bolya Judy Hoffman AAML 63 2 0 25 Aug 2020
Prevention is Better than Cure: Handling Basis Collapse and Transparency in Dense Networks Gurpreet Singh Soumyajit Gupta Clint Dawson AI4CE 19 0 0 22 Aug 2020
DronePose: Photorealistic UAV-Assistant Dataset Synthesis for 3D Pose Estimation via a Smooth Silhouette Loss G. Albanis N. Zioulis A. Dimou D. Zarpalas P. Daras 3DH 49 10 0 20 Aug 2020
Neural Complexity Measures Yoonho Lee Juho Lee Sung Ju Hwang Eunho Yang Seungjin Choi 85 9 0 07 Aug 2020
Continuous-in-Depth Neural Networks A. Queiruga N. Benjamin Erichson D. Taylor Michael W. Mahoney 101 48 0 05 Aug 2020
A Neural-Symbolic Framework for Mental Simulation Michael D Kissner 24 0 0 05 Aug 2020
Analytic Characterization of the Hessian in Shallow ReLU Models: A Tale of Symmetry Yossi Arjevani M. Field 55 16 0 04 Aug 2020
Shallow Univariate ReLu Networks as Splines: Initialization, Loss Surface, Hessian, & Gradient Flow Dynamics Justin Sahs Ryan Pyle Aneel Damaraju J. O. Caro Onur Tavaslioglu Andy Lu Ankit B. Patel 60 19 0 04 Aug 2020