Modular Block-diagonal Curvature Approximations for Feedforward Architectures

5 February 2019

Papers citing "Modular Block-diagonal Curvature Approximations for Feedforward Architectures"

3 / 3 papers shown

Title
What Does It Mean to Be a Transformer? Insights from a Theoretical Hessian Analysis Weronika Ormaniec Felix Dangel Sidak Pal Singh 33 6 0 14 Oct 2024
ISAAC Newton: Input-based Approximate Curvature for Newton's Method Felix Petersen Tobias Sutter Christian Borgelt Dongsung Huh Hilde Kuehne Yuekai Sun Oliver Deussen ODL 31 5 0 01 May 2023
Gradient Descent on Neurons and its Link to Approximate Second-Order Optimization Frederik Benzing ODL 40 23 0 28 Jan 2022