Hierarchical nucleation in deep neural networks

Hierarchical nucleation in deep neural networks

7 July 2020

Alessandro Laio

Papers citing "Hierarchical nucleation in deep neural networks"

10 / 10 papers shown

Title
The Geometry of Tokens in Internal Representations of Large Language Models Karthik Viswanathan Yuri Gardinazzi Giada Panerai Alberto Cazzaniga Matteo Biagetti AIFin 102 4 0 17 Jan 2025
Emergence of a High-Dimensional Abstraction Phase in Language Transformers Emily Cheng Diego Doimo Corentin Kervadec Iuri Macocco Jade Yu Alessandro Laio Marco Baroni 112 11 0 24 May 2024
Systematic Architectural Design of Scale Transformed Attention Condenser DNNs via Multi-Scale Class Representational Response Similarity Analysis Andrew Hryniowski Alexander Wong 23 0 0 16 Jun 2023
Deep neural networks architectures from the perspective of manifold learning German Magai AAML AI4CE 30 6 0 06 Jun 2023
Data Representations' Study of Latent Image Manifolds Ilya Kaufman Omri Azencot 14 7 0 31 May 2023
The geometry of hidden representations of large transformer models L. Valeriani Diego Doimo F. Cuturello Alessandro Laio A. Ansuini Alberto Cazzaniga MILM 29 50 0 01 Feb 2023
Neural Collapse with Normalized Features: A Geometric Analysis over the Riemannian Manifold Can Yaras Peng Wang Zhihui Zhu Laura Balzano Qing Qu 25 42 0 19 Sep 2022
What do CNNs Learn in the First Layer and Why? A Linear Systems Perspective Rhea Chowers Yair Weiss 33 2 0 06 Jun 2022
DADApy: Distance-based Analysis of DAta-manifolds in Python Aldo Glielmo Iuri Macocco Diego Doimo Matteo Carli C. Zeni Romina Wild M. d’Errico Alex Rodriguez Alessandro Laio 11 37 0 04 May 2022
Topology and geometry of data manifold in deep learning German Magai A. Ayzenberg AAML 21 11 0 19 Apr 2022