Unsupervised detection of semantic correlations in big data

4 November 2024

Papers citing "Unsupervised detection of semantic correlations in big data"

18 / 18 papers shown

Title
The Geometry of Tokens in Internal Representations of Large Language Models Karthik Viswanathan Yuri Gardinazzi Giada Panerai Alberto Cazzaniga Matteo Biagetti AIFin 129 7 0 17 Jan 2025
Intrinsic Dimension Correlation: uncovering nonlinear connections in multimodal representations Lorenzo Basile Santiago Acevedo Luca Bortolussi Fabio Anselmi Alex Rodriguez 73 4 0 22 Jun 2024
Emergence of a High-Dimensional Abstraction Phase in Language Transformers Emily Cheng Diego Doimo Corentin Kervadec Iuri Macocco Jade Yu Alessandro Laio Marco Baroni 131 15 0 24 May 2024
$What is the $\textit{intrinsic}$ dimension of your binary data? -- and how to compute it quickly$ What is the $\textit{intrinsic}$ dimension of your binary data? -- and how to compute it quickly Tom Hanika Tobias Hille 31 1 0 09 Apr 2024
Bridging Information-Theoretic and Geometric Compression in Language Models Emily Cheng Corentin Kervadec Marco Baroni 59 21 0 20 Oct 2023
BitNet: Scaling 1-bit Transformers for Large Language Models Hongyu Wang Shuming Ma Li Dong Shaohan Huang Huaijie Wang Lingxiao Ma Fan Yang Ruiping Wang Yi Wu Furu Wei MQ 70 110 0 17 Oct 2023
Phase transitions in the mini-batch size for sparse and dense two-layer neural networks Raffaele Marino F. Ricci-Tersenghi 62 15 0 10 May 2023
The geometry of hidden representations of large transformer models L. Valeriani Diego Doimo F. Cuturello Alessandro Laio A. Ansuini Alberto Cazzaniga MILM 56 58 0 01 Feb 2023
Intrinsic dimension estimation for discrete metrics Iuri Macocco Aldo Glielmo J. Grilli Alessandro Laio 99 10 0 20 Jul 2022
DADApy: Distance-based Analysis of DAta-manifolds in Python Aldo Glielmo Iuri Macocco Diego Doimo Matteo Carli C. Zeni Romina Wild M. d’Errico Alex Rodriguez Alessandro Laio 64 40 0 04 May 2022
Ranking the information content of distance measures Aldo Glielmo C. Zeni Bing Cheng Gábor Csányi Alessandro Laio 102 36 0 30 Apr 2021
The Intrinsic Dimension of Images and Its Impact on Learning Phillip E. Pope Chen Zhu Ahmed Abdelkader Micah Goldblum Tom Goldstein 231 271 0 18 Apr 2021
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 602 4,822 0 23 Jan 2020
Intrinsic dimension estimation for locally undersampled data Vittorio Erba M. Gherardi P. Rotondo 45 31 0 18 Jun 2019
Intrinsic dimension of data representations in deep neural networks A. Ansuini Alessandro Laio Jakob H. Macke D. Zoccolan AI4CE 69 279 0 29 May 2019
A Survey on Methods and Theories of Quantized Neural Networks Yunhui Guo MQ 65 232 0 13 Aug 2018
The High-Dimensional Geometry of Binary Neural Networks Alexander G. Anderson C. P. Berg MQ 59 75 0 19 May 2017
Quantized Neural Networks: Training Neural Networks with Low Precision Weights and Activations Itay Hubara Matthieu Courbariaux Daniel Soudry Ran El-Yaniv Yoshua Bengio MQ 149 1,864 0 22 Sep 2016