Emergence of Separable Manifolds in Deep Language Representations

Emergence of Separable Manifolds in Deep Language Representations

1 June 2020

Miguel Angel del Rio

Cory Stephenson

Papers citing "Emergence of Separable Manifolds in Deep Language Representations"

13 / 13 papers shown

Title
Geometric Signatures of Compositionality Across a Language Model's Lifetime Jin Hwa Lee Thomas Jiralerspong Lei Yu Yoshua Bengio Emily Cheng CoGe 84 0 0 02 Oct 2024
Large language models implicitly learn to straighten neural sentence trajectories to construct a predictive representation of natural language Eghbal A. Hosseini Evelina Fedorenko LLMSV 25 4 0 05 Nov 2023
Bridging Information-Theoretic and Geometric Compression in Language Models Emily Cheng Corentin Kervadec Marco Baroni 34 16 0 20 Oct 2023
Deep neural networks architectures from the perspective of manifold learning German Magai AAML AI4CE 24 6 0 06 Jun 2023
Privacy-Preserving Prompt Tuning for Large Language Model Services Yansong Li Zhixing Tan Yang Liu SILM VLM 50 63 0 10 May 2023
The geometry of hidden representations of large transformer models L. Valeriani Diego Doimo F. Cuturello A. Laio A. Ansuini Alberto Cazzaniga MILM 21 48 0 01 Feb 2023
Deep Learning Models to Study Sentence Comprehension in the Human Brain S. Arana Jacques Pesnot Lerousseau P. Hagoort 23 10 0 16 Jan 2023
Textual Manifold-based Defense Against Natural Language Adversarial Examples D. M. Nguyen Anh Tuan Luu AAML 21 17 0 05 Nov 2022
Same Pre-training Loss, Better Downstream: Implicit Bias Matters for Language Models Hong Liu Sang Michael Xie Zhiyuan Li Tengyu Ma AI4CE 40 49 0 25 Oct 2022
Neural Collapse with Normalized Features: A Geometric Analysis over the Riemannian Manifold Can Yaras Peng Wang Zhihui Zhu Laura Balzano Qing Qu 25 41 0 19 Sep 2022
Discovering Latent Concepts Learned in BERT Fahim Dalvi A. Khan Firoj Alam Nadir Durrani Jia Xu Hassan Sajjad SSL 11 56 0 15 May 2022
Neural Population Geometry Reveals the Role of Stochasticity in Robust Perception Joel Dapello J. Feather Hang Le Tiago Marques David D. Cox Josh H. McDermott J. DiCarlo SueYeon Chung AAML OOD 13 24 0 12 Nov 2021
The Bottom-up Evolution of Representations in the Transformer: A Study with Machine Translation and Language Modeling Objectives Elena Voita Rico Sennrich Ivan Titov 198 181 0 03 Sep 2019