Learning to Remove: Towards Isotropic Pre-trained BERT Embedding

12 April 2021

Papers citing "Learning to Remove: Towards Isotropic Pre-trained BERT Embedding"

8 / 8 papers shown

Title
ALF: Advertiser Large Foundation Model for Multi-Modal Advertiser Understanding Santosh Rajagopalan Jonathan Vronsky Songbai Yan S. Alireza Golestaneh Shubhra Chandra Min Zhou 66 0 0 26 Apr 2025
Norm of Mean Contextualized Embeddings Determines their Variance Hiroaki Yamagiwa Hidetoshi Shimodaira 27 0 0 17 Sep 2024
Exploring Anisotropy and Outliers in Multilingual Language Models for Cross-Lingual Semantic Sentence Similarity Katharina Hämmerl Alina Fastowski Jindrich Libovický Alexander Fraser 28 6 0 01 Jun 2023
Byte Pair Encoding for Symbolic Music Nathan Fradet Nicolas Gutowski F. Chhel Jean-Pierre Briot 29 15 0 27 Jan 2023
Reliable Measures of Spread in High Dimensional Latent Spaces Anna C. Marbut Katy McKinney-Bock Travis J. Wheeler 30 2 0 15 Dec 2022
Shortcut Learning of Large Language Models in Natural Language Understanding Mengnan Du Fengxiang He Na Zou Dacheng Tao Xia Hu KELM OffRL 40 84 0 25 Aug 2022
Outliers Dimensions that Disrupt Transformers Are Driven by Frequency Giovanni Puccetti Anna Rogers Aleksandr Drozd F. Dell’Orletta 79 42 0 23 May 2022
Efficient Estimation of Word Representations in Vector Space Tomáš Mikolov Kai Chen G. Corrado J. Dean 3DV 296 31,267 0 16 Jan 2013