Norm of Word Embedding Encodes Information Gain

19 December 2022

Papers citing "Norm of Word Embedding Encodes Information Gain"

10 / 10 papers shown

Title
Semantics at an Angle: When Cosine Similarity Works Until It Doesn't Kisung You 28 0 0 22 Apr 2025
Weight-based Analysis of Detokenization in Language Models: Understanding the First Stage of Inference Without Inference Go Kamoda Benjamin Heinzerling Tatsuro Inaba Keito Kudo Keisuke Sakaguchi Kentaro Inui MILM 36 1 0 27 Jan 2025
Zipfian Whitening Sho Yokoi Han Bao Hiroto Kurita Hidetoshi Shimodaira 37 0 0 01 Nov 2024
Norm of Mean Contextualized Embeddings Determines their Variance Hiroaki Yamagiwa Hidetoshi Shimodaira 27 0 0 17 Sep 2024
Revisiting Cosine Similarity via Normalized ICA-transformed Embeddings Hiroaki Yamagiwa Momose Oyama Hidetoshi Shimodaira LLMSV 46 2 0 16 Jun 2024
Words Worth a Thousand Pictures: Measuring and Understanding Perceptual Variability in Text-to-Image Generation Raphael Tang Xinyu Crystina Zhang Lixinyu Xu Yao Lu Wenyan Li Pontus Stenetorp Jimmy Lin Ferhan Ture 36 0 0 12 Jun 2024
Latent Space Translation via Semantic Alignment Valentino Maiorca Luca Moschella Antonio Norelli Marco Fumero Francesco Locatello Emanuele Rodolà 27 21 0 01 Nov 2023
Contrastive Learning-based Sentence Encoders Implicitly Weight Informative Words Hiroto Kurita Goro Kobayashi Sho Yokoi Kentaro Inui 35 2 0 24 Oct 2023
Subspace Representations for Soft Set Operations and Sentence Similarities Yoichi Ishibashi Sho Yokoi Katsuhito Sudoh Satoshi Nakamura NAI 34 1 0 24 Oct 2022
What company do words keep? Revisiting the distributional semantics of J.R. Firth & Zellig Harris Mikael Brunila J. LaViolette 32 20 0 16 May 2022