All-but-the-Top: Simple and Effective Postprocessing for Word Representations

5 February 2017

Pramod Viswanath

Papers citing "All-but-the-Top: Simple and Effective Postprocessing for Word Representations"

50 / 50 papers shown

Title
CASE -- Condition-Aware Sentence Embeddings for Conditional Semantic Textual Similarity Measurement Gaifan Zhang Yi Zhou Danushka Bollegala 195 0 0 21 Mar 2025
Implicit Geometry of Next-token Prediction: From Language Sparsity Patterns to Model Representations Yize Zhao Tina Behnia V. Vakilian Christos Thrampoulidis 68 8 0 20 Feb 2025
Discrete Speech Unit Extraction via Independent Component Analysis Tomohiko Nakamura Kwanghee Choi Keigo Hojo Yoshiaki Bando Satoru Fukayama Shinji Watanabe 48 0 0 11 Jan 2025
Predicting Drug-Gene Relations via Analogy Tasks with Word Embeddings Hiroaki Yamagiwa Ryoma Hashimoto Kiwamu Arakane Ken Murakami Shou Soeda Momose Oyama Mariko Okada Hidetoshi Shimodaira Hidetoshi Shimodaira 44 0 0 03 Jun 2024
CLCE: An Approach to Refining Cross-Entropy and Contrastive Learning for Optimized Learning Fusion Zijun Long George Killick Lipeng Zhuang Gerardo Aragon Camarasa Zaiqiao Meng R. McCreadie VLM 50 2 0 22 Feb 2024
Exploring Anisotropy and Outliers in Multilingual Language Models for Cross-Lingual Semantic Sentence Similarity Katharina Hämmerl Alina Fastowski Jindrich Libovický Alexander Fraser 28 6 0 01 Jun 2023
Metrics for quantifying isotropy in high dimensional unsupervised clustering tasks in a materials context Samantha Durdy M. Gaultois Vladimir V. Gusev Danushka Bollegala M. Rosseinsky 11 0 0 25 May 2023
Accessing Higher Dimensions for Unsupervised Word Translation Sida I. Wang 28 0 0 23 May 2023
Discovering Universal Geometry in Embeddings with ICA Hiroaki Yamagiwa Momose Oyama Hidetoshi Shimodaira 31 15 0 22 May 2023
Token Imbalance Adaptation for Radiology Report Generation Yuexin Wu I. Huang Xiaolei Huang MedIm 29 7 0 18 Apr 2023
VNE: An Effective Method for Improving Deep Representation by Manipulating Eigenvalue Distribution Jaeill Kim Suhyun Kang Duhun Hwang Jungwook Shin Wonjong Rhee DRL 13 21 0 04 Apr 2023
Rediscovering Hashed Random Projections for Efficient Quantization of Contextualized Sentence Embeddings Ulf A. Hamster Ji-Ung Lee Alexander Geyken Iryna Gurevych 34 0 0 13 Mar 2023
Byte Pair Encoding for Symbolic Music Nathan Fradet Nicolas Gutowski F. Chhel Jean-Pierre Briot 29 15 0 27 Jan 2023
The Undesirable Dependence on Frequency of Gender Bias Metrics Based on Word Embeddings Francisco Valentini Germán Rosati D. Slezak Edgar Altszyler FaML 6 8 0 02 Jan 2023
A Survey of Mix-based Data Augmentation: Taxonomy, Methods, Applications, and Explainability Chengtai Cao Fan Zhou Yurou Dai Jianping Wang Kunpeng Zhang AAML 24 28 0 21 Dec 2022
Reliable Measures of Spread in High Dimensional Latent Spaces Anna C. Marbut Katy McKinney-Bock Travis J. Wheeler 30 2 0 15 Dec 2022
Paraphrase Identification with Deep Learning: A Review of Datasets and Methods Chao Zhou Cheng Qiu Daniel Ernesto Acuna 32 25 0 13 Dec 2022
Investigating the Frequency Distortion of Word Embeddings and Its Impact on Bias Metrics Francisco Valentini Juan Cruz Sosa D. Slezak Edgar Altszyler 22 3 0 15 Nov 2022
Reconciliation of Pre-trained Models and Prototypical Neural Networks in Few-shot Named Entity Recognition Youcheng Huang Wenqiang Lei Jie Fu Jiancheng Lv 19 3 0 07 Nov 2022
Hierarchies over Vector Space: Orienting Word and Graph Embeddings Xingzhi Guo Steven Skiena 22 1 0 02 Nov 2022
Self-supervised Rewiring of Pre-trained Speech Encoders: Towards Faster Fine-tuning with Less Labels in Speech Processing Haomiao Yang Jinming Zhao Gholamreza Haffari Ehsan Shareghi 30 2 0 24 Oct 2022
Unsupervised Sentence Textual Similarity with Compositional Phrase Semantics Zihao Wang Jiaheng Dou Yong Zhang OT 40 4 0 05 Oct 2022
Addressing Token Uniformity in Transformers via Singular Value Transformation Hanqi Yan Lin Gui Wenjie Li Yulan He 32 14 0 24 Aug 2022
Word Tour: One-dimensional Word Embeddings via the Traveling Salesman Problem Ryoma Sato 17 0 0 04 May 2022
Contrastive Visual Semantic Pretraining Magnifies the Semantics of Natural Language Representations Robert Wolfe Aylin Caliskan VLM 21 13 0 14 Mar 2022
Just Rank: Rethinking Evaluation with Word and Sentence Similarities Bin Wang C.-C. Jay Kuo Haizhou Li ELM 24 29 0 05 Mar 2022
Mind the Gap: Understanding the Modality Gap in Multi-modal Contrastive Representation Learning Weixin Liang Yuhui Zhang Yongchan Kwon Serena Yeung James Zou VLM 45 391 0 03 Mar 2022
Regional Negative Bias in Word Embeddings Predicts Racial Animus--but only via Name Frequency Austin Van Loon Salvatore Giorgi Robb Willer J. Eichstaedt 42 10 0 20 Jan 2022
Low Frequency Names Exhibit Bias and Overfitting in Contextualizing Language Models Robert Wolfe Aylin Caliskan 92 51 0 01 Oct 2021
MirrorWiC: On Eliciting Word-in-Context Representations from Pretrained Language Models Qianchu Liu Fangyu Liu Nigel Collier Anna Korhonen Ivan Vulić 142 21 0 19 Sep 2021
A Simple and Effective Method To Eliminate the Self Language Bias in Multilingual Representations Ziyi Yang Yinfei Yang Daniel Cer Eric F. Darve 33 22 0 10 Sep 2021
Rare Tokens Degenerate All Tokens: Improving Neural Text Generation via Adaptive Gradient Gating for Rare Token Embeddings Sangwon Yu Jongyoon Song Heeseung Kim SeongEun Lee Woo-Jong Ryu Sung-Hoon Yoon 19 31 0 07 Sep 2021
A Mechanism for Producing Aligned Latent Spaces with Autoencoders Saachi Jain Adityanarayanan Radhakrishnan Caroline Uhler 24 9 0 29 Jun 2021
Empirical Evaluation of Pre-trained Transformers for Human-Level NLP: The Role of Sample Size and Dimensionality Adithya V Ganesan Matthew Matero Aravind Reddy Ravula Huy-Hien Vu H. Andrew Schwartz 30 35 0 07 May 2021
IITK@LCP at SemEval 2021 Task 1: Classification for Lexical Complexity Regression Task Neil Rajiv Shirude Sagnik Mukherjee Tushar Shandhilya Ananta Mukherjee Ashutosh Modi 13 4 0 02 Apr 2021
Understanding Capacity-Driven Scale-Out Neural Recommendation Inference Michael Lui Yavuz Yetim Özgür Özkan Zhuoran Zhao Shin-Yeh Tsai Carole-Jean Wu Mark Hempstead GNN BDL LRM 22 51 0 04 Nov 2020
On the Sentence Embeddings from Pre-trained Language Models Bohan Li Hao Zhou Junxian He Mingxuan Wang Yiming Yang Lei Li 30 213 0 02 Nov 2020
Robust and Consistent Estimation of Word Embedding for Bangla Language by fine-tuning Word2Vec Model Rifat Rahman 14 9 0 26 Oct 2020
Autoencoding Improves Pre-trained Word Embeddings Masahiro Kaneko Danushka Bollegala LLMSV 8 14 0 25 Oct 2020
Pretraining Federated Text Models for Next Word Prediction Joel Stremmel Arjun Singh FedML 15 52 0 11 May 2020
Double-Hard Debias: Tailoring Word Embeddings for Gender Bias Mitigation Tianlu Wang Xi Lin Nazneen Rajani Bryan McCann Vicente Ordonez Caimng Xiong CVBM 157 54 0 03 May 2020
IsoBN: Fine-Tuning BERT with Isotropic Batch Normalization Wenxuan Zhou Bill Yuchen Lin Xiang Ren 14 24 0 02 May 2020
Multi-SimLex: A Large-Scale Evaluation of Multilingual and Cross-Lingual Lexical Semantic Similarity Ivan Vulić Simon Baker Edoardo Ponti Ulla Petti Ira Leviant ... Eden Bar Matt Malone Thierry Poibeau Roi Reichart Anna Korhonen 21 82 0 10 Mar 2020
Embedding Compression with Isotropic Iterative Quantization Siyu Liao Jie Chen Yanzhi Wang Qinru Qiu Bo Yuan MQ 26 12 0 11 Jan 2020
Conceptor Debiasing of Word Representations Evaluated on WEAT S. Karve Lyle Ungar João Sedoc FaML 22 33 0 14 Jun 2019
An Empirical Study on Post-processing Methods for Word Embeddings Shuai Tang Mahta Mousavi V. D. Sa 17 6 0 27 May 2019
Correlation Coefficients and Semantic Textual Similarity V. Zhelezniak Aleksandar Savkov April Shen Nils Y. Hammerla 25 50 0 19 May 2019
A La Carte Embedding: Cheap but Effective Induction of Semantic Feature Vectors M. Khodak Nikunj Saunshi Yingyu Liang Tengyu Ma Brandon M Stewart Sanjeev Arora 38 98 0 14 May 2018
Simple and Effective Dimensionality Reduction for Word Embeddings Vikas Raunak 16 101 0 11 Aug 2017
Convolutional Neural Networks for Sentence Classification Yoon Kim AILaw VLM 267 13,368 0 25 Aug 2014