When Similarity Digest Meets Vector Management System: A Survey on Similarity Hash Function

Abstract
The booming vector manage system calls for feasible similarity hash function to perform similarity analysis. In this paper, we make a systematically survey on the existent well-known similarity hash functions to tease out the satisfied ones. We conclude that the similarity hash function MinHash, Nilsimsa can be directly plugged into the pipeline of similarity analysis using vector manage system. After that, we make a brief and empirical discussion on the performance, drawbacks of the these functions and highlight MinHash and the variant of SimHash are the best for vector management system for large-scale similarity analysis.
View on arXivComments on this paper