58
v1v2 (latest)

A note on entropy estimation

Abstract

We compare an entropy estimator HzH_z recently discussed in [10] with two estimators H1H_1 and H2H_2 introduced in [6][7]. We prove the identity HzH1H_z \equiv H_1, which has not been taken into account in [10]. Then, we prove that the statistical bias of H1H_1 is less than the bias of the ordinary likelihood estimator of entropy. Finally, by numerical simulation we verify that for the most interesting regime of small sample estimation and large event spaces, the estimator H2H_2 has a significant smaller statistical error than HzH_z.

View on arXiv
Comments on this paper