Convergence of Smoothed Empirical Measures with Applications to Entropy
Estimation

Convergence of Smoothed Empirical Measures with Applications to Entropy Estimation

30 May 2019

Kristjan Greenewald

Yury Polyanskiy

Jonathan Niles-Weed

Papers citing "Convergence of Smoothed Empirical Measures with Applications to Entropy Estimation"

19 / 19 papers shown

Title
InfoBridge: Mutual Information estimation via Bridge Matching Sergei Kholkin Ivan Butakov Evgeny Burnaev Nikita Gushchin Alexander Korotin DiffM FedML 96 0 0 03 Feb 2025
On the best approximation by finite Gaussian mixtures Yun Ma Yihong Wu Pengkun Yang 52 1 0 13 Apr 2024
Information-Theoretic Generalization Bounds for Deep Neural Networks Haiyun He Christina Lee Yu 79 5 0 04 Apr 2024
Estimating Differential Entropy under Gaussian Convolutions Ziv Goldfeld Kristjan Greenewald Yury Polyanskiy 43 11 0 27 Oct 2018
Estimating Information Flow in Deep Neural Networks Ziv Goldfeld E. Berg Kristjan Greenewald Igor Melnyk Nam H. Nguyen Brian Kingsbury Yury Polyanskiy 47 32 0 12 Oct 2018
Entropy and mutual information in models of deep neural networks Marylou Gabrié Andre Manoel Clément Luneau Jean Barbier N. Macris Florent Krzakala Lenka Zdeborová 61 180 0 24 May 2018
i-RevNet: Deep Invertible Networks J. Jacobsen A. Smeulders Edouard Oyallon 83 333 0 20 Feb 2018
The Nearest Neighbor Information Estimator is Adaptively Near Minimax Rate-Optimal Jiantao Jiao Weihao Gao Yanjun Han 47 47 0 23 Nov 2017
Optimal rates of entropy estimation over Lipschitz balls Yanjun Han Jiantao Jiao Tsachy Weissman Yihong Wu 67 73 0 06 Nov 2017
Additivity of Information in Multilayer Networks via Additive Gaussian Noise Transforms Galen Reeves 40 33 0 12 Oct 2017
Opening the Black Box of Deep Neural Networks via Information Ravid Shwartz-Ziv Naftali Tishby AI4CE 94 1,406 0 02 Mar 2017
Finite-Sample Analysis of Fixed-k Nearest Neighbor Density Functional Estimators Shashank Singh Barnabás Póczós 48 53 0 05 Jun 2016
Efficient multivariate entropy estimation via $k$ -nearest neighbour distances Thomas B. Berrett R. Samworth M. Yuan 47 123 0 01 Jun 2016
On the Kozachenko-Leonenko entropy estimator N. Fournier S. Delattre MDE 40 53 0 24 Feb 2016
Deep Learning and the Information Bottleneck Principle Naftali Tishby Noga Zaslavsky DRL 152 1,570 0 09 Mar 2015
Minimax rates of entropy estimation on large alphabets via best polynomial approximation Yihong Wu Pengkun Yang 74 220 0 01 Jul 2014
On the rate of convergence in Wasserstein distance of the empirical measure N. Fournier Arnaud Guillin 134 1,141 0 07 Dec 2013
Ensemble estimators for multivariate entropy estimation K. Sricharan Dennis L. Wei Alfred Hero 85 83 0 26 Mar 2012
A tail inequality for quadratic forms of subgaussian random vectors Daniel J. Hsu Sham Kakade Tong Zhang 101 418 0 13 Oct 2011

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.