Information-Theoretic Understanding of Population Risk Improvement with Model Compression

27 January 2019

Papers citing "Information-Theoretic Understanding of Population Risk Improvement with Model Compression"

6 / 6 papers shown

Title
Tighter Expected Generalization Error Bounds via Convexity of Information Measures Gholamali Aminian Yuheng Bu G. Wornell Miguel R. D. Rodrigues 13 22 0 24 Feb 2022
An Information-theoretical Approach to Semi-supervised Learning under Covariate-shift Gholamali Aminian Mahed Abroshan Mohammad Mahdi Khalili Laura Toni M. Rodrigues OOD 33 27 0 24 Feb 2022
Characterizing the Generalization Error of Gibbs Algorithm with Symmetrized KL information Gholamali Aminian Yuheng Bu Laura Toni M. Rodrigues G. Wornell 30 4 0 28 Jul 2021
Knowledge Distillation as Semiparametric Inference Tri Dao G. Kamath Vasilis Syrgkanis Lester W. Mackey 40 31 0 20 Apr 2021
Tightening Mutual Information Based Bounds on Generalization Error Yuheng Bu Shaofeng Zou V. Veeravalli 22 169 0 15 Jan 2019
Rate Distortion For Model Compression: From Theory To Practice Weihao Gao Yu-Han Liu Chong-Jun Wang Sewoong Oh 30 31 0 09 Oct 2018