Minimum Description Length and Generalization Guarantees for Representation Learning

5 February 2024

Papers citing "Minimum Description Length and Generalization Guarantees for Representation Learning"

16 / 16 papers shown

Title
Heterogeneity Matters even More in Distributed Learning: Study from Generalization Perspective Masoud Kavian Romain Chor Milad Sefidgaran Abdellatif Zaidi FedML 86 1 0 03 Mar 2025
Generalization Guarantees for Representation Learning via Data-Dependent Gaussian Mixture Priors Romain Chor Milad Sefidgaran Piotr Krasnowski 222 2 0 21 Feb 2025
Rate-Distortion Theoretic Generalization Bounds for Stochastic Learning Algorithms Romain Chor A. Gohari Gaël Richard Umut Simsekli 61 24 0 04 Mar 2022
Information-theoretic generalization bounds for black-box learning algorithms Hrayr Harutyunyan Maxim Raginsky Greg Ver Steeg Aram Galstyan 82 44 0 04 Oct 2021
Generalization bounds via distillation Daniel J. Hsu Ziwei Ji Matus Telgarsky Lan Wang FedML 46 34 0 12 Apr 2021
On Random Subset Generalization Error Bounds and the Stochastic Gradient Langevin Dynamics Algorithm Borja Rodríguez Gálvez Germán Bassi Ragnar Thobaben Mikael Skoglund 53 32 0 21 Oct 2020
Learning Optimal Representations with the Decodable Information Bottleneck Yann Dubois Douwe Kiela D. Schwab Ramakrishna Vedantam 56 43 0 27 Sep 2020
The Information Bottleneck Problem and Its Applications in Machine Learning Ziv Goldfeld Yury Polyanskiy 51 133 0 30 Apr 2020
On the Information Bottleneck Problems: Models, Connections, Applications and Information Theoretic Views Milad Sefidgaran Iñaki Estella Aguerri S. Shamai 40 90 0 31 Jan 2020
PyTorch: An Imperative Style, High-Performance Deep Learning Library Adam Paszke Sam Gross Francisco Massa Adam Lerer James Bradbury ... Sasank Chilamkurthy Benoit Steiner Lu Fang Junjie Bai Soumith Chintala ODL 389 42,299 0 03 Dec 2019
Tightening Mutual Information Based Bounds on Generalization Error Yuheng Bu Shaofeng Zou Venugopal V. Veeravalli 53 176 0 15 Jan 2019
Distributed Variational Representation Learning Iñaki Estella Aguerri Milad Sefidgaran 47 72 0 11 Jul 2018
Stronger generalization bounds for deep nets via a compression approach Sanjeev Arora Rong Ge Behnam Neyshabur Yi Zhang MLT AI4CE 84 639 0 14 Feb 2018
Neural Discrete Representation Learning Aaron van den Oord Oriol Vinyals Koray Kavukcuoglu BDL SSL OCL 208 4,989 0 02 Nov 2017
A PAC-Bayesian Approach to Spectrally-Normalized Margin Bounds for Neural Networks Behnam Neyshabur Srinadh Bhojanapalli Nathan Srebro 80 605 0 29 Jul 2017
Information-theoretic analysis of generalization capability of learning algorithms Aolin Xu Maxim Raginsky 153 445 0 22 May 2017