Low-Entropy Latent Variables Hurt Out-of-Distribution Performance

Low-Entropy Latent Variables Hurt Out-of-Distribution Performance

20 May 2023

ArXiv (abs)PDF HTML

Papers citing "Low-Entropy Latent Variables Hurt Out-of-Distribution Performance"

11 / 11 papers shown

Title
Towards Out-Of-Distribution Generalization: A Survey Jiashuo Liu Zheyan Shen Yue He Xingxuan Zhang Renzhe Xu Han Yu Peng Cui CML OOD 155 535 0 31 Aug 2021
An Effective Baseline for Robustness to Distributional Shift S. Thulasidasan Sushil Thapa S. Dhaubhadel Gopinath Chennupati Tanmoy Bhattacharya J. Bilmes OOD OODD 65 27 0 15 May 2021
A Survey on Contrastive Self-supervised Learning Ashish Jaiswal Ashwin Ramesh Babu Mohammad Zaki Zadeh Debapriya Banerjee F. Makedon SSL 129 1,398 0 31 Oct 2020
Compressing Images by Encoding Their Latent Representations with Relative Entropy Coding Gergely Flamich Marton Havasi José Miguel Hernández-Lobato 118 61 0 02 Oct 2020
Measuring Robustness to Natural Distribution Shifts in Image Classification Rohan Taori Achal Dave Vaishaal Shankar Nicholas Carlini Benjamin Recht Ludwig Schmidt OOD 123 549 0 01 Jul 2020
The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalization Dan Hendrycks Steven Basart Norman Mu Saurav Kadavath Frank Wang ... Samyak Parajuli Mike Guo Basel Alomair Jacob Steinhardt Justin Gilmer OOD 357 1,757 0 29 Jun 2020
Coherent Gradients: An Approach to Understanding Generalization in Gradient Descent-based Optimization S. Chatterjee ODL OOD 107 51 0 25 Feb 2020
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 792 132,454 0 12 Jun 2017
Learning to Communicate with Deep Multi-Agent Reinforcement Learning Jakob N. Foerster Yannis Assael Nando de Freitas Shimon Whiteson 155 1,614 0 21 May 2016
Deep Metric Learning via Lifted Structured Feature Embedding Hyun Oh Song Yu Xiang Stefanie Jegelka Silvio Savarese FedML SSL DML 97 1,645 0 19 Nov 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 2.1K 150,364 0 22 Dec 2014