On Variational Bounds of Mutual Information

16 May 2019

Papers citing "On Variational Bounds of Mutual Information"

50 / 172 papers shown

Title
Constructive Assimilation: Boosting Contrastive Learning Performance through View Generation Strategies Ligong Han Seung-Jun Han Shivchander Sudalairaj Charlotte Loh Rumen Dangovski ... Pulkit Agrawal Dimitris N. Metaxas Leonid Karlinsky Tsui-Wei Weng Akash Srivastava 30 1 0 02 Apr 2023
Accelerating exploration and representation learning with offline pre-training Bogdan Mazoure Jake Bruce Doina Precup Rob Fergus Ankit Anand OffRL 34 5 0 31 Mar 2023
Generalized Information Bottleneck for Gaussian Variables Wave Ngampruetikorn David J. Schwab 19 1 0 31 Mar 2023
The Wyner Variational Autoencoder for Unsupervised Multi-Layer Wireless Fingerprinting Tengfei Huang T. Dahanayaka Kanchana Thilakarathna Philip H. W. Leong H. El Gamal 22 2 0 28 Mar 2023
Deep Clustering with a Constraint for Topological Invariance based on Symmetric InfoNCE Yuhui Zhang Yuichiro Wada Hiroki Waida Kaito Goto Yusaku Hino Takafumi Kanamori 27 3 0 06 Mar 2023
Modern Bayesian Experimental Design Tom Rainforth Adam Foster Desi R. Ivanova Freddie Bickford-Smith 37 77 0 28 Feb 2023
Transformed Distribution Matching for Missing Value Imputation He Zhao Ke Sun Amir Dezfouli Edwin V. Bonilla 34 19 0 20 Feb 2023
Predictable MDP Abstraction for Unsupervised Model-Based RL Seohong Park Sergey Levine 19 9 0 08 Feb 2023
Bayesian Self-Supervised Contrastive Learning B. Liu Bang-wei Wang Tianrui Li SSL BDL 29 4 0 27 Jan 2023
Efficient data transport over multimode light-pipes with Megapixel images using differentiable ray tracing and Machine-learning Joowon Lim Jannes Gladrow Douglas J Kelly G. O'Shea Govert Verkes Ioan A. Stefanovici Sebastian Nowozin B. Thomsen 27 2 0 16 Jan 2023
GEDI: GEnerative and DIscriminative Training for Self-Supervised Learning Emanuele Sansone Robin Manhaeve SSL 20 9 0 27 Dec 2022
Localized Contrastive Learning on Graphs Hengrui Zhang Qitian Wu Yu Wang Shaofeng Zhang Junchi Yan Philip S. Yu 24 9 0 08 Dec 2022
Statistical Physics of Deep Neural Networks: Initialization toward Optimal Channels Kangyu Weng Aohua Cheng Ziyang Zhang Pei Sun Yang Tian 53 2 0 04 Dec 2022
Curiosity in Hindsight: Intrinsic Exploration in Stochastic Environments Daniel Jarrett Corentin Tallec Florent Altché Thomas Mesnard Rémi Munos Michal Valko 48 5 0 18 Nov 2022
A robust estimator of mutual information for deep learning interpretability Davide Piras H. Peiris A. Pontzen Luisa Lucie-Smith Ningyuan Guo Brian D. Nord SSL DRL 29 15 0 31 Oct 2022
Characterizing information loss in a chaotic double pendulum with the Information Bottleneck Kieran A. Murphy Danielle Bassett 8 0 0 25 Oct 2022
PI-QT-Opt: Predictive Information Improves Multi-Task Robotic Reinforcement Learning at Scale Kuang-Huei Lee Ted Xiao A. Li Paul Wohlhart Ian S. Fischer Yao Lu 51 10 0 15 Oct 2022
Variational Graph Generator for Multi-View Graph Clustering Jianpeng Chen Yawen Ling Jie Xu Yazhou Ren Shudong Huang X. Pu Zhifeng Hao Philip S. Yu Lifang He 33 5 0 13 Oct 2022
Decoding Visual Neural Representations by Multimodal Learning of Brain-Visual-Linguistic Features Changde Du Kaicheng Fu Jinpeng Li Huiguang He VLM 45 68 0 13 Oct 2022
Unsupervised Few-shot Learning via Deep Laplacian Eigenmaps Kuilin Chen Chi-Guhn Lee SSL 40 3 0 07 Oct 2022
InfoOT: Information Maximizing Optimal Transport Ching-Yao Chuang Stefanie Jegelka David Alvarez-Melis OT 35 12 0 06 Oct 2022
Spectral Augmentation for Self-Supervised Learning on Graphs Lu Lin Jinghui Chen Hongning Wang OOD 32 48 0 02 Oct 2022
A Causal Intervention Scheme for Semantic Segmentation of Quasi-periodic Cardiovascular Signals Xingyao Wang Yuwen Li Hongxiang Gao Xianghong Cheng Jianqing Li Chengyu Liu 33 6 0 19 Sep 2022
Augmenting Reinforcement Learning with Transformer-based Scene Representation Learning for Decision-making of Autonomous Driving Haochen Liu Zhiyu Huang Xiaoyu Mo Chen Lv ViT OffRL 35 33 0 24 Aug 2022
Neural PCA for Flow-Based Representation Learning Shen Li Bryan Hooi DRL 13 1 0 23 Aug 2022
RenyiCL: Contrastive Representation Learning with Skew Renyi Divergence Kyungmin Lee Jinwoo Shin SSL DRL 31 10 0 12 Aug 2022
Analyzing Data-Centric Properties for Graph Contrastive Learning Puja Trivedi Ekdeep Singh Lubana Mark Heimann Danai Koutra Jayaraman J. Thiagarajan 30 11 0 04 Aug 2022
Consistency is the key to further mitigating catastrophic forgetting in continual learning Prashant Shivaram Bhat Bahram Zonooz Elahe Arani CLL 32 16 0 11 Jul 2022
Mutual Information-guided Knowledge Transfer for Novel Class Discovery Chuyu Zhang Chuanyan Hu Ruijie Xu Zhitong Gao Qian He Xuming He 20 4 0 24 Jun 2022
Bayesian model calibration for block copolymer self-assembly: Likelihood-free inference and expected information gain computation via measure transport Ricardo Baptista Lianghao Cao Joshua Chen Omar Ghattas Fengyi Li Youssef M. Marzouk J. Oden 31 11 0 22 Jun 2022
Variational Distillation for Multi-View Learning Xudong Tian Zhizhong Zhang Cong Wang Wensheng Zhang Yanyun Qu Lizhuang Ma Zongze Wu Yuan Xie Dacheng Tao 26 5 0 20 Jun 2022
Contrastive Learning as Goal-Conditioned Reinforcement Learning Benjamin Eysenbach Tianjun Zhang Ruslan Salakhutdinov Sergey Levine SSL OffRL 28 140 0 15 Jun 2022
Gacs-Korner Common Information Variational Autoencoder Michael Kleinman Alessandro Achille Stefano Soatto J. Kao CML DRL 32 12 0 24 May 2022
Principled Paraphrase Generation with Parallel Corpora Aitor Ormazabal Mikel Artetxe Aitor Soroa Etxabe Gorka Labaka Eneko Agirre 48 9 0 24 May 2022
Conditional Supervised Contrastive Learning for Fair Text Classification Jianfeng Chi Will Shand Yaodong Yu Kai-Wei Chang Han Zhao Yuan Tian FaML 46 14 0 23 May 2022
Data-Driven Estimation of Capacity Upper Bounds Christian Hager E. Agrell 30 2 0 13 May 2022
Statistical applications of contrastive learning Michael U. Gutmann Steven Kleinegesse Benjamin Rhodes 24 7 0 29 Apr 2022
Exploring Negatives in Contrastive Learning for Unpaired Image-to-Image Translation Yu-Hsiang Lin Sen Zhang Tianshui Chen Yongyi Lu G. Li Yukai Shi SSL 34 20 0 23 Apr 2022
Empirical Evaluation and Theoretical Analysis for Representation Learning: A Survey Kento Nozawa Issei Sato AI4TS 24 4 0 18 Apr 2022
Augmentation-Free Graph Contrastive Learning with Performance Guarantee Haonan Wang Jieyu Zhang Qi Zhu Wei Huang 30 31 0 11 Apr 2022
Chaos is a Ladder: A New Theoretical Understanding of Contrastive Learning via Augmentation Overlap Yifei Wang Qi Zhang Yisen Wang Jiansheng Yang Zhouchen Lin 27 98 0 25 Mar 2022
A Unified Contrastive Energy-based Model for Understanding the Generative Ability of Adversarial Training Yifei Wang Yisen Wang Jiansheng Yang Zhouchen Lin AAML 29 13 0 25 Mar 2022
Language modeling via stochastic processes Rose E. Wang Esin Durmus Noah D. Goodman Tatsunori Hashimoto BDL AI4TS 40 24 0 21 Mar 2022
Information-Theoretic Odometry Learning Sen Zhang Jing Zhang Dacheng Tao 20 5 0 11 Mar 2022
Compressed Predictive Information Coding Rui Meng Tianyi Luo K. Bouchard 24 1 0 03 Mar 2022
Interventions, Where and How? Experimental Design for Causal Models at Scale P. Tigas Yashas Annadani Andrew Jesson Bernhard Schölkopf Y. Gal Stefan Bauer CML 36 48 0 03 Mar 2022
A Differential Entropy Estimator for Training Neural Networks Georg Pichler Pierre Colombo Malik Boudiaf Günther Koliander Pablo Piantanida 25 21 0 14 Feb 2022
CIC: Contrastive Intrinsic Control for Unsupervised Skill Discovery Michael Laskin Hao Liu Xue Bin Peng Denis Yarats Aravind Rajeswaran Pieter Abbeel SSL 78 65 0 01 Feb 2022
Fundamental Limits for Sensor-Based Robot Control Anirudha Majumdar Zhi-Yong Mei Vincent Pacelli 27 1 0 31 Jan 2022
Interpretable and Generalizable Graph Learning via Stochastic Attention Mechanism Siqi Miao Miaoyuan Liu Pan Li 14 197 0 31 Jan 2022