On Variational Bounds of Mutual Information

16 May 2019

Papers citing "On Variational Bounds of Mutual Information"

50 / 167 papers shown

Title
InfoPO: On Mutual Information Maximization for Large Language Model Alignment Teng Xiao Zhen Ge Sujay Sanghavi Tian Wang Julian Katz-Samuels Marc Versage Qingjun Cui Trishul Chilimbi 31 0 0 13 May 2025
DocVXQA: Context-Aware Visual Explanations for Document Question Answering Mohamed Ali Souibgui Changkyu Choi Andrey Barsky Kangsoo Jung Ernest Valveny Dimosthenis Karatzas 28 0 0 12 May 2025
A Tutorial on Discriminative Clustering and Mutual Information Louis Ohl Pierre-Alexandre Mattei F. Precioso 32 0 0 07 May 2025
MInCo: Mitigating Information Conflicts in Distracted Visual Model-based Reinforcement Learning Shiguang Sun Hanbo Zhang Zeyang Liu Xinrui Yang Lipeng Wan Bing Yan Xingyu Chen Xuguang Lan 38 0 0 05 Apr 2025
Weakly Supervised Contrastive Adversarial Training for Learning Robust Features from Semi-supervised Data Lilin Zhang Chengpei Wu Ning Yang 39 0 0 14 Mar 2025
Structural Entropy Guided Unsupervised Graph Out-Of-Distribution Detection Yue Hou He Zhu Ruomei Liu Yingke Su Jinxiang Xia Junran Wu Ke Xu OODD 111 0 0 13 Mar 2025
TwinTURBO: Semi-Supervised Fine-Tuning of Foundation Models via Mutual Information Decompositions for Downstream Task and Latent Spaces Guillaume Quétant Pavlo Molchanov Slava Voloshynovskiy 47 0 0 10 Mar 2025
INFO-SEDD: Continuous Time Markov Chains as Scalable Information Metrics Estimators Alberto Foresti Giulio Franzese Pietro Michiardi 82 0 0 26 Feb 2025
A Neural Difference-of-Entropies Estimator for Mutual Information Haoran Ni Martin Lotz SSL DRL 91 0 0 18 Feb 2025
The Energy Loss Phenomenon in RLHF: A New Perspective on Mitigating Reward Hacking Yuchun Miao Sen Zhang Liang Ding Yuqi Zhang Lefei Zhang Dacheng Tao 81 3 0 31 Jan 2025
The "Law" of the Unconscious Contrastive Learner: Probabilistic Alignment of Unpaired Modalities Yongwei Che Benjamin Eysenbach 41 1 0 20 Jan 2025
Learning to Assist Humans without Inferring Rewards Vivek Myers Evan Ellis Sergey Levine Benjamin Eysenbach Anca Dragan 43 2 0 17 Jan 2025
Interpreting Deep Neural Network-Based Receiver Under Varying Signal-To-Noise Ratios Marko Tuononen Dani Korpi Ville Hautamäki FAtt 38 1 0 10 Jan 2025
Discrete Curvature Graph Information Bottleneck Xingcheng Fu Jian Wang Yisen Gao Qingyun Sun Haonan Yuan Jianxin Li Xianxian Li 34 0 0 31 Dec 2024
Learning an Adaptive and View-Invariant Vision Transformer for Real-Time UAV Tracking You Wu Yongxin Li Mengyuan Liu Xucheng Wang Xiangyang Yang Hengzhou Ye Dan Zeng Qijun Zhao Shuiwang Li 140 0 0 28 Dec 2024
Constructing Fair Latent Space for Intersection of Fairness and Explainability Hyungjun Joo Hyeonggeun Han Sehwan Kim Sangwoo Hong Jungwoo Lee 40 0 0 23 Dec 2024
Bounds on Lp errors in density ratio estimation via f-divergence loss functions Yoshiaki Kitazawa 21 0 0 02 Oct 2024
Learning Deep Kernels for Non-Parametric Independence Testing Nathaniel Xu Feng Liu Danica J. Sutherland BDL 34 0 0 10 Sep 2024
Variational Inference Failures Under Model Symmetries: Permutation Invariant Posteriors for Bayesian Neural Networks Yoav Gelberg Tycho F. A. van der Ouderaa Mark van der Wilk Y. Gal AAML 40 4 0 10 Aug 2024
Invariant Graph Learning Meets Information Bottleneck for Out-of-Distribution Generalization Wenyu Mao Jiancan Wu Haoyang Liu Yongduo Sui Xiang Wang OOD 39 2 0 03 Aug 2024
Learning Temporal Distances: Contrastive Successor Features Can Provide a Metric Structure for Decision-Making Vivek Myers Chongyi Zheng Anca Dragan Sergey Levine Benjamin Eysenbach OffRL 45 7 0 24 Jun 2024
Partial Information Decomposition for Data Interpretability and Feature Selection Charles Westphal Stephen Hailes Mirco Musolesi 40 0 0 29 May 2024
Topological Perspectives on Optimal Multimodal Embedding Spaces Abdul Aziz Abdul Rahim BDL 42 0 0 29 May 2024
Contrastive Representation for Data Filtering in Cross-Domain Offline Reinforcement Learning Xiaoyu Wen Chenjia Bai Kang Xu Xudong Yu Yang Zhang Xuelong Li Zhen Wang 41 2 0 10 May 2024
MAIN-VC: Lightweight Speech Representation Disentanglement for One-shot Voice Conversion Pengcheng Li Jianzong Wang Xulong Zhang Yong Zhang Jing Xiao Ning Cheng DRL 41 1 0 02 May 2024
Contrastive Learning Method for Sequential Recommendation based on Multi-Intention Disentanglement Zeyu Hu Yuzhi Xiao Tao Huang Xuanrong Huo DRL 44 0 0 28 Apr 2024
Variational Bayesian Optimal Experimental Design with Normalizing Flows Jiayuan Dong Christian L. Jacobsen Mehdi Khalloufi Maryam Akram Wanjiao Liu Karthik Duraisamy Xun Huan BDL 54 5 0 08 Apr 2024
Poly-View Contrastive Learning Amitis Shidani Devon Hjelm Jason Ramapuram Russ Webb Eeshan Gunesh Dhekane Dan Busbridge VLM SSL 34 4 0 08 Mar 2024
Learning to Maximize Mutual Information for Chain-of-Thought Distillation Xin Chen Hanxian Huang Yanjun Gao Yi Wang Jishen Zhao Ke Ding 35 11 0 05 Mar 2024
Disentangling representations of retinal images with generative models Sarah Muller Lisa M. Koch Hendrik P. A. Lensch Philipp Berens MedIm 32 3 0 29 Feb 2024
Separating common from salient patterns with Contrastive Representation Learning Robin Louiset Edouard Duchesnay Antoine Grigis Pietro Gori SSL DRL 46 1 0 19 Feb 2024
Information-Theoretic State Variable Selection for Reinforcement Learning Charles Westphal Stephen Hailes Mirco Musolesi 26 3 0 21 Jan 2024
Bridging State and History Representations: Understanding Self-Predictive RL Tianwei Ni Benjamin Eysenbach Erfan Seyedsalehi Michel Ma Clement Gehring Aditya Mahajan Pierre-Luc Bacon AI4TS AI4CE 22 20 0 17 Jan 2024
Training on Synthetic Data Beats Real Data in Multimodal Relation Extraction Zilin Du Haoxin Li Xu Guo Boyang Li 35 1 0 05 Dec 2023
Removing Biases from Molecular Representations via Information Maximization Chenyu Wang Sharut Gupta Caroline Uhler Tommi Jaakkola 19 4 0 01 Dec 2023
Machine-learning optimized measurements of chaotic dynamical systems via the information bottleneck Kieran A. Murphy Danielle Bassett 36 5 0 08 Nov 2023
METRA: Scalable Unsupervised RL with Metric-Aware Abstraction Seohong Park Oleh Rybkin Sergey Levine OffRL 33 34 0 13 Oct 2023
Stabilizing Subject Transfer in EEG Classification with Divergence Estimation Niklas Smedemark-Margulies Ye Wang T. Koike-Akino Jing Liu K. Parsons Yunus Bicer Deniz Erdogmus 9 0 0 12 Oct 2023
Multimodal Variational Auto-encoder based Audio-Visual Segmentation Yuxin Mao Jing Zhang Mochu Xiang Yiran Zhong Yuchao Dai 40 34 0 12 Oct 2023
Interpretable Diffusion via Information Decomposition Xianghao Kong Ollie Liu Han Li Dani Yogatama Greg Ver Steeg 24 20 0 12 Oct 2023
Learning Disentangled Representation with Mutual Information Maximization for Real-Time UAV Tracking Xucheng Wang Xiangyang Yang Hengzhou Ye Shuiwang Li 21 5 0 20 Aug 2023
GiGaMAE: Generalizable Graph Masked Autoencoder via Collaborative Latent Space Reconstruction Yucheng Shi Yushun Dong Qiaoyu Tan Jundong Li Ninghao Liu 48 24 0 18 Aug 2023
Amortised Experimental Design and Parameter Estimation for User Models of Pointing Antti Keurulainen Isak Westerlund Oskar Keurulainen Andrew Howes 28 7 0 19 Jul 2023
HomoGCL: Rethinking Homophily in Graph Contrastive Learning Wenzhong Li Changdong Wang Hui Xiong Jian-Huang Lai 26 22 0 16 Jun 2023
Unsupervised Scientific Abstract Segmentation with Normalized Mutual Information Yingqiang Gao Jessica Lam Nianlong Gu Richard H. R. Hahnloser 18 0 0 19 May 2023
Long-Tailed Recognition by Mutual Information Maximization between Latent Features and Ground-Truth Labels Min-Kook Suh Seung-Woo Seo SSL 26 14 0 02 May 2023
Denoising Cosine Similarity: A Theory-Driven Approach for Efficient Representation Learning Takumi Nakagawa Y. Sanada Hiroki Waida Yuhui Zhang Yuichiro Wada K. Takanashi Tomonori Yamada Takafumi Kanamori DiffM 19 5 0 19 Apr 2023
LIMIT: Learning Interfaces to Maximize Information Transfer Benjamin A. Christie Dylan P. Losey 31 4 0 17 Apr 2023
VNE: An Effective Method for Improving Deep Representation by Manipulating Eigenvalue Distribution Jaeill Kim Suhyun Kang Duhun Hwang Jungwook Shin Wonjong Rhee DRL 13 21 0 04 Apr 2023
Constructive Assimilation: Boosting Contrastive Learning Performance through View Generation Strategies Ligong Han Seung-Jun Han Shivchander Sudalairaj Charlotte Loh Rumen Dangovski ... Pulkit Agrawal Dimitris N. Metaxas Leonid Karlinsky Tsui-Wei Weng Akash Srivastava 27 1 0 02 Apr 2023