Deep Learning and the Information Bottleneck Principle

9 March 2015

Papers citing "Deep Learning and the Information Bottleneck Principle"

36 / 36 papers shown

Title
Multi-Scale Probabilistic Generation Theory: A Hierarchical Framework for Interpreting Large Language Models Yukin Zhang Qi Dong 39 0 0 23 May 2025
Compression, Regularity, Randomness and Emergent Structure: Rethinking Physical Complexity in the Data-Driven Era Nima Dehghani AI4CE 59 0 0 12 May 2025
Quantifying Privacy Leakage in Split Inference via Fisher-Approximated Shannon Information Analysis Ruijun Deng Zhihui Lu Qiang Duan FedML 89 0 0 14 Apr 2025
Towards Combinatorial Interpretability of Neural Computation Micah Adler Dan Alistarh Nir Shavit FAtt 288 1 0 10 Apr 2025
A Quantitative Evaluation of the Expressivity of BMI, Pose and Gender in Body Embeddings for Recognition and Identification Basudha Pal Siyuan Huang 105 0 0 09 Mar 2025
Hyper-SET: Designing Transformers via Hyperspherical Energy Minimization Yunzhe Hu Difan Zou Dong Xu 67 1 0 17 Feb 2025
Steinmetz Neural Networks for Complex-Valued Data Shyam Venkatasubramanian Ali Pezeshki Vahid Tarokh 376 0 0 17 Feb 2025
Unleashing the Power of Large Language Model for Denoising Recommendation Shuyao Wang Zhi Zheng Yongduo Sui Hui Xiong 139 0 0 13 Feb 2025
Improving Deep Regression with Tightness Shihao Zhang Yuguang Yan Angela Yao OOD 115 0 0 13 Feb 2025
InfoBridge: Mutual Information estimation via Bridge Matching Sergei Kholkin Ivan Butakov Evgeny Burnaev Nikita Gushchin Alexander Korotin DiffM FedML 89 0 0 03 Feb 2025
Neural Honeytrace: A Robust Plug-and-Play Watermarking Framework against Model Extraction Attacks Yixiao Xu Binxing Fang Rui Wang Yinghai Zhou S. Ji Yuan Liu Mohan Li AAML MIACV 87 0 0 16 Jan 2025
Causal Deep Learning M. Alex O. Vasilescu CML 88 2 1 03 Jan 2025
Constructing Fair Latent Space for Intersection of Fairness and Explainability Hyungjun Joo Hyeonggeun Han Sehwan Kim Sangwoo Hong Jungwoo Lee 59 0 0 23 Dec 2024
Parallelized Autoregressive Visual Generation Yanjie Wang Shuhuai Ren Zhijie Lin Yujin Han Haoyuan Guo Zhenheng Yang Difan Zou Jiashi Feng Xihui Liu VGen 120 12 0 19 Dec 2024
Segment-Level Diffusion: A Framework for Controllable Long-Form Generation with Diffusion Language Models Xiaochen Zhu Georgi Karadzhov Chenxi Whitehouse Andreas Vlachos DiffM 112 0 0 15 Dec 2024
Editable-DeepSC: Reliable Cross-Modal Semantic Communications for Facial Editing Bin Chen Wenbo Yu Qinshan Zhang Tianqu Zhuang Yong Jiang Shu-Tao Xia 249 0 0 24 Nov 2024
Quantifying Knowledge Distillation Using Partial Information Decomposition Pasan Dissanayake Faisal Hamman Barproda Halder Ilia Sucholutsky Qiuyi Zhang Sanghamitra Dutta 53 0 0 12 Nov 2024
A Survey of Deep Graph Learning under Distribution Shifts: from Graph Out-of-Distribution Generalization to Adaptation Kexin Zhang Shuhan Liu Song Wang Weili Shi Chen Chen Pan Li Sheng Li Jundong Li Kaize Ding OOD 96 3 0 25 Oct 2024
LiNo: Advancing Recursive Residual Decomposition of Linear and Nonlinear Patterns for Robust Time Series Forecasting Guoqi Yu Yaoming Li Xiaoyu Guo Dayu Wang Zirui Liu Shujun Wang Tong Yang AI4TS 327 0 0 22 Oct 2024
Task-Augmented Cross-View Imputation Network for Partial Multi-View Incomplete Multi-Label Classification Xiaohuan Lu Lian Zhao Wai Keung Wong Jie Wen Jiang Long Wulin Xie 43 1 0 12 Sep 2024
Training Foundation Models as Data Compression: On Information, Model Weights and Copyright Law Giorgio Franceschelli Claudia Cevenini Mirco Musolesi 57 0 0 18 Jul 2024
Pretraining with Random Noise for Fast and Robust Learning without Weight Transport Jeonghwan Cheon Sang Wan Lee Se-Bum Paik OOD 333 2 0 27 May 2024
High-Dimension Human Value Representation in Large Language Models Samuel Cahyawijaya Delong Chen Yejin Bang Leila Khalatbari Bryan Wilie Ziwei Ji Etsuko Ishii Pascale Fung 129 6 0 11 Apr 2024
FOOL: Addressing the Downlink Bottleneck in Satellite Computing with Neural Feature Compression Alireza Furutanpey Qiyang Zhang Philipp Raith Tobias Pfandzelter Shangguang Wang Schahram Dustdar 107 4 0 25 Mar 2024
Debiased Offline Representation Learning for Fast Online Adaptation in Non-stationary Dynamics Xinyu Zhang Wenjie Qiu Yi-Chen Li Lei Yuan Chengxing Jia Zongzhang Zhang Yang Yu OffRL 70 1 0 17 Feb 2024
Towards an Information Theoretic Framework of Context-Based Offline Meta-Reinforcement Learning Lanqing Li Hai Zhang Xinyu Zhang Shatong Zhu Junqiao Zhao Junqiao Zhao Pheng-Ann Heng OffRL 65 8 0 04 Feb 2024
MIMIR: Masked Image Modeling for Mutual Information-based Adversarial Robustness Xiaoyun Xu Shujian Yu Jingzheng Wu S. Picek AAML 54 0 0 08 Dec 2023
Information-Theoretic Generalization Bounds for Transductive Learning and its Applications Huayi Tang Yong Liu 83 1 0 08 Nov 2023
Large Language Models at Work in China's Labor Market Qin Chen Jinfeng Ge Huaqing Xie Xingcheng Xu Yanqing Yang 64 1 0 17 Aug 2023
Explaining Representation by Mutual Information Li Gu SSL FAtt 55 0 0 28 Mar 2021
Utilizing Explainable AI for Quantization and Pruning of Deep Neural Networks Muhammad Sabih Frank Hannig J. Teich MQ 52 23 0 20 Aug 2020
ClusterFit: Improving Generalization of Visual Representations Xueting Yan Ishan Misra Abhinav Gupta Deepti Ghadiyaram D. Mahajan SSL VLM 57 132 0 06 Dec 2019
Nonlinear Information Bottleneck Artemy Kolchinsky Brendan D. Tracey David Wolpert 43 154 0 06 May 2017
Opening the Black Box of Deep Neural Networks via Information Ravid Shwartz-Ziv Naftali Tishby AI4CE 68 1,399 0 02 Mar 2017
An exact mapping between the Variational Renormalization Group and Deep Learning Pankaj Mehta D. Schwab AI4CE 44 309 0 14 Oct 2014
Representation Learning: A Review and New Perspectives Yoshua Bengio Aaron Courville Pascal Vincent OOD SSL 150 12,384 0 24 Jun 2012