To Compress or Not to Compress- Self-Supervised Learning and Information Theory: A Review

19 April 2023

Papers citing "To Compress or Not to Compress- Self-Supervised Learning and Information Theory: A Review"

20 / 20 papers shown

Title
Modality Interactive Mixture-of-Experts for Fake News Detection Yifan Liu Y. Liu Zehan Li Ruichen Yao Yang Zhang Dong Wang MoE 33 0 0 21 Jan 2025
"Efficient Complexity": a Constrained Optimization Approach to the Evolution of Natural Intelligence Serge Dolgikh 41 0 0 31 Dec 2024
An Information Criterion for Controlled Disentanglement of Multimodal Data Chenyu Wang Sharut Gupta Xinyi Zhang Sana Tonekaboni Stefanie Jegelka Tommi Jaakkola Caroline Uhler DRL 42 1 0 31 Oct 2024
Training Foundation Models as Data Compression: On Information, Model Weights and Copyright Law Giorgio Franceschelli Claudia Cevenini Mirco Musolesi 44 0 0 18 Jul 2024
Nonlinear time-series embedding by monotone variational inequality Jonathan Y. Zhou Yao Xie AI4TS 36 0 0 11 Jun 2024
High-Dimension Human Value Representation in Large Language Models Samuel Cahyawijaya Delong Chen Yejin Bang Leila Khalatbari Bryan Wilie Ziwei Ji Etsuko Ishii Pascale Fung 68 5 0 11 Apr 2024
Active Few-Shot Fine-Tuning Jonas Hübotter Bhavya Sukhija Lenart Treven Yarden As Andreas Krause 42 1 0 13 Feb 2024
A self-supervised framework for learning whole slide representations X. Hou Cheng Jiang A. Kondepudi Yiwei Lyu Asadur Chowdury Honglak Lee Todd C. Hollon MedIm 33 5 0 09 Feb 2024
TURBO: The Swiss Knife of Auto-Encoders Guillaume Quétant Yury Belousov Vitaliy Kinakh Slava Voloshynovskiy 26 6 0 11 Nov 2023
Understanding the limitations of self-supervised learning for tabular anomaly detection Kimberly T. Mai Toby O. Davies Lewis D. Griffin SSL 29 0 0 15 Sep 2023
Large Language Models at Work in China's Labor Market Qin Chen Jinfeng Ge Huaqing Xie Xingcheng Xu Yanqing Yang 44 1 0 17 Aug 2023
Reverse Engineering Self-Supervised Learning Ido Ben-Shaul Ravid Shwartz-Ziv Tomer Galanti S. Dekel Yann LeCun SSL 23 34 0 24 May 2023
Conditional Graph Information Bottleneck for Molecular Relational Learning Namkyeong Lee Dongmin Hyun Gyoung S. Na Sungwon Kim Junseok Lee Chanyoung Park 30 23 0 29 Apr 2023
Unsupervised Manifold Linearizing and Clustering Tianjiao Ding Shengbang Tong Kwan Ho Ryan Chan Xili Dai Y. Ma B. Haeffele 25 11 0 04 Jan 2023
Pre-Train Your Loss: Easy Bayesian Transfer Learning with Informative Priors Ravid Shwartz-Ziv Micah Goldblum Hossein Souri Sanyam Kapoor Chen Zhu Yann LeCun A. Wilson UQCV BDL 61 43 0 20 May 2022
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 305 7,443 0 11 Nov 2021
Compressive Visual Representations Kuang-Huei Lee Anurag Arnab S. Guadarrama John F. Canny Ian S. Fischer SSL 65 48 0 27 Sep 2021
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 317 5,785 0 29 Apr 2021
Contrastive Learning Inverts the Data Generating Process Roland S. Zimmermann Yash Sharma Steffen Schneider Matthias Bethge Wieland Brendel SSL 238 207 0 17 Feb 2021
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 267 3,371 0 09 Mar 2020