Reverse Engineering Self-Supervised Learning

24 May 2023

Papers citing "Reverse Engineering Self-Supervised Learning"

28 / 28 papers shown

Title
Register and CLS tokens yield a decoupling of local and global features in large ViTs Alexander Lappe M. Giese 24 0 0 09 May 2025
BottleHumor: Self-Informed Humor Explanation using the Information Bottleneck Principle EunJeong Hwang Peter West Vered Shwartz 39 1 0 22 Feb 2025
Does Representation Matter? Exploring Intermediate Layers in Large Language Models Oscar Skean Md Rifat Arefin Yann LeCun Ravid Shwartz-Ziv 81 7 0 12 Dec 2024
Deep Sparse Latent Feature Models for Knowledge Graph Completion Haotian Li Rui Zhang Lingzhi Wang Bin Yu Y. Wang Yuliang Wei Kai Wang Richard Y. D. Xu Bailing Wang BDL 74 0 0 24 Nov 2024
HEX: Hierarchical Emergence Exploitation in Self-Supervised Algorithms Kiran Kokilepersaud Seulgi Kim Mohit Prabhushankar Ghassan AlRegib 33 1 0 30 Oct 2024
Learning to Compress: Local Rank and Information Compression in Deep Neural Networks Niket Patel Ravid Shwartz-Ziv SSL 29 1 0 10 Oct 2024
Frequency-Guided Masking for Enhanced Vision Self-Supervised Learning Amin Karimi Monsefi Mengxi Zhou Nastaran Karimi Monsefi Ser-Nam Lim Wei-Lun Chao R. Ramnath 46 1 0 16 Sep 2024
DetailCLIP: Detail-Oriented CLIP for Fine-Grained Tasks Amin Karimi Monsefi Kishore Prakash Sailaja Ali Alilooee Ser-Nam Lim R. Ramnath VLM 37 6 0 10 Sep 2024
Words in Motion: Extracting Interpretable Control Vectors for Motion Transformers Omer Sahin Tas Royden Wagner 56 1 0 17 Jun 2024
The Entropy Enigma: Success and Failure of Entropy Minimization Ori Press Ravid Shwartz-Ziv Yann LeCun Matthias Bethge UQCV 52 12 0 08 May 2024
Object Instance Retrieval in Assistive Robotics: Leveraging Fine-Tuned SimSiam with Multi-View Images Based on 3D Semantic Map Taichi Sakaguchi Akira Taniguchi Y. Hagiwara Lotfi El Hafi Shoichi Hasegawa T. Taniguchi 33 3 0 15 Apr 2024
Real-world Instance-specific Image Goal Navigation for Service Robots: Bridging the Domain Gap with Contrastive Learning Taichi Sakaguchi Akira Taniguchi Y. Hagiwara Lotfi El Hafi Shoichi Hasegawa T. Taniguchi 38 0 0 15 Apr 2024
SP $^2$ OT: Semantic-Regularized Progressive Partial Optimal Transport for Imbalanced Clustering Chuyu Zhang Hui Ren Xuming He OT 37 0 0 04 Apr 2024
EEG2Rep: Enhancing Self-supervised EEG Representation Through Informative Masked Inputs Navid Mohammadi Foumani G. Mackellar Soheila Ghane Saad Irtza Nam Nguyen Mahsa Salehi 20 14 0 17 Feb 2024
A Probabilistic Model behind Self-Supervised Learning Alice Bizeul Bernhard Schölkopf Carl Allen SSL 26 2 0 02 Feb 2024
P $^2$ OT: Progressive Partial Optimal Transport for Deep Imbalanced Clustering Chuyu Zhang Hui Ren Xuming He 34 6 0 17 Jan 2024
Splicing Up Your Predictions with RNA Contrastive Learning Phil Fradkin Ruian Shi Bo Wang Brendan Frey Leo J. Lee SSL 29 0 0 12 Oct 2023
A simple connection from loss flatness to compressed neural representations Shirui Chen Stefano Recanatesi E. Shea-Brown 15 0 0 03 Oct 2023
KERMIT: Knowledge Graph Completion of Enhanced Relation Modeling with Inverse Transformation Haotian Li Lingzhi Wang Yuliang Wei Richard Y. D. Xu Bailing Wang Bailing Wang 53 2 0 26 Sep 2023
Sudden Drops in the Loss: Syntax Acquisition, Phase Transitions, and Simplicity Bias in MLMs Angelica Chen Ravid Schwartz-Ziv Kyunghyun Cho Matthew L. Leavitt Naomi Saphra 29 62 0 13 Sep 2023
Variance-Covariance Regularization Improves Representation Learning Jiachen Zhu Katrina Evtimova Yubei Chen Ravid Shwartz-Ziv Yann LeCun SSL 22 7 0 23 Jun 2023
What Do Self-Supervised Vision Transformers Learn? Namuk Park Wonjae Kim Byeongho Heo Taekyung Kim Sangdoo Yun SSL 69 76 1 01 May 2023
To Compress or Not to Compress- Self-Supervised Learning and Information Theory: A Review Ravid Shwartz-Ziv Yann LeCun SSL 35 71 0 19 Apr 2023
An Information-Theoretic Perspective on Variance-Invariance-Covariance Regularization Ravid Shwartz-Ziv Randall Balestriero Kenji Kawaguchi Tim G. J. Rudner Yann LeCun 38 23 0 01 Mar 2023
Improving Self-Supervised Learning by Characterizing Idealized Representations Yann Dubois Tatsunori Hashimoto Stefano Ermon Percy Liang SSL 83 40 0 13 Sep 2022
Pre-Train Your Loss: Easy Bayesian Transfer Learning with Informative Priors Ravid Shwartz-Ziv Micah Goldblum Hossein Souri Sanyam Kapoor Chen Zhu Yann LeCun A. Wilson UQCV BDL 61 43 0 20 May 2022
Nearest Class-Center Simplification through Intermediate Layers Ido Ben-Shaul S. Dekel 40 26 0 21 Jan 2022
Convolutional Neural Networks Analyzed via Convolutional Sparse Coding Vardan Papyan Yaniv Romano Michael Elad 59 284 0 27 Jul 2016