The Trade-off between Universality and Label Efficiency of
Representations from Contrastive Learning

The Trade-off between Universality and Label Efficiency of Representations from Contrastive Learning

28 February 2023

Jayaram Raghuram

Papers citing "The Trade-off between Universality and Label Efficiency of Representations from Contrastive Learning"

11 / 11 papers shown

Title
Fast RoPE Attention: Combining the Polynomial Method and Fast Fourier Transform Josh Alman Zhao Song 20 0 0 17 May 2025
Tensor Product Attention Is All You Need Yifan Zhang Yifeng Liu Huizhuo Yuan Zhen Qin Yang Yuan Q. Gu Andrew Chi-Chih Yao 96 9 0 11 Jan 2025
Bypassing the Exponential Dependency: Looped Transformers Efficiently Learn In-context by Multi-step Gradient Descent Bo Chen Xiaoyu Li Yingyu Liang Zhenmei Shi Zhao Song 98 20 0 15 Oct 2024
PhilEO Bench: Evaluating Geo-Spatial Foundation Models Casper Fibaek Luke Camilleri Andreas Luyts Nikolaos Dionelis B. L. Saux 44 16 0 09 Jan 2024
Domain Generalization via Nuclear Norm Regularization Zhenmei Shi Yifei Ming Ying Fan Frederic Sala Yingyu Liang 30 12 0 13 Mar 2023
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 322 7,457 0 11 Nov 2021
With a Little Help from My Friends: Nearest-Neighbor Contrastive Learning of Visual Representations Debidatta Dwibedi Y. Aytar Jonathan Tompson P. Sermanet Andrew Zisserman SSL 191 457 0 29 Apr 2021
ImageNet-21K Pretraining for the Masses T. Ridnik Emanuel Ben-Baruch Asaf Noy Lihi Zelnik-Manor SSeg VLM CLIP 187 689 0 22 Apr 2021
SelfReg: Self-supervised Contrastive Regularization for Domain Generalization Daehee Kim Seunghyun Park Jinkyu Kim Jaekoo Lee OOD SSL 77 265 0 20 Apr 2021
Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Concepts Soravit Changpinyo P. Sharma Nan Ding Radu Soricut VLM 299 1,084 0 17 Feb 2021
Contrastive Learning Inverts the Data Generating Process Roland S. Zimmermann Yash Sharma Steffen Schneider Matthias Bethge Wieland Brendel SSL 238 208 0 17 Feb 2021