Self-Supervised Learning of Pretext-Invariant Representations

4 December 2019

Ishan Misra

Laurens van der Maaten

SSL

VLM

ArXiv PDF HTML

Papers citing "Self-Supervised Learning of Pretext-Invariant Representations"

50 / 84 papers shown

Title
seq-JEPA: Autoregressive Predictive Learning of Invariant-Equivariant World Models Hafez Ghaemi Eilif Muller Shahab Bakhtiari 126 0 0 06 May 2025
AFiRe: Anatomy-Driven Self-Supervised Learning for Fine-Grained Representation in Radiographic Images Yihang Liu Lianghua He Y. Wen Longzhen Yang Hongzhou Chen MedIm 106 0 0 15 Apr 2025
Implicit Contrastive Representation Learning with Guided Stop-gradient Byeongchan Lee Sehyun Lee SSL 232 2 0 12 Mar 2025
CL-MVSNet: Unsupervised Multi-view Stereo with Dual-level Contrastive Learning K. Xiong Rui Peng Zhe Zhang Tianxing Feng Jianbo Jiao Feng Gao Ronggang Wang 111 13 0 11 Mar 2025
Learning Nash Equilibrial Hamiltonian for Two-Player Collision-Avoiding Interactions Lei Zhang Siddharth Das Tanner Merry Wenlong Zhang Yi Ren 80 0 0 10 Mar 2025
VRM: Knowledge Distillation via Virtual Relation Matching W. Zhang Fei Xie Weidong Cai Chao Ma 136 0 0 28 Feb 2025
Efficient Hierarchical Contrastive Self-supervising Learning for Time Series Classification via Importance-aware Resolution Selection Kevin Garcia Juan Manuel Perez Yifeng Gao AI4TS 98 0 0 14 Feb 2025
Self-supervised Benchmark Lottery on ImageNet: Do Marginal Improvements Translate to Improvements on Similar Datasets? Utku Ozbulak Esla Timothy Anzaku Solha Kang W. D. Neve J. Vankerschaver 98 0 0 28 Jan 2025
How Well Do Self-Supervised Methods Perform in Cross-Domain Few-Shot Learning? Yiyi Zhang Ying Zheng Xiaogang Xu Jun Wang SSL 84 4 0 28 Jan 2025
Enhancing Contrastive Learning Inspired by the Philosophy of "The Blind Men and the Elephant" Yudong Zhang Ruobing Xie Jiansheng Chen Xingwu Sun Zhanhui Kang Yu Wang 153 0 0 21 Dec 2024
Quantum Rationale-Aware Graph Contrastive Learning for Jet Discrimination Md Abrar Jahin Md. Akmol Masud M. F. Mridha Nilanjan Dey Zeyar Aung 131 0 0 03 Nov 2024
Self-supervised Learning for Acoustic Few-Shot Classification Jingyong Liang Bernd Meyer Isaac Ning Lee Thanh-Toan Do SSL 85 0 0 15 Sep 2024
DeNVeR: Deformable Neural Vessel Representations for Unsupervised Video Vessel Segmentation Chun-Hung Wu Shih-Hong Chen Chih-Yao Hu Hsin-Yu Wu Kai-Hsin Chen Yu-You Chen Chih-Hai Su Chih-Kuo Lee Yu-Lun Liu 95 2 0 03 Jun 2024
Modeling Caption Diversity in Contrastive Vision-Language Pretraining Samuel Lavoie Polina Kirichenko Mark Ibrahim Mahmoud Assran Andrew Gordon Wilson Aaron Courville Nicolas Ballas CLIP VLM 92 23 0 30 Apr 2024
Spatial Context-based Self-Supervised Learning for Handwritten Text Recognition Carlos Peñarrubia Carlos Garrido-Munoz J. J. Valero-Mas Jorge Calvo-Zaragoza 162 1 0 17 Apr 2024
LeOCLR: Leveraging Original Images for Contrastive Learning of Visual Representations Mohammad Alkhalefi Georgios Leontidis Mingjun Zhong 192 3 0 11 Mar 2024
URLOST: Unsupervised Representation Learning without Stationarity or Topology Zeyu Yun Juexiao Zhang Bruno A. Olshausen Yann LeCun 162 1 0 06 Oct 2023
ScaleNet: An Unsupervised Representation Learning Method for Limited Information Huili Huang M. M. Roozbahani SSL 91 805 0 03 Oct 2023
Asynchronous Graph Generator Christopher P. Ley Felipe Tobar AI4TS 86 0 0 29 Sep 2023
Semantic Positive Pairs for Enhancing Visual Representation Learning of Instance Discrimination Methods Mohammad Alkhalefi Georgios Leontidis Min Zhong SSL 149 2 0 28 Jun 2023
Self-Supervised Siamese Autoencoders Friederike Baier Sebastian Mair Samuel G. Fadel SSL 73 4 0 05 Apr 2023
Anomaly Detection-Inspired Few-Shot Medical Image Segmentation Through Self-Supervision With Supervoxels Stine Hansen Srishti Gautam Robert Jenssen Michael C. Kampffmeyer 98 86 0 03 Mar 2022
Multi-Mask Self-Supervised Learning for Physics-Guided Neural Networks in Highly Accelerated MRI Burhaneddin Yaman Hongyi Gu S. A. Hosseini Omer Burak Demirel S. Moeller J. Ellermann K. Uğurbil Mehmet Akçakaya OOD 75 38 0 13 Aug 2020
Unsupervised Learning of Visual Features by Contrasting Cluster Assignments Mathilde Caron Ishan Misra Julien Mairal Priya Goyal Piotr Bojanowski Armand Joulin OCL SSL 215 4,073 0 17 Jun 2020
CoMIR: Contrastive Multimodal Image Representation for Registration Nicolas Pielawski Elisabeth Wetzer Johan Öfverstedt Jiahao Lu Carolina Wählby Joakim Lindblad Natavsa Sladoje 69 81 0 11 Jun 2020
Momentum Contrast for Unsupervised Visual Representation Learning Kaiming He Haoqi Fan Yuxin Wu Saining Xie Ross B. Girshick SSL 181 12,073 0 13 Nov 2019
Video Representation Learning by Dense Predictive Coding Tengda Han Weidi Xie Andrew Zisserman SSL 88 361 0 10 Sep 2019
Large Scale Adversarial Representation Learning Jeff Donahue Karen Simonyan SSL 124 543 0 04 Jul 2019
Contrastive Multiview Coding Yonglong Tian Dilip Krishnan Phillip Isola SSL 155 2,398 0 13 Jun 2019
Learning Video Representations using Contrastive Bidirectional Transformer Chen Sun Fabien Baradel Kevin Patrick Murphy Cordelia Schmid SSL ViT 109 134 0 13 Jun 2019
Learning Representations by Maximizing Mutual Information Across Views Philip Bachman R. Devon Hjelm William Buchwalter SSL 189 1,472 0 03 Jun 2019
Data-Efficient Image Recognition with Contrastive Predictive Coding Olivier J. Hénaff A. Srinivas J. Fauw Ali Razavi Carl Doersch S. M. Ali Eslami Aaron van den Oord SSL 111 1,428 0 22 May 2019
S4L: Self-Supervised Semi-Supervised Learning Xiaohua Zhai Avital Oliver Alexander Kolesnikov Lucas Beyer SSL VLM 103 792 0 09 May 2019
Scaling and Benchmarking Self-Supervised Visual Representation Learning Priya Goyal D. Mahajan Abhinav Gupta Ishan Misra SSL 54 397 0 03 May 2019
Fast AutoAugment Sungbin Lim Ildoo Kim Taesup Kim Chiheon Kim Sungwoong Kim 94 595 0 01 May 2019
Temporal Cycle-Consistency Learning Debidatta Dwibedi Y. Aytar Jonathan Tompson P. Sermanet Andrew Zisserman SSL AI4TS 81 275 0 16 Apr 2019
Unsupervised Embedding Learning via Invariant and Spreading Instance Feature Mang Ye Xu-Yao Zhang PongChi Yuen Shih-Fu Chang SSL 78 581 0 06 Apr 2019
Local Aggregation for Unsupervised Learning of Visual Embeddings Chengxu Zhuang Alex Zhai Daniel L. K. Yamins SSL 89 447 0 29 Mar 2019
Domain Generalization by Solving Jigsaw Puzzles Fabio Maria Carlucci A. DÍnnocente S. Bucci Barbara Caputo Tatiana Tommasi SSL 64 815 0 16 Mar 2019
Revisiting Self-Supervised Visual Representation Learning Alexander Kolesnikov Xiaohua Zhai Lucas Beyer SSL 132 716 0 25 Jan 2019
AET vs. AED: Unsupervised Representation Learning by Auto-Encoding Transformations rather than Data Liheng Zhang Guo-Jun Qi Liqiang Wang Jiebo Luo 35 203 0 14 Jan 2019
Self-Supervised Video Representation Learning with Space-Time Cubic Puzzles Dahun Kim Donghyeon Cho In So Kweon SSL 65 348 0 24 Nov 2018
Video Jigsaw: Unsupervised Learning of Spatiotemporal Context for Video Action Recognition Unaiza Ahsan Rishi Madhok Irfan Essa SSL 56 109 0 22 Aug 2018
Learning deep representations by mutual information estimation and maximization R. Devon Hjelm A. Fedorov Samuel Lavoie-Marchildon Karan Grewal Phil Bachman Adam Trischler Yoshua Bengio SSL DRL 310 2,662 0 20 Aug 2018
Invariant Information Clustering for Unsupervised Image Classification and Segmentation Xu Ji João F. Henriques Andrea Vedaldi SSL VLM 82 850 0 17 Jul 2018
Representation Learning with Contrastive Predictive Coding Aaron van den Oord Yazhe Li Oriol Vinyals DRL SSL 302 10,282 0 10 Jul 2018
Cooperative Learning of Audio and Video Models from Self-Supervised Synchronization Bruno Korbar Du Tran Lorenzo Torresani 95 475 0 30 Jun 2018
Unsupervised Feature Learning via Non-Parametric Instance-level Discrimination Zhirong Wu Yuanjun Xiong Stella X. Yu Dahua Lin SSL 170 3,452 0 05 May 2018
Exploring the Limits of Weakly Supervised Pretraining D. Mahajan Ross B. Girshick Vignesh Ramanathan Kaiming He Manohar Paluri Yixuan Li Ashwin R. Bharambe Laurens van der Maaten VLM 178 1,367 0 02 May 2018
Boosting Self-Supervised Learning via Knowledge Transfer M. Noroozi Ananth Vinjimoor Paolo Favaro Hamed Pirsiavash SSL 274 296 0 01 May 2018