Demystifying Contrastive Self-Supervised Learning: Invariances, Augmentations and Dataset Biases

28 July 2020

Papers citing "Demystifying Contrastive Self-Supervised Learning: Invariances, Augmentations and Dataset Biases"

50 / 146 papers shown

Title
Faint Features Tell: Automatic Vertebrae Fracture Screening Assisted by Contrastive Learning Xin Wei Huaiwei Cong Zheng Zhang Junran Peng Guoping Chen Jinpeng Li 24 7 0 23 Aug 2022
Looking For A Match: Self-supervised Clustering For Automatic Doubt Matching In e-learning Platforms V. Joshi S. Tatinati Yubo Wang 24 1 0 20 Aug 2022
Matching Multiple Perspectives for Efficient Representation Learning Omiros Pantazis M. Salvaris SSL 28 0 0 16 Aug 2022
Analyzing Data-Centric Properties for Graph Contrastive Learning Puja Trivedi Ekdeep Singh Lubana Mark Heimann Danai Koutra Jayaraman J. Thiagarajan 28 11 0 04 Aug 2022
On the robustness of self-supervised representations for multi-view object classification David Torpey Richard Klein SSL 11 1 0 27 Jul 2022
Contrastive Self-Supervised Learning Leads to Higher Adversarial Susceptibility Rohit Gupta Naveed Akhtar Ajmal Saeed Mian M. Shah AAML SSL 21 5 0 22 Jul 2022
HyperInvariances: Amortizing Invariance Learning Ruchika Chavhan H. Gouk Jan Stuhmer Timothy M. Hospedales 13 0 0 17 Jul 2022
Pixel-level Correspondence for Self-Supervised Learning from Video Yash Sharma Yi Zhu Chris Russell Thomas Brox SSL 13 4 0 08 Jul 2022
Beyond Supervised vs. Unsupervised: Representative Benchmarking and Analysis of Image Representation Learning M. Gwilliam Abhinav Shrivastava SSL 76 19 1 16 Jun 2022
SERE: Exploring Feature Self-relation for Self-supervised Transformer Zhong-Yu Li Shanghua Gao Ming-Ming Cheng ViT MDE 26 14 0 10 Jun 2022
An Empirical Study on Disentanglement of Negative-free Contrastive Learning Jinkun Cao Ruiqian Nai Qing Yang Jialei Huang Yang Gao CoGe DRL 19 9 0 09 Jun 2022
Extreme Masking for Learning Instance and Distributed Visual Representations Zhirong Wu Zihang Lai Xiao Sun Stephen Lin 32 22 0 09 Jun 2022
Integrating Prior Knowledge in Contrastive Learning with Kernel Benoit Dufumier C. Barbano Robin Louiset Edouard Duchesnay Pietro Gori SSL 19 8 0 03 Jun 2022
Orchestra: Unsupervised Federated Learning via Globally Consistent Clustering Ekdeep Singh Lubana Chi Ian Tang F. Kawsar Robert P. Dick Akhil Mathur FedML 29 52 0 23 May 2022
3D Object Detection with a Self-supervised Lidar Scene Flow Backbone Ekim Yurtsever Emecc Erccelik Ming-Yu Liu Zhijie Yang Hanzhen Zhang Pinar Topccam Maximilian Listl Yilmaz Kaan cCayli Alois C. Knoll 3DPC 6 25 0 02 May 2022
On Negative Sampling for Audio-Visual Contrastive Learning from Movies Mahdi M. Kalayeh Shervin Ardeshir Lingyi Liu Nagendra Kamath Ashok Chandrashekar SSL 22 3 0 29 Apr 2022
Self-Supervised Learning of Object Parts for Semantic Segmentation A. Ziegler Yuki M. Asano SSL OCL 26 101 0 27 Apr 2022
SOS! Self-supervised Learning Over Sets Of Handled Objects In Egocentric Action Recognition Victor Escorcia Ricardo Guerrero Xiatian Zhu Brais Martínez EgoV 28 9 0 10 Apr 2022
CYBORGS: Contrastively Bootstrapping Object Representations by Grounding in Segmentation Renhao Wang Hang Zhao Yang Gao SSL 21 1 0 17 Mar 2022
S5CL: Unifying Fully-Supervised, Self-Supervised, and Semi-Supervised Learning Through Hierarchical Contrastive Learning Manuel Tran S. J. Wagner Melanie Boxberg T. Peng SSL 14 12 0 14 Mar 2022
UniVIP: A Unified Framework for Self-Supervised Visual Pre-training Zhaowen Li Yousong Zhu Fan Yang Wei Li Chaoyang Zhao ... Jiahao Xie Liwei Wu Rui Zhao Ming Tang Jinqiao Wang 17 36 0 14 Mar 2022
The Unsurprising Effectiveness of Pre-Trained Vision Models for Control Simone Parisi Aravind Rajeswaran Senthil Purushwalkam Abhinav Gupta LM&Ro 28 186 0 07 Mar 2022
Kubric: A scalable dataset generator Klaus Greff Francois Belletti Lucas Beyer Carl Doersch Yilun Du ... Ziyu Wang Tianhao Wu K. M. Yi Fangcheng Zhong Andrea Tagliasacchi 43 250 0 07 Mar 2022
Fuse Local and Global Semantics in Representation Learning Yuchi Zhao Yuhao Zhou FedML 9 1 0 28 Feb 2022
What Makes Good Contrastive Learning on Small-Scale Wearable-based Tasks? Hangwei Qian Tian Tian C. Miao SSL 22 50 0 12 Feb 2022
Crafting Better Contrastive Views for Siamese Representation Learning Xiang Peng Kai Wang Zheng Hua Zhu Mang Wang Yang You SSL 28 102 0 07 Feb 2022
Generalizing similarity in noisy setups: the DIBS phenomenon Nayara Fonseca V. Guidetti 13 0 0 30 Jan 2022
Video Transformers: A Survey Javier Selva A. S. Johansen Sergio Escalera Kamal Nasrollahi T. Moeslund Albert Clapés ViT 22 103 0 16 Jan 2022
SimReg: Regression as a Simple Yet Effective Tool for Self-supervised Knowledge Distillation K. Navaneet Soroush Abbasi Koohpayegani Ajinkya Tejankar Hamed Pirsiavash 13 19 0 13 Jan 2022
Barely-Supervised Learning: Semi-Supervised Learning with very few labeled images Thomas Lucas Philippe Weinzaepfel Grégory Rogez SSL 22 30 0 22 Dec 2021
Are Large-scale Datasets Necessary for Self-Supervised Pre-training? Alaaeldin El-Nouby Gautier Izacard Hugo Touvron Ivan Laptev Hervé Jégou Edouard Grave SSL 27 148 0 20 Dec 2021
Masked Feature Prediction for Self-Supervised Visual Pre-Training Chen Wei Haoqi Fan Saining Xie Chaoxia Wu Alan Yuille Christoph Feichtenhofer ViT 77 655 0 16 Dec 2021
Learning Representations with Contrastive Self-Supervised Learning for Histopathology Applications Karin Stacke Jonas Unger Claes Lundström Gabriel Eilertsen OOD SSL 21 25 0 10 Dec 2021
Tradeoffs Between Contrastive and Supervised Learning: An Empirical Study A. Karthik Mike Wu Noah D. Goodman Alex Tamkin SSL 32 5 0 10 Dec 2021
PreViTS: Contrastive Pretraining with Video Tracking Supervision Brian Chen Ramprasaath R. Selvaraju Shih-Fu Chang Juan Carlos Niebles Nikhil Naik ViT 25 2 0 01 Dec 2021
Object-Aware Cropping for Self-Supervised Learning Shlok Kumar Mishra Anshul B. Shah Ankan Bansal Abhyuday N. Jagannatha Janit Anjaria Abhishek Sharma David Jacobs Dilip Krishnan SSL 18 22 0 01 Dec 2021
Why Do Self-Supervised Models Transfer? Investigating the Impact of Invariance on Downstream Tasks Linus Ericsson H. Gouk Timothy M. Hospedales SSL 13 15 0 22 Nov 2021
Augmentations in Graph Contrastive Learning: Current Methodological Flaws & Towards Better Practices Puja Trivedi Ekdeep Singh Lubana Yujun Yan Yaoqing Yang Danai Koutra 37 52 0 05 Nov 2021
When Does Contrastive Learning Preserve Adversarial Robustness from Pretraining to Finetuning? Lijie Fan Sijia Liu Pin-Yu Chen Gaoyuan Zhang Chuang Gan AAML VLM 8 118 0 01 Nov 2021
Self-Supervised Representation Learning: Introduction, Advances and Challenges Linus Ericsson H. Gouk Chen Change Loy Timothy M. Hospedales SSL OOD AI4TS 29 270 0 18 Oct 2021
The Impact of Spatiotemporal Augmentations on Self-Supervised Audiovisual Representation Learning Haider Al-Tahan Y. Mohsenzadeh SSL AI4TS 27 0 0 13 Oct 2021
Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scans Ainaz Eftekhar Alexander Sax Roman Bachmann Jitendra Malik Amir Zamir MedIm 33 288 0 11 Oct 2021
Cluster Analysis with Deep Embeddings and Contrastive Learning Ramakrishnan Sundareswaran Jansel Herrera-Gerena John Just Ali Janessari SSL DRL 25 4 0 26 Sep 2021
Long Short View Feature Decomposition via Contrastive Video Representation Learning Nadine Behrmann Mohsen Fayyaz Juergen Gall M. Noroozi 13 36 0 23 Sep 2021
Multi-Task Self-Training for Learning General Representations Golnaz Ghiasi Barret Zoph E. D. Cubuk Quoc V. Le Tsung-Yi Lin SSL 24 100 0 25 Aug 2021
Learning From Long-Tailed Data With Noisy Labels Shyamgopal Karthik Jérôme Revaud Boris Chidlovskii SSL NoLa 11 27 0 25 Aug 2021
Self-Supervised Visual Representations Learning by Contrastive Mask Prediction Yucheng Zhao Guangting Wang Chong Luo Wenjun Zeng Zhengjun Zha ISeg SSL 19 46 0 18 Aug 2021
Improving Self-supervised Learning with Hardness-aware Dynamic Curriculum Learning: An Application to Digital Pathology C. Srinidhi Anne L. Martel 34 22 0 16 Aug 2021
Focus on the Positives: Self-Supervised Learning for Biodiversity Monitoring Omiros Pantazis Gabriel J. Brostow Kate E. Jones Oisin Mac Aodha SSL 23 30 0 14 Aug 2021
Object-aware Contrastive Learning for Debiased Scene Representation Sangwoo Mo H. Kang Kihyuk Sohn Chun-Liang Li Jinwoo Shin SSL OCL 16 48 0 30 Jul 2021