Dynamically Scaled Temperature in Self-Supervised Contrastive Learning

2 August 2023

Siladittya Manna

Soumitri Chattopadhyay

Papers citing "Dynamically Scaled Temperature in Self-Supervised Contrastive Learning"

47 / 47 papers shown

Title
Interpreting and Correcting Medical Image Classification with PIP-Net Meike Nauta J. H. Hegeman J. Geerdink Jorg Schlotterer M. V. Keulen Christin Seifert MedIm 38 11 0 19 Jul 2023
Not All Semantics are Created Equal: Contrastive Self-supervised Learning with Automatic Temperature Individualization Zimeng Qiu Quanqi Hu Zhuoning Yuan Denny Zhou Lijun Zhang Tianbao Yang 49 19 0 19 May 2023
Temperature Schedules for Self-Supervised Contrastive Methods on Long-Tail Data Anna Kukleva Moritz Bohle Bernt Schiele Hilde Kuehne Christian Rupprecht 61 42 0 23 Mar 2023
Multi-Head Multi-Loss Model Calibration Adrian Galdran Johan Verjans G. Carneiro M. A. G. Ballester UQCV 32 7 0 02 Mar 2023
Model-Aware Contrastive Learning: Towards Escaping the Dilemmas Zizheng Huang Haoxing Chen Ziqi Wen Chao Zhang Huaxiong Li Bojuan Wang Chunlin Chen 41 8 0 16 Jul 2022
From Modern CNNs to Vision Transformers: Assessing the Performance, Robustness, and Classification Strategies of Deep Learning Models in Histopathology Maximilian Springenberg A. Frommholz M. Wenzel Eva Weicken Jackie Ma Nils Strodthoff MedIm 51 44 0 11 Apr 2022
Generative Adversarial Networks Gilad Cohen Raja Giryes GAN 87 30,021 0 01 Mar 2022
Hard Sample Aware Noise Robust Learning for Histopathology Image Classification Chuang Zhu Wenkai Chen T. Peng Ying Wang M. Jin NoLa 41 73 0 05 Dec 2021
MIO : Mutual Information Optimization using Self-Supervised Binary Contrastive Learning Siladittya Manna Umapada Pal Saumik Bhattacharya SSL 54 1 0 24 Nov 2021
iBOT: Image BERT Pre-Training with Online Tokenizer Jinghao Zhou Chen Wei Huiyu Wang Wei Shen Cihang Xie Alan Yuille Tao Kong 48 722 0 15 Nov 2021
Decoupled Contrastive Learning Chun-Hsiao Yeh Cheng-Yao Hong Yen-Chi Hsu Tyng-Luh Liu Yubei Chen Yann LeCun 205 184 0 13 Oct 2021
Temperature as Uncertainty in Contrastive Learning Oliver Zhang Mike Wu Jasmine Bayrooti Noah D. Goodman UQCV 52 32 0 08 Oct 2021
VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning Adrien Bardes Jean Ponce Yann LeCun SSL DML 90 917 0 11 May 2021
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 521 5,920 0 29 Apr 2021
SimCSE: Simple Contrastive Learning of Sentence Embeddings Tianyu Gao Xingcheng Yao Danqi Chen AILaw SSL 127 3,336 0 18 Apr 2021
Barlow Twins: Self-Supervised Learning via Redundancy Reduction Jure Zbontar Li Jing Ishan Misra Yann LeCun Stéphane Deny SSL 179 2,321 0 04 Mar 2021
A Petri Dish for Histopathology Image Analysis Jerry W. Wei A. Suriawinata Bing Ren Xiaoying Liu Mikhail Lisovsky ... Michael Baker Naofumi Tomita Lorenzo Torresani Jason W. Wei Saeed Hassanpour 78 72 0 29 Jan 2021
Understanding the Behaviour of Contrastive Loss Feng Wang Huaping Liu SSL 65 679 0 15 Dec 2020
Exploring Simple Siamese Representation Learning Xinlei Chen Kaiming He SSL 151 3,992 0 20 Nov 2020
Intriguing Properties of Contrastive Losses Ting Chen Calvin Luo Lala Li 38 174 0 05 Nov 2020
Whitening for Self-Supervised Representation Learning Aleksandr Ermolov Aliaksandr Siarohin E. Sangineto N. Sebe SSL 49 310 0 13 Jul 2020
Unsupervised Learning of Visual Features by Contrasting Cluster Assignments Mathilde Caron Ishan Misra Julien Mairal Priya Goyal Piotr Bojanowski Armand Joulin OCL SSL 89 4,032 0 17 Jun 2020
Bootstrap your own latent: A new approach to self-supervised Learning Jean-Bastien Grill Florian Strub Florent Altché Corentin Tallec Pierre Harvey Richemond ... M. G. Azar Bilal Piot Koray Kavukcuoglu Rémi Munos Michal Valko SSL 233 6,718 0 13 Jun 2020
Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hypersphere Tongzhou Wang Phillip Isola SSL 74 1,808 0 20 May 2020
Supervised Contrastive Learning Prannay Khosla Piotr Teterwak Chen Wang Aaron Sarna Yonglong Tian Phillip Isola Aaron Maschinot Ce Liu Dilip Krishnan SSL 102 4,476 0 23 Apr 2020
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 405 3,397 0 09 Mar 2020
Decision-Making with Auto-Encoding Variational Bayes Romain Lopez Pierre Boyeau Nir Yosef Michael I. Jordan Jeffrey Regier BDL 119 10,591 0 17 Feb 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 144 18,523 0 13 Feb 2020
Self-Supervised Learning of Pretext-Invariant Representations Ishan Misra Laurens van der Maaten SSL VLM 56 1,448 0 04 Dec 2019
Momentum Contrast for Unsupervised Visual Representation Learning Kaiming He Haoqi Fan Yuxin Wu Saining Xie Ross B. Girshick SSL 79 11,959 0 13 Nov 2019
Contrastive Multiview Coding Yonglong Tian Dilip Krishnan Phillip Isola SSL 116 2,385 0 13 Jun 2019
Data-Efficient Image Recognition with Contrastive Predictive Coding Olivier J. Hénaff A. Srinivas J. Fauw Ali Razavi Carl Doersch S. M. Ali Eslami Aaron van den Oord SSL 80 1,422 0 22 May 2019
Unsupervised Deep Learning by Neighbourhood Discovery Jiabo Huang Qi Dong S. Gong Xiatian Zhu SSL 38 152 0 25 Apr 2019
Self-supervised Visual Feature Learning with Deep Neural Networks: A Survey Longlong Jing Yingli Tian SSL 83 1,692 0 16 Feb 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 753 93,936 0 11 Oct 2018
Deep Clustering for Unsupervised Learning of Visual Features Mathilde Caron Piotr Bojanowski Armand Joulin Matthijs Douze SSL 63 1,878 0 15 Jul 2018
Representation Learning with Contrastive Predictive Coding Aaron van den Oord Yazhe Li Oriol Vinyals DRL SSL 193 10,152 0 10 Jul 2018
MURA: Large Dataset for Abnormality Detection in Musculoskeletal Radiographs Pranav Rajpurkar Jeremy Irvin Aarti Bagul D. Ding Tony Duan ... Robyn L. Ball C. Langlotz K. Shpanskaya M. Lungren A. Ng 33 74 0 11 Dec 2017
Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network C. Ledig Lucas Theis Ferenc Huszár Jose Caballero Andrew Cunningham ... Andrew P. Aitken Alykhan Tejani J. Totz Zehan Wang Wenzhe Shi GAN 215 10,646 0 15 Sep 2016
CliqueCNN: Deep Unsupervised Exemplar Learning Miguel Angel Bautista A. Sanakoyeu Ekaterina Tikhoncheva Bjorn Ommer SSL 24 113 0 31 Aug 2016
Skin Lesion Analysis toward Melanoma Detection: A Challenge at the International Symposium on Biomedical Imaging (ISBI) 2016, hosted by the International Skin Imaging Collaboration (ISIC) David Gutman Noel Codella Emre M. Celebi Brian Helba Michael Marchetti N. Mishra Allan Halpern 39 656 0 04 May 2016
Context Encoders: Feature Learning by Inpainting Deepak Pathak Philipp Krahenbuhl Jeff Donahue Trevor Darrell Alexei A. Efros SSL 29 5,277 0 25 Apr 2016
Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzles M. Noroozi Paolo Favaro SSL 119 2,965 0 30 Mar 2016
Colorful Image Colorization Richard Y. Zhang Phillip Isola Alexei A. Efros 95 3,524 0 28 Mar 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 1.0K 192,638 0 10 Dec 2015
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift Sergey Ioffe Christian Szegedy OOD 212 43,154 0 11 Feb 2015
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification Kaiming He Xinming Zhang Shaoqing Ren Jian Sun VLM 103 18,534 0 06 Feb 2015