Temperature as Uncertainty in Contrastive Learning

8 October 2021

Papers citing "Temperature as Uncertainty in Contrastive Learning"

40 / 40 papers shown

Title
A Survey of Uncertainty in Deep Neural Networks J. Gawlikowski Cedrique Rovile Njieutcheu Tassi Mohsin Ali Jongseo Lee Matthias Humt ... R. Roscher Muhammad Shahzad Wen Yang R. Bamler Xiaoxiang Zhu BDL UQCV OOD 229 1,150 0 07 Jul 2021
Barlow Twins: Self-Supervised Learning via Redundancy Reduction Jure Zbontar Li Jing Ishan Misra Yann LeCun Stéphane Deny SSL 307 2,347 0 04 Mar 2021
Learning Transferable Visual Models From Natural Language Supervision Alec Radford Jong Wook Kim Chris Hallacy Aditya A. Ramesh Gabriel Goh ... Amanda Askell Pamela Mishkin Jack Clark Gretchen Krueger Ilya Sutskever CLIP VLM 929 29,436 0 26 Feb 2021
Understanding the Behaviour of Contrastive Loss Feng Wang Huaping Liu SSL 102 689 0 15 Dec 2020
Exploring Simple Siamese Representation Learning Xinlei Chen Kaiming He SSL 253 4,054 0 20 Nov 2020
A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challenges Moloud Abdar Farhad Pourpanah Sadiq Hussain Dana Rezazadegan Li Liu ... Xiaochun Cao Abbas Khosravi U. Acharya V. Makarenkov S. Nahavandi BDL UQCV 341 1,922 0 12 Nov 2020
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 654 41,103 0 22 Oct 2020
Viewmaker Networks: Learning Views for Unsupervised Representation Learning Alex Tamkin Mike Wu Noah D. Goodman SSL 101 64 0 14 Oct 2020
Temperature check: theory and practice for training models with softmax-cross-entropy losses Atish Agarwala Jeffrey Pennington Yann N. Dauphin S. Schoenholz UQCV 42 34 0 14 Oct 2020
Conditional Negative Sampling for Contrastive Learning of Visual Representations Mike Wu Milan Mossé Chengxu Zhuang Daniel L. K. Yamins Noah D. Goodman SSL 95 79 0 05 Oct 2020
Delving into Inter-Image Invariance for Unsupervised Visual Representations Jiahao Xie Xiaohang Zhan Ziwei Liu Yew-Soon Ong Chen Change Loy SSL VLM 59 59 0 26 Aug 2020
Bayesian Neural Networks: An Introduction and Survey Ethan Goan Clinton Fookes BDL UQCV 62 205 0 22 Jun 2020
Self-supervised Knowledge Distillation for Few-shot Learning Jathushan Rajasegaran Salman Khan Munawar Hayat Fahad Shahbaz Khan M. Shah SSL 72 93 0 17 Jun 2020
Bootstrap your own latent: A new approach to self-supervised Learning Jean-Bastien Grill Florian Strub Florent Altché Corentin Tallec Pierre Harvey Richemond ... M. G. Azar Bilal Piot Koray Kavukcuoglu Rémi Munos Michal Valko SSL 371 6,806 0 13 Jun 2020
On Mutual Information in Contrastive Learning for Visual Representations Mike Wu Chengxu Zhuang Milan Mossé Daniel L. K. Yamins Noah D. Goodman SSL 60 84 0 27 May 2020
What Makes for Good Views for Contrastive Learning? Yonglong Tian Chen Sun Ben Poole Dilip Krishnan Cordelia Schmid Phillip Isola SSL 102 1,329 0 20 May 2020
Toward Adversarial Robustness by Diversity in an Ensemble of Specialized Deep Neural Networks Mahdieh Abbasi Arezoo Rajabi Christian Gagné R. Bobba AAML 35 15 0 17 May 2020
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 481 3,433 0 09 Mar 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 369 18,778 0 13 Feb 2020
Detecting Out-of-Distribution Examples with In-distribution Examples and Gram Matrices Chandramouli Shama Sastry Sageev Oore OODD 46 54 0 28 Dec 2019
Self-Supervised Learning of Pretext-Invariant Representations Ishan Misra Laurens van der Maaten SSL VLM 103 1,453 0 04 Dec 2019
Momentum Contrast for Unsupervised Visual Representation Learning Kaiming He Haoqi Fan Yuxin Wu Saining Xie Ross B. Girshick SSL 201 12,085 0 13 Nov 2019
Deep Neural Network Ensembles against Deception: Ensemble Diversity, Accuracy and Robustness Ling Liu Wenqi Wei Ka-Ho Chow Margaret Loper Emre Gursoy Stacey Truex Yanzhao Wu UQCV AAML FedML 48 60 0 29 Aug 2019
Contrastive Multiview Coding Yonglong Tian Dilip Krishnan Phillip Isola SSL 169 2,403 0 13 Jun 2019
Learning Representations by Maximizing Mutual Information Across Views Philip Bachman R. Devon Hjelm William Buchwalter SSL 189 1,475 0 03 Jun 2019
On Variational Bounds of Mutual Information Ben Poole Sherjil Ozair Aaron van den Oord Alexander A. Alemi George Tucker SSL 104 807 0 16 May 2019
Deep Neural Network Ensembles S. Tao OOD FaML UQCV 119 37 0 11 Apr 2019
Local Aggregation for Unsupervised Learning of Visual Embeddings Chengxu Zhuang Alex Zhai Daniel L. K. Yamins SSL 89 447 0 29 Mar 2019
Modeling Uncertainty with Hedged Instance Embedding Seong Joon Oh Kevin Patrick Murphy Jiyan Pan Joseph Roth Florian Schroff Andrew C. Gallagher UQCV 430 70 0 30 Sep 2018
Heated-Up Softmax Embedding Xu-Yao Zhang Felix X. Yu Svebor Karaman Wei Zhang Shih-Fu Chang 47 46 0 11 Sep 2018
Learning deep representations by mutual information estimation and maximization R. Devon Hjelm A. Fedorov Samuel Lavoie-Marchildon Karan Grewal Phil Bachman Adam Trischler Yoshua Bengio SSL DRL 320 2,662 0 20 Aug 2018
Representation Learning with Contrastive Predictive Coding Aaron van den Oord Yazhe Li Oriol Vinyals DRL SSL 320 10,302 0 10 Jul 2018
TADAM: Task dependent adaptive metric for improved few-shot learning Boris N. Oreshkin Pau Rodríguez López Alexandre Lacoste 96 1,313 0 23 May 2018
Unsupervised Feature Learning via Non-Parametric Instance-level Discrimination Zhirong Wu Yuanjun Xiong Stella X. Yu Dahua Lin SSL 173 3,458 0 05 May 2018
Large Batch Training of Convolutional Networks Yang You Igor Gitman Boris Ginsburg ODL 128 848 0 13 Aug 2017
On Calibration of Modern Neural Networks Chuan Guo Geoff Pleiss Yu Sun Kilian Q. Weinberger UQCV 299 5,833 0 14 Jun 2017
Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networks Shiyu Liang Yixuan Li R. Srikant UQCV OODD 168 2,072 0 08 Jun 2017
A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networks Dan Hendrycks Kevin Gimpel UQCV 158 3,454 0 07 Oct 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.2K 194,020 0 10 Dec 2015
Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning Y. Gal Zoubin Ghahramani UQCV BDL 821 9,318 0 06 Jun 2015