v1v2 (latest)

Emerging Properties in Self-Supervised Vision Transformers

29 April 2021

Papers citing "Emerging Properties in Self-Supervised Vision Transformers"

25 / 4,175 papers shown

Title
Diffusion Mechanism in Residual Neural Network: Theory and Applications Tangjun Wang Zehao Dou Chenglong Bao Zuoqiang Shi DiffM 64 9 0 07 May 2021
Hyperspherically Regularized Networks for Self-Supervision A. Durrant Georgios Leontidis SSL 131 7 0 29 Apr 2021
With a Little Help from My Friends: Nearest-Neighbor Contrastive Learning of Visual Representations Debidatta Dwibedi Y. Aytar Jonathan Tompson P. Sermanet Andrew Zisserman SSL 265 467 0 29 Apr 2021
If your data distribution shifts, use self-learning E. Rusak Steffen Schneider George Pachitariu L. Eck Peter V. Gehler Oliver Bringmann Wieland Brendel Matthias Bethge VLM OOD TTA 174 33 0 27 Apr 2021
DisCo: Remedy Self-supervised Learning on Lightweight Models with Distilled Contrastive Learning Yuting Gao Jia-Xin Zhuang Xiaowei Guo Hao Cheng Xing Sun Ke Li Feiyue Huang 136 40 0 19 Apr 2021
SiT: Self-supervised vIsion Transformer Sara Atito Ali Ahmed Muhammad Awais J. Kittler ViT 110 139 0 08 Apr 2021
An Empirical Study of Training Self-Supervised Vision Transformers Xinlei Chen Saining Xie Kaiming He ViT 179 1,874 0 05 Apr 2021
Sparse Object-level Supervision for Instance Segmentation with Pixel Embeddings A. Wolny Qin Yu Constantin Pape Anna Kreshuk ISeg 93 21 0 26 Mar 2021
Characterizing and Improving the Robustness of Self-Supervised Learning through Background Augmentations Chaitanya K. Ryali D. Schwab Ari S. Morcos SSL 88 9 0 23 Mar 2021
Self-Supervised Classification Network Elad Amrani Leonid Karlinsky A. Bronstein SSL 66 29 0 19 Mar 2021
UNETR: Transformers for 3D Medical Image Segmentation Ali Hatamizadeh Yucheng Tang Vishwesh Nath Dong Yang Andriy Myronenko Bennett Landman H. Roth Daguang Xu ViT MedIm 198 1,631 0 18 Mar 2021
CoDeGAN: Contrastive Disentanglement for Generative Adversarial Network Lili Pan Peijun Tang Zhiyong Chen Zenglin Xu GAN DRL 64 5 0 05 Mar 2021
Predicting post-operative right ventricular failure using video-based deep learning R. Shad Nicolas Quach R. Fong P. Kasinpila C. Bowles ... Y. Woo J. Teuteberg John P. Cunningham C. Langlotz W. Hiesinger 53 46 0 28 Feb 2021
Unleashing the Power of Contrastive Self-Supervised Visual Models via Contrast-Regularized Fine-Tuning Yifan Zhang Bryan Hooi Dapeng Hu Jian Liang Jiashi Feng 129 64 0 12 Feb 2021
Deep Learning with Label Differential Privacy Badih Ghazi Noah Golowich Ravi Kumar Pasin Manurangsi Chiyuan Zhang 118 153 0 11 Feb 2021
Generative Multi-Label Zero-Shot Learning Akshita Gupta Sanath Narayan Salman Khan Fahad Shahbaz Khan Ling Shao Joost van de Weijer VLM 104 32 0 27 Jan 2021
Curriculum Learning: A Survey Petru Soviany Radu Tudor Ionescu Paolo Rota N. Sebe ODL 188 363 0 25 Jan 2021
Transformers in Vision: A Survey Salman Khan Muzammal Naseer Munawar Hayat Syed Waqas Zamir Fahad Shahbaz Khan M. Shah ViT 369 2,560 0 04 Jan 2021
Concept Generalization in Visual Representation Learning Mert Bulent Sariyildiz Yannis Kalantidis Diane Larlus Alahari Karteek SSL 109 50 0 10 Dec 2020
Multi-level Knowledge Distillation via Knowledge Alignment and Correlation Fei Ding Yin Yang Hongxin Hu Venkat Krovi Feng Luo 43 4 0 01 Dec 2020
Exploring Simple Siamese Representation Learning Xinlei Chen Kaiming He SSL 266 4,081 0 20 Nov 2020
Combating the Instability of Mutual Information-based Losses via Regularization Kwanghee Choi Siyeong Lee AAML 62 4 0 16 Nov 2020
A Practical Tutorial on Graph Neural Networks I. Ward J. Joyner C. Lickfold Yulan Guo Bennamoun GNN AI4CE 120 15 0 11 Oct 2020
Unsupervised Learning of Visual Features by Contrasting Cluster Assignments Mathilde Caron Ishan Misra Julien Mairal Priya Goyal Piotr Bojanowski Armand Joulin OCL SSL 334 4,109 0 17 Jun 2020
Characterizing Structural Regularities of Labeled Data in Overparameterized Models Ziheng Jiang Chiyuan Zhang Kunal Talwar Michael C. Mozer TDI 68 104 0 08 Feb 2020