v1v2 (latest)

Emerging Properties in Self-Supervised Vision Transformers

29 April 2021

Papers citing "Emerging Properties in Self-Supervised Vision Transformers"

50 / 4,175 papers shown

Title
Nearest Class-Center Simplification through Intermediate Layers Ido Ben-Shaul S. Dekel 95 27 0 21 Jan 2022
Omnivore: A Single Model for Many Visual Modalities Rohit Girdhar Mannat Singh Nikhil Ravi Laurens van der Maaten Armand Joulin Ishan Misra 286 237 0 20 Jan 2022
Revisiting Weakly Supervised Pre-Training of Visual Perception Models Mannat Singh Laura Gustafson Aaron B. Adcock Vinicius de Freitas Reis B. Gedik Raj Prateek Kosaraju D. Mahajan Ross B. Girshick Piotr Dollár Laurens van der Maaten VLM 99 130 0 20 Jan 2022
Self-supervised Video Representation Learning with Cascade Positive Retrieval Cheng-En Wu Farley Lai Yujie Hu Asim Kadav SSL AI4TS 78 3 0 20 Jan 2022
Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detection A. Haliassos Rodrigo Mira Stavros Petridis Maja Pantic CVBM 121 132 0 18 Jan 2022
RePre: Improving Self-Supervised Vision Transformer with Reconstructive Pre-training Luyang Wang Feng Liang Yangguang Li Honggang Zhang Wanli Ouyang Jing Shao ViT 94 25 0 18 Jan 2022
Self-Supervised Anomaly Detection by Self-Distillation and Negative Sampling Nima Rafiee Rahil Gholamipoorfard Nikolas Adaloglou Simon Jaxy Julius Ramakers M. Kollmann OODD 34 8 0 17 Jan 2022
Video Transformers: A Survey Javier Selva A. S. Johansen Sergio Escalera Kamal Nasrollahi T. Moeslund Albert Clapés ViT 141 107 0 16 Jan 2022
Pushing the limits of self-supervised ResNets: Can we outperform supervised learning without labels on ImageNet? Nenad Tomašev Ioana Bica Brian McWilliams Lars Buesing Razvan Pascanu Charles Blundell Jovana Mitrović SSL 177 83 0 13 Jan 2022
BigDatasetGAN: Synthesizing ImageNet with Pixel-wise Annotations Daiqing Li Huan Ling Seung Wook Kim Karsten Kreis Adela Barriuso Sanja Fidler Antonio Torralba 139 107 0 12 Jan 2022
Generalized Category Discovery S. Vaze Kai Han Andrea Vedaldi Andrew Zisserman 93 204 0 07 Jan 2022
Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Images Ali Hatamizadeh V. Nath Yucheng Tang Dong Yang H. Roth Daguang Xu ViT MedIm 128 1,156 0 04 Jan 2022
Splicing ViT Features for Semantic Appearance Transfer Narek Tumanyan Omer Bar-Tal Shai Bagon Tali Dekel DiffM 89 181 0 02 Jan 2022
Optimal Representations for Covariate Shift Yangjun Ruan Yann Dubois Chris J. Maddison OOD 118 69 0 31 Dec 2021
Continually Learning Self-Supervised Representations with Projected Functional Regularization Alex Gomez-Villa Bartlomiej Twardowski Lu Yu Andrew D. Bagdanov Joost van de Weijer CLL SSL 94 40 0 30 Dec 2021
Augmenting Convolutional networks with attention-based aggregation Hugo Touvron Matthieu Cord Alaaeldin El-Nouby Piotr Bojanowski Armand Joulin Gabriel Synnaeve Hervé Jégou ViT 114 49 0 27 Dec 2021
SLIP: Self-supervision meets Language-Image Pre-training Norman Mu Alexander Kirillov David Wagner Saining Xie VLM CLIP 156 492 0 23 Dec 2021
Self-Supervised Graph Representation Learning for Neuronal Morphologies Marissa A. Weis Laura Hansel Timo Lüddecke Alexander S. Ecker MedIm 81 8 0 23 Dec 2021
Simple and Effective Balance of Contrastive Losses Arnaud Sors Rafael Sampaio de Rezende Sarah Ibrahimi J. Andreoli SSL 96 1 0 22 Dec 2021
Few-Shot Object Detection: A Comprehensive Survey Mona Köhler M. Eisenbach H. Groß ObjD 94 67 0 22 Dec 2021
MIA-Former: Efficient and Robust Vision Transformers via Multi-grained Input-Adaptation Zhongzhi Yu Y. Fu Sicheng Li Chaojian Li Yingyan Lin ViT 76 19 0 21 Dec 2021
Teacher-Student Architecture for Mixed Supervised Lung Tumor Segmentation Vemund Fredriksen Svein Ole M. Svele André Pedersen T. Langø Gabriel Kiss Frank Lindseth 73 1 0 21 Dec 2021
Are Large-scale Datasets Necessary for Self-Supervised Pre-training? Alaaeldin El-Nouby Gautier Izacard Hugo Touvron Ivan Laptev Hervé Jégou Edouard Grave SSL 106 152 0 20 Dec 2021
Learning with Label Noise for Image Retrieval by Selecting Interactions Sarah Ibrahimi Arnaud Sors Rafael Sampaio de Rezende Stéphane Clinchant NoLa VLM 79 16 0 20 Dec 2021
Watermarking Images in Self-Supervised Latent Spaces Pierre Fernandez Alexandre Sablayrolles Teddy Furon Hervé Jégou Matthijs Douze WIGM 87 87 0 17 Dec 2021
Data Efficient Language-supervised Zero-shot Recognition with Optimal Transport Distillation Bichen Wu Rui Cheng Peizhao Zhang Tianren Gao Peter Vajda Joseph E. Gonzalez VLM 110 45 0 17 Dec 2021
UniMiSS: Universal Medical Self-Supervised Learning via Breaking Dimensionality Barrier Yutong Xie Jianpeng Zhang Yong-quan Xia Qi Wu MedIm 138 64 0 17 Dec 2021
How to augment your ViTs? Consistency loss and StyleAug, a random style transfer augmentation Akash Umakantha João Dias Semedo S. Golestaneh Wan-Yi Lin ViT 43 0 0 16 Dec 2021
High Fidelity Visualization of What Your Self-Supervised Representation Knows About Florian Bordes Randall Balestriero Pascal Vincent DiffM 109 65 0 16 Dec 2021
Masked Feature Prediction for Self-Supervised Visual Pre-Training Chen Wei Haoqi Fan Saining Xie Chaoxia Wu Alan Yuille Christoph Feichtenhofer ViT 190 674 0 16 Dec 2021
HODOR: High-level Object Descriptors for Object Re-segmentation in Video Learned from Static Images A. Athar Jonathon Luiten Alexander Hermans Deva Ramanan Bastian Leibe VOS 148 27 0 16 Dec 2021
Ensembling Off-the-shelf Models for GAN Training Nupur Kumari Richard Y. Zhang Eli Shechtman Jun-Yan Zhu 105 88 0 16 Dec 2021
Unsupervised Dense Information Retrieval with Contrastive Learning Gautier Izacard Mathilde Caron Lucas Hosseini Sebastian Riedel Piotr Bojanowski Armand Joulin Edouard Grave RALM 268 928 0 16 Dec 2021
Deep Hash Distillation for Image Retrieval Young Kyun Jang Geonmo Gu ByungSoo Ko Isaac Kang N. Cho 93 37 0 16 Dec 2021
FIgLib & SmokeyNet: Dataset and Deep Learning Model for Real-Time Wildland Fire Smoke Detection Anshuman Dewangan Yash Pande Hans-Werner Braun F. Vernon Ismael Pérez I. Altintas G. Cottrell M. H. Nguyen 62 49 0 16 Dec 2021
Rethinking Nearest Neighbors for Visual Classification Menglin Jia Bor-Chun Chen Zuxuan Wu Claire Cardie Serge Belongie Ser-Nam Lim SSL 92 10 0 15 Dec 2021
Towards General and Efficient Active Learning Yichen Xie Masayoshi Tomizuka Wei Zhan VLM 95 10 0 15 Dec 2021
Deep ViT Features as Dense Visual Descriptors Shirzad Amir Yossi Gandelsman Shai Bagon Tali Dekel MDE ViT 154 290 0 10 Dec 2021
Label, Verify, Correct: A Simple Few Shot Object Detection Method Prannay Kaul Weidi Xie Andrew Zisserman ObjD 78 83 0 10 Dec 2021
Exploring the Equivalence of Siamese Self-Supervised Learning via A Unified Gradient Framework Chenxin Tao Honghui Wang Xizhou Zhu Jiahua Dong S. Song Gao Huang Jifeng Dai SSL 84 61 0 09 Dec 2021
PE-former: Pose Estimation Transformer Paschalis Panteleris Antonis Argyros ViT 74 12 0 09 Dec 2021
Constrained Mean Shift Using Distant Yet Related Neighbors for Representation Learning K. Navaneet Soroush Abbasi Koohpayegani Ajinkya Tejankar Kossar Pourahmadi Akshayvarun Subramanya Hamed Pirsiavash SSL 77 8 0 08 Dec 2021
FLAVA: A Foundational Language And Vision Alignment Model Amanpreet Singh Ronghang Hu Vedanuj Goswami Guillaume Couairon Wojciech Galuba Marcus Rohrbach Douwe Kiela CLIP VLM 133 719 0 08 Dec 2021
Self-Supervised Models are Continual Learners Enrico Fini Victor G. Turrisi da Costa Xavier Alameda-Pineda Elisa Ricci Alahari Karteek Julien Mairal BDL CLL SSL 116 167 0 08 Dec 2021
Few-Shot Image Classification Along Sparse Graphs Joseph F. Comer P. Jacobson Heiko Hoffmann 84 1 0 07 Dec 2021
Joint Learning of Localized Representations from Medical Images and Reports Philipp Muller Georgios Kaissis Cong Zou Daniel Munich 208 86 0 06 Dec 2021
Forward Compatible Training for Large-Scale Embedding Retrieval Systems Vivek Ramanujan Pavan Kumar Anasosalu Vasu Ali Farhadi Oncel Tuzel Hadi Pouransari VLM 73 19 0 06 Dec 2021
Dynamic Token Normalization Improves Vision Transformers Wenqi Shao Yixiao Ge Zhaoyang Zhang Xuyuan Xu Xiaogang Wang Ying Shan Ping Luo ViT 198 12 0 05 Dec 2021
3rd Place: A Global and Local Dual Retrieval Solution to Facebook AI Image Similarity Challenge Xinlong Sun Yangyang Qin Xuyuan Xu Guoping Gong Yang Fang Yexin Wang 118 5 0 04 Dec 2021
Unsupervised Domain Generalization by Learning a Bridge Across Domains Sivan Harary Eli Schwartz Assaf Arbelle Peter W. J. Staar Shady Abu Hussein ... Hildegard Kuehne Dina Katabi Kate Saenko Rogerio Feris Leonid Karlinsky OOD 84 42 0 04 Dec 2021