v1v2 (latest)

Emerging Properties in Self-Supervised Vision Transformers

29 April 2021

Papers citing "Emerging Properties in Self-Supervised Vision Transformers"

50 / 4,175 papers shown

Title
Locality-Aware Inter-and Intra-Video Reconstruction for Self-Supervised Correspondence Learning Liulei Li Tianfei Zhou Wenguan Wang Lu Yang Jian-Wei Li Yi Yang SSL 111 49 0 27 Mar 2022
Beyond Masking: Demystifying Token-Based Pre-Training for Vision Transformers Yunjie Tian Lingxi Xie Jiemin Fang Mengnan Shi Junran Peng Xiaopeng Zhang Jianbin Jiao Qi Tian QiXiang Ye 73 20 0 27 Mar 2022
Towards Discriminative Representation: Multi-view Trajectory Contrastive Learning for Online Multi-object Tracking En Yu Zhuoling Li Shoudong Han 119 44 0 27 Mar 2022
Recent Few-Shot Object Detection Algorithms: A Survey with Performance Comparison Tianying Liu Lu Zhang Yang Wang Jihong Guan Yanwei Fu Jiajia Zhao Shuigeng Zhou ObjD AAML 82 27 0 27 Mar 2022
Semantic Segmentation by Early Region Proxy Yifan Zhang Bo Pang Cewu Lu ViT 122 30 0 26 Mar 2022
On the Viability of Monocular Depth Pre-training for Semantic Segmentation Dong Lao Fengyu Yang Daniel Wang Hyoungseob Park Samuel Lu Alex Wong Stefano Soatto MDE 81 0 0 26 Mar 2022
Making Heads or Tails: Towards Semantically Consistent Visual Counterfactuals Simon Vandenhende D. Mahajan Filip Radenovic Deepti Ghadiyaram 76 30 0 24 Mar 2022
The Challenges of Continuous Self-Supervised Learning Senthil Purushwalkam Pedro Morgado Abhinav Gupta CLL 85 44 0 23 Mar 2022
Unsupervised Salient Object Detection with Spectral Cluster Voting Gyungin Shin Samuel Albanie Weidi Xie 98 68 0 23 Mar 2022
VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Training Zhan Tong Yibing Song Jue Wang Limin Wang ViT 252 1,220 0 23 Mar 2022
Interpretable Prediction of Lung Squamous Cell Carcinoma Recurrence With Self-supervised Learning Weicheng Zhu C. Fernandez‐Granda N. Razavian SSL 64 4 0 23 Mar 2022
A Broad Study of Pre-training for Domain Generalization and Adaptation Donghyun Kim Kaihong Wang Stan Sclaroff Kate Saenko OOD AI4CE 103 81 0 22 Mar 2022
CP2: Copy-Paste Contrastive Pretraining for Semantic Segmentation Feng Wang Huiyu Wang Chen Wei Alan Yuille Wei Shen SSL VLM 110 35 0 22 Mar 2022
Representation Uncertainty in Self-Supervised Learning as Variational Inference Hiroki Nakamura Masashi Okada T. Taniguchi 82 19 0 22 Mar 2022
Drive&Segment: Unsupervised Semantic Segmentation of Urban Scenes via Cross-modal Distillation Antonín Vobecký David Hurych Oriane Siméoni Spyros Gidaris Andrei Bursuc Patrick Pérez Josef Sivic 3DPC 80 21 0 21 Mar 2022
Hyperbolic Vision Transformers: Combining Improvements in Metric Learning Aleksandr Ermolov L. Mirvakhabova Valentin Khrulkov N. Sebe Ivan Oseledets 96 105 0 21 Mar 2022
Three things everyone should know about Vision Transformers Hugo Touvron Matthieu Cord Alaaeldin El-Nouby Jakob Verbeek Hervé Jégou ViT 114 123 0 18 Mar 2022
Attribute Surrogates Learning and Spectral Tokens Pooling in Transformers for Few-shot Learning Yang He Weihan Liang Dongyang Zhao Hong-Yu Zhou Weifeng Ge Yizhou Yu Wenqiang Zhang ViT 98 46 0 17 Mar 2022
DATA: Domain-Aware and Task-Aware Self-supervised Learning Qing Chang Junran Peng Lingxi Xie Jiajun Sun Hao Yin Qi Tian Zhaoxiang Zhang 68 8 0 17 Mar 2022
Object discovery and representation networks Olivier J. Hénaff Skanda Koppula Evan Shelhamer Daniel Zoran Andrew Jaegle Andrew Zisserman João Carreira Relja Arandjelović 108 89 0 16 Mar 2022
Weak Augmentation Guided Relational Self-Supervised Learning Mingkai Zheng Shan You Fei Wang Chao Qian Changshui Zhang Xiaogang Wang Chang Xu 83 5 0 16 Mar 2022
Pushing the limits of raw waveform speaker recognition Jee-weon Jung You Jin Kim Hee-Soo Heo Bong-Jin Lee Youngki Kwon Joon Son Chung 85 90 0 16 Mar 2022
Unsupervised Semantic Segmentation by Distilling Feature Correspondences Mark Hamilton Zhoutong Zhang Bharath Hariharan Noah Snavely William T. Freeman 59 245 0 16 Mar 2022
Patch-Fool: Are Vision Transformers Always Robust Against Adversarial Perturbations? Y. Fu Shunyao Zhang Shan-Hung Wu Cheng Wan Yingyan Lin AAML 113 67 0 16 Mar 2022
Zipfian environments for Reinforcement Learning Stephanie C. Y. Chan Andrew Kyle Lampinen Pierre Harvey Richemond Felix Hill OffRL 122 15 0 15 Mar 2022
Bamboo: Building Mega-Scale Vision Dataset Continually with Human-Machine Synergy Yuanhan Zhang Qi Sun Yichun Zhou Zexin He Zhen-fei Yin Kunze Wang Lu Sheng Yu Qiao Jing Shao Ziwei Liu ObjD VLM 108 19 0 15 Mar 2022
Mixed Evidence for Gestalt Grouping in Deep Neural Networks Valerio Biscione J. Bowers 88 11 0 14 Mar 2022
Self-Promoted Supervision for Few-Shot Transformer Bowen Dong Pan Zhou Shuicheng Yan W. Zuo ViT 79 31 0 14 Mar 2022
Active Learning by Feature Mixing Amin Parvaneh Ehsan Abbasnejad Damien Teney Reza Haffari Anton Van Den Hengel Javen Qinfeng Shi 81 94 0 14 Mar 2022
UniVIP: A Unified Framework for Self-Supervised Visual Pre-training Zhaowen Li Yousong Zhu Fan Yang Wei Li Chaoyang Zhao ... Jiahao Xie Liwei Wu Rui Zhao Ming Tang Jinqiao Wang 83 37 0 14 Mar 2022
SimMatch: Semi-supervised Learning with Similarity Matching Mingkai Zheng Shan You Lang Huang Fei Wang Chao Qian Chang Xu 113 183 0 14 Mar 2022
RecursiveMix: Mixed Learning with History Lingfeng Yang Xiang Li Borui Zhao Renjie Song Jian Yang VLM 86 20 0 14 Mar 2022
Scaling Up Your Kernels to 31x31: Revisiting Large Kernel Design in CNNs Xiaohan Ding Xinming Zhang Yi Zhou Jungong Han Guiguang Ding Jian Sun VLM 151 554 0 13 Mar 2022
Sparse Subspace Clustering for Concept Discovery (SSCCD) Johanna Vielhaben Stefan Blücher Nils Strodthoff 67 6 0 11 Mar 2022
Towards Self-Supervised Learning of Global and Object-Centric Representations Federico Baldassarre Hossein Azizpour SSL 3DPC OCL 96 13 0 11 Mar 2022
MVP: Multimodality-guided Visual Pre-training Longhui Wei Lingxi Xie Wen-gang Zhou Houqiang Li Qi Tian 82 108 0 10 Mar 2022
Text-DIAE: A Self-Supervised Degradation Invariant Autoencoders for Text Recognition and Document Enhancement Mohamed Ali Souibgui Sanket Biswas Andrés Mafla Ali Furkan Biten Alicia Fornés Yousri Kessentini Josep Lladós Lluís Gómez Dimosthenis Karatzas 75 25 0 09 Mar 2022
3SD: Self-Supervised Saliency Detection With No Labels R. Yasarla Renliang Weng Wongun Choi Vishal M. Patel Amir Sadeghian 64 5 0 09 Mar 2022
Self-Supervision, Remote Sensing and Abstraction: Representation Learning Across 3 Million Locations Sachith Seneviratne K. Nice J. Wijnands Mark Stevenson Jason Thompson SSL 41 8 0 08 Mar 2022
PASS: Part-Aware Self-Supervised Pre-Training for Person Re-Identification Kuan Zhu Haiyun Guo Tianyi Yan Yousong Zhu Jinqiao Wang Ming Tang 72 10 0 08 Mar 2022
Monocular Robot Navigation with Self-Supervised Pretrained Vision Transformers Miguel A. Saavedra-Ruiz Sacha Morin Liam Paull MDE ViT 62 3 0 07 Mar 2022
Unsupervised Domain Adaptation with Contrastive Learning for OCT Segmentation Alvaro Gomariz Huanxiang Lu Yun Yvonna Li Thomas Albrecht Andreas Maunz Fethallah Benmansour A. Valcarcel Jennifer Luu Daniela Ferrara O. Goksel 63 12 0 07 Mar 2022
Self-supervised learning for analysis of temporal and morphological drug effects in cancer cell imaging data A. Dmitrenko M. M. Masiero N. Zamboni MedIm 50 8 0 07 Mar 2022
Multi-class Token Transformer for Weakly Supervised Semantic Segmentation Lian Xu Wanli Ouyang Bennamoun F. Boussaïd Dan Xu ViT 107 214 0 06 Mar 2022
A Large-scale Comprehensive Dataset and Copy-overlap Aware Evaluation Protocol for Segment-level Video Copy Detection Sifeng He Xudong Yang Chenhan Jiang Gang Liang Wei Zhang ... Kaiming Huang Yuan Cheng Feng Qian Xiaobo Zhang Lei Yang 60 12 0 05 Mar 2022
UVCGAN: UNet Vision Transformer cycle-consistent GAN for unpaired image-to-image translation D. Torbunov Yi Huang Haiwang Yu Jin-zhi Huang Shinjae Yoo Meifeng Lin B. Viren Yihui Ren ViT 100 85 0 04 Mar 2022
DiT: Self-supervised Pre-training for Document Image Transformer Junlong Li Yiheng Xu Tengchao Lv Lei Cui Chaoxi Zhang Furu Wei ViT VLM 126 170 0 04 Mar 2022
Class-Aware Contrastive Semi-Supervised Learning Fan Yang Kai Wu Shuyi Zhang Guannan Jiang Yong Liu Feng Zheng Wei Zhang Chengjie Wang Long Zeng 67 100 0 04 Mar 2022
Measuring Self-Supervised Representation Quality for Downstream Classification using Discriminative Features Neha Kalibhat Kanika Narang Hamed Firooz Maziar Sanjabi Soheil Feizi SSL 135 8 0 03 Mar 2022
What Makes Transfer Learning Work For Medical Images: Feature Reuse & Other Factors Christos Matsoukas Johan Fredin Haslum Moein Sorkhei Magnus P Soderberg Kevin Smith VLM OOD MedIm 132 88 0 02 Mar 2022