v1v2 (latest)

Emerging Properties in Self-Supervised Vision Transformers

29 April 2021

Papers citing "Emerging Properties in Self-Supervised Vision Transformers"

50 / 4,175 papers shown

Title
BEVT: BERT Pretraining of Video Transformers Rui Wang Dongdong Chen Zuxuan Wu Yinpeng Chen Xiyang Dai Mengchen Liu Yu-Gang Jiang Luowei Zhou Lu Yuan ViT 108 209 0 02 Dec 2021
A Fast Knowledge Distillation Framework for Visual Recognition Zhiqiang Shen Eric P. Xing VLM 112 49 0 02 Dec 2021
DenseCLIP: Language-Guided Dense Prediction with Context-Aware Prompting Yongming Rao Wenliang Zhao Guangyi Chen Yansong Tang Zheng Zhu Guan Huang Jie Zhou Jiwen Lu VLM CLIP 224 582 0 02 Dec 2021
TransFGU: A Top-down Approach to Fine-Grained Unsupervised Semantic Segmentation Zhao-Heng Yin Pichao Wang Fan Wang Xianzhe Xu Hanling Zhang Hao Li Rong Jin 102 41 0 02 Dec 2021
Self-supervised Video Transformer Kanchana Ranasinghe Muzammal Naseer Salman Khan Fahad Shahbaz Khan Michael S. Ryoo ViT 130 88 0 02 Dec 2021
OW-DETR: Open-world Detection Transformer Akshita Gupta Sanath Narayan K. J. Joseph Salman Khan Fahad Shahbaz Khan M. Shah ViT 94 174 0 02 Dec 2021
Toward Foundation Models for Earth Monitoring: Proposal for a Climate Change Benchmark Alexandre Lacoste Evan D. Sherwin Hannah Kerner Hamed Alemohammad Bjorn Lutjens ... Alex Chang Mehmet Gunturkun Alexandre Drouin Pau Rodríguez López David Vazquez AI4Cl AI4CE 60 31 0 01 Dec 2021
Revisiting the Transferability of Supervised Pretraining: an MLP Perspective Yizhou Wang Shixiang Tang Feng Zhu Lei Bai Rui Zhao Donglian Qi Wanli Ouyang 104 53 0 01 Dec 2021
Boosting Discriminative Visual Representation Learning with Scenario-Agnostic Mixup Siyuan Li Zicheng Liu Zedong Wang Di Wu Zihan Liu Stan Z. Li 102 27 0 30 Nov 2021
MC-SSL0.0: Towards Multi-Concept Self-Supervised Learning Sara Atito Muhammad Awais Ammarah Farooq Zhenhua Feng J. Kittler 56 17 0 30 Nov 2021
Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysis Yucheng Tang Dong Yang Wenqi Li H. Roth Bennett Landman Daguang Xu V. Nath Ali Hatamizadeh ViT MedIm 156 536 0 29 Nov 2021
A Simple Long-Tailed Recognition Baseline via Vision-Language Model Teli Ma Shijie Geng Mengmeng Wang Jing Shao Jiasen Lu Hongsheng Li Peng Gao Yu Qiao VLM 114 47 0 29 Nov 2021
Similarity Contrastive Estimation for Self-Supervised Soft Contrastive Learning J. Denize Jaonary Rabarisoa Astrid Orcesi Romain Hérault S. Canu SSL 47 30 0 29 Nov 2021
SWAT: Spatial Structure Within and Among Tokens Kumara Kahatapitiya Michael S. Ryoo 72 6 0 26 Nov 2021
Semantic-Aware Generation for Self-Supervised Visual Representation Learning Yunjie Tian Lingxi Xie Xiaopeng Zhang Jiemin Fang Haohang Xu Wei Huang Jianbin Jiao Qi Tian QiXiang Ye SSL GAN 69 16 0 25 Nov 2021
Global Interaction Modelling in Vision Transformer via Super Tokens Ammarah Farooq Muhammad Awais S. Ahmed J. Kittler ViT 59 7 0 25 Nov 2021
Self-Distilled Self-Supervised Representation Learning Jiho Jang Seonhoon Kim Kiyoon Yoo Chaerin Kong Jang-Hyun Kim Nojun Kwak SSL 94 15 0 25 Nov 2021
PeCo: Perceptual Codebook for BERT Pre-training of Vision Transformers Xiaoyi Dong Jianmin Bao Ting Zhang Dongdong Chen Weiming Zhang Lu Yuan Dong Chen Fang Wen Nenghai Yu Baining Guo ViT 150 245 0 24 Nov 2021
Conditional Object-Centric Learning from Video Thomas Kipf Gamaleldin F. Elsayed Aravindh Mahendran Austin Stone S. Sabour G. Heigold Rico Jonschkowski Alexey Dosovitskiy Klaus Greff OCL 141 218 0 24 Nov 2021
ViCE: Improving Dense Representation Learning by Superpixelization and Contrasting Cluster Assignment Robin Karlsson Tomoki Hayashi Keisuke Fujii Alexander Carballo Kento Ohtani K. Takeda SSL 60 4 0 24 Nov 2021
RegionCL: Can Simple Region Swapping Contribute to Contrastive Learning? Yufei Xu Qiming Zhang Jing Zhang Dacheng Tao SSL 134 18 0 24 Nov 2021
Self-Supervised Pre-Training for Transformer-Based Person Re-Identification Haowen Luo Pichao Wang Yi Tian Xu Feng Ding Yanxin Zhou Fan Wang Hao Li Rong Jin ViT 78 62 0 23 Nov 2021
Pruning Self-attentions into Convolutional Layers in Single Path Haoyu He Jianfei Cai Jing Liu Zizheng Pan Jing Zhang Dacheng Tao Bohan Zhuang ViT 95 40 0 23 Nov 2021
RedCaps: web-curated image-text data created by the people, for the people Karan Desai Gaurav Kaul Zubin Aysola Justin Johnson 135 169 0 22 Nov 2021
Class-agnostic Object Detection with Multi-modal Transformer Muhammad Maaz H. Rasheed Salman Khan Fahad Shahbaz Khan Rao Muhammad Anwer Ming-Hsuan Yang 141 97 0 22 Nov 2021
Benchmarking Detection Transfer Learning with Vision Transformers Yanghao Li Saining Xie Xinlei Chen Piotr Dollar Kaiming He Ross B. Girshick 110 170 0 22 Nov 2021
Why Do Self-Supervised Models Transfer? Investigating the Impact of Invariance on Downstream Tasks Linus Ericsson Henry Gouk Timothy M. Hospedales SSL 95 15 0 22 Nov 2021
Semi-Supervised Vision Transformers Zejia Weng Xitong Yang Ang Li Zuxuan Wu Yu-Gang Jiang ViT 82 43 0 22 Nov 2021
Global and Local Alignment Networks for Unpaired Image-to-Image Translation Guanglei Yang Hao Tang Humphrey Shi M. Ding N. Sebe Radu Timofte Luc Van Gool Elisa Ricci 49 1 0 19 Nov 2021
ClevrTex: A Texture-Rich Benchmark for Unsupervised Multi-Object Segmentation Laurynas Karazija Iro Laina Christian Rupprecht 3DV VOS 149 90 0 19 Nov 2021
SimMIM: A Simple Framework for Masked Image Modeling Zhenda Xie Zheng Zhang Yue Cao Yutong Lin Jianmin Bao Zhuliang Yao Qi Dai Han Hu 246 1,371 0 18 Nov 2021
TransMix: Attend to Mix for Vision Transformers Jieneng Chen Shuyang Sun Ju He Philip Torr Alan Yuille S. Bai ViT 117 110 0 18 Nov 2021
XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scale Arun Babu Changhan Wang Andros Tjandra Kushal Lakhotia Qiantong Xu ... Yatharth Saraf J. Pino Alexei Baevski Alexis Conneau Michael Auli SSL 114 712 0 17 Nov 2021
INTERN: A New Learning Paradigm Towards General Vision Jing Shao Siyu Chen Yangguang Li Kun Wang Zhen-fei Yin ... F. Yu Junjie Yan Dahua Lin Xiaogang Wang Yu Qiao 110 34 0 16 Nov 2021
LiT: Zero-Shot Transfer with Locked-image text Tuning Xiaohua Zhai Tianlin Li Basil Mustafa Andreas Steiner Daniel Keysers Alexander Kolesnikov Lucas Beyer VLM 159 561 0 15 Nov 2021
iBOT: Image BERT Pre-Training with Online Tokenizer Jinghao Zhou Chen Wei Huiyu Wang Wei Shen Cihang Xie Alan Yuille Tao Kong 92 744 0 15 Nov 2021
Attention Mechanisms in Computer Vision: A Survey Meng-Hao Guo Tianhan Xu Jiangjiang Liu Zheng-Ning Liu Peng-Tao Jiang Tai-Jiang Mu Song-Hai Zhang Ralph Robert Martin Ming-Ming Cheng Shimin Hu 142 1,735 0 15 Nov 2021
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 507 7,865 0 11 Nov 2021
Unsupervised Part Discovery from Contrastive Reconstruction Subhabrata Choudhury Iro Laina Christian Rupprecht Andrea Vedaldi OCL SSL 239 62 0 11 Nov 2021
A Survey of Visual Transformers Yang Liu Yao Zhang Yixin Wang Feng Hou Jin Yuan Jiang Tian Yang Zhang Zhongchao Shi Jianping Fan Zhiqiang He 3DGS ViT 189 356 0 11 Nov 2021
A Relational Model for One-Shot Classification Arturs Polis Alexander Ilin BDL VLM 48 1 0 08 Nov 2021
Augmentations in Graph Contrastive Learning: Current Methodological Flaws & Towards Better Practices Puja Trivedi Ekdeep Singh Lubana Yujun Yan Yaoqing Yang Danai Koutra 85 55 0 05 Nov 2021
PatchGame: Learning to Signal Mid-level Patches in Referential Games Kamal Gupta Gowthami Somepalli Anubhav Gupta Vinoj Jayasundara Matthias Zwicker Abhinav Shrivastava 74 4 0 02 Nov 2021
Learning Co-segmentation by Segment Swapping for Retrieval and Discovery Xi Shen Alexei A. Efros Armand Joulin Mathieu Aubry 68 11 0 29 Oct 2021
Equivariant Contrastive Learning Rumen Dangovski Li Jing Charlotte Loh Seung-Jun Han Akash Srivastava Brian Cheung Pulkit Agrawal Marin Soljacic 96 79 0 28 Oct 2021
Blending Anti-Aliasing into Vision Transformer Shengju Qian Hao Shao Yi Zhu Mu Li Jiaya Jia 109 21 0 28 Oct 2021
Intermediate Layers Matter in Momentum Contrastive Self Supervised Learning Aakash Kaku Sahana Upadhya N. Razavian SSL 86 29 0 27 Oct 2021
A Survey of Self-Supervised and Few-Shot Object Detection Gabriel Huang I. Laradji David Vazquez Simon Lacoste-Julien Pau Rodríguez López ObjD 109 80 0 27 Oct 2021
DreamerPro: Reconstruction-Free Model-Based Reinforcement Learning with Prototypical Representations Fei Deng Ingook Jang Sungjin Ahn VLM 79 62 0 27 Oct 2021
Self-supervised similarity search for large scientific datasets G. Stein P. Harrington Jacqueline Blaum Tomislav Medan Z. Lukić 63 21 0 25 Oct 2021