v1v2 (latest)

Emerging Properties in Self-Supervised Vision Transformers

29 April 2021

Papers citing "Emerging Properties in Self-Supervised Vision Transformers"

50 / 4,175 papers shown

Title
Unsupervised Semantic Segmentation with Self-supervised Object-centric Representations Andrii Zadaianchuk Matthaeus Kleindessner Yi Zhu Francesco Locatello Thomas Brox 130 53 0 11 Jul 2022
Consistency is the key to further mitigating catastrophic forgetting in continual learning Prashant Shivaram Bhat Bahram Zonooz Elahe Arani CLL 63 17 0 11 Jul 2022
A clinically motivated self-supervised approach for content-based image retrieval of CT liver images Kristoffer Wickstrøm Eirik Agnalt Ostmo Keyur Radiya Karl Øyvind Mikalsen Michael C. Kampffmeyer Robert Jenssen SSL 92 16 0 11 Jul 2022
Facilitated machine learning for image-based fruit quality assessment Manuel Knott Fernando Perez-Cruz T. Defraeye 37 51 0 10 Jul 2022
Self-supervised Learning with Local Contrastive Loss for Detection and Semantic Segmentation Ashraful Islam Bengt Lundell H. Sawhney Sudipta N. Sinha Peter Morales Richard J. Radke SSL 87 11 0 10 Jul 2022
Radiomics-Guided Global-Local Transformer for Weakly Supervised Pathology Localization in Chest X-Rays Yan Han G. Holste Ying Ding Ahmed H. Tewfik Yifan Peng Zhangyang Wang LM&MA ViT 124 16 0 10 Jul 2022
Training Transformers Together Alexander Borzunov Max Ryabinin Tim Dettmers Quentin Lhoest Lucile Saulnier Michael Diskin Yacine Jernite Thomas Wolf ViT 63 10 0 07 Jul 2022
LASSIE: Learning Articulated Shapes from Sparse Image Ensemble via 3D Part Discovery Chunfeng Yao Wei-Chih Hung Yuanzhen Li Michael Rubinstein Ming-Hsuan Yang Varun Jampani 3DV 111 51 0 07 Jul 2022
Contrastive Learning from Spatio-Temporal Mixed Skeleton Sequences for Self-Supervised Skeleton-Based Action Recognition Zhan Chen Hong Liu Tianyu Guo Zhengyang Chen Pinhao Song Haoling Tang SSL 78 20 0 07 Jul 2022
Vision Transformers: State of the Art and Research Challenges Bo-Kai Ruan Hong-Han Shuai Wen-Huang Cheng ViT 70 18 0 07 Jul 2022
Not All Models Are Equal: Predicting Model Transferability in a Self-challenging Fisher Space Wenqi Shao Xun Zhao Yixiao Ge Zhaoyang Zhang Lei Yang Xiaogang Wang Ying Shan Ping Luo 81 26 0 07 Jul 2022
Segmenting Moving Objects via an Object-Centric Layered Representation Jun Xie Weidi Xie Andrew Zisserman VOS OCL 100 49 0 05 Jul 2022
Open-Vocabulary Multi-Label Classification via Multi-Modal Knowledge Transfer Su He Taian Guo Tao Dai Ruizhi Qiao Bo Ren Shutao Xia VLM 147 50 0 05 Jul 2022
Dynamic Contrastive Distillation for Image-Text Retrieval Jun Rao Liang Ding Shuhan Qi Meng Fang Yang Liu Liqiong Shen Dacheng Tao VLM 112 33 0 04 Jul 2022
A Survey on Label-efficient Deep Image Segmentation: Bridging the Gap between Weak Supervision and Dense Prediction Wei Shen Zelin Peng Xuehui Wang Huayu Wang Jiazhong Cen Dongsheng Jiang Lingxi Xie Xiaokang Yang Qi Tian VLM 114 84 0 04 Jul 2022
Masked Autoencoder for Self-Supervised Pre-training on Lidar Point Clouds Georg Hess Johan Jaxing Elias Svensson David Hagerman Christoffer Petersson Lennart Svensson 3DPC ViT 115 36 0 01 Jul 2022
Dissecting Self-Supervised Learning Methods for Surgical Computer Vision Sanat Ramesh V. Srivastav Deepak Alapatt Tong Yu Aditya Murali ... Saurav Sharma A. Fleurentin Georgios Exarchakis Alexandros Karargyris N. Padoy 129 46 0 01 Jul 2022
Visual Pre-training for Navigation: What Can We Learn from Noise? Yanwei Wang Ching-Yun Ko Pulkit Agrawal SSL 83 7 0 30 Jun 2022
No Reason for No Supervision: Improved Generalization in Supervised Models Mert Bulent Sariyildiz Yannis Kalantidis Alahari Karteek Diane Larlus SSL OOD LRM 87 29 0 30 Jun 2022
Deep Reinforcement Learning with Swin Transformers Li Meng Morten Goodwin Anis Yazidi P. Engelstad ViT 97 2 0 30 Jun 2022
Teach me how to Interpolate a Myriad of Embeddings Shashanka Venkataramanan Ewa Kijak Laurent Amsaleg Yannis Avrithis 84 2 0 29 Jun 2022
Masked World Models for Visual Control Younggyo Seo Danijar Hafner Hao Liu Fangchen Liu Stephen James Kimin Lee Pieter Abbeel OffRL 177 149 0 28 Jun 2022
SSL-Lanes: Self-Supervised Learning for Motion Forecasting in Autonomous Driving Prarthana Bhattacharyya Chengjie Huang Krzysztof Czarnecki SSL 126 57 0 28 Jun 2022
Reducing Annotation Need in Self-Explanatory Models for Lung Nodule Diagnosis Jiahao Lu Chong Yin Oswin Krause Kenny Erleben M. B. Nielsen S. Darkner MedIm 77 3 0 27 Jun 2022
Guillotine Regularization: Why removing layers is needed to improve generalization in Self-Supervised Learning Florian Bordes Randall Balestriero Q. Garrido Adrien Bardes Pascal Vincent 115 24 0 27 Jun 2022
Self-supervised Learning in Remote Sensing: A Review Yi Wang C. Albrecht Nassim Ait Ali Braham Lichao Mou Xiao Xiang Zhu 159 228 0 27 Jun 2022
Vision Transformer for Contrastive Clustering Hua-Bao Ling Bo Zhu Dong Huang Dingfan Chen Changdong Wang Jianhuang Lai ViT 35 3 0 26 Jun 2022
Exploiting Transformation Invariance and Equivariance for Self-supervised Sound Localisation Jinxian Liu Chen Ju Weidi Xie Ya Zhang 68 39 0 26 Jun 2022
ZSON: Zero-Shot Object-Goal Navigation using Multimodal Goal Embeddings Arjun Majumdar Gunjan Aggarwal Bhavika Devnani Judy Hoffman Dhruv Batra LM&Ro 213 163 0 24 Jun 2022
NovelCraft: A Dataset for Novelty Detection and Discovery in Open Worlds Patrick Feeney Sarah Schneider Panagiotis Lymperopoulos Liping Liu matthias. scheutz Michael C. Hughes Dept. of Computer Science 72 6 0 23 Jun 2022
ProtoCLIP: Prototypical Contrastive Language Image Pretraining Delong Chen Zhao Wu Fan Liu Zaiquan Yang Huaxi Huang Ying Tan Erjin Zhou VLM CLIP 97 28 0 22 Jun 2022
SCIM: Simultaneous Clustering, Inference, and Mapping for Open-World Semantic Scene Understanding Hermann Blum M. Müller Abel Gawel Roland Siegwart Cesar Cadena LM&Ro 74 4 0 21 Jun 2022
SemMAE: Semantic-Guided Masking for Learning Masked Autoencoders Gang Li Heliang Zheng Daqing Liu Chaoyue Wang Fuchun Sun Changwen Zheng 119 130 0 21 Jun 2022
Visualizing and Understanding Contrastive Learning Fawaz Sammani Boris Joukovsky Nikos Deligiannis SSL FAtt 81 9 0 20 Jun 2022
StudioGAN: A Taxonomy and Benchmark of GANs for Image Synthesis Minguk Kang Joonghyuk Shin Jaesik Park EGVM 66 70 0 19 Jun 2022
EATFormer: Improving Vision Transformer Inspired by Evolutionary Algorithm Jiangning Zhang Xiangtai Li Yabiao Wang Chengjie Wang Yibo Yang Yong Liu Dacheng Tao ViT 121 35 0 19 Jun 2022
Model-Agnostic Few-Shot Open-Set Recognition Malik Boudiaf Etienne Bennequin Myriam Tami C´eline Hudelot Antoine Toubhans Pablo Piantanida Ismail Ben Ayed BDL 107 1 0 18 Jun 2022
Replacing Labeled Real-image Datasets with Auto-generated Contours Hirokatsu Kataoka Ryo Hayamizu Ryosuke Yamada Kodai Nakashima Sora Takashima Xinyu Zhang Edgar Josafat Martinez-Noriega Nakamasa Inoue Rio Yokota 53 26 0 18 Jun 2022
SimA: Simple Softmax-free Attention for Vision Transformers Soroush Abbasi Koohpayegani Hamed Pirsiavash 92 26 0 17 Jun 2022
Rarity Score : A New Metric to Evaluate the Uncommonness of Synthesized Images Jiyeon Han Hwanil Choi Yunjey Choi Jae Hyun Kim Jung-Woo Ha Jaesik Choi EGVM 112 33 0 17 Jun 2022
OmniMAE: Single Model Masked Pretraining on Images and Videos Rohit Girdhar Alaaeldin El-Nouby Mannat Singh Kalyan Vasudev Alwala Armand Joulin Ishan Misra ViT 114 99 0 16 Jun 2022
Beyond Supervised vs. Unsupervised: Representative Benchmarking and Analysis of Image Representation Learning M. Gwilliam Abhinav Shrivastava SSL 138 21 1 16 Jun 2022
iBoot: Image-bootstrapped Self-Supervised Video Representation Learning F. Saleh Fuwen Tan Adrian Bulat Georgios Tzimiropoulos Brais Martínez SSL 99 1 0 16 Jun 2022
Adapting Self-Supervised Vision Transformers by Probing Attention-Conditioned Masking Consistency Viraj Prabhu Sriram Yenamandra Aaditya K. Singh Judy Hoffman 64 15 0 16 Jun 2022
Evaluating Self-Supervised Learning for Molecular Graph Embeddings Hanchen Wang Jean Kaddour Shengchao Liu Jian Tang Joan Lasenby Qi Liu 121 23 0 16 Jun 2022
Patch-level Representation Learning for Self-supervised Vision Transformers Sukmin Yun Hankook Lee Jaehyung Kim Jinwoo Shin ViT 120 68 0 16 Jun 2022
Masked Frequency Modeling for Self-Supervised Visual Pre-Training Jiahao Xie Wei Li Xiaohang Zhan Ziwei Liu Yew-Soon Ong Chen Change Loy 115 74 0 15 Jun 2022
Masked Siamese ConvNets L. Jing Jiachen Zhu Yann LeCun SSL 114 35 0 15 Jun 2022
Write and Paint: Generative Vision-Language Models are Unified Modal Learners Shizhe Diao Wangchunshu Zhou Xinsong Zhang Jiawei Wang MLLM AI4CE 95 17 0 15 Jun 2022
A Simple Data Mixing Prior for Improving Self-Supervised Learning Sucheng Ren Huiyu Wang Zhengqi Gao Shengfeng He Alan Yuille Yuyin Zhou Cihang Xie 51 35 0 15 Jun 2022