Emerging Properties in Self-Supervised Vision Transformers

29 April 2021

Papers citing "Emerging Properties in Self-Supervised Vision Transformers"

50 / 1,258 papers shown

Title
Instance-Dependent Noisy Label Learning via Graphical Modelling Arpit Garg Cuong C. Nguyen Rafael Felix Thanh-Toan Do G. Carneiro NoLa 37 27 0 02 Sep 2022
TokenCut: Segmenting Objects in Images and Videos with Self-supervised Transformer and Normalized Cut Yangtao Wang Xiaoke Shen Yuan. Yuan Yuming Du Maomao Li S. Hu James L. Crowley Dominique Vaufreydaz VOS ViT 27 76 0 01 Sep 2022
Open-Set Semi-Supervised Object Detection Yen-Cheng Liu Chih-Yao Ma Xiaoliang Dai Junjiao Tian Peter Vajda Zijian He Z. Kira 21 22 0 29 Aug 2022
MaskCLIP: Masked Self-Distillation Advances Contrastive Language-Image Pretraining Xiaoyi Dong Jianmin Bao Yinglin Zheng Ting Zhang Dongdong Chen ... Weiming Zhang Lu Yuan Dong Chen Fang Wen Nenghai Yu CLIP VLM 54 158 0 25 Aug 2022
Masked Autoencoders Enable Efficient Knowledge Distillers Yutong Bai Zeyu Wang Junfei Xiao Chen Wei Huiyu Wang Alan Yuille Yuyin Zhou Cihang Xie CLL 32 39 0 25 Aug 2022
Refine and Represent: Region-to-Object Representation Learning Akash Gokul Konstantinos Kallidromitis Shufang Li Yu Kato Kazuki Kozuka Trevor Darrell Colorado Reed SSeg 31 5 0 25 Aug 2022
Transfer Learning Application of Self-supervised Learning in ARPES S. Ekahana Genta Indra Winata Y. Soh G. Aeppli Radovic Milan Mingzhi Shi 20 5 0 23 Aug 2022
Patient-level Microsatellite Stability Assessment from Whole Slide Images By Combining Momentum Contrast Learning and Group Patch Embeddings D. Shats Hadar Hezi Guy Shani Y. Maruvka Moti Freiman 24 2 0 22 Aug 2022
Net2Brain: A Toolbox to compare artificial vision models with human brain responses Domenic Bersch Kshitij Dwivedi Martina Vilas Radoslaw Martin Cichy Gemma Roig 28 5 0 20 Aug 2022
Towards Label-efficient Automatic Diagnosis and Analysis: A Comprehensive Survey of Advanced Deep Learning-based Weakly-supervised, Semi-supervised and Self-supervised Techniques in Histopathological Image Analysis Linhao Qu Siyu Liu Xiaoyu Liu Manning Wang Zhijian Song 25 56 0 18 Aug 2022
Toward Interpretable Sleep Stage Classification Using Cross-Modal Transformers Jathurshan Pradeepkumar Mithunjha Anandakumar Vinith Kugathasan Dhinesh Suntharalingham S. L. Kappel A. D. Silva Chamira U. S. Edussooriya 31 31 0 15 Aug 2022
RenyiCL: Contrastive Representation Learning with Skew Renyi Divergence Kyungmin Lee Jinwoo Shin SSL DRL 29 10 0 12 Aug 2022
On the Pros and Cons of Momentum Encoder in Self-Supervised Visual Representation Learning T. Pham Chaoning Zhang Axi Niu Kang Zhang Chang D. Yoo 36 11 0 11 Aug 2022
Non-Contrastive Self-supervised Learning for Utterance-Level Information Extraction from Speech Jaejin Cho Jesús Villalba Laureano Moro Velázquez Najim Dehak SSL 36 16 0 10 Aug 2022
How Well Do Vision Transformers (VTs) Transfer To The Non-Natural Image Domain? An Empirical Study Involving Art Classification Vincent Tonkes M. Sabatelli ViT 27 6 0 09 Aug 2022
Analyzing Data-Centric Properties for Graph Contrastive Learning Puja Trivedi Ekdeep Singh Lubana Mark Heimann Danai Koutra Jayaraman J. Thiagarajan 30 11 0 04 Aug 2022
OpenCon: Open-world Contrastive Learning Yiyou Sun Yixuan Li VLM SSL DRL 52 39 0 04 Aug 2022
MVSFormer: Multi-View Stereo by Learning Robust Image Features and Temperature-based Depth Chenjie Cao Xinlin Ren Yanwei Fu 31 46 0 04 Aug 2022
Automatically Discovering Novel Visual Categories with Self-supervised Prototype Learning Lu Zhang Lu Qi Xu Yang Hong Qiao Ming Yang Zhiyong Liu SSL 38 3 0 01 Aug 2022
SdAE: Self-distillated Masked Autoencoder Yabo Chen Yuchen Liu Dongsheng Jiang Xiaopeng Zhang Wenrui Dai H. Xiong Qi Tian ViT 26 70 0 31 Jul 2022
A Survey on Masked Autoencoder for Self-supervised Learning in Vision and Beyond Chaoning Zhang Chenshuang Zhang Junha Song John Seon Keun Yi Kang Zhang In So Kweon SSL 57 71 0 30 Jul 2022
ALADIN: Distilling Fine-grained Alignment Scores for Efficient Image-Text Matching and Retrieval Nicola Messina Matteo Stefanini Marcella Cornia Lorenzo Baraldi Fabrizio Falchi Giuseppe Amato Rita Cucchiara VLM 16 21 0 29 Jul 2022
Self-supervised learning with rotation-invariant kernels Léon Zheng Gilles Puy E. Riccietti Patrick Pérez Rémi Gribonval SSL 19 2 0 28 Jul 2022
Contrastive Masked Autoencoders are Stronger Vision Learners Zhicheng Huang Xiaojie Jin Cheng Lu Qibin Hou Mingg-Ming Cheng Dongmei Fu Xiaohui Shen Jiashi Feng 50 148 0 27 Jul 2022
Exploring the Design of Adaptation Protocols for Improved Generalization and Machine Learning Safety Puja Trivedi Danai Koutra Jayaraman J. Thiagarajan AAML 28 0 0 26 Jul 2022
Active Learning Strategies for Weakly-supervised Object Detection Huy V. Vo Oriane Siméoni Spyros Gidaris Andrei Bursuc Patrick Pérez Jean Ponce 41 19 0 25 Jul 2022
Jigsaw-ViT: Learning Jigsaw Puzzles in Vision Transformer Yingyi Chen Xiaoke Shen Yahui Liu Qinghua Tao Johan A. K. Suykens AAML ViT 28 22 0 25 Jul 2022
High-Resolution Swin Transformer for Automatic Medical Image Segmentation Chen Wei Shenghan Ren Kaitai Guo Haihong Hu Jimin Liang ViT OOD MedIm 22 36 0 23 Jul 2022
Few-Shot Class-Incremental Learning via Entropy-Regularized Data-Free Replay Huan Liu Li Gu Zhixiang Chi Yang Wang Yuanhao Yu Jun Chen Jingshan Tang 33 81 0 22 Jul 2022
Contrastive Self-Supervised Learning Leads to Higher Adversarial Susceptibility Rohit Gupta Naveed Akhtar Ajmal Saeed Mian M. Shah AAML SSL 26 5 0 22 Jul 2022
Towards Efficient Adversarial Training on Vision Transformers Boxi Wu Jindong Gu Zhifeng Li Deng Cai Xiaofei He Wei Liu ViT AAML 46 37 0 21 Jul 2022
On Label Granularity and Object Localization Elijah Cole Kimberly Wilber Grant Van Horn Xuan S. Yang Marco Fornoni Pietro Perona Serge Belongie Andrew G. Howard Oisin Mac Aodha WSOL 30 13 0 20 Jul 2022
Adversarial Pixel Restoration as a Pretext Task for Transferable Perturbations H. Malik Shahina Kunhimon Muzammal Naseer Salman Khan F. Khan AAML 23 8 0 18 Jul 2022
Class-incremental Novel Class Discovery Subhankar Roy Mingxuan Liu Zhun Zhong N. Sebe Elisa Ricci CLL 33 43 0 18 Jul 2022
Position Prediction as an Effective Pretraining Strategy Shuangfei Zhai Navdeep Jaitly Jason Ramapuram Dan Busbridge Tatiana Likhomanenko Joseph Y. Cheng Walter A. Talbott Chen Huang Hanlin Goh J. Susskind ViT 46 23 0 15 Jul 2022
Bootstrapped Masked Autoencoders for Vision BERT Pretraining Xiaoyi Dong Jianmin Bao Ting Zhang Dongdong Chen Weiming Zhang Lu Yuan Dong Chen Fang Wen Nenghai Yu 22 75 0 14 Jul 2022
Wayformer: Motion Forecasting via Simple & Efficient Attention Networks Nigamaa Nayakanti Rami Al-Rfou Aurick Zhou Kratarth Goel Khaled S. Refaat Benjamin Sapp AI4TS 42 235 0 12 Jul 2022
Modality-Aware Contrastive Instance Learning with Self-Distillation for Weakly-Supervised Audio-Visual Violence Detection Jiashuo Yu Jin-Yuan Liu Ying Cheng Rui Feng Yuejie Zhang 19 34 0 12 Jul 2022
Unsupervised Semantic Segmentation with Self-supervised Object-centric Representations Andrii Zadaianchuk Matthaeus Kleindessner Yi Zhu Francesco Locatello Thomas Brox 27 49 0 11 Jul 2022
A clinically motivated self-supervised approach for content-based image retrieval of CT liver images Kristoffer Wickstrøm Eirik Agnalt Ostmo Keyur Radiya Karl Øyvind Mikalsen Michael C. Kampffmeyer Robert Jenssen SSL 23 13 0 11 Jul 2022
Facilitated machine learning for image-based fruit quality assessment Manuel Knott Fernando Perez-Cruz T. Defraeye 19 47 0 10 Jul 2022
Self-supervised Learning with Local Contrastive Loss for Detection and Semantic Segmentation Ashraful Islam Bengt Lundell H. Sawhney Sudipta N. Sinha Peter Morales Richard J. Radke SSL 31 9 0 10 Jul 2022
LASSIE: Learning Articulated Shapes from Sparse Image Ensemble via 3D Part Discovery Chunfeng Yao Wei-Chih Hung Yuanzhen Li Michael Rubinstein Ming Yang Varun Jampani 3DV 34 47 0 07 Jul 2022
Segmenting Moving Objects via an Object-Centric Layered Representation Jun Xie Weidi Xie Andrew Zisserman VOS OCL 28 47 0 05 Jul 2022
Open-Vocabulary Multi-Label Classification via Multi-Modal Knowledge Transfer Su He Taian Guo Tao Dai Ruizhi Qiao Bo Ren Shutao Xia VLM 75 49 0 05 Jul 2022
Masked Autoencoder for Self-Supervised Pre-training on Lidar Point Clouds Georg Hess Johan Jaxing Elias Svensson David Hagerman Christoffer Petersson Lennart Svensson 3DPC ViT 25 33 0 01 Jul 2022
Dissecting Self-Supervised Learning Methods for Surgical Computer Vision Sanat Ramesh V. Srivastav Deepak Alapatt Tong Yu Aditya Murali ... Saurav Sharma A. Fleurentin Georgios Exarchakis Alexandros Karargyris N. Padoy 23 42 0 01 Jul 2022
Teach me how to Interpolate a Myriad of Embeddings Shashanka Venkataramanan Ewa Kijak Laurent Amsaleg Yannis Avrithis 43 2 0 29 Jun 2022
Masked World Models for Visual Control Younggyo Seo Danijar Hafner Hao Liu Fangchen Liu Stephen James Kimin Lee Pieter Abbeel OffRL 93 146 0 28 Jun 2022
SSL-Lanes: Self-Supervised Learning for Motion Forecasting in Autonomous Driving Prarthana Bhattacharyya Chengjie Huang Krzysztof Czarnecki SSL 42 55 0 28 Jun 2022