Emerging Properties in Self-Supervised Vision Transformers

29 April 2021

Papers citing "Emerging Properties in Self-Supervised Vision Transformers"

50 / 1,249 papers shown

Title
Masked Siamese Networks for Label-Efficient Learning Mahmoud Assran Mathilde Caron Ishan Misra Piotr Bojanowski Florian Bordes Pascal Vincent Armand Joulin Michael G. Rabbat Nicolas Ballas SSL 28 310 0 14 Apr 2022
3D Shuffle-Mixer: An Efficient Context-Aware Vision Learner of Transformer-MLP Paradigm for Dense Prediction in Medical Volume Jianye Pang Cheng Jiang Yihao Chen Jianbo Chang M. Feng Renzhi Wang Jianhua Yao ViT MedIm 28 11 0 14 Apr 2022
Focal Length and Object Pose Estimation via Render and Compare Georgy Ponimatkin Yann Labbé Bryan C. Russell Mathieu Aubry Josef Sivic 27 19 0 11 Apr 2022
Evaluating Vision Transformer Methods for Deep Reinforcement Learning from Pixels Tianxin Tao Daniele Reda M. van de Panne ViT 11 19 0 11 Apr 2022
Representation Learning by Detecting Incorrect Location Embeddings Sepehr Sameni Simon Jenni Paolo Favaro ViT 34 4 0 10 Apr 2022
Particle Video Revisited: Tracking Through Occlusions Using Point Trajectories Adam W. Harley Zhaoyuan Fang Katerina Fragkiadaki 27 160 0 08 Apr 2022
Global Readiness of Language Technology for Healthcare: What would it Take to Combat the Next Pandemic? Ishani Mondal Kabir Ahuja Mohit Jain Jacki O Neil Kalika Bali Monojit Choudhury ELM LM&MA 24 4 0 06 Apr 2022
MultiMAE: Multi-modal Multi-task Masked Autoencoders Roman Bachmann David Mizrahi Andrei Atanov Amir Zamir 35 265 0 04 Apr 2022
BatchFormerV2: Exploring Sample Relationships for Dense Representation Learning Zhi Hou Baosheng Yu Chaoyue Wang Yibing Zhan Dacheng Tao ViT 29 11 0 04 Apr 2022
Dynamic Focus-aware Positional Queries for Semantic Segmentation Haoyu He Jianfei Cai Zizheng Pan Jing Liu Jing Zhang Dacheng Tao Bohan Zhuang 34 17 0 04 Apr 2022
Improving Vision Transformers by Revisiting High-frequency Components Jiawang Bai Liuliang Yuan Shutao Xia Shuicheng Yan Zhifeng Li Wei Liu ViT 16 90 0 03 Apr 2022
SinNeRF: Training Neural Radiance Fields on Complex Scenes from a Single Image Dejia Xu Yi Ding Peihao Wang Zhiwen Fan Humphrey Shi Zhangyang Wang 34 187 0 02 Apr 2022
Learnable latent embeddings for joint behavioral and neural analysis Steffen Schneider Jin Hwa Lee Mackenzie W. Mathis 19 207 0 01 Apr 2022
On the Importance of Asymmetry for Siamese Representation Learning Tianlin Li Haoqi Fan Yuandong Tian Daisuke Kihara Xinlei Chen SSL 30 51 0 01 Apr 2022
Self-distillation Augmented Masked Autoencoders for Histopathological Image Classification Yang Luo Zhineng Chen Shengtian Zhou Xieping Gao 31 1 0 31 Mar 2022
Weakly Supervised Patch Label Inference Networks for Efficient Pavement Distress Detection and Recognition in the Wild Sheng Huang Wenhao Tang Guixin Huang Luwen Huangfu Dan Yang 25 7 0 31 Mar 2022
Image-to-Lidar Self-Supervised Distillation for Autonomous Driving Data Corentin Sautier Gilles Puy Spyros Gidaris Alexandre Boulch Andrei Bursuc Renaud Marlet 3DPC 20 117 0 30 Mar 2022
A Style-aware Discriminator for Controllable Image Translation Kunhee Kim S. Park Eunyeong Jeon Tae-Hyeon Kim Daijin Kim 38 24 0 29 Mar 2022
mc-BEiT: Multi-choice Discretization for Image BERT Pre-training Xiaotong Li Yixiao Ge Kun Yi Zixuan Hu Ying Shan Ling-yu Duan 37 38 0 29 Mar 2022
Learning Where to Learn in Cross-View Self-Supervised Learning Lang Huang Shan You Mingkai Zheng Fei Wang Chao Qian T. Yamasaki SSL 25 41 0 28 Mar 2022
Large-scale Bilingual Language-Image Contrastive Learning ByungSoo Ko Geonmo Gu VLM 32 14 0 28 Mar 2022
Locality-Aware Inter-and Intra-Video Reconstruction for Self-Supervised Correspondence Learning Liulei Li Tianfei Zhou Wenguan Wang Lu Yang Jian-Wei Li Yi Yang SSL 30 47 0 27 Mar 2022
Towards Discriminative Representation: Multi-view Trajectory Contrastive Learning for Online Multi-object Tracking En Yu Zhuoling Li Shoudong Han 44 44 0 27 Mar 2022
Semantic Segmentation by Early Region Proxy Yifan Zhang Bo Pang Cewu Lu ViT 52 29 0 26 Mar 2022
Unsupervised Salient Object Detection with Spectral Cluster Voting Gyungin Shin Samuel Albanie Weidi Xie 24 65 0 23 Mar 2022
VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Training Zhan Tong Yibing Song Jue Wang Limin Wang ViT 137 1,129 0 23 Mar 2022
Interpretable Prediction of Lung Squamous Cell Carcinoma Recurrence With Self-supervised Learning Weicheng Zhu C. Fernandez‐Granda N. Razavian SSL 16 4 0 23 Mar 2022
CP2: Copy-Paste Contrastive Pretraining for Semantic Segmentation Feng Wang Huiyu Wang Chen Wei Alan Yuille Wei Shen SSL VLM 25 35 0 22 Mar 2022
Hyperbolic Vision Transformers: Combining Improvements in Metric Learning Aleksandr Ermolov L. Mirvakhabova Valentin Khrulkov N. Sebe Ivan V. Oseledets 25 100 0 21 Mar 2022
Attribute Surrogates Learning and Spectral Tokens Pooling in Transformers for Few-shot Learning Yang He Weihan Liang Dongyang Zhao Hong-Yu Zhou Weifeng Ge Yizhou Yu Wenqiang Zhang ViT 30 45 0 17 Mar 2022
Object discovery and representation networks Olivier J. Hénaff Skanda Koppula Evan Shelhamer Daniel Zoran Andrew Jaegle Andrew Zisserman João Carreira Relja Arandjelović 44 87 0 16 Mar 2022
Pushing the limits of raw waveform speaker recognition Jee-weon Jung You Jin Kim Hee-Soo Heo Bong-Jin Lee Youngki Kwon Joon Son Chung 31 87 0 16 Mar 2022
Bamboo: Building Mega-Scale Vision Dataset Continually with Human-Machine Synergy Yuanhan Zhang Qi Sun Yichun Zhou Zexin He Zhen-fei Yin Kunze Wang Lu Sheng Yu Qiao Jing Shao Ziwei Liu ObjD VLM 32 19 0 15 Mar 2022
Active Learning by Feature Mixing Amin Parvaneh Ehsan Abbasnejad Damien Teney Reza Haffari Anton Van Den Hengel Javen Qinfeng Shi 32 89 0 14 Mar 2022
SimMatch: Semi-supervised Learning with Similarity Matching Mingkai Zheng Shan You Lang Huang Fei Wang Chao Qian Chang Xu 41 171 0 14 Mar 2022
RecursiveMix: Mixed Learning with History Lingfeng Yang Xiang Li Borui Zhao Renjie Song Jian Yang VLM 29 18 0 14 Mar 2022
Scaling Up Your Kernels to 31x31: Revisiting Large Kernel Design in CNNs Xiaohan Ding Xinming Zhang Yi Zhou Jungong Han Guiguang Ding Jian Sun VLM 49 528 0 13 Mar 2022
Sparse Subspace Clustering for Concept Discovery (SSCCD) Johanna Vielhaben Stefan Blücher Nils Strodthoff 23 6 0 11 Mar 2022
Towards Self-Supervised Learning of Global and Object-Centric Representations Federico Baldassarre Hossein Azizpour SSL 3DPC OCL 35 13 0 11 Mar 2022
MVP: Multimodality-guided Visual Pre-training Longhui Wei Lingxi Xie Wen-gang Zhou Houqiang Li Qi Tian 28 106 0 10 Mar 2022
Monocular Robot Navigation with Self-Supervised Pretrained Vision Transformers Miguel A. Saavedra-Ruiz Sacha Morin Liam Paull MDE ViT 35 3 0 07 Mar 2022
Self-supervised learning for analysis of temporal and morphological drug effects in cancer cell imaging data A. Dmitrenko M. M. Masiero N. Zamboni MedIm 19 8 0 07 Mar 2022
Multi-class Token Transformer for Weakly Supervised Semantic Segmentation Lian Xu Wanli Ouyang Bennamoun F. Boussaïd Dan Xu ViT 31 209 0 06 Mar 2022
A Large-scale Comprehensive Dataset and Copy-overlap Aware Evaluation Protocol for Segment-level Video Copy Detection Sifeng He Xudong Yang Chenhan Jiang Gang Liang Wei Zhang ... Kaiming Huang Yuan Cheng Feng Qian Xiaobo Zhang Lei Yang 17 12 0 05 Mar 2022
DiT: Self-supervised Pre-training for Document Image Transformer Junlong Li Yiheng Xu Tengchao Lv Lei Cui Chaoxi Zhang Furu Wei ViT VLM 35 159 0 04 Mar 2022
Measuring Self-Supervised Representation Quality for Downstream Classification using Discriminative Features N. Kalibhat Kanika Narang Hamed Firooz Maziar Sanjabi S. Feizi SSL 38 7 0 03 Mar 2022
What Makes Transfer Learning Work For Medical Images: Feature Reuse & Other Factors Christos Matsoukas Johan Fredin Haslum Moein Sorkhei Magnus P Soderberg Kevin Smith VLM OOD MedIm 27 85 0 02 Mar 2022
CrossPoint: Self-Supervised Cross-Modal Contrastive Learning for 3D Point Cloud Understanding Mohamed Afham Isuru Dissanayake Dinithi Dissanayake Amaya Dharmasiri Kanchana Thilakarathna Ranga Rodrigo 3DPC 16 251 0 01 Mar 2022
TRILLsson: Distilled Universal Paralinguistic Speech Representations Joel Shor Subhashini Venugopalan 25 37 0 01 Mar 2022
Multi-modal Alignment using Representation Codebook Jiali Duan Liqun Chen Son Tran Jinyu Yang Yi Xu Belinda Zeng Trishul Chilimbi 33 66 0 28 Feb 2022