v1v2 (latest)

Emerging Properties in Self-Supervised Vision Transformers

29 April 2021

Papers citing "Emerging Properties in Self-Supervised Vision Transformers"

50 / 4,175 papers shown

Title
The Curious Case of Benign Memorization Sotiris Anagnostidis Gregor Bachmann Lorenzo Noci Thomas Hofmann AAML 132 10 0 25 Oct 2022
Foreground Guidance and Multi-Layer Feature Fusion for Unsupervised Object Discovery with Transformers Zhiwei Lin Ze Yang Yongtao Wang ViT 83 2 0 24 Oct 2022
Delving into Masked Autoencoders for Multi-Label Thorax Disease Classification Junfei Xiao Yutong Bai Alan Yuille Zongwei Zhou MedIm ViT 82 62 0 23 Oct 2022
Adversarial Pretraining of Self-Supervised Deep Networks: Past, Present and Future Guo-Jun Qi M. Shah SSL 78 8 0 23 Oct 2022
Rethinking Rotation in Self-Supervised Contrastive Learning: Adaptive Positive or Negative Data Augmentation Atsuyuki Miyai Qing Yu Daiki Ikami Go Irie Kiyoharu Aizawa SSL 91 5 0 23 Oct 2022
Neural Eigenfunctions Are Structured Representation Learners Zhijie Deng Jiaxin Shi Hao Zhang Peng Cui Cewu Lu Jun Zhu 109 14 0 23 Oct 2022
Accumulated Trivial Attention Matters in Vision Transformers on Small Datasets Xiangyu Chen Qinghao Hu Kaidong Li Cuncong Zhong Guanghui Wang ViT 81 13 0 22 Oct 2022
Boosting vision transformers for image retrieval Chull Hwan Song Jooyoung Yoon Shunghyun Choi Yannis Avrithis ViT 117 33 0 21 Oct 2022
Unsupervised Image Semantic Segmentation through Superpixels and Graph Neural Networks Moshe Eliasof Nir Ben Zikri Eran Treister SSL GNN 71 4 0 21 Oct 2022
Self-Supervised Learning via Maximum Entropy Coding Xin Liu Zhongdao Wang Yali Li Shengjin Wang SSL 134 43 0 20 Oct 2022
MixMask: Revisiting Masking Strategy for Siamese ConvNets Kirill Vishniakov Eric P. Xing Zhiqiang Shen 37 0 0 20 Oct 2022
Self-Supervised Learning with Masked Image Modeling for Teeth Numbering, Detection of Dental Restorations, and Instance Segmentation in Dental Panoramic Radiographs A. Almalki Longin Jan Latecki MedIm 36 16 0 20 Oct 2022
On Feature Learning in the Presence of Spurious Correlations Pavel Izmailov Polina Kirichenko Nate Gruver A. Wilson 127 129 0 20 Oct 2022
SS-VAERR: Self-Supervised Apparent Emotional Reaction Recognition from Video Marija Jegorova Stavros Petridis Maja Pantic 66 2 0 20 Oct 2022
Towards Sustainable Self-supervised Learning Shanghua Gao Pan Zhou Mingg-Ming Cheng Shuicheng Yan CLL 127 7 0 20 Oct 2022
Visual-Semantic Contrastive Alignment for Few-Shot Image Classification Mohamed Afham Ranga Rodrigo VLM 142 5 0 20 Oct 2022
SSiT: Saliency-guided Self-supervised Image Transformer for Diabetic Retinopathy Grading Yijin Huang Junyan Lyu Pujin Cheng Roger Tam Xiaoying Tang ViT MedIm 100 20 0 20 Oct 2022
Anomaly Detection Requires Better Representations Tal Reiss Niv Cohen Eliahu Horwitz Ron Abutbul Yedid Hoshen OOD AI4TS SSL 129 21 0 19 Oct 2022
CroCo: Self-Supervised Pre-training for 3D Vision Tasks by Cross-View Completion Philippe Weinzaepfel Vincent Leroy Thomas Lucas Romain Brégier Yohann Cabon Vaibhav Arora L. Antsfeld Boris Chidlovskii G. Csurka Jérôme Revaud SSL 138 73 0 19 Oct 2022
A Unified View of Masked Image Modeling Zhiliang Peng Li Dong Hangbo Bao QiXiang Ye Furu Wei VLM 133 38 0 19 Oct 2022
Effective Targeted Attacks for Adversarial Self-Supervised Learning Minseon Kim Hyeonjeong Ha Sooel Son Sung Ju Hwang AAML 75 3 0 19 Oct 2022
LAVA: Label-efficient Visual Learning and Adaptation Islam Nassar Munawar Hayat Ehsan Abbasnejad Hamid Rezatofighi Mehrtash Harandi Gholamreza Haffari VLM 83 1 0 19 Oct 2022
Perceptual Grouping in Contrastive Vision-Language Models Kanchana Ranasinghe Brandon McKinzie S. S. Ravi Yinfei Yang Alexander Toshev Jonathon Shlens VLM 131 55 0 18 Oct 2022
FIMP: Foundation Model-Informed Message Passing for Graph Neural Networks S. Rizvi Nazreen Pallikkavaliyaveetil David Zhang Zhuoyang Lyu Nhi Nguyen ... Amin Karbasi Rex Ying Maria Brbić Rahul M. Dhodapkar David van Dijk GNN AI4CE 23 1 0 17 Oct 2022
Multiple Instance Learning via Iterative Self-Paced Supervised Contrastive Learning Kangning Liu Weicheng Zhu Yiqiu Shen Sheng Liu N. Razavian Krzysztof J. Geras C. Fernandez‐Granda SSL 103 25 0 17 Oct 2022
Non-Contrastive Learning Meets Language-Image Pre-Training Jinghao Zhou Li Dong Zhe Gan Lijuan Wang Furu Wei VLM CLIP 75 26 0 17 Oct 2022
Improving Contrastive Learning on Visually Homogeneous Mars Rover Images I. Ward Charles Moore Kai Pak Jingdao Chen Edwin Y. Goh SSL 48 2 0 17 Oct 2022
Histopathological Image Classification based on Self-Supervised Vision Transformer and Weak Labels A. Gul Ozdemir Cetin Christoph Reich Tim Prangemeier Nadine Flinner Heinz Koeppl ViT MedIm 63 11 0 17 Oct 2022
Improving Object-centric Learning with Query Optimization Baoxiong Jia Yu Liu Siyuan Huang OCL 97 52 0 17 Oct 2022
Approximating Continuous Convolutions for Deep Network Compression Theo W. Costain V. Prisacariu 66 0 0 17 Oct 2022
Continuous Pseudo-Labeling from the Start Dan Berrebbi R. Collobert Samy Bengio Navdeep Jaitly Tatiana Likhomanenko 65 16 0 17 Oct 2022
Learning Self-Regularized Adversarial Views for Self-Supervised Vision Transformers Tao Tang Changlin Li Guangrun Wang Kaicheng Yu Xiaojun Chang Xiaodan Liang ViT 70 1 0 16 Oct 2022
Self-Distillation for Unsupervised 3D Domain Adaptation Adriano Cardace Riccardo Spezialetti Pierluigi Zama Ramirez Samuele Salti Luigi Di Stefano 3DPC 65 16 0 15 Oct 2022
MOVE: Unsupervised Movable Object Segmentation and Detection Adam Bielski Paolo Favaro OCL 63 21 0 14 Oct 2022
CAP: Correlation-Aware Pruning for Highly-Accurate Sparse Vision Models Denis Kuznedelev Eldar Kurtic Elias Frantar Dan Alistarh VLM ViT 76 13 0 14 Oct 2022
Vision Transformers provably learn spatial structure Samy Jelassi Michael E. Sander Yuan-Fang Li ViT MLT 100 83 0 13 Oct 2022
The Hidden Uniform Cluster Prior in Self-Supervised Learning Mahmoud Assran Randall Balestriero Quentin Duval Florian Bordes Ishan Misra Piotr Bojanowski Pascal Vincent Michael G. Rabbat Nicolas Ballas SSL 96 50 0 13 Oct 2022
How to Train Vision Transformer on Small-scale Datasets? Hanan Gani Muzammal Naseer Mohammad Yaqub ViT 70 51 0 13 Oct 2022
Unified Vision and Language Prompt Learning Yuhang Zang Wei Li Kaiyang Zhou Chen Huang Chen Change Loy VLM VPVLM 80 151 0 13 Oct 2022
Exploring Long-Sequence Masked Autoencoders Ronghang Hu Shoubhik Debnath Saining Xie Xinlei Chen 54 18 0 13 Oct 2022
Self-Supervised Geometric Correspondence for Category-Level 6D Object Pose Estimation in the Wild Kaifeng Zhang Yang Fu Shubhankar Borse H. Cai Fatih Porikli Xinyu Wang SSL 3DPC 137 26 0 13 Oct 2022
Self-Guided Diffusion Models Vincent Tao Hu David W. Zhang Yuki M. Asano Gertjan J. Burghouts Cees G. M. Snoek 126 33 0 12 Oct 2022
ACSeg: Adaptive Conceptualization for Unsupervised Semantic Segmentation Kehan Li Zhennan Wang Ze-Long Cheng Runyi Yu Yian Zhao Guoli Song Chang Liu Li-ming Yuan Jie Chen 103 38 0 12 Oct 2022
SaiT: Sparse Vision Transformers through Adaptive Token Pruning Ling Li D. Thorsley Joseph Hassoun ViT 41 19 0 11 Oct 2022
OPERA: Omni-Supervised Representation Learning with Hierarchical Supervisions Cheng-Hao Wang Wenzhao Zheng Zhengbiao Zhu Jie Zhou Jiwen Lu SSL AI4TS 98 4 0 11 Oct 2022
Meta-Learning with Self-Improving Momentum Target Jihoon Tack Jongjin Park Hankook Lee Jaeho Lee Jinwoo Shin LRM 126 12 0 11 Oct 2022
Visual Prompt Tuning for Test-time Domain Adaptation Yunhe Gao Xingjian Shi Yi Zhu Hongya Wang Zhiqiang Tang Xiong Zhou Mu Li Dimitris N. Metaxas VPVLM VLM 176 89 0 10 Oct 2022
4D Unsupervised Object Discovery Yu-Quan Wang Yuntao Chen Zhaoxiang Zhang 3DPC 112 20 0 10 Oct 2022
A Memory Transformer Network for Incremental Learning Ahmet Iscen Thomas Bird Mathilde Caron Alireza Fathi Cordelia Schmid CLL 162 14 0 10 Oct 2022
Learning to Decompose Visual Features with Latent Textual Prompts Feng Wang Manling Li Xudong Lin Hairong Lv Alex Schwing Heng Ji VLM 103 25 0 09 Oct 2022