Emerging Properties in Self-Supervised Vision Transformers

29 April 2021

Papers citing "Emerging Properties in Self-Supervised Vision Transformers"

50 / 1,287 papers shown

Title
cRedAnno+: Annotation Exploitation in Self-Explanatory Lung Nodule Diagnosis Jiahao Lu Chong Yin Kenny Erleben M. B. Nielsen S. Darkner 24 1 0 28 Oct 2022
Open-vocabulary Semantic Segmentation with Frozen Vision-Language Models Chaofan Ma Yu-Hao Yang Yanfeng Wang Ya Zhang Weidi Xie VLM 29 48 0 27 Oct 2022
From colouring-in to pointillism: revisiting semantic segmentation supervision Rodrigo Benenson V. Ferrari VLM 21 18 0 25 Oct 2022
Learning Explicit Object-Centric Representations with Vision Transformers Oscar Vikström Alexander Ilin OCL ViT 38 4 0 25 Oct 2022
On Fine-Tuned Deep Features for Unsupervised Domain Adaptation Qian Wang T. Breckon 30 3 0 25 Oct 2022
The Curious Case of Benign Memorization Sotiris Anagnostidis Gregor Bachmann Lorenzo Noci Thomas Hofmann AAML 49 8 0 25 Oct 2022
Foreground Guidance and Multi-Layer Feature Fusion for Unsupervised Object Discovery with Transformers Zhiwei Lin Ze Yang Yongtao Wang ViT 39 2 0 24 Oct 2022
Delving into Masked Autoencoders for Multi-Label Thorax Disease Classification Junfei Xiao Yutong Bai Alan Yuille Zongwei Zhou MedIm ViT 37 59 0 23 Oct 2022
Adversarial Pretraining of Self-Supervised Deep Networks: Past, Present and Future Guo-Jun Qi M. Shah SSL 23 8 0 23 Oct 2022
Boosting vision transformers for image retrieval Chull Hwan Song Jooyoung Yoon Shunghyun Choi Yannis Avrithis ViT 34 32 0 21 Oct 2022
Unsupervised Image Semantic Segmentation through Superpixels and Graph Neural Networks Moshe Eliasof Nir Ben Zikri Eran Treister SSL GNN 14 3 0 21 Oct 2022
Self-Supervised Learning via Maximum Entropy Coding Xin Liu Zhongdao Wang Yali Li Shengjin Wang SSL 29 40 0 20 Oct 2022
On Feature Learning in the Presence of Spurious Correlations Pavel Izmailov Polina Kirichenko Nate Gruver A. Wilson 36 117 0 20 Oct 2022
SS-VAERR: Self-Supervised Apparent Emotional Reaction Recognition from Video Marija Jegorova Stavros Petridis M. Pantic 24 2 0 20 Oct 2022
Towards Sustainable Self-supervised Learning Shanghua Gao Pan Zhou Mingg-Ming Cheng Shuicheng Yan CLL 48 7 0 20 Oct 2022
SSiT: Saliency-guided Self-supervised Image Transformer for Diabetic Retinopathy Grading Yijin Huang Junyan Lyu Pujin Cheng Roger Tam Xiaoying Tang ViT MedIm 19 20 0 20 Oct 2022
CroCo: Self-Supervised Pre-training for 3D Vision Tasks by Cross-View Completion Philippe Weinzaepfel Vincent Leroy Thomas Lucas Romain Brégier Yohann Cabon Vaibhav Arora L. Antsfeld Boris Chidlovskii G. Csurka Jérôme Revaud SSL 42 64 0 19 Oct 2022
A Unified View of Masked Image Modeling Zhiliang Peng Li Dong Hangbo Bao QiXiang Ye Furu Wei VLM 54 35 0 19 Oct 2022
Effective Targeted Attacks for Adversarial Self-Supervised Learning Minseon Kim Hyeonjeong Ha Sooel Son Sung Ju Hwang AAML 39 3 0 19 Oct 2022
Multiple Instance Learning via Iterative Self-Paced Supervised Contrastive Learning Kangning Liu Weicheng Zhu Yiqiu Shen Sheng Liu N. Razavian Krzysztof J. Geras C. Fernandez‐Granda SSL 28 24 0 17 Oct 2022
Approximating Continuous Convolutions for Deep Network Compression Theo W. Costain V. Prisacariu 36 0 0 17 Oct 2022
Learning Self-Regularized Adversarial Views for Self-Supervised Vision Transformers Tao Tang Changlin Li Guangrun Wang Kaicheng Yu Xiaojun Chang Xiaodan Liang ViT 31 1 0 16 Oct 2022
Self-Supervised Geometric Correspondence for Category-Level 6D Object Pose Estimation in the Wild Kaifeng Zhang Yang Fu Shubhankar Borse H. Cai Fatih Porikli Xinyu Wang SSL 3DPC 47 25 0 13 Oct 2022
SaiT: Sparse Vision Transformers through Adaptive Token Pruning Ling Li D. Thorsley Joseph Hassoun ViT 27 17 0 11 Oct 2022
Visual Prompt Tuning for Test-time Domain Adaptation Yunhe Gao Xingjian Shi Yi Zhu Hongya Wang Zhiqiang Tang Xiong Zhou Mu Li Dimitris N. Metaxas VPVLM VLM 37 82 0 10 Oct 2022
Learning to Decompose Visual Features with Latent Textual Prompts Feng Wang Manling Li Xudong Lin Hairong Lv A. Schwing Heng Ji VLM 19 23 0 09 Oct 2022
MAMO: Masked Multimodal Modeling for Fine-Grained Vision-Language Representation Learning Zijia Zhao Longteng Guo Xingjian He Shuai Shao Zehuan Yuan Jing Liu 21 8 0 09 Oct 2022
Grow and Merge: A Unified Framework for Continuous Categories Discovery Xinwei Zhang Jianwen Jiang Yutong Feng Zhi-Fan Wu Xibin Zhao Hai Wan Mingqian Tang Rong Jin Yue Gao CLL 38 29 0 09 Oct 2022
In What Ways Are Deep Neural Networks Invariant and How Should We Measure This? Henry Kvinge Tegan H. Emerson Grayson Jorgenson Scott Vasquez T. Doster Jesse D. Lew 51 8 0 07 Oct 2022
Bi-directional Weakly Supervised Knowledge Distillation for Whole Slide Image Classification Linhao Qu Xiao-Zhuo Luo Manning Wang Zhijian Song WSOD 26 59 0 07 Oct 2022
EmbryosFormer: Deformable Transformer and Collaborative Encoding-Decoding for Embryos Stage Development Classification Tien-Phat Nguyen Trong-Thang Pham Tri Minh Nguyen Hung Le Dung Nguyen Hau Lam Phong H. Nguyen Jennifer Fowler Minh-Triet Tran Ngan Le ViT 30 13 0 07 Oct 2022
Content-Based Search for Deep Generative Models Daohan Lu Sheng-Yu Wang Nupur Kumari Rohan Agarwal Mia Tang David Bau Jun-Yan Zhu DiffM SyDa 38 5 0 06 Oct 2022
Env-Aware Anomaly Detection: Ignore Style Changes, Stay True to Content! Stefan Smeu Elena Burceanu Andrei Liviu Nicolicioiu Emanuela Haller 35 4 0 06 Oct 2022
Structure Representation Network and Uncertainty Feedback Learning for Dense Non-Uniform Fog Removal Yeying Jin Wending Yan Wenhan Yang R. Tan 39 38 0 06 Oct 2022
Feature-Realistic Neural Fusion for Real-Time, Open Set Scene Understanding Kirill Mazur Edgar Sucar Andrew J. Davison 3DPC AI4CE 96 45 0 06 Oct 2022
Effective Self-supervised Pre-training on Low-compute Networks without Distillation Fuwen Tan F. Saleh Brais Martínez 35 4 0 06 Oct 2022
Active Image Indexing Pierre Fernandez Matthijs Douze Hervé Jégou Teddy Furon VLM 23 9 0 05 Oct 2022
Granularity-aware Adaptation for Image Retrieval over Multiple Tasks Jon Almazán ByungSoo Ko Geonmo Gu Diane Larlus Yannis Kalantidis ObjD VLM 39 7 0 05 Oct 2022
RankMe: Assessing the downstream performance of pretrained self-supervised representations by their rank Q. Garrido Randall Balestriero Laurent Najman Yann LeCun SSL 59 73 0 05 Oct 2022
Relational Proxies: Emergent Relationships as Fine-Grained Discriminators Abhra Chaudhuri Massimiliano Mancini Zeynep Akata Anjan Dutta 23 4 0 05 Oct 2022
Rank-N-Contrast: Learning Continuous Representations for Regression Kaiwen Zha Peng Cao Jeany Son Yuzhe Yang Dina Katabi CML 64 37 0 03 Oct 2022
Improving Sample Quality of Diffusion Models Using Self-Attention Guidance Susung Hong Gyuseong Lee Wooseok Jang Seung Wook Kim DiffM 27 97 0 03 Oct 2022
What shapes the loss landscape of self-supervised learning? Liu Ziyin Ekdeep Singh Lubana Masakuni Ueda Hidenori Tanaka 50 20 0 02 Oct 2022
Learning Hierarchical Image Segmentation For Recognition and By Recognition Tsung-Wei Ke Sangwoo Mo Stella X. Yu VLM 37 9 0 01 Oct 2022
Motion-inductive Self-supervised Object Discovery in Videos Shuangrui Ding Weidi Xie Yabo Chen Rui Qian Xiaopeng Zhang H. Xiong Q. Tian VOS 16 18 0 01 Oct 2022
Multimodality Multi-Lead ECG Arrhythmia Classification using Self-Supervised Learning Thi-Thu-Hong Phan Duc Le Brijesh Patel Donald Adjeroh Jingxian Wu M. Jensen Ngan Le 25 11 0 30 Sep 2022
Where Should I Spend My FLOPS? Efficiency Evaluations of Visual Pre-training Methods Skanda Koppula Yazhe Li Evan Shelhamer Andrew Jaegle Nikhil Parthasarathy Relja Arandjelović João Carreira Olivier J. Hénaff 33 9 0 30 Sep 2022
Dual Progressive Transformations for Weakly Supervised Semantic Segmentation Dong Huo Yukun Su Qingyao Wu ViT 26 4 0 30 Sep 2022
Understanding Collapse in Non-Contrastive Siamese Representation Learning Alexander C. Li Alexei A. Efros Deepak Pathak SSL 50 33 0 29 Sep 2022
Variance Covariance Regularization Enforces Pairwise Independence in Self-Supervised Representations Grégoire Mialon Randall Balestriero Yann LeCun 32 9 0 29 Sep 2022