v1v2 (latest)

Emerging Properties in Self-Supervised Vision Transformers

29 April 2021

Papers citing "Emerging Properties in Self-Supervised Vision Transformers"

50 / 4,175 papers shown

Title
NeRF-SOS: Any-View Self-supervised Object Segmentation on Complex Scenes Zhiwen Fan Peihao Wang Yi Ding Xinyu Gong Dejia Xu Zhangyang Wang 218 73 0 19 Sep 2022
S $^3$ R: Self-supervised Spectral Regression for Hyperspectral Histopathology Image Classification Xingran Xie Yan Wang Qingli Li 96 5 0 19 Sep 2022
The Geometry of Self-supervised Learning Models and its Impact on Transfer Learning Romain Cosentino Sarath Shekkizhar Mahdi Soltanolkotabi A. Avestimehr Antonio Ortega SSL 98 7 0 18 Sep 2022
PPT: token-Pruned Pose Transformer for monocular and multi-view human pose estimation Haoyu Ma Zhe Wang Yifei Chen Deying Kong Liangjian Chen Xingwei Liu Xiangyi Yan Hao Tang Xiaohui Xie ViT 87 48 0 16 Sep 2022
Self-Supervised Learning of Phenotypic Representations from Cell Images with Weak Labels J. Cross-Zamirski Guy B. Williams E. Mouchet Carola-Bibiane Schönlieb Riku Turkki Yinhai Wang 148 21 0 16 Sep 2022
Automatic Tumor Segmentation via False Positive Reduction Network for Whole-Body Multi-Modal PET/CT Images Yige Peng Jinman Kim Dagan Feng Lei Bi MedIm 31 5 0 16 Sep 2022
Self-Relation Attention and Temporal Awareness for Emotion Recognition via Vocal Burst Dang-Linh Trinh Minh-Cong Vo Gueesang Lee 64 3 0 15 Sep 2022
One-Shot Transfer of Affordance Regions? AffCorrs! Denis Hadjivelichkov Sicelukwanda Zwane M. Deisenroth Lourdes Agapito Dimitrios Kanoulas 106 39 0 15 Sep 2022
Exploring Visual Interpretability for Contrastive Language-Image Pre-training Yi Li Hualiang Wang Yiqun Duan Han Xu Xiaomeng Li CLIP VLM 153 27 0 15 Sep 2022
On the interplay of adversarial robustness and architecture components: patches, convolution and attention Francesco Croce Matthias Hein 89 6 0 14 Sep 2022
Improving Self-Supervised Learning by Characterizing Idealized Representations Yann Dubois Tatsunori Hashimoto Stefano Ermon Percy Liang SSL 167 43 0 13 Sep 2022
Discriminative Sampling of Proposals in Self-Supervised Transformers for Weakly Supervised Object Localization Shakeeb Murtaza Soufiane Belharbi M. Pedersoli Aydin Sarraf Eric Granger ViT WSOL 134 16 0 09 Sep 2022
Exploring Target Representations for Masked Autoencoders Xingbin Liu Jinghao Zhou Tao Kong Xianming Lin Rongrong Ji 197 52 0 08 Sep 2022
FETA: Towards Specializing Foundation Models for Expert Task Applications Amit Alfassy Assaf Arbelle Oshri Halimi Sivan Harary Roei Herzig ... Christoph Auer Kate Saenko Peter W. J. Staar Rogerio Feris Leonid Karlinsky 90 20 0 08 Sep 2022
Neural Feature Fusion Fields: 3D Distillation of Self-Supervised 2D Image Representations Vadim Tschernezki Iro Laina Diane Larlus Andrea Vedaldi 255 194 0 07 Sep 2022
Measuring the Interpretability of Unsupervised Representations via Quantized Reverse Probing Iro Laina Yuki M. Asano Andrea Vedaldi SSL 69 8 0 07 Sep 2022
MimCo: Masked Image Modeling Pre-training with Contrastive Teacher Qiang-feng Zhou Chaohui Yu Haowen Luo Zhibin Wang Hao Li VLM 132 21 0 07 Sep 2022
Prior Knowledge-Guided Attention in Self-Supervised Vision Transformers Kevin Miao Akash Gokul Raghav Singh Suzanne Petryk Joseph E. Gonzalez Kurt Keutzer Trevor Darrell Colorado Reed ViT MedIm 65 6 0 07 Sep 2022
Semi-Supervised Domain Adaptation by Similarity based Pseudo-label Injection Abhay Rawat Isha Dua Saurav Gupta Rahul Tallamraju 79 1 0 05 Sep 2022
Multi-modal Masked Autoencoders Learn Compositional Histopathological Representations Wisdom O. Ikezogwo M. S. Seyfioglu Linda G. Shapiro 21 5 0 04 Sep 2022
Back-to-Bones: Rediscovering the Role of Backbones in Domain Generalization Simone Angarano Mauro Martini Francesco Salvetti Vittorio Mazzia Marcello Chiaberge OOD 107 12 0 02 Sep 2022
Instance-Dependent Noisy Label Learning via Graphical Modelling Arpit Garg Cuong C. Nguyen Rafael Felix Thanh-Toan Do G. Carneiro NoLa 93 29 0 02 Sep 2022
SkeletonMAE: Spatial-Temporal Masked Autoencoders for Self-supervised Skeleton Action Recognition Wenhan Wu Yilei Hua Ce Zheng Shi-Bao Wu Chong Chen Aidong Lu ViT 137 36 0 01 Sep 2022
TokenCut: Segmenting Objects in Images and Videos with Self-supervised Transformer and Normalized Cut Yangtao Wang Xiaoke Shen Yuan. Yuan Yuming Du Maomao Li S. Hu James L. Crowley Dominique Vaufreydaz VOS ViT 86 86 0 01 Sep 2022
Self-Supervised Pyramid Representation Learning for Multi-Label Visual Analysis and Beyond Cheng-Yen Hsieh Chih-Jung Chang Fu-En Yang Yu-Chiang Frank Wang SSL 81 8 0 30 Aug 2022
Open-Set Semi-Supervised Object Detection Yen-Cheng Liu Chih-Yao Ma Xiaoliang Dai Junjiao Tian Peter Vajda Zijian He Z. Kira 62 24 0 29 Aug 2022
Efficient Vision-Language Pretraining with Visual Concepts and Hierarchical Alignment Mustafa Shukor Guillaume Couairon Matthieu Cord VLM CLIP 100 27 0 29 Aug 2022
CrackSeg9k: A Collection and Benchmark for Crack Segmentation Datasets and Frameworks Shreyas Kulkarni Shreyas Singh Dhananjay Balakrishnan Siddharth Sharma Saipraneeth Devunuri Sai Chowdeswara Rao Korlapati 66 36 0 27 Aug 2022
Object Goal Navigation using Data Regularized Q-Learning Nandiraju Gireesh D. A. S. Kiran Snehasis Banerjee Mohan Sridharan Brojeshwar Bhowmick Madhava Krishna 54 9 0 27 Aug 2022
Light-weight probing of unsupervised representations for Reinforcement Learning Wancong Zhang Anthony GX-Chen Vlad Sobal Yann LeCun Nicolas Carion SSL OffRL 76 14 0 25 Aug 2022
MaskCLIP: Masked Self-Distillation Advances Contrastive Language-Image Pretraining Xiaoyi Dong Jianmin Bao Yinglin Zheng Ting Zhang Dongdong Chen ... Weiming Zhang Lu Yuan Dong Chen Fang Wen Nenghai Yu CLIP VLM 113 167 0 25 Aug 2022
Pix4Point: Image Pretrained Standard Transformers for 3D Point Cloud Understanding Guocheng Qian Abdullah Hamdi Xingdi Zhang Guohao Li 3DPC ViT 63 6 0 25 Aug 2022
Masked Autoencoders Enable Efficient Knowledge Distillers Yutong Bai Zeyu Wang Junfei Xiao Chen Wei Huiyu Wang Alan Yuille Yuyin Zhou Cihang Xie CLL 100 44 0 25 Aug 2022
DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation Nataniel Ruiz Yuanzhen Li Varun Jampani Yael Pritch Michael Rubinstein Kfir Aberman 310 2,904 0 25 Aug 2022
Refine and Represent: Region-to-Object Representation Learning Akash Gokul Konstantinos Kallidromitis Shufang Li Yu Kato Kazuki Kozuka Trevor Darrell Colorado Reed SSeg 93 5 0 25 Aug 2022
Transfer Learning Application of Self-supervised Learning in ARPES S. Ekahana Genta Indra Winata Y. Soh G. Aeppli Radovic Milan Mingzhi Shi 53 5 0 23 Aug 2022
Patient-level Microsatellite Stability Assessment from Whole Slide Images By Combining Momentum Contrast Learning and Group Patch Embeddings D. Shats Hadar Hezi Guy Shani Y. Maruvka Moti Freiman 29 2 0 22 Aug 2022
Net2Brain: A Toolbox to compare artificial vision models with human brain responses Domenic Bersch Kshitij Dwivedi Martina Vilas Radoslaw Martin Cichy Gemma Roig 72 5 0 20 Aug 2022
Towards Label-efficient Automatic Diagnosis and Analysis: A Comprehensive Survey of Advanced Deep Learning-based Weakly-supervised, Semi-supervised and Self-supervised Techniques in Histopathological Image Analysis Linhao Qu Siyu Liu Xiaoyu Liu Manning Wang Zhijian Song 83 58 0 18 Aug 2022
C3-DINO: Joint Contrastive and Non-contrastive Self-Supervised Learning for Speaker Verification Chunlei Zhang Dong Yu 117 20 0 15 Aug 2022
Self-Supervised Multimodal Fusion Transformer for Passive Activity Recognition Armand K. Koupai M. J. Bocus Raúl Santos-Rodríguez Robert Piechocki Ryan McConville ViT 60 9 0 15 Aug 2022
Toward Interpretable Sleep Stage Classification Using Cross-Modal Transformers Jathurshan Pradeepkumar Mithunjha Anandakumar Vinith Kugathasan Dhinesh Suntharalingham S. L. Kappel A. D. Silva Chamira U. S. Edussooriya 101 31 0 15 Aug 2022
Recent Progress in Transformer-based Medical Image Analysis Zhao-cheng Liu Qiujie Lv Ziduo Yang Yifan Li Chau Hung Lee Leizhao Shen MedIm 79 66 0 13 Aug 2022
CCRL: Contrastive Cell Representation Learning Ramin Nakhli Amirali Darbandsari H. Farahani A. Bashashati SSL 41 3 0 12 Aug 2022
BEiT v2: Masked Image Modeling with Vector-Quantized Visual Tokenizers Zhiliang Peng Li Dong Hangbo Bao QiXiang Ye Furu Wei 71 322 0 12 Aug 2022
RenyiCL: Contrastive Representation Learning with Skew Renyi Divergence Kyungmin Lee Jinwoo Shin SSL DRL 99 10 0 12 Aug 2022
An Algorithm-Hardware Co-Optimized Framework for Accelerating N:M Sparse Transformers Chao Fang Aojun Zhou Zhongfeng Wang MoE 76 54 0 12 Aug 2022
MILAN: Masked Image Pretraining on Language Assisted Representation Zejiang Hou Fei Sun Yen-kuang Chen Yuan Xie S. Kung ViT 121 70 0 11 Aug 2022
On the Pros and Cons of Momentum Encoder in Self-Supervised Visual Representation Learning T. Pham Chaoning Zhang Axi Niu Kang Zhang Chang D. Yoo 78 11 0 11 Aug 2022
Semi-supervised Vision Transformers at Scale Zhaowei Cai Avinash Ravichandran Paolo Favaro Manchen Wang Davide Modolo Rahul Bhotika Zhuowen Tu Stefano Soatto ViT 108 58 0 11 Aug 2022