Emerging Properties in Self-Supervised Vision Transformers

29 April 2021

Papers citing "Emerging Properties in Self-Supervised Vision Transformers"

50 / 1,395 papers shown

Title
Large-scale Pre-trained Models are Surprisingly Strong in Incremental Novel Class Discovery Mingxuan Liu Subhankar Roy Zhun Zhong N. Sebe Elisa Ricci CLL SSL 41 10 0 28 Mar 2023
On the Stepwise Nature of Self-Supervised Learning James B. Simon Maksis Knutins Liu Ziyin Daniel Geisz Abraham J. Fetterman Joshua Albrecht SSL 39 30 0 27 Mar 2023
The Stable Signature: Rooting Watermarks in Latent Diffusion Models Pierre Fernandez Guillaume Couairon Hervé Jégou Matthijs Douze Teddy Furon WIGM 31 177 0 27 Mar 2023
Leveraging Hidden Positives for Unsupervised Semantic Segmentation Hyun Seok Seong WonJun Moon Subeen Lee Jae-Pil Heo ViT 33 32 0 27 Mar 2023
UnScene3D: Unsupervised 3D Instance Segmentation for Indoor Scenes Dávid Rozenberszki Or Litany Angela Dai 3DPC ISeg 36 23 0 25 Mar 2023
Best of Both Worlds: Multimodal Contrastive Learning with Tabular and Imaging Data Paul Hager M. Menten Daniel Rueckert 31 47 0 24 Mar 2023
CrOC: Cross-View Online Clustering for Dense Visual Representation Learning Thomas Stegmüller Tim Lebailly Behzad Bozorgtabar Tinne Tuytelaars Jean-Philippe Thiran 39 15 0 23 Mar 2023
Top-Down Visual Attention from Analysis by Synthesis Baifeng Shi Trevor Darrell Xin Eric Wang 27 29 0 23 Mar 2023
MV-MR: multi-views and multi-representations for self-supervised learning and knowledge distillation Vitaliy Kinakh M. Drozdova Slava Voloshynovskiy 42 1 0 21 Mar 2023
Machine Learning for Brain Disorders: Transformers and Visual Transformers Robin Courant Maika Edberg Nicolas Dufour Vicky Kalogeiton MedIm ViT 40 1 0 21 Mar 2023
Detecting the open-world objects with the help of the Brain Shuailei Ma Yuefeng Wang Ying-yu Wei Peihao Chen Zhixiang Ye Jiaqi Fan Enming Zhang Thomas H. Li VLM ObjD 24 2 0 21 Mar 2023
Coreset Sampling from Open-Set for Fine-Grained Self-Supervised Learning Sungnyun Kim Sangmin Bae Se-Young Yun 22 9 0 20 Mar 2023
Neural Refinement for Absolute Pose Regression with Feature Synthesis Shuai Chen Yash Bhalgat Xinghui Li Jiawang Bian Kejie Li Zirui Wang V. Prisacariu 29 18 0 17 Mar 2023
Denoising Diffusion Autoencoders are Unified Self-supervised Learners Weilai Xiang Hongyu Yang Di Huang Yunhong Wang DiffM 30 71 0 17 Mar 2023
P+: Extended Textual Conditioning in Text-to-Image Generation A. Voynov Qinghao Chu Daniel Cohen-Or Kfir Aberman VLM DiffM 51 176 0 16 Mar 2023
RSFNet: A White-Box Image Retouching Approach using Region-Specific Color Filters Wenqi Ouyang Yi Dong Xiaoyang Kang Peiran Ren Xin Xu Xuansong Xie 35 7 0 15 Mar 2023
MAHTM: A Multi-Agent Framework for Hierarchical Transactive Microgrids Nicolas Mauricio Cuadrado Roberto Gutiérrez Yongli Zhu Martin Takáč 36 2 0 15 Mar 2023
Task-specific Fine-tuning via Variational Information Bottleneck for Weakly-supervised Pathology Whole Slide Image Classification Honglin Li Chenglu Zhu Yunlong Zhang Yuxuan Sun Zhongyi Shui Wenwei Kuang S. Zheng Ling Yang 69 57 0 15 Mar 2023
AdPE: Adversarial Positional Embeddings for Pretraining Vision Transformers via MAE+ Tianlin Li Ying Wang Ziwei Xuan Guo-Jun Qi ViT 48 3 0 14 Mar 2023
DPPMask: Masked Image Modeling with Determinantal Point Processes Junde Xu Zikai Lin Donghao Zhou Yao-Cheng Yang Xiangyun Liao Bian Wu Guangyong Chen Pheng-Ann Heng 28 1 0 13 Mar 2023
FireRisk: A Remote Sensing Dataset for Fire Risk Assessment with Benchmarks Using Supervised and Self-supervised Learning Shuchang Shen Sachith Seneviratne Xinye Wanyan M. Kirley 49 14 0 13 Mar 2023
Pretrained ViTs Yield Versatile Representations For Medical Images Christos Matsoukas Johan Fredin Haslum Magnus P Soderberg Kevin Smith MedIm ViT 27 11 0 13 Mar 2023
Towards domain-invariant Self-Supervised Learning with Batch Styles Standardization Marin Scalbert Maria Vakalopoulou Florent Couzinié-Devy 21 2 0 10 Mar 2023
Classification in Histopathology: A unique deep embeddings extractor for multiple classification tasks A. Nivaggioli Nicolas Pozin Rémy Peyret Stéphane Sockeel Marie Sockeel Nicolas Nerrienet Marceau Clavel Clara Simmat C. Miquel MedIm 19 0 0 09 Mar 2023
TQ-Net: Mixed Contrastive Representation Learning For Heterogeneous Test Questions He Zhu Xihua Li Xuemin Zhao Yunbo Cao Shan Yu 23 0 0 09 Mar 2023
Rethinking Visual Prompt Learning as Masked Visual Token Modeling Ning Liao Bowen Shi Xiaopeng Zhang Min Cao Junchi Yan Qi Tian VLM 34 7 0 09 Mar 2023
Video-P2P: Video Editing with Cross-attention Control Shaoteng Liu Yuechen Zhang Wenbo Li Zhe-nan Lin Jiaya Jia DiffM VGen 147 202 0 08 Mar 2023
A Message Passing Perspective on Learning Dynamics of Contrastive Learning Yifei Wang Qi Zhang Tianqi Du Jiansheng Yang Zhouchen Lin Yisen Wang SSL 32 18 0 08 Mar 2023
MABNet: Master Assistant Buddy Network with Hybrid Learning for Image Retrieval Rohit Agarwal Gyanendra Das Saksham Aggarwal Alexander Horsch Dilip K. Prasad 26 0 0 06 Mar 2023
Semantic-aware Occlusion Filtering Neural Radiance Fields in the Wild Jae-Won Lee In-Ho Kim Hwan Heo Hyunwoo J. Kim 45 7 0 05 Mar 2023
Unleashing Text-to-Image Diffusion Models for Visual Perception Wenliang Zhao Yongming Rao Zuyan Liu Benlin Liu Jie Zhou Jiwen Lu ObjD VLM MDE 163 218 0 03 Mar 2023
Prompt, Generate, then Cache: Cascade of Foundation Models makes Strong Few-shot Learners Renrui Zhang Xiangfei Hu Bohao Li Siyuan Huang Hanqiu Deng Hongsheng Li Yu Qiao Peng Gao VLM MLLM 42 170 0 03 Mar 2023
Learning Common Rationale to Improve Self-Supervised Representation for Fine-Grained Visual Recognition Problems Yangyang Shu Anton Van Den Hengel Lingqiao Liu SSL 38 14 0 03 Mar 2023
Hierarchical discriminative learning improves visual representations of biomedical microscopy Cheng Jiang X. Hou A. Kondepudi Asadur Chowdury C. Freudiger D. Orringer Honglak Lee Todd C. Hollon 34 12 0 02 Mar 2023
Self-attention in Vision Transformers Performs Perceptual Grouping, Not Attention Paria Mehrani John K. Tsotsos 25 24 0 02 Mar 2023
Token Contrast for Weakly-Supervised Semantic Segmentation Lixiang Ru Heliang Zheng Yibing Zhan Bo Du ViT 37 86 0 02 Mar 2023
Multimodal Industrial Anomaly Detection via Hybrid Fusion Yue Wang Jinlong Peng Jiangning Zhang Ran Yi Yabiao Wang Chengjie Wang 3DPC 83 88 0 01 Mar 2023
Generic-to-Specific Distillation of Masked Autoencoders Wei Huang Zhiliang Peng Li Dong Furu Wei Jianbin Jiao QiXiang Ye 32 23 0 28 Feb 2023
Efficient Masked Autoencoders with Self-Consistency Zhaowen Li Yousong Zhu Zhiyang Chen Wei Li Chaoyang Zhao Rui Zhao Ming Tang Jinqiao Wang 55 2 0 28 Feb 2023
DC-Former: Diverse and Compact Transformer for Person Re-Identification Wenqi Li Cheng Zou Meng Wang Furong Xu Jianan Zhao Ruobing Zheng Yuan Cheng Wei Chu ViT 36 40 0 28 Feb 2023
Foundation Model Drives Weakly Incremental Learning for Semantic Segmentation Chaohui Yu Qiang-feng Zhou Jingliang Li Jia-Chao Yuan Zhibin Wang Fan Wang VLM CLL 35 13 0 28 Feb 2023
Enhanced Controllability of Diffusion Models via Feature Disentanglement and Realism-Enhanced Sampling Methods Wonwoong Cho Hareesh Ravi Midhun Harikumar V. Khuc Krishna Kumar Singh Jingwan Lu David I. Inouye Ajinkya Kale DiffM 34 7 0 28 Feb 2023
Layer Grafted Pre-training: Bridging Contrastive Learning And Masked Image Modeling For Label-Efficient Representations Ziyu Jiang Yinpeng Chen Mengchen Liu Dongdong Chen Xiyang Dai Lu Yuan Zicheng Liu Zhangyang Wang SSL VLM CLIP 43 16 0 27 Feb 2023
ACE: Zero-Shot Image to Image Translation via Pretrained Auto-Contrastive-Encoder Sihan Xu Zelong Jiang Ruisi Liu Kai-Lin Yang Zhijie Huang VLM 38 1 0 22 Feb 2023
Steerable Equivariant Representation Learning Sangnie Bhardwaj Willie McClinton Tongzhou Wang Guillaume Lajoie Chen Sun Phillip Isola Dilip Krishnan OOD LLMSV 34 5 0 22 Feb 2023
Novel Class Discovery: an Introduction and Key Concepts Colin Troisemaine V. Lemaire Stéphane Gosselin Alexandre Reiffers-Masson Joachim Flocon-Cholet Sandrine Vaton 50 21 0 22 Feb 2023
Unsupervised Learning on a DIET: Datum IndEx as Target Free of Self-Supervision, Reconstruction, Projector Head Randall Balestriero 38 3 0 20 Feb 2023
Evaluating Representations with Readout Model Switching Yazhe Li J. Bornschein Marcus Hutter 27 0 0 19 Feb 2023
Mutual Exclusive Modulator for Long-Tailed Recognition Haixu Long Xiaolin Zhang Yanbin Liu Zongtai Luo Jianbo Liu 19 2 0 19 Feb 2023
Self-Supervised Representation Learning from Temporal Ordering of Automated Driving Sequences Christopher Lang Alexander Braun Lars Schillingmann Karsten Haug Abhinav Valada SSL 22 10 0 17 Feb 2023