v1v2 (latest)

Emerging Properties in Self-Supervised Vision Transformers

29 April 2021

Papers citing "Emerging Properties in Self-Supervised Vision Transformers"

50 / 4,175 papers shown

Title
Self-supervised learning of Split Invariant Equivariant representations Q. Garrido Laurent Najman Yann LeCun SSL 87 34 0 14 Feb 2023
Stitchable Neural Networks Zizheng Pan Jianfei Cai Bohan Zhuang 102 25 0 13 Feb 2023
Beyond Uniform Smoothness: A Stopped Analysis of Adaptive SGD Matthew Faw Litu Rout Constantine Caramanis Sanjay Shakkottai 88 42 0 13 Feb 2023
Do Vision and Language Models Share Concepts? A Vector Space Alignment Study Jiaang Li Yova Kementchedjhieva Constanza Fierro Anders Søgaard VLM 64 13 0 13 Feb 2023
Less is More: Selective Layer Finetuning with SubTuning Gal Kaplun Andrey Gurevich Tal Swisa Mazor David Shai Shalev-Shwartz Eran Malach 78 9 0 13 Feb 2023
CholecTriplet2022: Show me a tool and tell me the triplet -- an endoscopic vision challenge for surgical action triplet detection C. Nwoye Tong Yu Saurav Sharma Aditya Murali Deepak Alapatt ... Pietro Mascagni B. Seeliger Cristians Gonzalez Didier Mutter N. Padoy 102 20 0 13 Feb 2023
Self-supervised pseudo-colorizing of masked cells Royden Wagner Carlos Fernandez Lopez Christoph Stiller 58 1 0 12 Feb 2023
Multispectral Contrastive Learning with Viewmaker Networks Jasmine Bayrooti Noah D. Goodman Alex Tamkin 74 1 0 11 Feb 2023
Anatomical Invariance Modeling and Semantic Alignment for Self-supervised Learning in 3D Medical Image Analysis Yankai Jiang Ming Sun Heng Guo Xiaoyu Bai K. Yan Le Lu Minfeng Xu MedIm 130 22 0 11 Feb 2023
MaskSketch: Unpaired Structure-guided Masked Image Generation D. Bashkirova José Lezama Kihyuk Sohn Kate Saenko Irfan Essa DiffM 60 25 0 10 Feb 2023
Q-Match: Self-Supervised Learning by Matching Distributions Induced by a Queue Thomas Mulc Debidatta Dwibedi SSL 28 0 0 10 Feb 2023
Key Design Choices for Double-Transfer in Source-Free Unsupervised Domain Adaptation Andrea Maracani Raffaello Camoriano Elisa Maiettini Davide Talon Lorenzo Rosasco Lorenzo Natale 85 2 0 10 Feb 2023
Self-supervised learning-based cervical cytology for the triage of HPV-positive women in resource-limited settings and low-data regime Thomas Stegmüller C. Abbet Behzad Bozorgtabar Holly E. Clarke P. Petignat P. Vassilakos Jean-Philippe Thiran 55 6 0 10 Feb 2023
AV-data2vec: Self-supervised Learning of Audio-Visual Speech Representations with Contextualized Target Representations Jiachen Lian Alexei Baevski Wei-Ning Hsu Michael Auli SSL 150 34 0 10 Feb 2023
Is This Loss Informative? Faster Text-to-Image Customization by Tracking Objective Dynamics Anton Voronov Mikhail Khoroshikh Artem Babenko Max Ryabinin 71 6 0 09 Feb 2023
Adapting Pre-trained Vision Transformers from 2D to 3D through Weight Inflation Improves Medical Image Segmentation Yuhui Zhang Shihua Huang Zhengping Zhou M. Lungren Serena Yeung ViT MedIm 66 11 0 08 Feb 2023
Weakly-supervised Representation Learning for Video Alignment and Analysis Guy Bar-Shalom G. Leifman Michael Elad Ehud Rivlin 65 2 0 08 Feb 2023
Neural Congealing: Aligning Images to a Joint Semantic Atlas Dolev Ofri-Amar Michal Geyer Yoni Kasten Tali Dekel 86 25 0 08 Feb 2023
A Prototype-Oriented Clustering for Domain Shift with Source Privacy Korawat Tanwisuth Shujian Zhang Pengcheng He Mingyuan Zhou 77 3 0 08 Feb 2023
SimCon Loss with Multiple Views for Text Supervised Semantic Segmentation Yash J. Patel Yusheng Xie Yi Zhu Srikar Appalaraju R. Manmatha 80 4 0 07 Feb 2023
Autodecompose: A generative self-supervised model for semantic decomposition M. Bonyadi SSL 41 0 0 06 Feb 2023
Evaluating Self-Supervised Learning via Risk Decomposition Yann Dubois Tatsunori Hashimoto Percy Liang 73 9 0 06 Feb 2023
The SSL Interplay: Augmentations, Inductive Bias, and Generalization Vivien A. Cabannes B. Kiani Randall Balestriero Yann LeCun A. Bietti SSL 92 33 0 06 Feb 2023
Contrast with Reconstruct: Contrastive 3D Representation Learning Guided by Generative Pretraining Zekun Qi Runpei Dong Guo Fan Zheng Ge Xiangyu Zhang Kaisheng Ma Li Yi 154 131 0 05 Feb 2023
Referential communication in heterogeneous communities of pre-trained visual deep networks Matéo Mahaut Francesca Franzon Roberto Dessì Marco Baroni 76 7 0 04 Feb 2023
MOMA:Distill from Self-Supervised Teachers Yuan Yao Nandakishor Desai M. Palaniswami 103 2 0 04 Feb 2023
Self-Supervised Transformer Architecture for Change Detection in Radio Access Networks Igor Kozlov D. Rivkin Wei-Di Chang Di Wu Xue Liu Gregory Dudek AI4TS 60 1 0 03 Feb 2023
Show me your NFT and I tell you how it will perform: Multimodal representation learning for NFT selling price prediction Davide Costa Lucio La Cava Andrea Tagarelli 64 23 0 03 Feb 2023
Blockwise Self-Supervised Learning at Scale Shoaib Ahmed Siddiqui David M. Krueger Yann LeCun Stéphane Deny SSL 90 16 0 03 Feb 2023
Energy-Inspired Self-Supervised Pretraining for Vision Models Ze Wang Jiang Wang Zicheng Liu Qiang Qiu 61 8 0 02 Feb 2023
Vision Transformer-based Feature Extraction for Generalized Zero-Shot Learning Jiseob Kim Kyuhong Shim Junhan Kim B. Shim ViT 78 14 0 02 Feb 2023
Image-Based Vehicle Classification by Synergizing Features from Supervised and Self-Supervised Learning Paradigms S. Ma Jidong J. Yang SSL 18 5 0 01 Feb 2023
Real Estate Property Valuation using Self-Supervised Vision Transformers Mahdieh Yazdani M. Raissi ViT 51 1 0 31 Jan 2023
ViewCo: Discovering Text-Supervised Segmentation Masks via Multi-View Semantic Consistency Pengzhen Ren Changlin Li Hang Xu Yi Zhu Guangrun Wang Jian-zhuo Liu Xiaojun Chang Xiaodan Liang 106 45 0 31 Jan 2023
Inference Time Evidences of Adversarial Attacks for Forensic on Transformers Hugo Lemarchant Liang Li Yiming Qian Yuta Nakashima Hajime Nagahara ViT AAML 80 0 0 31 Jan 2023
Continuous Spatiotemporal Transformers Antonio H. O. Fonseca E. Zappala J. O. Caro David van Dijk 83 8 0 31 Jan 2023
MILO: Model-Agnostic Subset Selection Framework for Efficient Model Training and Tuning Krishnateja Killamsetty A. Evfimievski Tejaswini Pedapati K. Kate Lucian Popa Rishabh K. Iyer 67 8 0 30 Jan 2023
Exploring Image Augmentations for Siamese Representation Learning with Chest X-Rays Rogier van der Sluijs Nandita Bhaskhar D. Rubin C. Langlotz Akshay S. Chaudhari SSL 48 14 0 30 Jan 2023
Don't Play Favorites: Minority Guidance for Diffusion Models Soo Bin Um Suhyeon Lee Jong Chul Ye DiffM 103 26 0 29 Jan 2023
A Closer Look at Few-shot Classification Again Xu Luo Hao Wu Ji Zhang Lianli Gao Jing Xu Jingkuan Song 90 52 0 28 Jan 2023
Deciphering the Projection Head: Representation Evaluation Self-supervised Learning Jiajun Ma Tianyang Hu Wei Cao 78 8 0 28 Jan 2023
Cross-Architectural Positive Pairs improve the effectiveness of Self-Supervised Learning P. Singh Jacopo Cirrone SSL 117 0 0 27 Jan 2023
Understanding Self-Supervised Pretraining with Part-Aware Representation Learning Jie Zhu Jiyang Qi Mingyu Ding Xiaokang Chen Ping Luo Xinggang Wang Wenyu Liu Leye Wang Jingdong Wang SSL 106 8 0 27 Jan 2023
Multi-dimensional concept discovery (MCD): A unifying framework with completeness guarantees Johanna Vielhaben Stefan Blücher Nils Strodthoff 88 42 0 27 Jan 2023
Robust Transformer with Locality Inductive Bias and Feature Normalization Omid Nejati Manzari Hossein Kashiani Hojat Asgarian Dehkordi S. B. Shokouhi ViT 77 15 0 27 Jan 2023
SNeRL: Semantic-aware Neural Radiance Fields for Reinforcement Learning D. Shim Seungjae Lee H. J. Kim 108 15 0 27 Jan 2023
Cut and Learn for Unsupervised Object Detection and Instance Segmentation Xudong Wang Rohit Girdhar Stella X. Yu Ishan Misra VLM 131 173 0 26 Jan 2023
Discovering and Mitigating Visual Biases through Keyword Explanation Younghyun Kim Sangwoo Mo Minkyu Kim Kyungmin Lee Jaeho Lee Jinwoo Shin 153 34 0 26 Jan 2023
Self-Supervised Curricular Deep Learning for Chest X-Ray Image Classification Iván de Andrés Tamé Kirill Sirotkin Pablo Carballeira Marcos Escudero-Viñolo 68 2 0 25 Jan 2023
RangeViT: Towards Vision Transformers for 3D Semantic Segmentation in Autonomous Driving Angelika Ando Spyros Gidaris Andrei Bursuc Gilles Puy Alexandre Boulch Renaud Marlet ViT 3DPC 73 79 0 24 Jan 2023