v1v2 (latest)

Emerging Properties in Self-Supervised Vision Transformers

29 April 2021

Papers citing "Emerging Properties in Self-Supervised Vision Transformers"

50 / 4,175 papers shown

Title
CrossPoint: Self-Supervised Cross-Modal Contrastive Learning for 3D Point Cloud Understanding Mohamed Afham Isuru Dissanayake Dinithi Dissanayake Amaya Dharmasiri Kanchana Thilakarathna Ranga Rodrigo 3DPC 97 259 0 01 Mar 2022
Self-Supervised Vision Transformers Learn Visual Concepts in Histopathology Richard J. Chen Rahul G. Krishnan MedIm ViT 93 88 0 01 Mar 2022
TRILLsson: Distilled Universal Paralinguistic Speech Representations Joel Shor Subhashini Venugopalan 79 41 0 01 Mar 2022
Multi-modal Alignment using Representation Codebook Jiali Duan Liqun Chen Son Tran Jinyu Yang Yi Xu Belinda Zeng Trishul Chilimbi 96 68 0 28 Feb 2022
Single-shot self-supervised particle tracking Benjamin Midtvedt Jesús Pineda Fredrik Skärberg Erik Olsén Harshith Bachimanchi ... E. K. Esbjörner Erik Selander F. Höök Daniel Midtvedt Giovanni Volpe 17 2 0 28 Feb 2022
Supervising Remote Sensing Change Detection Models with 3D Surface Semantics Isaac Corley Peyman Najafirad 3DPC 61 6 0 26 Feb 2022
FreeSOLO: Learning to Segment Objects without Annotations Xinlong Wang Zhiding Yu Shalini De Mello Jan Kautz Anima Anandkumar Chunhua Shen J. Álvarez ISeg SSeg 105 115 0 24 Feb 2022
Learning with Free Object Segments for Long-Tailed Instance Segmentation Cheng Zhang Tai-Yu Pan Tianle Chen Shitian Zhao Wen-juan Fu Wei-Lun Chao VLM 104 12 0 22 Feb 2022
GroupViT: Semantic Segmentation Emerges from Text Supervision Jiarui Xu Shalini De Mello Sifei Liu Wonmin Byeon Thomas Breuel Jan Kautz Xinyu Wang ViT VLM 300 527 0 22 Feb 2022
Assessing the State of Self-Supervised Human Activity Recognition using Wearables H. Haresamudram Irfan Essa Thomas Plötz SSL 95 94 0 22 Feb 2022
CaMEL: Mean Teacher Learning for Image Captioning Manuele Barraco Matteo Stefanini Marcella Cornia S. Cascianelli Lorenzo Baraldi Rita Cucchiara ViT VLM 78 30 0 21 Feb 2022
A Self-Supervised Descriptor for Image Copy Detection Ed Pizzi Sreya . Dutta Roy Sugosh Nagavara Ravindra Priya Goyal Matthijs Douze SSL 96 126 0 21 Feb 2022
Hilbert Flattening: a Locality-Preserving Matrix Unfolding Method for Visual Discrimination Qingsong Zhao Shuguang Dou Zhipeng Zhou Yangguang Li Yin Wang Yu Qiao Cairong Zhao 26 3 0 21 Feb 2022
A study of deep perceptual metrics for image quality assessment Rémi Kazmierczak Gianni Franchi Nacim Belkhir Antoine Manzanera David Filliat 22 3 0 17 Feb 2022
Vision Models Are More Robust And Fair When Pretrained On Uncurated Images Without Supervision Priya Goyal Quentin Duval Isaac Seessel Mathilde Caron Ishan Misra Levent Sagun Armand Joulin Piotr Bojanowski VLM SSL 128 111 0 16 Feb 2022
A Developmentally-Inspired Examination of Shape versus Texture Bias in Machines Alexa R. Tartaglini Wai Keen Vong Brenden M. Lake 64 14 0 16 Feb 2022
Open-Ended Reinforcement Learning with Neural Reward Functions Robert Meier Asier Mujika 101 7 0 16 Feb 2022
Meta Knowledge Distillation Jihao Liu Boxiao Liu Hongsheng Li Yu Liu 83 26 0 16 Feb 2022
Not All Patches are What You Need: Expediting Vision Transformers via Token Reorganizations Youwei Liang Chongjian Ge Zhan Tong Yibing Song Jue Wang P. Xie ViT 81 255 0 16 Feb 2022
ScoreNet: Learning Non-Uniform Attention and Augmentation for Transformer-Based Histopathological Image Classification Thomas Stegmüller Behzad Bozorgtabar A. Spahr Jean-Philippe Thiran ViT MedIm 105 43 0 15 Feb 2022
Handcrafted Histological Transformer (H2T): Unsupervised Representation of Whole Slide Images Q. Vu K. Rajpoot S. Raza Nasir M. Rajpoot ViT MedIm 63 32 0 14 Feb 2022
CATs++: Boosting Cost Aggregation with Convolutions and Transformers Seokju Cho Sunghwan Hong Seung Wook Kim ViT 99 40 0 14 Feb 2022
AI can evolve without labels: self-evolving vision transformer for chest X-ray diagnosis through knowledge distillation S. Park Gwanghyun Kim Y. Oh J. Seo Sang Min Lee Jin Hwan Kim Sungjun Moon Jae-Kwang Lim Changhyun Park Jong Chul Ye ViT MedIm 76 51 0 13 Feb 2022
Multi-Modal Knowledge Graph Construction and Application: A Survey Xiangru Zhu Zhixu Li Xiaodan Wang Xueyao Jiang Penglei Sun Xuwu Wang Yanghua Xiao N. Yuan 73 167 0 11 Feb 2022
Energy-Based Contrastive Learning of Visual Representations Beomsu Kim Jong Chul Ye 61 16 0 10 Feb 2022
Point-Level Region Contrast for Object Detection Pre-Training Yutong Bai Xinlei Chen Alexander Kirillov Alan Yuille Alexander C. Berg 3DPC 94 51 0 09 Feb 2022
Automated Distance Estimation for Wildlife Camera Trapping Peter Johanns T. Haucke Volker Steinhage 66 18 0 09 Feb 2022
Distillation with Contrast is All You Need for Self-Supervised Point Cloud Representation Learning Kexue Fu Peng Gao Renrui Zhang Hongsheng Li Yu Qiao Manning Wang SSL 3DPC 63 23 0 09 Feb 2022
MaskGIT: Masked Generative Image Transformer Huiwen Chang Han Zhang Lu Jiang Ce Liu William T. Freeman ViT 158 695 0 08 Feb 2022
Results and findings of the 2021 Image Similarity Challenge Zoe Papakipos Giorgos Tolias Tomás Jenícek Ed Pizzi Shuhei Yokoo ... Sanjay V. Addicam S. M. Papadakis Cristian Canton Ferrer Ondřej Chum Matthijs Douze 90 14 0 08 Feb 2022
How to Understand Masked Autoencoders Shuhao Cao Peng Xu David Clifton 98 42 0 08 Feb 2022
Corrupted Image Modeling for Self-Supervised Visual Pre-Training Yuxin Fang Li Dong Hangbo Bao Xinggang Wang Furu Wei 95 88 0 07 Feb 2022
Crafting Better Contrastive Views for Siamese Representation Learning Xiang Peng Kai Wang Zheng Hua Zhu Mang Wang Yang You SSL 83 105 0 07 Feb 2022
Transformers in Self-Supervised Monocular Depth Estimation with Unknown Camera Intrinsics Arnav Varma Hemang Chawla Bahram Zonooz Elahe Arani ViT MDE 75 50 0 07 Feb 2022
Leveraging Ensembles and Self-Supervised Learning for Fully-Unsupervised Person Re-Identification and Text Authorship Attribution Gabriel Bertocco Antônio Theóphilo Fernanda A. Andaló Anderson de Rezende Rocha 69 12 0 07 Feb 2022
Machine Translation from Signed to Spoken Languages: State of the Art and Challenges Mathieu De Coster D. Shterionov Mieke Van Herreweghe J. Dambre SLR 66 42 0 07 Feb 2022
OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework Peng Wang An Yang Rui Men Junyang Lin Shuai Bai Zhikang Li Jianxin Ma Chang Zhou Jingren Zhou Hongxia Yang MLLM ObjD 176 884 0 07 Feb 2022
Context Autoencoder for Self-Supervised Representation Learning Xiaokang Chen Mingyu Ding Xiaodi Wang Ying Xin Shentong Mo Yunhao Wang Shumin Han Ping Luo Gang Zeng Jingdong Wang SSL 193 400 0 07 Feb 2022
Automatic defect segmentation by unsupervised anomaly learning Nati Ofir Ran Yacobi Omer Granoviter B. Levant Ore Shtalrid 23 5 0 07 Feb 2022
Active Learning on a Budget: Opposite Strategies Suit High and Low Budgets Guy Hacohen Avihu Dekel D. Weinshall 233 123 0 06 Feb 2022
Bootstrapped Representation Learning for Skeleton-Based Action Recognition Olivier Moliner Sangxia Huang Kalle Åström SSL 57 14 0 04 Feb 2022
AtmoDist: Self-supervised Representation Learning for Atmospheric Dynamics Sebastian Hoffmann C. Lessig AI4Cl 75 10 0 02 Feb 2022
Mars Terrain Segmentation with Less Labels Edwin Y. Goh Jingdao Chen Brian Wilson 97 30 0 01 Feb 2022
ColloSSL: Collaborative Self-Supervised Learning for Human Activity Recognition Yash Jain Chi Ian Tang Chulhong Min F. Kawsar Akhil Mathur SSL 100 54 0 01 Feb 2022
Learning Super-Features for Image Retrieval Philippe Weinzaepfel Thomas Lucas Diane Larlus Yannis Kalantidis SupR VLM 61 45 0 31 Jan 2022
Natural Language Descriptions of Deep Visual Features Evan Hernandez Sarah Schwettmann David Bau Teona Bagashvili Antonio Torralba Jacob Andreas MILM 313 125 0 26 Jan 2022
Team Yao at Factify 2022: Utilizing Pre-trained Models and Co-attention Networks for Multi-Modal Fact Verification Wei-Yao Wang Chao-Han Huck Yang 36 10 0 26 Jan 2022
Training Vision Transformers with Only 2040 Images Yunhao Cao Hao Yu Jianxin Wu ViT 176 44 0 26 Jan 2022
Transformers in Medical Imaging: A Survey Fahad Shamshad Salman Khan Syed Waqas Zamir Muhammad Haris Khan Munawar Hayat Fahad Shahbaz Khan Huazhu Fu ViT LM&MA MedIm 195 709 0 24 Jan 2022
Visual Representation Learning with Self-Supervised Attention for Low-Label High-data Regime Prarthana Bhattacharyya Chenge Li Xiaonan Zhao István Fehérvári Jason Sun ViT 64 2 0 22 Jan 2022