v1v2 (latest)

Emerging Properties in Self-Supervised Vision Transformers

29 April 2021

Papers citing "Emerging Properties in Self-Supervised Vision Transformers"

50 / 4,175 papers shown

Title
MTGLS: Multi-Task Gaze Estimation with Limited Supervision Abdulaziz Shamsah Munawar Hayat Seth Hutchinson Jarrod Knibbe CVBM 102 21 0 23 Oct 2021
Improving Model Generalization by Agreement of Learned Representations from Data Augmentation Rowel Atienza ViT 141 9 0 20 Oct 2021
SSAST: Self-Supervised Audio Spectrogram Transformer Yuan Gong Cheng-I Jeff Lai Yu-An Chung James R. Glass ViT 91 276 0 19 Oct 2021
TLDR: Twin Learning for Dimensionality Reduction Yannis Kalantidis Carlos Lassance Jon Almazán Diane Larlus SSL 63 11 0 18 Oct 2021
Understanding Dimensional Collapse in Contrastive Self-supervised Learning Li Jing Pascal Vincent Yann LeCun Yuandong Tian SSL 122 359 0 18 Oct 2021
Illiterate DALL-E Learns to Compose Gautam Singh Fei Deng Sungjin Ahn CoGe OCL 117 139 0 17 Oct 2021
Self-Supervised Learning by Estimating Twin Class Distributions Feng Wang Tao Kong Rufeng Zhang Huaping Liu Hang Li SSL 98 19 0 14 Oct 2021
Decoupled Contrastive Learning Chun-Hsiao Yeh Cheng-Yao Hong Yen-Chi Hsu Tyng-Luh Liu Yubei Chen Yann LeCun 245 191 0 13 Oct 2021
Can machines learn to see without visual databases? Alessandro Betti Marco Gori S. Melacci Marcello Pelillo Fabio Roli VLM 82 3 0 12 Oct 2021
Revitalizing CNN Attentions via Transformers in Self-Supervised Visual Representation Learning Chongjian Ge Youwei Liang Yibing Song Jianbo Jiao Jue Wang Ping Luo ViT 74 35 0 11 Oct 2021
Towards Demystifying Representation Learning with Non-contrastive Self-supervision Xiang Wang Xinlei Chen S. Du Yuandong Tian SSL 78 26 0 11 Oct 2021
Vector-quantized Image Modeling with Improved VQGAN Jiahui Yu Xin Li Jing Yu Koh Han Zhang Ruoming Pang James Qin Alexander Ku Yuanzhong Xu Jason Baldridge Yonghui Wu ViT VLM DRL 168 527 0 09 Oct 2021
Unsupervised Selective Labeling for More Effective Semi-Supervised Learning Xudong Wang Long Lian Stella X. Yu 259 32 0 06 Oct 2021
Algorithm Fairness in AI for Medicine and Healthcare Richard J. Chen Tiffany Y. Chen Jana Lipkova Judy J. Wang Drew F. K. Williamson Ming Y. Lu S. Sahai Faisal Mahmood FaML 148 47 0 01 Oct 2021
Stochastic Contrastive Learning Jason Ramapuram Dan Busbridge Xavier Suau Russ Webb BDL SSL 93 3 0 01 Oct 2021
Evaluating the fairness of fine-tuning strategies in self-supervised learning Jason Ramapuram Dan Busbridge Russ Webb 69 6 0 01 Oct 2021
Do Self-Supervised and Supervised Methods Learn Similar Visual Representations? Tom George Grigg Dan Busbridge Jason Ramapuram Russ Webb SSL DRL 88 27 0 01 Oct 2021
ResNet strikes back: An improved training procedure in timm Ross Wightman Hugo Touvron Hervé Jégou AI4TS 281 500 0 01 Oct 2021
Localizing Objects with Self-Supervised Transformers and no Labels Oriane Siméoni Gilles Puy Huy V. Vo Simon Roburin Spyros Gidaris Andrei Bursuc P. Pérez Renaud Marlet Jean Ponce ViT 260 203 0 29 Sep 2021
Unsolved Problems in ML Safety Dan Hendrycks Nicholas Carlini John Schulman Jacob Steinhardt 274 294 0 28 Sep 2021
The JHU submission to VoxSRC-21: Track 3 Jejin Cho Jesus Villalba Najim Dehak 131 21 0 28 Sep 2021
Fine-tuning Vision Transformers for the Prediction of State Variables in Ising Models Onur Kara Arijit Sehanobish H. Corzo 70 4 0 28 Sep 2021
PASS: An ImageNet replacement for self-supervised pretraining without humans Yuki M. Asano Christian Rupprecht Andrew Zisserman Andrea Vedaldi VLM SSL 100 58 0 27 Sep 2021
How much human-like visual experience do current self-supervised learning algorithms need in order to achieve human-level object recognition? Emin Orhan OOD 100 4 0 23 Sep 2021
Intra-Inter Subject Self-supervised Learning for Multivariate Cardiac Signals Xiang Lan Dianwen Ng linda Qiao Mengling Feng OOD 109 52 0 18 Sep 2021
Torch.manual_seed(3407) is all you need: On the influence of random seeds in deep learning architectures for computer vision David Picard 3DV VLM 83 92 0 16 Sep 2021
Vision Transformer for Learning Driving Policies in Complex Multi-Agent Environments E. Kargar Ville Kyrki ViT 75 13 0 14 Sep 2021
Self supervised learning improves dMMR/MSI detection from histology slides across multiple cancers C. Saillard Olivier Dehaene Tanguy Marchand O. Moindrot A. Kamoun B. Schmauch S. Jégou 93 39 0 13 Sep 2021
Scaled ReLU Matters for Training Vision Transformers Pichao Wang Xue Wang Haowen Luo Jingkai Zhou Zhipeng Zhou Fan Wang Hao Li Rong Jin 97 43 0 08 Sep 2021
The Functional Correspondence Problem Zihang Lai Senthil Purushwalkam Abhinav Gupta 115 15 0 02 Sep 2021
SimVLM: Simple Visual Language Model Pretraining with Weak Supervision Zirui Wang Jiahui Yu Adams Wei Yu Zihang Dai Yulia Tsvetkov Yuan Cao VLM MLLM 153 799 0 24 Aug 2021
Improving Object Detection by Label Assignment Distillation Chuong H. Nguyen Thuy C. Nguyen Tuan N. Tang N. Phan 82 42 0 24 Aug 2021
Jointly Learnable Data Augmentations for Self-Supervised GNNs Zekarias T. Kefato Sarunas Girdzijauskas Hannes Stärk SSL 73 5 0 23 Aug 2021
How Transferable Are Self-supervised Features in Medical Image Classification Tasks? T. Truong Sadegh Mohammadi Matthias Lenga 79 45 0 23 Aug 2021
Discriminative Region-based Multi-Label Zero-Shot Learning Sanath Narayan Akshita Gupta Salman Khan Fahad Shahbaz Khan Ling Shao M. Shah VLM 117 47 0 20 Aug 2021
Is it Time to Replace CNNs with Transformers for Medical Images? Christos Matsoukas Johan Fredin Haslum Magnus P Soderberg Kevin Smith ViT OOD MedIm 74 150 0 20 Aug 2021
Do Vision Transformers See Like Convolutional Neural Networks? M. Raghu Thomas Unterthiner Simon Kornblith Chiyuan Zhang Alexey Dosovitskiy ViT 145 967 0 19 Aug 2021
An Information Theory-inspired Strategy for Automatic Network Pruning Xiawu Zheng Yuexiao Ma Teng Xi Gang Zhang Errui Ding Yuchao Li Jie Chen Yonghong Tian Rongrong Ji 194 13 0 19 Aug 2021
How Self-Supervised Learning Can be Used for Fine-Grained Head Pose Estimation? Mahdi Pourmirzaei Farzaneh Esmaili G. Montazer Sasan Karamizadeh Seyedehsamaneh Shojaeilangari 62 0 0 10 Aug 2021
A Low Rank Promoting Prior for Unsupervised Contrastive Learning Yu Wang Jingyang Lin Qi Cai Yingwei Pan Ting Yao Hongyang Chao Tao Mei SSL 91 16 0 05 Aug 2021
Semi-weakly Supervised Contrastive Representation Learning for Retinal Fundus Images Boon Peng Yap B. Ng SSL 75 3 0 04 Aug 2021
On The State of Data In Computer Vision: Human Annotations Remain Indispensable for Developing Deep Learning Models Z. Emam Andrew Kondrich Sasha Harrison Felix Lau Yushi Wang Aerin Kim E. Branson VLM 50 13 0 31 Jul 2021
Bridging Gap between Image Pixels and Semantics via Supervision: A Survey Jiali Duan C.-C. Jay Kuo 96 8 0 29 Jul 2021
Pixyz: a Python library for developing deep generative models Masahiro Suzuki T. Kaneko Y. Matsuo AI4CE 83 3 0 28 Jul 2021
AASAE: Augmentation-Augmented Stochastic Autoencoders William Falcon A. Jha Teddy Koker Kyunghyun Cho 100 0 0 26 Jul 2021
Trip-ROMA: Self-Supervised Learning with Triplets and Random Mappings Wenbin Li Xuesong Yang Meihao Kong Lei Wang Jing Huo Yang Gao Jiebo Luo 52 0 0 22 Jul 2021
OODformer: Out-Of-Distribution Detection Transformer Rajat Koner Poulami Sinhamahapatra Karsten Roscher Stephan Günnemann Volker Tresp ViT 64 40 0 19 Jul 2021
Unsupervised Skill-Discovery and Skill-Learning in Minecraft J. J. Nieto Roger Creus Xavier Giró-i-Nieto SSL DRL 71 4 0 18 Jul 2021
Focal Self-attention for Local-Global Interactions in Vision Transformers Jianwei Yang Chunyuan Li Pengchuan Zhang Xiyang Dai Bin Xiao Lu Yuan Jianfeng Gao ViT 84 436 0 01 Jul 2021
Action Transformer: A Self-Attention Model for Short-Time Pose-Based Human Action Recognition Vittorio Mazzia Simone Angarano Francesco Salvetti Federico Angelini Marcello Chiaberge ViT 118 143 0 01 Jul 2021