v1v2 (latest)

Emerging Properties in Self-Supervised Vision Transformers

29 April 2021

Papers citing "Emerging Properties in Self-Supervised Vision Transformers"

50 / 4,175 papers shown

Title
Visual Attention Emerges from Recurrent Sparse Reconstruction Baifeng Shi Ya-heng Song Neel Joshi Trevor Darrell Xin Eric Wang 3DH 55 6 0 23 Apr 2022
Self-Supervised Video Object Segmentation via Cutout Prediction and Tagging Jyoti Kini Fahad Shahbaz Khan Salman Khan M. Shah VOS 58 1 0 22 Apr 2022
Adversarial Contrastive Learning by Permuting Cluster Assignments Muntasir Wahed Afrina Tabassum Ismini Lourentzou SSL 30 5 0 21 Apr 2022
BTranspose: Bottleneck Transformers for Human Pose Estimation with Self-Supervised Pre-Training K. Balakrishnan Devesh Upadhyay ViT 31 2 0 21 Apr 2022
Neuro-BERT: Rethinking Masked Autoencoding for Self-supervised Neurological Pretraining Di Wu Siyuan Li Jie Yang Mohamad Sawan SSL 76 15 0 20 Apr 2022
Hephaestus: A large scale multitask dataset towards InSAR understanding Nikolaos Ioannis Bountos Ioannis Papoutsis Dimitrios Michail Andreas Karavias P. Elias I. Parcharidis 89 13 0 20 Apr 2022
Less than Few: Self-Shot Video Instance Segmentation Pengwan Yang Yuki M. Asano Pascal Mettes Cees G. M. Snoek SSL 84 2 0 19 Apr 2022
Active Learning Helps Pretrained Models Learn the Intended Task Alex Tamkin Dat Nguyen Salil Deshpande Jesse Mu Noah D. Goodman 81 39 0 18 Apr 2022
The Devil is in the Frequency: Geminated Gestalt Autoencoder for Self-Supervised Visual Pre-Training Hao Liu Xinghua Jiang Xin Li Antai Guo Deqiang Jiang Bo Ren 88 39 0 18 Apr 2022
Pushing the Limits of Simple Pipelines for Few-Shot Learning: External Data and Fine-Tuning Make a Difference S. Hu Da Li Jan Stuhmer Minyoung Kim Timothy M. Hospedales 92 197 0 15 Apr 2022
Masked Siamese Networks for Label-Efficient Learning Mahmoud Assran Mathilde Caron Ishan Misra Piotr Bojanowski Florian Bordes Pascal Vincent Armand Joulin Michael G. Rabbat Nicolas Ballas SSL 131 325 0 14 Apr 2022
3D Shuffle-Mixer: An Efficient Context-Aware Vision Learner of Transformer-MLP Paradigm for Dense Prediction in Medical Volume Jianye Pang Cheng Jiang Yihao Chen Jianbo Chang M. Feng Renzhi Wang Jianhua Yao ViT MedIm 55 11 0 14 Apr 2022
Self-supervised Vision Transformers for Joint SAR-optical Representation Learning Yi Wang C. Albrecht Xiaoxiang Zhu ViT 114 52 0 11 Apr 2022
Focal Length and Object Pose Estimation via Render and Compare Georgy Ponimatkin Yann Labbé Bryan C. Russell Mathieu Aubry Josef Sivic 74 20 0 11 Apr 2022
Evaluating Vision Transformer Methods for Deep Reinforcement Learning from Pixels Tianxin Tao Daniele Reda M. van de Panne ViT 78 19 0 11 Apr 2022
Representation Learning by Detecting Incorrect Location Embeddings Sepehr Sameni Simon Jenni Paolo Favaro ViT 69 5 0 10 Apr 2022
Particle Video Revisited: Tracking Through Occlusions Using Point Trajectories Adam W. Harley Zhaoyuan Fang Katerina Fragkiadaki 111 168 0 08 Apr 2022
Zero-Shot Category-Level Object Pose Estimation Walter Goodwin S. Vaze Ioannis Havoutis Ingmar Posner ViT 82 58 0 07 Apr 2022
Unified Contrastive Learning in Image-Text-Label Space Jianwei Yang Chunyuan Li Pengchuan Zhang Bin Xiao Ce Liu Lu Yuan Jianfeng Gao VLM SSL 148 227 0 07 Apr 2022
Deep Visual Geo-localization Benchmark Gabriele Berton R. Mereu Gabriele Trivigno Carlo Masone G. Csurka Torsten Sattler Barbara Caputo ObjD 84 91 0 07 Apr 2022
Global Readiness of Language Technology for Healthcare: What would it Take to Combat the Next Pandemic? Ishani Mondal Kabir Ahuja Mohit Jain Jacki O Neil Kalika Bali Monojit Choudhury ELM LM&MA 66 4 0 06 Apr 2022
Text2LIVE: Text-Driven Layered Image and Video Editing Omer Bar-Tal Dolev Ofri-Amar Rafail Fridman Yoni Kasten Tali Dekel VGen DiffM 113 319 0 05 Apr 2022
MultiMAE: Multi-modal Multi-task Masked Autoencoders Roman Bachmann David Mizrahi Andrei Atanov Amir Zamir 142 279 0 04 Apr 2022
BatchFormerV2: Exploring Sample Relationships for Dense Representation Learning Zhi Hou Baosheng Yu Chaoyue Wang Yibing Zhan Dacheng Tao ViT 112 13 0 04 Apr 2022
Dynamic Focus-aware Positional Queries for Semantic Segmentation Haoyu He Jianfei Cai Zizheng Pan Jing Liu Jing Zhang Dacheng Tao Bohan Zhuang 82 17 0 04 Apr 2022
Revisiting a kNN-based Image Classification System with High-capacity Storage K. Nakata Youyang Ng Daisuke Miyashita A. Maki Yu Lin J. Deguchi 96 26 0 03 Apr 2022
Improving Vision Transformers by Revisiting High-frequency Components Jiawang Bai Liuliang Yuan Shutao Xia Shuicheng Yan Zhifeng Li Wen Liu ViT 108 94 0 03 Apr 2022
SinNeRF: Training Neural Radiance Fields on Complex Scenes from a Single Image Dejia Xu Yi Ding Peihao Wang Zhiwen Fan Humphrey Shi Zhangyang Wang 106 190 0 02 Apr 2022
Mix-up Self-Supervised Learning for Contrast-agnostic Applications Yichen Zhang Yifang Yin Ying Zhang Roger Zimmermann SSL 53 4 0 02 Apr 2022
Learnable latent embeddings for joint behavioral and neural analysis Steffen Schneider Jin Hwa Lee Mackenzie W. Mathis 126 231 0 01 Apr 2022
Simplicial Embeddings in Self-Supervised Learning and Downstream Classification Samuel Lavoie Christos Tsirigotis Max Schwarzer Ankit Vani Michael Noukhovitch Kenji Kawaguchi Rameswar Panda SSL 54 18 0 01 Apr 2022
On the Importance of Asymmetry for Siamese Representation Learning Tianlin Li Haoqi Fan Yuandong Tian Daisuke Kihara Xinlei Chen SSL 122 52 0 01 Apr 2022
Connect, Not Collapse: Explaining Contrastive Learning for Unsupervised Domain Adaptation Kendrick Shen Robbie Jones Ananya Kumar Sang Michael Xie Jeff Z. HaoChen Tengyu Ma Percy Liang SSL 119 89 0 01 Apr 2022
Leverage Your Local and Global Representations: A New Self-Supervised Learning Strategy Tong Zhang Congpei Qiu Wei Ke Sabine Süsstrunk Mathieu Salzmann SSL 108 39 0 31 Mar 2022
Self-distillation Augmented Masked Autoencoders for Histopathological Image Classification Yang Luo Zhineng Chen Shengtian Zhou Xieping Gao 77 1 0 31 Mar 2022
Weakly Supervised Patch Label Inference Networks for Efficient Pavement Distress Detection and Recognition in the Wild Sheng Huang Wenhao Tang Guixin Huang Luwen Huangfu Dan Yang 121 9 0 31 Mar 2022
Hybrid Handcrafted and Learnable Audio Representation for Analysis of Speech Under Cognitive and Physical Load Gasser Elbanna A. Biryukov Neil Scheidwasser Lara Orlandic Pablo Mainar M. Kegler P. Beckmann Milos Cernak 48 13 0 30 Mar 2022
Dual Temperature Helps Contrastive Learning Without Many Negative Samples: Towards Understanding and Simplifying MoCo Chaoning Zhang Kang Zhang T. Pham Axi Niu Zhinan Qiao Chang D. Yoo In So Kweon 117 57 0 30 Mar 2022
How Does SimSiam Avoid Collapse Without Negative Samples? A Unified Understanding with Self-supervised Contrastive Learning Chaoning Zhang Kang Zhang Chenshuang Zhang T. Pham Chang D. Yoo In So Kweon SSL 103 74 0 30 Mar 2022
Image-to-Lidar Self-Supervised Distillation for Autonomous Driving Data Corentin Sautier Gilles Puy Spyros Gidaris Alexandre Boulch Andrei Bursuc Renaud Marlet 3DPC 110 118 0 30 Mar 2022
A Style-aware Discriminator for Controllable Image Translation Kunhee Kim S. Park Eunyeong Jeon Tae-Hyeon Kim Daijin Kim 92 24 0 29 Mar 2022
mc-BEiT: Multi-choice Discretization for Image BERT Pre-training Xiaotong Li Yixiao Ge Kun Yi Zixuan Hu Ying Shan Ling-yu Duan 92 39 0 29 Mar 2022
In-N-Out Generative Learning for Dense Unsupervised Video Segmentation Xiaomiao Pan Peike Li Zongxin Yang Huiling Zhou Chang Zhou Hongxia Yang Jingren Zhou Yi Yang VOS 80 12 0 29 Mar 2022
Word Discovery in Visually Grounded, Self-Supervised Speech Models Puyuan Peng David Harwath SSL 128 40 0 28 Mar 2022
CD-Net: Histopathology Representation Learning using Pyramidal Context-Detail Network S. Kapse Srijan Das Prateek Prasanna 60 5 0 28 Mar 2022
Learning Where to Learn in Cross-View Self-Supervised Learning Lang Huang Shan You Mingkai Zheng Fei Wang Chao Qian T. Yamasaki SSL 60 43 0 28 Mar 2022
Large-scale Bilingual Language-Image Contrastive Learning ByungSoo Ko Geonmo Gu VLM 112 14 0 28 Mar 2022
Core Risk Minimization using Salient ImageNet Sahil Singla Mazda Moayeri Soheil Feizi 88 14 0 28 Mar 2022
Mugs: A Multi-Granular Self-Supervised Learning Framework Pan Zhou Yichen Zhou Chenyang Si Weihao Yu Teck Khim Ng Shuicheng Yan VLM 81 60 0 27 Mar 2022
CaCo: Both Positive and Negative Samples are Directly Learnable via Cooperative-adversarial Contrastive Learning Tianlin Li Yuhang Huang Dan Zeng Guo-Jun Qi SSL 54 18 0 27 Mar 2022