v1v2 (latest)

Emerging Properties in Self-Supervised Vision Transformers

29 April 2021

Papers citing "Emerging Properties in Self-Supervised Vision Transformers"

50 / 4,175 papers shown

Title
Do DALL-E and Flamingo Understand Each Other? Hang Li Jindong Gu Rajat Koner Sahand Sharifzadeh Volker Tresp MLLM 82 12 0 23 Dec 2022
SupeRGB-D: Zero-shot Instance Segmentation in Cluttered Indoor Environments Evin Pınar Örnek Aravindhan K. Krishnan Shreekant Gayaka Cheng-Hao Kuo Arnie Sen Nassir Navab F. Tombari 86 7 0 22 Dec 2022
Metadata-guided Consistency Learning for High Content Images Johan Fredin Haslum Christos Matsoukas Karl‐Johan Leuchowius Erik Mullers Kevin Smith 60 8 0 22 Dec 2022
A Mathematical Framework for Learning Probability Distributions Hongkang Yang 111 7 0 22 Dec 2022
Offline Clustering Approach to Self-supervised Learning for Class-imbalanced Image Data H. Chang Sungkyun Chang SSL 67 0 0 22 Dec 2022
Similarity Contrastive Estimation for Image and Video Soft Contrastive Self-Supervised Learning J. Denize Jaonary Rabarisoa Astrid Orcesi Romain Hérault SSL 87 6 0 21 Dec 2022
Hi-LASSIE: High-Fidelity Articulated Shape and Skeleton Discovery from Sparse Image Ensemble Chunfeng Yao Wei-Chih Hung Yuanzhen Li Michael Rubinstein Ming-Hsuan Yang Varun Jampani 3DH 3DV 100 28 0 21 Dec 2022
Masked Event Modeling: Self-Supervised Pretraining for Event Cameras Simone Klenk David Bonello Lukas Koestler Nikita Araslanov Zorah Lähner 92 25 0 20 Dec 2022
Towards Unsupervised Visual Reasoning: Do Off-The-Shelf Features Know How to Reason? Monika Wysoczañska Tom Monnier Tomasz Trzciñski David Picard ReLM OCL 73 1 0 20 Dec 2022
Image Segmentation-based Unsupervised Multiple Objects Discovery Sandra Kara Hejer Ammar Florian Chabot Q. C. Pham OCL 54 6 0 20 Dec 2022
AI applications in forest monitoring need remote sensing benchmark datasets E. Lines Matthew J. Allen Carlos Cabo K. Calders Amandine Debus S. Grieve Milto Miltiadou Adam Noach H. Owen Stefano Puliti 51 9 0 20 Dec 2022
Randomized Quantization: A Generic Augmentation for Data Agnostic Self-supervised Learning Huimin Wu Chenyang Lei Xiao Sun Pengju Wang Qifeng Chen Kwang-Ting Cheng Stephen Lin Zhirong Wu MQ 86 5 0 19 Dec 2022
ColoristaNet for Photorealistic Video Style Transfer Xiaowen Qiu Ruize Xu Boan He Yingtao Zhang Wenqiang Zhang Weifeng Ge 59 0 0 19 Dec 2022
Improving Unsupervised Video Object Segmentation with Motion-Appearance Synergy Long Lian Zhirong Wu Stella X. Yu VOS 61 0 0 17 Dec 2022
Fake it till you make it: Learning transferable representations from synthetic ImageNet clones Mert Bulent Sariyildiz Alahari Karteek Diane Larlus Yannis Kalantidis DiffM VLM 105 161 0 16 Dec 2022
DQnet: Cross-Model Detail Querying for Camouflaged Object Detection Wei Sun Chengao Liu Linyan Zhang Yu Li Pengxu Wei Chang-rui Liu J. Zou Jianbin Jiao QiXiang Ye 84 6 0 16 Dec 2022
Improving self-supervised representation learning via sequential adversarial masking Dylan Sam Min Bai Tristan McKinney Li Erran Li SSL 88 0 0 16 Dec 2022
MAViL: Masked Audio-Video Learners Po-Yao (Bernie) Huang Vasu Sharma Hu Xu Chaitanya K. Ryali Haoqi Fan Yanghao Li Shang-Wen Li Gargi Ghosh Jitendra Malik Christoph Feichtenhofer 81 54 0 15 Dec 2022
Rethinking Vision Transformers for MobileNet Size and Speed Yanyu Li Ju Hu Yang Wen Georgios Evangelidis Kamyar Salahi Yanzhi Wang Sergey Tulyakov Jian Ren ViT 112 169 0 15 Dec 2022
Unsupervised Object Localization: Observing the Background to Discover Objects Oriane Siméoni Chloé Sekkat Gilles Puy Antonín Vobecký Éloi Zablocki Patrick Pérez OCL SSL 81 59 0 15 Dec 2022
Efficient Self-supervised Learning with Contextualized Target Representations for Vision, Speech and Language Alexei Baevski Arun Babu Wei-Ning Hsu Michael Auli VLM SSL 129 97 0 14 Dec 2022
Learning 3D Representations from 2D Pre-trained Models via Image-to-Point Masked Autoencoders Renrui Zhang Liuhui Wang Yu Qiao Peng Gao Hongsheng Li 3DPC 92 136 0 13 Dec 2022
Boosting Semi-Supervised Learning with Contrastive Complementary Labeling Qinyi Deng Yong Guo Zhibang Yang Haolin Pan Jian Chen 119 10 0 13 Dec 2022
OAMixer: Object-aware Mixing Layer for Vision Transformers H. Kang Sangwoo Mo Jinwoo Shin VLM 119 4 0 13 Dec 2022
FastMIM: Expediting Masked Image Modeling Pre-training for Vision Jianyuan Guo Kai Han Han Wu Yehui Tang Yunhe Wang Chang Xu 80 10 0 13 Dec 2022
Semantics-Consistent Feature Search for Self-Supervised Visual Representation Learning Kaiyou Song Shanyi Zhang Zihao An Zimeng Luo Tongzhou Wang Jin Xie SSL 87 7 0 13 Dec 2022
Jointly Learning Visual and Auditory Speech Representations from Raw Data A. Haliassos Pingchuan Ma Rodrigo Mira Stavros Petridis Maja Pantic SSL 92 49 0 12 Dec 2022
ALSO: Automotive Lidar Self-supervision by Occupancy estimation Alexandre Boulch Corentin Sautier Bjoern Michele Gilles Puy Renaud Marlet SSL 3DPC 80 58 0 12 Dec 2022
DeepCut: Unsupervised Segmentation using Graph Neural Networks Clustering Amit Aflalo Shai Bagon Tamar Kashti Yonina C. Eldar GNN 97 35 0 12 Dec 2022
TriNet: stabilizing self-supervised learning from complete or slow collapse on ASR Lixin Cao Jun Wang Ben Yang Jane Polak Scowcroft Dong Yu 72 4 0 12 Dec 2022
Accelerating Self-Supervised Learning via Efficient Training Strategies Mustafa Taha Koccyiugit Timothy M. Hospedales Hakan Bilen SSL 66 8 0 11 Dec 2022
PromptCAL: Contrastive Affinity Learning via Auxiliary Prompts for Generalized Novel Category Discovery Shengxiang Zhang Salman Khan Zhiqiang Shen Muzammal Naseer Guangyi Chen Fahad Shahbaz Khan CLL VLM 71 63 0 11 Dec 2022
SEPT: Towards Scalable and Efficient Visual Pre-Training Yiqi Lin Huabin Zheng Huaping Zhong Jinjing Zhu Weijia Li Conghui He Lin Wang 80 2 0 11 Dec 2022
CLIP-TSA: CLIP-Assisted Temporal Self-Attention for Weakly-Supervised Video Anomaly Detection Kevin Hyekang Joo Khoa T. Vo Kashu Yamazaki Ngan Le 61 51 0 09 Dec 2022
Audiovisual Masked Autoencoders Mariana-Iuliana Georgescu Eduardo Fonseca Radu Tudor Ionescu Mario Lucic Cordelia Schmid Anurag Arnab SSL 118 45 0 09 Dec 2022
Open Vocabulary Semantic Segmentation with Patch Aligned Contrastive Learning Jishnu Mukhoti Tsung-Yu Lin Omid Poursaeed Rui Wang Ashish Shah Philip Torr Ser-Nam Lim VLM 135 83 0 09 Dec 2022
Co-training $2^L$ Submodels for Visual Recognition Hugo Touvron Matthieu Cord Maxime Oquab Piotr Bojanowski Jakob Verbeek Hervé Jégou VLM 72 10 0 09 Dec 2022
Implicit variance regularization in non-contrastive SSL Manu Srinath Halvagal Axel Laborieux Friedemann Zenke 126 10 0 09 Dec 2022
Benchmarking Self-Supervised Learning on Diverse Pathology Datasets Mingu Kang Heon Song Seonwook Park Donggeun Yoo Sérgio Pereira 63 138 0 09 Dec 2022
Self-Supervised Object Goal Navigation with In-Situ Finetuning So Yeon Min Yao-Hung Hubert Tsai Wei Ding Ali Farhadi Ruslan Salakhutdinov Yonatan Bisk Jian Zhang SSL 71 7 0 09 Dec 2022
Masked Video Distillation: Rethinking Masked Feature Modeling for Self-supervised Video Representation Learning Rui Wang Dongdong Chen Zuxuan Wu Yinpeng Chen Xiyang Dai Mengchen Liu Lu Yuan Yu-Gang Jiang VGen 124 94 0 08 Dec 2022
Group Generalized Mean Pooling for Vision Transformer ByungSoo Ko Han-Gyu Kim Byeongho Heo Sangdoo Yun Sanghyuk Chun Geonmo Gu Wonjae Kim ViT 88 1 0 08 Dec 2022
EPCL: Frozen CLIP Transformer is An Efficient Point Cloud Encoder Xiaoshui Huang Zhou Huang Shengjia Li Wentao Qu Tong He Yuenan Hou Yifan Zuo Wanli Ouyang 104 13 0 08 Dec 2022
Teaching Matters: Investigating the Role of Supervision in Vision Transformers Matthew Walmer Saksham Suri Kamal Gupta Abhinav Shrivastava 77 33 0 07 Dec 2022
Diffusion Art or Digital Forgery? Investigating Data Replication in Diffusion Models Gowthami Somepalli Vasu Singla Micah Goldblum Jonas Geiping Tom Goldstein 105 330 0 07 Dec 2022
GAMMA: Generative Augmentation for Attentive Marine Debris Detection Vaishnavi Khindkar Janhavi Khindkar ViT 64 1 0 07 Dec 2022
MEDIAR: Harmony of Data-Centric and Model-Centric for Multi-Modality Microscopy Gihun Lee Sangmook Kim Joonkee Kim Se-Young Yun MedIm 63 20 0 07 Dec 2022
Framework-agnostic Semantically-aware Global Reasoning for Segmentation Mir Rayat Imtiaz Hossain Leonid Sigal James J. Little ViT 50 0 0 06 Dec 2022
Giga-SSL: Self-Supervised Learning for Gigapixel Images Tristan Lazard Marvin Lerousseau Etienne Decencière Thomas Walter 77 19 0 06 Dec 2022
Visual Query Tuning: Towards Effective Usage of Intermediate Representations for Parameter and Memory Efficient Transfer Learning Cheng-Hao Tu Zheda Mai Wei-Lun Chao 57 48 0 06 Dec 2022