v1v2 (latest)

Emerging Properties in Self-Supervised Vision Transformers

29 April 2021

Papers citing "Emerging Properties in Self-Supervised Vision Transformers"

50 / 4,175 papers shown

Title
MAMO: Masked Multimodal Modeling for Fine-Grained Vision-Language Representation Learning Zijia Zhao Longteng Guo Xingjian He Shuai Shao Zehuan Yuan Jing Liu 105 9 0 09 Oct 2022
Grow and Merge: A Unified Framework for Continuous Categories Discovery Xinwei Zhang Jianwen Jiang Yutong Feng Zhi-Fan Wu Xibin Zhao Hai Wan Mingqian Tang Rong Jin Yue Gao CLL 78 31 0 09 Oct 2022
VoLTA: Vision-Language Transformer with Weakly-Supervised Local-Feature Alignment Shraman Pramanick Li Jing Sayan Nag Jiachen Zhu Hardik Shah Yann LeCun Ramalingam Chellappa 82 22 0 09 Oct 2022
In What Ways Are Deep Neural Networks Invariant and How Should We Measure This? Henry Kvinge Tegan H. Emerson Grayson Jorgenson Scott Vasquez T. Doster Jesse D. Lew 84 9 0 07 Oct 2022
Bi-directional Weakly Supervised Knowledge Distillation for Whole Slide Image Classification Linhao Qu Xiao-Zhuo Luo Manning Wang Zhijian Song WSOD 105 61 0 07 Oct 2022
EmbryosFormer: Deformable Transformer and Collaborative Encoding-Decoding for Embryos Stage Development Classification Tien-Phat Nguyen Trong-Thang Pham Tri Minh Nguyen Hung Le Dung Nguyen Hau Lam Phong H. Nguyen Jennifer Fowler Minh-Triet Tran Ngan Le ViT 91 17 0 07 Oct 2022
Content-Based Search for Deep Generative Models Daohan Lu Sheng-Yu Wang Nupur Kumari Rohan Agarwal Mia Tang David Bau Jun-Yan Zhu DiffM SyDa 101 6 0 06 Oct 2022
Env-Aware Anomaly Detection: Ignore Style Changes, Stay True to Content! Stefan Smeu Elena Burceanu Andrei Liviu Nicolicioiu Emanuela Haller 81 4 0 06 Oct 2022
Structure Representation Network and Uncertainty Feedback Learning for Dense Non-Uniform Fog Removal Yeying Jin Wending Yan Wenhan Yang R. Tan 100 41 0 06 Oct 2022
Feature-Realistic Neural Fusion for Real-Time, Open Set Scene Understanding Kirill Mazur Edgar Sucar Andrew J. Davison 3DPC AI4CE 151 45 0 06 Oct 2022
Effective Self-supervised Pre-training on Low-compute Networks without Distillation Fuwen Tan F. Saleh Brais Martínez 81 4 0 06 Oct 2022
Active Image Indexing Pierre Fernandez Matthijs Douze Hervé Jégou Teddy Furon VLM 67 10 0 05 Oct 2022
Promising or Elusive? Unsupervised Object Segmentation from Real-world Single Images Yafei Yang Bo Yang OCL 153 18 0 05 Oct 2022
Granularity-aware Adaptation for Image Retrieval over Multiple Tasks Jon Almazán ByungSoo Ko Geonmo Gu Diane Larlus Yannis Kalantidis ObjD VLM 94 7 0 05 Oct 2022
RankMe: Assessing the downstream performance of pretrained self-supervised representations by their rank Q. Garrido Randall Balestriero Laurent Najman Yann LeCun SSL 138 79 0 05 Oct 2022
Relational Proxies: Emergent Relationships as Fine-Grained Discriminators Abhra Chaudhuri Massimiliano Mancini Zeynep Akata Anjan Dutta 60 4 0 05 Oct 2022
Exploring The Role of Mean Teachers in Self-supervised Masked Auto-Encoders Youngwan Lee Jeffrey Willette Jonghee Kim Juho Lee Sung Ju Hwang 93 16 0 05 Oct 2022
ASIF: Coupled Data Turns Unimodal Models to Multimodal Without Training Antonio Norelli Marco Fumero Valentino Maiorca Luca Moschella Emanuele Rodolà Francesco Locatello VLM 166 36 0 04 Oct 2022
VICRegL: Self-Supervised Learning of Local Visual Features Adrien Bardes Jean Ponce Yann LeCun SSL 99 126 0 04 Oct 2022
Rank-N-Contrast: Learning Continuous Representations for Regression Kaiwen Zha Peng Cao Jeany Son Yuzhe Yang Dina Katabi CML 142 43 0 03 Oct 2022
LPT: Long-tailed Prompt Tuning for Image Classification Bowen Dong Pan Zhou Shuicheng Yan W. Zuo VPVLM VLM 177 61 0 03 Oct 2022
Attention Distillation: self-supervised vision transformer students need more guidance Kai Wang Fei Yang Joost van de Weijer ViT 57 18 0 03 Oct 2022
Improving Sample Quality of Diffusion Models Using Self-Attention Guidance Susung Hong Gyuseong Lee Wooseok Jang Seung Wook Kim DiffM 131 105 0 03 Oct 2022
Pixel-global Self-supervised Learning with Uncertainty-aware Context Stabilizer Zhuangzhuang Zhang Weixiong Zhang 24 0 0 02 Oct 2022
What shapes the loss landscape of self-supervised learning? Liu Ziyin Ekdeep Singh Lubana Masakuni Ueda Hidenori Tanaka 105 21 0 02 Oct 2022
Learning Hierarchical Image Segmentation For Recognition and By Recognition Tsung-Wei Ke Sangwoo Mo Stella X. Yu VLM 136 11 0 01 Oct 2022
Motion-inductive Self-supervised Object Discovery in Videos Shuangrui Ding Weidi Xie Yabo Chen Rui Qian Xiaopeng Zhang H. Xiong Q. Tian VOS 58 18 0 01 Oct 2022
Multimodality Multi-Lead ECG Arrhythmia Classification using Self-Supervised Learning Thi-Thu-Hong Phan Duc Le Brijesh Patel Donald Adjeroh Jingxian Wu M. Jensen Ngan Le 77 11 0 30 Sep 2022
Where Should I Spend My FLOPS? Efficiency Evaluations of Visual Pre-training Methods Skanda Koppula Yazhe Li Evan Shelhamer Andrew Jaegle Nikhil Parthasarathy Relja Arandjelović João Carreira Olivier J. Hénaff 84 9 0 30 Sep 2022
Diffusion-based Image Translation using Disentangled Style and Content Representation Gihyun Kwon Jong Chul Ye DiffM 238 160 0 30 Sep 2022
Dual Progressive Transformations for Weakly Supervised Semantic Segmentation Dong Huo Yukun Su Qingyao Wu ViT 88 4 0 30 Sep 2022
Self-Distillation for Further Pre-training of Transformers Seanie Lee Minki Kang Juho Lee Sung Ju Hwang Kenji Kawaguchi 100 8 0 30 Sep 2022
Understanding Collapse in Non-Contrastive Siamese Representation Learning Alexander C. Li Alexei A. Efros Deepak Pathak SSL 94 35 0 29 Sep 2022
Variance Covariance Regularization Enforces Pairwise Independence in Self-Supervised Representations Grégoire Mialon Randall Balestriero Yann LeCun 98 10 0 29 Sep 2022
Bridging the Gap to Real-World Object-Centric Learning Maximilian Seitzer Max Horn Andrii Zadaianchuk Dominik Zietlow Tianjun Xiao ... Tong He Zheng Zhang Bernhard Schölkopf Thomas Brox Francesco Locatello OCL 139 153 0 29 Sep 2022
Audio Barlow Twins: Self-Supervised Audio Representation Learning Jonah Anton H. Coppock Pancham Shukla Bjorn W. Schuller BDL SSL 81 8 0 28 Sep 2022
Obj2Seq: Formatting Objects as Sequences with Class Prompt for Visual Tasks Zhiyang Chen Yousong Zhu Zhaowen Li Fan Yang Wei Li ... Chaoyang Zhao Liwei Wu Rui Zhao Jinqiao Wang Ming Tang VLM VOS 124 16 0 28 Sep 2022
Revisiting Few-Shot Learning from a Causal Perspective Guoliang Lin Yongheng Xu Hanjiang Lai Jian Yin CML 108 3 0 28 Sep 2022
FreeSeg: Free Mask from Interpretable Contrastive Language-Image Pretraining for Semantic Segmentation Yi Li Huifeng Yao Hualiang Wang Xuelong Li ISeg VLM 93 3 0 27 Sep 2022
Baking in the Feature: Accelerating Volumetric Segmentation by Rendering Feature Maps Kenneth Blomqvist Lionel Ott Jen Jen Chung Roland Siegwart 63 11 0 26 Sep 2022
VAESim: A probabilistic approach for self-supervised prototype discovery Matteo Ferrante T. Boccato Simeon E. Spasov A. Duggento N. Toschi 21 4 0 25 Sep 2022
Collaboration of Pre-trained Models Makes Better Few-shot Learner Renrui Zhang Bohao Li Wei Zhang Hao Dong Hongsheng Li Peng Gao Yu Qiao VLM 114 7 0 25 Sep 2022
Contrastive learning for unsupervised medical image clustering and reconstruction Matteo Ferrante T. Boccato Simeon E. Spasov A. Duggento N. Toschi SSL DRL 68 2 0 24 Sep 2022
GIDP: Learning a Good Initialization and Inducing Descriptor Post-enhancing for Large-scale Place Recognition Zhaoxin Fan Zhenbo Song Hongyan Liu Jun He 121 0 0 23 Sep 2022
NamedMask: Distilling Segmenters from Complementary Foundation Models Gyungin Shin Weidi Xie Samuel Albanie ISeg VLM 106 23 0 22 Sep 2022
Self-supervised Learning for Clustering of Wireless Spectrum Activity Ljupcho Milosheski Gregor Cerar Blaž Bertalanič Carolina Fortuna M. Mohorčič 61 4 0 22 Sep 2022
Pretraining the Vision Transformer using self-supervised methods for vision based Deep Reinforcement Learning Manuel Goulão Arlindo L. Oliveira ViT 109 6 0 22 Sep 2022
Lightweight Transformers for Human Activity Recognition on Mobile Devices Sannara Ek François Portet P. Lalanda 83 32 0 22 Sep 2022
A Simple and Powerful Global Optimization for Unsupervised Video Object Segmentation Georgy Ponimatkin Nermin Samet Yanghua Xiao Yuming Du Renaud Marlet Vincent Lepetit VOS 120 20 0 19 Sep 2022
Panoramic Vision Transformer for Saliency Detection in 360° Videos Heeseung Yun Se-Ho Lee Gunhee Kim ViT MDE 83 18 0 19 Sep 2022