Deep Spectral Methods: A Surprisingly Strong Baseline for Unsupervised Semantic Segmentation and Localization

16 May 2022

Luke Melas-Kyriazi

Christian Rupprecht

Iro Laina

Andrea Vedaldi

ArXiv PDF HTML

Papers citing "Deep Spectral Methods: A Surprisingly Strong Baseline for Unsupervised Semantic Segmentation and Localization"

50 / 92 papers shown

Title
Distilling Spectral Graph for Object-Context Aware Open-Vocabulary Semantic Segmentation Chanyoung Kim Dayun Ju Woojung Han Ming-Hsuan Yang Seong Jae Hwang VLM VOS 241 1 0 26 Nov 2024
DiPEx: Dispersing Prompt Expansion for Class-Agnostic Object Detection Jia Syuen Lim Zhuoxiao Chen Mahsa Baktashmotlagh Zhi Chen Xin Yu Zi Huang Yadan Luo VLM ObjD 122 1 0 21 Jun 2024
A ConvNet for the 2020s Zhuang Liu Hanzi Mao Chaozheng Wu Christoph Feichtenhofer Trevor Darrell Saining Xie ViT 146 5,158 0 10 Jan 2022
ClevrTex: A Texture-Rich Benchmark for Unsupervised Multi-Object Segmentation Laurynas Karazija Iro Laina Christian Rupprecht 3DV VOS 97 90 0 19 Nov 2021
Unsupervised Part Discovery from Contrastive Reconstruction Subhabrata Choudhury Iro Laina Christian Rupprecht Andrea Vedaldi OCL SSL 233 62 0 11 Nov 2021
Localizing Objects with Self-Supervised Transformers and no Labels Oriane Siméoni Gilles Puy Huy V. Vo Simon Roburin Spyros Gidaris Andrei Bursuc P. Pérez Renaud Marlet Jean Ponce ViT 216 201 0 29 Sep 2021
Temporal Knowledge Consistency for Unsupervised Visual Representation Learning Wei Feng Yuanjiang Wang Lihua Ma Ye Yuan Chi Zhang SSL 30 13 0 24 Aug 2021
XCiT: Cross-Covariance Image Transformers Alaaeldin El-Nouby Hugo Touvron Mathilde Caron Piotr Bojanowski Matthijs Douze ... Ivan Laptev Natalia Neverova Gabriel Synnaeve Jakob Verbeek Hervé Jégou ViT 134 510 0 17 Jun 2021
Large-Scale Unsupervised Object Discovery Huy V. Vo Elena Sizikova Cordelia Schmid P. Pérez Jean Ponce ObjD 118 55 0 12 Jun 2021
Efficient Iterative Amortized Inference for Learning Symmetric and Disentangled Multi-Object Representations Patrick Emami Pan He Sanjay Ranka Anand Rangarajan OCL 109 45 0 07 Jun 2021
Finding an Unsupervised Image Segmenter in Each of Your Deep Generative Models Luke Melas-Kyriazi Christian Rupprecht Iro Laina Andrea Vedaldi OCL 70 53 0 17 May 2021
Universal Weakly Supervised Segmentation by Pixel-to-Segment Contrastive Learning Tsung-Wei Ke Jyh-Jing Hwang Stella X. Yu SSL 77 75 0 03 May 2021
Unsupervised Layered Image Decomposition into Object Prototypes Tom Monnier Elliot Vincent Jean Ponce Mathieu Aubry OCL 35 53 0 29 Apr 2021
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 613 6,029 0 29 Apr 2021
Semantic Image Matting Yanan Sun Chi-Keung Tang Yu-Wing Tai 60 87 0 16 Apr 2021
SiT: Self-supervised vIsion Transformer Sara Atito Ali Ahmed Muhammad Awais J. Kittler ViT 59 139 0 08 Apr 2021
An Empirical Study of Training Self-Supervised Vision Transformers Xinlei Chen Saining Xie Kaiming He ViT 146 1,857 0 05 Apr 2021
LeViT: a Vision Transformer in ConvNet's Clothing for Faster Inference Ben Graham Alaaeldin El-Nouby Hugo Touvron Pierre Stock Armand Joulin Hervé Jégou Matthijs Douze ViT 62 788 0 02 Apr 2021
Going deeper with Image Transformers Hugo Touvron Matthieu Cord Alexandre Sablayrolles Gabriel Synnaeve Hervé Jégou ViT 133 1,006 0 31 Mar 2021
Rethinking Spatial Dimensions of Vision Transformers Byeongho Heo Sangdoo Yun Dongyoon Han Sanghyuk Chun Junsuk Choe Seong Joon Oh ViT 494 578 0 30 Mar 2021
CvT: Introducing Convolutions to Vision Transformers Haiping Wu Bin Xiao Noel Codella Mengchen Liu Xiyang Dai Lu Yuan Lei Zhang ViT 136 1,907 0 29 Mar 2021
Labels4Free: Unsupervised Segmentation using StyleGAN Rameen Abdal Peihao Zhu Niloy Mitra Peter Wonka 93 83 0 27 Mar 2021
CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classification Chun-Fu Chen Quanfu Fan Yikang Shen ViT 68 1,477 0 27 Mar 2021
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows Ze Liu Yutong Lin Yue Cao Han Hu Yixuan Wei Zheng Zhang Stephen Lin B. Guo ViT 421 21,347 0 25 Mar 2021
DeepViT: Towards Deeper Vision Transformer Daquan Zhou Bingyi Kang Xiaojie Jin Linjie Yang Xiaochen Lian Zihang Jiang Qibin Hou Jiashi Feng ViT 81 518 0 22 Mar 2021
Barlow Twins: Self-Supervised Learning via Redundancy Reduction Jure Zbontar Li Jing Ishan Misra Yann LeCun Stéphane Deny SSL 296 2,338 0 04 Mar 2021
Learning Transferable Visual Models From Natural Language Supervision Alec Radford Jong Wook Kim Chris Hallacy Aditya A. Ramesh Gabriel Goh ... Amanda Askell Pamela Mishkin Jack Clark Gretchen Krueger Ilya Sutskever CLIP VLM 826 29,341 0 26 Feb 2021
Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision Chao Jia Yinfei Yang Ye Xia Yi-Ting Chen Zarana Parekh Hieu H. Pham Quoc V. Le Yun-hsuan Sung Zhen Li Tom Duerig VLM CLIP 422 3,826 0 11 Feb 2021
Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet Li-xin Yuan Yunpeng Chen Tao Wang Weihao Yu Yujun Shi Zihang Jiang Francis E. H. Tay Jiashi Feng Shuicheng Yan ViT 119 1,935 0 28 Jan 2021
Training data-efficient image transformers & distillation through attention Hugo Touvron Matthieu Cord Matthijs Douze Francisco Massa Alexandre Sablayrolles Hervé Jégou ViT 361 6,757 0 23 Dec 2020
Self-Supervised Visual Representation Learning from Hierarchical Grouping Xiao Zhang Michael Maire SSL 65 74 0 05 Dec 2020
Exploring Simple Siamese Representation Learning Xinlei Chen Kaiming He SSL 247 4,047 0 20 Nov 2020
Propagate Yourself: Exploring Pixel-Level Consistency for Unsupervised Visual Representation Learning Zhenda Xie Yutong Lin Zheng Zhang Yue Cao Stephen Lin Han Hu SSL 99 413 0 19 Nov 2020
Dense Contrastive Learning for Self-Supervised Visual Pre-Training Xinlong Wang Rufeng Zhang Chunhua Shen Tao Kong Lei Li SSL 72 683 0 18 Nov 2020
Unsupervised Learning of Dense Visual Representations Pedro H. O. Pinheiro Amjad Almahairi Ryan Y. Benmalek Florian Golemo Aaron Courville SSL MDE 98 193 0 11 Nov 2020
The Mathematical Foundations of Manifold Learning Luke Melas-Kyriazi AI4CE 40 18 0 30 Oct 2020
Image Representations Learned With Unsupervised Pre-Training Contain Human-like Biases Ryan Steed Aylin Caliskan SSL 58 160 0 28 Oct 2020
Hard Negative Mixing for Contrastive Learning Yannis Kalantidis Mert Bulent Sariyildiz Noé Pion Philippe Weinzaepfel Diane Larlus SSL 122 643 0 02 Oct 2020
Toward unsupervised, multi-object discovery in large-scale image collections Huy V. Vo P. Pérez Jean Ponce OCL 51 74 0 06 Jul 2020
Object-Centric Learning with Slot Attention Francesco Locatello Dirk Weissenborn Thomas Unterthiner Aravindh Mahendran G. Heigold Jakob Uszkoreit Alexey Dosovitskiy Thomas Kipf OCL 212 844 0 26 Jun 2020
Large image datasets: A pyrrhic win for computer vision? Vinay Uday Prabhu Abeba Birhane 57 366 0 24 Jun 2020
Unsupervised Learning of Visual Features by Contrasting Cluster Assignments Mathilde Caron Ishan Misra Julien Mairal Priya Goyal Piotr Bojanowski Armand Joulin OCL SSL 215 4,070 0 17 Jun 2020
Bootstrap your own latent: A new approach to self-supervised Learning Jean-Bastien Grill Florian Strub Florent Altché Corentin Tallec Pierre Harvey Richemond ... M. G. Azar Bilal Piot Koray Kavukcuoglu Rémi Munos Michal Valko SSL 347 6,773 0 13 Jun 2020
Object Segmentation Without Labels with Large-Scale Generative Models A. Voynov S. Morozov Artem Babenko SSL OCL VLM 55 61 0 08 Jun 2020
What Makes for Good Views for Contrastive Learning? Yonglong Tian Chen Sun Ben Poole Dilip Krishnan Cordelia Schmid Phillip Isola SSL 84 1,323 0 20 May 2020
Prototypical Contrastive Learning of Unsupervised Representations Junnan Li Pan Zhou Caiming Xiong Guosheng Lin SSL DRL 134 971 0 11 May 2020
PyMatting: A Python Library for Alpha Matting Thomas Germer Tobias Uelwer Stefan Conrad Stefan Harmeling VOS 20 16 0 25 Mar 2020
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 452 3,422 0 09 Mar 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 339 18,721 0 13 Feb 2020
SPACE: Unsupervised Object-Oriented Scene Representation via Spatial Attention and Decomposition Zhixuan Lin Yi-Fu Wu Skand Peri Weihao Sun Gautam Singh Fei Deng Jindong Jiang Sungjin Ahn BDL OCL 3DPC 154 250 0 08 Jan 2020