v1v2 (latest)

SAVi++: Towards End-to-End Object-Centric Learning from Real-World Videos

15 June 2022

Gamaleldin F. Elsayed

Aravindh Mahendran

Sjoerd van Steenkiste

Papers citing "SAVi++: Towards End-to-End Object-Centric Learning from Real-World Videos"

50 / 57 papers shown

Title
Object-Centric Representations Improve Policy Generalization in Robot Manipulation Alexandre Chapin Bruno Machado Emmanuel Dellandrea Liming Chen OCL 132 0 0 16 May 2025
Vector-Quantized Vision Foundation Models for Object-Centric Learning Rongzhen Zhao V. Wang Arno Solin Joni Pajarinen OCL VLM 547 1 0 27 Feb 2025
Dynamic Scene Understanding through Object-Centric Voxelization and Neural Rendering Yanpeng Zhao Yiwei Hao Siyu Gao Yunbo Wang Xiaokang Yang OCL 258 1 0 17 Feb 2025
Object-Centric Image to Video Generation with Language Guidance Angel Villar-Corrales Gjergj Plepi Sven Behnke DiffM VGen OCL 237 1 0 17 Feb 2025
PlaySlot: Learning Inverse Latent Dynamics for Controllable Object-Centric Video Prediction and Planning Angel Villar-Corrales Sven Behnke 213 4 0 11 Feb 2025
Slot-BERT: Self-supervised Object Discovery in Surgical Video Guiqiu Liao M. Jogan Marcel Hussing Kenta Nakahashi Kazuhiro Yasufuku Amin Madani Eric Eaton Daniel A. Hashimoto 468 0 0 21 Jan 2025
Object-centric proto-symbolic behavioural reasoning from pixels R. S. V. Bergen Justus F. Hübotter Pablo Lanillos LM&Ro OCL 187 1 0 26 Nov 2024
Multi-Scale Fusion for Object Representation Rongzhen Zhao V. Wang Arno Solin Joni Pajarinen OCL VOS 108 1 0 02 Oct 2024
Exploring the Effectiveness of Object-Centric Representations in Visual Question Answering: Comparative Insights with Foundation Models Amir Mohammad Karimi Mamaghan Samuele Papa Karl Henrik Johansson Stefan Bauer Andrea Dittadi OCL 160 9 0 22 Jul 2024
Reasoning-Enhanced Object-Centric Learning for Videos Jian Li Pu Ren Yang Liu Hao Sun OCL LRM 117 2 0 22 Mar 2024
Neural Slot Interpreters: Grounding Object Semantics in Emergent Slot Representations Bhishma Dedhia N. Jha OCL 125 1 0 02 Feb 2024
Drive&Segment: Unsupervised Semantic Segmentation of Urban Scenes via Cross-modal Distillation Antonín Vobecký David Hurych Oriane Siméoni Spyros Gidaris Andrei Bursuc Patrick Pérez Josef Sivic 3DPC 65 21 0 21 Mar 2022
Discovering Objects that Can Move Zhipeng Bao P. Tokmakov Allan Jabri Yu-Xiong Wang Adrien Gaidon M. Hebert OCL 98 44 0 18 Mar 2022
Object discovery and representation networks Olivier J. Hénaff Skanda Koppula Evan Shelhamer Daniel Zoran Andrew Jaegle Andrew Zisserman João Carreira Relja Arandjelović 96 89 0 16 Mar 2022
Kubric: A scalable dataset generator Klaus Greff Francois Belletti Lucas Beyer Carl Doersch Yilun Du ... Ziyu Wang Tianhao Wu K. M. Yi Fangcheng Zhong Andrea Tagliasacchi 107 268 0 07 Mar 2022
GroupViT: Semantic Segmentation Emerges from Text Supervision Jiarui Xu Shalini De Mello Sifei Liu Wonmin Byeon Thomas Breuel Jan Kautz Xinyu Wang ViT VLM 292 527 0 22 Feb 2022
Slot-VPS: Object-centric Representation Learning for Video Panoptic Segmentation Yi Zhou Hui Zhang Hana Lee Shuyang Sun Pingjun Li Yangguang Zhu ByungIn Yoo Xiaojuan Qi Jae-Joon Han VOS 67 28 0 16 Dec 2021
Conditional Object-Centric Learning from Video Thomas Kipf Gamaleldin F. Elsayed Aravindh Mahendran Austin Stone S. Sabour G. Heigold Rico Jonschkowski Alexey Dosovitskiy Klaus Greff OCL 136 218 0 24 Nov 2021
ClevrTex: A Texture-Rich Benchmark for Unsupervised Multi-Object Segmentation Laurynas Karazija Iro Laina Christian Rupprecht 3DV VOS 144 90 0 19 Nov 2021
SIMONe: View-Invariant, Temporally-Abstracted Object Representations via Unsupervised Video Decomposition Rishabh Kabra Daniel Zoran Goker Erdogan Loic Matthey Antonia Creswell M. Botvinick Alexander Lerchner Christopher P. Burgess OCL 118 79 0 07 Jun 2021
MDETR -- Modulated Detection for End-to-End Multi-Modal Understanding Aishwarya Kamath Mannat Singh Yann LeCun Gabriel Synnaeve Ishan Misra Nicolas Carion ObjD VLM 190 890 0 26 Apr 2021
Self-supervised Video Object Segmentation by Motion Grouping Charig Yang Hala Lamdouar Erika Lu Andrew Zisserman Weidi Xie VOS OCL 88 162 0 15 Apr 2021
Track, Check, Repeat: An EM Approach to Unsupervised Tracking Adam W. Harley Yiming Zuo Jing Wen Ayush Mangal Shubhankar Potdar Ritwick Chaudhry Katerina Fragkiadaki 72 9 0 07 Apr 2021
Vision Transformers for Dense Prediction René Ranftl Alexey Bochkovskiy V. Koltun ViT MDE 138 1,747 0 24 Mar 2021
TrackFormer: Multi-Object Tracking with Transformers Tim Meinhardt A. Kirillov Laura Leal-Taixe Christoph Feichtenhofer VOT 281 775 0 07 Jan 2021
On the Binding Problem in Artificial Neural Networks Klaus Greff Sjoerd van Steenkiste Jürgen Schmidhuber OCL 306 267 0 09 Dec 2020
Unsupervised Object Detection with LiDAR Clues Haofei Tian Yuntao Chen Jifeng Dai Zhaoxiang Zhang Xizhou Zhu 3DPC 86 28 0 25 Nov 2020
Learning Object-Centric Video Models by Contrasting Sets Sindy Löwe Klaus Greff Rico Jonschkowski Alexey Dosovitskiy Thomas Kipf SSL OCL 59 24 0 20 Nov 2020
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 684 41,563 0 22 Oct 2020
Object-Centric Learning with Slot Attention Francesco Locatello Dirk Weissenborn Thomas Unterthiner Aravindh Mahendran G. Heigold Jakob Uszkoreit Alexey Dosovitskiy Thomas Kipf OCL 227 859 0 26 Jun 2020
Space-Time Correspondence as a Contrastive Random Walk Allan Jabri Andrew Owens Alexei A. Efros SSL OT 109 303 0 25 Jun 2020
Learning Physical Graph Representations from Visual Scenes Daniel M. Bear Chaofei Fan Damian Mrowca Yunzhu Li S. Alter ... Jeremy Schwartz Li Fei-Fei Jiajun Wu J. Tenenbaum Daniel L. K. Yamins SSL GNN SSeg AI4CE 94 79 0 22 Jun 2020
End-to-End Object Detection with Transformers Nicolas Carion Francisco Massa Gabriel Synnaeve Nicolas Usunier Alexander Kirillov Sergey Zagoruyko ViT 3DV PINN 456 13,130 0 26 May 2020
TAO: A Large-Scale Benchmark for Tracking Any Object Achal Dave Tarasha Khurana P. Tokmakov Cordelia Schmid Deva Ramanan 75 180 0 20 May 2020
On Layer Normalization in the Transformer Architecture Ruibin Xiong Yunchang Yang Di He Kai Zheng Shuxin Zheng Chen Xing Huishuai Zhang Yanyan Lan Liwei Wang Tie-Yan Liu AI4CE 153 998 0 12 Feb 2020
Big Transfer (BiT): General Visual Representation Learning Alexander Kolesnikov Lucas Beyer Xiaohua Zhai J. Puigcerver Jessica Yung Sylvain Gelly N. Houlsby MQ 289 1,211 0 24 Dec 2019
Scalability in Perception for Autonomous Driving: Waymo Open Dataset Pei Sun Henrik Kretzschmar Xerxes Dotiwalla Aurelien Chouard Vijaysai Patnaik ... Shuyang Cheng Yu Zhang Jonathon Shlens Zhifeng Chen Dragomir Anguelov 152 2,907 0 10 Dec 2019
Contrastive Learning of Structured World Models Thomas Kipf Elise van der Pol Max Welling OCL DRL 104 285 0 27 Nov 2019
Entity Abstraction in Visual Model-Based Reinforcement Learning Rishi Veerapaneni John D. Co-Reyes Michael Chang Michael Janner Chelsea Finn Jiajun Wu J. Tenenbaum Sergey Levine OCL OffRL 126 189 0 28 Oct 2019
CATER: A diagnostic dataset for Compositional Actions and TEmporal Reasoning Rohit Girdhar Deva Ramanan 101 178 0 10 Oct 2019
SCALOR: Generative World Models with Scalable Object Representations Jindong Jiang Sepehr Janghorbani Gerard de Melo Sungjin Ahn OCL DRL 101 133 0 06 Oct 2019
The 2019 DAVIS Challenge on VOS: Unsupervised Multi-Object Segmentation Sergi Caelles Jordi Pont-Tuset Federico Perazzi Alberto Montes Kevis-Kokitsi Maninis Luc Van Gool VOS 101 147 0 02 May 2019
Multi-Object Representation Learning with Iterative Variational Inference Klaus Greff Raphael Lopez Kaufman Rishabh Kabra Nicholas Watters Christopher P. Burgess Daniel Zoran Loic Matthey M. Botvinick Alexander Lerchner OCL SSL 106 510 0 01 Mar 2019
MONet: Unsupervised Scene Decomposition and Representation Christopher P. Burgess Loic Matthey Nicholas Watters Rishabh Kabra I. Higgins M. Botvinick Alexander Lerchner OCL 90 531 0 22 Jan 2019
Deep Ordinal Regression Network for Monocular Depth Estimation Huan Fu Biwei Huang Chaohui Wang Kayhan Batmanghelich Dacheng Tao MDE 486 1,736 0 06 Jun 2018
Sequential Attend, Infer, Repeat: Generative Modelling of Moving Objects Adam R. Kosiorek Hyunjik Kim Ingmar Posner Yee Whye Teh BDL 100 258 0 05 Jun 2018
Group Normalization Yuxin Wu Kaiming He 249 3,676 0 22 Mar 2018
Relational Neural Expectation Maximization: Unsupervised Discovery of Objects and their Interactions Sjoerd van Steenkiste Michael Chang Klaus Greff Jürgen Schmidhuber BDL OCL DRL 209 292 0 28 Feb 2018
Deep Image Prior Dmitry Ulyanov Andrea Vedaldi Victor Lempitsky SupR 135 3,167 0 29 Nov 2017
Neural Expectation Maximization Klaus Greff Sjoerd van Steenkiste Jürgen Schmidhuber OCL 134 287 0 11 Aug 2017