v1v2 (latest)

Conditional Object-Centric Learning from Video

24 November 2021

Thomas Kipf

Gamaleldin F. Elsayed

Alexey Dosovitskiy

Papers citing "Conditional Object-Centric Learning from Video"

50 / 81 papers shown

Title
CTRL-O: Language-Controllable Object-Centric Visual Representation Learning Aniket Didolkar Andrii Zadaianchuk Rabiul Awal Maximilian Seitzer E. Gavves Aishwarya Agrawal OCL VLM 170 3 0 27 Mar 2025
Vector-Quantized Vision Foundation Models for Object-Centric Learning Rongzhen Zhao V. Wang Arno Solin Joni Pajarinen OCL VLM 530 1 0 27 Feb 2025
Dynamic Scene Understanding through Object-Centric Voxelization and Neural Rendering Yanpeng Zhao Yiwei Hao Siyu Gao Yunbo Wang Xiaokang Yang OCL 248 1 0 17 Feb 2025
Object-Centric Image to Video Generation with Language Guidance Angel Villar-Corrales Gjergj Plepi Sven Behnke DiffM VGen OCL 235 1 0 17 Feb 2025
Object-Centric Latent Action Learning Albina Klepach Alexander Nikulin Ilya Zisman Denis Tarasov Alexander Derevyagin Andrei Polubarov Nikita Lyubaykin Vladislav Kurenkov 113 0 0 13 Feb 2025
PlaySlot: Learning Inverse Latent Dynamics for Controllable Object-Centric Video Prediction and Planning Angel Villar-Corrales Sven Behnke 204 4 0 11 Feb 2025
Slot-BERT: Self-supervised Object Discovery in Surgical Video Guiqiu Liao M. Jogan Marcel Hussing Kenta Nakahashi Kazuhiro Yasufuku Amin Madani Eric Eaton Daniel A. Hashimoto 438 0 0 21 Jan 2025
FACTS: A Factored State-Space Framework For World Modelling Li Nanbo Firas Laakom Yucheng Xu Wenyi Wang Jürgen Schmidhuber AI4TS 521 1 0 28 Oct 2024
Multi-Scale Fusion for Object Representation Rongzhen Zhao V. Wang Arno Solin Joni Pajarinen OCL VOS 99 1 0 02 Oct 2024
Exploring the Effectiveness of Object-Centric Representations in Visual Question Answering: Comparative Insights with Foundation Models Amir Mohammad Karimi Mamaghan Samuele Papa Karl Henrik Johansson Stefan Bauer Andrea Dittadi OCL 132 9 0 22 Jul 2024
Reasoning-Enhanced Object-Centric Learning for Videos Jian Li Pu Ren Yang Liu Hao Sun OCL LRM 115 2 0 22 Mar 2024
Neural Slot Interpreters: Grounding Object Semantics in Emergent Slot Representations Bhishma Dedhia N. Jha OCL 109 1 0 02 Feb 2024
Explicitly Disentangled Representations in Object-Centric Learning Riccardo Majellaro Jonathan Collu Aske Plaat Thomas M. Moerland CoGe OOD OCL 141 1 0 18 Jan 2024
ClevrTex: A Texture-Rich Benchmark for Unsupervised Multi-Object Segmentation Laurynas Karazija Iro Laina Christian Rupprecht 3DV VOS 127 90 0 19 Nov 2021
Unsupervised Learning of Compositional Energy Concepts Yilun Du Shuang Li Yash Sharma J. Tenenbaum Igor Mordatch CoGe OCL 74 81 0 04 Nov 2021
Dynamic Visual Reasoning by Learning Differentiable Physics Models from Video and Language Mingyu Ding Zhenfang Chen Tao Du Ping Luo J. Tenenbaum Chuang Gan VGen PINN OCL 90 75 0 28 Oct 2021
Perceiver IO: A General Architecture for Structured Inputs & Outputs Andrew Jaegle Sebastian Borgeaud Jean-Baptiste Alayrac Carl Doersch Catalin Ionescu ... Olivier J. Hénaff M. Botvinick Andrew Zisserman Oriol Vinyals João Carreira MLLM VLM GNN 82 584 0 30 Jul 2021
SIMONe: View-Invariant, Temporally-Abstracted Object Representations via Unsupervised Video Decomposition Rishabh Kabra Daniel Zoran Goker Erdogan Loic Matthey Antonia Creswell M. Botvinick Alexander Lerchner Christopher P. Burgess OCL 105 79 0 07 Jun 2021
SMURF: Self-Teaching Multi-Frame Unsupervised RAFT with Full-Image Warping Austin Stone Daniel Maurer Alper Ayvaci A. Angelova Rico Jonschkowski 98 84 0 14 May 2021
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 706 6,121 0 29 Apr 2021
MDETR -- Modulated Detection for End-to-End Multi-Modal Understanding Aishwarya Kamath Mannat Singh Yann LeCun Gabriel Synnaeve Ishan Misra Nicolas Carion ObjD VLM 182 889 0 26 Apr 2021
Self-supervised Video Object Segmentation by Motion Grouping Charig Yang Hala Lamdouar Erika Lu Andrew Zisserman Weidi Xie VOS OCL 80 162 0 15 Apr 2021
Track, Check, Repeat: An EM Approach to Unsupervised Tracking Adam W. Harley Yiming Zuo Jing Wen Ayush Mangal Shubhankar Potdar Ritwick Chaudhry Katerina Fragkiadaki 72 9 0 07 Apr 2021
Decomposing 3D Scenes into Objects via Unsupervised Volume Segmentation Karl Stelzner Kristian Kersting Adam R. Kosiorek 126 108 0 02 Apr 2021
Grounding Physical Concepts of Objects and Events Through Dynamic Visual Reasoning Zhenfang Chen Jiayuan Mao Jiajun Wu Kwan-Yee K. Wong J. Tenenbaum Chuang Gan VGen 81 94 0 30 Mar 2021
Unsupervised Object-Based Transition Models for 3D Partially Observable Environments Antonia Creswell Rishabh Kabra Christopher P. Burgess Murray Shanahan OCL 95 29 0 08 Mar 2021
Perceiver: General Perception with Iterative Attention Andrew Jaegle Felix Gimeno Andrew Brock Andrew Zisserman Oriol Vinyals João Carreira VLM ViT MDE 204 1,022 0 04 Mar 2021
Neural Production Systems: Learning Rule-Governed Visual Dynamics Anirudh Goyal Aniket Didolkar Nan Rosemary Ke Charles Blundell Philippe Beaudoin N. Heess Michael C. Mozer Yoshua Bengio OCL 91 86 0 02 Mar 2021
TrackFormer: Multi-Object Tracking with Transformers Tim Meinhardt A. Kirillov Laura Leal-Taixe Christoph Feichtenhofer VOT 271 774 0 07 Jan 2021
Attention over learned object embeddings enables complex visual reasoning David Ding Felix Hill Adam Santoro Malcolm Reynolds M. Botvinick OCL 102 71 0 15 Dec 2020
On the Binding Problem in Artificial Neural Networks Klaus Greff Sjoerd van Steenkiste Jürgen Schmidhuber OCL 306 264 0 09 Dec 2020
Unsupervised part representation by Flow Capsules S. Sabour Andrea Tagliasacchi S. Yazdani Geoffrey E. Hinton David J. Fleet 3DPC OCL 91 37 0 27 Nov 2020
Unsupervised Discovery of 3D Physical Objects from Video Yilun Du Kevin A. Smith Tomer Ulman J. Tenenbaum Jiajun Wu OCL 169 38 0 24 Jul 2020
Unsupervised object-centric video generation and decomposition in 3D Paul Henderson Christoph H. Lampert OCL 99 36 0 07 Jul 2020
Compositional Video Synthesis with Action Graphs Amir Bar Roei Herzig Xiaolong Wang Anna Rohrbach Gal Chechik Trevor Darrell Amir Globerson 82 44 0 27 Jun 2020
Object-Centric Learning with Slot Attention Francesco Locatello Dirk Weissenborn Thomas Unterthiner Aravindh Mahendran G. Heigold Jakob Uszkoreit Alexey Dosovitskiy Thomas Kipf OCL 225 856 0 26 Jun 2020
Space-Time Correspondence as a Contrastive Random Walk Allan Jabri Andrew Owens Alexei A. Efros SSL OT 94 302 0 25 Jun 2020
Learning Physical Graph Representations from Visual Scenes Daniel M. Bear Chaofei Fan Damian Mrowca Yunzhu Li S. Alter ... Jeremy Schwartz Li Fei-Fei Jiajun Wu J. Tenenbaum Daniel L. K. Yamins SSL GNN SSeg AI4CE 91 79 0 22 Jun 2020
End-to-End Object Detection with Transformers Nicolas Carion Francisco Massa Gabriel Synnaeve Nicolas Usunier Alexander Kirillov Sergey Zagoruyko ViT 3DV PINN 432 13,094 0 26 May 2020
A Transductive Approach for Video Object Segmentation Yizhuo Zhang Zhirong Wu Houwen Peng Stephen Lin VOS 84 113 0 15 Apr 2020
SPACE: Unsupervised Object-Oriented Scene Representation via Spatial Attention and Decomposition Zhixuan Lin Yi-Fu Wu Skand Peri Weihao Sun Gautam Singh Fei Deng Jindong Jiang Sungjin Ahn BDL OCL 3DPC 168 250 0 08 Jan 2020
Contrastive Learning of Structured World Models Thomas Kipf Elise van der Pol Max Welling OCL DRL 91 285 0 27 Nov 2019
Exploiting Spatial Invariance for Scalable Unsupervised Object Tracking Eric Crawford Joelle Pineau 120 67 0 20 Nov 2019
Entity Abstraction in Visual Model-Based Reinforcement Learning Rishi Veerapaneni John D. Co-Reyes Michael Chang Michael Janner Chelsea Finn Jiajun Wu J. Tenenbaum Sergey Levine OCL OffRL 87 189 0 28 Oct 2019
R-SQAIR: Relational Sequential Attend, Infer, Repeat Aleksandar Stanić Jürgen Schmidhuber 69 31 0 11 Oct 2019
CATER: A diagnostic dataset for Compositional Actions and TEmporal Reasoning Rohit Girdhar Deva Ramanan 72 178 0 10 Oct 2019
SCALOR: Generative World Models with Scalable Object Representations Jindong Jiang Sepehr Janghorbani Gerard de Melo Sungjin Ahn OCL DRL 90 133 0 06 Oct 2019
CLEVRER: CoLlision Events for Video REpresentation and Reasoning Kexin Yi Yuta Saito Yunzhu Li Pushmeet Kohli Jiajun Wu Antonio Torralba J. Tenenbaum NAI 123 475 0 03 Oct 2019
Joint-task Self-supervised Learning for Temporal Correspondence Xueting Li Sifei Liu Shalini De Mello Xiaolong Wang Jan Kautz Ming-Hsuan Yang SSL 73 142 0 26 Sep 2019
Recurrent Independent Mechanisms Anirudh Goyal Alex Lamb Jordan Hoffmann Shagun Sodhani Sergey Levine Yoshua Bengio Bernhard Schölkopf 91 337 0 24 Sep 2019