Entity Abstraction in Visual Model-Based Reinforcement Learning

28 October 2019

Jiajun Wu

Papers citing "Entity Abstraction in Visual Model-Based Reinforcement Learning"

50 / 61 papers shown

Title
Learning Attentive Neural Processes for Planning with Pushing Actions Atharv Jain Seiji Shaw Nicholas Roy 213 0 0 24 Apr 2025
Multi-Robot Collaboration through Reinforcement Learning and Abstract Simulation Adam Labiosa Josiah P. Hanna 54 0 0 07 Mar 2025
Object-centric proto-symbolic behavioural reasoning from pixels R. S. V. Bergen Justus F. Hübotter Pablo Lanillos LM&Ro OCL 95 0 0 26 Nov 2024
Efficient Exploration and Discriminative World Model Learning with an Object-Centric Abstraction Anthony GX-Chen Kenneth Marino Rob Fergus OCL 60 1 0 21 Aug 2024
Reasoning-Enhanced Object-Centric Learning for Videos Jian Li Pu Ren Yang Liu Hao Sun OCL LRM 48 2 0 22 Mar 2024
VONet: Unsupervised Video Object Learning With Parallel U-Net Attention and Object-wise Sequential VAE Haonan Yu Wei Xu ViT 38 1 0 20 Jan 2024
Unsupervised Object-Centric Learning from Multiple Unspecified Viewpoints Jinyang Yuan Tonglin Chen Zhimeng Shen Bin Li Xiangyang Xue OCL 35 2 0 03 Jan 2024
Enhancing Interpretable Object Abstraction via Clustering-based Slot Initialization Ni Gao Bernard Hohmann Gerhard Neumann OCL 32 2 0 22 Aug 2023
Object-Centric Learning for Real-World Videos by Predicting Temporal Feature Similarities Andrii Zadaianchuk Maximilian Seitzer Georg Martius OCL 23 39 0 07 Jun 2023
SlotDiffusion: Object-Centric Generative Modeling with Diffusion Models Ziyi Wu Jingyu Hu Wuyue Lu Igor Gilitschenski Animesh Garg DiffM OCL 38 45 0 18 May 2023
3D-IntPhys: Towards More Generalized 3D-grounded Visual Intuitive Physics under Challenging Scenes Haotian Xue Antonio Torralba J. Tenenbaum Daniel L. K. Yamins Yunzhu Li H. Tung PINN VGen AI4CE 66 8 0 22 Apr 2023
Neural Constraint Satisfaction: Hierarchical Abstraction for Combinatorial Generalization in Object Rearrangement Michael Chang Alyssa Dayan Franziska Meier Thomas Griffiths Sergey Levine Amy Zhang OCL OffRL 37 9 0 20 Mar 2023
Neural Systematic Binder Gautam Singh Yeongbin Kim Sungjin Ahn OCL 34 36 0 02 Nov 2022
Unsupervised Multi-object Segmentation by Predicting Probable Motion Patterns Laurynas Karazija Subhabrata Choudhury Iro Laina Christian Rupprecht Andrea Vedaldi OCL 108 21 0 21 Oct 2022
MoCoDA: Model-based Counterfactual Data Augmentation Silviu Pitis Elliot Creager Ajay Mandlekar Animesh Garg OffRL 48 34 0 20 Oct 2022
Visual Reinforcement Learning with Self-Supervised 3D Representations Yanjie Ze Nicklas Hansen Yinbo Chen Mohit Jain Xiaolong Wang SSL 32 49 0 13 Oct 2022
Bridging the Gap to Real-World Object-Centric Learning Maximilian Seitzer Max Horn Andrii Zadaianchuk Dominik Zietlow Tianjun Xiao ... Tong He Zheng-Wei Zhang Bernhard Schölkopf Thomas Brox Francesco Locatello OCL 47 140 0 29 Sep 2022
Object-based active inference R. S. V. Bergen Pablo Lanillos OCL AI4CE 34 5 0 02 Sep 2022
Learning to Generalize with Object-centric Agents in the Open World Survival Game Crafter Aleksandar Stanić Yujin Tang David R Ha Jürgen Schmidhuber ELM 29 13 0 05 Aug 2022
Object Representations as Fixed Points: Training Iterative Refinement Algorithms with Implicit Differentiation Michael Chang Thomas Griffiths Sergey Levine OCL 69 58 0 02 Jul 2022
SAVi++: Towards End-to-End Object-Centric Learning from Real-World Videos Gamaleldin F. Elsayed Aravindh Mahendran Sjoerd van Steenkiste Klaus Greff Michael C. Mozer Thomas Kipf VOS OCL 58 138 0 15 Jun 2022
Towards Improving the Generation Quality of Autoregressive Slot VAEs Patrick Emami Pan He Sanjay Ranka Anand Rangarajan OCL 38 1 0 03 Jun 2022
Simple Unsupervised Object-Centric Learning for Complex and Naturalistic Videos Gautam Singh Yi-Fu Wu Sungjin Ahn OCL 53 115 0 27 May 2022
Unsupervised Multi-object Segmentation Using Attention and Soft-argmax Bruno Sauvalle A. de La Fortelle 3DPC 56 12 0 26 May 2022
Binding Actions to Objects in World Models Ondrej Biza Robert W. Platt Jan-Willem van de Meent Lawson L. S. Wong Thomas Kipf OCL 18 7 0 27 Apr 2022
Discovering Objects that Can Move Zhipeng Bao P. Tokmakov Allan Jabri Yu-xiong Wang Adrien Gaidon M. Hebert OCL 36 43 0 18 Mar 2022
COPA: Certifying Robust Policies for Offline Reinforcement Learning against Poisoning Attacks Fan Wu Linyi Li Chejian Xu Huan Zhang B. Kailkhura K. Kenthapadi Ding Zhao Bo-wen Li AAML OffRL 32 34 0 16 Mar 2022
Policy Architectures for Compositional Generalization in Control Allan Zhou Vikash Kumar Chelsea Finn Aravind Rajeswaran 26 22 0 10 Mar 2022
Neural Marionette: Unsupervised Learning of Motion Skeleton and Latent Dynamics from Volumetric Video Jinseok Bae Hojun Jang Cheol-Hui Min H. Choi Y. Kim 24 5 0 17 Feb 2022
Retrieval-Augmented Reinforcement Learning Anirudh Goyal A. Friesen Andrea Banino T. Weber Nan Rosemary Ke ... Michal Valko Simon Osindero Timothy Lillicrap N. Heess Charles Blundell OffRL 32 53 0 17 Feb 2022
Filtered-CoPhy: Unsupervised Learning of Counterfactual Physics in Pixel Space Steeven Janny Fabien Baradel Natalia Neverova M. Nadri Greg Mori Christian Wolf CML 38 15 0 01 Feb 2022
Conditional Object-Centric Learning from Video Thomas Kipf Gamaleldin F. Elsayed Aravindh Mahendran Austin Stone S. Sabour G. Heigold Rico Jonschkowski Alexey Dosovitskiy Klaus Greff OCL 43 214 0 24 Nov 2021
Unsupervised Learning of Compositional Energy Concepts Yilun Du Shuang Li Yash Sharma J. Tenenbaum Igor Mordatch CoGe OCL 30 76 0 04 Nov 2021
Dynamic Visual Reasoning by Learning Differentiable Physics Models from Video and Language Mingyu Ding Zhenfang Chen Tao Du Ping Luo J. Tenenbaum Chuang Gan VGen PINN OCL 38 74 0 28 Oct 2021
Unsupervised Object Learning via Common Fate Matthias Tangemann Steffen Schneider Julius von Kügelgen Francesco Locatello Peter V. Gehler Thomas Brox Matthias Kümmerer Matthias Bethge Bernhard Schölkopf OCL 41 23 0 13 Oct 2021
Unsupervised Image Decomposition with Phase-Correlation Networks Angel Villar-Corrales Sven Behnke OCL 35 4 0 07 Oct 2021
Self-supervised Reinforcement Learning with Independently Controllable Subgoals Andrii Zadaianchuk Georg Martius Fanny Yang SSL 69 16 0 09 Sep 2021
Capturing the objects of vision with neural networks B. Peters N. Kriegeskorte OCL 33 56 0 07 Sep 2021
Generative Video Transformer: Can Objects be the Words? Yi-Fu Wu Jaesik Yoon Sungjin Ahn ViT 32 34 0 20 Jul 2021
Reasoning-Modulated Representations Petar Velivcković Matko Bovsnjak Thomas Kipf Alexander Lerchner R. Hadsell Razvan Pascanu Charles Blundell OCL OOD SSL 18 15 0 19 Jul 2021
Discrete-Valued Neural Communication Dianbo Liu DianboLiu Alex Lamb Kenji Kawaguchi Anirudh Goyal Chen Sun Michael C. Mozer Yoshua Bengio 26 50 0 06 Jul 2021
Systematic Evaluation of Causal Discovery in Visual Model Based Reinforcement Learning Nan Rosemary Ke Aniket Didolkar Sarthak Mittal Anirudh Goyal Guillaume Lajoie Stefan Bauer Danilo Jimenez Rezende Yoshua Bengio Michael C. Mozer C. Pal CML 29 54 0 02 Jul 2021
Physion: Evaluating Physical Prediction from Vision in Humans and Machines Daniel M. Bear E. Wang Damian Mrowca Felix Binder Hsiau-Yu Fish Tung ... Li Fei-Fei Nancy Kanwisher J. Tenenbaum Daniel L. K. Yamins Judith E. Fan OOD 58 87 0 15 Jun 2021
GENESIS-V2: Inferring Unordered Object Representations without Iterative Refinement Martin Engelcke Oiwi Parker Jones Ingmar Posner OCL 37 115 0 20 Apr 2021
Self-Supervision by Prediction for Object Discovery in Videos Beril Besbinar P. Frossard SSL 33 7 0 09 Mar 2021
Unsupervised Object-Based Transition Models for 3D Partially Observable Environments Antonia Creswell Rishabh Kabra Christopher P. Burgess Murray Shanahan OCL 30 29 0 08 Mar 2021
DMotion: Robotic Visuomotor Control with Unsupervised Forward Model Learned from Videos Haoqi Yuan Ruihai Wu Andrew Zhao Hanwang Zhang Zihan Ding Hao Dong 19 3 0 07 Mar 2021
Greedy Hierarchical Variational Autoencoders for Large-Scale Video Prediction Bohan Wu Suraj Nair Roberto Martin-Martin Li Fei-Fei Chelsea Finn DRL 27 100 0 06 Mar 2021
Neural Production Systems: Learning Rule-Governed Visual Dynamics Anirudh Goyal Aniket Didolkar Nan Rosemary Ke Charles Blundell Philippe Beaudoin N. Heess Michael C. Mozer Yoshua Bengio OCL 52 82 0 02 Mar 2021
Language-Mediated, Object-Centric Representation Learning Ruocheng Wang Jiayuan Mao S. Gershman Jiajun Wu 16 12 0 31 Dec 2020