Learning Fused State Representations for Control from Multi-View Observations

3 February 2025

Papers citing "Learning Fused State Representations for Control from Multi-View Observations"

39 / 39 papers shown

Title
Multi-view Disentanglement for Reinforcement Learning with Multiple Cameras Mhairi Dunion Stefano V. Albrecht 58 5 0 22 Apr 2024
Understanding and Addressing the Pitfalls of Bisimulation-based Representations in Offline Reinforcement Learning Hongyu Zang Xin-hui Li Leiji Zhang Yang Liu Baigui Sun Riashat Islam Rémi Tachet des Combes Romain Laroche OffRL 80 5 0 26 Oct 2023
Sequential Action-Induced Invariant Representation for Reinforcement Learning Dayang Liang Qihang Chen Yunlong Liu 65 4 0 22 Sep 2023
TACO: Temporal Latent Action-Driven Contrastive Loss for Visual Reinforcement Learning Ruijie Zheng Xiyao Wang Yanchao Sun Shuang Ma Jieyu Zhao Huazhe Xu Hal Daumé Furong Huang 60 36 0 22 Jun 2023
Multi-View Masked World Models for Visual Robotic Manipulation Younggyo Seo Junsup Kim Stephen James Kimin Lee Jinwoo Shin Pieter Abbeel VGen 65 60 0 05 Feb 2023
Mastering Diverse Domains through World Models Danijar Hafner J. Pašukonis Jimmy Ba Timothy Lillicrap 63 600 0 10 Jan 2023
Masked Autoencoding for Scalable and Generalizable Decision Making Fangchen Liu Hao Liu Aditya Grover Pieter Abbeel OffRL 64 7 0 23 Nov 2022
Visual Reinforcement Learning with Self-Supervised 3D Representations Yanjie Ze Nicklas Hansen Yinbo Chen Mohit Jain Xiaolong Wang SSL 61 51 0 13 Oct 2022
Guaranteed Discovery of Control-Endogenous Latent States with Multi-Step Inverse Models Alex Lamb Riashat Islam Yonathan Efroni Aniket Didolkar Dipendra Kumar Misra Dylan J. Foster Lekan Molu Rajan Chari A. Krishnamurthy John Langford 80 24 0 17 Jul 2022
Masked World Models for Visual Control Younggyo Seo Danijar Hafner Hao Liu Fangchen Liu Stephen James Kimin Lee Pieter Abbeel OffRL 138 148 0 28 Jun 2022
Causal Dynamics Learning for Task-Independent State Abstraction Zizhao Wang Xuesu Xiao Zifan Xu Yuke Zhu Peter Stone CML 58 56 0 27 Jun 2022
Sample-Efficient Reinforcement Learning in the Presence of Exogenous Information Yonathan Efroni Dylan J. Foster Dipendra Kumar Misra A. Krishnamurthy John Langford OffRL 59 25 0 09 Jun 2022
Multimodal Masked Autoencoders Learn Transferable Representations Xinyang Geng Hao Liu Lisa Lee Dale Schuurams Sergey Levine Pieter Abbeel 62 118 0 27 May 2022
Mask-based Latent Reconstruction for Reinforcement Learning Tao Yu Zhizheng Zhang Cuiling Lan Yan Lu Zhibo Chen 72 45 0 28 Jan 2022
Look Closer: Bridging Egocentric and Third-Person Views with Transformers for Robotic Manipulation Rishabh Jangir Nicklas Hansen Sambaran Ghosal Mohit Jain Xiaolong Wang 68 68 0 19 Jan 2022
SimSR: Simple Distance-based State Representation for Deep Reinforcement Learning Hongyu Zang Xin Li Mingzhong Wang 45 15 0 31 Dec 2021
Mastering Visual Continuous Control: Improved Data-Augmented Reinforcement Learning Denis Yarats Rob Fergus A. Lazaric Lerrel Pinto OffRL 81 347 0 20 Jul 2021
Learning Task Informed Abstractions Xiang Fu Ge Yang Pulkit Agrawal Tommi Jaakkola 75 66 0 29 Jun 2021
Unsupervised Learning of Visual 3D Keypoints for Control Boyuan Chen Pieter Abbeel Deepak Pathak 3DPC SSL 67 39 0 14 Jun 2021
Exploring Simple Siamese Representation Learning Xinlei Chen Kaiming He SSL 247 4,047 0 20 Nov 2020
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 593 40,961 0 22 Oct 2020
Mastering Atari with Discrete World Models Danijar Hafner Timothy Lillicrap Mohammad Norouzi Jimmy Ba DRL 95 852 0 05 Oct 2020
Learning Invariant Representations for Reinforcement Learning without Reconstruction Amy Zhang R. McAllister Roberto Calandra Y. Gal Sergey Levine OOD SSL 100 469 0 18 Jun 2020
Reinforcement Learning with Augmented Data Michael Laskin Kimin Lee Adam Stooke Lerrel Pinto Pieter Abbeel A. Srinivas OffRL 76 660 0 30 Apr 2020
Image Augmentation Is All You Need: Regularizing Deep Reinforcement Learning from Pixels Ilya Kostrikov Denis Yarats Rob Fergus OffRL 94 790 0 28 Apr 2020
CURL: Contrastive Unsupervised Representations for Reinforcement Learning A. Srinivas Michael Laskin Pieter Abbeel SSL DRL OffRL 83 1,087 0 08 Apr 2020
Learning Precise 3D Manipulation from Multiple Uncalibrated Cameras Iretiayo Akinola Jacob Varley Dmitry Kalashnikov SSL 61 30 0 21 Feb 2020
Scalable methods for computing state similarity in deterministic Markov Decision Processes Pablo Samuel Castro 66 136 0 21 Nov 2019
Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learning Tianhe Yu Deirdre Quillen Zhanpeng He Ryan Julian Avnish Narayan Hayden Shively Adithya Bellathur Karol Hausman Chelsea Finn Sergey Levine OffRL 224 1,165 0 24 Oct 2019
Multi-View Reinforcement Learning Minne Li Lisheng Wu Haitham Bou-Ammar Jun Wang 42 26 0 18 Oct 2019
Stochastic Latent Actor-Critic: Deep Reinforcement Learning with a Latent Variable Model Alex X. Lee Anusha Nagabandi Pieter Abbeel Sergey Levine OffRL BDL 78 380 0 01 Jul 2019
Learning Representations by Maximizing Mutual Information Across Views Philip Bachman R. Devon Hjelm William Buchwalter SSL 189 1,472 0 03 Jun 2019
Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actor Tuomas Haarnoja Aurick Zhou Pieter Abbeel Sergey Levine 292 8,329 0 04 Jan 2018
DeepMind Control Suite Yuval Tassa Yotam Doron Alistair Muldal Tom Erez Yazhe Li ... A. Abdolmaleki J. Merel Andrew Lefrancq Timothy Lillicrap Martin Riedmiller ELM LM&Ro BDL 127 1,134 0 02 Jan 2018
Proximal Policy Optimization Algorithms John Schulman Filip Wolski Prafulla Dhariwal Alec Radford Oleg Klimov OffRL 463 19,006 0 20 Jul 2017
Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization Ramprasaath R. Selvaraju Michael Cogswell Abhishek Das Ramakrishna Vedantam Devi Parikh Dhruv Batra FAtt 277 19,981 0 07 Oct 2016
A Survey of Multi-View Representation Learning Yingming Li Ming Yang Zhongfei Zhang AI4TS 3DV 298 512 0 03 Oct 2016
Deep Visual-Semantic Alignments for Generating Image Descriptions A. Karpathy Li Fei-Fei 118 5,583 0 07 Dec 2014
Metrics for Finite Markov Decision Processes N. Ferns Prakash Panangaden Doina Precup 74 320 0 11 Jul 2012