A Relational Intervention Approach for Unsupervised Dynamics Generalization in Model-Based Reinforcement Learning

9 June 2022

Papers citing "A Relational Intervention Approach for Unsupervised Dynamics Generalization in Model-Based Reinforcement Learning"

50 / 50 papers shown

Title
Sequential Causal Imitation Learning with Unobserved Confounders D. Kumor Junzhe Zhang Elias Bareinboim CML 43 40 0 12 Aug 2022
Causal Imitation Learning with Unobserved Confounders Junzhe Zhang D. Kumor Elias Bareinboim CML 78 76 0 12 Aug 2022
AdaRL: What, Where, and How to Adapt in Transfer Reinforcement Learning Erdun Gao Fan Feng Chaochao Lu Sara Magliacane Kun Zhang 87 68 0 06 Jul 2021
Augmented World Models Facilitate Zero-Shot Dynamics Generalization From a Single Offline Environment Philip J. Ball Cong Lu Jack Parker-Holder Stephen J. Roberts OffRL 90 45 0 12 Apr 2021
Model-based Meta Reinforcement Learning using Graph Structured Surrogate Models Q. Wang H. V. Hoof OffRL 60 20 0 16 Feb 2021
Sample-Efficient Reinforcement Learning via Counterfactual-Based Data Augmentation Chaochao Lu Erdun Gao Ke Wang José Miguel Hernández-Lobato Kun Zhang Bernhard Schölkopf CML OOD OffRL 77 60 0 16 Dec 2020
Intervention Design for Effective Sim2Real Transfer Melissa Mozifian Amy Zhang Joelle Pineau David Meger 43 9 0 03 Dec 2020
Trajectory-wise Multiple Choice Learning for Dynamics Generalization in Reinforcement Learning Younggyo Seo Kimin Lee I. Clavera Thanard Kurutach Jinwoo Shin Pieter Abbeel 75 39 0 26 Oct 2020
Provably Efficient Causal Reinforcement Learning with Confounded Observational Data Lingxiao Wang Zhuoran Yang Zhaoran Wang OffRL 78 48 0 22 Jun 2020
Self-Supervised Relational Reasoning for Representation Learning Massimiliano Patacchiola Amos Storkey OOD SSL 67 63 0 10 Jun 2020
Neural Methods for Point-wise Dependency Estimation Yao-Hung Hubert Tsai Han Zhao M. Yamada Louis-Philippe Morency Ruslan Salakhutdinov 85 33 0 09 Jun 2020
Causality and Batch Reinforcement Learning: Complementary Approaches To Planning In Unknown Domains James Bannon Bradford T. Windsor Wenbo Song Tao Li CML OOD OffRL 59 20 0 03 Jun 2020
Context-aware Dynamics Model for Generalization in Model-Based Reinforcement Learning Kimin Lee Younggyo Seo Seunghyun Lee Honglak Lee Jinwoo Shin 99 133 0 14 May 2020
Invariant Causal Prediction for Block MDPs Amy Zhang Clare Lyle Shagun Sodhani Angelos Filos Marta Z. Kwiatkowska Joelle Pineau Y. Gal Doina Precup OffRL AI4CE OOD 118 144 0 12 Mar 2020
Resolving Spurious Correlations in Causal Models of Environments via Interventions S. Volodin Nevan Wichers Jeremy Nixon CML 61 18 0 12 Feb 2020
Deep Reinforcement Learning for Autonomous Driving: A Survey B. R. Kiran Ibrahim Sobh V. Talpaert Patrick Mannion A. A. Sallab S. Yogamani P. Pérez 358 1,693 0 02 Feb 2020
Dream to Control: Learning Behaviors by Latent Imagination Danijar Hafner Timothy Lillicrap Jimmy Ba Mohammad Norouzi VLM 140 1,374 0 03 Dec 2019
Single Episode Policy Transfer in Reinforcement Learning Jiachen Yang Brenden K. Petersen H. Zha Daniel Faissol OOD OffRL 125 35 0 17 Oct 2019
Environment Probing Interaction Policies Wenxuan Zhou Lerrel Pinto Abhinav Gupta 56 67 0 26 Jul 2019
Data Efficient Reinforcement Learning for Legged Robots Yuxiang Yang Ken Caluwaerts Atil Iscen Tingnan Zhang Jie Tan Vikas Sindhwani 83 140 0 08 Jul 2019
Learning Causal State Representations of Partially Observable Environments Amy Zhang Zachary Chase Lipton Luis Villaseñor-Pineda Kamyar Azizzadenesheli Anima Anandkumar Laurent Itti Joelle Pineau Tommaso Furlanello CML 104 51 0 25 Jun 2019
When to Trust Your Model: Model-Based Policy Optimization Michael Janner Justin Fu Marvin Zhang Sergey Levine OffRL 113 957 0 19 Jun 2019
When to use parametric models in reinforcement learning? H. V. Hasselt Matteo Hessel John Aslanides 87 195 0 12 Jun 2019
Efficient Off-Policy Meta-Reinforcement Learning via Probabilistic Context Variables Kate Rakelly Aurick Zhou Deirdre Quillen Chelsea Finn Sergey Levine OffRL 86 661 0 19 Mar 2019
Model-Based Reinforcement Learning for Atari Lukasz Kaiser Mohammad Babaeizadeh Piotr Milos B. Osinski R. Campbell ... Sergey Levine Afroz Mohiuddin Ryan Sepassi George Tucker Henryk Michalewski OffRL 147 870 0 01 Mar 2019
Deconfounding Reinforcement Learning in Observational Settings Chaochao Lu Bernhard Schölkopf José Miguel Hernández-Lobato CML OOD 164 75 0 26 Dec 2018
Deep Online Learning via Meta-Learning: Continual Adaptation for Model-Based RL Anusha Nagabandi Chelsea Finn Sergey Levine OffRL CLL 99 191 0 18 Dec 2018
Learning Latent Dynamics for Planning from Pixels Danijar Hafner Timothy Lillicrap Ian S. Fischer Ruben Villegas David R Ha Honglak Lee James Davidson BDL 94 1,449 0 12 Nov 2018
Assessing Generalization in Deep Reinforcement Learning Charles Packer Katelyn Gao Jernej Kos Philipp Krahenbuhl V. Koltun Basel Alomair OffRL 124 238 0 29 Oct 2018
Representation Learning with Contrastive Predictive Coding Aaron van den Oord Yazhe Li Oriol Vinyals DRL SSL 356 10,369 0 10 Jul 2018
Relational recurrent neural networks Adam Santoro Ryan Faulkner David Raposo Jack W. Rae Mike Chrzanowski T. Weber Daan Wierstra Oriol Vinyals Razvan Pascanu Timothy Lillicrap GNN 150 211 0 05 Jun 2018
Relational inductive biases, deep learning, and graph networks Peter W. Battaglia Jessica B. Hamrick V. Bapst Alvaro Sanchez-Gonzalez V. Zambaldi ... Pushmeet Kohli M. Botvinick Oriol Vinyals Yujia Li Razvan Pascanu AI4CE NAI 771 3,132 0 04 Jun 2018
Evaluating Reinforcement Learning Algorithms in Observational Health Settings Omer Gottesman Fredrik D. Johansson Joshua Meier Jack Dent Donghun Lee ... Matthieu Komorowski A. Faisal Leo Anthony Celi David Sontag Finale Doshi-Velez OOD OffRL 44 134 0 31 May 2018
Confounding-Robust Policy Improvement Nathan Kallus Angela Zhou CML OffRL 335 153 0 22 May 2018
Learning to Adapt in Dynamic, Real-World Environments Through Meta-Reinforcement Learning Anusha Nagabandi I. Clavera Simin Liu R. Fearing Pieter Abbeel Sergey Levine Chelsea Finn 136 553 0 30 Mar 2018
Meta Reinforcement Learning with Latent Variable Gaussian Processes Steindór Sæmundsson Katja Hofmann M. Deisenroth BDL OffRL AI4CE 87 142 0 20 Mar 2018
Model-Ensemble Trust-Region Policy Optimization Thanard Kurutach I. Clavera Yan Duan Aviv Tamar Pieter Abbeel 84 453 0 28 Feb 2018
Precision medicine as a control problem: Using simulation and deep reinforcement learning to discover adaptive, personalized multi-cytokine therapy for sepsis Brenden K. Petersen Jiachen Yang Will Grathwohl Chase Cockrell Claudio Santiago G. An Daniel Faissol AI4CE 46 26 0 08 Feb 2018
Relation Networks for Object Detection Han Hu Jiayuan Gu Zheng Zhang Jifeng Dai Yichen Wei ObjD 138 1,227 0 30 Nov 2017
Learning to Compare: Relation Network for Few-Shot Learning Flood Sung Yongxin Yang Li Zhang Tao Xiang Philip Torr Timothy M. Hospedales 314 4,054 0 16 Nov 2017
Using Simulation and Domain Adaptation to Improve Efficiency of Deep Robotic Grasping Konstantinos Bousmalis A. Irpan Paul Wohlhart Yunfei Bai Matthew Kelcey ... Julian Ibarz P. Pastor K. Konolige Sergey Levine Vincent Vanhoucke OOD 107 656 0 22 Sep 2017
A simple neural network module for relational reasoning Adam Santoro David Raposo David Barrett Mateusz Malinowski Razvan Pascanu Peter W. Battaglia Timothy Lillicrap GNN NAI 189 1,615 0 05 Jun 2017
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 835 11,961 0 09 Mar 2017
Discovering objects and their relations from entangled scene representations David Raposo Adam Santoro David Barrett Razvan Pascanu Timothy Lillicrap Peter W. Battaglia GNN OCL 91 71 0 16 Feb 2017
Deep Reinforcement Learning for Robotic Manipulation with Asynchronous Off-Policy Updates S. Gu E. Holly Timothy Lillicrap Sergey Levine OffRL SSL 116 1,483 0 03 Oct 2016
Causal Bandits: Learning Good Interventions via Causal Inference Finnian Lattimore Tor Lattimore Mark D. Reid CML 57 163 0 10 Jun 2016
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 2.1K 150,433 0 22 Dec 2014
Playing Atari with Deep Reinforcement Learning Volodymyr Mnih Koray Kavukcuoglu David Silver Alex Graves Ioannis Antonoglou Daan Wierstra Martin Riedmiller 134 12,272 0 19 Dec 2013
Hidden Parameter Markov Decision Processes: A Semiparametric Regression Approach for Discovering Latent Task Parametrizations Finale Doshi-Velez George Konidaris 163 130 0 15 Aug 2013
Direct and Indirect Effects Judea Pearl CML 103 2,179 0 10 Jan 2013