On Covariate Shift of Latent Confounders in Imitation and Reinforcement Learning

13 October 2021

Gal Dalal

Papers citing "On Covariate Shift of Latent Confounders in Imitation and Reinforcement Learning"

25 / 25 papers shown

Title
Mitigating Covariate Shift in Imitation Learning for Autonomous Vehicles Using Latent Space Generative World Models A. Popov Alperen Degirmenci David Wehr Shashank Hegde Ryan Oldja ... David Nistér Urs Muller Ruchi Bhargava Stan Birchfield Nikolai Smolyanskiy 110 11 0 25 Sep 2024
Causal Imitation Learning with Unobserved Confounders Junzhe Zhang D. Kumor Elias Bareinboim CML 62 75 0 12 Aug 2022
Reward is enough for convex MDPs Tom Zahavy Brendan O'Donoghue Guillaume Desjardins Satinder Singh 89 74 0 01 Jun 2021
Offline Reinforcement Learning with Fisher Divergence Critic Regularization Ilya Kostrikov Jonathan Tompson Rob Fergus Ofir Nachum OffRL 125 304 0 14 Mar 2021
Provably Efficient Causal Reinforcement Learning with Confounded Observational Data Lingxiao Wang Zhuoran Yang Zhaoran Wang OffRL 49 47 0 22 Jun 2020
AWAC: Accelerating Online Reinforcement Learning with Offline Datasets Ashvin Nair Abhishek Gupta Murtaza Dalal Sergey Levine OffRL OnRL 88 607 0 16 Jun 2020
Bandits with Partially Observable Confounded Data Guy Tennenholtz Uri Shalit Shie Mannor Yonathan Efroni OffRL 28 24 0 11 Jun 2020
Conservative Q-Learning for Offline Reinforcement Learning Aviral Kumar Aurick Zhou George Tucker Sergey Levine OffRL OnRL 131 1,806 0 08 Jun 2020
Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problems Sergey Levine Aviral Kumar George Tucker Justin Fu OffRL GP 527 2,018 0 04 May 2020
Off-policy Policy Evaluation For Sequential Decisions Under Unobserved Confounding Hongseok Namkoong Ramtin Keramati Steve Yadlowsky Emma Brunskill OffRL 135 65 0 12 Mar 2020
Keep Doing What Worked: Behavioral Modelling Priors for Offline Reinforcement Learning Noah Y. Siegel Jost Tobias Springenberg Felix Berkenkamp A. Abdolmaleki Michael Neunert Thomas Lampe Roland Hafner Nicolas Heess Martin Riedmiller OffRL 56 283 0 19 Feb 2020
Confounding-Robust Policy Evaluation in Infinite-Horizon Reinforcement Learning Nathan Kallus Angela Zhou OffRL 60 59 0 11 Feb 2020
Imitation Learning via Off-Policy Distribution Matching Ilya Kostrikov Ofir Nachum Jonathan Tompson OOD OffRL 129 204 0 10 Dec 2019
AlgaeDICE: Policy Gradient from Arbitrary Experience Ofir Nachum Bo Dai Ilya Kostrikov Yinlam Chow Lihong Li Dale Schuurmans OffRL 143 241 0 04 Dec 2019
Assistive Gym: A Physics Simulation Framework for Assistive Robotics Zackory M. Erickson Vamsee Gangaram Ariel Kapusta Chenxi Liu Charles C. Kemp 83 109 0 10 Oct 2019
Advantage-Weighted Regression: Simple and Scalable Off-Policy Reinforcement Learning Xue Bin Peng Aviral Kumar Grace Zhang Sergey Levine OffRL 126 555 0 01 Oct 2019
RecSim: A Configurable Simulation Platform for Recommender Systems Eugene Ie Chih-Wei Hsu Martin Mladenov Vihan Jain Sanmit Narvekar Jing Wang Rui Wu Craig Boutilier 93 181 0 11 Sep 2019
Off-Policy Evaluation in Partially Observable Environments Guy Tennenholtz Shie Mannor Uri Shalit OffRL 51 86 0 09 Sep 2019
Imitation Learning as $f$ -Divergence Minimization Liyiming Ke Sanjiban Choudhury Matt Barnes Wen Sun Gilwoo Lee S. Srinivasa VLM 54 161 0 30 May 2019
Counterfactual Off-Policy Evaluation with Gumbel-Max Structural Causal Models Michael Oberst David Sontag CML OffRL 60 173 0 14 May 2019
Learning Robust Rewards with Adversarial Inverse Reinforcement Learning Justin Fu Katie Z Luo Sergey Levine 118 749 0 30 Oct 2017
Proximal Policy Optimization Algorithms John Schulman Filip Wolski Prafulla Dhariwal Alec Radford Oleg Klimov OffRL 444 18,931 0 20 Jul 2017
Generative Adversarial Imitation Learning Jonathan Ho Stefano Ermon GAN 131 3,101 0 10 Jun 2016
Causal Bandits: Learning Good Interventions via Causal Inference Finnian Lattimore Tor Lattimore Mark D. Reid CML 51 160 0 10 Jun 2016
Contextual Markov Decision Processes Assaf Hallak Dotan Di Castro Shie Mannor 89 247 0 08 Feb 2015