Learning Discrete State Abstractions With Deep Variational Inference

9 March 2020

Ondrej Biza

Robert Platt

Jan-Willem van de Meent

Lawson L. S. Wong

BDL

ArXiv PDF HTML

Papers citing "Learning Discrete State Abstractions With Deep Variational Inference"

27 / 27 papers shown

Title
Plannable Approximations to MDP Homomorphisms: Equivariance under Actions Elise van der Pol Thomas Kipf F. Oliehoek Max Welling 50 79 0 27 Feb 2020
Decision-Making with Auto-Encoding Variational Bayes Romain Lopez Pierre Boyeau Nir Yosef Michael I. Jordan Jeffrey Regier BDL 212 10,591 0 17 Feb 2020
Scalable methods for computing state similarity in deterministic Markov Decision Processes Pablo Samuel Castro 43 136 0 21 Nov 2019
DeepMDP: Learning Continuous Latent Space Models for Representation Learning Carles Gelada Saurabh Kumar Jacob Buckman Ofir Nachum Marc G. Bellemare BDL 54 283 0 06 Jun 2019
MinAtar: An Atari-Inspired Testbed for Thorough and Reproducible Reinforcement Learning Experiments K. Young Tian Tian 34 24 0 07 Mar 2019
InfoBot: Transfer and Exploration via the Information Bottleneck Anirudh Goyal Riashat Islam Daniel Strouse Zafarali Ahmed M. Botvinick Hugo Larochelle Yoshua Bengio Sergey Levine OffRL 43 166 0 30 Jan 2019
Online Abstraction with MDP Homomorphisms for Deep Learning Ondrej Biza Robert Platt OffRL 40 22 0 30 Nov 2018
Learning Features and Abstract Actions for Computing Generalized Plans Blai Bonet Guillem Francès Hector Geffner 26 59 0 17 Nov 2018
Learning to Share and Hide Intentions using Information Regularization D. Strouse Max Kleiman-Weiner J. Tenenbaum M. Botvinick D. Schwab 26 60 0 06 Aug 2018
Learning Plannable Representations with Causal InfoGAN Thanard Kurutach Aviv Tamar Ge Yang Stuart J. Russell Pieter Abbeel GAN DRL 49 180 0 24 Jul 2018
The Bottleneck Simulator: A Model-based Deep Reinforcement Learning Approach Iulian Serban Chinnadhurai Sankar Michael Pieper Joelle Pineau Yoshua Bengio OffRL 72 29 0 12 Jul 2018
Transfer with Model Features in Reinforcement Learning Lucas Lehnert Michael L. Littman 11 10 0 04 Jul 2018
World Models David R Ha Jürgen Schmidhuber SyDa 103 1,062 0 27 Mar 2018
Efficient Model-Based Deep Reinforcement Learning with Variational State Tabulation Dane S. Corneil W. Gerstner Johanni Brea OffRL 38 62 0 12 Feb 2018
Distral: Robust Multitask Reinforcement Learning Yee Whye Teh V. Bapst Wojciech M. Czarnecki John Quan J. Kirkpatrick R. Hadsell N. Heess Razvan Pascanu 120 551 0 13 Jul 2017
Near Optimal Behavior via Approximate State Abstraction David Abel D Ellis Hershkowitz Michael L. Littman OffRL 56 163 0 15 Jan 2017
Deep Variational Information Bottleneck Alexander A. Alemi Ian S. Fischer Joshua V. Dillon Kevin Patrick Murphy 83 1,697 0 01 Dec 2016
Categorical Reparameterization with Gumbel-Softmax Eric Jang S. Gu Ben Poole BDL 221 5,323 0 03 Nov 2016
The Concrete Distribution: A Continuous Relaxation of Discrete Random Variables Chris J. Maddison A. Mnih Yee Whye Teh BDL 111 2,523 0 02 Nov 2016
Prioritized Experience Replay Tom Schaul John Quan Ioannis Antonoglou David Silver OffRL 198 3,781 0 18 Nov 2015
Embed to Control: A Locally Linear Latent Dynamics Model for Control from Raw Images Manuel Watter Jost Tobias Springenberg Joschka Boedecker Martin Riedmiller BDL 50 839 0 24 Jun 2015
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift Sergey Ioffe Christian Szegedy OOD 328 43,154 0 11 Feb 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 840 149,474 0 22 Dec 2014
Latent Kullback Leibler Control for Continuous-State Systems using Probabilistic Graphical Models Takamitsu Matsubara Vicencc Gómez H. Kappen 31 21 0 04 Jun 2014
Model Reduction Techniques for Computing Approximately Optimal Solutions for Markov Decision Processes T. Dean R. Givan Sonia M. Leach 69 140 0 06 Feb 2013
Metrics for Finite Markov Decision Processes N. Ferns Prakash Panangaden Doina Precup 66 321 0 11 Jul 2012
Methods for computing state similarity in Markov Decision Processes N. Ferns Pablo Samuel Castro Doina Precup Prakash Panangaden 44 87 0 27 Jun 2012