Challenges and Opportunities in Offline Reinforcement Learning from Visual Observations

9 June 2022

Papers citing "Challenges and Opportunities in Offline Reinforcement Learning from Visual Observations"

49 / 49 papers shown

Title
Video-Enhanced Offline Reinforcement Learning: A Model-Based Approach Minting Pan Yitao Zheng Jiajian Li Yunbo Wang Xiaokang Yang OffRL 48 0 0 10 May 2025
A Clean Slate for Offline Reinforcement Learning Matthew Jackson Uljad Berdica Jarek Liesen Shimon Whiteson Jakob Foerster OffRL OnRL 52 0 0 15 Apr 2025
Behavior Preference Regression for Offline Reinforcement Learning Padmanaba Srinivasan William J. Knottenbelt OffRL 38 0 0 02 Mar 2025
Fewer May Be Better: Enhancing Offline Reinforcement Learning with Reduced Dataset Yiqin Yang Quanwei Wang Chenghao Li Hao Hu Chengjie Wu ... Dianyu Zhong Ziyou Zhang Qianchuan Zhao Chongjie Zhang Xu Bo OffRL 54 0 0 26 Feb 2025
Prioritized Generative Replay Renhao Wang Kevin Frans Pieter Abbeel Sergey Levine Alexei A. Efros OnRL DiffM 114 2 0 23 Oct 2024
Offline-to-online Reinforcement Learning for Image-based Grasping with Scarce Demonstrations Bryan Chan Anson Leung James Bergstra OffRL OnRL 62 0 0 19 Oct 2024
DMC-VB: A Benchmark for Representation Learning for Control with Visual Distractors Joseph Ortiz Antoine Dedieu Wolfgang Lehrach Swaroop Guntupalli Carter Wendelken Ahmad Humayun Guangyao Zhou Sivaramakrishnan Swaminathan Miguel Lázaro-Gredilla Kevin P. Murphy OffRL 49 1 0 26 Sep 2024
D5RL: Diverse Datasets for Data-Driven Deep Reinforcement Learning Rafael Rafailov Kyle Hatch Anikait Singh Laura Smith Aviral Kumar ... Victor Kolev Philip J. Ball Jiajun Wu Chelsea Finn Sergey Levine OffRL 34 3 0 15 Aug 2024
Is Value Learning Really the Main Bottleneck in Offline RL? Seohong Park Kevin Frans Sergey Levine Aviral Kumar OffRL 53 8 0 13 Jun 2024
ATraDiff: Accelerating Online Reinforcement Learning with Imaginary Trajectories Qianlan Yang Yu-Xiong Wang OnRL 42 1 0 06 Jun 2024
GTA: Generative Trajectory Augmentation with Guidance for Offline Reinforcement Learning Jaewoo Lee Sujin Yun Taeyoung Yun Jinkyoo Park 46 6 0 27 May 2024
Generalizing Multi-Step Inverse Models for Representation Learning to Finite-Memory POMDPs Lili Wu Ben Evans Riashat Islam Raihan Seraj Yonathan Efroni Alex Lamb 52 1 0 22 Apr 2024
The Edge-of-Reach Problem in Offline Model-Based Reinforcement Learning Anya Sims Cong Lu Yee Whye Teh OffRL 35 3 0 19 Feb 2024
SEABO: A Simple Search-Based Method for Offline Imitation Learning Jiafei Lyu Xiaoteng Ma Le Wan Runze Liu Xiu Li Zongqing Lu OffRL 19 9 0 06 Feb 2024
Uni-RLHF: Universal Platform and Benchmark Suite for Reinforcement Learning with Diverse Human Feedback Yifu Yuan Jianye Hao Yi Ma Zibin Dong Hebin Liang Jinyi Liu Zhixin Feng Kai-Wen Zhao Yan Zheng OffRL ALM 24 14 0 04 Feb 2024
Diffusion Reward: Learning Rewards via Conditional Video Diffusion Tao Huang Guangqi Jiang Yanjie Ze Huazhe Xu VGen 39 22 0 21 Dec 2023
The Generalization Gap in Offline Reinforcement Learning Ishita Mediratta Qingfei You Minqi Jiang Roberta Raileanu OffRL 86 10 0 10 Dec 2023
Action Inference by Maximising Evidence: Zero-Shot Imitation from Observation with World Models Xingyuan Zhang Philip Becker-Ehmck Patrick van der Smagt Maximilian Karl 42 5 0 04 Dec 2023
PcLast: Discovering Plannable Continuous Latent States Anurag Koul Shivakanth Sujit Shaoru Chen Ben Evans Lili Wu ... Yonathan Efroni Lekan Molu Miro Dudik John Langford Alex Lamb OffRL BDL 26 1 0 06 Nov 2023
Unsupervised Behavior Extraction via Random Intent Priors Haotian Hu Yiqin Yang Jianing Ye Ziqing Mai Chongjie Zhang OffRL 34 6 0 28 Oct 2023
Understanding and Addressing the Pitfalls of Bisimulation-based Representations in Offline Reinforcement Learning Hongyu Zang Xin-hui Li Leiji Zhang Yang Liu Baigui Sun Riashat Islam Rémi Tachet des Combes Romain Laroche OffRL 29 5 0 26 Oct 2023
Minimax Optimal Q Learning with Nearest Neighbors Puning Zhao Lifeng Lai OffRL 59 11 0 03 Aug 2023
Transformers in Reinforcement Learning: A Survey Pranav Agarwal A. Rahman P. St-Charles Simon J. D. Prince Samira Ebrahimi Kahou OffRL 26 19 0 12 Jul 2023
Learning to Modulate pre-trained Models in RL Thomas Schmied M. Hofmarcher Fabian Paischer Razvan Pascanu Sepp Hochreiter CLL OffRL 26 14 0 26 Jun 2023
LVLM-eHub: A Comprehensive Evaluation Benchmark for Large Vision-Language Models Peng Xu Wenqi Shao Kaipeng Zhang Peng Gao Shuo Liu Meng Lei Fanqing Meng Siyuan Huang Yu Qiao Ping Luo ELM MLLM 33 159 0 15 Jun 2023
Katakomba: Tools and Benchmarks for Data-Driven NetHack Vladislav Kurenkov Alexander Nikulin Denis Tarasov Sergey Kolesnikov OffRL 30 5 0 14 Jun 2023
A Simple Unified Uncertainty-Guided Framework for Offline-to-Online Reinforcement Learning Siyuan Guo Yanchao Sun Jifeng Hu Sili Huang Hechang Chen Haiyin Piao Lichao Sun Yi-Ju Chang OffRL OnRL 31 7 0 13 Jun 2023
Making Offline RL Online: Collaborative World Models for Offline Visual Reinforcement Learning Q. Wang Jun Yang Yunbo Wang Xin Jin Wenjun Zeng Xiaokang Yang OffRL OnRL 35 3 0 24 May 2023
Revisiting the Minimalist Approach to Offline Reinforcement Learning Denis Tarasov Vladislav Kurenkov Alexander Nikulin Sergey Kolesnikov OffRL 33 36 0 16 May 2023
A Control-Centric Benchmark for Video Prediction Stephen Tian Chelsea Finn Jiajun Wu 42 10 0 26 Apr 2023
Synthetic Experience Replay Cong Lu Philip J. Ball Yee Whye Teh Jack Parker-Holder OffRL 94 67 0 12 Mar 2023
Ignorance is Bliss: Robust Control via Information Gating Manan Tomar Riashat Islam Matthew E. Taylor Sergey Levine Philip Bachman 41 9 0 10 Mar 2023
Efficient Online Reinforcement Learning with Offline Data Philip J. Ball Laura M. Smith Ilya Kostrikov Sergey Levine OffRL OnRL 34 163 0 06 Feb 2023
Policy Expansion for Bridging Offline-to-Online Reinforcement Learning Haichao Zhang Weiwen Xu Haonan Yu CLL OffRL OnRL 40 62 0 02 Feb 2023
Off-the-Grid MARL: Datasets with Baselines for Offline Multi-Agent Reinforcement Learning Claude Formanek Asad Jeewa Jonathan P. Shock Arnu Pretorius OffRL 43 1 0 01 Feb 2023
Variational Latent Branching Model for Off-Policy Evaluation Qitong Gao Ge Gao Min Chi Miroslav Pajic OffRL 36 6 0 28 Jan 2023
Representation Learning in Deep RL via Discrete Information Bottleneck Riashat Islam Hongyu Zang Manan Tomar Aniket Didolkar Md. Mofijul Islam ... Tariq Iqbal Xin-hui Li Anirudh Goyal N. Heess Alex Lamb SSL OffRL 38 6 0 28 Dec 2022
Bridging the Gap Between Offline and Online Reinforcement Learning Evaluation Methodologies Shivakanth Sujit Pedro H. M. Braga J. Bornschein Samira Ebrahimi Kahou OffRL 22 1 0 15 Dec 2022
One Risk to Rule Them All: A Risk-Sensitive Perspective on Model-Based Offline Reinforcement Learning Marc Rigter Bruno Lacerda Nick Hawes OffRL 18 6 0 30 Nov 2022
Prototypical context-aware dynamics generalization for high-dimensional model-based reinforcement learning Junjie Wang Yao Mu Dong Li Qichao Zhang Dongbin Zhao Yuzheng Zhuang Ping Luo Bin Wang Jianye Hao OffRL 30 3 0 23 Nov 2022
Joint Embedding Predictive Architectures Focus on Slow Features Vlad Sobal V. JyothirS Siddhartha Jalagam Nicolas Carion Kyunghyun Cho Yann LeCun 24 8 0 20 Nov 2022
Behavior Prior Representation learning for Offline Reinforcement Learning Hongyu Zang Xin Li Jie Yu Chen Liu Riashat Islam Rémi Tachet des Combes Romain Laroche OffRL OnRL 35 10 0 02 Nov 2022
Agent-Controller Representations: Principled Offline RL with Rich Exogenous Information Riashat Islam Manan Tomar Alex Lamb Yonathan Efroni Hongyu Zang ... Dipendra Kumar Misra Xin-hui Li H. V. Seijen Rémi Tachet des Combes John Langford OffRL 24 7 0 31 Oct 2022
Offline Reinforcement Learning with Implicit Q-Learning Ilya Kostrikov Ashvin Nair Sergey Levine OffRL 214 843 0 12 Oct 2021
What Matters in Learning from Offline Human Demonstrations for Robot Manipulation Ajay Mandlekar Danfei Xu J. Wong Soroush Nasiriany Chen Wang Rohun Kulkarni Li Fei-Fei Silvio Savarese Yuke Zhu Roberto Martín-Martín OffRL 161 475 0 06 Aug 2021
COMBO: Conservative Offline Model-Based Policy Optimization Tianhe Yu Aviral Kumar Rafael Rafailov Aravind Rajeswaran Sergey Levine Chelsea Finn OffRL 219 415 0 16 Feb 2021
The Distracting Control Suite -- A Challenging Benchmark for Reinforcement Learning from Pixels Austin Stone Oscar Ramirez K. Konolige Rico Jonschkowski 137 101 0 07 Jan 2021
Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problems Sergey Levine Aviral Kumar George Tucker Justin Fu OffRL GP 340 1,960 0 04 May 2020
Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles Balaji Lakshminarayanan Alexander Pritzel Charles Blundell UQCV BDL 276 5,675 0 05 Dec 2016