Representation Matters: Offline Pretraining for Sequential Decision Making

11 February 2021

Papers citing "Representation Matters: Offline Pretraining for Sequential Decision Making"

50 / 80 papers shown

Title
Contrastive Learning from Exploratory Actions: Leveraging Natural Interactions for Preference Elicitation N. Dennler Stefanos Nikolaidis Maja J. Matarić 462 0 0 03 Jan 2025
DMC-VB: A Benchmark for Representation Learning for Control with Visual Distractors Joseph Ortiz Antoine Dedieu Wolfgang Lehrach Swaroop Guntupalli Carter Wendelken Ahmad Humayun Guangyao Zhou Sivaramakrishnan Swaminathan Miguel Lázaro-Gredilla Kevin P. Murphy OffRL 76 1 0 26 Sep 2024
A Survey on Physics Informed Reinforcement Learning: Review and Open Problems C. Banerjee Kien Nguyen Clinton Fookes M. Raissi PINN AI4CE 107 10 0 05 Sep 2023
PASTA: Pretrained Action-State Transformer Agents Raphael Boige Yannis Flet-Berliac Arthur Flajolet Guillaume Richard Thomas Pierrot LM&Ro OffRL 119 5 0 20 Jul 2023
Look Beneath the Surface: Exploiting Fundamental Symmetry for Sample-Efficient Offline RL Peng Cheng Xianyuan Zhan Zhihao Wu Wenjia Zhang Shoucheng Song Han Wang Youfang Lin Li Jiang OffRL 124 10 0 07 Jun 2023
Stabilizing Contrastive RL: Techniques for Robotic Goal Reaching from Offline Data Chongyi Zheng Benjamin Eysenbach Homer Walke Patrick Yin Kuan Fang Ruslan Salakhutdinov Sergey Levine OffRL SSL 72 6 0 06 Jun 2023
Future-conditioned Unsupervised Pretraining for Decision Transformer Zhihui Xie Zichuan Lin Deheng Ye Qiang Fu Wei Yang Shuai Li OffRL OnRL 92 23 0 26 May 2023
Accelerating exploration and representation learning with offline pre-training Bogdan Mazoure Jake Bruce Doina Precup Rob Fergus Ankit Anand OffRL 70 5 0 31 Mar 2023
Boosting Reinforcement Learning and Planning with Demonstrations: A Survey Tongzhou Mu H. Su OffRL 70 1 0 23 Mar 2023
Representation Learning in Deep RL via Discrete Information Bottleneck Riashat Islam Hongyu Zang Manan Tomar Aniket Didolkar Md. Mofijul Islam ... Tariq Iqbal Xin-hui Li Anirudh Goyal N. Heess Alex Lamb SSL OffRL 67 8 0 28 Dec 2022
Learning Options via Compression Yiding Jiang Emmy Liu Benjamin Eysenbach Zico Kolter Chelsea Finn OffRL 93 14 0 08 Dec 2022
Multi-Task Imitation Learning for Linear Dynamical Systems Thomas T. Zhang Katie Kang Bruce D. Lee Claire Tomlin Sergey Levine Stephen Tu Nikolai Matni 115 24 0 01 Dec 2022
On the Effect of Pre-training for Transformer in Different Modality on Offline Reinforcement Learning S. Takagi OffRL 65 8 0 17 Nov 2022
Pretraining in Deep Reinforcement Learning: A Survey Zhihui Xie Zichuan Lin Junyou Li Shuai Li Deheng Ye OffRL OnRL AI4CE 81 23 0 08 Nov 2022
Behavior Prior Representation learning for Offline Reinforcement Learning Hongyu Zang Xin Li Jie Yu Chen Liu Riashat Islam Rémi Tachet des Combes Romain Laroche OffRL OnRL 104 10 0 02 Nov 2022
Discrete Factorial Representations as an Abstraction for Goal Conditioned Reinforcement Learning Riashat Islam Hongyu Zang Anirudh Goyal Alex Lamb Kenji Kawaguchi Xin-hui Li Romain Laroche Yoshua Bengio Rémi Tachet des Combes OffRL AI4CE 92 11 0 01 Nov 2022
SAM-RL: Sensing-Aware Model-Based Reinforcement Learning via Differentiable Physics-Based Simulation and Rendering Jun Lv Yunhai Feng Cheng Zhang Shu Zhao Lin Shao Cewu Lu 75 26 0 27 Oct 2022
Adaptive Behavior Cloning Regularization for Stable Offline-to-Online Reinforcement Learning Yi Zhao Rinu Boney Alexander Ilin Arno Solin Joni Pajarinen OffRL OnRL 84 40 0 25 Oct 2022
Pre-Training for Robots: Offline RL Enables Learning New Tasks from a Handful of Trials Aviral Kumar Anika Singh F. Ebert Mitsuhiko Nakamoto Yanlai Yang Chelsea Finn Sergey Levine OffRL OnRL 213 71 0 11 Oct 2022
Law Informs Code: A Legal Informatics Approach to Aligning Artificial Intelligence with Humans John J. Nay ELM AILaw 190 28 0 14 Sep 2022
Spectral Decomposition Representation for Reinforcement Learning Zhaolin Ren Tianjun Zhang Lisa Lee Joseph E. Gonzalez Dale Schuurmans Bo Dai OffRL 98 29 0 19 Aug 2022
Contrastive UCB: Provably Efficient Contrastive Self-Supervised Learning in Online Reinforcement Learning Shuang Qiu Lingxiao Wang Chenjia Bai Zhuoran Yang Zhaoran Wang SSL OffRL 120 32 0 29 Jul 2022
PI-ARS: Accelerating Evolution-Learned Visual-Locomotion with Predictive Information Representations Kuang-Huei Lee Ofir Nachum Tingnan Zhang S. Guadarrama Jie Tan Wenhao Yu 80 16 0 27 Jul 2022
Learning Bellman Complete Representations for Offline Policy Evaluation Jonathan D. Chang Kaiwen Wang Nathan Kallus Wen Sun OffRL 65 16 0 12 Jul 2022
A Survey on Model-based Reinforcement Learning Fan Luo Tian Xu Hang Lai Xiong-Hui Chen Weinan Zhang Yang Yu OffRL LRM 118 110 0 19 Jun 2022
Chain of Thought Imitation with Procedure Cloning Mengjiao Yang Dale Schuurmans Pieter Abbeel Ofir Nachum OffRL 111 33 0 22 May 2022
Offline Policy Comparison with Confidence: Benchmarks and Baselines Anurag Koul Mariano Phielipp Alan Fern OffRL 67 0 0 22 May 2022
An Empirical Investigation of Representation Learning for Imitation Xin Chen Sam Toyer Cody Wild Scott Emmons Ian S. Fischer ... Steven H. Wang Ping Luo Stuart J. Russell Pieter Abbeel Rohin Shah AI4TS 90 27 0 16 May 2022
Task-Induced Representation Learning Jun Yamada Karl Pertsch Anisha Gunjal Joseph J. Lim SSL 62 13 0 25 Apr 2022
Switch Trajectory Transformer with Distributional Value Approximation for Multi-Task Reinforcement Learning Qinjie Lin Han Liu B. Sengupta OffRL 70 12 0 14 Mar 2022
VRL3: A Data-Driven Framework for Visual Deep Reinforcement Learning Che Wang Xufang Luo George Andriopoulos Dongsheng Li OffRL 121 51 0 17 Feb 2022
Why Should I Trust You, Bellman? The Bellman Error is a Poor Replacement for Value Error Scott Fujimoto David Meger Doina Precup Ofir Nachum S. Gu 110 32 0 28 Jan 2022
Divergent representations of ethological visual inputs emerge from supervised, unsupervised, and reinforcement learning Grace W. Lindsay J. Merel T. Mrsic-Flogel M. Sahani SSL DRL 81 6 0 03 Dec 2021
Generalized Decision Transformer for Offline Hindsight Information Matching Hiroki Furuta Y. Matsuo S. Gu OffRL 111 104 0 19 Nov 2021
Representation Learning for Online and Offline RL in Low-rank MDPs Masatoshi Uehara Xuezhou Zhang Wen Sun OffRL 140 129 0 09 Oct 2021
Conservative Data Sharing for Multi-Task Offline Reinforcement Learning Tianhe Yu Aviral Kumar Yevgen Chebotar Karol Hausman Sergey Levine Chelsea Finn OffRL 91 77 0 16 Sep 2021
Recommendation Fairness: From Static to Dynamic De-Fu Zhang Jun Wang OffRL 72 15 0 05 Sep 2021
What Matters in Learning from Offline Human Demonstrations for Robot Manipulation Ajay Mandlekar Danfei Xu J. Wong Soroush Nasiriany Chen Wang Rohun Kulkarni Li Fei-Fei Silvio Savarese Yuke Zhu Roberto Martín-Martín OffRL 291 519 0 06 Aug 2021
Policy Gradients Incorporating the Future David Venuto Elaine Lau Doina Precup Ofir Nachum OffRL 97 9 0 04 Aug 2021
Corruption-Robust Offline Reinforcement Learning Xuezhou Zhang Yiding Chen Jerry Zhu Wen Sun OffRL 94 43 0 11 Jun 2021
Pretraining Representations for Data-Efficient Reinforcement Learning Max Schwarzer Nitarshan Rajkumar Michael Noukhovitch Ankesh Anand Laurent Charlin Devon Hjelm Philip Bachman Aaron Courville OffRL 113 118 0 09 Jun 2021
Cross-Trajectory Representation Learning for Zero-Shot Generalization in RL Bogdan Mazoure Ahmed M. Ahmed Patrick MacAlpine R. Devon Hjelm Andrey Kolobov 74 27 0 04 Jun 2021
Provable Representation Learning for Imitation with Contrastive Fourier Features Ofir Nachum Mengjiao Yang SSL OffRL 105 39 0 26 May 2021
Contrastive Behavioral Similarity Embeddings for Generalization in Reinforcement Learning Rishabh Agarwal Marlos C. Machado Pablo Samuel Castro Marc G. Bellemare OffRL 121 168 0 13 Jan 2021
Parrot: Data-Driven Behavioral Priors for Reinforcement Learning Avi Singh Huihan Liu G. Zhou Albert Yu Nicholas Rhinehart Sergey Levine OffRL OnRL 81 144 0 19 Nov 2020
OPAL: Offline Primitive Discovery for Accelerating Offline Reinforcement Learning Anurag Ajay Aviral Kumar Pulkit Agrawal Sergey Levine Ofir Nachum OffRL OnRL 98 159 0 26 Oct 2020
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 705 41,681 0 22 Oct 2020
Mastering Atari with Discrete World Models Danijar Hafner Timothy Lillicrap Mohammad Norouzi Jimmy Ba DRL 149 875 0 05 Oct 2020
Transfer Learning in Deep Reinforcement Learning: A Survey Zhuangdi Zhu Kaixiang Lin Anil K. Jain Jiayu Zhou OffRL LRM 116 602 0 16 Sep 2020
Decoupling Representation Learning from Reinforcement Learning Adam Stooke Kimin Lee Pieter Abbeel Michael Laskin SSL DRL 374 345 0 14 Sep 2020