CoBERL: Contrastive BERT for Reinforcement Learning

v1v2 (latest)

CoBERL: Contrastive BERT for Reinforcement Learning

12 July 2021

Adria Puidomenech Badia

Jovana Mitrović

Charles Blundell

ArXiv (abs)PDF HTML

Papers citing "CoBERL: Contrastive BERT for Reinforcement Learning"

18 / 18 papers shown

Title
MarineFormer: A Transformer-based Navigation Policy Model for Collision Avoidance in Marine Environment Ehsan Kazemi Iman Soltani 397 2 0 17 Oct 2024
Contrastive Abstraction for Reinforcement Learning Vihang Patil M. Hofmarcher Elisabeth Rumetshofer Sepp Hochreiter OffRL SSL 107 2 0 01 Oct 2024
Learning Goal-Conditioned Representations for Language Reward Models Vaskar Nath Dylan Slack Jeff Da Yuntao Ma Hugh Zhang Spencer Whitehead Sean Hendryx 56 0 0 18 Jul 2024
CORN: Contact-based Object Representation for Nonprehensile Manipulation of General Unseen Objects Yoonyoung Cho Junhyek Han Yoontae Cho Beomjoon Kim 115 8 0 16 Mar 2024
PASTA: Pretrained Action-State Transformer Agents Raphael Boige Yannis Flet-Berliac Arthur Flajolet Guillaume Richard Thomas Pierrot LM&Ro OffRL 119 5 0 20 Jul 2023
Transformers in Reinforcement Learning: A Survey Pranav Agarwal A. Rahman P. St-Charles Simon J. D. Prince Samira Ebrahimi Kahou OffRL 106 21 0 12 Jul 2023
RePreM: Representation Pre-training with Masked Model for Reinforcement Learning Yuanying Cai Wei Shen Wei Shen Xuyun Zhang Wenjie Ruan Longbo Huang OffRL 99 5 0 03 Mar 2023
SMART: Self-supervised Multi-task pretrAining with contRol Transformers Yanchao Sun Shuang Ma Ratnesh Madaan Rogerio Bonatti Furong Huang Ashish Kapoor 102 42 0 24 Jan 2023
A Survey on Transformers in Reinforcement Learning Wenzhe Li Hao Luo Zichuan Lin Chongjie Zhang Zongqing Lu Deheng Ye OffRL MU AI4CE 128 58 0 08 Jan 2023
Transformer in Transformer as Backbone for Deep Reinforcement Learning Hangyu Mao Rui Zhao Hao Chen Jianye Hao Yiqun Chen Dong Li Junge Zhang Zhen Xiao OffRL 93 8 0 30 Dec 2022
On Transforming Reinforcement Learning by Transformer: The Development Trajectory Shengchao Hu Li Shen Ya Zhang Yixin Chen Dacheng Tao OffRL 148 30 0 29 Dec 2022
Using Forwards-Backwards Models to Approximate MDP Homomorphisms Augustine N. Mavor-Parker Matthew J. Sargent Christian Pehle Andrea Banino Lewis D. Griffin Caswell Barry 64 1 0 14 Sep 2022
Light-weight probing of unsupervised representations for Reinforcement Learning Wancong Zhang Anthony GX-Chen Vlad Sobal Yann LeCun Nicolas Carion SSL OffRL 76 14 0 25 Aug 2022
Retrieval-Augmented Reinforcement Learning Anirudh Goyal A. Friesen Andrea Banino T. Weber Nan Rosemary Ke ... Michal Valko Simon Osindero Timothy Lillicrap N. Heess Charles Blundell OffRL 89 55 0 17 Feb 2022
Abstraction for Deep Reinforcement Learning Murray Shanahan Melanie Mitchell OffRL 95 28 0 10 Feb 2022
Procedural Generalization by Planning with Self-Supervised World Models Ankesh Anand Jacob Walker Yazhe Li Eszter Vértes Julian Schrittwieser Sherjil Ozair T. Weber Jessica B. Hamrick 80 31 0 02 Nov 2021
Towards mental time travel: a hierarchical memory for reinforcement learning agents Andrew Kyle Lampinen Stephanie C. Y. Chan Andrea Banino Felix Hill 92 47 0 28 May 2021
Unsupervised Learning of Visual Features by Contrasting Cluster Assignments Mathilde Caron Ishan Misra Julien Mairal Priya Goyal Piotr Bojanowski Armand Joulin OCL SSL 346 4,109 0 17 Jun 2020