Warm-Start Actor-Critic: From Approximation Error to Sub-optimality Gap

20 June 2023

Papers citing "Warm-Start Actor-Critic: From Approximation Error to Sub-optimality Gap"

26 / 26 papers shown

Title
Leveraging Offline Data in Online Reinforcement Learning Andrew Wagenmaker Aldo Pacchiano OffRL OnRL 66 40 0 09 Nov 2022
Hybrid RL: Using Both Offline and Online Data Can Make RL Efficient Yuda Song Yi Zhou Ayush Sekhari J. Andrew Bagnell A. Krishnamurthy Wen Sun OffRL OnRL 75 105 0 13 Oct 2022
Jump-Start Reinforcement Learning Ikechukwu Uchendu Ted Xiao Yao Lu Banghua Zhu Mengyuan Yan ... Chuyuan Fu Cong Ma Jiantao Jiao Sergey Levine Karol Hausman OffRL OnRL 84 113 0 05 Apr 2022
Lessons from AlphaZero for Optimal, Model Predictive, and Adaptive Control Dimitri Bertsekas AI4CE 105 56 0 20 Aug 2021
Offline-to-Online Reinforcement Learning via Balanced Replay and Pessimistic Q-Ensemble Seunghyun Lee Younggyo Seo Kimin Lee Pieter Abbeel Jinwoo Shin OffRL OnRL 60 191 0 01 Jul 2021
Policy Finetuning: Bridging Sample-Efficient Offline and Online Reinforcement Learning Tengyang Xie Nan Jiang Huan Wang Caiming Xiong Yu Bai OffRL OnRL 90 164 0 09 Jun 2021
Finite Sample Analysis of Two-Time-Scale Natural Actor-Critic Algorithm S. Khodadadian Thinh T. Doan Justin Romberg S. T. Maguluri 85 43 0 26 Jan 2021
Single-Timescale Actor-Critic Provably Finds Globally Optimal Policy Zuyue Fu Zhuoran Yang Zhaoran Wang 85 43 0 02 Aug 2020
On the Convergence of SGD with Biased Gradients Ahmad Ajalloeian Sebastian U. Stich 58 87 0 31 Jul 2020
AWAC: Accelerating Online Reinforcement Learning with Offline Datasets Ashvin Nair Abhishek Gupta Murtaza Dalal Sergey Levine OffRL OnRL 111 615 0 16 Jun 2020
Non-asymptotic Convergence Analysis of Two Time-scale (Natural) Actor-Critic Algorithms Tengyu Xu Zhe Wang Yingbin Liang 78 58 0 07 May 2020
DisCor: Corrective Feedback in Reinforcement Learning via Distribution Correction Aviral Kumar Abhishek Gupta Sergey Levine OffRL 54 102 0 16 Mar 2020
A Tale of Two-Timescale Reinforcement Learning with the Tightest Finite-Time Bound Gal Dalal Balazs Szorenyi Gugan Thoppe OffRL 57 52 0 20 Nov 2019
Relay Policy Learning: Solving Long-Horizon Tasks via Imitation and Reinforcement Learning Abhishek Gupta Vikash Kumar Corey Lynch Sergey Levine Karol Hausman 95 433 0 25 Oct 2019
On the Sample Complexity of Actor-Critic Method for Reinforcement Learning with Function Approximation Harshat Kumar Alec Koppel Alejandro Ribeiro 152 84 0 18 Oct 2019
On the Theory of Policy Gradient Methods: Optimality, Approximation, and Distribution Shift Alekh Agarwal Sham Kakade Jason D. Lee G. Mahajan 72 321 0 01 Aug 2019
Finite-Sample Analysis for SARSA with Linear Function Approximation Shaofeng Zou Tengyu Xu Yingbin Liang 63 148 0 06 Feb 2019
Regret Bounds for Reinforcement Learning via Markov Chain Concentration R. Ortner 69 46 0 06 Aug 2018
A Finite Time Analysis of Temporal Difference Learning With Linear Function Approximation Jalaj Bhandari Daniel Russo Raghav Singal 106 340 0 06 Jun 2018
Bernstein's inequalities for general Markov chains Bai Jiang Qiang Sun Jianqing Fan 49 45 0 28 May 2018
Addressing Function Approximation Error in Actor-Critic Methods Scott Fujimoto H. V. Hoof David Meger OffRL 189 5,212 0 26 Feb 2018
Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithm David Silver Thomas Hubert Julian Schrittwieser Ioannis Antonoglou Matthew Lai ... D. Kumaran T. Graepel Timothy Lillicrap Karen Simonyan Demis Hassabis 153 1,782 0 05 Dec 2017
Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learning Stefan Elfwing E. Uchibe Kenji Doya 136 1,739 0 10 Feb 2017
Deep Reinforcement Learning: An Overview Yuxi Li OffRL VLM 241 1,542 0 25 Jan 2017
Safe, Multi-Agent, Reinforcement Learning for Autonomous Driving Shai Shalev-Shwartz Shaked Shammah Amnon Shashua 111 840 0 11 Oct 2016
Deep Reinforcement Learning with Double Q-learning H. V. Hasselt A. Guez David Silver OffRL 172 7,662 0 22 Sep 2015