Provably Fast Convergence of Independent Natural Policy Gradient for
Markov Potential Games

v1v2 (latest)

Provably Fast Convergence of Independent Natural Policy Gradient for Markov Potential Games

15 October 2023

Shahin Shahrampour

ArXiv (abs)PDF HTML

Papers citing "Provably Fast Convergence of Independent Natural Policy Gradient for Markov Potential Games"

14 / 14 papers shown

Title
First-order Policy Optimization for Robust Markov Decision Process Yan Li Guanghui Lan Tuo Zhao 113 24 0 21 Sep 2022
Independent Natural Policy Gradient Methods for Potential Games: Finite-time Global Convergence with Entropy Regularization Shicong Cen Fan Chen Yuejie Chi 69 15 0 12 Apr 2022
V-Learning -- A Simple, Efficient, Decentralized Algorithm for Multiagent RL Chi Jin Qinghua Liu Yuanhao Wang Tiancheng Yu OffRL 59 132 0 27 Oct 2021
When Can We Learn General-Sum Markov Games with a Large Number of Players Sample-Efficiently? Ziang Song Song Mei Yu Bai 101 68 0 08 Oct 2021
Building a Foundation for Data-Driven, Interpretable, and Robust Policy Design using the AI Economist Alexander R. Trott Sunil Srinivasa D. V. D. Wal S. Haneuse Stephan Zheng OffRL 55 38 0 06 Aug 2021
Policy Gradient Methods Find the Nash Equilibrium in N-player General-sum Linear-quadratic Games B. Hambly Renyuan Xu Huining Yang 61 28 0 27 Jul 2021
Global Convergence of Multi-Agent Policy Gradient in Markov Potential Games Stefanos Leonardos W. Overman Ioannis Panageas Georgios Piliouras 73 123 0 03 Jun 2021
Gradient play in stochastic games: stationary points, convergence, and sample complexity Runyu Zhang Tongzheng Ren Na Li 81 44 0 01 Jun 2021
The Surprising Effectiveness of PPO in Cooperative, Multi-Agent Games Chao Yu Akash Velu Eugene Vinitsky Jiaxuan Gao Yu Wang Alexandre M. Bayen Yi Wu OffRL 137 1,252 0 02 Mar 2021
Independent Policy Gradient Methods for Competitive Reinforcement Learning C. Daskalakis Dylan J. Foster Noah Golowich 217 162 0 11 Jan 2021
Multi-Agent Reinforcement Learning: A Selective Overview of Theories and Algorithms Kai Zhang Zhuoran Yang Tamer Basar 196 1,218 0 24 Nov 2019
Learning Parametric Closed-Loop Policies for Markov Potential Games Sergio Valcarcel Macua Javier Zazo S. Zazo 64 46 0 03 Feb 2018
Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environments Ryan J. Lowe Yi Wu Aviv Tamar J. Harb Pieter Abbeel Igor Mordatch 140 4,485 0 07 Jun 2017
Safe, Multi-Agent, Reinforcement Learning for Autonomous Driving Shai Shalev-Shwartz Shaked Shammah Amnon Shashua 108 836 0 11 Oct 2016

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.