Special Session 49: Stochastic Control, Filtering and Related Fields

Policy Iteration Reinforcement Learning Method for Continuous-time Linear-Quadratic Mean-Field Control Problem
Na Li
School of Statistics and Mathematics, Shandong University of Finance and Economics
Peoples Rep of China
Co-Author(s):    
Abstract:
This paper employs a policy iteration reinforcement learning (RL) method to study continuous-time linear quadratic mean-field control problems in the infinite horizon. The drift and diffusion terms in the dynamics involve the state as well as the control. We investigate the stability and convergence of the RL algorithm using a Lyapunov Recursion. Instead of solving a pair of coupled Riccati equations, the RL technique focuses on strengthening an auxiliary function and the cost functional as the objective functions and updating the new policy to compute the optimal control via state trajectories. A numerical example sheds light on the established theoretical results.