Invited talk: Karl Kunisch
Prof. Dr. Karl Kunisch (University of Graz)
Solution Concepts for Optimal Feedback Control of Nonlinear Partial Differential Equations
(Tuesday, 03.03.20, 09:00-09:55, lecture hall H12)
I consider controlled dynamical systems governed by nonlinear partial differential equations. Feedback – or closed loop – control allows to express the control as a function of the state. Due to its robustness against perturbations it has significant advantages over open loop control. Optimal closed loop controls are characterized by means of solutions of Hamilton-Jacobi-Bellman (HJB) equations. These equations represent a formidable task to solve in practice. For this reason solution strategies to date are frequently based on linearisation of the underlying nonlinear differential equation. For the resulting linear problems efficient solutions based on Riccati feedback control are available.
I concentrate on the nonlinear case and present three solution strategies. The first one is based on Taylor expansions of the value function and leads to control which rely on generalized Ljapunov equations. This contains the Riccati synthesis as a special case. The second approach is based on value iteration or alternatively Newton steps applied to the HJB equation. Combined with spectral techniques and tensor calculus this allowed to solve HJB equations up to dimension 100. The third technique circumvents the direct solution of the HJB equation. Rather a neural network is trained by means of a succinctly chosen ansatz and it is proven that it approximates the solution to the HJB equation as the dimension of the network is increased.
This work relies on collaborations with T. Breiten, S. Dolgov, D. Kalise, L. Pfeiffer, and D. Walter.