Optimal control using microscopic models for a pollutant elimination problem

Optimal control problem with partial derivative equation (PDE) constraint is a numerical-wise difficult problem because the optimality conditions lead to PDEs with mixed types of boundary values. The authors provide a new approach to solve this type of problem by space discretization and transform it into a standard optimal control for a multi-agent system. This resulting problem is formulated from a microscopic perspective while the solution only needs limited the macroscopic measurement due to the approach of Hamilton-Jacobi-Bellman (HJB) equation approximation. For solving the problem, only an HJB equation (a PDE with only terminal boundary condition) needs to be solved, although the dimension of that PDE is increased as a drawback. A pollutant elimination problem is considered as an example and solved by this approach. A numerical method for solving the HJB equation is proposed and a simulation is carried out.

[1]  B. Øksendal,et al.  Applied Stochastic Control of Jump Diffusions , 2004, Universitext.

[2]  Xiaoming Hu,et al.  Optimal leader-follower control for crowd evacuation , 2013, 52nd IEEE Conference on Decision and Control.

[3]  D. Luenberger.  Optimization by Vector Space Methods , 1968 .

[4]  Xiaoming Hu,et al.  Shaping up crowd of agents through controlling their statistical moments , 2015, 2015 European Control Conference (ECC).

[5]  M. Egerstedt,et al.  Leader-based multi-agent coordination: controllability and optimal control , 2006, 2006 American Control Conference.

[6]  Randal W. Beard,et al.  Consensus seeking in multiagent systems under dynamically changing interaction topologies , 2005, IEEE Transactions on Automatic Control.

[7]  A. Aziz,et al.  Control theory of systems governed by partial differential equations , 1977 .

[8]  Karl Kunisch,et al.  Primal-Dual Strategy for State-Constrained Optimal Control Problems , 2002, Comput. Optim. Appl..

[9]  R Bellman,et al.  DYNAMIC PROGRAMMING AND LAGRANGE MULTIPLIERS. , 1956, Proceedings of the National Academy of Sciences of the United States of America.

[10]  K. Hoffmann,et al.  Optimal Control of Partial Differential Equations , 1991 .

[11]  S. Kahne,et al.  Optimal control: An introduction to the theory and ITs applications , 1967, IEEE Transactions on Automatic Control.

[12]  Richard M. Murray,et al.  Consensus problems in networks of agents with switching topology and time-delays , 2004, IEEE Transactions on Automatic Control.