Dynamic Programming Principle and Hamilton-Jacobi-Bellman Equations for Fractional-Order Systems

We consider a Bolza-type optimal control problem for a dynamical system described by a fractional differential equation with the Caputo derivative of an order $\alpha \in (0, 1)$. The value of this problem is introduced as a functional in a suitable space of histories of motions. We prove that this functional satisfies the dynamic programming principle. Based on a new notion of coinvariant derivatives of the order $\alpha$, we associate the considered optimal control problem with a Hamilton-Jacobi-Bellman equation. Under certain smoothness assumptions, we establish a connection between the value functional and a solution to this equation. Moreover, we propose a way of constructing optimal feedback controls. The paper concludes with an example.

[1]  On Hamilton-Jacobi equations for neutral-type differential games , 2018 .

[2]  A. V. Kim,et al.  Functional Differential Equations: Application of i-smooth calculus , 1999 .

[3]  Delfim F. M. Torres,et al.  Fractional Order Version of the Hamilton–Jacobi–Bellman Equation , 2018, Journal of Computational and Nonlinear Dynamics.

[4]  Yuri F. Saporito.  Stochastic Control and Differential Games with Path-Dependent Influence of Controls on Dynamics and Running Cost , 2019, SIAM J. Control. Optim..

[5]  Danna Zhou,et al.  d. , 1934, Microbial pathogenesis.

[6]  N. Lukoyanov,et al.  Hamilton–Jacobi functional equations and differential games for neutral-type systems , 2017 .

[7]  Urmila M. Diwekar,et al.  A fractional calculus approach to the dynamic optimization of biological reactive systems. Part II: Numerical solution of fractional optimal control problems , 2014 .

[8]  A. N. Krasovskii,et al.  Control under Lack of Information , 1994, Dynamics and Control.

[9]  G. Jumarie.  Fractional Hamilton-Jacobi equation for the optimal control of nonrandom fractional dynamics with fractional cost function , 2007 .

[10]  Jianfeng Zhang,et al.  Two Person Zero-Sum Game in Weak Formulation and Path Dependent Bellman-Isaacs Equation , 2012, SIAM J. Control. Optim..

[11]  N. Lukoyanov.  A Hamilton-Jacobi type equation in control problems with hereditary information , 2000 .

[12]  Sean R Eddy,et al.  What is dynamic programming? , 2004, Nature Biotechnology.

[13]  Bruno Dupire,et al.  Functional Itô Calculus , 2009 .

[14]  A. Bruckner,et al.  Differentiation of real functions , 1978 .

[15]  T. A. Burton,et al.  Fractional differential equations and Lyapunov functionals , 2011 .

[16]  N. Krasovskii.  Stability of Motion: Applications of Lyapunov's Second Method to Differential Systems and Equations with Delay , 1963 .

[17]  K. Diethelm.  The Analysis of Fractional Differential Equations: An Application-Oriented Exposition Using Differential Operators of Caputo Type , 2010 .

[18]  J.-P. Aubin,et al.  History Path Dependent Optimal Control and Portfolio Valuation and Management , 2002 .

[19]  A. I. Subbotin,et al.  Game-Theoretical Control Problems , 1987 .

[20]  Vasily E. Tarasov.  No nonlocality. No fractional derivative , 2018, Commun. Nonlinear Sci. Numer. Simul..

[21]  M. Gomoyunov.  Extremal Shift to Accompanying Points in a Positional Differential Game for a Fractional-Order System , 2020 .

[22]  Mikhail Gomoyunov,et al.  Solution to a Zero-Sum Differential Game with Fractional Dynamics via Approximations , 2019, Dynamic Games and Applications.

[23]  E. Bayraktar,et al.  Path-dependent Hamilton–Jacobi equations in infinite dimensions , 2017, Journal of Functional Analysis.

[24]  Dumitru Baleanu,et al.  On the adaptive sliding mode controller for a hyperchaotic fractional-order financial system , 2018 .

[25]  Donal O’Regan,et al.  Stability of Caputo fractional differential equations by Lyapunov functions , 2015 .

[26]  Sohrab Effati,et al.  Solving a class of fractional optimal control problems by the Hamilton–Jacobi–Bellman equation , 2018 .

[27]  Manuel A. Duarte-Mermoud,et al.  Lyapunov functions for fractional order systems , 2014, Commun. Nonlinear Sci. Numer. Simul..

[28]  I. Osipov.  On the theory of differential games of systems with aftereffect: PMM vol. 35, n≗2, 1971, pp. 300–311 , 1971 .

[29]  M. Gomoyunov.  Fractional derivatives of convex Lyapunov functions and control problems in fractional order systems , 2017, Fractional Calculus and Applied Analysis.

[30]  O. Marichev,et al.  Fractional Integrals and Derivatives: Theory and Applications , 1993 .

[31]  H. T. Tuan,et al.  Stability of fractional‐order nonlinear systems by Lyapunov direct method , 2017, IET Control Theory & Applications.

[32]  Lorenz T. Biegler,et al.  Optimization of Fractional Order Dynamic Chemical Processing Systems , 2014 .

[33]  Tadeusz Kaczorek,et al.  Minimum Energy Control of Fractional Positive Electrical Circuits with Bounded Inputs , 2014, Circuits, Systems, and Signal Processing.

[34]  A. Alikhanov.  A priori estimates for solutions of boundary value problems for fractional-order equations , 2010, 1105.4592.

[35]  Hidehiro Kaise,et al.  Path-dependent differential games of inf-sup type and Isaacs partial differential equations , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[36]  Anton Plaksin,et al.  Minimax and Viscosity Solutions of Hamilton–Jacobi–Bellman Equations for Time-Delay Systems , 2019, Journal of Optimization Theory and Applications.

[37]  H. Srivastava,et al.  Theory and Applications of Fractional Differential Equations , 2006 .

[38]  Vasily E. Tarasov,et al.  On chain rule for fractional derivatives , 2016, Commun. Nonlinear Sci. Numer. Simul..

[39]  H. Kheiri,et al.  Optimal control of a fractional-order model for the HIV/AIDS epidemic , 2018, International Journal of Biomathematics.

[40]  Jiongmin Yong,et al.  Differential Games: A Concise Introduction , 2014 .