Zero-Sum Games for Volterra Integral Equations and Viscosity Solutions of Path-Dependent Hamilton-Jacobi Equations

We consider a game, in which the dynamics is described by a non-linear Volterra integral equation of Hammerstein type with a weakly-singular kernel and the goals of the first and second players are, respectively, to minimize and maximize a given cost functional. We propose a way of how the dynamic programming principle can be formalized and the theory of generalized (viscosity) solutions of path-dependent Hamilton--Jacobi equations can be developed in order to prove the existence of the game value, obtain a characterization of the value functional, and construct players' optimal feedback strategies.

[1]  D. Idczak.  Optimal control problem governed by a highly nonlinear singular Volterra equation: Existence of solutions and maximum principle , 2023, Optimal Control Applications and Methods.

[2]  H. Kaise.  Convergence of Discrete-Time Deterministic Games to Path-Dependent Isaacs Partial Differential Equations Under Quadratic Growth Conditions , 2022, Applied Mathematics and Optimization.

[3]  Jun Moon.  Maximum Principle for State-Constrained Optimal Control Problems of Volterra Integral Equations having Singular and Nonsingular Kernels , 2022, 2203.05165.

[4]  N. Lukoyanov,et al.  Differential Games in Fractional-Order Systems: Inequalities for Directional Derivatives of the Value Functional , 2021, Proceedings of the Steklov Institute of Mathematics.

[5]  Jiongmin Yong,et al.  Causal state feedback representation for linear quadratic optimal control problems of singular Volterra integral equations , 2021, Mathematical Control and Related Fields.

[6]  Mikhail I. Gomoyunov,et al.  On viscosity solutions of path-dependent Hamilton–Jacobi–Bellman–Isaacs equations for fractional-order systems , 2021, Journal of Differential Equations.

[7]  M. Gomoyunov.  Differential Games for Fractional-Order Systems: Hamilton–Jacobi–Bellman–Isaacs Equation and Optimal Feedback Strategies , 2021, Mathematics.

[8]  N. Lukoyanov,et al.  Path-Dependent Hamilton–Jacobi Equations: The Minimax Solutions Revised , 2020, Applied Mathematics & Optimization.

[9]  Anton Plaksin,et al.  Viscosity Solutions of Hamilton-Jacobi-Bellman-Isaacs Equations for Time-Delay Systems , 2020, SIAM J. Control. Optim..

[10]  Mikhail I. Gomoyunov,et al.  Dynamic Programming Principle and Hamilton-Jacobi-Bellman Equations for Fractional-Order Systems , 2019, SIAM J. Control. Optim..

[11]  Jiongmin Yong,et al.  Controlled Singular Volterra Integral Equations and Pontryagin Maximum Principle , 2017, SIAM J. Control. Optim..

[12]  M. Gomoyunov.  Fractional derivatives of convex Lyapunov functions and control problems in fractional order systems , 2017, Fractional Calculus and Applied Analysis.

[13]  A. Dmitruk,et al.  Necessary conditions for a weak minimum in a general optimal control problem with integral equations on a variable time interval , 2017 .

[14]  L. Bourdin.  Cauchy-Lipschitz theory for fractional multi-order dynamics: State-transition matrices, Duhamel formulas and duality theorems , 2017, Differential and Integral Equations.

[15]  H. Brunner.  Volterra Integral Equations: An Introduction to Theory and Applications , 2017 .

[16]  D. Carlson.  Open-Loop Nash Equilibria for Dynamic Games Involving Volterra Integral Equations , 2016 .

[17]  Alexander G. Ramm,et al.  Integral equations and applications , 2015 .

[18]  Jiongmin Yong,et al.  Differential Games: A Concise Introduction , 2014 .

[19]  A. V. Chernov,et al.  On Volterra functional operator games on a given set , 2014, Automation and Remote Control.

[20]  S. Zagatti.  On viscosity solutions of Hamilton-Jacobi equations , 2008 .

[21]  S. A. Belbas,et al.  A reduction method for optimal control of Volterra integral equations , 2008, Appl. Math. Comput..

[22]  N. Lukoyanov.  On viscosity solution of functional Hamilton-Jacobi type equations for hereditary systems , 2007 .

[23]  S. A. Belbas,et al.  A new method for optimal control of Volterra integral equations , 2006, Appl. Math. Comput..

[24]  Y. You.  Quadratic integral games and causal synthesis , 1999 .

[25]  A. V. Kim,et al.  Functional Differential Equations: Application of i-smooth calculus , 1999 .

[26]  M. Bardi,et al.  Optimal Control and Viscosity Solutions of Hamilton-Jacobi-Bellman Equations , 1997 .

[27]  Andrei I. Subbotin,et al.  Generalized solutions of first-order PDEs - the dynamical optimization perspective , 1994, Systems and control.

[28]  M. James.  Controlled markov processes and viscosity solutions , 1994 .

[29]  R. Gorenflo,et al.  Abel Integral Equations: Analysis and Applications , 1991 .

[30]  H. Soner.  On the Hamilton-Jacobi-Bellman equations in Banach spaces , 1988 .

[31]  A. I. Subbotin,et al.  Game-Theoretical Control Problems , 1987 .

[32]  P. Lions,et al.  Some Properties of Viscosity Solutions of Hamilton-Jacobi Equations. , 1984 .

[33]  P. Souganidis,et al.  Differential Games and Representation Formulas for Solutions of Hamilton-Jacobi-Isaacs Equations. , 1983 .

[34]  Jun Moon.  A Pontryagin maximum principle for terminal state-constrained optimal control problems of Volterra integral equations with singular kernels , 2023, AIMS Mathematics.

[35]  N. Lukoyanov.  Strategies for aiming in the direction of invariant gradient , 2004 .

[36]  N. Lukoyanov.  A Hamilton-Jacobi type equation in control problems with hereditary information , 2000 .

[37]  R. Isaacs.  Differential games: a mathematical theory with applications to warfare and pursuit , 1999 .

[38]  A. I. Subbotin,et al.  Strategies of minimax aiming in the direction of the quasigradient , 1994 .

[39]  Nonlinear functional analysis and its applications, part I: Fixed-point theorems , 1991 .

[40]  R. Doss.  An elementary proof of Titchmarsh’s convolution theorem , 1988 .

[41]  V. Hutson.  Integral Equations , 1967, Nature.

[42]  E. C. Titchmarsh.  The Zeros of Certain Integral Functions , 1926 .

[43]  Author manuscript, published in "Journal of Optimization Theory and Applications (2013)" DOI: 10.1007/s10957-013-0299-3 , 2022 .