Practical Output-Feedback Risk-Sensitive Control for Stochastic Nonlinear Systems with Stable Zero-Dynamics

This paper addresses the design problem of practical (or satisfaction) output-feedback controls for stochastic strict-feedback nonlinear systems in observer canonical form with stable zero-dynamics under long-term average tracking risk-sensitive cost criteria. The cost function adopted here is of the quadratic-integral type usually encountered in practice, rather than the quartic-integral one used to avoid difficulty in control design and performance analysis of the closed-loop system. A sequence of coordinate diffeomorphisms is introduced to separate the zero-dynamics from the entire system, so that the transformed system has an appropriate form suitable for integrator backstepping design. For any given risk-sensitivity parameter and desired cost value, by using the integrator backstepping methodology, an output-feedback control is constructively designed such that (a) the closed-loop system is bounded in probability and (b) the long-term average risk-sensitive cost is upper bounded by the desired value. In addition, this paper does not require the uniform boundedness of the gain functions of the system noise. Furthermore, an example is given to show the effectiveness of the theory.

[1]  Miroslav Krstic,et al.  Output-feedback stochastic nonlinear stabilization , 1999, IEEE Trans. Autom. Control..

[2]  I. Kanellakopoulos,et al.  Nonlinear design of adaptive controllers for linear systems , 1994, IEEE Trans. Autom. Control..

[3]  Wei Lin,et al.  Adaptive output tracking of inherently nonlinear systems with nonlinear parameterization , 2003, IEEE Trans. Autom. Control..

[4]  S.,et al.  Risk-Sensitive Control and Dynamic Games for Partially Observed Discrete-Time Nonlinear Systems , 1994 .

[5]  H. Nagai Bellman equations of risk sensitive control , 1995, Proceedings of 1995 34th IEEE Conference on Decision and Control.

[6]  Farshad Khorrami,et al.  Application of a decentralized adaptive output feedback based on backstepping to power systems , 1995, Proceedings of 1995 34th IEEE Conference on Decision and Control.

[7]  T. Runolfsson The equivalence between infinite-horizon optimal control of stochastic systems with exponential-of-integral performance index and stochastic differential games , 1994, IEEE Trans. Autom. Control..

[8]  Zhong-Ping Jiang,et al.  Backstepping-based adaptive controllers for uncertain nonholonomic systems , 1995, Proceedings of 1995 34th IEEE Conference on Decision and Control.

[9]  Zhong-Ping Jiang,et al.  A recursive technique for tracking control of nonholonomic systems in chained form , 1999, IEEE Trans. Autom. Control..

[10]  Yungang Liu,et al.  Design of satisfaction output feedback controls for stochastic nonlinear systems under quadratic tracking risk-sensitive index , 2007, Science in China Series F: Information Sciences.

[11]  LIUYungang,et al.  Minimal-order observer and output-feedback stabilization control design of stochastic nonlinear systems , 2004 .

[12]  Tamer Basar,et al.  Risk-sensitive adaptive trackers for strict-feedback systems with output measurements , 2002, IEEE Trans. Autom. Control..

[13]  Ruth J. Williams,et al.  Stabilization of stochastic nonlinear systems driven by noise of unknown covariance , 1998, Proceedings of the 1998 American Control Conference. ACC (IEEE Cat. No.98CH36207).

[14]  A. Bensoussan,et al.  Optimal control of partially observable stochastic systems with an exponential-of-integral performance index , 1985 .

[15]  John S. Baras,et al.  Partially Observed Differential Games, Infinite Dimensional HJI Equations, and Nonlinear HControl , 1994 .

[16]  P. Whittle Risk-sensitive linear/quadratic/gaussian control , 1981, Advances in Applied Probability.

[17]  T. Basar,et al.  Backstepping controller design for nonlinear stochastic systems under a risk-sensitive cost criterion , 1997, Proceedings of the 1997 American Control Conference (Cat. No.97CH36041).

[18]  R. Marino,et al.  Global adaptive output-feedback control of nonlinear systems , 1991, [1991] Proceedings of the 30th IEEE Conference on Decision and Control.

[19]  W. Fleming,et al.  Risk-Sensitive Control on an Infinite Time Horizon , 1995 .

[20]  Yungang Liu,et al.  Output feedback control design for strict-feedback stochastic nonlinear systems under a risk-sensitive cost , 2003, IEEE Trans. Autom. Control..

[21]  P. Florchinger Lyapunov-Like Techniques for Stochastic Stability , 1995 .

[22]  P. Whittle Risk-Sensitive Optimal Control , 1990 .

[23]  Robert J. Elliott,et al.  General finite-dimensional risk-sensitive problems and small noise limits , 1996, IEEE Trans. Autom. Control..

[24]  Rhodes,et al.  Optimal stochastic linear systems with exponential performance criteria and their relation to deterministic differential games , 1973 .

[25]  Ji-Feng Zhang,et al.  Reduced-order observer-based control design for nonlinear stochastic systems , 2004, Syst. Control. Lett..

[26]  A. Isidori Nonlinear Control Systems , 1985 .

[27]  Yungang Liu,et al.  Output feedback stabilization for stochastic nonlinear systems in observer canonical form with stable zero-dynamics , 2007, Science in China Series : Information Sciences.

[28]  Miroslav Krstic,et al.  Stabilization of stochastic nonlinear systems driven by noise of unknown covariance , 2001, IEEE Trans. Autom. Control..

[29]  A. Annaswamy,et al.  Adaptive control of nonlinear systems with a triangular structure , 1994, IEEE Trans. Autom. Control..

[30]  M. James,et al.  Extending H-infinity Control to Nonlinear Systems: Control of Nonlinear Systems to Achieve Performance Objectives , 1987 .

[31]  A. Swiech Risk-sensitive control and differential games in infinite dimensions☆ , 2002 .

[32]  Zigang Pan,et al.  Locally optimal backstepping design , 1997, Proceedings of the 36th IEEE Conference on Decision and Control.

[33]  Murat Arcak,et al.  Constructive nonlinear control: a historical perspective , 2001, Autom..

[34]  I. Kanellakopoulos,et al.  Systematic Design of Adaptive Controllers for Feedback Linearizable Systems , 1991, 1991 American Control Conference.

[35]  A. Bensoussan Stochastic Control of Partially Observable Systems , 1992 .

[36]  D. Mayne Nonlinear and Adaptive Control Design [Book Review] , 1996, IEEE Transactions on Automatic Control.

[37]  T. Başar,et al.  Adaptive Controller Design for Tracking and Disturbance Attenuation in Parametric-Strict-Feedback Nonlinear Systems , 1996 .

[38]  Arthur J. Krener,et al.  Backstepping design with local optimality matching , 2001, IEEE Trans. Autom. Control..