Nonlinear feedback systems perturbed by noise: steady-state probability distributions and optimal control

We describe a class of nonlinear feedback systems perturbed by white noise for which explicit formulas for steady-state probability densities can be found. We show that this class includes what has been called monotemperaturic systems in earlier work and establish relationships with Lyapunov functions for the corresponding deterministic systems. We also treat a number of stochastic optimal control problems in the case of quantized feedback, with performance criteria formulated in terms of the steady-state probability density.

[1]  Vladimir I. Bogachev,et al.  ON UNIQUENESS OF INVARIANT MEASURES FOR FINITE- AND INFINITE-DIMENSIONAL DIFFUSIONS , 1999 .

[2]  Jan Seidler,et al.  Ergodic behaviour of stochastic parabolic equations , 1997 .

[3]  W. Brockett,et al.  Minimum attention control , 1997, Proceedings of the 36th IEEE Conference on Decision and Control.

[4]  Daniel Liberzon,et al.  On explicit steady-state solutions of Fokker-Planck equations for a class of nonlinear feedback systems , 1998, Proceedings of the 1998 American Control Conference. ACC (IEEE Cat. No.98CH36207).

[5]  D. Stroock,et al.  Asymptotics of the spectral gap with applications to the theory of simulated annealing , 1989 .

[6]  T. Caughey.  The Steady-State Response of a Class of Dynamical Systems to Stochastic Excitation , 1982 .

[7]  R. Bhattacharya.  Criteria for Recurrence and Existence of Invariant Measures for Multidimensional Diffusions , 1978 .

[8]  R. W. Brockett,et al.  On the Stability of Nonlinear Feedback Systems , 1964, IEEE Transactions on Applications and Industry.

[9]  R. Khasminskii.  Stochastic Stability of Differential Equations , 1980 .

[10]  Roger W. Brockett,et al.  Oscillatory descent for function minimization , 1997 .

[11]  Weiqiu Zhu,et al.  Exact Stationary Solutions of Stochastically Excited and Dissipated Integrable Hamiltonian Systems , 1996 .

[12]  R. Khas'minskii.  Ergodic Properties of Recurrent Diffusion Processes and Stabilization of the Solution to the Cauchy Problem for Parabolic Equations , 1960 .

[13]  Daniel Liberzon,et al.  Quantized feedback stabilization of linear systems , 2000, IEEE Trans. Autom. Control..

[14]  S. Berman.  Stationary and Related Stochastic Processes , 1967 .

[15]  Daniel Liberzon,et al.  Spectral Analysis of Fokker--Planck and Related Operators Arising From Linear Stochastic Differential Equations , 2000, SIAM J. Control. Optim..

[16]  D. Delchamps.  Stabilizing a linear system with quantized state feedback , 1990 .

[17]  R. Brockett.  Lie Algebras and Lie Groups in Control Theory , 1973 .

[18]  A. T. Fuller,et al.  Analysis of nonlinear stochastic systems by means of the Fokker–Planck equation† , 1969 .

[19]  V. Bogachev.  On Uniqueness of Invariant Measures for Nite and Innnite Dimensional Diiusions , 1997 .

[20]  D. Liberzon.  Asymptotic Properties of Nonlinear Feedback Control Systems , 1998 .

[21]  M. Zakai.  A Lyapunov Criterion for the Existence of Stationary Probability Distributions for Systems Perturbed by Noise , 1969 .

[22]  J. Willems,et al.  Stochastic control and the second law of thermodynamics , 1978, 1978 IEEE Conference on Decision and Control including the 17th Symposium on Adaptive Processes.

[23]  R. Brockett,et al.  Quantized feedback systems perturbed by white noise , 1998, Proceedings of the 37th IEEE Conference on Decision and Control (Cat. No.98CH36171).

[24]  Roger W. Brockett.  Notes on Stochastic Processes on Manifolds , 1997 .

[25]  harald Cramer,et al.  Stationary And Related Stochastic Processes , 1967 .

[26]  Joachim Rosenthal,et al.  Current and future directions in applied mathematics , 1997 .