A stochastic controller for a scalar linear system with additive Cauchy noise

A stochastic control scheme is developed for scalar, discrete-time, and linear-dynamic systems driven by Cauchy distributed process and measurement noises. When addressing the optimal control problem for such systems, the standard quadratic cost criteria cannot be used. In this study we introduce a new objective function that is functionally similar to the Cauchy probability density function. The performance index, defined as the expectation of this objective function with respect to the Cauchy densities, exists. The dynamic programming solution to the fixed and finite horizon optimal control problem that uses this performance index appears to be intractable. Therefore, a moving horizon optimal model predictive control problem is implemented, for which the conditional expected value of the objective function and its gradients can be computed in closed form and without assumptions such as certainty equivalence. Numerical results are shown for this m -step model predictive optimal controller and compared to a similar, Linear-Exponential-Gaussian model predictive controller. An essential difference between the Cauchy and Gaussian controllers when applied to a system with Cauchy noises is that, while the Gaussian controller is linear and reacts strongly to all noise pulses, the Cauchy controller can differentiate between measurement and process noise pulses by ignoring the former while responding to the latter. This property of the Cauchy controller occurs when an impulsive measurement noise is more likely than an impulsive process noise. The Cauchy and Gaussian controllers react similarly when applied to a system with Gaussian noises, demonstrating the robustness of the proposed control scheme.

[1]  P. Holland,et al.  Robust regression using iteratively reweighted least-squares , 1977 .

[2]  Jun Yan,et al.  Incorporating state estimation into model predictive control and its application to network traffic control , 2005, Autom..

[3]  C. L. Nikias,et al.  Deviation from normality in statistical signal processing: parameter estimation with alpha-stable distributions , 1998 .

[4]  Rhodes,et al.  Optimal stochastic linear systems with exponential performance criteria and their relation to deterministic differential games , 1973 .

[5]  Basil Kouvaritakis,et al.  Stochastic tube MPC with state estimation , 2012, Autom..

[6]  M. Taqqu,et al.  Stable Non-Gaussian Random Processes : Stochastic Models with Infinite Variance , 1995 .

[7]  Moshe Idan,et al.  Cauchy Estimation for Linear Scalar Systems , 2008, IEEE Transactions on Automatic Control.

[8]  Roger Fletcher,et al.  A Rapidly Convergent Descent Method for Minimization , 1963, Comput. J..

[9]  S. Dreyfus Dynamic Programming and the Calculus of Variations , 1960 .

[10]  G. E. Myers Properties of the conjugate-gradient and Davidon methods , 1968 .

[11]  Moshe Idan,et al.  A stochastic controller for vector linear systems with additive cauchy noises , 2013, 52nd IEEE Conference on Decision and Control.

[12]  Evanghelos Zafiriou,et al.  Robust process control , 1987 .

[13]  A. A. Emadzadeh,et al.  Optimal control for a scalar one-step linear system with additive Cauchy noise , 2010, Proceedings of the 2010 American Control Conference.

[14]  B. Heimann,et al.  Fleming, W. H./Rishel, R. W., Deterministic and Stochastic Optimal Control. New York‐Heidelberg‐Berlin. Springer‐Verlag. 1975. XIII, 222 S, DM 60,60 , 1979 .

[15]  Peter J. W. Rayner,et al.  Near optimal detection of signals in impulsive noise modeled with a symmetric /spl alpha/-stable distribution , 1998, IEEE Communications Letters.

[16]  W. Fleming,et al.  Deterministic and Stochastic Optimal Control , 1975 .

[17]  Moshe Idan,et al.  Multi-step prediction optimal control for a scalar linear system with additive Cauchy noise , 2010, 49th IEEE Conference on Decision and Control (CDC).

[18]  Moshe Idan,et al.  Multivariate Cauchy estimator with scalar measurement and process noises , 2013, 52nd IEEE Conference on Decision and Control.

[19]  T.W. Pirinen,et al.  A Confidence Statistic and an Outlier Detector for Difference Estimates in Sensor Arrays , 2008, IEEE Sensors Journal.

[20]  An outlier nomination method based on the multihalver , 2004 .

[21]  Jason L. Speyer,et al.  Stochastic Processes, Estimation, and Control , 2008, Advances in design and control.