ILC-Based Minimum Entropy Filter Design and Implementation for Non-Gaussian Stochastic Systems

A new filtering approach based on the idea of iterative learning control (ILC) is proposed for linear and non-Gaussian stochastic systems. The objective of filtering is to estimate the states of linear systems with non-Gaussian random disturbances so that the entropy of output error is made to monotonically decrease along the progress of batches of process operation. The term Batch is referred to a period of time when the process repeats itself. During a batch, the filter gain is kept fixed and state estimation is performed. Between any two adjacent batches, the filter gain is updated so that the entropy of closed-loop output error is reduced for the next batch. Analysis is carried out to explicitly determine the learning rates which lead to convergence of the overall algorithm. Experiments have been implemented on a laboratory-based process test rig to demonstrate the effectiveness of proposed filtering method.

[1]  Hong Wang,et al.  Iterative Learning based Stochastic Distribution Control and Its Applications , 2006 .

[2]  Hong Wang,et al.  ILC-Based Fixed-Structure Controller Design for Output PDF Shaping in Stochastic Systems Using LMI Techniques , 2009, IEEE Transactions on Automatic Control.

[3]  Hong Wang,et al.  Minimum entropy control of closed-loop tracking errors for dynamic stochastic systems , 2003, IEEE Trans. Autom. Control..

[4]  Hong Wang,et al.  Filter-based FDD using PDFs for stochastic systems with time delays , 2005, Proceedings of the 2005, American Control Conference, 2005..

[5]  F. Carravetta,et al.  Polynomial Filtering for Linear Discrete Time Non-Gaussian Systems , 1996 .

[6]  D. McFarlane,et al.  Optimal guaranteed cost filtering for uncertain discrete-time linear systems , 1996 .

[7]  Hong Wang,et al.  ILC-based Generalised PI Control for Output PDF of Stochastic Systems Using LMI and RBF Neural Networks , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[8]  Qing Zhang,et al.  Hybrid filtering for linear systems with non-Gaussian disturbances , 2000, IEEE Trans. Autom. Control..

[9]  V. Balakrishnan,et al.  Robust adaptive Kalman filters for linear time-varying systems with stochastic parametric uncertainties , 1999, Proceedings of the 1999 American Control Conference (Cat. No. 99CH36251).

[10]  Lei Guo,et al.  Applying constrained nonlinear generalized PI strategy to PDF tracking control through square root B-spline models , 2004 .

[11]  Sauro Longhi,et al.  Development and experimental validation of an adaptive extended Kalman filter for the localization of mobile robots , 1999, IEEE Trans. Robotics Autom..

[12]  Isaac Yaesh,et al.  Hinfinity control and filtering of discrete-time stochastic systems with multiplicative noise , 2001, Autom..

[13]  C. D. Kemp,et al.  Density Estimation for Statistics and Data Analysis , 1987 .

[14]  Fan Wang,et al.  Robust Kalman filters for linear time-varying systems with stochastic parametric uncertainties , 2002, IEEE Trans. Signal Process..

[15]  Graham C. Goodwin,et al.  Adaptive filtering prediction and control , 1984 .

[16]  K. Glover,et al.  Minimum entropy H ∞ control , 1990 .

[17]  Hong Wang,et al.  Fault detection and diagnosis for general stochastic systems using B-spline expansions and nonlinear filters , 2005, IEEE Transactions on Circuits and Systems I: Regular Papers.

[18]  Jay H. Lee,et al.  Extended Kalman Filter Based Nonlinear Model Predictive Control , 1993, 1993 American Control Conference.

[19]  Hong Wang,et al.  Robust Iterative Learning Control of Output PDF in Non-Gaussian Stochastic Systems Using Youla Parametrization , 2007, 2007 American Control Conference.

[20]  Stephen P. Boyd,et al.  Linear Matrix Inequalities in Systems and Control Theory , 1994 .

[21]  Fuwen Yang,et al.  Robust Kalman filtering for discrete time-varying uncertain systems with multiplicative noises , 2002, IEEE Trans. Autom. Control..

[22]  Hong Wang,et al.  Bounded Dynamic Stochastic Systems: Modelling and Control , 2000 .

[23]  Hong Wang,et al.  Radial Basis Function based Iterative Learning Control for stochastic distribution systems , 2006, 2006 IEEE Conference on Computer Aided Control System Design, 2006 IEEE International Conference on Control Applications, 2006 IEEE International Symposium on Intelligent Control.

[24]  Uri Shaked,et al.  Robust minimum variance filtering , 1995, IEEE Trans. Signal Process..

[25]  Konrad Reif,et al.  The extended Kalman filter as an exponential observer for nonlinear systems , 1999, IEEE Trans. Signal Process..

[26]  Hong Wang,et al.  ILC-based adaptive minimum entropy control for general stochastic systems using neural networks , 2007, 2007 46th IEEE Conference on Decision and Control.

[27]  Hong Wang,et al.  An ILC-based Minimum Entropy PI Controller for Unknown and Non-Gaussian Stochastic Systems , 2008 .

[28]  Jian-Wu Xu,et al.  Minimum error entropy Luenberger observer , 2005, Proceedings of the 2005, American Control Conference, 2005..

[29]  Magnus Mossberg,et al.  Optimal experimental design for identification of viscoelastic materials , 2004, IEEE Transactions on Control Systems Technology.

[30]  Fuwen Yang,et al.  Robust Error Square Constrained Filter Design for Systems With Non-Gaussian Noises , 2008, IEEE Signal Processing Letters.

[31]  J. Speyer,et al.  A stochastic analysis of a modified gain extended Kalman filter with applications to estimation with bearings only measurements , 1983 .

[32]  Lei Guo,et al.  Minimum entropy filtering for multivariate stochastic systems with non-Gaussian noises , 2005 .

[33]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[34]  ZuTao Zhang,et al.  A novel strong tracking finite-difference extended Kalman filter for nonlinear eye tracking , 2009, Science in China Series F: Information Sciences.

[35]  Lei Guo,et al.  PID controller design for output PDFs of stochastic systems using linear matrix inequalities , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[36]  Tianyou Chai,et al.  An ILC-Based Adaptive Control for General Stochastic Systems With Strictly Decreasing Entropy , 2009, IEEE Transactions on Neural Networks.

[37]  Hong Wang,et al.  Bounded Dynamic Stochastic Systems , 2012 .

[38]  B. Anderson,et al.  Optimal Filtering , 1979, IEEE Transactions on Systems, Man, and Cybernetics.

[39]  Puya Afshar,et al.  Intelligent model reference adaptive distribution control for non-Gaussian stochastic systems , 2009, 2009 International Conference on Networking, Sensing and Control.