OVERVIEW OF EMERGING BAYESIAN APPROACH TO NONLINEAR SYSTEM IDENTIFICATION

Over the last twenty years, nonlinear system identiflcation has gained signiflcant interest due to the increasing demand of high performance control. Nonlinear system identiflcation is challenging owing to its complexity, unpre- dictability, and dimension curse. The literature has mainly focused on two classes of modeling. One is the most studied black-box modeling that is completely data based. Another important class of system identiflcation is grey-box modeling, i.e. certain model structure of the underlying system is known, but parameters and state variables are unknown. The general Bayesian approach to nonlinear system identiflcation targets not only the black-box problem but also the grey- box problem. The Bayesian inference idea is certainly not new but its usefulness has not been proven in nonlinear system identiflcation until recent years owing to the increasing capacity of computation power. This paper gives an overview of its most signiflcant development in recent years, namely the unscented Kalman fllter (UKF) for sequential inference of parameters/state. The UKF can be used for on- line as well as ofi-line applications. The general solution to the sequential Bayesian inference problem is flrst reviewed, and the paper will then focus on the unscented Kalman fllter as a representative of the emerging Bayesian flltering approach to system identiflcation. We endeavor to explain mathematical concepts in a simple language and provide a tutorial on some key results. Several engineering examples are presented to illustrate the new developments and their utilities.

[1]  Wlodzimierz Greblicki,et al.  Nonparametric identification of Wiener systems , 1992, IEEE Trans. Inf. Theory.

[2]  Sirish L. Shah,et al.  Closed-loop identification: a two step approach☆ , 1997 .

[3]  Eric A. Wan,et al.  Nonlinear estimation and modeling of noisy time series by dual kalman filtering methods , 2000 .

[4]  Jeffrey K. Uhlmann,et al.  Unscented filtering and nonlinear estimation , 2004, Proceedings of the IEEE.

[5]  J Kurths,et al.  Estimation of parameters and unobserved components for nonlinear systems from noisy time series. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[6]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[7]  Thomas Bo Schön,et al.  Particle Filters for System Identification of State-Space Models Linear in Either Parameters or States , 2003 .

[8]  J. Kantor An Overview of Nonlinear Geometrical Methods for Process Control , 1987 .

[9]  Thomas F. Edgar,et al.  Nonlinear state estimation , 1997 .

[10]  B. Bakshi,et al.  Bayesian estimation via sequential Monte Carlo sampling: Unconstrained nonlinear dynamic systems , 2004 .

[11]  Timothy J. Robinson,et al.  Sequential Monte Carlo Methods in Practice , 2003 .

[12]  Biao Huang,et al.  Dynamic Modelling and Prediction of Cytotoxicity on Microelectronic cell Sensor Array , 2008 .

[13]  H. Musoff,et al.  Unscented Kalman Filter , 2015 .

[14]  W. Greblicki,et al.  Recursive nonparametric identification of Hammerstein systems , 1989 .

[15]  Rudolph van der Merwe,et al.  Dual Estimation and the Unscented Transformation , 1999, NIPS.

[16]  Niels Kjølstad Poulsen,et al.  New developments in state estimation for nonlinear systems , 2000, Autom..

[17]  Leon O. Chua,et al.  Fading memory and the problem of approximating nonlinear operators with volterra series , 1985 .

[18]  Niclas Bergman,et al.  Recursive Bayesian Estimation : Navigation and Tracking Applications , 1999 .

[19]  P. Lindskog Methods, Algorithms and Tools for System Identification Based on Prior Knowledge , 1996 .

[20]  Miroslaw Pawlak,et al.  Nonparametric identification of Hammerstein systems , 1989, IEEE Trans. Inf. Theory.

[21]  M. Nowak,et al.  Virus dynamics: Mathematical principles of immunology and virology , 2001 .