Recursive hidden input estimation in nonlinear dynamic systems with varying amounts of a priori knowledge

Estimation of additive driving-forces (e.g., hidden inputs) in nonlinear dynamic systems is addressed with varying amounts of a priori knowledge on system models exemplified by three typical scenarios: (1) there is no sufficient prior knowledge to build a mathematical model of the underlying system; (2) the system is partially described by an analytic model; (3) a complete and accurate model of the underlying system is available. Three algorithms are proposed for each scenario and analyzed comprehensively. The adaptive driving-force estimator (ADFE) [1,2] is used for the retrieval of driving-forces using only the system outputs for the first scenario. A variational Bayesian and a Bayesian algorithm are established for the second and the third scenarios, respectively. All three algorithms are studied in depth on a nonlinear dynamic system with equivalent computational resources, and the Posterior Cramer-Rao Lower Bounds (PCRLB) are specified as performance metrics for each case. The results lead to a thorough understanding of the capabilities and limitations of the ADFE, which manifests itself as an effective technique for the estimation of rapidly varying hidden inputs unless a complete and accurate model is available. Moreover, the methods developed in this paper facilitate a suitable framework for the construction of new and efficient tools for various input estimation problems. In particular, the proposed algorithms constitute a readily available basis for the design of novel input residual estimators to approach the Fault Diagnosis and Isolation (FDI) problem from a new and different perspective.

[1]  Michael A. West,et al.  Combined Parameter and State Estimation in Simulation-Based Filtering , 2001, Sequential Monte Carlo Methods in Practice.

[2]  Thomas Schreiber,et al.  Detecting and Analyzing Nonstationarity in a Time Series Using Nonlinear Cross Predictions , 1997, chao-dyn/9909044.

[3]  Fredrik Gustafsson,et al.  On Resampling Algorithms for Particle Filters , 2006, 2006 IEEE Nonlinear Statistical Signal Processing Workshop.

[4]  D. Ruelle,et al.  Recurrence Plots of Dynamical Systems , 1987 .

[5]  A. Doucet,et al.  Particle filtering for partially observed Gaussian state space models , 2002 .

[6]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[7]  Gianluigi Pillonetto,et al.  Input estimation in nonlinear dynamical systems using differential algebra techniques , 2006, Autom..

[8]  T. Moon The expectation-maximization algorithm , 1996, IEEE Signal Process. Mag..

[9]  Pablo M. Granitto,et al.  Extracting driving signals from non-stationary time series , 2002, VII Brazilian Symposium on Neural Networks, 2002. SBRN 2002. Proceedings..

[10]  Jie Chen,et al.  Robust Model-Based Fault Diagnosis for Dynamic Systems , 1998, The International Series on Asian Studies in Computer and Information Science.

[11]  Petar V. Kokotovic,et al.  Nonlinear observers: a circle criterion design and robustness analysis , 2001, Autom..

[12]  Huazhen Fang,et al.  Simultaneous input and state estimation for nonlinear systems with applications to flow field estimation , 2013, Autom..

[13]  Ron J. Patton,et al.  Input Observability and Input Reconstruction , 1998, Autom..

[14]  Ulaş Güntürkün,et al.  Sequential reconstruction of driving-forces from nonlinear nonstationary dynamics , 2010 .

[15]  Pablo M. Granitto,et al.  Modelling nonstationary dynamics , 2003 .

[16]  Donghua Zhou,et al.  Particle-filter-based estimation and prediction of chaotic states , 2007 .

[17]  T. Schreiber Interdisciplinary application of nonlinear time series methods , 1998, chao-dyn/9807001.

[18]  Kristine L. Bell,et al.  A Tutorial on Particle Filters for Online Nonlinear/NonGaussian Bayesian Tracking , 2007 .

[19]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[20]  M. Boutayeb,et al.  Generalized state-space observers for chaotic synchronization and secure communication , 2002 .

[21]  P. F. Verdes,et al.  Overembedding method for modeling nonstationary systems. , 2006, Physical review letters.

[22]  John G. Proakis,et al.  Probability, random variables and stochastic processes , 1985, IEEE Trans. Acoust. Speech Signal Process..

[23]  M. Darouach,et al.  Full-order observers for linear systems with unknown inputs , 1994, IEEE Trans. Autom. Control..

[24]  G.J. Vachtsevanos,et al.  A particle filtering-based framework for real-time fault diagnosis and failure prognosis in a turbine engine , 2007, 2007 Mediterranean Conference on Control & Automation.

[25]  Herbert Jaeger,et al.  Adaptive Nonlinear System Identification with Echo State Networks , 2002, NIPS.

[26]  Thomas B. Schön,et al.  Marginalized particle filters for mixed linear/nonlinear state-space models , 2005, IEEE Transactions on Signal Processing.

[27]  Athanasios Papoulis,et al.  Predictable processes and Wold's decomposition: A review , 1985, IEEE Trans. Acoust. Speech Signal Process..

[28]  Christophe Andrieu,et al.  Online expectation-maximization type algorithms for parameter estimation in general state space models , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[29]  G. Kitagawa A self-organizing state-space model , 1998 .

[30]  F. Gustafsson,et al.  Complexity analysis of the marginalized particle filter , 2005, IEEE Transactions on Signal Processing.

[31]  G. Kitagawa Monte Carlo Filter and Smoother for Non-Gaussian Nonlinear State Space Models , 1996 .

[32]  R. K. Mehra,et al.  Correspondence item: An innovations approach to fault detection and diagnosis in dynamic systems , 1971 .

[33]  A. Krener,et al.  Nonlinear observers with linearizable error dynamics , 1985 .

[34]  Ulas Gunturkun Recursive Estimation of Driving-Forces from Nonlinear Nonstationary Systems with Unknown Dynamics , 2010 .

[35]  R. Patton,et al.  Optimal filtering for systems with unknown inputs , 1998, IEEE Trans. Autom. Control..

[36]  N. D. Freitas Rao-Blackwellised particle filtering for fault diagnosis , 2002 .

[37]  G. Kitagawa Theory and Methods , 1998 .

[38]  Donghua Zhou,et al.  Chaotic secure communication based on particle filtering , 2006 .

[39]  X. Xia,et al.  Nonlinear observer design by observer error linearization , 1989 .

[40]  P. F. Verdes,et al.  Nonstationary time-series analysis: accurate reconstruction of driving forces. , 2001, Physical review letters.

[41]  Fredrik Gustafsson,et al.  A New Formulation of the Rao-Blackwellized Particle Filter , 2007, 2007 IEEE/SP 14th Workshop on Statistical Signal Processing.

[42]  M. Casdagli Recurrence plots revisited , 1997 .

[43]  Ulaş Güntürkün,et al.  Toward the Development of Radar Scene Analyzer for Cognitive Radar , 2010, IEEE Journal of Oceanic Engineering.

[44]  Geir Storvik,et al.  Particle filters for state-space models with the presence of unknown static parameters , 2002, IEEE Trans. Signal Process..

[45]  Bart De Moor,et al.  Unbiased minimum-variance input and state estimation for linear discrete-time systems , 2007, Autom..

[46]  Pablo M. Granitto,et al.  Artificial Neural Network Learning of Nonstationary Behavior in Time Series , 2003, Int. J. Neural Syst..

[47]  James P. Reilly,et al.  An Information Geometric Approach to ML Estimation With Incomplete Data: Application to Semiblind MIMO Channel Identification , 2007, IEEE Transactions on Signal Processing.

[48]  Harald Haas,et al.  Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication , 2004, Science.

[49]  J. L. Mancilla Aguilar,et al.  Nonlinear observers , 1997 .

[50]  M. Saif,et al.  A novel approach to the design of unknown input observers , 1991 .

[51]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[52]  Yan Liu,et al.  Rao-Blackwellized particle filtering for fault detection and diagnosis , 2010, Proceedings of the 29th Chinese Control Conference.

[53]  James P. Reilly,et al.  An EM Algorithm for Nonlinear State Estimation With Model Uncertainties , 2008, IEEE Transactions on Signal Processing.

[54]  Carlos H. Muravchik,et al.  Posterior Cramer-Rao bounds for discrete-time nonlinear filtering , 1998, IEEE Trans. Signal Process..

[55]  Zhengzhi Han,et al.  A note on observers for Lipschitz nonlinear systems , 2002, IEEE Trans. Autom. Control..