Identification of noisy dynamical systems with parameter estimation based on Hopfield neural networks

An algorithm for estimating time-varying parameters of dynamical systems is proposed, within the large family of prediction error methods. The algorithm is based on the ability of Hopfield neural networks to solve optimisation problems, since its formulation can be summarized as minimisation of the prediction error by means of a continuous Hopfield network. In previous work, it was proved, under mild assumptions, that the estimates converge towards the actual values of parameters and the estimation error remains asymptotically bounded in the presence of measurement noise. The novelty of this work is the advance in the robustness analysis, by considering deterministic disturbances, which do not fulfil the usual statistical hypothesis such as normality and uncorrelatedness. A model of HIV epidemics in Cuba is used as suitable benchmark, which is confirmed by the computation of the sensitivity matrix. The results show a promising performance, in comparison to the conventional Least Squares Estimator. Indeed, the estimation error is almost always lower in the proposed method that in least squares, and it is never significantly higher. Further, from a qualitative point of view, the estimate provided by the Hopfield estimator is smoother, with no overshoot that could eventually destabilize a closed control loop. A significant finding is the fact that the form of the perturbation affects critically the dynamical behaviour and magnitude of the estimation, since the estimation error asymptotically vanishes when the disturbances are additive, but not when they are multiplicative. To summarize, we can conclude that the proposed estimator is an efficient and robust method to estimate time-varying parameters of dynamical systems.

[1]  Philipp Kügler,et al.  Online parameter identification in time-dependent differential equations as a non-linear inverse problem , 2008, European Journal of Applied Mathematics.

[2]  Rolf Isermann,et al.  Identification of Dynamic Systems , 2011 .

[3]  Gonzalo Joya,et al.  Parametric identification of robotic systems with stable time-varying Hopfield networks , 2004 .

[4]  Francisco Sandoval Hernández,et al.  Hopfield Neural Networks for Parametric Identification of Dynamical Systems , 2004, Neural Processing Letters.

[5]  Weiping Li,et al.  Applied Nonlinear Control , 1991 .

[6]  Rachid Lounes,et al.  What percentage of the Cuban HIV-AIDS epidemic is known? , 2003, Revista cubana de medicina tropical.

[7]  Gonzalo Joya,et al.  Hopfield neural networks for optimization: study of the different dynamics , 2002 .

[8]  E. Hairer,et al.  Solving Ordinary Differential Equations II: Stiff and Differential-Algebraic Problems , 2010 .

[9]  H. Engl,et al.  Regularization of Inverse Problems , 1996 .

[10]  Gonzalo Joya,et al.  Dynamical analysis of continuous higher-order hopfield networks for combinatorial optimization. , 2005, Neural computation.

[11]  Karl Johan Åström,et al.  BOOK REVIEW SYSTEM IDENTIFICATION , 1994, Econometric Theory.

[12]  Ricardo Riaza,et al.  Differential-Algebraic Systems: Analytical Aspects and Circuit Applications , 2008 .

[13]  Francisco Sandoval Hernández,et al.  Estimation of the Rate of Detection of Infected Individuals in an Epidemiological Model , 2007, IWANN.

[14]  Petros A. Ioannou,et al.  Robust Adaptive Control , 2012 .

[15]  Teresa Mendonça,et al.  Hopfield neural networks for on-line parameter estimation , 2009, Neural Networks.

[16]  Klaus Schittkowski,et al.  Numerical Data Fitting in Dynamical Systems , 2002 .

[17]  Jinde Cao,et al.  Parameter identification of dynamical systems from time series. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[18]  P. Olver Nonlinear Systems , 2013 .

[19]  John W. Eaton,et al.  Gnu Octave Manual , 2002 .

[20]  John J. Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities , 1999 .

[21]  L. Ljung Prediction error estimation methods , 2002 .

[22]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[23]  Robert J. Gelinas,et al.  Sensitivity analysis of ordinary differential equation systems—A direct method , 1976 .

[24]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[25]  J. J. Hopfield,et al.  “Neural” computation of decisions in optimization problems , 1985, Biological Cybernetics.

[26]  Gonzalo Joya,et al.  Modelling the HIV-AIDS Cuban Epidemics with Hopfield Neural Networks , 2009 .

[27]  Mounir Ghogho,et al.  Maximum likelihood estimation of amplitude-modulated time series , 1999, Signal Process..