Efficient state and parameter estimation for high-dimensional nonlinear system identification with application to MEG brain network modeling

System identification poses a significant bottleneck to characterizing and controlling complex systems. This challenge is greatest when both the system states and parameters are not directly accessible leading to a dual-estimation problem. Current approaches to such problems are limited in their ability to scale with many-parameter systems as often occurs in networks. In the current work, we present a new, computationally efficient approach to treat large dual-estimation problems. Our approach consists of directly integrating pseudooptimal state estimation (the Extended Kalman Filter) into a dual-optimization objective, leaving a differentiable cost/error function of only in terms of the unknown system parameters which we solve using numerical gradient/Hessian methods. Intuitively, our approach consists of solving for the parameters that generate the most accurate state estimator (Extended Kalman Filter). We demonstrate that our approach is at least as accurate in state and parameter estimation as joint Kalman Filters (Extended/Unscented), despite lower complexity. We demonstrate the utility of our approach by inverting anatomically-detailed individualized brain models from human magnetoencephalography (MEG) data.

[1]  Rudolph van der Merwe,et al.  The square-root unscented Kalman filter for state and parameter-estimation , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[2]  Sharad Singhal,et al.  Training Multilayer Perceptrons with the Extende Kalman Algorithm , 1988, NIPS.

[3]  M. Xiong,et al.  Extended Kalman Filter for Estimation of Parameters in Nonlinear State-Space Models of Biochemical Networks , 2008, PloS one.

[4]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[5]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[6]  Timothy Dozat,et al.  Incorporating Nesterov Momentum into Adam , 2016 .

[7]  Leo K. Cheng,et al.  The inverse problem of electrocardiography , 2011 .

[8]  Essa Yacoub,et al.  The WU-Minn Human Connectome Project: An overview , 2013, NeuroImage.

[9]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[10]  Michael J. Cole,et al.  Estimation and validation of individualized dynamic brain models with resting state fMRI , 2019, NeuroImage.

[11]  Soosan Beheshti,et al.  A systematic review of EEG source localization techniques and their applications on diagnosis of brain abnormalities , 2019, Journal of Neuroscience Methods.

[12]  Matthew F. Singh,et al.  Scalable surrogate deconvolution for identification of partially-observable systems and brain modeling , 2020, bioRxiv.

[13]  G. Nolte The magnetic lead field theorem in the quasi-static approximation and its use for magnetoencephalography forward calculation in realistic volume conductors. , 2003, Physics in medicine and biology.

[14]  Kevan A. C. Martin,et al.  A Canonical Microcircuit for Neocortex , 1989, Neural Computation.

[15]  Danna Zhou,et al.  d. , 1840, Microbial pathogenesis.

[16]  Evan M. Gordon,et al.  Local-Global Parcellation of the Human Cerebral Cortex From Intrinsic Functional Connectivity MRI , 2017, bioRxiv.

[17]  Mark W. Woolrich,et al.  Adding dynamics to the Human Connectome Project with MEG , 2013, NeuroImage.

[18]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[19]  Jeffrey K. Uhlmann,et al.  New extension of the Kalman filter to nonlinear systems , 1997, Defense, Security, and Sensing.

[20]  Richard D. Braatz,et al.  On the "Identification and control of dynamical systems using neural networks" , 1997, IEEE Trans. Neural Networks.

[21]  Jean-Philippe Noël,et al.  Three Benchmarks Addressing Open Challenges in Nonlinear System Identification , 2017 .