Detecting changes in transient complex systems via dynamic network inference

Abstract Graph analytics methods have evoked significant interest in recent years. Their applicability to real-world complex systems is currently limited by the challenges of inferring effective graph representations of the high-dimensional, noisy, nonlinear and transient dynamics from limited time series outputs, as well as of extracting statistical quantifiers that capture the salient structure of the inferred graphs for detecting change. In this article, we present an approach to detecting changes in complex dynamic systems that is based on spectral-graph-theory and uses a single realization of time series data collected under specific, common types of transient conditions, such as intermittency. We introduce a statistic, γk, based on the spectral content of the inferred graph. We show that the γk statistic under high-dimensional dynamics converges to a normal distribution, and we employ the parameters of this distribution to construct a procedure to detect qualitative changes in the coupling structure of a dynamical system. Experimental investigations suggest that the γk statistic by itself is able to detect changes with modified area under curve (mAUC) of about 0.96 (for numerical simulation tests), and can, by itself, achieve a true positive rate of about 40% for detecting seizures from EEG signals. In addition, by incorporating this statistic with random forest, one of the best seizure detection methods, the seizure detection rate of the random forest method improves by 5% in 35% of the subjects. These studies of the network inferred from EEG signals suggest that γk can capture salient structural changes in the physiology of the process and can therefore serve as an effective feature for detecting seizures from EEG signals.

[1]  A. Barabasi,et al.  Network biology: understanding the cell's functional organization , 2004, Nature Reviews Genetics.

[2]  Tobias Loddenkemper,et al.  Seizure detection, seizure prediction, and closed-loop warning systems in epilepsy , 2014, Epilepsy & Behavior.

[3]  Diogo M. Camacho,et al.  Wisdom of crowds for robust gene network inference , 2012, Nature Methods.

[4]  Satish T. S. Bukkapatnam,et al.  A Dirichlet Process Gaussian State Machine Model for Change Detection in Transient Processes , 2018, Technometrics.

[5]  John Skvoretz,et al.  Node centrality in weighted networks: Generalizing degree and shortest paths , 2010, Soc. Networks.

[6]  Lai Distinct small-distance scaling behavior of on-off intermittency in chaotic dynamical systems. , 1996, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[7]  Kathleen M. Carley,et al.  Social Network Change Detection , 2008 .

[8]  Danai Koutra,et al.  Graph based anomaly detection and description: a survey , 2014, Data Mining and Knowledge Discovery.

[9]  Eduardo D. Sontag,et al.  Inferring dynamic architecture of cellular networks using time series of gene expression, protein and metabolite data , 2004, Bioinform..

[10]  T. Tao,et al.  Random Matrices: the Distribution of the Smallest Singular Values , 2009, 0903.0614.

[11]  Ali Shojaie,et al.  Network granger causality with inherent grouping structure , 2012, J. Mach. Learn. Res..

[12]  M. Fox,et al.  Spontaneous fluctuations in brain activity observed with functional magnetic resonance imaging , 2007, Nature Reviews Neuroscience.

[13]  Ying-Cheng Lai,et al.  Attack vulnerability of scale-free networks due to cascading breakdown. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[14]  Muriel Médard,et al.  Network deconvolution as a general method to distinguish direct dependencies in networks , 2013, Nature Biotechnology.

[15]  A. Aue,et al.  Break detection in the covariance structure of multivariate time series models , 2009, 0911.3796.

[16]  J. Kurths,et al.  Coherence Resonance in a Noise-Driven Excitable System , 1997 .

[17]  Giri P Krishnan,et al.  Dynamics of high-frequency synchronization during seizures. , 2013, Journal of neurophysiology.

[18]  Masashi Sugiyama,et al.  Sequential change‐point detection based on direct density‐ratio estimation , 2012, Stat. Anal. Data Min..

[19]  Gerhard Dangelmayr,et al.  Dynamics and bifurcation of patterns in dissipative systems , 2004 .

[20]  N. Crone,et al.  Network dynamics of the brain and influence of the epileptic seizure onset zone , 2014, Proceedings of the National Academy of Sciences.

[21]  Kaushik Majumdar,et al.  Synchronization Implies Seizure or Seizure Implies Synchronization? , 2013, Brain Topography.

[22]  W. Woodall,et al.  Multivariate CUSUM Quality- Control Procedures , 1985 .

[23]  C. Tracy,et al.  Distribution Functions for Largest Eigenvalues and Their Applications , 2002, math-ph/0210034.

[24]  Orrin Devinsky,et al.  Recognizing and preventing epilepsy-related mortality , 2016, Neurology.

[25]  A. A. Kalgonda,et al.  Multivariate Quality Control Chart for Autocorrelated Processes , 2004 .

[26]  Charles F. Cadieu,et al.  Phase Coupling Estimation from Multivariate Phase Statistics , 2009, Neural Computation.

[27]  Hoang M. Tran,et al.  Inferring sparse networks for noisy transient processes , 2016, Scientific Reports.

[28]  Jing Li,et al.  Modeling and change detection of dynamic network data by a network state space model , 2017 .

[29]  Hisashi Kashima,et al.  Eigenspace-based anomaly detection in computer systems , 2004, KDD.

[30]  Andreas Schulze-Bonhage,et al.  Early Seizure Detection Algorithm Based on Intracranial EEG and Random Forest Classification , 2015, Int. J. Neural Syst..

[31]  Moe Z. Win,et al.  On the marginal distribution of the eigenvalues of wishart matrices , 2009, IEEE Transactions on Communications.

[32]  S. Bukkapatnam,et al.  Nonlinear Dynamics Forecasting of Obstructive Sleep Apnea Onsets , 2016, PloS one.

[33]  Michal Linial,et al.  Using Bayesian Networks to Analyze Expression Data , 2000, J. Comput. Biol..

[34]  Pogromskiy Cooperative oscillatory behavior of mutually coupled dynamical systems , 2005 .

[35]  Frances S. Chance,et al.  Gain Modulation from Background Synaptic Input , 2002, Neuron.

[36]  Satish T. S. Bukkapatnam,et al.  Time series forecasting for nonlinear and non-stationary processes: a review and comparative study , 2015 .

[37]  Anja Vogler,et al.  An Introduction to Multivariate Statistical Analysis , 2004 .

[38]  H. Dette,et al.  Detection of Multiple Structural Breaks in Multivariate Time Series , 2013, 1309.1309.

[39]  E.J. Candes,et al.  An Introduction To Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[40]  Curtis B. Storlie,et al.  Scan Statistics for the Online Detection of Locally Anomalous Subgraphs , 2013, Technometrics.

[41]  Olaf Sporns,et al.  Network structure of cerebral cortex shapes functional connectivity on multiple time scales , 2007, Proceedings of the National Academy of Sciences.

[42]  George C. Runger,et al.  Designing a Multivariate EWMA Control Chart , 1997 .

[43]  Jeff H. Duyn,et al.  Sleep and the functional connectome , 2013, NeuroImage.

[44]  Á. Pascual-Leone,et al.  Exploration and modulation of brain network interactions with noninvasive brain stimulation in combination with neuroimaging , 2012, The European journal of neuroscience.

[45]  A. Barabasi,et al.  Network link prediction by global silencing of indirect correlations , 2013, Nature Biotechnology.

[46]  Carey E. Priebe,et al.  Anomaly Detection in Time Series of Graphs using Fusion of Graph Invariants , 2012, IEEE Journal of Selected Topics in Signal Processing.

[47]  Rob Sturman,et al.  Internal Dynamics of Intermittency , 2004 .

[48]  Ali H. Shoeb,et al.  Application of Machine Learning To Epileptic Seizure Detection , 2010, ICML.

[49]  Jukka-Pekka Onnela,et al.  Change Point Detection in Correlation Networks , 2014, Scientific Reports.

[50]  Aneta Stefanovska,et al.  Coupling functions in networks of oscillators , 2015 .

[51]  Hermann Hinrichs,et al.  Brain functional connectivity network breakdown and restoration in blindness , 2014, Neurology.

[52]  B. Bakshi Multiscale PCA with application to multivariate statistical process monitoring , 1998 .