Graph-Adaptive Semi-Supervised Tracking of Dynamic Processes Over Switching Network Modes

A plethora of network-science related applications call for inference of spatio-temporal graph processes. Such an inference task can be aided by the underlying graph topology that might jump over discrete modes. For example, the connectivity in dynamic brain networks, switches among candidate topologies, each corresponding to a different emotional state, also known as the network mode. Taking advantage of limited nodal observations, the present contribution deals with semi-supervised tracking of dynamic processes over a given candidate set of graphs with unknown switches. Towards this end, a dynamical model is introduced to capture the per-slot spatial correlation using the active topology, as well as the temporal variation across slots through a state-space model. A scalable graph-adaptive Bayesian approach is developed, based on what is termed interacting multi-graph model (IMGM), to track the dynamic nodal processes and the active graph topology on-the-fly. Besides switching topologies, the proposed IMGM algorithm can accommodate various generalizations, including multiple dynamic functions, multiple kernels, and adaptive observation noise covariances. IMGM learns the dynamical model that best fits the data from a pool of available models. Thus, the resultant adaptive algorithm does not require offline model training. Numerical tests with synthetic and real datasets demonstrate the superior tracking performance of the novel approach compared to the mode-clairvoyant existing alternatives.

[1]  Zhi-Li Zhang,et al.  Commute Times for a Directed Graph using an Asymmetric Laplacian , 2011 .

[2]  Georgios B. Giannakis,et al.  Kernel-Based Reconstruction of Space-Time Functions on Dynamic Graphs , 2016, IEEE Journal of Selected Topics in Signal Processing.

[3]  Pavel Yu. Chebotarev,et al.  The Matrix of Maximum Out Forests of a Digraph and Its Applications , 2006, ArXiv.

[4]  Sergio Barbarossa,et al.  Adaptive Least Mean Squares Estimation of Graph Signals , 2016, IEEE Transactions on Signal and Information Processing over Networks.

[5]  Y. Bar-Shalom,et al.  A recursive multiple model approach to noise identification , 1994 .

[6]  Risi Kondor,et al.  Diffusion kernels on graphs and other discrete structures , 2002, ICML 2002.

[7]  Yaakov Bar-Shalom,et al.  Design of an interacting multiple model algorithm for air traffic control tracking , 1993, IEEE Trans. Control. Syst. Technol..

[8]  Eric A. Wan,et al.  Dual Kalman Filtering Methods for Nonlinear Prediction, Smoothing and Estimation , 1996, NIPS.

[9]  Georgios B. Giannakis,et al.  Sketched Subspace Clustering , 2017, IEEE Transactions on Signal Processing.

[10]  Amir Averbuch,et al.  Interacting Multiple Model Methods in Target Tracking: A Survey , 1988 .

[11]  F. Chung Laplacians and the Cheeger Inequality for Directed Graphs , 2005 .

[12]  Alexander J. Smola,et al.  Kernels and Regularization on Graphs , 2003, COLT.

[13]  Pierre Vandergheynst,et al.  Stationary Signal Processing on Graphs , 2016, IEEE Transactions on Signal Processing.

[14]  Yonggang Zhang,et al.  A Novel Adaptive Kalman Filter With Inaccurate Process and Measurement Noise Covariance Matrices , 2018, IEEE Transactions on Automatic Control.

[15]  Georgios B. Giannakis,et al.  Tracking Switched Dynamic Network Topologies From Information Cascades , 2016, IEEE Transactions on Signal Processing.

[16]  Stergios I. Roumeliotis,et al.  Consensus in Ad Hoc WSNs With Noisy Links—Part II: Distributed Estimation and Smoothing of Random Signals , 2008, IEEE Transactions on Signal Processing.

[17]  Georgios B. Giannakis,et al.  Learning Graph Processes with Multiple Dynamical Models , 2019, 2019 53rd Asilomar Conference on Signals, Systems, and Computers.

[18]  Y. Bar-Shalom,et al.  The interacting multiple model algorithm for systems with Markovian switching coefficients , 1988 .

[19]  Pascal Frossard,et al.  The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains , 2012, IEEE Signal Processing Magazine.

[20]  Georgios B. Giannakis,et al.  Topology Identification and Learning over Graphs: Accounting for Nonlinearities and Dynamics , 2018, Proceedings of the IEEE.

[21]  Georgios B. Giannakis,et al.  Kernel-Based Reconstruction of Graph Signals , 2016, IEEE Transactions on Signal Processing.

[22]  Robin J. Evans,et al.  Hybrid Dynamical Systems: Controller and Sensor Switching Problems , 2012 .

[23]  Georgios B. Giannakis,et al.  Prediction of Partially Observed Dynamical Processes Over Networks via Dictionary Learning , 2014, IEEE Transactions on Signal Processing.

[24]  Yuantao Gu,et al.  A Distributed Tracking Algorithm for Reconstruction of Graph Signals , 2015, IEEE Journal of Selected Topics in Signal Processing.

[25]  Georgios B. Giannakis,et al.  Semi-Supervised Tracking of Dynamic Processes Over Switching Graphs , 2019, 2019 IEEE Data Science Workshop (DSW).

[26]  Pavel Yu. Chebotarev,et al.  Spanning Forests of a Digraph and Their Applications , 2001, ArXiv.

[27]  Georgios B. Giannakis,et al.  Inference of Spatio-Temporal Functions Over Graphs via Multikernel Kriged Kalman Filtering , 2017, IEEE Transactions on Signal Processing.

[28]  Santiago Segarra,et al.  Reconstruction of Graph Signals Through Percolation from Seeding Nodes , 2015, IEEE Transactions on Signal Processing.

[29]  Kevin P. Murphy,et al.  Machine learning - a probabilistic perspective , 2012, Adaptive computation and machine learning series.

[30]  Vince D. Calhoun,et al.  Application of Graph Theory to Assess Static and Dynamic Brain Connectivity: Approaches for Building Brain Graphs , 2018, Proceedings of the IEEE.

[31]  Thia Kirubarajan,et al.  Estimation with Applications to Tracking and Navigation: Theory, Algorithms and Software , 2001 .

[32]  Rudolph van der Merwe,et al.  The unscented Kalman filter for nonlinear estimation , 2000, Proceedings of the IEEE 2000 Adaptive Systems for Signal Processing, Communications, and Control Symposium (Cat. No.00EX373).

[33]  M. Kramer,et al.  Emergent network topology at seizure onset in humans , 2008, Epilepsy Research.

[34]  Eric D. Kolaczyk,et al.  Statistical Analysis of Network Data: Methods and Models , 2009 .