Optimal Sampling for Dynamic Complex Networks With Graph-Bandlimited Initialization

Many engineering, social, and biological complex systems consist of dynamical elements connected via a large-scale network. Monitoring the network’s dynamics is essential for a variety of maintenance and scientific purposes. Whilst we understand how to optimally sample and discretize a single continuous dynamic element or a non-dynamic graph, we do not possess a theory on how to optimally sample networked dynamical elements. Here, we study nonlinear dynamic graph signals on a fixed complex network. We define the necessary conditions for optimal sampling in the combining time- and graph-domain to fully recover the networked dynamics. We firstly interpret the networked dynamics into a linearized matrix. Then, we prove that the dynamic signals can be sampled and fully recovered if the networked dynamics is stable and their initialization and inputs (which are unknown) are bandlimited in the graph spectral domain. This new theory directly maps optimal sampling locations and rates to the graph properties and governing nonlinear dynamics. This can inform the placement of experimental probes and sensors on dynamical networks especially for the case where the employed sensors are difficult to change. Also, this guides the design of each sensor’s optimal sampling rate for further digital signal processing. We motivate the reader with two examples of recovering the networked dynamics for: social population growth and networked protein biochemical interactions with both bandlimited and arbitrary initialization and inputs.

[1]  Eckehard Schöll,et al.  Synchronization patterns: from network motifs to hierarchical networks , 2016, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[2]  Andreas Loukas,et al.  A Time-Vertex Signal Processing Framework: Scalable Processing and Meaningful Representations for Time-Series on Graphs , 2017, IEEE Transactions on Signal Processing.

[3]  Santiago Segarra,et al.  Reconstruction of Graph Signals Through Percolation from Seeding Nodes , 2015, IEEE Transactions on Signal Processing.

[4]  José M. F. Moura,et al.  Discrete Signal Processing on Graphs: Frequency Analysis , 2013, IEEE Transactions on Signal Processing.

[5]  I. Pesenson Sampling in paley-wiener spaces on combinatorial graphs , 2008, 1111.5896.

[6]  Gene Cheung,et al.  A-Optimal Sampling and Robust Reconstruction for Graph Signals via Truncated Neumann Series , 2018, IEEE Signal Processing Letters.

[7]  Shreyas Sundaram,et al.  Sensor selection for Kalman filtering of linear dynamical systems: Complexity, limitations and greedy algorithms , 2017, Autom..

[8]  Christos Ellinas,et al.  Dynamics of organizational culture: Individual beliefs vs. social conformity , 2017, PloS one.

[9]  Geert Leus,et al.  Observing Bandlimited Graph Processes from Subsampled Measurements , 2018, 2018 52nd Asilomar Conference on Signals, Systems, and Computers.

[10]  Guy Woodward,et al.  Drought rewires the cores of food webs , 2016 .

[11]  Sergio Barbarossa,et al.  Signals on Graphs: Uncertainty Principle and Sampling , 2015, IEEE Transactions on Signal Processing.

[12]  Jelena Kovacevic,et al.  Signal Recovery on Graphs: Fundamental Limits of Sampling Strategies , 2015, IEEE Transactions on Signal and Information Processing over Networks.

[13]  Weisi Guo,et al.  Node-Level Resilience Loss in Dynamic Complex Networks , 2018, Scientific Reports.

[14]  Yoshihiko Hasegawa Thermodynamics of collective enhancement of precision , 2018, Physical Review E.

[15]  Antonio Ortega,et al.  Submitted to Ieee Transactions on Signal Processing 1 Efficient Sampling Set Selection for Bandlimited Graph Signals Using Graph Spectral Proxies , 2022 .

[16]  Marc Timme,et al.  Dynamically induced cascading failures in power grids , 2017, Nature Communications.

[17]  Albert-László Barabási,et al.  Universality in network dynamics , 2013, Nature Physics.

[18]  Fan Chung,et al.  Spectral Graph Theory , 1996 .

[19]  Sergio Barbarossa,et al.  Distributed Adaptive Learning of Graph Signals , 2016, IEEE Transactions on Signal Processing.

[20]  Pierre Vandergheynst,et al.  Graph Signal Processing: Overview, Challenges, and Applications , 2017, Proceedings of the IEEE.

[21]  Geert Leus,et al.  Observing and Tracking Bandlimited Graph Processes , 2017, 1712.00404.

[22]  Paul Jeffrey,et al.  Complex network analysis of water distribution systems , 2011, Chaos.

[23]  José M. F. Moura,et al.  Big Data Analysis with Signal Processing on Graphs: Representation and processing of massive data sets with irregular structure , 2014, IEEE Signal Processing Magazine.

[24]  B. Barzel,et al.  Spatiotemporal signal propagation in complex networks , 2019, Nature Physics.

[25]  Anastasios Kyrillidis,et al.  Multi-Way Compressed Sensing for Sparse Low-Rank Tensors , 2012, IEEE Signal Processing Letters.

[26]  Liz Varga,et al.  Resilience or robustness: identifying topological vulnerabilities in rail networks , 2018, Royal Society Open Science.

[27]  A. Barabasi,et al.  Universal resilience patterns in complex networks , 2016, Nature.

[28]  Alan Wilson,et al.  Boltzmann, Lotka and Volterra and spatial structural evolution: an integrated methodology for some dynamical systems , 2008, Journal of The Royal Society Interface.

[29]  Ian J. Wassell,et al.  Joint Sensing Matrix and Sparsifying Dictionary Optimization for Tensor Compressive Sensing , 2017, IEEE Transactions on Signal Processing.

[30]  Yuantao Gu,et al.  Generalized graph signal sampling and reconstruction , 2015, 2015 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[31]  Guido Caldarelli,et al.  Pathways towards instability in financial networks , 2016 .

[32]  Y. Narahari,et al.  Modeling Spread of Preferences in Social Networks for Sampling-Based Preference Aggregation , 2017, IEEE Transactions on Network Science and Engineering.

[33]  Ingo Scholtes,et al.  Causality-driven slow-down and speed-up of diffusion in non-Markovian temporal networks , 2013, Nature Communications.

[34]  Alejandro Ribeiro,et al.  Greedy Sampling of Graph Signals , 2017, IEEE Transactions on Signal Processing.

[35]  Dibo Hou,et al.  Compressed sensing based optimal sensor placement for leak localization in water distribution networks , 2018 .

[36]  A. M. Lyapunov The general problem of the stability of motion , 1992 .

[37]  Antonio Ortega,et al.  Signal compression in wireless sensor networks , 2012, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[38]  Jelena Kovacevic,et al.  Discrete Signal Processing on Graphs: Sampling Theory , 2015, IEEE Transactions on Signal Processing.

[39]  Antonio Ortega,et al.  Towards a sampling theorem for signals on arbitrary graphs , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).