Modelling Graph Errors: Towards Robust Graph Signal Processing

The first step for any graph signal processing (GSP) procedure is to learn the graph signal representation, i.e., to capture the dependence structure of the data into an adjacency matrix. Indeed, the adjacency matrix is typically not known a priori and has to be learned. However, it is learned with errors. A little, if any, attention has been paid to modeling such errors in the adjacency matrix, and studying their effects on GSP methods. However, modeling errors in adjacency matrix will enable both to study the graph error effects in GSP and to develop robust GSP algorithms. In this paper, we therefore introduce practically justifiable graph error models. We also study, both analytically and in terms of simulations, the graph error effect on the performance of GSP methods based on the examples of more traditional different types of filtering of graph signals and less known independent component analysis (ICA) of graph signals (graph decorrelation).

[1]  Douglas B. Clarkson Remark AS R71: A Remark on Algorithm AS 211. The F-G Diagonalization Algorithm , 1988 .

[2]  Santiago Segarra,et al.  Sampling of Graph Signals With Successive Local Aggregations , 2015, IEEE Transactions on Signal Processing.

[3]  Soummya Kar,et al.  Finite-time distributed consensus through graph filters , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[4]  Geert Leus,et al.  Autoregressive Moving Average Graph Filtering , 2016, IEEE Transactions on Signal Processing.

[5]  Sergio Barbarossa,et al.  Robust Graph Signal Processing in the Presence of Uncertainties on Graph Topology , 2018, 2018 IEEE 19th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC).

[6]  Pascal Frossard,et al.  Learning Laplacian Matrix in Smooth Graph Signal Representations , 2014, IEEE Transactions on Signal Processing.

[7]  Geert Leus,et al.  Filtering Random Graph Processes Over Random Time-Varying Graphs , 2017, IEEE Transactions on Signal Processing.

[8]  Klaus Nordhausen,et al.  Separation of Uncorrelated Stationary time series using Autocovariance Matrices , 2014, Journal of Time Series Analysis.

[9]  Pascal Frossard,et al.  Graph Signal Processing , 2018 .

[10]  Klaus Nordhausen,et al.  A New Performance Index for ICA: Properties, Computation and Asymptotic Analysis , 2010, LVA/ICA.

[11]  Fernando Gama,et al.  Stability Properties of Graph Neural Networks , 2019, IEEE Transactions on Signal Processing.

[12]  Zhi-Quan Luo,et al.  Robust adaptive beamforming using worst-case performance optimization: a solution to the signal mismatch problem , 2003, IEEE Trans. Signal Process..

[13]  Ali H. Sayed,et al.  Mobile Adaptive Networks , 2011, IEEE Journal of Selected Topics in Signal Processing.

[14]  B. Bollobás,et al.  The phase transition in inhomogeneous random graphs , 2007 .

[15]  Santiago Segarra,et al.  Centrality Measures for Graphons: Accounting for Uncertainty in Networks , 2017, IEEE Transactions on Network Science and Engineering.

[16]  Santiago Segarra,et al.  Network Topology Inference from Spectral Templates , 2016, IEEE Transactions on Signal and Information Processing over Networks.

[17]  Sergiy A. Vorobyov,et al.  Graph Error Effect in Graph Signal Processing , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[18]  László Lovász,et al.  Limits of dense graph sequences , 2004, J. Comb. Theory B.

[19]  Santiago Segarra,et al.  Reconstruction of Graph Signals Through Percolation from Seeding Nodes , 2015, IEEE Transactions on Signal Processing.

[20]  José M. F. Moura,et al.  Discrete Signal Processing on Graphs: Frequency Analysis , 2013, IEEE Transactions on Signal Processing.

[21]  László Lovász,et al.  Large Networks and Graph Limits , 2012, Colloquium Publications.

[22]  Santiago Segarra,et al.  Stationary Graph Processes and Spectral Estimation , 2016, IEEE Transactions on Signal Processing.

[23]  Alfred O. Hero,et al.  Learning sparse graphs under smoothness prior , 2016, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[24]  Laura Cottatellucci,et al.  Spectral properties of random matrices for stochastic block model , 2015, 2015 13th International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks (WiOpt).

[25]  Michael G. Rabbat,et al.  Characterization and Inference of Graph Diffusion Processes From Observations of Stationary Signals , 2016, IEEE Transactions on Signal and Information Processing over Networks.

[26]  Sergio Barbarossa,et al.  Graph Signal Processing in the Presence of Topology Uncertainties , 2020, IEEE Transactions on Signal Processing.

[27]  Tengyuan Liang,et al.  On Detection and Structural Reconstruction of Small-World Random Networks , 2016, IEEE Transactions on Network Science and Engineering.

[28]  José M. F. Moura,et al.  Optimal Filter Design for Signal Processing on Random Graphs: Accelerated Consensus , 2018, IEEE Transactions on Signal Processing.

[29]  Paul Erdös,et al.  On random graphs, I , 1959 .

[30]  Amit Singer,et al.  Decoding Binary Node Labels from Censored Edge Measurements: Phase Transition and Efficient Recovery , 2014, IEEE Transactions on Network Science and Engineering.

[31]  Fabian J. Theis,et al.  Second-Order Source Separation Based on Prior Knowledge Realized in a Graph Model , 2010, LVA/ICA.

[32]  José M. F. Moura,et al.  Discrete Signal Processing on Graphs , 2012, IEEE Transactions on Signal Processing.

[33]  Santiago Segarra,et al.  Stability and continuity of centrality measures in weighted graphs , 2014, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[34]  Jari Miettinen,et al.  Graph Signal Processing Meets Blind Source Separation , 2020, IEEE Transactions on Signal Processing.

[35]  Santiago Segarra,et al.  Optimal Graph-Filter Design and Applications to Distributed Linear Network Operators , 2017, IEEE Transactions on Signal Processing.

[36]  Geert Leus,et al.  Signal processing on kernel-based random graphs , 2017, 2017 25th European Signal Processing Conference (EUSIPCO).

[37]  Alejandro Ribeiro,et al.  Graph Frequency Analysis of Brain Signals , 2015, IEEE Journal of Selected Topics in Signal Processing.

[38]  Kathryn B. Laskey,et al.  Stochastic blockmodels: First steps , 1983 .

[39]  Sundeep Prabhakar Chepuri,et al.  Graph Sampling for Covariance Estimation , 2017, IEEE Transactions on Signal and Information Processing over Networks.

[40]  J. Shanks RECURSION FILTERS FOR DIGITAL PROCESSING , 1967 .

[41]  Eric Moulines,et al.  A blind source separation technique using second-order statistics , 1997, IEEE Trans. Signal Process..

[42]  Asuman E. Ozdaglar,et al.  Opinion Fluctuations and Disagreement in Social Networks , 2010, Math. Oper. Res..

[43]  Georgios B. Giannakis,et al.  Network topology inference via elastic net structural equation models , 2017, 2017 25th European Signal Processing Conference (EUSIPCO).

[44]  Sergio Barbarossa,et al.  Small Perturbation Analysis of Network Topologies , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[45]  Pascal Frossard,et al.  The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains , 2012, IEEE Signal Processing Magazine.

[46]  Sergio Barbarossa,et al.  Graph-Based Learning Under Perturbations via Total Least-Squares , 2020, IEEE Transactions on Signal Processing.

[47]  Jelena Kovacevic,et al.  Discrete Signal Processing on Graphs: Sampling Theory , 2015, IEEE Transactions on Signal Processing.

[48]  Albert-László Barabási,et al.  Statistical mechanics of complex networks , 2001, ArXiv.

[49]  Gitta Kutyniok,et al.  On the Transferability of Spectral Graph Filters , 2019, 2019 13th International conference on Sampling Theory and Applications (SampTA).

[50]  Usman A. Khan,et al.  Revisiting Finite-Time Distributed Algorithms via Successive Nulling of Eigenvalues , 2015, IEEE Signal Processing Letters.

[51]  James Hardy Wilkinson,et al.  Rounding errors in algebraic processes , 1964, IFIP Congress.

[52]  Pierre Vandergheynst,et al.  Graph Signal Processing: Overview, Challenges, and Applications , 2017, Proceedings of the IEEE.