Spectral Projector-Based Graph Fourier Transforms

This paper considers the definition of the graph Fourier transform (GFT) and of the spectral decomposition of graph signals. Current literature does not address the lack of unicity of the GFT. The GFT is the mapping from the signal set into its representation by a direct sum of irreducible shift invariant subspaces: 1) this decomposition may not be unique; and 2) there is freedom in the choice of basis for each component subspace. These issues are particularly relevant when the graph shift has repeated eigenvalues as is the case in many real-world applications; by ignoring them, there is no way of knowing if different researchers are using the same definition of the GFT and whether their results are comparable or not. The paper presents how to resolve the above degrees of freedom. We develop a quasi-coordinate free definition of the GFT and graph spectral decomposition of graph signals that we implement through oblique spectral projectors. We present properties of the GFT and of the spectral projectors and discuss a generalized Parseval's inequality. An illustrative example for a large real-world urban traffic dataset is provided.

[1]  José M. F. Moura,et al.  Signal Processing on Graphs: Causal Modeling of Unstructured Data , 2015, IEEE Transactions on Signal Processing.

[2]  Deborah Estrin,et al.  Multiresolution storage and search in sensor networks , 2005, TOS.

[3]  José M. F. Moura,et al.  Big Data Analysis with Signal Processing on Graphs: Representation and processing of massive data sets with irregular structure , 2014, IEEE Signal Processing Magazine.

[4]  Sunil K. Narang,et al.  Compact Support Biorthogonal Wavelet Filterbanks for Arbitrary Undirected Graphs , 2012, IEEE Transactions on Signal Processing.

[5]  Louis L. Scharf,et al.  Signal processing applications of oblique projection operators , 1994, IEEE Trans. Signal Process..

[6]  José M. F. Moura,et al.  Matrices with banded inverses: Inversion algorithms and factorization of Gauss-Markov processes , 2000, IEEE Trans. Inf. Theory.

[7]  A. W. M. van den Enden,et al.  Discrete Time Signal Processing , 1989 .

[8]  Po-Ling Loh,et al.  Structure estimation for discrete graphical models: Generalized covariance matrices and their inverses , 2012, NIPS.

[9]  Jie Lin,et al.  Coordination of groups of mobile autonomous agents using nearest neighbor rules , 2003, IEEE Trans. Autom. Control..

[10]  José M. F. Moura,et al.  Signal Recovery on Graphs: Variation Minimization , 2014, IEEE Transactions on Signal Processing.

[11]  M. Degroot Reaching a Consensus , 1974 .

[12]  Dennis M. Healy,et al.  Fast Discrete Polynomial Transforms with Applications to Data Analysis for Distance Transitive Graphs , 1997, SIAM J. Comput..

[13]  Paulo Gonçalves,et al.  Translation on Graphs: An Isometric Shift Operator , 2015, IEEE Signal Processing Letters.

[14]  H. Hotelling Relations Between Two Sets of Variates , 1936 .

[15]  Kevin Curran,et al.  OpenStreetMap , 2012, Int. J. Interact. Commun. Syst. Technol..

[16]  Stephen P. Boyd,et al.  Fast linear iterations for distributed averaging , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[17]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[18]  Sunil K. Narang,et al.  Perfect Reconstruction Two-Channel Wavelet Filter Banks for Graph Structured Data , 2011, IEEE Transactions on Signal Processing.

[19]  Fan Chung Graham,et al.  Diameter of random spanning trees in a given graph , 2012, J. Graph Theory.

[20]  José M. F. Moura,et al.  Discrete Signal Processing on Graphs: Frequency Analysis , 2013, IEEE Transactions on Signal Processing.

[21]  Michael I. Jordan,et al.  Graphical Models, Exponential Families, and Variational Inference , 2008, Found. Trends Mach. Learn..

[22]  Vivek K Goyal,et al.  Foundations of Signal Processing , 2014 .

[23]  Michael G. Rabbat,et al.  Approximating signals supported on graphs , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[24]  José M. F. Moura,et al.  The Algebraic Approach to the Discrete Cosine and Sine Transforms and Their Fast Algorithms , 2003, SIAM J. Comput..

[25]  José M. F. Moura,et al.  Taxi data in New York city: A network perspective , 2015, 2015 49th Asilomar Conference on Signals, Systems and Computers.

[26]  José M. F. Moura,et al.  Graph Equivalence Classes for Spectral Projector-Based Graph Fourier Transforms , 2017, ArXiv.

[27]  F. R. Gantmakher The Theory of Matrices , 1984 .

[28]  Thomas Kailath,et al.  Displacement-structure approach to polynomial Vandermonde and related matrices , 1997 .

[29]  Kannan Ramchandran,et al.  Multiresolution graph signal processing via circulant structures , 2013, 2013 IEEE Digital Signal Processing and Signal Processing Education Meeting (DSP/SPE).

[30]  P. P. Vaidyanathan,et al.  Extending Classical Multirate Signal Processing Theory to Graphs—Part I: Fundamentals , 2017, IEEE Transactions on Signal Processing.

[31]  Toshihisa Tanaka,et al.  Efficient sensor position selection using graph signal sampling theory , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[32]  P. Lancaster,et al.  Invariant subspaces of matrices with applications , 1986 .

[33]  José M. F. Moura,et al.  Agile Inexact Methods for Spectral Projector-Based Graph Fourier Transforms , 2017, ArXiv.

[34]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[35]  Yue M. Lu,et al.  A Spectral Graph Uncertainty Principle , 2012, IEEE Transactions on Information Theory.

[36]  Markus Püschel,et al.  Algebraic Signal Processing Theory: Foundation and 1-D Time , 2008, IEEE Transactions on Signal Processing.

[37]  John N. Tsitsiklis,et al.  Problems in decentralized decision making and computation , 1984 .

[38]  M. C. Jordan Traite des substitutions et des equations algebriques , 1870 .

[39]  José M. F. Moura,et al.  Algebraic Signal Processing Theory: 1-D Space , 2008, IEEE Transactions on Signal Processing.

[40]  J. A. Fax,et al.  Graph Laplacians and Stabilization of Vehicle Formations , 2002 .

[41]  Xiao-Ping Zhang,et al.  On the Shift Operator, Graph Frequency, and Optimal Filtering in Graph Signal Processing , 2015, IEEE Transactions on Signal Processing.

[42]  Geert Leus,et al.  Autoregressive Moving Average Graph Filtering , 2016, IEEE Transactions on Signal Processing.

[43]  Santiago Segarra,et al.  Stationary graph processes: Nonparametric spectral estimation , 2016, 2016 IEEE Sensor Array and Multichannel Signal Processing Workshop (SAM).

[44]  H. Hotelling Analysis of a complex of statistical variables into principal components. , 1933 .

[45]  Franz Franchetti,et al.  Big data computation of taxi movement in New York City , 2016, 2016 IEEE International Conference on Big Data (Big Data).

[46]  José M. F. Moura,et al.  Discrete Signal Processing on Graphs , 2012, IEEE Transactions on Signal Processing.

[47]  Vincent Y. F. Tan,et al.  Learning Graphical Models for Hypothesis Testing and Classification , 2010, IEEE Transactions on Signal Processing.

[48]  L. Williams,et al.  Contents , 2020, Ophthalmology (Rochester, Minn.).

[49]  Mikhail Belkin,et al.  Towards a Theoretical Foundation for Laplacian-Based Manifold Methods , 2005, COLT.

[50]  R. Coifman,et al.  Diffusion Wavelets , 2004 .

[51]  Markus Püschel,et al.  Algebraic Signal Processing Theory: Cooley–Tukey Type Algorithms for Real DFTs , 2008, IEEE Transactions on Signal Processing.

[52]  D. Donoho,et al.  Hessian eigenmaps: Locally linear embedding techniques for high-dimensional data , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[53]  P. P. Vaidyanathan,et al.  Extending Classical Multirate Signal Processing Theory to Graphs—Part II: M-Channel Filter Banks , 2017, IEEE Transactions on Signal Processing.

[54]  Pascal Frossard,et al.  The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains , 2012, IEEE Signal Processing Magazine.

[55]  Nikhil Balram,et al.  Recursive structure of noncausal Gauss-Markov random fields , 1992, IEEE Trans. Inf. Theory.

[56]  Fan Chung Graham,et al.  Extreme values of the stationary distribution of random walks on directed graphs , 2016, Adv. Appl. Math..

[57]  Gabriele Steidl,et al.  Fast algorithms for discrete polynomial transforms , 1998, Math. Comput..

[58]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[59]  S. Mallat A wavelet tour of signal processing , 1998 .

[60]  R.G. Baraniuk,et al.  An architecture for distributed wavelet analysis and processing in sensor networks , 2006, 2006 5th International Conference on Information Processing in Sensor Networks.

[61]  Mikhail Belkin,et al.  Towards a theoretical foundation for Laplacian-based manifold methods , 2005, J. Comput. Syst. Sci..

[62]  Pascal Frossard,et al.  Learning Parametric Dictionaries for Signals on Graphs , 2014, IEEE Transactions on Signal Processing.

[63]  Karl Pearson F.R.S. LIII. On lines and planes of closest fit to systems of points in space , 1901 .

[64]  F. Chung Laplacians and the Cheeger Inequality for Directed Graphs , 2005 .

[65]  Hyeokho Choi,et al.  Distributed wavelet transform for irregular sensor network grids , 2005, IEEE/SP 13th Workshop on Statistical Signal Processing, 2005.

[66]  José M. F. Moura,et al.  Algebraic Signal Processing Theory: Cooley–Tukey Type Algorithms for DCTs and DSTs , 2007, IEEE Transactions on Signal Processing.

[67]  Gene H. Golub,et al.  Matrix computations , 1983 .

[68]  Peter Lancaster,et al.  The theory of matrices , 1969 .

[69]  T. Hughes,et al.  Signals and systems , 2006, Genome Biology.

[70]  Santiago Segarra,et al.  Sampling of Graph Signals With Successive Local Aggregations , 2015, IEEE Transactions on Signal Processing.

[71]  Pierre Vandergheynst,et al.  Wavelets on Graphs via Spectral Graph Theory , 2009, ArXiv.

[72]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[73]  Santiago Segarra,et al.  Blind Identification of Graph Filters , 2016, IEEE Transactions on Signal Processing.

[74]  Jelena Kovacevic,et al.  Discrete Signal Processing on Graphs: Sampling Theory , 2015, IEEE Transactions on Signal Processing.

[75]  R. Murray,et al.  Consensus protocols for networks of dynamic agents , 2003, Proceedings of the 2003 American Control Conference, 2003..

[76]  Hadley Wickham,et al.  ggmap: Spatial Visualization with ggplot2 , 2013, R J..

[77]  Benjamin Girault Stationary graph signals using an isometric graph translation , 2015, 2015 23rd European Signal Processing Conference (EUSIPCO).

[78]  Lada A. Adamic,et al.  The political blogosphere and the 2004 U.S. election: divided they blog , 2005, LinkKDD '05.

[79]  J. Moura,et al.  Topology for Global Average Consensus , 2006, 2006 Fortieth Asilomar Conference on Signals, Systems and Computers.