Discrete Signal Processing on Graphs: Frequency Analysis

Signals and datasets that arise in physical and engineering applications, as well as social, genetics, biomolecular, and many other domains, are becoming increasingly larger and more complex. In contrast to traditional time and image signals, data in these domains are supported by arbitrary graphs. Signal processing on graphs extends concepts and techniques from traditional signal processing to data indexed by generic graphs. This paper studies the concepts of low and high frequencies on graphs, and low-, high- and band-pass graph signals and graph filters. In traditional signal processing, these concepts are easily defined because of a natural frequency ordering that has a physical interpretation. For signals residing on graphs, in general, there is no obvious frequency ordering. We propose a definition of total variation for graph signals that naturally leads to a frequency ordering on graphs and defines low-, high-, and band-pass graph signals and filters. We study the design of graph filters with specified frequency response, and illustrate our approach with applications to sensor malfunction detection and data classification.

[1]  Kannan Ramchandran,et al.  Circulant structures and graph signal processing , 2013, 2013 IEEE International Conference on Image Processing.

[2]  Pascal Frossard,et al.  The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains , 2012, IEEE Signal Processing Magazine.

[3]  Yue M. Lu,et al.  A Spectral Graph Uncertainty Principle , 2012, IEEE Transactions on Information Theory.

[4]  Markus Püschel,et al.  Algebraic Signal Processing Theory: Foundation and 1-D Time , 2008, IEEE Transactions on Signal Processing.

[5]  Sunil K. Narang,et al.  Perfect Reconstruction Two-Channel Wavelet Filter Banks for Graph Structured Data , 2011, IEEE Transactions on Signal Processing.

[6]  Mikhail Belkin,et al.  Regularization and Semi-supervised Learning on Large Graphs , 2004, COLT.

[7]  M. Puschel,et al.  Fourier transform for the directed quincunx lattice , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[8]  José M. F. Moura,et al.  Algebraic Signal Processing Theory: 1-D Space , 2008, IEEE Transactions on Signal Processing.

[9]  Fei Wang,et al.  Label Propagation through Linear Neighborhoods , 2006, IEEE Transactions on Knowledge and Data Engineering.

[10]  T. J. Rivlin.  An Introduction to the Approximation of Functions , 2003 .

[11]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[12]  John G. Proakis,et al.  Probability, random variables and stochastic processes , 1985, IEEE Trans. Acoust. Speech Signal Process..

[13]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[14]  Mark Newman,et al.  Networks: An Introduction , 2010 .

[15]  Shigeo Abe DrEng.  Pattern Classification , 2001, Springer London.

[16]  Peter Lancaster,et al.  The theory of matrices , 1969 .

[17]  I. Miller.  Probability, Random Variables, and Stochastic Processes , 1966 .

[18]  José M. F. Moura,et al.  Algebraic Signal Processing Theory , 2006, ArXiv.

[19]  Pierre Vandergheynst,et al.  Wavelets on Graphs via Spectral Graph Theory , 2009, ArXiv.

[20]  M. Puschel,et al.  Fourier transform for the spatial quincunx lattice , 2005, IEEE International Conference on Image Processing 2005.

[21]  Tony F. Chan,et al.  The digital TV filter and nonlinear denoising , 2001, IEEE Trans. Image Process..

[22]  José M. Bioucas-Dias,et al.  Adaptive total variation image deblurring: A majorization-minimization approach , 2009, Signal Process..

[23]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[24]  David G. Stork,et al.  Pattern Classification (2nd ed.) , 1999 .

[25]  José M. F. Moura,et al.  Discrete Signal Processing on Graphs , 2012, IEEE Transactions on Signal Processing.

[26]  Markus Püschel,et al.  Algebraic Signal Processing Theory: Cooley–Tukey Type Algorithms for Real DFTs , 2008, IEEE Transactions on Signal Processing.

[27]  S. Mallat.  A wavelet tour of signal processing , 1998 .

[28]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[29]  José M. F. Moura,et al.  The Algebraic Approach to the Discrete Cosine and Sine Transforms and Their Fast Algorithms , 2003, SIAM J. Comput..

[30]  Sergey Brin,et al.  The Anatomy of a Large-Scale Hypertextual Web Search Engine , 1998, Comput. Networks.

[31]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[32]  Mikhail Belkin,et al.  Tikhonov regularization and semi-supervised learning on large graphs , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[33]  Christine Connolly,et al.  Handbook of Image and Video Processing 2nd Edition (Hardback) , 2006 .

[34]  José M. F. Moura,et al.  Algebraic Signal Processing Theory: Cooley–Tukey Type Algorithms for DCTs and DSTs , 2007, IEEE Transactions on Signal Processing.

[35]  Bernhard Schölkopf,et al.  Learning with Local and Global Consistency , 2003, NIPS.

[36]  U. Feige,et al.  Spectral Graph Theory , 2015 .

[37]  Jelena Kovacevic,et al.  Algebraic Signal Processing Theory: 1-D Nearest Neighbor Models , 2012, IEEE Transactions on Signal Processing.

[38]  M. Newman.  Coauthorship networks and patterns of scientific collaboration , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[39]  Lada A. Adamic,et al.  The political blogosphere and the 2004 U.S. election: divided they blog , 2005, LinkKDD '05.

[40]  Ann B. Lee,et al.  Geometric diffusions as a tool for harmonic analysis and structure definition of data: diffusion maps. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[41]  J. Kleinberg,et al.  Networks, Crowds, and Markets , 2010 .

[42]  P. Laguna,et al.  Signal Processing , 2002, Yearbook of Medical Informatics.

[43]  R. Coifman,et al.  Diffusion Wavelets , 2004 .

[44]  José M. F. Moura,et al.  Discrete signal processing on graphs: Graph fourier transform , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[45]  Ivan W. Selesnick,et al.  Total variation denoising with overlapping group sparsity , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[46]  Jelena Kovacevic,et al.  Algebraic Signal Processing Theory: Cooley-Tukey-Type Algorithms for Polynomial Transforms Based on Induction , 2010, SIAM J. Matrix Anal. Appl..

[47]  F. R. Gantmakher.  The Theory of Matrices , 1984 .

[48]  Технология,et al.  National Climatic Data Center , 2011 .

[49]  Martin Rötteler,et al.  Algebraic Signal Processing Theory: 2-D Spatial Hexagonal Lattice , 2007, IEEE Trans. Image Process..

[50]  Kannan Ramchandran,et al.  Multiresolution graph signal processing via circulant structures , 2013, 2013 IEEE Digital Signal Processing and Signal Processing Education Meeting (DSP/SPE).

[51]  José M. F. Moura,et al.  Discrete signal processing on graphs: Graph filters , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[52]  A. W. M. van den Enden,et al.  Discrete Time Signal Processing , 1989 .

[53]  Michael G. Rabbat,et al.  Approximating signals supported on graphs , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[54]  Jerry D. Gibson,et al.  Handbook of Image and Video Processing , 2000 .