Tight Wavelet Frames on Multislice Graphs

We present a framework for the design of wavelet transforms tailored to data defined on multislice graphs (i.e., multiplex or dynamic graphs). Graphs with multiple types of interactions are ubiquitous in real life, motivating the extension of wavelets to these complex domains. Our framework generalizes the recently proposed spectral graph wavelet transform (SGWT) [D. Hammond, P. Vandergheynst, and R. Gribonval, “Wavelets on Graphs via Spectral Graph Theory,” Appl. Comput. Harmon. Anal., vol. 30, pp. 129-150, Mar. 2011], which is designed in the spectral (frequency) domain of an arbitrary finite weighted graph. We extend the SGWT to form a tight frame, which conserves energy in the wavelet domain, and define the relationship between conventional and spectral graph wavelets. We then propose a design for multislice graphs that is based on the higher-order singular value decomposition (HOSVD), a powerful tool from multilinear algebra. In particular, the multiple adjacency matrices are stacked to form a tensor and the HOSVD decomposition provides information about its third-order structure, analogous to that provided by matrix factorizations. We obtain a set of “eigennetworks” and from these graph wavelets, which exploit the variability across the graphs. We demonstrate the feasibility of our method 1) by capturing different orientations of a gray-scale image and 2) by decomposing brain signals from functional magnetic resonance imaging. We show its effectiveness to identify variability across graph edges and provide meaningful decompositions.

[1]  Brigitte Forster-Heinlein,et al.  Steerable Wavelet Frames Based on the Riesz Transform , 2010, IEEE Transactions on Image Processing.

[2]  U. Feige,et al.  Spectral Graph Theory , 2015 .

[3]  Daniela Calvetti,et al.  Matrix methods in data mining and pattern recognition , 2009, Math. Comput..

[4]  Joos Vandewalle,et al.  A Multilinear Singular Value Decomposition , 2000, SIAM J. Matrix Anal. Appl..

[5]  R. Harshman,et al.  ‘Stretch’ vs ‘slice’ methods for representing three‐way structure via matrix notation , 2002 .

[6]  Frédéric Truchetet,et al.  Rational multiresolution analysis and fast wavelet transform: application to wavelet shrinkage denoising , 2004, Signal Process..

[7]  M. Gazzaniga,et al.  Understanding complexity in the human brain , 2011, Trends in Cognitive Sciences.

[8]  Demetri Terzopoulos,et al.  Multilinear Analysis of Image Ensembles: TensorFaces , 2002, ECCV.

[9]  J. Friedman,et al.  Wave equations for graphs and the edge-based Laplacian , 2004 .

[10]  L. Tucker,et al.  Some mathematical notes on three-mode factor analysis , 1966, Psychometrika.

[11]  Pascal Frossard,et al.  Clustering With Multi-Layer Graphs: A Spectral Perspective , 2011, IEEE Transactions on Signal Processing.

[12]  B. Silverman,et al.  Multiscale methods for data on graphs and irregular multidimensional situations , 2009 .

[13]  Harry Eugene Stanley,et al.  Catastrophic cascade of failures in interdependent networks , 2009, Nature.

[14]  Jianqin Zhou,et al.  On discrete cosine transform , 2011, ArXiv.

[15]  Lars Elden,et al.  Matrix methods in data mining and pattern recognition , 2007, Fundamentals of algorithms.

[16]  Silvano Di Zenzo,et al.  A note on the gradient of a multi-image , 1986, Comput. Vis. Graph. Image Process..

[17]  Michael Szell,et al.  Multirelational organization of large-scale social networks in an online world , 2010, Proceedings of the National Academy of Sciences.

[18]  J. Chang,et al.  Analysis of individual differences in multidimensional scaling via an n-way generalization of “Eckart-Young” decomposition , 1970 .

[19]  C. Cattaneo The spectrum of the continuous Laplacian on a graph , 1997 .

[20]  Richard A. Harshman,et al.  Foundations of the PARAFAC procedure: Models and conditions for an "explanatory" multi-model factor analysis , 1970 .

[21]  Scott T. Grafton,et al.  Dynamic reconfiguration of human brain networks during learning , 2010, Proceedings of the National Academy of Sciences.

[22]  E. Davidson,et al.  Strategies for analyzing data from video fluorometric monitoring of liquid chromatographic effluents , 1981 .

[23]  R. Coifman,et al.  Diffusion Wavelets , 2004 .

[24]  Eero P. Simoncelli,et al.  A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients , 2000, International Journal of Computer Vision.

[25]  Emmanuel Papadakis,et al.  The geometry and the analytic properties of isotropic multiresolution analysis , 2009, Adv. Comput. Math..

[26]  R. Bro PARAFAC. Tutorial and applications , 1997 .

[27]  John J. Benedetto,et al.  Finite Normalized Tight Frames , 2003, Adv. Comput. Math..

[28]  José M. F. Moura,et al.  Discrete Signal Processing on Graphs , 2012, IEEE Transactions on Signal Processing.

[29]  Dimitri Van De Ville,et al.  Wavelet frames on graphs defined by fMRI functional connectivity , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[30]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..

[31]  N. Tzourio-Mazoyer,et al.  Automated Anatomical Labeling of Activations in SPM Using a Macroscopic Anatomical Parcellation of the MNI MRI Single-Subject Brain , 2002, NeuroImage.

[32]  Joos Vandewalle,et al.  On the Best Rank-1 and Rank-(R1 , R2, ... , RN) Approximation of Higher-Order Tensors , 2000, SIAM J. Matrix Anal. Appl..

[33]  Dimitri Van De Ville,et al.  Impact of transient emotions on functional connectivity during subsequent resting state: A wavelet correlation approach , 2011, NeuroImage.

[34]  Dimitri Van De Ville,et al.  Decoding brain states from fMRI connectivity graphs , 2011, NeuroImage.

[35]  L. Lathauwer,et al.  On the Best Rank-1 and Rank-( , 2004 .

[36]  Jukka-Pekka Onnela,et al.  Community Structure in Time-Dependent, Multiscale, and Multiplex Networks , 2009, Science.

[37]  J. Below A characteristic equation associated to an eigenvalue problem on c2-networks , 1985 .

[38]  D. Long Networks of the Brain , 2011 .

[39]  Sunil K. Narang,et al.  Perfect Reconstruction Two-Channel Wavelet Filter Banks for Graph Structured Data , 2011, IEEE Transactions on Signal Processing.

[40]  Pierre Vandergheynst,et al.  Wavelets on Graphs via Spectral Graph Theory , 2009, ArXiv.

[41]  Y. Meyer Principe d'incertitude, bases hilbertiennes et algèbres d'opérateurs , 1986 .

[42]  Catie Chang,et al.  Time–frequency dynamics of resting-state brain connectivity measured with fMRI , 2010, NeuroImage.

[43]  Michael Elad,et al.  Generalized Tree-Based Wavelet Transform , 2010, IEEE Transactions on Signal Processing.