Bipartite Approximation for Graph Wavelet Signal Decomposition

To compactly represent a graph signal in the frequency domain, critically sampled biorthogonal wavelet filterbanks have been proposed to decompose signals on bipartite graphs. However, in practice graph signals often reside on general graph structures that are not bipartite. Thus, an original nonbipartite graph must be decomposed into a sequence of bipartite graph approximations, so that the filterbanks can be applied successively for signal decomposition. In this paper, unlike previous proposals that are heuristic in nature, we design new bipartite approximation strategies for model-based and empirically derived probability distributions. In the first case, a signal prior assumes a Gaussian Markov Random Field (GMRF) model parametrized by the original graph. In the second case, beyond the GMRF signal prior, empirical signal observations are available to compute a posterior probability distribution. In both cases, we optimize for energy compaction in the bipartite subgraphs with two criteria: the Kullback–Leibler divergence metric, which encourages preserving the spectral characteristics of the original graph; and multiplicity of eigenvalue at frequency 1 for graph Laplacian, which is the frequency with minimal energy discrimination. The relative importance between the two criteria is determined by a proposed measure that evaluates the degree of mismatch between the signal prior and posterior. Given these criteria, we first design a global numerical optimization, and then propose a local heuristic approach for fast implementation with simplifications leading to local metric computation. Experimental results show that our proposed bipartite subgraph decomposition outperforms competing proposals in terms of energy compaction.

[1]  Dragoš Cvetković,et al.  The algebraic multiplicity of the number zero in the spectrum of a bipartite graph , 1972 .

[2]  An upper bound for the nullity of a bipartite graph in terms of its maximum degree , 2016 .

[3]  Toshihisa Tanaka,et al.  Efficient sensor position selection using graph signal sampling theory , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[4]  M. Bóna A Walk Through Combinatorics: An Introduction to Enumeration and Graph Theory , 2006 .

[5]  Sunil K. Narang,et al.  Downsampling graphs using spectral theory , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[6]  P. P. Vaidyanathan,et al.  Extending Classical Multirate Signal Processing Theory to Graphs—Part II: M-Channel Filter Banks , 2017, IEEE Transactions on Signal Processing.

[7]  Pierre Borgnat,et al.  Subgraph-Based Filterbanks for Graph Signals , 2015, IEEE Transactions on Signal Processing.

[8]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[9]  Gholam Reza Omidi On the Nullity of Bipartite Graphs , 2009, Graphs Comb..

[10]  Pascal Frossard,et al.  The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains , 2012, IEEE Signal Processing Magazine.

[11]  Long Wang,et al.  Bounds for the matching number, the edge chromatic number and the independence number of a graph in terms of rank , 2014, Discret. Appl. Math..

[12]  Gregory K. Wallace,et al.  The JPEG still picture compression standard , 1992 .

[13]  Sunil K. Narang,et al.  Graph based transforms for depth video coding , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[14]  Quanzheng Li,et al.  A graph theoretical regression model for brain connectivity learning of Alzheimer'S disease , 2013, 2013 IEEE 10th International Symposium on Biomedical Imaging.

[15]  William M. Campbell,et al.  Social Network Analysis with Content and Graphs , 2013 .

[16]  Richard M. Karp,et al.  A n^5/2 Algorithm for Maximum Matchings in Bipartite Graphs , 1971, SWAT.

[17]  Stephen P. Boyd,et al.  Log-det heuristic for matrix rank minimization with applications to Hankel and Euclidean distance matrices , 2003, Proceedings of the 2003 American Control Conference, 2003..

[18]  Edward Chung,et al.  Estimating link-dependent Origin-Destination matrices from sample trajectories and traffic counts , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[19]  Antonio Ortega,et al.  Critical sampling for wavelet filterbanks on arbitrary graphs , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[20]  Antonio Ortega,et al.  Bipartite subgraph decomposition for critically sampled wavelet filterbanks on arbitrary graphs , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[21]  Yuichi Tanaka,et al.  Oversampled Graph Laplacian Matrix for Graph Filter Banks , 2014, IEEE Transactions on Signal Processing.

[22]  Marco Levorato,et al.  Optimization of wireless networks via graph interpolation , 2013, 2013 IEEE Global Conference on Signal and Information Processing.

[23]  M. Yuan,et al.  Model selection and estimation in the Gaussian graphical model , 2007 .

[24]  Pascal Frossard,et al.  Learning Laplacian Matrix in Smooth Graph Signal Representations , 2014, IEEE Transactions on Signal Processing.

[25]  Antonio Ortega,et al.  Generalized Laplacian precision matrix estimation for graph signal processing , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[26]  Frank Harary,et al.  The biparticity of a graph , 1977, J. Graph Theory.

[27]  Yuichi Tanaka,et al.  M-Channel Oversampled Graph Filter Banks , 2014, IEEE Trans. Signal Process..

[28]  Joshua B. Tenenbaum,et al.  Discovering Structure by Learning Sparse Graphs , 2010 .

[29]  Sunil K. Narang,et al.  Perfect Reconstruction Two-Channel Wavelet Filter Banks for Graph Structured Data , 2011, IEEE Transactions on Signal Processing.

[30]  Gene Cheung,et al.  Graph-based Dequantization of Block-Compressed Piecewise Smooth Images , 2016, IEEE Signal Processing Letters.

[31]  Chong Peng,et al.  LogDet Rank Minimization with Application to Subspace Clustering , 2015, Comput. Intell. Neurosci..

[32]  P. P. Vaidyanathan,et al.  Extending Classical Multirate Signal Processing Theory to Graphs—Part I: Fundamentals , 2017, IEEE Transactions on Signal Processing.

[33]  Dmitry Malioutov,et al.  Convex Total Least Squares , 2014, ICML.

[34]  Yusheng Ji,et al.  Image classifier learning from noisy labels via generalized graph smoothness priors , 2016, 2016 IEEE 12th Image, Video, and Multidimensional Signal Processing Workshop (IVMSP).

[35]  Antonio Ortega,et al.  A probabilistic interpretation of sampling theory of graph signals , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[36]  Pascal Frossard,et al.  Multiscale event detection in social media , 2014, Data Mining and Knowledge Discovery.

[37]  Richard M. Karp,et al.  A n^5/2 Algorithm for Maximum Matchings in Bipartite Graphs , 1971, SWAT.

[38]  Arne Storjohann,et al.  Integer matrix rank certification , 2009, ISSAC '09.

[39]  David Zuckerman,et al.  Electronic Colloquium on Computational Complexity, Report No. 100 (2005) Linear Degree Extractors and the Inapproximability of MAX CLIQUE and CHROMATIC NUMBER , 2005 .

[40]  Hong-Jian Lai,et al.  On the permanental nullity and matching number of graphs , 2016, 1603.03109.

[41]  Sunil K. Narang,et al.  Multi-dimensional separable critically sampled wavelet filterbanks on arbitrary graphs , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[42]  Virginia Vassilevska Williams,et al.  Multiplying matrices faster than coppersmith-winograd , 2012, STOC '12.

[43]  Matthias Hein,et al.  Estimation of positive definite M-matrices and structure learning for attractive Gaussian Markov Random fields , 2014, 1404.6640.

[44]  J. Cramer,et al.  Logit Models from Economics and Other Fields: The origins and development of the logit model , 2003 .

[45]  Minh N. Do,et al.  Downsampling of Signals on Graphs Via Maximum Spanning Trees , 2015, IEEE Transactions on Signal Processing.

[46]  Sunil K. Narang,et al.  Compact Support Biorthogonal Wavelet Filterbanks for Arbitrary Undirected Graphs , 2012, IEEE Transactions on Signal Processing.

[47]  Oscar H. Ibarra,et al.  A Generalization of the Fast LUP Matrix Decomposition Algorithm and Applications , 1982, J. Algorithms.