Closed Form Solutions of Combinatorial Graph Laplacian Estimation under Acyclic Topology Constraints

How to obtain a graph from data samples is an important problem in graph signal processing. One way to formulate this graph learning problem is based on Gaussian maximum likelihood estimation, possibly under particular topology constraints. To solve this problem, we typically require iterative convex optimization solvers. In this paper, we show that when the target graph topology does not contain any cycle, then the solution has a closed form in terms of the empirical covariance matrix. This enables us to efficiently construct a tree graph from data, even if there is only a single data sample available. We also provide an error bound of the objective function when we use the same solution to approximate a cyclic graph. As an example, we consider an image denoising problem, in which for each input image we construct a graph based on the theoretical result. We then apply low-pass graph filters based on this graph. Experimental results show that the weights given by the graph learning solution lead to better denoising results than the bilateral weights under some conditions.

[1]  Salar Fattahi,et al.  Graphical Lasso and Thresholding: Equivalence and Closed-form Solutions , 2017, J. Mach. Learn. Res..

[2]  Pascal Frossard,et al.  The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains , 2012, IEEE Signal Processing Magazine.

[3]  José M. F. Moura,et al.  Discrete Signal Processing on Graphs , 2012, IEEE Transactions on Signal Processing.

[4]  Antonio Ortega,et al.  Graph-based transforms for inter predicted video coding , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[5]  Sunil K. Narang,et al.  Bilateral filter: Graph spectral interpretation and extensions , 2013, 2013 IEEE International Conference on Image Processing.

[6]  Antonio Ortega,et al.  Tree-based wavelets for image coding: Orthogonalization and tree selection , 2009, 2009 Picture Coding Symposium.

[7]  Sunil K. Narang,et al.  Perfect Reconstruction Two-Channel Wavelet Filter Banks for Graph Structured Data , 2011, IEEE Transactions on Signal Processing.

[8]  Jaejoon Lee,et al.  Edge-adaptive transforms for efficient depth map coding , 2010, 28th Picture Coding Symposium.

[9]  Richard Szeliski,et al.  Noise Estimation from a Single Image , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[10]  R. Tibshirani,et al.  Sparse inverse covariance estimation with the graphical lasso. , 2008, Biostatistics.

[11]  D. West Introduction to Graph Theory , 1995 .

[12]  Ireneusz Jabłoński,et al.  Graph Signal Processing in Applications to Sensor Networks, Smart Grids, and Smart Cities , 2017, IEEE Sensors Journal.

[13]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[14]  Antonio Ortega,et al.  Symmetric line graph transforms for inter predictive video coding , 2016, 2016 Picture Coding Symposium (PCS).

[15]  Pascal Frossard,et al.  Learning Laplacian Matrix in Smooth Graph Signal Representations , 2014, IEEE Transactions on Signal Processing.

[16]  Antonio Ortega,et al.  Active semi-supervised learning using sampling theory for graph signals , 2014, KDD.

[17]  Antonio Ortega,et al.  Learning separable transforms by inverse covariance estimation , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[18]  Antonio Ortega,et al.  Graph Learning From Data Under Laplacian and Structural Constraints , 2016, IEEE Journal of Selected Topics in Signal Processing.

[19]  Cha Zhang,et al.  Analyzing the Optimality of Predictive Transform Coding Using Graph-Based Models , 2013, IEEE Signal Processing Letters.

[20]  Mihailo R. Jovanovic,et al.  Topology identification of undirected consensus networks via sparse inverse covariance estimation , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[21]  Eduardo Pavez,et al.  Learning Graphs With Monotone Topology Properties and Multiple Connected Components , 2017, IEEE Transactions on Signal Processing.