Graph fourier transform with negative edges for depth image coding

Recent advent in graph signal processing (GSP) has led to the development of new graph-based transforms and wavelets for image / video coding, where the underlying graph describes inter-pixel correlations. In this paper, we develop a new transform called signed graph Fourier transform (SGFT), where the underlying graph G contains negative edges that describe anti-correlations between pixel pairs. Specifically, we first construct a one-state Markov process that models both inter-pixel correlations and anti-correlations. We then derive the corresponding precision matrix, and show that the loopy graph Laplacian matrix Q of a graph G with a negative edge and two self-loops at its end nodes is approximately equivalent. This proves that the eigenvectors of Q — called SGFT — approximates the optimal Karhunen-Loève Transform (KLT). We show the importance of the self-loops in G to ensure Q is positive semi-definite. We prove that the first eigenvector of Q is piecewise constant (PWC), and thus can well approximate a piecewise smooth (PWS) signal like a depth image. Experimental results show that a block-based coding scheme based on SGFT outperforms a previous scheme using graph transforms with only positive edges for several depth images.

[1]  Oscar C. Au,et al.  Depth map compression using multi-resolution graph-based transform for depth-image-based rendering , 2012, 2012 19th IEEE International Conference on Image Processing.

[2]  Oscar C. Au,et al.  Multiresolution Graph Fourier Transform for Compression of Piecewise Smooth Images , 2015, IEEE Transactions on Image Processing.

[3]  Antonio Ortega,et al.  Designing sparse graphs via structure tensor for block transform coding of images , 2015, 2015 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA).

[4]  Peter F. Stadler,et al.  Nodal Domain Theorems and Bipartite Subgraphs , 2005 .

[5]  J. Pei,et al.  Finding Gangs in War from Signed Networks , 2016, KDD.

[6]  Antonio Ortega,et al.  Intra-Prediction and Generalized Graph Fourier Transform for Image Coding , 2015, IEEE Signal Processing Letters.

[7]  Florian Dörfler,et al.  Kron Reduction of Graphs With Applications to Electrical Networks , 2011, IEEE Transactions on Circuits and Systems I: Regular Papers.

[8]  Kenneth Rose,et al.  Jointly Optimized Spatial Prediction and Block Transform for Video and Image Coding , 2012, IEEE Transactions on Image Processing.

[9]  Jaejoon Lee,et al.  Edge-aware intra prediction for depth-map coding , 2010, 2010 IEEE International Conference on Image Processing.

[10]  Mathias Bürger,et al.  On the definiteness of the weighted Laplacian and its connection to effective resistance , 2014, 53rd IEEE Conference on Decision and Control.

[11]  Tryphon T. Georgiou,et al.  On the definiteness of graph Laplacians with negative weights: Geometrical and passivity-based approaches , 2016, 2016 American Control Conference (ACC).

[12]  Gene Cheung,et al.  Arbitrarily Shaped Motion Prediction for Depth Video Compression Using Arithmetic Edge Coding , 2014, IEEE Transactions on Image Processing.

[13]  Antonio Ortega,et al.  Lifting Based Wavelet Transforms on Graphs , 2009 .

[14]  Pascal Frossard,et al.  The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains , 2012, IEEE Signal Processing Magazine.

[15]  Antonio Ortega,et al.  Edge-adaptive depth map coding with lifting transform on graphs , 2015, 2015 Picture Coding Symposium (PCS).

[16]  Jaejoon Lee,et al.  Edge-adaptive transforms for efficient depth map coding , 2010, 28th Picture Coding Symposium.

[17]  Antonio Ortega,et al.  GTT: Graph template transforms with applications to image coding , 2015, 2015 Picture Coding Symposium (PCS).

[18]  A. Ostrowski,et al.  On the inertia of some classes of partitioned matrices , 1968 .

[19]  Sahin Albayrak,et al.  Spectral Analysis of Signed Graphs for Clustering, Prediction and Visualization , 2010, SDM.