Graph transform learning for image compression

In this paper, we propose a new graph-based compression scheme for image coding. Our approach relies on the careful design of a graph that optimizes the overall rate-distortion performance. In particular, we model the pixels as nodes of a graph and we treat the pixel intensities as a signal living on an unknown graph topology. We then introduce a novel graph learning algorithm targeted for image compression that uncovers the connectivities between the pixels, by taking into consideration the coding of the image signal and the graph topology in rate-distortion terms. The cost of the graph description is introduced in the optimization problem by treating the edge weights as another graph signal that lies on the dual graph, and minimizing the sparsity of its graph Fourier coefficients (GFT). In this way, we obtain a convex optimization problem whose solution defines the transform of the image signal. The experimental results show that the proposed method outperforms classical fixed transforms such as DCT, and confirm the potential of graph-based methods for adaptive image coding solutions.

[1]  Leonhard Held,et al.  Gaussian Markov Random Fields: Theory and Applications , 2005 .

[2]  Antonio Ortega,et al.  Graph-based transforms for inter predicted video coding , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[3]  Enrico Magli,et al.  Predictive graph construction for image compression , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[4]  Eduardo Pavez,et al.  Learning Graphs With Monotone Topology Properties and Multiple Connected Components , 2017, IEEE Transactions on Signal Processing.

[5]  David L. Neuhoff,et al.  Quantization , 2022, IEEE Trans. Inf. Theory.

[6]  Anil K. Jain,et al.  A Sinusoidal Family of Unitary Transforms , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[8]  Xianming Liu,et al.  Joint denoising and contrast enhancement of images using graph laplacian operator , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[9]  Richard Szeliski,et al.  High-accuracy stereo depth maps using structured light , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[10]  Antonio Ortega,et al.  GBST: Separable transforms based on line graphs for predictive video coding , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[11]  Jaejoon Lee,et al.  Edge-adaptive transforms for efficient depth map coding , 2010, 28th Picture Coding Symposium.

[12]  Stéphane Mallat,et al.  Analysis of low bit rate image transform coding , 1998, IEEE Trans. Signal Process..

[13]  Gene Cheung,et al.  Graph-based Dequantization of Block-Compressed Piecewise Smooth Images , 2016, IEEE Signal Processing Letters.

[14]  Ullrich Köthe,et al.  Edge and Junction Detection with an Improved Structure Tensor , 2003, DAGM-Symposium.

[15]  Antonio Ortega,et al.  Intra-Prediction and Generalized Graph Fourier Transform for Image Coding , 2015, IEEE Signal Processing Letters.

[16]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[17]  Antonio Ortega,et al.  Graph Learning from Data under Structural and Laplacian Constraints , 2016, ArXiv.

[18]  Christopher Joseph Pal,et al.  Learning Conditional Random Fields for Stereo , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Ian H. Witten,et al.  Arithmetic coding for data compression , 1987, CACM.

[20]  Pascal Frossard,et al.  The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains , 2012, IEEE Signal Processing Magazine.

[21]  N. Ahmed,et al.  Discrete Cosine Transform , 1996 .

[22]  B. S. Manjunath,et al.  An axiomatic approach to corner detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[23]  Vivek K. Goyal,et al.  Transform coding with backward adaptive updates , 2000, IEEE Trans. Inf. Theory.

[24]  Cha Zhang,et al.  Analyzing the Optimality of Predictive Transform Coding Using Graph-Based Models , 2013, IEEE Signal Processing Letters.

[25]  Heiko Schwarz,et al.  Source Coding: Part I of Fundamentals of Source and Video Coding , 2011, Found. Trends Signal Process..

[26]  B. Schölkopf,et al.  A Regularization Framework for Learning from Graph Data , 2004, ICML 2004.

[27]  Oscar C. Au,et al.  Multiresolution Graph Fourier Transform for Compression of Piecewise Smooth Images , 2015, IEEE Transactions on Image Processing.

[28]  Pascal Frossard,et al.  Learning Laplacian Matrix in Smooth Graph Signal Representations , 2014, IEEE Transactions on Signal Processing.

[29]  Khalid Sayood,et al.  Introduction to Data Compression , 1996 .

[30]  Sunil K. Narang,et al.  Graph based transforms for depth video coding , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[31]  Antonio Ortega,et al.  Generalized Laplacian precision matrix estimation for graph signal processing , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[32]  Vassilis Kalofolias,et al.  How to Learn a Graph from Smooth Signals , 2016, AISTATS.

[33]  Antonio Ortega,et al.  Symmetric line graph transforms for inter predictive video coding , 2016, 2016 Picture Coding Symposium (PCS).

[34]  Jean H. Gallier,et al.  Notes on Elementary Spectral Graph Theory. Applications to Graph Clustering Using Normalized Cuts , 2013, ArXiv.

[35]  Antonio Ortega,et al.  Designing sparse graphs via structure tensor for block transform coding of images , 2015, 2015 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA).

[36]  Gene Cheung,et al.  Graph fourier transform with negative edges for depth image coding , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[37]  Stéphane Mallat,et al.  A Wavelet Tour of Signal Processing - The Sparse Way, 3rd Edition , 2008 .

[38]  Pierre Vandergheynst,et al.  Wavelets on Graphs via Spectral Graph Theory , 2009, ArXiv.

[39]  Antonio Ortega,et al.  GTT: Graph template transforms with applications to image coding , 2015, 2015 Picture Coding Symposium (PCS).