Lifting Transforms on Graphs for Video Coding

We present a new graph-based transform for video signals using wavelet lifting. Graphs are created to capture spatial and temporal correlations in video sequences. Our new transforms allow spatial and temporal correlation to be jointly exploited, in contrast to existing techniques, such as motion compensated temporal filtering, which can be seen as "separable" transforms, since spatial and temporal filtering are performed separately. We design efficient ways to form the graphs and to design the prediction and update filters for different levels of the lifting transform as a function of expected degree of correlation between pixels. Our initial results are promising, with improvements in performance as compared to existing methods in terms of PSNR as a function of the percentage of retained coefficients of the transform.

[1]  Antonio Ortega,et al.  Tree-based wavelets for image coding: Orthogonalization and tree selection , 2009, 2009 Picture Coding Symposium.

[2]  David S. Taubman,et al.  Lifting-based invertible motion adaptive transform (LIMAT) framework for highly scalable video compression , 2003, IEEE Trans. Image Process..

[3]  Stéphane Mallat,et al.  Sparse geometric image representations with bandelets , 2005, IEEE Transactions on Image Processing.

[4]  Baltasar Beferull-Lozano,et al.  Directionlets: anisotropic multidirectional representation with separable filtering , 2006, IEEE Transactions on Image Processing.

[5]  Antonio Ortega,et al.  Comopact image representation using wavelet lifting along arbitrary trees , 2008, 2008 15th IEEE International Conference on Image Processing.

[6]  Wim Sweldens,et al.  The lifting scheme: a construction of second generation wavelets , 1998 .

[7]  Christophe Tillier,et al.  Motion compensation and scalability in lifting-based video coding , 2004, Signal Process. Image Commun..

[8]  Chi-Ping Hsu Minimum-Via Topological Routing , 1983, IEEE Trans. Comput. Aided Des. Integr. Circuits Syst..

[9]  Sunil K. Narang,et al.  Unidirectional graph-based wavelet transforms for efficient data gathering in sensor networks , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[10]  Antonio Ortega,et al.  Optimized distributed 2D transforms for irregularly sampled sensor network grids using wavelet lifting , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[11]  Antonio Ortega,et al.  Lifting Based Wavelet Transforms on Graphs , 2009 .

[12]  Raanan Fattal,et al.  Edge-avoiding wavelets and their applications , 2009, ACM Trans. Graph..

[13]  Alberto Signoroni,et al.  State-of-the-Art and Trends in Scalable Video Compression With Wavelet-Based Approaches , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Béatrice Pesquet-Popescu,et al.  Three-dimensional lifting schemes for motion compensated video compression , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).