Spatial prediction based on self-similarity compensation for 3D holoscopic image and video coding

Holoscopic imaging, also known as integral imaging, provides a solution for glassless 3D, and is promising to change the market for 3D television. To start, this paper briefly describes the general concepts of holoscopic imaging, focusing mainly on the spatial correlations inherent to this new type of content, which appear due to the micro-lens array that is used for both acquisition and display. The micro-images that are formed behind each micro-lens, from which only one pixel is viewed from a given observation point, have a high cross-correlation between them, which can be exploited for coding. A novel scheme for spatial prediction, exploring the particular arrangement of holoscopic images, is proposed. The proposed scheme can be used for both still image coding and intra-coding of video. Experimental results based on an H.264/AVC video codec modified to handle 3D holoscopic images and video are presented, showing the superior performance of this approach.

[1]  Tong Zhen,et al.  3D Multi-view Autostereoscopic Display and Its Key Technologie , 2009, 2009 Asia-Pacific Conference on Information Processing.

[2]  Amar Aggoun,et al.  Quantisation strategies for 3D-DCT-based compression of full parallax 3D images , 1997 .

[3]  Warnakulasuriya Anil Chandana Fernando,et al.  A Joint Motion & Disparity Motion Estimation Technique for 3D Integral Video Compression Using Evolutionary Strategy , 2007, IEEE Transactions on Consumer Electronics.

[4]  Amar Aggoun,et al.  Adaptive 3D-DCT compression algorithm for continuous parallax 3D integral imaging , 2002, Signal Process. Image Commun..

[5]  Gary J. Sullivan,et al.  Rate-constrained coder control and comparison of video coding standards , 2003, IEEE Trans. Circuits Syst. Video Technol..

[6]  A. Stern,et al.  A Hybrid Compression Method for Integral Images Using Discrete Wavelet Transform and Discrete Cosine Transform , 2007, Journal of Display Technology.

[7]  Amar Aggoun,et al.  A 3D Dct Compression Algorithm For Omnidirectional Integral Images , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[8]  Alin Achim,et al.  18th IEEE International Conference on Image Processing, ICIP 2011, Brussels, Belgium, September 11-14, 2011 , 2011, ICIP.

[9]  Amar Aggoun,et al.  Compression of Full Parallax Colour Integral 3D TV Image Data Based on Sub-Sampling of Chrominance Components , 2001, Data Compression Conference.

[10]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[11]  Amar Aggoun,et al.  Wavelet-based compression algorithm for still omnidirectional 3d integral images , 2008, Signal Image Video Process..

[12]  Ahmet M. Kondoz,et al.  Motion and Disparity Estimation with Self Adapted Evolutionary Strategy in 3D Video Coding , 2007, IEEE Transactions on Consumer Electronics.

[13]  Malcolm McCormick,et al.  Computer modeling of lens arrays for integral image rendering , 2002, Proceedings 20th Eurographics UK Conference.

[14]  B. Mandelbrot.  How Long Is the Coast of Britain? Statistical Self-Similarity and Fractional Dimension , 1967, Science.

[15]  G. Lippmann.  Epreuves reversibles donnant la sensation du relief , 1908 .