SIFT-based adaptive prediction structure for light field compression

A light field consists of multiple views of a scene, which can be arranged and encoded like a pseudo sequence. Since the correlations between views are not equal and indeed content dependent, a well-constructed coding order and adaptive prediction structure will improve performance. In this paper, we propose an adaptive prediction structure for light field compression. While the coding order is inherited from the 2-D hierarchical coding order, the prediction structure is determined by the differences between scale-invariant feature transform (SIFT) descriptors of the views. Experimental results show that the proposed method leads to on average 5.71% BD-rate reduction compared with fixed prediction structure.

[1]  Shinjini Kundu,et al.  Light field compression using homography and 2D warping , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[2]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[3]  Li Li,et al.  Pseudo-sequence-based light field image compression , 2016, 2016 IEEE International Conference on Multimedia & Expo Workshops (ICMEW).

[4]  Takayuki Hamamoto,et al.  A novel scheme for 4-D Light-Field compression based on 3-D representation by multi-focus images , 2012, 2012 19th IEEE International Conference on Image Processing.

[5]  Luís Ducla Soares,et al.  HEVC-based light field image coding with bi-predicted self-similarity compensation , 2016, 2016 IEEE International Conference on Multimedia & Expo Workshops (ICMEW).

[6]  Gary J. Sullivan,et al.  Overview of the Stereo and Multiview Video Coding Extensions of the H.264/MPEG-4 AVC Standard , 2011, Proceedings of the IEEE.

[7]  Xiaoyan Sun,et al.  Feature-based image set compression , 2013, 2013 IEEE International Conference on Multimedia and Expo (ICME).

[8]  Yun Li,et al.  Efficient intra prediction scheme for light field image compression , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[9]  Bin Li,et al.  Pseudo-Sequence-Based 2-D Hierarchical Coding Structure for Light-Field Image Compression , 2016, IEEE Journal of Selected Topics in Signal Processing.

[10]  Cristian Perra Light field image compression based on preprocessing and high efficiency coding , 2016, 2016 24th Telecommunications Forum (TELFOR).