Multi-model prediction for image set compression

The key task in image set compression is how to efficiently remove set redundancy among images and within a single image. In this paper, we propose the first multi-model prediction (MoP) method for image set compression to significantly reduce inter image redundancy. Unlike the previous prediction methods, our MoP enhances the correlation between images using feature-based geometric multi-model fitting. Based on estimated geometric models, multiple deformed prediction images are generated to reduce geometric distortions in different image regions. The block-based adaptive motion compensation is then adopted to further eliminate local variances. Experimental results demonstrate the advantage of our approach, especially for images with complicated scenes and geometric relationships.

[1]  Antonio Torralba,et al.  SIFT Flow: Dense Correspondence across Scenes and Its Applications , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  VekslerOlga,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001 .

[3]  J. Li,et al.  Multiview Image Coding Based on Geometric Prediction , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Antonio Ortega,et al.  Overlapped block disparity compensation with adaptive windows for stereo image coding , 2000, IEEE Trans. Circuits Syst. Video Technol..

[5]  Yurij S. Musatenko,et al.  Correlated image set compression system based on new fast efficient algorithm of Karhunen-Loeve transform , 1998, Other Conferences.

[6]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[7]  Xiaoyan Sun,et al.  Feature-based image set compression , 2013, 2013 IEEE International Conference on Multimedia and Expo (ICME).

[8]  Yasuyuki Matsushita,et al.  Smoothly varying affine stitching , 2011, CVPR 2011.

[9]  John M. Tyler,et al.  The Centroid method for compressing sets of similar images , 1998, Pattern Recognit. Lett..

[10]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[11]  Yuri Boykov,et al.  Energy-Based Geometric Multi-model Fitting , 2012, International Journal of Computer Vision.

[12]  Xiaobo Li,et al.  A Study of Clustering Algorithms and Validity for Lossy Image Set Compression , 2009, IPCV.

[13]  Xiaoyan Sun,et al.  Cloud-Based Image Coding for Mobile Devices—Toward Thousands to One Compression , 2013, IEEE Transactions on Multimedia.

[14]  An Ping,et al.  Stereo video coding based on frame estimation and interpolation , 2003 .

[15]  Gregory K. Wallace,et al.  The JPEG still picture compression standard , 1992 .

[16]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[17]  Yun He,et al.  A novel multi-view video coding scheme based on H.264 , 2003, Fourth International Conference on Information, Communications and Signal Processing, 2003 and the Fourth Pacific Rim Conference on Multimedia. Proceedings of the 2003 Joint.

[18]  Xin Tong,et al.  Coding of multi-view images for immersive viewing , 2000, 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100).

[19]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[21]  Marcus A. Magnor,et al.  Multi-view coding for image-based rendering using 3-D scene geometry , 2003, IEEE Trans. Circuits Syst. Video Technol..

[22]  Gary J. Sullivan,et al.  Rate-constrained coder control and comparison of video coding standards , 2003, IEEE Trans. Circuits Syst. Video Technol..

[23]  Samy Ait-Aoudia,et al.  A Comparison of Set Redundancy Compression Techniques , 2006, EURASIP J. Adv. Signal Process..