Integrated Multi-view Compensation for Real Sense Video Interfaces

Multi-view video is a new multimedia service which provides immersion and realism using the multiple view channels. However, as the number of cameras increases, the enormous data volume generated by them inevitably calls for better video compression and processing algorithms. However, the multiple images taken at any certain time instants always have inconsistency among the views in their intensity, color, sharpness, and so on. It not only degrades the compression efficiency greatly but also causes subjective quality loss such as dizziness and unnaturalness in random view access. To solve this problem, in this paper, we propose a new multi-view compensation method which uses the Kalman filter. It estimates the illumination discrepancy parameters autonomously both in encoder and decoder. Therefore, our method needs not transmit any additional data for illumination discrepancy information.

[1]  Ruigang Yang,et al.  Camera-based calibration techniques for seamless multiprojector displays , 2005, IEEE Transactions on Visualization and Computer Graphics.

[2]  Arthur Gelb,et al.  Applied Optimal Estimation , 1974 .

[3]  Wen Gao,et al.  Viewpoint switching in multiview video streaming , 2005, 2005 IEEE International Symposium on Circuits and Systems.

[4]  Aljoscha Smolic,et al.  Interactive 3-D Video Representation and Coding Technologies , 2005, Proceedings of the IEEE.

[5]  S. B. Kang,et al.  Survey of image-based representations and compression techniques , 2003, IEEE Trans. Circuits Syst. Video Technol..

[6]  Jeon Byeung-Woo,et al.  Intensity Compensation for Efficient Stereo Image Compression , 2005 .

[7]  Wenxian Yang,et al.  A multiview sequence CODEC with view scalability , 2004, Signal Process. Image Commun..

[8]  Wojciech Matusik,et al.  3D TV: a scalable system for real-time acquisition, transmission, and autostereoscopic display of dynamic scenes , 2004, ACM Trans. Graph..

[9]  J-R. Olm Encoding and reconstruction of multiview video objects , 1999 .

[10]  Hiroshi Yasuda,et al.  Video coding using global motion and brightness-variation compensation with complexity reduction , 1999 .

[11]  Glenn Healey,et al.  Radiometric CCD camera calibration and noise estimation , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Takeo Kanade,et al.  Statistical calibration of CCD imaging process , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[13]  Peng Yin,et al.  Localized weighted prediction for video coding , 2005, 2005 IEEE International Symposium on Circuits and Systems.