Real-time embedded system for stereo video processing for multiview displays

In video systems, the introduction of 3D video might be the next revolution after the introduction of color. Nowadays multiview auto-stereoscopic displays are entering the market. Such displays offer various views at the same time. Depending on its positions, the viewers' eyes see different images. Hence, the viewers' left eye receives a signal that is different from what his right eye gets; this gives, provided the signals have been properly processed, the impression of depth. New auto-stereoscopic products use an image-plus-depth interface. On the other hand, a growing number of 3D productions from the entertainment industry use a stereo format. In this paper, we show how to compute depth from the stereo signal to comply with the display interface format. Furthermore, we present a realisation suitable for a real-time cost-effective implementation on an embedded media processor.

[1]  D. Scharstein,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001).

[2]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[3]  Christoph Fehn,et al.  Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV , 2004, IS&T/SPIE Electronic Imaging.

[4]  Shree K. Nayar,et al.  Rectifying transformations that minimize resampling effects , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[5]  Stamatis Vassiliadis,et al.  The TM3270 media-processor , 2005, 38th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO'05).

[6]  John A. Clarke,et al.  Characterization and optimization of 3D-LCD module design , 1997, Electronic Imaging.

[7]  John Mark Bishop,et al.  NAPSAC: high noise, high dimensional model parameterisation - it's in the bag , 2002 .

[8]  Chris Varekamp,et al.  Challenges in 3DTV image processing , 2007, Electronic Imaging.

[9]  Ralph Braspenning,et al.  Efficient view synthesis from uncalibrated stereo , 2006, Electronic Imaging.

[10]  Bart Barenbrug.  3 D Throughout the video chain , 2006 .

[11]  Gerard de Haan,et al.  True-motion estimation with 3-D recursive search block matching , 1993, IEEE Trans. Circuits Syst. Video Technol..

[12]  Slawomir J. Nasuto,et al.  NAPSAC: High Noise, High Dimensional Robust Estimation - it's in the Bag , 2002, BMVC.

[13]  Gerard de Haan,et al.  IC for motion compensated de-interlacing, noise reduction, and picture rate conversion , 1999, 1999 Digest of Technical Papers. International Conference on Consumer Electronics (Cat. No.99CH36277).

[14]  R.K. Gunnewiek,et al.  Enabling Introduction of Stereoscopic (3D) Video: Compression Standards & its Impact on Display Rendering , 2007, 2007 Digest of Technical Papers International Conference on Consumer Electronics.