Content-Based Pseudoscopic View Detection

Stereoscopic images are generated from a pair of images (i.e., left and right images). In order to generate 3-D perception using the left and right images, it should be guaranteed that each image is perceived by the corresponding eye only. However, the depth perception becomes distorted when the left and the right eye views are interchanged, also known as a pseudoscopic problem. In this paper, we propose a novel method for detecting the pseudoscopic view by using disparity comparison in stereo images. Our approach originates from the idea that the disparities on a scene are categorized into three classes: zero disparity, positive disparity, and negative disparity, and that the foreground is usually located in front of the background. The proposed pseudoscopic view detection system consists of three sequential stages: 1) foreground/background segmentation, 2) feature points extraction, and 3) disparity comparison. We first segment the given image into two layers (i.e., foreground and background). Then, the feature points at each layer are extracted and matched to estimate the disparity characteristics of each layer. Finally, the existence of the pseudoscopic view can be investigated by using a disparity calibration model (DCM) presented in this paper and comparing the sign and magnitude of the average disparity of selected matching points set at each layer. Experimental results on various stereoscopic video sequences show that the proposed method is a useful and efficient approach in detecting the pseudoscopic view stereo images.

[1]  Manlu Liu,et al.  Stereo Cameras Self-Calibration Based on SIFT , 2009, 2009 International Conference on Measuring Technology and Mechatronics Automation.

[2]  Liang Zhang,et al.  Stereoscopic image generation based on depth images for 3D TV , 2005, IEEE Transactions on Broadcasting.

[3]  Chanho Jung,et al.  Automatic segmentation of salient objects using iterative reversible graph cut , 2010, 2010 IEEE International Conference on Multimedia and Expo.

[4]  Makoto Okui,et al.  Real-Time Integral Imaging Based on Extremely High Resolution Video System , 2006, Proceedings of the IEEE.

[5]  Liqing Zhang,et al.  Saliency Detection: A Spectral Residual Approach , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Christian Hoffmann,et al.  Continuous Stereo Self-Calibration by Camera Parameter Tracking , 2009, IEEE Transactions on Image Processing.

[7]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[8]  Yuji Iwahori,et al.  Self-calibration and neural network implementation of photometric stereo , 2002, Object recognition supported by user interaction for service robots.

[9]  Jean Ponce,et al.  Accurate camera calibration from multi-view stereo and bundle adjustment , 2008, CVPR.

[10]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[11]  Andrew J. Woods,et al.  Image distortions in stereoscopic video systems , 1993, Electronic Imaging.

[12]  S. I. Granshaw,et al.  BUNDLE ADJUSTMENT METHODS IN ENGINEERING PHOTOGRAMMETRY , 2006 .

[13]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[14]  Jörn Ostermann,et al.  Extrinsic Calibration of a Stereo Camera System Using a 3D CAD Model Considering the Uncertainties of Estimated Feature Points , 2009, 2009 Conference for Visual Media Production.

[15]  Hanqing Lu,et al.  Saliency Cuts: An automatic approach to object segmentation , 2008, 2008 19th International Conference on Pattern Recognition.

[16]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.