Investigation of the effect of three-dimensional smoothing on multiview stereo images

Future stereoscopic (3D) systems will become multiview capable to allow for the user to experience a more realistic 3D experience since they will not be limited to one view. This will help to make 3D technology more realistic, however, viewing discomfort will still be an issue. When viewing stereoscopic images, one cause of viewing discomfort can be attributed to the images appearing unnaturally sharp across the entire range of depth. To correct this problem for multiview images, a 3D filtering approach is proposed that will reduce the computation time required since the filter need only be applied once, whereas conventional 2D filtering techniques would be required to be performed 2n times (where n is the number of views). After conducting an initial experiment on 15 people, the proposed filter (on average) received similar ratings for discomfort and naturalness, when compared to the well established 2D bilateral filters. The benefit of this work is that it can provide an alternative method for filtering multiview images at a low cost, while obtaining similar results to bilateral filters, making it a useful filter for a wide range of future multiview stereo systems/applications.

[1]  Lifeng Sun,et al.  Generation of Layered Depth Images from Multi-View Video , 2007, 2007 IEEE International Conference on Image Processing.

[2]  Levent Onural Signal Processing and 3DTV [In the Spotlight] , 2010, IEEE Signal Processing Magazine.

[3]  S. Pastoor,et al.  Stereoscopic image representation with synthetic depth of field , 1997 .

[4]  Peter H. N. de With,et al.  Quality improving techniques for free-viewpoint DIBR , 2010, Electronic Imaging.

[5]  Shang-Hong Lai,et al.  Improved novel view synthesis from depth image with large baseline , 2008, 2008 19th International Conference on Pattern Recognition.

[6]  Mtm Marc Lambooij,et al.  Visual Discomfort and Visual Fatigue of Stereoscopic Displays: A Review , 2009 .

[7]  Richard Szeliski,et al.  Layered depth images , 1998, SIGGRAPH.

[8]  Yo-Sung Ho,et al.  Hole filling method using depth based in-painting for view synthesis in free viewpoint television and 3-D video , 2009, 2009 Picture Coding Symposium.

[9]  Richard Szeliski,et al.  High-quality video view interpolation using a layered representation , 2004, SIGGRAPH 2004.

[10]  Rafael C. González,et al.  Local Determination of a Moving Contrast Edge , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Chung-Hyun Ahn,et al.  Investigation on the effects of disparity-based asymmetrical filtering of stereoscopic video , 2003, Visual Communications and Image Processing.