Focus mismatch detection in stereoscopic content

Live-action stereoscopic content production requires a stereo rig with two cameras precisely matched and aligned. While most deviations from this perfect setup can be corrected either live or in post-production, a difference in the focus distance or focus range between the two cameras will lead to unrecoverable degradations of the stereoscopic footage. In this paper we detect focus mismatch between views of a stereoscopic pair in four steps. First, we compute a dense disparity map. Then, we use a measure to compare focus in both images. After this, we use robust statistics to find which images zones have a different focus. Finally, to give useful feedback, we show the results on the original images and give hints on how to solve the focus mismatch.

[1]  Richard W. Kroon.  3D A-to-Z , 2012 .

[2]  Yoav Y. Schechner,et al.  Depth from Defocus vs. Stereo: How Different Really Are They? , 2004, International Journal of Computer Vision.

[3]  Alex Pentland,et al.  A New Sense for Depth of Field , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Murali Subbarao,et al.  Depth from defocus: A spatial domain approach , 1994, International Journal of Computer Vision.

[5]  Murali Subbarao.  Parallel Depth Recovery By Changing Camera Parameters , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[6]  Stefano Soatto,et al.  Observing Shape from Defocused Images , 2004, International Journal of Computer Vision.

[7]  Shree K. Nayar,et al.  Shape from Focus , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Alexander Toet,et al.  Visual comfort of binocular and 3D displays , 2004 .

[9]  Zhongliang Jing,et al.  Evaluation of focus measures in multi-focus image fusion , 2007, Pattern Recognit. Lett..

[10]  W. Cathey,et al.  Defocus transfer function for circularly symmetric pupils. , 1997, Applied optics.

[11]  Huei-Yung Lin,et al.  Photo-Realistic Depth-of-Field Effects Synthesis Based on Real Camera Parameters , 2007, ISVC.

[12]  Stefano Soatto,et al.  Observing Shape from Defocused Images , 1999, Proceedings 10th International Conference on Image Analysis and Processing.

[13]  André Vincent,et al.  Human perception of mismatched stereoscopic 3D inputs , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[14]  Richard P. Wildes,et al.  Coarse-to-fine stereo vision with accurate 3D boundaries , 2010, Image Vis. Comput..

[15]  Subhasis Chaudhuri,et al.  Depth estimation and image restoration using defocused stereo pairs , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Wijnand A. IJsselsteijn,et al.  Perceived quality of compressed stereoscopic images: Effects of symmetric and asymmetric JPEG coding and camera separation , 2006, TAP.

[17]  Wa Wijnand IJsselsteijn,et al.  Visual discomfort in stereoscopic displays: a review , 2007, Electronic Imaging.