Perceptual enhancement for stereoscopic videos based on horopter consistency

Audience discomfort, such as eye strain and dizziness, is one of the urgent issues that virtual reality and 3D movie technologies should tackle. Except for inappropriate horizontal and vertical disparity, one major problem is that people's binocular vergence and focal length in the cinema remain inconsistent from normal visual habits. Psychologists discovered the horopter and Panum's fusional area to describe zero-disparity points projected on the retinas based on accommodation-convergence consistency. In this paper, inspired by these concepts, we propose a stereoscopic effect correction system for perceptual enhancement according to fixated region and scene information. As a preprocessing step, tracking and stereo matching algorithms are implemented to prepare cues for further transformation in 3D space. Then in order to accomplish certain visual effects, we describe a geometric framework for disparity refinement and image warping based on parameter adjustment of the virtual stereoscopic rig. For evaluation, subjective experiments have been conducted to prove the effectiveness of our method. Therefore, our work provides a possibility to improve the audience experience from a formerly underexplored perspective.

[1]  Zdenek Kalal,et al.  Tracking-Learning-Detection , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Sebastian Thrun,et al.  A Noise‐aware Filter for Real‐time Depth Upsampling , 2008 .

[3]  Christel Chamaret,et al.  Adaptive 3D rendering based on region-of-interest , 2010, Electronic Imaging.

[4]  Andreas Geiger,et al.  Efficient Large-Scale Stereo Matching , 2010, ACCV.

[5]  Martin S. Banks,et al.  Misperceptions in stereoscopic displays: a vision science perspective , 2008, APGV '08.

[6]  Lifeng Sun,et al.  Cross-Scale Cost Aggregation for Stereo Matching , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Michael F. Cohen,et al.  A Viewer-Centric Editor for 3D Movies , 2011, IEEE Computer Graphics and Applications.

[8]  Hans-Peter Seidel,et al.  GazeStereo3D: seamless disparity manipulations , 2016, ACM Trans. Graph..

[9]  Barry Andersson The DSLR Filmmaker's Handbook: Real-World Production Techniques , 2012 .

[10]  Jessika Weiss,et al.  Vision Science Photons To Phenomenology , 2016 .

[11]  B. Julesz,et al.  Modifications of the Classical Notion of Panum's Fusional Area , 1980, Perception.