Attention-Aware Disparity Control in interactive environments

Our paper introduces a novel approach for controlling stereo camera parameters in interactive 3D environments in a way that specifically addresses the interplay of binocular depth perception and saliency of scene contents. Our proposed Dynamic Attention-Aware Disparity Control (DADC) method produces depth-rich stereo rendering that improves viewer comfort through joint optimization of stereo parameters. While constructing the optimization model, we consider the importance of scene elements, as well as their distance to the camera and the locus of attention on the display. Our method also optimizes the depth effect of a given scene by considering the individual user’s stereoscopic disparity range and comfortable viewing experience by controlling accommodation/convergence conflict. We validate our method in a formal user study that also reveals the advantages, such as superior quality and practical relevance, of considering our method.

[1]  Paul Milgram,et al.  Adaptation effects in stereo due to on-line changes in camera configuration , 1992, Electronic Imaging.

[2]  Yung-Yu Chuang,et al.  3D cinematography principles and their applications to stereoscopic media processing , 2011, ACM Multimedia.

[3]  Hans-Peter Seidel,et al.  A luminance-contrast-aware disparity model and applications , 2012, ACM Trans. Graph..

[4]  P. Kauff,et al.  STAN — An assistance system for 3D productions: From bad stereo to good stereo , 2011, 2011 14th ITG Conference on Electronic Media Technology.

[5]  Reinhard Klein,et al.  GPU‐based Collision Detection for Deformable Parameterized Surfaces , 2006, Comput. Graph. Forum.

[6]  Olga Sorkine-Hornung,et al.  Visual media retargeting , 2009, SIGGRAPH ASIA Courses.

[7]  Peter Kauff,et al.  Production Rules for Stereo Acquisition , 2011, Proceedings of the IEEE.

[8]  Markus H. Gross,et al.  OSCAM - optimized stereoscopic camera control for interactive 3D , 2011, ACM Trans. Graph..

[9]  Bernard Mendiburu,et al.  3D Movie Making: Stereoscopic Digital Cinema from Script to Screen , 2009 .

[10]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[11]  Martin Reddy,et al.  Perceptually Optimized 3D Graphics , 2001, IEEE Computer Graphics and Applications.

[12]  Graham R Jones,et al.  Controlling perceived depth in stereoscopic images , 2001, IS&T/SPIE Electronic Imaging.

[13]  Xin Yao,et al.  Stochastic ranking for constrained evolutionary optimization , 2000, IEEE Trans. Evol. Comput..

[14]  Michael F. Cohen,et al.  A Viewer-Centric Editor for 3D Movies , 2011, IEEE Computer Graphics and Applications.

[15]  Aljoscha Smolic,et al.  Nonlinear disparity mapping for stereoscopic 3D , 2010, ACM Trans. Graph..

[16]  Subjective methods for the assessment of stereoscopic 3DTV systems , 2015 .

[17]  Daniel Cohen-Or,et al.  Semi-automatic stereo extraction from video footage , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[18]  Aljoscha Smolic,et al.  Computational stereo camera system with programmable control loop , 2011, ACM Trans. Graph..

[19]  I. Howard,et al.  Seeing in depth, Vol. 2: Depth perception. , 2002 .

[20]  Ian P. Howard,et al.  Seeing in Depth , 2008 .

[21]  Hans-Peter Seidel,et al.  A perceptual model for disparity , 2011, ACM Trans. Graph..