Digitalization versus immersion: performance and subjective evaluation of 3D perception with emulated accommodation and parallax in digital microsurgery

Abstract. In the visually challenging situation of microsurgery with many altered depth cues, digitalization of surgical systems disrupts two further depth cues, namely focus and parallax. Although in purely optical surgical systems accommodation and eye movements induce expected focus and parallax changes, they become statically fixed through digitalization. Our study evaluates the impact of static focus and parallax onto performance and subjective 3D perception. Subjects reported decreased depth realism under static parallax and focus. Thus surgeons’ depth perception is impacted further through digitalization of microsurgery, increasing the potential of artificial stereo-induced fatigue.

[1]  Mtm Marc Lambooij,et al.  Visual Discomfort and Visual Fatigue of Stereoscopic Displays: A Review , 2009 .

[2]  Nick Holliman,et al.  Can the perception of depth in stereoscopic images be influenced by 3D sound? , 2011, Electronic Imaging.

[3]  James E. Cutting,et al.  Perceiving Layout and Knowing Distances , 1995 .

[4]  Liang Xu,et al.  Visual fatigue and discomfort after stereoscopic display viewing , 2013, Acta ophthalmologica.

[5]  David Kane,et al.  The rate of change of vergence–accommodation conflict affects visual discomfort , 2014, Vision Research.

[6]  Chris Chase,et al.  Accommodation response and visual discomfort , 2009, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[7]  M. Landy,et al.  Measurement and modeling of depth cue combination: in defense of weak fusion , 1995, Vision Research.

[8]  David M. Hoffman,et al.  Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. , 2008, Journal of vision.

[9]  Francisco José Madrid-Cuevas,et al.  Automatic generation and detection of highly reliable fiducial markers under occlusion , 2014, Pattern Recognit..

[10]  Peter A Howarth,et al.  Potential hazards of viewing 3‐D stereoscopic television, cinema and computer games: a review , 2011, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[11]  Michael S. Langer,et al.  Are blur and disparity complementary cues to depth? , 2015, Vision Research.

[12]  Mark Wexler,et al.  Depth perception by the active observer , 2005, Trends in Cognitive Sciences.

[13]  Thiago Santini,et al.  Non-intrusive practitioner pupil detection for unmodified microscope oculars , 2016, Comput. Biol. Medicine.

[14]  Marcus Barkowsky,et al.  How visual fatigue and discomfort impact 3D-TV quality of experience: a comprehensive review of technological, psychophysical, and psychological factors , 2013, annals of telecommunications - annales des télécommunications.

[15]  Robert S. Allison,et al.  Impact of depth of field simulation on visual fatigue: Who are impacted? and how? , 2016, Int. J. Hum. Comput. Stud..

[16]  B Knave,et al.  Investigation of visual strain experienced by microscope operators at an electronics plant. , 1983, Applied ergonomics.

[17]  Andrew J Parker,et al.  Vision in our three-dimensional world , 2016, Philosophical Transactions of the Royal Society B: Biological Sciences.

[18]  Wijnand A. IJsselsteijn,et al.  Visual discomfort of 3D TV: Assessment methods and modeling , 2011, Displays.

[19]  Masaki Emoto,et al.  Two factors in visual fatigue caused by stereoscopic HDTV images , 2004 .

[20]  Geoffrey P. Bingham,et al.  Optical flow from eye movement with head immobilized: “Ocular occlusion” beyond the nose , 1993, Vision Research.

[21]  Efstathios Stavrakis,et al.  The effects of fast disparity adjustment in gaze-controlled stereoscopic applications , 2014, ETRA.

[22]  Alan Godfrey,et al.  Viewing 3D TV over two months produces no discernible effects on balance, coordination or eyesight , 2016, Ergonomics.

[23]  Robert S. Allison,et al.  Gaze-contingent depth of field in realistic scenes: the user experience , 2014, ETRA.

[24]  M F Bradshaw,et al.  The Task-Dependent use of Binocular Disparity and Motion Parallax under Natural Viewing Conditions , 1997 .

[25]  Alexander Toet,et al.  Visual comfort of binocular and 3D displays , 2004 .

[26]  Martin S Banks,et al.  Visual discomfort with stereo 3D displays when the head is not upright , 2012, Electronic Imaging.

[27]  Philip J. Corriveau,et al.  Stereoscopic Viewing and Reported Perceived Immersion and Symptoms , 2012, Optometry and vision science : official publication of the American Academy of Optometry.

[28]  Masaki Emoto,et al.  Visual comfort/discomfort and visual fatigue caused by stereoscopic HDTV viewing , 2004, IS&T/SPIE Electronic Imaging.

[29]  M. Ernst,et al.  Focus cues affect perceived depth. , 2005, Journal of vision.

[30]  Walter J. Riker A Review of J , 2010 .

[31]  Wa Wijnand IJsselsteijn,et al.  Measuring visual fatigue and visual discomfort associated with 3‐D displays , 2010 .

[32]  Thiago Santini,et al.  EyeRecToo: Open-source Software for Real-time Pervasive Head-mounted Eye Tracking , 2017, VISIGRAPP.

[33]  Gregory Kramida,et al.  Resolving the Vergence-Accommodation Conflict in Head-Mounted Displays , 2016, IEEE Transactions on Visualization and Computer Graphics.

[34]  Chiuhsiang Joe Lin,et al.  Interaction and visual performance in stereoscopic displays: A review , 2015 .

[35]  Y. Yeh,et al.  Limits of Fusion and Depth Judgment in Stereoscopic Color Displays , 1990, Human factors.

[36]  S. Blackburn,et al.  Contrast as a depth cue , 1994, Vision Research.

[37]  Jenny C.A. Read,et al.  User experience while viewing stereoscopic 3D television , 2014, Ergonomics.

[38]  David M. Hoffman,et al.  The zone of comfort: Predicting visual discomfort with stereo displays. , 2011, Journal of vision.

[39]  Kwanghoon Sohn,et al.  Visual Fatigue Prediction for Stereoscopic Image , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[40]  Klaus-Peter Zimmer Optical designs for stereomicroscopes , 1998, Other Conferences.

[41]  G. Mather The Use of Image Blur as a Depth Cue , 1997, Perception.

[42]  Sumio Yano,et al.  Visual fatigue caused by stereoscopic images and the search for the requirement to prevent them: A review , 2012, Displays.

[43]  Guang-Zhong Yang,et al.  Assessment of Perceptual Quality for Gaze-Contingent Motion Stabilization in Robotic Assisted Minimally Invasive Surgery , 2007, MICCAI.

[44]  Manuela Chessa,et al.  Simulated disparity and peripheral blur interact during binocular fusion. , 2014, Journal of vision.

[45]  A. Bovik,et al.  3D visual discomfort predictor: analysis of horizontal disparity and neural activity statistics. , 2015, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[46]  Donald H. House,et al.  Measuring gaze depth with an eye tracker during stereoscopic display , 2011, APGV '11.