Perceptual Limits of Optical See-Through Visors for Augmented Reality Guidance of Manual Tasks

Objective: The focal length of available optical see-through (OST) head-mounted displays (HMDs) is at least 2 m; therefore, during manual tasks, the user eye cannot keep in focus both the virtual and real content at the same time. Another perceptual limitation is related to the vergence-accommodation conflict, the latter being present in binocular vision only. This paper investigates the effect of incorrect focus cues on the user performance, visual comfort, and workload during the execution of augmented reality (AR)-guided manual task with one of the most advanced OST HMD, the Microsoft HoloLens. Methods: An experimental study was designed to investigate the performance of 20 subjects in a connect-the-dots task, with and without the use of AR. The following tests were planned: AR-guided monocular and binocular, and naked-eye monocular and binocular. Each trial was analyzed to evaluate the accuracy in connecting dots. NASA Task Load Index and Likert questionnaires were used to assess the workload and the visual comfort. Results: No statistically significant differences were found in the workload, and in the perceived comfort between the AR-guided binocular and monocular test. User performances were significantly better during the naked eye tests. No statistically significant differences in performances were found in the monocular and binocular tests. The maximum error in AR tests was 5.9 mm. Conclusion: Even if there is a growing interest in using commercial OST HMD, for guiding high-precision manual tasks, attention should be paid to the limitations of the available technology not designed for the peripersonal space.

[1]  Fabrizio Cutolo,et al.  Perspective Preserving Solution for Quasi-Orthoscopic Video See-Through HMDs , 2018 .

[2]  Fabrizio Cutolo,et al.  Proof of Concept: Wearable Augmented Reality Video See-Through Display for Neuro-Endoscopy , 2018, AVR.

[3]  M Rosenfield,et al.  Blur sensitivity in myopes. , 1999, Optometry and vision science : official publication of the American Academy of Optometry.

[4]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[5]  M. Ernst,et al.  Focus cues affect perceived depth. , 2005, Journal of vision.

[6]  G Smith,et al.  Effect of Defocus on Blur Thresholds and on Thresholds of Perceived Change in Blur: Comparison of Source and Observer Methods , 1989, Optometry and vision science : official publication of the American Academy of Optometry.

[7]  Hong Hua,et al.  Design and Assessment of a Depth-Fused Multi-Focal-Plane Display Prototype , 2014, Journal of Display Technology.

[8]  Jens Grubert,et al.  A Survey of Calibration Methods for Optical See-Through Head-Mounted Displays , 2017, IEEE Transactions on Visualization and Computer Graphics.

[9]  Lucio Tommaso De Paolis,et al.  An Augmented Reality System for Maxillo-Facial Surgery , 2017, AVR.

[10]  Qiang Ling,et al.  Designing a Wearable Navigation System for Image-Guided Cancer Resection Surgery , 2014, Annals of Biomedical Engineering.

[11]  Bin Wang,et al.  Depth-of-focus of the human eye: theory and clinical implications. , 2006, Survey of ophthalmology.

[12]  Douglas Lanman,et al.  Near-eye light field displays , 2013, SIGGRAPH Emerging Technologies.

[13]  Bernard C. Kress,et al.  Optical architecture of HoloLens mixed reality headset , 2017, Other Conferences.

[14]  Henry Fuchs,et al.  Optical Versus Video See-Through Head-Mounted Displays in Medical Visualization , 2000, Presence: Teleoperators & Virtual Environments.

[15]  W N Charman,et al.  THE DEPTH‐OF‐FOCUS OF THE HUMAN EYE FOR SNELLEN LETTERS* , 1975, American journal of optometry and physiological optics.

[16]  Bahram Javidi,et al.  A 3D integral imaging optical see-through head-mounted display. , 2014, Optics express.

[17]  Stephen A. Benton.  Selected papers on three-dimensional displays , 2000 .

[18]  David M. Hoffman,et al.  Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. , 2008, Journal of vision.

[19]  E. Peli,et al.  The visual effects of head-mounted display (HMD) are not distinguishable from those of desk-top computer display , 1998, Vision Research.

[20]  Alessandro Rizzi,et al.  Assessing stereo blindness and stereo acuity on digital displays , 2014, Displays.

[21]  Sara Condino,et al.  How to Build a Patient-Specific Hybrid Simulator for Orthopaedic Open Surgery: Benefits and Limits of Mixed-Reality Using the Microsoft HoloLens , 2018, Journal of healthcare engineering.

[22]  Neil A. Dodgson,et al.  Three-Dimensional Displays: A Review and Applications Analysis , 2011, IEEE Transactions on Broadcasting.

[23]  O. Muensterer,et al.  Google Glass in pediatric surgery: an exploratory study. , 2014, International journal of surgery.

[24]  Robert Earl Patterson.  Human Factors of Stereoscopic 3D Displays , 2015, Springer London.

[25]  W. Charman.  The eye in focus: accommodation and presbyopia , 2008, Clinical & experimental optometry.

[26]  J. P. Rolland,et al.  Studies of depth judgments in a see-through head-mounted display , 1997 .

[27]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[28]  Erik Blaser,et al.  Retinal blur and the perception of egocentric distance. , 2010, Journal of vision.

[29]  Rosanna Maria Viglialoro,et al.  A Microsoft HoloLens Mixed Reality Surgical Simulator for Patient-Specific Hip Arthroplasty Training , 2018, AVR.

[30]  Henry Been-Lirn Duh,et al.  Trends in augmented reality tracking, interaction and display: A review of ten years of ISMAR , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[31]  Mark Mon-Williams,et al.  Natural problems for stereoscopic depth perception in virtual environments , 1995, Vision Research.

[32]  H. Davson.  Physiology of the Eye , 1951 .

[33]  Hong Hua.  Enabling Focus Cues in Head-Mounted Displays , 2017 .

[34]  ’ K.POWERS,et al.  DEPTH OF FOCUS, EYE SIZE AND VISUAL ACUITY , 2002 .

[35]  Ozan Cakmakci,et al.  The past, present, and future of head-mounted display designs , 2005, SPIE/COS Photonics Asia.

[36]  Hirokazu Kato,et al.  SharpView: Improved clarity of defocussed content on optical see-through head-mounted displays , 2016, 2016 IEEE Virtual Reality (VR).