Quantification of adaptation to virtual-eye location in see-thru head-mounted displays

An experiment was conducted on the effect of a prototype see-thru head-mounted display (HMD) on visuo-motor adaptation. When wearing video see-thru HMDs in augmented reality systems, subjects see the world around them through a pair of head-mounted video cameras. The study looked at the effects of sensory rearrangement caused by a HMD design that displaces the user's "virtual" eye position forward (165 mm) and up (62 mm) toward the spatial position of the cameras. Measures of hand-eye coordination and speed on a manual task revealed substantial perceptual costs of the eye displacement, but also evidence of adaptation. Upon first wearing the video see-thru HMD, subjects' pointing errors increased significantly along the spatial dimensions displaced (the y and z dimensions). Speed of performance on a manual task decreased by 43% compared to baseline performance. Pointing accuracy improved by about a 1/3 as subjects adapted to the sensory rearrangement but did not reach baseline performance. When subjects removed the see-thru HMD there was evidence that their hand-eye coordination had been altered by the see-thru HMD. Negative aftereffects were observed in the form of greater errors in pointing accuracy compared to baseline. Although these effects are temporary, the results may have serious practical implications for the use of see-thru HMDs by user populations who depend on accurate hand-eye coordination such as surgeons.

[1]  I. Rock.  The nature of perceptual adaptation , 1969 .

[2]  BRENDAN O. MCGONIGLE,et al.  Long-term retention of single and multistate prismatic adaptation by humans , 1978, Nature.

[3]  Jannick P. Rolland,et al.  Video see-through design for merging of real and virtual environments , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[4]  Frank Biocca,et al.  Will Simulation Sickness Slow Down the Diffusion of Virtual Reality Technology , 1992 .

[5]  R. Welch.  Perceptual Modification: Adapting to Altered Sensory Environments , 1978 .

[6]  Justin G. Droessler,et al.  Tilted cat helmet-mounted display , 1990 .

[7]  S. Ellis.  Pictorial communication in virtual and real environments , 1991 .

[8]  Norman E. Lane,et al.  Profile Analysis of Simulator Sickness Symptoms: Application to Virtual Environment Systems , 1992, Presence: Teleoperators & Virtual Environments.

[9]  J T Reason,et al.  Motion Sickness Adaptation: A Neural Mismatch Model 1 , 1978, Journal of the Royal Society of Medicine.

[10]  Richard Held,et al.  Technique for Studying Adaptation to Disarranged Hand-Eye Coordination , 1958 .

[11]  Henry Fuchs,et al.  Comparison of optical and video see-through, head-mounted displays , 1995, Other Conferences.

[12]  C. S. Harris.  Perceptual adaptation to inverted, reversed, and displaced vision. , 1965, Psychological review.

[13]  A. Kornheiser.  Adaptation to laterally displaced vision: a review. , 1976, Psychological bulletin.

[14]  Michael Bajura,et al.  Merging Virtual Objects with the Real World , 1992 .

[15]  A. Kornheiser,et al.  Adaptation to laterally displaced vision: a review. , 1976, Psychological bulletin.

[16]  FuchsHenry,et al.  Merging virtual objects with the real world , 1992 .

[17]  B. Bridgeman,et al.  Alternating prism exposure causes dual adaptation and generalization to a novel displacement , 1993, Perception & psychophysics.

[18]  Jie. Yao,et al.  Model observers for predicting human performance on signal detection tasks. , 1994 .

[19]  C. Oman.  Sensory conflict in motion sickness: an Observer Theory approach , 1991 .

[20]  Ryutarou Ohbuchi,et al.  Merging virtual objects with the real world: seeing ultrasound imagery within the patient , 1992, SIGGRAPH.

[21]  Robert S. Kennedy,et al.  Guidelines for Alleviation of Simulator Sickness Symptomatology , 1987 .

[22]  Frank Biocca,et al.  Will Simulation Sickness Slow Down the Diffusion of Virtual Environment Technology? , 1992, Presence: Teleoperators & Virtual Environments.