An Analysis of Eye Scanpath Entropy in a Progressively Forming Virtual Environment

A sign of presence in virtual environments is that people respond to situations and events as if they were real, where response may be considered at many different levels, ranging from unconscious physiological responses through to overt behavior, emotions, and thoughts. In this paper we consider two responses that gave different indications of the onset of presence in a gradually forming environment. Two aspects of the response of people to an immersive virtual environment were recorded: their eye scanpath, and their skin conductance response (SCR). The scenario was formed over a period of 2 min, by introducing an increasing number of its polygons in random order in a head-tracked head-mounted display. For one group of experimental participants (n = 8) the environment formed into one in which they found themselves standing on top of a 3 m high column. For a second group of participants (n = 6) the environment was otherwise the same except that the column was only 1 cm high, so that they would be standing at normal ground level. For a third group of participants (n = 14) the polygons never formed into a meaningful environment. The participants who stood on top of the tall column exhibited a significant decrease in entropy of the eye scanpath and an increase in the number of SCR by 99 s into the scenario, at a time when only 65 of the polygons had been displayed. The ground level participants exhibited a similar decrease in scanpath entropy, but not the increase in SCR. The random scenario grouping did not exhibit this decrease in eye scanpath entropy. A drop in scanpath entropy indicates that the environment had cohered into a meaningful perception. An increase in the rate of SCR indicates the perception of an aversive stimulus. These results suggest that on these two dimensions (scanpath entropy and rate of SCR) participants were responding realistically to the scenario shown in the virtual environment. In addition, the response occurred well before the entire scenario had been displayed, suggesting that once a set of minimal cues exists within a scenario, it is enough to form a meaningful perception. Moreover, at the level of the sympathetic nervous system, the participants who were standing on top of the column exhibited arousal as if their experience might be real. This is an important practical aspect of the concept of presence.

[1]  Antonio Torralba,et al.  Contextual guidance of eye movements and attention in real-world scenes: the role of global features in object search. , 2006, Psychological review.

[2]  Frederick P. Brooks.  What's Real About Virtual Reality? , 1999, IEEE Computer Graphics and Applications.

[3]  Rl Gregory,et al.  Eye and brain, 5th edition , 1998 .

[4]  Jean Bragard,et al.  Analysis of physiological times series (ECG) , 2007 .

[5]  Robert S. Kennedy,et al.  Simulator Sickness Questionnaire: An enhanced method for quantifying simulator sickness. , 1993 .

[6]  Rajesh P. N. Rao,et al.  Eye movements in iconic visual search , 2002, Vision Research.

[7]  Katerina Mania,et al.  The effect of quality of rendering on user lighting impressions and presence in virtual environments , 2004, VRCAI '04.

[8]  M. Whitton,et al.  Effect of latency on presence in stressful virtual environments , 2003, IEEE Virtual Reality, 2003. Proceedings..

[9]  Michael Meehan,et al.  Physiological measures of presence in stressful virtual environments , 2002, SIGGRAPH.

[10]  Paul Zimmons,et al.  The influence of rendering quality on presence and task performance in a virtual environment , 2003, IEEE Virtual Reality, 2003. Proceedings..

[11]  J. Moran,et al.  Sensation and perception , 1980 .

[12]  Gerard Jounghyun Kim,et al.  A SWOT Analysis of the Field of Virtual Reality Rehabilitation and Therapy , 2005, Presence: Teleoperators & Virtual Environments.

[13]  A. L. I︠A︡rbus.  Eye Movements and Vision , 1967 .

[14]  S R Ellis,et al.  Statistical Dependency in Visual Scanning , 1986, Human factors.

[15]  RICHARD L. DIDDAY,et al.  Eye Movements and Visual Perception: A "Two Visual System" Model , 1975, Int. J. Man Mach. Stud..

[16]  Bruno Arnaldi,et al.  Real Handball Goalkeeper vs. Virtual Handball Thrower , 2003, Presence: Teleoperators & Virtual Environments.

[17]  D. Noton,et al.  Eye movements and visual perception. , 1971, Scientific American.

[18]  L. Brillouin,et al.  Science and information theory , 1956 .

[19]  Colin Ware,et al.  Visual Thinking for Design , 2008 .

[20]  Nancy Millette,et al.  How People Look at Pictures , 1935 .

[21]  Gert Pfurtscheller,et al.  Analysis of Physiological Responses to a Social Situation in an Immersive Virtual Environment , 2006, PRESENCE: Teleoperators and Virtual Environments.

[22]  M. Dawson,et al.  The electrodermal system , 2007 .

[23]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.

[24]  H. Ridley.  Eye and Brain , 1973 .

[25]  Thomas B. Sheridan,et al.  Musings on Telepresence and Virtual Presence , 1992, Presence: Teleoperators & Virtual Environments.

[26]  Mel Slater,et al.  How Colorful Was Your Day? Why Questionnaires Cannot Assess Presence in Virtual Environments , 2004, Presence: Teleoperators & Virtual Environments.

[27]  Russell M. Taylor,et al.  VRPN: a device-independent, network-transparent VR peripheral system , 2001, VRST '01.

[28]  R. Almond.  The therapeutic community. , 1971, Scientific American.

[29]  Gerard Jounghyun Kim,et al.  A SWOT Analysis of the Field of VR Rehabilitation and Therapy , 2004 .

[30]  Mel Slater,et al.  Presence and The Sixth Sense , 2002, Presence: Teleoperators & Virtual Environments.

[31]  J. Henderson.  Regarding Scenes , 2007 .

[32]  Lawrence W. Stark,et al.  How virtual reality works: illusions of vision in "real" and virtual environments , 1995, Electronic Imaging.

[33]  Mel Slater,et al.  A Virtual Presence Counter , 2000, Presence: Teleoperators & Virtual Environments.

[34]  Maria V. Sanchez-Vives,et al.  A Virtual Reprise of the Stanley Milgram Obedience Experiments , 2006, PloS one.

[35]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.

[36]  Laura Chamberlain.  Eye Tracking Methodology; Theory and Practice , 2007 .

[37]  Maria V. Sanchez-Vives,et al.  From presence to consciousness through virtual reality , 2005, Nature Reviews Neuroscience.