Visibility analysis, spatial experience and EEG recordings in virtual reality environments: The experience of ‘knowing where one is’ and isovist properties as a means to assess the related brain activity

Virtual Reality environments in combination with brain activity recordings using electroencephalography (EEG) offer a fruitful method to investigate the emergence of specific experiential events in response to the built environment. However, real-world experimental settings involve dynamic and complex conditions which are difficult to be controlled in order to test specific hypothesis that are related to neurophysiology. We discuss here several factors that should be taking into account when designing ecological EEG experiments such as a reflective approach on the human spatial experience, consideration of first-person perspectives and a quantitative analysis of the spatial context. The focus of this paper is to propose a methodology that may facilitate the design of virtual reality EEG experiments that aim to investigate the human experience and cognition within and of the built environment. A pilot virtual reality case study is presented to illustrate how the experience of 'suddenly knowing where one is' could be approached. In this case the isovist measurements of area and revelation along participants' paths offer a useful 'tool' that allows us to isolate and study with further analysis of the EEG signal, the moment that this experience might be manifested as neuronal firing patterns in the human brain.

[1]  Beatrix Emo,et al.  Seeing the Axial Line: Evidence from Wayfinding Experiments , 2014, Behavioral sciences.

[2]  Hilde Haider,et al.  The route from implicit learning to verbal expression of what has been learned , 2003 .

[3]  N Burgess,et al.  Unilateral temporal lobectomy patients show lateralized topographical and episodic memory deficits in a virtual town. , 2001, Brain : a journal of neurology.

[4]  Diane J. Schiano,et al.  Perceptual and conceptual factors in distortions in memory for graphs and maps. , 1989, Journal of experimental psychology. General.

[5]  Eleanor A. Maguire,et al.  Thoughts, behaviour, and brain dynamics during navigation in the real world , 2006, NeuroImage.

[6]  R. Heuser Surprise, surprise , 2014, Catheterization and cardiovascular interventions : official journal of the Society for Cardiac Angiography & Interventions.

[7]  Jonathan W. Kelly,et al.  Integration of Spatial Relations across Perceptual Experiences , 2012, Spatial Cognition.

[8]  Simon J. Büchner,et al.  Gaze behaviour during space perception and spatial decision making , 2011, Psychological Research.

[9]  N. Dalton,et al.  Synergy, inteligibility and revelation in neighbourhood places , 2011 .

[10]  Beatrix Emo,et al.  Hippocampal and prefrontal processing of network topology to simulate the future , 2017, Nature Communications.

[11]  Heinrich H Bülthoff,et al.  Isovist Analysis Captures Properties of Space Relevant for Locomotion and Experience , 2007, Perception.

[12]  Alexander Klippel,et al.  Perceptually Induced Distortions in Cognitive Maps , 2004, Spatial Cognition.

[13]  A. Penn Space Syntax And Spatial Cognition , 2003 .

[14]  Ruth Dalton,et al.  Navigating Complex Buildings: Cognition, Neuroscience and Architectural Design , 2011 .

[15]  J. Wiener,et al.  ‘All the corridors are the same’: a qualitative study of the orientation experiences and design preferences of UK older adults living in a communal retirement development , 2017, Ageing and Society.

[16]  Bernhard Hommel,et al.  Action Related Determinants of Spatial Coding in Perception and Memory , 2000, Spatial Cognition.

[17]  Barbara Tversky,et al.  Cognitive Maps, Cognitive Collages, and Spatial Mental Models , 1993, COSIT.

[18]  Bernhard E. Riecke,et al.  Qualitative Modeling of Spatial Orientation Processes using Logical Propositions: Interconnecting Spatial Presence, Spatial Updating, Piloting, and Spatial Cognition , 2002 .

[19]  N. Burgess,et al.  Spatial memory: how egocentric and allocentric combine , 2006, Trends in Cognitive Sciences.

[20]  B. Tversky Distortions in memory for maps , 1981, Cognitive Psychology.

[21]  David C. Jangraw,et al.  NEDE: An open-source scripting suite for developing experiments in 3D virtual environments , 2014, Journal of Neuroscience Methods.

[22]  Karl J. Friston,et al.  Encoding uncertainty in the hippocampus , 2006, Neural Networks.

[23]  Jan M. Wiener,et al.  Exploring isovist-based correlates of spatial behavior and experience , 2005 .

[24]  Dennis Rünger,et al.  How incidental sequence learning creates reportable knowledge: the role of unexpected events. , 2008, Journal of experimental psychology. Learning, memory, and cognition.

[25]  C. Ratti,et al.  A Digital Image of the City : 3-D isovists and a tribute to Kevin Lynch , 2007 .

[26]  R. Knight,et al.  The Hippocampus and Entorhinal Cortex Encode the Path and Euclidean Distances to Goals during Navigation , 2014, Current Biology.