Virtual navigation tested on a mobile app is predictive of real-world wayfinding navigation performance

Virtual reality environments presented on tablets and smartphones have potential to aid the early diagnosis of conditions such as Alzheimer’s dementia by quantifying impairments in navigation performance. However, it is unclear whether performance on mobile devices can predict navigation errors in the real world. We compared the performance of 49 participants (25 females, 18-35 years old) at wayfinding and path integration tasks designed in our mobile app ‘Sea Hero Quest’ with their performance at similar tasks in a real-world environment. We first performed this experiment in the streets of London (UK) and replicated it in Paris (France). In both cities, we found a significant correlation between virtual and real-world wayfinding performance and a male advantage in both environments, although smaller in the real world (Cohen’s d in the game = 0.89, in the real world = 0.59). Results in London and Paris were highly similar, and controlling for familiarity with video games did not change the results. The strength of the correlation between real world and virtual environment increased with the difficulty of the virtual wayfinding task, indicating that Sea Hero Quest does not merely capture video gaming skills. The fact that the Sea Hero Quest wayfinding task has real-world ecological validity constitutes a step toward controllable, sensitive, safe, low-cost, and easy to administer digital cognitive assessment of navigation ability.

[1]  Russell A. Epstein,et al.  The cognitive map in humans: spatial navigation and beyond , 2017, Nature Neuroscience.

[2]  Francesca Pazzaglia,et al.  Relationship between spatial ability, visuospatial working memory and self-assessed spatial orientation ability: a study in older adults , 2015, Cognitive Processing.

[3]  S. Moffat,et al.  Navigation in a “Virtual” Maze: Sex Differences and Correlation With Psychometric Measures of Spatial Ability in Humans , 1998 .

[4]  S. Fabrikant,et al.  Virtual environments as memory training devices in navigational tasks for older adults , 2018, Scientific Reports.

[5]  R. Klatzky,et al.  Nonvisual navigation by blind and sighted: assessment of path integration ability. , 1993, Journal of experimental psychology. General.

[6]  Simon J Graham,et al.  Age and dementia related differences in spatial navigation within an immersive virtual environment. , 2009, Medical science monitor : international medical journal of experimental and clinical research.

[7]  H. Spiers,et al.  Global determinants of navigation ability , 2017 .

[8]  R. Astur,et al.  Sex differences and correlations in a virtual Morris water task, a virtual radial arm maze, and mental rotation , 2004, Behavioural Brain Research.

[9]  Richard S. J. Frackowiak,et al.  Knowing where and getting there: a human navigation network. , 1998, Science.

[10]  Michael Hornberger,et al.  Egocentric versus Allocentric Spatial Memory in Behavioral Variant Frontotemporal Dementia and Alzheimer's Disease. , 2017, Journal of Alzheimer's disease : JAD.

[11]  E. Cashdan,et al.  Spatial cognition, mobility, and reproductive success in northwestern Namibia , 2015 .

[12]  E. Olivier,et al.  Pupil size variations correlate with physical effort perception , 2014, Front. Behav. Neurosci..

[13]  Michiel H G Claessen,et al.  A Direct Comparison of Real-World and Virtual Navigation Performance in Chronic Stroke Patients , 2016, Journal of the International Neuropsychological Society.

[14]  A. Wunderlich,et al.  Brain activation during human navigation: gender-different neural networks as substrate of performance , 2000, Nature Neuroscience.

[15]  G. Andersson,et al.  Mobile technology for mental health assessment , 2016, Dialogues in clinical neuroscience.

[16]  M. van der Schoot,et al.  The developmental onset of symbolic approximation: beyond nonsymbolic representations, the language of numbers matters , 2015, Front. Psychol..

[17]  André Dufour,et al.  Spatial navigation in normal aging and the prodromal stage of Alzheimer's disease: Insights from imaging and behavioral studies , 2013, Ageing Research Reviews.

[18]  Rand R. Wilcox,et al.  Inferences Based on a Skipped Correlation Coefficient , 2004 .

[19]  Ruth Alison Conroy-Dalton,et al.  Spatial navigation in immersive virtual environments , 2001 .

[20]  David L. Stern,et al.  Correlated Evolution of Two Copulatory Organs via a Single cis-Regulatory Nucleotide Change , 2018, Current Biology.

[21]  Jan Laczó,et al.  Behavioral Neuroscience Mini Review Article Neural Correlates of Spatial Navigation Changes in Mild Cognitive Impairment and Alzheimer's Disease , 2022 .

[22]  J. C. Malinowski,et al.  INDIVIDUAL DIFFERENCES IN PERFORMANCE ON A LARGE-SCALE, REAL-WORLD WAYFINDING TASK , 2001 .

[23]  Ariane S Etienne,et al.  Path integration in mammals , 2004, Hippocampus.

[24]  É. Sorita,et al.  Do patients with traumatic brain injury learn a route in the same way in real and virtual environments? , 2013, Disability and rehabilitation.

[25]  Ewout H. Meijer,et al.  Detecting Concealed Information from Groups Using a Dynamic Questioning Approach: Simultaneous Skin Conductance Measurement and Immediate Feedback , 2013, Front. Psychology.

[26]  Thomas Wolbers,et al.  Ageing effects on path integration and landmark navigation , 2012, Hippocampus.

[27]  Dar Dowlatshahi,et al.  RecoverNow: Feasibility of a Mobile Tablet-Based Rehabilitation Intervention to Treat Post-Stroke Communication Deficits in the Acute Care Setting , 2016, PloS one.

[28]  Charles J Duffy,et al.  Detecting navigational deficits in cognitive aging and Alzheimer disease using virtual reality , 2008, Neurology.

[29]  Christoph Hölscher,et al.  Taxonomy of Human Wayfinding Tasks: A Knowledge-Based Approach , 2009, Spatial Cogn. Comput..

[30]  Elizabeth A. Yost,et al.  Getting Grandma Online: Are Tablets the Answer for Increasing Digital Inclusion for Older Adults in the U.S.? , 2015, Educational gerontology.

[31]  Guillaume A Rousselet,et al.  A Guide to Robust Statistical Methods in Neuroscience , 2017, bioRxiv.

[32]  E. Maguire,et al.  Neurodevelopmental Aspects of Spatial Navigation: A Virtual Reality fMRI Study , 2002, NeuroImage.

[33]  Andrew J. Saykin,et al.  Spatial patterns of neuroimaging biomarker change in individuals from families with autosomal dominant Alzheimer disease: a longitudinal study , 2018, The Lancet Neurology.

[34]  C. Sotozono,et al.  Involvement of anterior and posterior corneal surface area imbalance in the pathological change of keratoconus , 2018, Scientific Reports.

[35]  É. Sorita,et al.  The contribution of virtual reality to the diagnosis of spatial navigation disorders and to the study of the role of navigational aids: A systematic literature review. , 2017, Annals of physical and rehabilitation medicine.

[36]  Giuseppe Riva,et al.  Getting lost in Alzheimer's disease: a break in the mental frame syncing. , 2013, Medical hypotheses.

[37]  Ronald W. Skelton,et al.  Virtual environment navigation tasks and the assessment of cognitive deficits in individuals with brain injury , 2007, Behavioural Brain Research.

[38]  Dylan M. Jones,et al.  Navigating Buildings in "Desk-Top" Virtual Environments: Experimental Investigations Using Extended Navigational Experience , 1997 .

[39]  Tim Wright,et al.  An investigation of the validity of the virtual spatial navigation assessment , 2013, Front. Psychol..

[40]  Peter König,et al.  Cultural background shapes spatial reference frame proclivity , 2015, Scientific Reports.

[41]  K. Varady,et al.  Corrigendum: Effects of weight loss via high fat vs. low fat alternate day fasting diets on free fatty acid profiles , 2015, Scientific Reports.

[42]  Kai Ruggeri,et al.  Are We There Yet? Exploring the Impact of Translating Cognitive Tests for Dementia Using Mobile Technology in an Aging Population , 2016, Front. Aging Neurosci..

[43]  Johannes Naumann,et al.  Effects of linear reading, basic computer skills, evaluating online information, and navigation on reading digital text , 2016, Comput. Hum. Behav..

[44]  Anthony E. Richardson,et al.  Video game experience predicts virtual, but not real navigation performance , 2011, Comput. Hum. Behav..

[45]  John H. Bailey,et al.  Virtual spaces and real world places: transfer of route knowledge , 1996, Int. J. Hum. Comput. Stud..

[46]  Mary Hegarty,et al.  What determines our navigational abilities? , 2010, Trends in Cognitive Sciences.

[47]  H. Spiers,et al.  Impact of Sex and APOE Status on Spatial Navigation in Pre-symptomatic Alzheimer’s disease , 2018, bioRxiv.

[48]  Hugo J. Spiers,et al.  Human Spatial Navigation , 2018 .

[49]  Guillaume A. Rousselet,et al.  Robust Correlation Analyses: False Positive and Power Validation Using a New Open Source Matlab Toolbox , 2012, Front. Psychology.

[50]  S. Resnick,et al.  Age differences in spatial memory in a virtual environment navigation task , 2001, Neurobiology of Aging.

[51]  R. Goebel,et al.  Local Discriminability Determines the Strength of Holistic Processing for Faces in the Fusiform Face Area , 2013, Front. Psychology.

[52]  Jakub Hort,et al.  Spatial navigation deficits — overlooked cognitive marker for preclinical Alzheimer disease? , 2018, Nature Reviews Neurology.

[53]  J. Hodges,et al.  Lost in spatial translation – A novel tool to objectively assess spatial disorientation in Alzheimer's disease and frontotemporal dementia , 2015, Cortex.

[54]  Maarten Löffler,et al.  Ecological validity of virtual environments to assess human navigation ability , 2015, Front. Psychol..

[55]  Arne D. Ekstrom,et al.  Perspective: Assessing the Flexible Acquisition, Integration, and Deployment of Human Spatial Representations and Information , 2018, Front. Hum. Neurosci..

[56]  Anthony E. Richardson,et al.  Spatial knowledge acquisition from maps and from navigation in real and virtual environments , 1999, Memory & cognition.