Augmented Reality Based on SLAM to Assess Spatial Short-Term Memory

Spatial short-term memory is defined as the limited ability of people to retain and remember the location of elements for short periods of time. In this paper, we present the first AR app based on SLAM (Simultaneous Localization and Mapping) to assess spatial short-term memory. A total of 55 participants were involved in a study for remembering the real place where four virtual objects were located in the real environment. The participants were divided into two groups: the ARGroup (the participants learned the location of the virtual objects in the real environment in an adaptation phase using AR) and the NoARGroup (the participants learned the location of the objects by looking at photographs). The results indicated that the performance outcomes in remembering objects and their location for the participants in the ARGroup were statistically significantly greater than those obtained by the participants in the NoARGroup. From this result and our observations, we can conclude that touring the augmented environment helped the participants to better remember the location of virtual objects added to the real scene compared to looking at photographs of the environment. Furthermore, statistically significant differences were not found in relation to gender or age. Finally, our app has several advantages: 1) Our app works in any environment and does not require adding real elements to the environment; 2) the evaluators can select any real environment and place the virtual elements where they want and even change them between sessions; and 3) our app could work similar to the way spatial memory does in everyday life.

[1]  Maria del Carmen Juan Lizandra,et al.  The effects of the size and weight of a mobile device on an educational game , 2013, Comput. Educ..

[2]  E. Pérez-Hernández,et al.  Learning in the navigational space: Age differences in a short-term memory for objects task , 2016 .

[3]  Magdalena Méndez-López,et al.  MnemoCity Task: Assessment of Childrens Spatial Memory Using Stereoscopy and Virtual Environments , 2016, PloS one.

[4]  Mihran Tuceryan,et al.  Distributed monocular visual SLAM as a basis for a collaborative augmented reality framework , 2018, Comput. Graph..

[5]  R. Kessels,et al.  The Corsi Block-Tapping Task: Standardization and Normative Data , 2000, Applied neuropsychology.

[6]  Roy A. Ruddle,et al.  The benefits of using a walking interface to navigate virtual environments , 2009, TCHI.

[7]  E. Pérez-Hernández,et al.  Augmented Reality for the Assessment of Children's Spatial Memory in Real Settings , 2014, PloS one.

[8]  Michael J. Singer,et al.  The Factor Structure of the Presence Questionnaire , 2005, Presence: Teleoperators & Virtual Environments.

[9]  Umair Rehman,et al.  Augmented Reality-Based Indoor Navigation Using Google Glass as a Wearable Head-Mounted Display , 2015, 2015 IEEE International Conference on Systems, Man, and Cybernetics.

[10]  Andrés-Marcelo Calle-Bustos,et al.  An augmented reality game to support therapeutic education for children with diabetes , 2017, PloS one.

[11]  Robert S. Astur,et al.  Spatial memory deficits in a virtual reality eight-arm radial maze in schizophrenia , 2012, Schizophrenia Research.

[12]  Hirokazu Kato,et al.  SlidAR: A 3D positioning method for SLAM-based handheld augmented reality , 2016, Comput. Graph..

[13]  Holger Regenbrecht,et al.  Measuring Presence in Augmented Reality Environments: Design and a First Test of a Questionnaire , 2021, ArXiv.

[14]  Doug A. Bowman,et al.  Virtual Reality: How Much Immersion Is Enough? , 2007, Computer.

[15]  Long Chen,et al.  SLAM-based dense surface reconstruction in monocular Minimally Invasive Surgery and its application to Augmented Reality , 2018, Comput. Methods Programs Biomed..

[16]  G. Lancioni,et al.  Intervention strategies for spatial orientation disorders in dementia: A selective review , 2014, Developmental neurorehabilitation.

[17]  Mel Slater,et al.  Depth of Presence in Virtual Environments , 1994, Presence: Teleoperators & Virtual Environments.

[18]  Shin-Dug Kim,et al.  Adaptive Monocular Visual–Inertial SLAM for Real-Time Augmented Reality Applications in Mobile Devices , 2017, Sensors.

[19]  E. Pérez-Hernández,et al.  A Virtual Object-Location Task for Children: Gender and Videogame Experience Influence Navigation; Age Impacts Memory and Completion Time , 2018, Front. Psychol..

[20]  Michael J. Singer,et al.  Measuring Presence in Virtual Environments: A Presence Questionnaire , 1998, Presence.

[21]  P. H. Miller,et al.  A developmental perspective on executive function. , 2010, Child development.

[22]  M. D’Esposito Working memory. , 2008, Handbook of clinical neurology.

[23]  Maria del Carmen Juan Lizandra,et al.  Using a Virtual Maze Task to Assess Spatial Short-term Memory in Adults , 2017, VISIGRAPP.

[24]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[25]  Alessandro O. Caffò,et al.  Besides navigation accuracy: Gender differences in strategy selection and level of spatial confidence , 2011 .

[26]  A. Barrett,et al.  Spatial cognitive rehabilitation and motor recovery after stroke. , 2014, Current opinion in neurology.

[27]  B. Ambridge,et al.  The structure of working memory from 4 to 15 years of age. , 2004, Developmental psychology.

[28]  Daniel O. David,et al.  Task difficulty of virtual reality-based assessment tools compared to classical paper-and-pencil or computerized measures: A meta-analytic approach , 2016, Comput. Hum. Behav..

[29]  Jorge Bacca,et al.  Augmented Reality Trends in Education: A Systematic Review of Research and Applications , 2014, J. Educ. Technol. Soc..

[30]  Tom Foulsham,et al.  Individual differences and personality correlates of navigational performance in the virtual route learning task , 2015, Comput. Hum. Behav..

[31]  Maria del Carmen Juan Lizandra,et al.  Evaluation of learning outcomes using an educational iPhone game vs. traditional game , 2013, Comput. Educ..

[32]  José Manuel Cimadevilla,et al.  Spatial memory alterations in children with epilepsy of genetic origin or unknown cause. , 2014, Epileptic disorders : international epilepsy journal with videotape.

[33]  José Manuel Cimadevilla,et al.  A new virtual task to evaluate human place learning , 2008, Behavioural Brain Research.

[34]  Pedro Gamito,et al.  The Immersive Virtual Reality Experience: A Typology of Users Revealed Through Multiple Correspondence Analysis Combined with Cluster Analysis Technique , 2016, Cyberpsychology Behav. Soc. Netw..

[35]  Hugh Durrant-Whyte,et al.  Simultaneous localization and mapping (SLAM): part II , 2006 .