Performance on naturalistic virtual reality tasks depends on global cognitive functioning as assessed via traditional neurocognitive tests

ABSTRACT This investigation sought to understand whether performance in naturalistic virtual reality tasks for cognitive assessment relates to the cognitive domains that are supposed to be measured. The Shoe Closet Test (SCT) was developed based on a simple visual search task involving attention skills, in which participants have to match each pair of shoes with the colors of the compartments in a virtual shoe closet. The interaction within the virtual environment was made using the Microsoft Kinect. The measures consisted of concurrent paper-and-pencil neurocognitive tests for global cognitive functioning, executive functions, attention, psychomotor ability, and the outcomes of the SCT. The results showed that the SCT correlated with global cognitive performance as measured with the Montreal Cognitive Assessment (MoCA). The SCT explained one third of the total variance of this test and revealed good sensitivity and specificity in discriminating scores below one standard deviation in this screening tool. These findings suggest that performance of such functional tasks involves a broad range of cognitive processes that are associated with global cognitive functioning and that may be difficult to isolate through paper-and-pencil neurocognitive tests.

[1]  R. Nebes,et al.  Patterns of Hand Preference in a Student Population , 1975, Cortex.

[2]  Corey J. Bohil,et al.  Virtual reality in neuroscience research and therapy , 2011, Nature Reviews Neuroscience.

[3]  C. Higginson,et al.  Functional cooking skills and neuropsychological functioning in patients with stroke: An ecological validity study , 2010, Neuropsychological rehabilitation.

[4]  J. Tirapu-Ustárroz,et al.  Evaluación neuropsicológica de las funciones ejecutivas mediante realidad virtual , 2014 .

[5]  T. Parsons.  Virtual Reality for Enhanced Ecological Validity and Experimental Control in the Clinical, Affective and Social Neurosciences , 2015, Front. Hum. Neurosci..

[6]  I. Santana,et al.  Montreal Cognitive Assessment (MoCA): Normative study for the Portuguese population , 2011, Journal of clinical and experimental neuropsychology.

[7]  Kasper Hornbæk,et al.  Measuring usability: are effectiveness, efficiency, and satisfaction really correlated? , 2000, CHI.

[8]  Katharina N. Seidl-Rathkopf,et al.  Automatic guidance of attention during real-world visual search , 2015, Attention, perception & psychophysics.

[9]  Martin Eimer,et al.  Qualitative differences in the guidance of attention during single-color and multiple-color visual search: behavioral and electrophysiological evidence. , 2013, Journal of experimental psychology. Human perception and performance.

[10]  J. McGrath.  Methodology matters: doing research in the behavioral and social sciences , 1995 .

[11]  T. Toulopoulou,et al.  Assessment of executive functions: review of instruments and identification of critical issues. , 2008, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[12]  Xinhao Xu,et al.  From psychomotor to ‘motorpsycho’: learning through gestures with body sensory technologies , 2014, Educational Technology Research and Development.

[13]  T. Parsons,et al.  The potential of function-led virtual environments for ecologically valid measures of executive function in experimental and clinical neuropsychology , 2017, Neuropsychological rehabilitation.

[14]  H B Gibson.  The Gibson Spiral Maze test: retest data in relation to behavioural disturbance, personality and physical measures. , 1969, British journal of psychology.

[15]  H. Markowitsch,et al.  Real-life memory and spatial navigation in patients with focal epilepsy: Ecological validity of a virtual reality supermarket task , 2014, Epilepsy & Behavior.

[16]  Andrea Gaggioli,et al.  A Virtual Reality Platform for Assessment and Rehabilitation of Neglect Using a Kinect , 2014, MMVR.

[17]  T. Kuroda,et al.  2013 7th International Conference on Pervasive Computing Technologies for Healthcare and Workshops Effect of a Kinect-based Exercise Game on Improving Executive Cognitive Performance in Community­ Dwelling Elderly , 2022 .

[18]  P. Gamito,et al.  Evaluation of Cognitive Functions through the Systemic Lisbon Battery: Normative Data , 2015, Methods of Information in Medicine.

[19]  Luciano Gamberini,et al.  Neuropsychological testing through a Nintendo Wii console. , 2010, Studies in health technology and informatics.

[20]  C. Higginson,et al.  The ecological validity of clinical tests of memory and attention in multiple sclerosis. , 2000, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[21]  J. Cummings,et al.  The Montreal Cognitive Assessment, MoCA: A Brief Screening Tool For Mild Cognitive Impairment , 2005, Journal of the American Geriatrics Society.

[22]  Evelyne Klinger,et al.  An exploration of the ecological validity of the Virtual Action Planning–Supermarket (VAP-S) with people with schizophrenia , 2018, Neuropsychological rehabilitation.

[23]  Pedro Gamito,et al.  Executive Functioning in Alcoholics Following an mHealth Cognitive Stimulation Program: Randomized Controlled Trial , 2014, Journal of medical Internet research.

[24]  R. Ruff.  A friendly critique of neuropsychology: facing the challenges of our future. , 2003, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[25]  D. Royall,et al.  The FAB: A frontal assessment battery at bedside , 2001, Neurology.

[26]  M. Schmitter-Edgecombe,et al.  Applications of Technology in Neuropsychological Assessment , 2013, The Clinical neuropsychologist.

[27]  C. Lima,et al.  The Frontal Assessment Battery (FAB) in Parkinson’s disease and correlations with formal measures of executive functioning , 2008, Journal of Neurology.

[28]  N. Silverberg,et al.  Impairment versus deficiency in neuropsychological assessment: Implications for ecological validity , 2009, Journal of the International Neuropsychological Society.