Are 3D virtual environments better than 2D interfaces in serious games performance? An explorative study for the assessment of executive functions

Abstract Executive functions refer to higher-order cognitive processes that supervise and guide goal-directed and adaptive behaviors in response to everyday situations. The traditional measures used to assess executive functions include paper-and-pencil tests and/or computerized tests that have been found to have a moderate level of ecological validity in predicting real-world performance. Serious games (SG) represent a novel methodological approach, allowing investigating subjects’ performance in real-simulated situations. Serious games are computer games whose primary purposes include investigating human behaviors and changes. Furthermore, SG can also vary according to the technology used and the interaction. Indeed, a SG can be rendered via a nonimmersive screen-based (2D) or via an immersive virtual reality game (3D). Starting from these premises, we compared a narrative-contextualized SG in 2D and 3D, correlating them with traditional tests. Findings showed different condition correlations with the traditional tasks and the comparison between the two systems have revealed that 3D is able to generate lower reaction times, higher correct answers, and lower perseverative responses in attentional abilities, inhibition control, and cognitive shifting than 2D condition. The present study yielded evidence on the use of more ecological tools to identify the functional cognitive status in real-simulated contexts along with traditional evaluation.

[1]  P. Lang International affective picture system (IAPS) : affective ratings of pictures and instruction manual , 2005 .

[2]  Erika Nyhus,et al.  The Wisconsin Card Sorting Test and the cognitive assessment of prefrontal executive functions: A critical update , 2009, Brain and Cognition.

[3]  Albert Rizzo,et al.  Virtual Reality as a Tool for Delivering PTSD Exposure Therapy and Stress Resilience Training , 2013 .

[4]  Bruno Dubois,et al.  An Ecological Approach to Planning Dysfunction: Script Execution , 2000, Cortex.

[5]  L. Barker,et al.  Impaired Implicit Cognition with Intact Executive Function After Extensive Bilateral Prefrontal Pathology: A Case Study , 2004, Neurocase.

[6]  E. Barratt,et al.  Anxiety and Impulsiveness Related to Psychomotor Efficiency , 1959 .

[7]  M. Schmitter-Edgecombe,et al.  The Ecological Validity of Neuropsychological Tests: A Review of the Literature on Everyday Cognitive Skills , 2003, Neuropsychology Review.

[8]  Schubert Foo,et al.  Effect of Exergames on Depression: A Systematic Review and Meta-Analysis , 2016, Cyberpsychology Behav. Soc. Netw..

[9]  ThengYin-Leng,et al.  Effect of Exergames on Depression: A Systematic Review and Meta-Analysis , 2016 .

[10]  R. Rubin,et al.  A New Measure of Cognitive Flexibility , 1995 .

[11]  P. Burgess,et al.  The case for the development and use of “ecologically valid” measures of executive function in experimental and clinical neuropsychology , 2006, Journal of the International Neuropsychological Society.

[12]  Elena Parra,et al.  EXPANSE: A novel narrative serious game for the behavioral assessment of cognitive abilities , 2018, PloS one.

[13]  Patrice L. (Tamar) Weiss,et al.  Evaluation of virtual shopping in the VMall: Comparison of post-stroke participants to healthy control groups , 2007, Disability and rehabilitation.

[14]  J. Stroop Studies of interference in serial verbal reactions. , 1992 .

[15]  M. Fillmore,et al.  Acute effects of cocaine in two models of inhibitory control: implications of non-linear dose effects. , 2006, Addiction.

[16]  Unai Díaz-Orueta,et al.  AULA virtual reality test as an attention measure: Convergent validity with Conners’ Continuous Performance Test , 2014, Child neuropsychology : a journal on normal and abnormal development in childhood and adolescence.

[17]  P. Nolin,et al.  Development and initial assessment of a new paradigm for assessing cognitive and motor inhibition: The bimodal virtual-reality Stroop , 2012, Journal of Neuroscience Methods.

[18]  J. McGonigal,et al.  Randomized Controlled Trial of SuperBetter, a Smartphone-Based/Internet-Based Self-Help Tool to Reduce Depressive Symptoms. , 2015, Games for health journal.

[19]  M. Schmitter-Edgecombe,et al.  Applications of Technology in Neuropsychological Assessment , 2013, The Clinical neuropsychologist.

[20]  Maureen Schmitter-Edgecombe,et al.  Improving the ecological validity of executive functioning assessment. , 2006, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[21]  U. Díaz-Orueta,et al.  AULA—Advanced Virtual Reality Tool for the Assessment of Attention , 2016, Journal of attention disorders.

[22]  D. Derryberry,et al.  Anxiety-related attentional biases and their regulation by attentional control. , 2002, Journal of abnormal psychology.

[23]  Gianluca Castelnuovo,et al.  Experience with V-STORE: Considerations on Presence in Virtual Environments for Effective Neuropsychological Rehabilitation of Executive Functions , 2003, Cyberpsychology Behav. Soc. Netw..

[24]  S. Folstein,et al.  "Mini-mental state". A practical method for grading the cognitive state of patients for the clinician. , 1975, Journal of psychiatric research.

[25]  Mel Slater,et al.  Depth of Presence in Virtual Environments , 1994, Presence: Teleoperators & Virtual Environments.

[26]  Alan D. Baddeley,et al.  The cognitive psychology of everyday life , 1981 .

[27]  D. A. Grant,et al.  A behavioral analysis of degree of reinforcement and ease of shifting to new responses in a Weigl-type card-sorting problem. , 1948, Journal of experimental psychology.

[28]  C. Hughes Executive function: development, individual differences and clinical insights , 2013 .

[29]  H. Jackson,et al.  The assessment of executive functions: coming out of the office , 2004, Brain injury.

[30]  D. Stuss,et al.  The involvement of orbitofrontal cerebrum in cognitive tasks , 1983, Neuropsychologia.

[31]  E. A. Attree,et al.  Probing Memory and Executive Functions with Virtual Reality: Past and Present Studies , 1998, Cyberpsychology Behav. Soc. Netw..

[32]  Mathijs F. G. Lucassen,et al.  Serious Games and Gamification for Mental Health: Current Status and Promising Directions , 2017, Frontiers in psychiatry.

[33]  Mathijs F. G. Lucassen,et al.  The effectiveness of SPARX, a computerised self help intervention for adolescents seeking help for depression: randomised controlled non-inferiority trial , 2012, BMJ : British Medical Journal.

[34]  James M. Boyle,et al.  A systematic literature review of empirical evidence on computer games and serious games , 2012, Comput. Educ..

[35]  James S. Elkind,et al.  A Simulated Reality Scenario Compared with the Computerized Wisconsin Card Sorting Test: An Analysis of Preliminary Results , 2001, Cyberpsychology Behav. Soc. Netw..

[36]  J. Galen Buckwalter,et al.  A Controlled Clinical Comparison of Attention Performance in Children with ADHD in a Virtual Reality Classroom Compared to Standard Neuropsychological Methods , 2007, Child neuropsychology : a journal on normal and abnormal development in childhood and adolescence.

[37]  M. Fillmore,et al.  The effect of image complexity on attentional bias towards alcohol-related images in adult drinkers. , 2010, Addiction.

[38]  Noomi Katz,et al.  Validation of the Virtual MET as an assessment tool for executive functions , 2009, Neuropsychological rehabilitation.

[39]  Albert Rizzo,et al.  Is Learning and Memory Different in a Virtual Environment? , 2007, The Clinical neuropsychologist.

[40]  Mel Slater,et al.  Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[41]  L Pugnetti,et al.  Evaluation and retraining of adults' cognitive impairment: which role for virtual reality technology? , 1995, Computers in biology and medicine.

[42]  R. Reitan Validity of the Trail Making Test as an Indicator of Organic Brain Damage , 1958 .

[43]  B. Richardson,et al.  The Ecological and Construct Validity of a Newly Developed Measure of Executive Function: The Virtual Library Task , 2012, Journal of the International Neuropsychological Society.

[44]  Donald T. Stuss,et al.  Executive functions and the frontal lobes: a conceptual view , 2000, Psychological research.

[45]  Colleen Cheek,et al.  Serious games for the treatment or prevention of depression: A systematic review , 2015 .