EXPANSE: A novel narrative serious game for the behavioral assessment of cognitive abilities

EFs are a set of processes that supports many cognitive domains as goal setting, monitoring, planning, and cognitive-behavioural flexible control. Currently, many standardized paper-and-pencil tests or scales are used to assess EFs. These tests are easy to administer, score, and interpret but present some limitations in terms of generalizability of behaviours in real life. More recently, Information and Communication Technology has provided a higher ecological validity in the EFs assessment. In order to increase the ecological validity, we have developed a serious game (SG), named EXPANSE, which aim was to compare the participants’ game performance (latency times, and correct answers) with the results obtained in the traditional tasks and scales. 354 healthy subjects participated to the study and the findings showed significant correlations among standard tasks and the serious game. The exploratory nature of the present study, on one hand, highlighted that SG could be an additional behavioral tool to assess EFs and, on the other, we need further investigations, including clinical populations, for better defining the game sensitivity toward EF components. Finally, the results show that serious games are a promising technology for the evaluation of real cognitive behavior along with traditional evaluation.

[1]  L. Barker,et al.  The contribution of injury severity, executive and implicit functions to awareness of deficits after traumatic brain injury (TBI) , 2010, Journal of the International Neuropsychological Society.

[2]  Dan J Stein,et al.  Barriers to mental health treatment: results from the WHO World Mental Health surveys , 2013, Psychological Medicine.

[3]  David M Johnson,et al.  Introduction to and Review of Simulator Sickness Research , 2005 .

[4]  A. Diamond.  Executive functions. , 2014, Handbook of clinical neurology.

[5]  H. Christensen,et al.  Predictors of adherence among community users of a cognitive behavior therapy website , 2008, Patient preference and adherence.

[6]  M. Fillmore,et al.  Acute effects of cocaine in two models of inhibitory control: implications of non-linear dose effects. , 2006, Addiction.

[7]  Noomi Katz,et al.  Validation of the Virtual MET as an assessment tool for executive functions , 2009, Neuropsychological rehabilitation.

[8]  Stephen J. Westerman,et al.  Individual differences in human-computer interaction , 1993 .

[9]  D. Le Gall,et al.  Ecological approach of executive functions using the Behavioural Assessment of the Dysexecutive Syndrome for Children (BADS-C): Developmental and validity study , 2015, Journal of clinical and experimental neuropsychology.

[10]  M. Fillmore,et al.  The effect of image complexity on attentional bias towards alcohol-related images in adult drinkers. , 2010, Addiction.

[11]  G. Spitoni,et al.  An ecological approach to the behavioral assessment of executive functions in anorexia nervosa , 2018, Psychiatry Research.

[12]  R. Rubin,et al.  A New Measure of Cognitive Flexibility , 1995 .

[13]  P. Lang.  International affective picture system (IAPS) : affective ratings of pictures and instruction manual , 2005 .

[14]  Anya Andrews.  Serious Games for Psychological Health Education , 2011, HCI.

[15]  N. Pachana,et al.  Ecological validity in neuropsychological assessment: a case for greater consideration in research with neurologically intact populations. , 2006, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[16]  Giuseppe Riva,et al.  Virtual reality: an experiential tool for clinical psychology , 2009 .

[17]  Randall Shumaker.  Virtual and Mixed Reality - Systems and Applications - International Conference, Virtual and Mixed Reality 2011, Held as Part of HCI International 2011, Orlando, FL, USA, July 9-14, 2011, Proceedings, Part II , 2011, HCI.

[18]  Colleen Cheek,et al.  Integrating Health Behavior Theory and Design Elements in Serious Games , 2015, JMIR mental health.

[19]  Maureen Schmitter-Edgecombe,et al.  Improving the ecological validity of executive functioning assessment. , 2006, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[20]  Adele Diamond,et al.  Attention-deficit disorder (attention-deficit/ hyperactivity disorder without hyperactivity): A neurobiologically and behaviorally distinct disorder from attention-deficit/hyperactivity disorder (with hyperactivity) , 2005, Development and Psychopathology.

[21]  Donald T. Stuss,et al.  Executive functions and the frontal lobes: a conceptual view , 2000, Psychological research.

[22]  Xin-Ping Guan,et al.  Adaptive Formation Control of Cooperative Teleoperators With Intermittent Communications , 2019, IEEE Transactions on Cybernetics.

[23]  D. Derryberry,et al.  Anxiety-related attentional biases and their regulation by attentional control. , 2002, Journal of abnormal psychology.

[24]  J. Cummings,et al.  Executive Control Function , 2002 .

[25]  Paul W. Burgess,et al.  The Development of an Ecologically Valid Test for Assessing Patients with a Dysexecutive Syndrome , 1998 .

[26]  Gianluca Castelnuovo,et al.  Experience with V-STORE: Considerations on Presence in Virtual Environments for Effective Neuropsychological Rehabilitation of Executive Functions , 2003, Cyberpsychology Behav. Soc. Netw..

[27]  T. Shallice,et al.  Deficits in strategy application following frontal lobe damage in man. , 1991, Brain : a journal of neurology.

[28]  S. Folstein,et al.  "Mini-mental state". A practical method for grading the cognitive state of patients for the clinician. , 1975, Journal of psychiatric research.

[29]  M. Schmitter-Edgecombe,et al.  Applications of Technology in Neuropsychological Assessment , 2013, The Clinical neuropsychologist.

[30]  Colleen Cheek,et al.  Serious games for the treatment or prevention of depression: A systematic review , 2015 .

[31]  Paul Richard,et al.  Virtual reality and neuropsychological assessment: The reliability of a virtual kitchen to assess daily-life activities in victims of traumatic brain injury , 2016, Applied neuropsychology. Adult.

[32]  James M. Boyle,et al.  A systematic literature review of empirical evidence on computer games and serious games , 2012, Comput. Educ..

[33]  Evelyne Klinger,et al.  Use of the Virtual Action Planning Supermarket for the Diagnosis of Mild Cognitive Impairment , 2009, Dementia and Geriatric Cognitive Disorders.

[34]  Bruno Dubois,et al.  An Ecological Approach to Planning Dysfunction: Script Execution , 2000, Cortex.

[35]  Jonathan J. Evans,et al.  A real-life, ecologically valid test of executive functioning: The executive secretarial task , 2010, Journal of clinical and experimental neuropsychology.

[36]  L. Barker,et al.  Impaired Implicit Cognition with Intact Executive Function After Extensive Bilateral Prefrontal Pathology: A Case Study , 2004, Neurocase.

[37]  Muriel D. Lezak,et al.  The Problem of Assessing Executive Functions , 1982 .

[38]  M. Onofrj,et al.  Behavioural assessment of dysexecutive syndrome in Parkinson's disease without dementia: a comparison with other clinical executive tasks. , 2010, Parkinsonism & related disorders.

[39]  Maria Adler,et al.  Science and human behavior , 2017 .

[40]  N. Volkow,et al.  Drug addiction: the neurobiology of disrupted self-control. , 2006, Trends in molecular medicine.

[41]  Mathijs F. G. Lucassen,et al.  Serious Games and Gamification for Mental Health: Current Status and Promising Directions , 2017, Frontiers in psychiatry.

[42]  D. A. Grant,et al.  A behavioral analysis of degree of reinforcement and ease of shifting to new responses in a Weigl-type card-sorting problem. , 1948, Journal of experimental psychology.

[43]  H. Jackson,et al.  The assessment of executive functions: coming out of the office , 2004, Brain injury.

[44]  Albert A. Rizzo,et al.  Analysis of assets for virtual reality applications in neuropsychology , 2004 .

[45]  R. Reitan.  Validity of the Trail Making Test as an Indicator of Organic Brain Damage , 1958 .

[46]  N. Titov,et al.  Use of Virtual Reality Tasks to Assess Prospective Memory: Applicability and Evidence , 2009, Brain Impairment.

[47]  Paul W. Burgess,et al.  Behavioural Assessment of the Dysexecutive Syndrome , 1997 .

[48]  Peter McGeorge,et al.  Using Virtual Environments in the Assessment of Executive Dysfunction , 2001, Presence: Teleoperators & Virtual Environments.

[49]  N. Korner-Bitensky,et al.  Stroke-specific executive function assessment: a literature review of performance-based tools. , 2013, Australian occupational therapy journal.

[50]  J. Cummings,et al.  Executive control function: a review of its promise and challenges for clinical research. A report from the Committee on Research of the American Neuropsychiatric Association. , 2002, The Journal of neuropsychiatry and clinical neurosciences.

[51]  E. Barratt,et al.  Anxiety and Impulsiveness Related to Psychomotor Efficiency , 1959 .

[52]  T. Morrison,et al.  Inter-rater reliability of the Dysexecutive Questionnaire (DEX): Comparative data from non-clinician respondents—all raters are not equal , 2011, Brain injury.

[53]  T. Toulopoulou,et al.  Assessment of executive functions: review of instruments and identification of critical issues. , 2008, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[54]  J. Stroop.  Studies of interference in serial verbal reactions. , 1992 .

[55]  Albert A. Rizzo,et al.  Initial Validation of a Virtual Environment for Assessment of Memory Functioning: Virtual Reality Cognitive Performance Assessment Test , 2008, Cyberpsychology Behav. Soc. Netw..

[56]  R. Tannock,et al.  Behavioral and Brain Functions , 2006 .

[57]  R. Benoit,et al.  Mesulam's frontal lobe mystery re-examined. , 2009, Restorative neurology and neuroscience.

[58]  E. Klinger,et al.  A Virtual Supermarket to Assess Cognitive Planning , 2009 .

[59]  B. Sahakian,et al.  Distinct Profiles of Neurocognitive Function in Unmedicated Unipolar Depression and Bipolar II Depression , 2007, Biological Psychiatry.

[60]  L. Barker,et al.  Investigating the ‘latent’ deficit hypothesis: Age at time of head injury, implicit and executive functions and behavioral insight , 2010, Neuropsychologia.

[61]  David Huepe,et al.  From ancient Greece to the cognitive revolution: A comprehensive view of physical rehabilitation sciences , 2017, Physiotherapy theory and practice.

[62]  Darryl Charles,et al.  Optimising engagement for stroke rehabilitation using serious games , 2009, The Visual Computer.

[63]  T. Hennig-Thurau,et al.  Value Creation in the Video Game Industry: Industry Economics, Consumer Benefits, and Research Opportunities , 2013 .

[64]  Ralph E. Chatham,et al.  Games for training , 2007, CACM.

[65]  Nuray Aykin,et al.  Individual differences in human-computer interaction: a survey , 1991 .