A Usability Study of a Serious Game in Cognitive Rehabilitation: A Compensatory Navigation Training in Acquired Brain Injury Patients

Acquired brain injury patients often report navigation impairments. A cognitive rehabilitation therapy has been designed in the form of a serious game. The aim of the serious game is to aid patients in the development of compensatory navigation strategies by providing exercises in 3D virtual environments on their home computers. The objective of this study was to assess the usability of three critical gaming attributes: movement control in 3D virtual environments, instruction modality and feedback timing. Thirty acquired brain injury patients performed three tasks in which objective measures of usability were obtained. Mouse controlled movement was compared to keyboard controlled movement in a navigation task. Text-based instructions were compared to video-based instructions in a knowledge acquisition task. The effect of feedback timing on performance and motivation was examined in a navigation training game. Subjective usability ratings of all design options were assessed using questionnaires. Results showed that mouse controlled interaction in 3D environments is more effective than keyboard controlled interaction. Patients clearly preferred video-based instructions over text-based instructions, even though video-based instructions were not more effective in context of knowledge acquisition and comprehension. No effect of feedback timing was found on performance and motivation in games designed to train navigation abilities. Overall appreciation of the serious game was positive. The results provide valuable insights in the design choices that facilitate the transfer of skills from serious games to real-life situations.

[1]  Lael J. Schooler,et al.  The Disruptive Potential of Immediate Feedback , 2008 .

[2]  Jessica Brown,et al.  Let the games begin: A preliminary study using Attention Process Training-3 and Lumosity™ brain games to remediate attention deficits following traumatic brain injury , 2013, Brain injury.

[3]  Gary B. Wills,et al.  A Conceptual Framework for Serious Games , 2009, 2009 Ninth IEEE International Conference on Advanced Learning Technologies.

[4]  Corey P. Carbonara,et al.  Controller Required? The Impact of Natural Mapping on Interactivity, Realism, Presence, and Enjoyment in Motion-Based Video Games , 2014, PRESENCE: Teleoperators and Virtual Environments.

[5]  P. Langhorne,et al.  Rehabilitation therapy services for stroke patients living at home: systematic review of randomised trials , 2004, The Lancet.

[6]  修希 渡邉.  第１回 Evidence-based Cognitive Rehabilitation：Updated Review of the Literature from 2003 Through 2008 , 2018 .

[7]  Anthony M. Limperos,et al.  Gaming Across Different Consoles: Exploring the Influence of Control Scheme on Game-Player Enjoyment , 2011, Cyberpsychology Behav. Soc. Netw..

[8]  Joanne Azulay,et al.  Evidence-based cognitive rehabilitation: updated review of the literature from 2003 through 2008. , 2011, Archives of physical medicine and rehabilitation.

[9]  Nicholas David Bowman,et al.  It's not the model that doesn't fit, it's the controller! The role of cognitive skills in understanding the links between natural mapping, performance, and enjoyment of console video games , 2015, Comput. Hum. Behav..

[10]  James E. Driskell,et al.  Games, Motivation, and Learning: A Research and Practice Model , 2002 .

[11]  Dong-Hee Shin,et al.  The effects of input modality and story-based knowledge on users' game experience , 2017, Comput. Hum. Behav..

[12]  L. Chan,et al.  Incidence, prevalence, costs, and impact on disability of common conditions requiring rehabilitation in the United States: stroke, spinal cord injury, traumatic brain injury, multiple sclerosis, osteoarthritis, rheumatoid arthritis, limb loss, and back pain. , 2014, Archives of physical medicine and rehabilitation.

[13]  Jelle Jolles,et al.  Occurrence and measurement of transfer in cognitive rehabilitation: A critical review. , 2007, Journal of rehabilitation medicine.

[14]  A. Betker,et al.  Video game-based exercises for balance rehabilitation: a single-subject design. , 2006, Archives of physical medicine and rehabilitation.

[15]  P A Hancock,et al.  The stress and workload of virtual reality training: the effects of presence, immersion and flow , 2016, Ergonomics.

[16]  S. Cassidy,et al.  Developing the Computer User Self-Efficacy (Cuse) Scale: Investigating the Relationship between Computer Self-Efficacy, Gender and Experience with Computers , 2002 .

[17]  Mark D'Esposito,et al.  Working memory impairments in traumatic brain injury: evidence from a dual-task paradigm , 1997, Neuropsychologia.

[18]  W. Katon,et al.  Psychiatric disorders and functional disability in outpatients with traumatic brain injuries. , 1995, The American journal of psychiatry.

[19]  Michiel H G Claessen,et al.  Neuropsychological Rehabilitation: An International , 2012 .

[20]  Mary Hegarty,et al.  When static media promote active learning: annotated illustrations versus narrated animations in multimedia instruction. , 2005, Journal of experimental psychology. Applied.

[21]  A. Postma,et al.  Is navigation ability a problem in mild stroke patients? Insights from self-reported navigation measures. , 2013, Journal of rehabilitation medicine.

[22]  R. Mayer,et al.  Nine Ways to Reduce Cognitive Load in Multimedia Learning , 2003 .

[23]  Sohaib Ghani,et al.  A therapy-driven gamification framework for hand rehabilitation , 2017, User Modeling and User-Adapted Interaction.

[24]  J. Giacino,et al.  Evidence-based cognitive rehabilitation: updated review of the literature from 1998 through 2002. , 2005, Archives of physical medicine and rehabilitation.

[25]  V. Shute.  Focus on Formative Feedback , 2008 .

[26]  Valerie K. Sims,et al.  Effects of input modality and expertise on workload and video game performance 2011 , 2018 .

[27]  Dick J. Veltman,et al.  Brain training improves recovery after stroke but waiting list improves equally: A multicenter randomized controlled trial of a computer-based cognitive flexibility training , 2017, PloS one.

[28]  Daniel A. Sternberg,et al.  The largest human cognitive performance dataset reveals insights into the effects of lifestyle factors and aging , 2013, Front. Hum. Neurosci..

[29]  Wouter Peeters,et al.  Epidemiology of traumatic brain injury in Europe , 2015, Acta Neurochirurgica.

[30]  Gary S. Nickell,et al.  The computer attitude scale , 1986 .

[31]  Yueh-Min Huang,et al.  A video annotation learning approach to improve the effects of video learning , 2018 .

[32]  C. Youngblut.  Experience of Presence in Virtual Environments , 2003 .

[33]  Eric Jamet,et al.  Digital game-based learning: Impact of instructions and feedback on motivation and learning effectiveness , 2013, Comput. Educ..

[34]  Bruce H Dobkin,et al.  New Evidence for Therapies in Stroke Rehabilitation , 2013, Current Atherosclerosis Reports.

[35]  H. Marsh,et al.  Development and Validation of a Scale to Measure Optimal Experience: The Flow State Scale , 1996 .

[36]  J. H. You,et al.  Effects of innovative virtual reality game and EMG biofeedback on neuromotor control in cerebral palsy. , 2014, Bio-medical materials and engineering.

[37]  Barrie Gunter,et al.  Sex, Presentation Mode and Memory for Violent and Non‐violent News , 1985 .

[38]  Juliette H. Walma van der Molen,et al.  Children's and Adults' Recall of Television and Print News in Children's and Adult News Formats , 2000, Commun. Res..

[39]  Chen-Lin C. Kulik,et al.  Timing of Feedback and Verbal Learning , 1988 .

[40]  F. Verhage.  Intelligentie en leeftijd : onderzoek bij Nederlanders van twaalf tot zevenenzeventig jaar , 1964 .

[41]  Peta Wyeth,et al.  Videogame control device impact on the play experience , 2012, IE '12.

[42]  Kirsten Adam,et al.  Reducing failures of working memory with performance feedback , 2015, Psychonomic bulletin & review.

[43]  S. Wolf,et al.  Repetitive Task Practice: A Critical Review of Constraint-Induced Movement Therapy in Stroke , 2002, The neurologist.

[44]  Dennis Charsky,et al.  From Edutainment to Serious Games: A Change in the Use of Game Characteristics , 2010, Games Cult..

[45]  David Pinelle,et al.  Heuristic evaluation for games: usability principles for video game design , 2008, CHI.

[46]  Katharina Stibrant Sunnerhagen,et al.  Virtual Rehabilitation after Stroke , 2008, MIE.

[47]  Shawn A. Weil,et al.  From Gaming to Training: A Review of Studies on Fidelity, Immersion, Presence, and Buy-in and Their Effects on Transfer in PC-Based Simulations and Games , 2005 .

[48]  B M Bly,et al.  Functional magnetic resonance imaging of working memory impairment after traumatic brain injury , 2001, Journal of neurology, neurosurgery, and psychiatry.

[49]  J. Giacino,et al.  Evidence-based cognitive rehabilitation: recommendations for clinical practice. , 2000, Archives of physical medicine and rehabilitation.