The PERSON project: a serious brain-computer interface game for treatment in cognitive impairment

The cognitive and computational neurosciences have developed neurorehabilitative tools able to treat suffering subjects from early symptoms, in order to give priority to a home environment. In this way, the curative treatment would not burden the hospital with excessive costs and the patient with psychological disorientation. Recent studies have shown the efficacy of video games on improving cognitive processes impaired by ageing’s physiological effect, neurodegenerative or other diseases, with potential beneficial effects. The PERvasive game for perSOnalized treatment of cognitive and functional deficits associated with chronic and Neurodegenerative diseases (PERSON) project proposed new tools for cognitive rehabilitation, aiming to improve the quality of life for patients with cognitive impairments, especially at early stages, by the use of sophisticated, non-invasive technology. This article is an overview of game solutions for training cognitive abilities and it presents the tools developed within the PERSON project. These tools are serious games based on virtual reality, connected to a brain-computer interface based on electroencephalography (EEG) and to haptic devices. The project was born thanks to a strategic synergy between research and public health, to implement a technology for personalized medicine that relies on the cloud infrastructure of the REte di CAlcolo per SuperB ed altre applicazioni (ReCaS)-Bari data centre. PERSON developed a completely open source and innovative framework to interface the game device with the computational resources in the cloud. We exploited the container technology and the Software as a Service (SaaS) paradigm to implement a genetic algorithm that analyses the neural responses in EEG recordings. The paper focuses on technical aspects of the designed tools. A test was conducted on a few volunteers for the purpose of tuning the overall system. The paper does not contain results of a clinical trial as this is planned in a second testing phase, when the user’s perception of the system will also be tested.

[1]  Gerwin Schalk,et al.  Prior Knowledge Improves Decoding of Finger Flexion from Electrocorticographic Signals , 2011, Front. Neurosci..

[2]  Michael Zyda,et al.  From visual simulation to virtual reality to games , 2005, Computer.

[3]  J. Polich,et al.  P300 and probability: comparison of oddball and single-stimulus paradigms. , 1997, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[4]  Marina Schmid,et al.  An Introduction To The Event Related Potential Technique , 2016 .

[5]  R. Armentano,et al.  An IoT approach for integration of computational intelligence and wearable sensors for Parkinson’s disease diagnosis and monitoring , 2016 .

[6]  G. Burdea,et al.  Feasibility study of the BrightBrainer™ integrative cognitive rehabilitation system for elderly with dementia , 2015, Disability and rehabilitation. Assistive technology.

[7]  Alberto L. Sangiovanni-Vincentelli,et al.  Designing a Cyber–Physical System for Fall Prevention by Cortico–Muscular Coupling Detection , 2016, IEEE Design & Test.

[8]  H. Levin.  A Compendium of Neuropsychological Tests: Administration, Norms, and Commentary , 1993 .

[9]  Michitaka Hirose,et al.  Brain-Computer Interfaces, Virtual Reality, and Videogames , 2008, Computer.

[10]  Nicola Amoroso,et al.  Deep learning reveals Alzheimer's disease onset in MCI subjects: Results from an international challenge , 2017, Journal of Neuroscience Methods.

[11]  Théodore Papadopoulo,et al.  Brain computer interface with the P300 speller: Usability for disabled people with amyotrophic lateral sclerosis. , 2018, Annals of physical and rehabilitation medicine.

[12]  Richard P. Heitz,et al.  An automated version of the operation span task , 2005, Behavior research methods.

[13]  S. Sakkiah,et al.  Identification of Inhibitor Binding Site in Human Sirtuin 2 Using Molecular Docking and Dynamics Simulations , 2013, PloS one.

[14]  Jaime Sánchez,et al.  Usability and Cognitive Impact of the Interaction with 3D Virtual Interactive Acoustic Environments by Blind Children , 2000 .

[15]  K. Krishnan,et al.  A Brain-Computer Interface Based Cognitive Training System for Healthy Elderly: A Randomized Control Pilot Study for Usability and Preliminary Efficacy , 2013, PloS one.

[16]  Bruno Vellas,et al.  Recommendations for the use of Serious Games in people with Alzheimer's Disease, related disorders and frailty , 2014, Front. Aging Neurosci..

[17]  Pilwon Hur,et al.  Synergistic Effects on the Elderly People's Motor Control by Wearable Skin-Stretch Device Combined with Haptic Joystick , 2017, Front. Neurorobot..

[18]  Bull,et al.  An Overview of Genetic Algorithms: Part 2, Research Topics , 1993 .

[19]  Sylvie Belleville,et al.  The Virtual Shop: A new immersive virtual reality environment and scenario for the assessment of everyday memory , 2018, Journal of Neuroscience Methods.

[20]  Christa Neuper,et al.  Rehabilitation with Brain-Computer Interface Systems , 2008, Computer.

[21]  Albert A. Rizzo,et al.  Virtual Reality in Brain Damage Rehabilitation: Review , 2005, Cyberpsychology Behav. Soc. Netw..

[22]  Joseph F. Coughlin,et al.  Impact of Virtual Reality (VR) Experience on Older Adults' Well-Being , 2018, HCI.

[23]  Alessandro Biamonti,et al.  Conceptual Design of Haptic-Feedback Navigation Device for Individuals with Alzheimer's Disease , 2015, AAATE Conf..

[24]  J. Trojanowski,et al.  Spreading of pathology in neurodegenerative diseases: a focus on human studies , 2015, Nature Reviews Neuroscience.

[25]  M. Prince,et al.  World Alzheimer report 2016: improving healthcare for people living with dementia: coverage, quality and costs now and in the future , 2016 .

[26]  Valerio De Luca,et al.  Haptic, Virtual Interaction and Motor Imagery: Entertainment Tools and Psychophysiological Testing , 2016, Sensors.

[27]  Elisa Pedroli,et al.  Technology and Cognitive Empowerment for Healthy Elderly: The Link between Cognitive Skills Acquisition and Well-Being , 2016 .

[28]  A Tateo,et al.  Hippocampal unified multi-atlas network (HUMAN): protocol and scale validation of a novel segmentation tool , 2015, Physics in medicine and biology.

[29]  G. Burdea.  Virtual Rehabilitation - Benefits and Challenges , 2003, Yearbook of Medical Informatics.

[30]  S Tangaro,et al.  Trial latencies estimation of event-related potentials in EEG by means of genetic algorithms , 2018, Journal of neural engineering.

[31]  Bo Jiang,et al.  Brain computer interface based 3D game for attention training and rehabilitation , 2011, 2011 6th IEEE Conference on Industrial Electronics and Applications.

[32]  G. Pfurtscheller,et al.  An SSVEP BCI to Control a Hand Orthosis for Persons With Tetraplegia , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[33]  Christian Mühl,et al.  Flaws in current human training protocols for spontaneous Brain-Computer Interfaces: lessons learned from instructional design , 2013, Front. Hum. Neurosci..

[34]  Matt C. Howard.  A meta-analysis and systematic literature review of virtual reality rehabilitation programs , 2017, Comput. Hum. Behav..

[35]  Simon McCallum,et al.  Gamification and Serious Games for Personalized Health , 2012, pHealth.

[36]  Kevin Polistico,et al.  Novel integrative virtual rehabilitation reduces symptomatology of primary progressive aphasia - a case report , 2015, The International journal of neuroscience.

[37]  Rajkumar Buyya,et al.  Cloud Computing Principles and Paradigms , 2011 .

[38]  Mateu Sbert,et al.  Serious Games for e-Health Care , 2014 .

[39]  Rebeca I. García-Betances,et al.  Using Virtual Reality for Cognitive Training of the Elderly , 2015, American journal of Alzheimer's disease and other dementias.

[40]  Steven M. LaValle,et al.  Virtual Reality , 2004, Heilberufe.

[41]  Harold E. Jones,et al.  The galvanic skin reflex as related to overt emotional expression. , 1935 .

[42]  Grigore C. Burdea,et al.  A review of integrative virtual reality games for rehabilitation , 2017, 2017 E-Health and Bioengineering Conference (EHB).

[43]  Daniela De Venuto,et al.  Brain-computer interface using P300: a gaming approach for neurocognitive impairment diagnosis , 2016, 2016 IEEE International High Level Design Validation and Test Workshop (HLDVT).

[44]  Ignacio Blanquer,et al.  INDIGO-Datacloud: foundations and architectural description of a Platform as a Service oriented to scientific computing , 2016, ArXiv.

[45]  G. McCarthy,et al.  Augmenting mental chronometry: the P300 as a measure of stimulus evaluation time. , 1977, Science.

[46]  Gareth J Waldron,et al.  Reducing safety-related drug attrition: the use of in vitro pharmacological profiling , 2012, Nature Reviews Drug Discovery.