Spatial memory training in a citizen science context

Memory deficit is one of the primary effects of intellectual disability, and has a great impact on daily life. Here, we propose a novel spatial memory training system based on a citizen science virtual environment, in which users navigate an aquatic robot in a polluted canal and identify specific objects from images acquired by the robot. A portable low-cost electroencephalography device is utilized to enhance the degree of interactivity and enable real-time estimation of the affective state of the user. We involved a cohort of 60 healthy adult subjects to evaluate users' interest, memory performance, and affective variables as a function of navigation modality (active versus passive) and interface (a traditional computer mouse versus the headset). Despite offering a higher level of difficulty, the headset was preferred over a traditional mouse control by the users, whose spatial memory performance did not vary with the navigation modality or the interface. Active navigation was found to lead to a higher level of engagement, as measured by the headset. These findings suggest the possibility of a new, effective, and entertaining form of intellectual rehabilitation with potential impact on fetal alcohol syndrome. We present a spatial memory training system using a low-cost EEG headset.The system is constructed around an environmental citizen science project.A group of healthy adults evaluated the system as highly engaging and entertaining.The headset was preferred to a traditional computer mouse.A higher engagement was attained during active navigation tasks.

[1]  Subhabrata Chakraborti,et al.  Nonparametric Statistical Inference , 2011, International Encyclopedia of Statistical Science.

[2]  David B. Kaber,et al.  Emotional State Classification in Patient–Robot Interaction Using Wavelet Analysis and Statistics-Based Feature Selection , 2013, IEEE Transactions on Human-Machine Systems.

[3]  Christian Mühl,et al.  Valence, arousal and dominance in the EEG during game play , 2013, Int. J. Auton. Adapt. Commun. Syst..

[4]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces , 2007, Journal of neural engineering.

[5]  E. A. Attree,et al.  A preliminary investigation into the use of virtual environments in memory retraining after vascular brain injury: indications for future strategy? , 1999, Disability and rehabilitation.

[6]  Yantao Shen,et al.  Measurement and analysis of braille stimulus to brain using an EEG: A preliminary study , 2013, 2013 IEEE International Conference on Cyber Technology in Automation, Control and Intelligent Systems.

[7]  David P. Anderson,et al.  Scientists@Home: What Drives the Quantity and Quality of Online Citizen Science Participation? , 2014, PloS one.

[8]  Carson Jonathan Reynolds,et al.  The sensing and measurement of frustration with computers , 2001 .

[9]  Ghada Al-Hudhud Affective command-based control system integrating brain signals in commands control systems , 2014, Comput. Hum. Behav..

[10]  Regan L. Mandryk,et al.  Games as neurofeedback training for children with FASD , 2013, IDC.

[11]  R. Mayer,et al.  Nine Ways to Reduce Cognitive Load in Multimedia Learning , 2003 .

[12]  David W. Smith,et al.  The fetal alcohol syndrome. , 1978, The Lamp.

[13]  Albert A. Rizzo,et al.  The Virtual Classroom: A Virtual Reality Environment for the Assessment and Rehabilitation of Attention Deficits , 2000, Cyberpsychology Behav. Soc. Netw..

[14]  Bruce Gooch,et al.  Cognitive games as therapy for children with FAS , 2010, SIGGRAPH '10.

[15]  Patrick Péruch,et al.  Acquisition of Spatial Knowledge Through Visual Exploration of Simulated Environments , 1995 .

[16]  Juan E. Gilbert,et al.  Let's learn!: enhancing user's engagement levels through passive brain-computer interfaces , 2013, CHI Extended Abstracts.

[17]  C. Gianoulakis,et al.  Rats exposed prenatally to alcohol exhibit impairment in spatial navigation test , 1990, Behavioural Brain Research.

[18]  G. Handelmann,et al.  Hippocampus, space, and memory , 1979 .

[19]  Julien Penders,et al.  Wearable, Wireless EEG Solutions in Daily Life Applications: What are we Missing? , 2015, IEEE Journal of Biomedical and Health Informatics.

[20]  Olga Sourina,et al.  EEG-enabled Affective Human-Computer Interfaces , 2014, HCI.

[21]  Timothy T. Baldwin,et al.  TRANSFER OF TRAINING: A REVIEW AND DIRECTIONS FOR FUTURE RESEARCH , 1988 .

[22]  Susanne M. Jaeggi,et al.  Improving fluid intelligence with training on working memory: a meta-analysis , 2008, Psychonomic Bulletin & Review.

[23]  J. Gregory Trafton,et al.  Dynamic Operator Overload: A Model for Predicting Workload During Supervisory Control , 2014, IEEE Transactions on Human-Machine Systems.

[24]  V. A. Ponomarev,et al.  EEG-Biocontrol Method in Treating the Attention Deficit Hyperactivity Disorder in Children , 2001, Human Physiology.

[25]  Rebecca Shaw,et al.  Inhibition, ADHD, and Computer Games: The Inhibitory Performance of Children with ADHD on Computerized Tasks and Games , 2005, Journal of attention disorders.

[26]  C. Tifft,et al.  Fetal alcohol syndrome. , 2001, Pediatrics in review.

[27]  Albert A. Rizzo,et al.  Virtual Reality in Brain Damage Rehabilitation: Review , 2005, Cyberpsychology Behav. Soc. Netw..

[28]  J. Silvertown A new dawn for citizen science. , 2009, Trends in ecology & evolution.

[29]  B. Duchaine,et al.  The Cambridge Car Memory Test: A task matched in format to the Cambridge Face Memory Test, with norms, reliability, sex differences, dissociations from face memory, and expertise effects , 2012, Behavior research methods.

[30]  Matt Lang,et al.  Investigating the Emotiv EPOC for cognitive control in limited training time , 2012 .

[31]  Christian Burgers,et al.  How feedback boosts motivation and play in a brain-training game , 2015, Comput. Hum. Behav..

[32]  Oded Nov,et al.  A natural user interface to integrate citizen science and physical exercise , 2017, PloS one.

[33]  E. Maguire,et al.  Knowing Where Things Are: Parahippocampal Involvement in Encoding Object Locations in Virtual Large-Scale Space , 1998, Journal of Cognitive Neuroscience.

[34]  Jonathan Klein,et al.  Frustrating the user on purpose: a step toward building an affective computer , 2002, Interact. Comput..

[35]  M. Pett Nonparametric Statistics for Health Care Research: Statistics for Small Samples and Unusual Distributions , 1997 .

[36]  R. Golledge Wayfinding Behavior: Cognitive Mapping and Other Spatial Processes , 2010 .

[37]  Oded Nov,et al.  Activating social strategies: Face-to-face interaction in technology-mediated citizen science. , 2016, Journal of environmental management.

[38]  W. Klimesch EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis , 1999, Brain Research Reviews.

[39]  Sarah N. Mattson,et al.  Fetal Alcohol Spectrum Disorders: Neuropsychological and Behavioral Features , 2011, Neuropsychology Review.

[40]  Martin H. Teicher,et al.  Objective measurement of hyperactivity and attentional problems in ADHD. , 1996, Journal of the American Academy of Child and Adolescent Psychiatry.

[41]  R J Sokol,et al.  Incidence of fetal alcohol syndrome and economic impact of FAS-related anomalies. , 1987, Drug and alcohol dependence.

[42]  Neal J. Cohen,et al.  Hippocampal brain-network coordination during volitional exploratory behavior enhances learning , 2010, Nature Neuroscience.

[43]  R. Morris Spatial Localization Does Not Require the Presence of Local Cues , 1981 .

[44]  M. Haklay Citizen Science and Volunteered Geographic Information: Overview and Typology of Participation , 2013 .

[45]  Oded Nov,et al.  Can Force Feedback and Science Learning Enhance the Effectiveness of Neuro-Rehabilitation? An Experimental Study on Using a Low-Cost 3D Joystick and a Virtual Visit to a Zoo , 2013, PloS one.

[46]  David N. Bonter,et al.  Citizen Science as an Ecological Research Tool: Challenges and Benefits , 2010 .

[47]  Oded Nov,et al.  Increasing citizen science contribution using a virtual peer , 2017, J. Assoc. Inf. Sci. Technol..

[48]  Thierry Dutoit,et al.  Performance of the Emotiv Epoc headset for P300-based applications , 2013, Biomedical engineering online.

[49]  Pier J. M. Prins,et al.  Does Computerized Working Memory Training with Game Elements Enhance Motivation and Training Efficacy in Children with ADHD? , 2011, Cyberpsychology Behav. Soc. Netw..

[50]  Shamus P. Smith,et al.  Exploring the effectiveness of commercial and custom-built games for cognitive training , 2013, Comput. Hum. Behav..

[51]  P. Maruff,et al.  Abnormal executive function in attention deficit hyperactivity disorder: the effect of stimulant medication and age on spatial working memory , 2001, Psychological Medicine.

[52]  Steven M Butnik,et al.  Neurofeedback in adolescents and adults with attention deficit hyperactivity disorder. , 2005, Journal of clinical psychology.

[53]  Kevin G. F. Thomas,et al.  Place Learning in Virtual Space I: Acquisition, Overshadowing, and Transfer , 1997 .

[54]  Tracy Packiam Alloway,et al.  How does working memory work in the classroom , 2006 .

[55]  Rubin Wang,et al.  Recognition of Mental Workload Levels Under Complex Human–Machine Collaboration by Using Physiological Features and Adaptive Support Vector Machines , 2015, IEEE Transactions on Human-Machine Systems.

[56]  Tracy Packiam Alloway,et al.  Computerized working memory training: Can it lead to gains in cognitive skills in students? , 2013, Comput. Hum. Behav..

[57]  A. Pope,et al.  Biocybernetic system evaluates indices of operator engagement in automated task , 1995, Biological Psychology.

[58]  C S Breathnach,et al.  The Hippocampus as a Cognitive Map , 1980 .

[59]  Reinout W. Wiers,et al.  Improving Executive Functioning in Children with ADHD: Training Multiple Executive Functions within the Context of a Computer Game. A Randomized Double-Blind Placebo Controlled Trial , 2015, PloS one.

[60]  G. VandenBos APA dictionary of psychology , 2007 .

[61]  D. Walker,et al.  Prenatal ethanol exposure permanently reduces the number of pyramidal neurons in rat hippocampus. , 1981, Brain research.

[62]  P. Kodituwakku,et al.  Neurocognitive profile in children with fetal alcohol spectrum disorders. , 2009, Developmental disabilities research reviews.

[63]  Jennifer Preece,et al.  Dynamic changes in motivation in collaborative citizen-science projects , 2012, CSCW.

[64]  D P Munoz,et al.  Executive function deficits in children with fetal alcohol spectrum disorders (FASD) measured using the Cambridge Neuropsychological Tests Automated Battery (CANTAB). , 2009, Journal of child psychology and psychiatry, and allied disciplines.

[65]  P. Kodituwakku,et al.  From Research to Practice: An Integrative Framework for the Development of Interventions for Children with Fetal Alcohol Spectrum Disorders , 2011, Neuropsychology Review.

[66]  Morag MacLean,et al.  Working memory performance in children with and without intellectual disabilities. , 2002, American journal of mental retardation : AJMR.

[67]  Qiang Wang,et al.  EEG-Based "Serious" Games Design for Medical Applications , 2010, 2010 International Conference on Cyberworlds.

[68]  Oded Nov,et al.  Development of a Mechatronics-Based Citizen Science Platform for Aquatic Environmental Monitoring , 2014, IEEE/ASME Transactions on Mechatronics.

[69]  Hans Forssberg,et al.  Increased Brain Activity in Frontal and Parietal Cortex Underlies the Development of Visuospatial Working Memory Capacity during Childhood , 2002, Journal of Cognitive Neuroscience.

[70]  Oded Nov,et al.  Increasing Patient Engagement in Rehabilitation Exercises Using Computer-Based Citizen Science , 2015, PloS one.

[71]  C. Lintott,et al.  Galaxy Zoo: Exploring the Motivations of Citizen Science Volunteers. , 2009, 0909.2925.

[72]  F. Massey The Kolmogorov-Smirnov Test for Goodness of Fit , 1951 .

[73]  Melody Moore Jackson,et al.  A galvanic skin response interface for people with severe motor disabilities , 2004, Assets '04.

[74]  Miyoung Kim,et al.  A Review on the Computational Methods for Emotional State Estimation from the Human EEG , 2013, Comput. Math. Methods Medicine.

[75]  E. Sowell,et al.  Teratogenic effects of alcohol: A decade of brain imaging , 2004, American journal of medical genetics. Part C, Seminars in medical genetics.

[76]  D. M. Burgess,et al.  Fetal Alcohol Syndrome and Fetal Alcohol Effects: Principles for Educators. , 1992 .

[77]  Carmen Rasmussen,et al.  The effect of rehearsal training on working memory span of children with fetal alcohol spectrum disorder. , 2008, Research in developmental disabilities.

[78]  L. Nerad,et al.  Human spatial navigation deficits after traumatic brain injury shown in the arena maze, a virtual Morris water maze , 2006, Brain injury.

[79]  H. Jasper,et al.  The ten-twenty electrode system of the International Federation. The International Federation of Clinical Neurophysiology. , 1999, Electroencephalography and clinical neurophysiology. Supplement.

[80]  Reginald G. Golledge,et al.  HUMAN WAYFINDING AND COGNITIVE MAPS , 2003 .