Real-Time Closed-Loop Control of Cognitive Load in Neurological Patients During Robot-Assisted Gait Training

Cognitively challenging training sessions during robot-assisted gait training after stroke were shown to be key requirements for the success of rehabilitation. Despite a broad variability of cognitive impairments amongst the stroke population, current rehabilitation environments do not adapt to the cognitive capabilities of the patient, as cognitive load cannot be objectively assessed in real-time. We provided healthy subjects and stroke patients with a virtual task during robot-assisted gait training, which allowed modulating cognitive load by adapting the difficulty level of the task. We quantified the cognitive load of stroke patients by using psychophysiological measurements and performance data. In open-loop experiments with healthy subjects and stroke patients, we obtained training data for a linear, adaptive classifier that estimated the current cognitive load of patients in real-time. We verified our classification results via questionnaires and obtained 88% correct classification in healthy subjects and 75% in patients. Using the pre-trained, adaptive classifier, we closed the cognitive control loop around healthy subjects and stroke patients by automatically adapting the difficulty level of the virtual task in real-time such that patients were neither cognitively overloaded nor under-challenged.

[1]  A. Ax The Physiological Differentiation between Fear and Anger in Humans , 1953, Psychosomatic medicine.

[2]  R. Stephenson A and V , 1962, The British journal of ophthalmology.

[3]  J. Andreassi Psychophysiology: Human Behavior and Physiological Response , 1980 .

[4]  D Carroll,et al.  The effects of level of difficulty of mental arithmetic challenge on heart rate and oxygen consumption. , 1986, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[5]  P. Ekman,et al.  Voluntary facial action generates emotion-specific autonomic nervous system activity. , 1990, Psychophysiology.

[6]  G. M. Redding,et al.  Cognitive Load and Prism Adaptation. , 1992, Journal of motor behavior.

[7]  V. Myllylä,et al.  Suppressed Sympathetic Skin Response in Brain Infarction , 1993, Stroke.

[8]  N. Frijda,et al.  Emotions and respiratory patterns: review and critical analysis. , 1994, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[9]  R. Mccraty,et al.  The effects of emotions on short-term power spectrum analysis of heart rate variability . , 1995, The American journal of cardiology.

[10]  G. Wallin,et al.  Autonomic and thermal sensory symptoms and dysfunction after stroke. , 1995, Stroke.

[11]  J. Blascovich,et al.  Cardiorespiratory response under combined psychological and exercise stress. , 1995, International Journal of Psychophysiology.

[12]  H. Huikuri,et al.  Abnormal heart rate variability as a manifestation of autonomic dysfunction in hemispheric brain infarction. , 1996, Stroke.

[13]  K. Hugdahl Psychophysiology: The Mind-Body Perspective , 1996 .

[14]  A. Malliani,et al.  Heart rate variability. Standards of measurement, physiological interpretation, and clinical use , 1996 .

[15]  J. Kagan,et al.  The psychological significance of changes in skin temperature , 1996 .

[16]  A. Finset,et al.  Heart rate and skin conductance reactivity to brief psychological stress in brain-injured patients. , 1998, Journal of psychosomatic research.

[17]  A. Oto,et al.  Effects of stroke localization on cardiac autonomic balance and sudden death. , 1999, Stroke.

[18]  D. Brodie,et al.  Effects of Short-Term Psychological Stress on the Time and Frequency Domains of Heart-Rate Variability , 2000, Perceptual and motor skills.

[19]  J. Cacioppo,et al.  Handbook of psychophysiology (2nd ed.). , 2000 .

[20]  P. Pound,et al.  A critical review of the concept of patient motivation in the literature on physical rehabilitation. , 2000, Social science & medicine.

[21]  A. Angrilli,et al.  Cardiac responses associated with affective processing of unpleasant film stimuli. , 2000, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[22]  M. Ohsuga,et al.  Assessment of phasic work stress using autonomic indices. , 2001, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[23]  J. Gómez-Amor,et al.  Gender differences in cardiovascular and electrodermal responses to public speaking task: the role of anxiety and mood states. , 2001, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[24]  D. Watenpaugh,et al.  Interactive effects of mental and physical stress on cardiovascular control. , 2002, Journal of applied physiology.

[25]  Nilanjan Sarkar,et al.  Online stress detection using psychophysiological signals for implicit human-robot cooperation , 2002, Robotica.

[26]  C. Braun,et al.  Motor learning elicited by voluntary drive. , 2003, Brain : a journal of neurology.

[27]  Ivaylo I Christov,et al.  Real time electrocardiogram QRS detection using combined adaptive threshold , 2004, Biomedical engineering online.

[28]  Alfonso Nastro,et al.  Low temperature method for the production of calcium phosphate fillers , 2004, Biomedical engineering online.

[29]  B. Schmitz,et al.  Lateralization in autononic dysfunction in ischemic stroke involving the insular cortex , 2004, Neuroreport.

[30]  Patrick Gomez,et al.  Respiratory responses associated with affective processing of film stimuli , 2005, Biological Psychology.

[31]  L. Cohen,et al.  Role of voluntary drive in encoding an elementary motor memory. , 2005, Journal of neurophysiology.

[32]  Maureen K. Holden,et al.  Virtual Environments for Motor Rehabilitation: Review , 2005, Cyberpsychology Behav. Soc. Netw..

[33]  D. Carroll,et al.  The effects of the spontaneous presence of a spouse/partner and others on cardiovascular reactions to an acute psychological challenge. , 2006, Psychophysiology.

[34]  Veikko Louhevaara,et al.  Responses of the autonomic nervous system during periods of perceived high and low work stress in younger and older female teachers. , 2006, Applied ergonomics.

[35]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[36]  Reinhold Scherer,et al.  Study of On-Line Adaptive Discriminant Analysis for EEG-Based Brain Computer Interfaces , 2007, IEEE Transactions on Biomedical Engineering.

[37]  J. Cacioppo,et al.  Handbook Of Psychophysiology , 2019 .

[38]  Vincent G. Duffy,et al.  Handbook of Digital Human Modeling: Research for Applied Ergonomics and Human Factors Engineering , 2008 .

[39]  V. Dietz,et al.  Computerized Visual Feedback: An Adjunct to Robotic-Assisted Gait Training , 2008, Physical Therapy.

[40]  Maurizio Codispoti,et al.  Watching emotional movies: affective reactions and gender differences. , 2008, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[41]  Kurt A. Thoroughman,et al.  Motor Adaptation Scaled by the Difficulty of a Secondary Cognitive Task , 2008, PloS one.

[42]  Sylvia D. Kreibig,et al.  Autonomic nervous system activity in emotion: A review , 2010, Biological Psychology.

[43]  Robert Riener,et al.  Special section on rehabilitation via bio-cooperative control. , 2010, IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[44]  Marko Munih,et al.  Measuring motor actions and psychophysiology for task difficulty estimation in human-robot interaction , 2010, MB '10.

[45]  Marko Munih,et al.  Psychophysiological responses to different levels of cognitive and physical workload in haptic interaction , 2010, Robotica.

[46]  M. Munih,et al.  Psychophysiological Responses to Robotic Rehabilitation Tasks in Stroke , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[47]  R. Riener,et al.  Psychological state estimation from physiological recordings during robot-assisted gait rehabilitation. , 2011, Journal of rehabilitation research and development.

[48]  W. Marsden I and J , 2012 .

[49]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.