fNIRS-based Neurorobotic Interface for gait rehabilitation

BackgroundIn this paper, a novel functional near-infrared spectroscopy (fNIRS)-based brain-computer interface (BCI) framework for control of prosthetic legs and rehabilitation of patients suffering from locomotive disorders is presented.MethodsfNIRS signals are used to initiate and stop the gait cycle, while a nonlinear proportional derivative computed torque controller (PD-CTC) with gravity compensation is used to control the torques of hip and knee joints for minimization of position error. In the present study, the brain signals of walking intention and rest tasks were acquired from the left hemisphere’s primary motor cortex for nine subjects. Thereafter, for removal of motion artifacts and physiological noises, the performances of six different filters (i.e. Kalman, Wiener, Gaussian, hemodynamic response filter (hrf), Band-pass, finite impulse response) were evaluated. Then, six different features were extracted from oxygenated hemoglobin signals, and their different combinations were used for classification. Also, the classification performances of five different classifiers (i.e. k-Nearest Neighbour, quadratic discriminant analysis, linear discriminant analysis (LDA), Naïve Bayes, support vector machine (SVM)) were tested.ResultsThe classification accuracies obtained from SVM using the hrf were significantly higher (p < 0.01) than those of the other classifier/ filter combinations. Those accuracies were 77.5, 72.5, 68.3, 74.2, 73.3, 80.8, 65, 76.7, and 86.7% for the nine subjects, respectively.ConclusionThe control commands generated using the classifiers initiated and stopped the gait cycle of the prosthetic leg, the knee and hip torques of which were controlled using the PD-CTC to minimize the position error. The proposed scheme can be effectively used for neurofeedback training and rehabilitation of lower-limb amputees and paralyzed patients.

[1]  S Hesse,et al.  Repetitive locomotor training and physiotherapy improve walking and basic activities of daily living after stroke: a single-blind, randomized multicentre trial (DEutsche GAngtrainerStudie, DEGAS) , 2007, Clinical rehabilitation.

[2]  Auke Jan Ijspeert,et al.  Robust 3D Walking Using Inverse Dynamics And Footstep Planning With Model Predictive Control , 2014 .

[3]  David A. Boas,et al.  Motion artifacts in functional near-infrared spectroscopy: A comparison of motion correction techniques applied to real cognitive data , 2014, NeuroImage.

[4]  Sarah D Power,et al.  Classification of prefrontal activity due to mental arithmetic and music imagery using hidden Markov models and frequency domain near-infrared spectroscopy , 2010, Journal of neural engineering.

[5]  Heidrun Wabnitz,et al.  Identifying and quantifying main components of physiological noise in functional near infrared spectroscopy on the prefrontal cortex , 2013, Front. Hum. Neurosci..

[6]  Vahid Azimi,et al.  Stable Robust Adaptive Impedance Control of a Prosthetic Leg , 2015 .

[7]  Y. Kim,et al.  Classification of prefrontal and motor cortex signals for three-class fNIRS–BCI , 2015, Neuroscience Letters.

[8]  Keum-Shik Hong,et al.  Online binary decision decoding using functional near-infrared spectroscopy for the development of brain–computer interface , 2014, Experimental Brain Research.

[9]  Tom Chau,et al.  Towards a multimodal brain–computer interface: Combining fNIRS and fTCD measurements to enable higher classification accuracy , 2013, NeuroImage.

[10]  COMPUTING THE TORQUE DEMAND OF A PROSTHETIC LEG , 2011 .

[11]  Martin Wolf,et al.  Reproducibility and sensitivity of detecting brain activity by simultaneous electroencephalography and near-infrared spectroscopy , 2012, Experimental Brain Research.

[12]  Jason Farquhar,et al.  Decoding Sensorimotor Rhythms during Robotic-Assisted Treadmill Walking for Brain Computer Interface (BCI) Applications , 2015, PloS one.

[13]  Liaquat Ali Khan,et al.  Modeling and dynamic analysis of the biped robot , 2015, 2015 15th International Conference on Control, Automation and Systems (ICCAS).

[14]  T. Chau,et al.  Single-trial classification of NIRS signals during emotional induction tasks: towards a corporeal machine interface , 2009, Journal of NeuroEngineering and Rehabilitation.

[15]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces , 2007, Journal of neural engineering.

[16]  E. Andersson,et al.  Mild traumatic brain injury: A description of how children and youths between 16 and 18 years of age perform leisure activities after 1 year , 2013, Developmental neurorehabilitation.

[17]  Robert Bergevin,et al.  Human gait characteristics from unconstrained walks and viewpoints , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[18]  L. Montesano,et al.  Detecting intention to walk in stroke patients from pre-movement EEG correlates , 2015, Journal of NeuroEngineering and Rehabilitation.

[19]  J. Contreras-Vidal,et al.  Applications of Brain–Machine Interface Systems in Stroke Recovery and Rehabilitation , 2014, Current Physical Medicine and Rehabilitation Reports.

[20]  Keum-Shik Hong,et al.  Linear parameter-varying model and adaptive filtering technique for detecting neuronal activities: an fNIRS study , 2013, Journal of neural engineering.

[21]  Andrej Gams,et al.  Control approaches for robotic knee exoskeleton and their effects on human motion , 2013, Adv. Robotics.

[22]  Xu Cui,et al.  Speeded Near Infrared Spectroscopy (NIRS) Response Detection , 2010, PloS one.

[23]  Bram Koopman,et al.  Body weight support by virtual model control of an impedance controlled exoskeleton (LOPES) for gait training. , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[24]  F. Jöbsis Noninvasive, infrared monitoring of cerebral and myocardial oxygen sufficiency and circulatory parameters. , 1977, Science.

[25]  John J. Craig,et al.  Introduction to Robotics Mechanics and Control , 1986 .

[26]  John J. Craig,et al.  Introduction to robotics - mechanics and control (2. ed.) , 1989 .

[27]  Fei Li,et al.  The Design and Control Simulation of Trans-femoral Prosthesis Based on Virtual Prototype , 2013 .

[28]  A F Mak,et al.  State-of-the-art research in lower-limb prosthetic biomechanics-socket interface: a review. , 2001, Journal of rehabilitation research and development.

[29]  Stéphane Perrey,et al.  Possibilities for examining the neural control of gait in humans with fNIRS , 2014, Front. Physiol..

[30]  Preeti Raghavan,et al.  The Effect of Body Weight Support Treadmill Training on Gait Recovery, Proximal Lower Limb Motor Pattern, and Balance in Patients with Subacute Stroke , 2015, BioMed research international.

[31]  K. Kubota,et al.  Cortical Mapping of Gait in Humans: A Near-Infrared Spectroscopic Topography Study , 2001, NeuroImage.

[32]  Keum Shik Hong,et al.  Analysis of Different Classification Techniques for Two-Class Functional Near-Infrared Spectroscopy-Based Brain-Computer Interface , 2016, Comput. Intell. Neurosci..

[33]  T. Chau,et al.  Towards a system-paced near-infrared spectroscopy brain–computer interface: differentiating prefrontal activity due to mental arithmetic and mental singing from the no-control state , 2011, Journal of neural engineering.

[34]  Masahiro Nakagawa,et al.  Functional Near Infrared Spectroscope for Cognition Brain Tasks by Wavelets Analysis and Neural Networks , 2008 .

[35]  Theodore J Huppert,et al.  Commentary on the statistical properties of noise and its implication on general linear models in functional near-infrared spectroscopy. , 2016, Neurophotonics.

[36]  D. Delpy,et al.  System for long-term measurement of cerebral blood and tissue oxygenation on newborn infants by near infra-red transillumination , 1988, Medical and Biological Engineering and Computing.

[37]  A. Villringer,et al.  Near infrared spectroscopy (NIRS): A new tool to study hemodynamic changes during activation of brain function in human adults , 1993, Neuroscience Letters.

[38]  N. Birbaumer,et al.  Lower Limb Movement Preparation in Chronic Stroke , 2014, Neurorehabilitation and neural repair.

[39]  M. Grimble Robust Industrial Control Systems: Optimal Design Approach for Polynomial Systems , 1994 .

[40]  Andrej Gams,et al.  Real-time full body motion imitation on the COMAN humanoid robot , 2014, Robotica.

[41]  Philipp Beckerle,et al.  Active lower limb prosthetics: a systematic review of design issues and solutions , 2016, BioMedical Engineering OnLine.

[42]  S. Stuart,et al.  fNIRS response during walking — Artefact or cortical activity? A systematic review , 2017, Neuroscience & Biobehavioral Reviews.

[43]  Phillip Wolff,et al.  Causal reasoning with forces , 2015, Front. Hum. Neurosci..

[44]  Keum Shik Hong,et al.  Reduction of Delay in Detecting Initial Dips from Functional Near-Infrared Spectroscopy Signals Using Vector-Based Phase Analysis , 2016, Int. J. Neural Syst..

[45]  Martin Wolf,et al.  Single-trial classification of motor imagery differing in task complexity: a functional near-infrared spectroscopy study , 2011, Journal of NeuroEngineering and Rehabilitation.

[46]  Theodore J. Huppert,et al.  Real-time imaging of human brain function by near-infrared spectroscopy using an adaptive general linear model , 2009, NeuroImage.

[47]  Noman Naseer,et al.  Enhancing Classification Performance of Functional Near-Infrared Spectroscopy- Brain–Computer Interface Using Adaptive Estimation of General Linear Model Coefficients , 2017, Front. Neurorobot..

[48]  Noman Naseer,et al.  Optimal feature selection from fNIRS signals using genetic algorithms for BCI , 2017, Neuroscience Letters.

[49]  Atsuo Takanishi,et al.  Study of Bipedal Robot Walking Motion in Low Gravity: Investigation and Analysis , 2014 .

[50]  Dudley S. Childress,et al.  Problems associated with the use of inverse dynamics in prosthetic applications: An example using a polycentric prosthetic knee , 2005, Robotica.

[51]  Biswarup Neogi,et al.  Study of Proper Tuning of Prosthetic Limb Control System with Paraplegia and Fatigue Condition , 2011, 2011 Second International Conference on Emerging Applications of Information Technology.

[52]  S. Ge,et al.  fNIRS-based online deception decoding , 2012, Journal of neural engineering.

[53]  Auke Jan Ijspeert,et al.  Model-based and model-free approaches for postural control of a compliant humanoid robot using optical flow , 2013, 2013 13th IEEE-RAS International Conference on Humanoid Robots (Humanoids).

[54]  Aaron D. Ames,et al.  First steps toward translating robotic walking to prostheses: a nonlinear optimization based control approach , 2017, Auton. Robots.

[55]  Shuzhi Sam Ge,et al.  Detection of event-related hemodynamic response to neuroactivation by dynamic modeling of brain activity , 2012, NeuroImage.

[56]  Wu Zhang,et al.  Unobtrusive ambulatory estimation of knee joint angles during walking using gyroscope and accelerometer data - a preliminary evaluation study , 2012, Proceedings of 2012 IEEE-EMBS International Conference on Biomedical and Health Informatics.

[57]  Tom Chau,et al.  Automatic single-trial classification of prefrontal hemodynamic activity in an individual with Duchenne muscular dystrophy , 2013, Developmental neurorehabilitation.

[58]  Christopher G. Atkeson,et al.  Experimental evaluation of feedforward and computed torque control , 1987, IEEE Trans. Robotics Autom..

[59]  G R Müller-Putz,et al.  Separating heart and brain: on the reduction of physiological noise from multichannel functional near-infrared spectroscopy (fNIRS) signals , 2014, Journal of neural engineering.

[60]  Keum-Shik Hong,et al.  fNIRS-based brain-computer interfaces: a review , 2015, Front. Hum. Neurosci..

[61]  Farzin Piltan,et al.  Design Baseline Computed Torque Controller , 2012 .

[62]  Keum-Shik Hong,et al.  Classification of functional near-infrared spectroscopy signals corresponding to the right- and left-wrist motor imagery for development of a brain–computer interface , 2013, Neuroscience Letters.

[63]  Ichiro Miyai,et al.  Role of the prefrontal cortex in human balance control , 2008, NeuroImage.

[64]  S. Stramigioli,et al.  Biomechanical conceptual design of a passive transfemoral prosthesis , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[65]  L. Alfredsson,et al.  The Association between Job Strain and Atrial Fibrillation: Results from the Swedish WOLF Study , 2015, BioMed research international.

[66]  Andrej Gams,et al.  Effects of Robotic Knee Exoskeleton on Human Energy Expenditure , 2013, IEEE Transactions on Biomedical Engineering.

[67]  Jonathon W. Sensinger,et al.  Virtual Constraint Control of a Powered Prosthetic Leg: From Simulation to Experiments With Transfemoral Amputees , 2014, IEEE Transactions on Robotics.

[68]  Masashi Kiguchi,et al.  A Communication Means for Totally Locked-in ALS Patients Based on Changes in Cerebral Blood Volume Measured with Near-Infrared Light , 2007, IEICE Trans. Inf. Syst..

[69]  Keum-Shik Hong,et al.  Reduction of physiological effects in fNIRS waveforms for efficient brain-state decoding , 2014, Neuroscience Letters.

[70]  S. Coyle,et al.  Brain–computer interfaces: a review , 2003 .

[71]  J. Verhoeven,et al.  Developmental Foreign Accent Syndrome: Report of a New Case , 2016, Front. Hum. Neurosci..

[72]  Christopher J. C. Burges,et al.  A Tutorial on Support Vector Machines for Pattern Recognition , 1998, Data Mining and Knowledge Discovery.

[73]  Tom Chau,et al.  Decoding subjective preference from single-trial near-infrared spectroscopy signals , 2009, Journal of neural engineering.

[74]  David A. Boas,et al.  The utility of near-infrared spectroscopy in the regression of low-frequency physiological noise from functional magnetic resonance imaging data , 2012, NeuroImage.

[75]  Sungho Tak,et al.  NIRS-SPM: Statistical parametric mapping for near-infrared spectroscopy , 2009, NeuroImage.

[76]  Peter E. Keller,et al.  The ADaptation and Anticipation Model (ADAM) of sensorimotor synchronization , 2013, Front. Hum. Neurosci..

[77]  Keum-Shik Hong,et al.  Cortical brain imaging by adaptive filtering of NIRS signals , 2012, Neuroscience Letters.

[78]  M. Molinari,et al.  Rehabilitation of gait after stroke: a review towards a top-down approach , 2011, Journal of NeuroEngineering and Rehabilitation.

[79]  Francisco Sepulveda,et al.  Classification effects of real and imaginary movement selective attention tasks on a P300-based brain–computer interface , 2010, Journal of neural engineering.

[80]  George I. Lambrou,et al.  Proliferation versus regeneration: the good, the bad and the ugly , 2014, Front. Physiol..

[81]  Bin Li,et al.  Using SVD on Clusters to Improve Precision of Interdocument Similarity Measure , 2016, Comput. Intell. Neurosci..

[82]  Gert Pfurtscheller,et al.  Walking from thought , 2006, Brain Research.

[83]  Oleksandr Poliakov,et al.  Transfemoral Prosthesis with Polycentric Knee Mechanism: Design, Kinematics, Dynamics and Control Strategy , 2013 .

[84]  Bruce H Dobkin,et al.  Body-weight-supported treadmill rehabilitation after stroke. , 2011, The New England journal of medicine.

[85]  Keum-Shik Hong,et al.  Decoding Answers to Four-Choice Questions Using Functional near Infrared Spectroscopy , 2015 .

[86]  S. N. Shulga,et al.  Time-varying wiener filtering based on short-time fourier transform , 2012, 2012 6th International Conference on Ultrawideband and Ultrashort Impulse Signals.

[87]  Andrew S. Whitford,et al.  Cortical control of a prosthetic arm for self-feeding , 2008, Nature.

[88]  Akshay Nanjangud,et al.  SIMULTANEOUS CONTROL OF AN ANKLE-FOOT PROSTHESIS MODEL USING A VIRTUAL CONSTRAINT. , 2014, Proceedings of the ASME Dynamic Systems and Control Conference. ASME Dynamic Systems and Control Conference.

[89]  Jinung An,et al.  Classification of frontal cortex haemodynamic responses during cognitive tasks using wavelet transforms and machine learning algorithms. , 2012, Medical engineering & physics.

[90]  Chi-Woong Mun,et al.  Comparison of k-nearest neighbor, quadratic discriminant and linear discriminant analysis in classification of electromyogram signals based on the wrist-motion directions , 2011 .

[91]  K. Hong,et al.  Determining Optimal Feature-Combination for LDA Classification of Functional Near-Infrared Spectroscopy Signals in Brain-Computer Interface Application , 2016, Front. Hum. Neurosci..

[92]  W. N. Dare,et al.  A Comparative Study on Thigh Length to Leg Length Ratio in Adult Males of Two Southern States in Nigeria , 2013 .

[93]  Yashraj S. Narang Identification of design requirements for a high-performance, low-cost, passive prosthetic knee through user analysis and dynamic simulation , 2013 .

[94]  Sungho Tak,et al.  Statistical analysis of fNIRS data: A comprehensive review , 2014, NeuroImage.

[95]  Meltem Izzetoglu,et al.  Online fronto-cortical control of simple and attention-demanding locomotion in humans , 2015, NeuroImage.

[96]  Hanz Richter,et al.  Dynamic Modeling, Parameter Estimation and Control of a Leg Prosthesis Test Robot , 2015 .

[97]  Cuntai Guan,et al.  Temporal classification of multichannel near-infrared spectroscopy signals of motor imagery for developing a brain–computer interface , 2007, NeuroImage.

[98]  T. Oberg,et al.  Joint angle parameters in gait: reference data for normal subjects, 10-79 years of age. , 1994, Journal of rehabilitation research and development.

[99]  Qingsong Ai,et al.  A Subject-Specific EMG-Driven Musculoskeletal Model for Applications in Lower-Limb Rehabilitation Robotics , 2016, Int. J. Humanoid Robotics.