Hybrid EEG-NIRS based BCI for quadcopter control

In this paper, we have proposed a novel control strategy for a quadcopter control using brain signals. A brain-computer interface (BCI) technology is developed using hybrid electroencephalography - near-infrared spectroscopy (EEG-NIRS) system and two commands are used to operate the quadcopter. An active brain signal upon the user's own will is generated using a motor imagery task and a reactive brain signal is generated by visual flickering of light. The reactive command is used for the triggering control of the quadcopter and the active command is used to navigate the quadcopter in the forward direction. Linear discriminant analysis is used to classify the brain activity in offline environment. The results indicate that the proposed scheme is suitable for the BCI control applications.

[1]  S. Sul,et al.  Anti-Sway Control of Container Cranes: Inclinometer, Observer, and State Feedback , 2004 .

[2]  Keum-Shik Hong,et al.  Real-time feature extraction of P300 component using adaptive nonlinear principal component analysis , 2011, Biomedical engineering online.

[3]  Keum-Shik Hong,et al.  Stabilization and tracking control for a class of nonlinear systems , 2011 .

[4]  Keum-Shik Hong,et al.  Direct adaptive control of parabolic systems: algorithm synthesis, and convergence and stability analysis , 1993, Proceedings of 32nd IEEE Conference on Decision and Control.

[5]  Rabab K Ward,et al.  A survey of signal processing algorithms in brain–computer interfaces based on electrical brain signals , 2007, Journal of neural engineering.

[6]  S. Ge,et al.  fNIRS-based online deception decoding , 2012, Journal of neural engineering.

[7]  Keum-Shik Hong,et al.  Functional near-infrared spectroscopy based brain activity classification for development of a brain-computer interface , 2012, 2012 International Conference of Robotics and Artificial Intelligence.

[8]  Shuzhi Sam Ge,et al.  Approximation-based adaptive tracking control of pure-feedback nonlinear systems with multiple unknown time-varying delays , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[9]  Keum-Shik Hong,et al.  Modified Skyhook Control of Semi-Active Suspensions: A New Model, Gain Scheduling, and Hardware-in-the-Loop Tuning , 2002 .

[10]  K. Hong,et al.  CLASSIFYING MENTAL ACTIVITIES FROM EEG-P 300 SIGNALS USING ADAPTIVE NEURAL NETWORKS , 2012 .

[11]  José del R. Millán,et al.  Brain-Controlled Wheelchairs: A Robotic Architecture , 2013, IEEE Robotics & Automation Magazine.

[12]  Keum Shik Hong,et al.  Sliding-mode and proportional-derivative-type motion control with radial basis function neural network based estimators for wheeled vehicles , 2014, Int. J. Syst. Sci..

[13]  Keum-Shik Hong,et al.  fNIRS-based brain-computer interfaces: a review , 2015, Front. Hum. Neurosci..

[14]  Keum-Shik Hong,et al.  Classification of functional near-infrared spectroscopy signals corresponding to the right- and left-wrist motor imagery for development of a brain–computer interface , 2013, Neuroscience Letters.

[15]  K. Hong,et al.  A Feedback Linearization Control of Container Cranes: Varying Rope Length , 2007 .

[16]  M. R. Bhutta,et al.  Water correction algorithm to improve the classification accuracy: A near-infrared spectroscopy study , 2014, 2014 International Conference on Robotics and Emerging Allied Technologies in Engineering (iCREATE).

[17]  Jon A. Mukand,et al.  Neuronal ensemble control of prosthetic devices by a human with tetraplegia , 2006, Nature.

[18]  Keum-Shik Hong,et al.  A PC-based open robot control system: PC-ORC , 2001, ISIE 2001. 2001 IEEE International Symposium on Industrial Electronics Proceedings (Cat. No.01TH8570).

[19]  M. J. Khan,et al.  Control system design for a prosthetic leg using series damping actuator , 2012, 2012 International Conference of Robotics and Artificial Intelligence.

[20]  Keum-Shik Hong,et al.  Linear parameter-varying model and adaptive filtering technique for detecting neuronal activities: an fNIRS study , 2013, Journal of neural engineering.

[21]  Keum-Shik Hong,et al.  A hybrid EEG-fNIRS BCI: Motor imagery for EEG and mental arithmetic for fNIRS , 2014, 2014 14th International Conference on Control, Automation and Systems (ICCAS 2014).

[22]  K. Hong,et al.  Simultaneous control of longitudinal and transverse vibrations of an axially moving string with velocity tracking , 2012 .

[23]  Keum Shik Hong,et al.  Navigation Function-Based Control of Multiple Wheeled Vehicles , 2011, IEEE Transactions on Industrial Electronics.

[24]  Andrzej Cichocki,et al.  Bimodal BCI Using Simultaneously NIRS and EEG , 2014, IEEE Transactions on Biomedical Engineering.

[25]  S. Ge,et al.  Recognition of stimulus-evoked neuronal optical response by identifying chaos levels of near-infrared spectroscopy time series , 2011, Neuroscience Letters.

[26]  Keum-Shik Hong,et al.  State-space models of impulse hemodynamic responses over motor, somatosensory, and visual cortices. , 2014, Biomedical optics express.

[27]  Suzanne Kieffer,et al.  Feature extraction and selection for objective gait analysis and fall risk assessment by accelerometry , 2011, Biomedical engineering online.

[28]  Nicolas Y. Masse,et al.  Reach and grasp by people with tetraplegia using a neurally controlled robotic arm , 2012, Nature.

[29]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[30]  K. Lafleur,et al.  Quadcopter control in three-dimensional space using a noninvasive motor imagery-based brain–computer interface , 2013, Journal of neural engineering.

[31]  Y. Kim,et al.  Classification of prefrontal and motor cortex signals for three-class fNIRS–BCI , 2015, Neuroscience Letters.

[32]  Klaus-Robert Müller,et al.  Enhanced Performance by a Hybrid Nirs–eeg Brain Computer Interface , 2022 .

[33]  Shuzhi Sam Ge,et al.  Boundary control of a flexible marine riser with vessel dynamics , 2010, Proceedings of the 2010 American Control Conference.

[34]  M. R. Bhutta,et al.  Note: three wavelengths near-infrared spectroscopy system for compensating the light absorbance by water. , 2014, The Review of scientific instruments.

[35]  Keum-Shik Hong,et al.  Adaptive sliding mode control of container cranes , 2012 .

[36]  김동환,et al.  A New Dual-Frequency Stimulation Method to Increase the Number of Visual Stimuli for Multi-Class SSVEP-Based Brain-Computer Interface (BCI) , 2013 .

[37]  Keum-Shik Hong,et al.  Reduction of trial-to-trial variability in functional near-infrared spectroscopy signals by accounting for resting-state functional connectivity , 2013, Journal of biomedical optics.

[38]  Keum-Shik Hong,et al.  Online binary decision decoding using functional near-infrared spectroscopy for the development of brain–computer interface , 2014, Experimental Brain Research.

[39]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces , 2007, Journal of neural engineering.

[40]  Keum-Shik Hong,et al.  Improving classification accuracy of covert yes/no response decoding using support vector machines: An fNIRS study , 2014, 2014 International Conference on Robotics and Emerging Allied Technologies in Engineering (iCREATE).

[41]  A. Zeeshan,et al.  Design, control and implementation of a ball on plate balancing system , 2012, Proceedings of 2012 9th International Bhurban Conference on Applied Sciences & Technology (IBCAST).

[42]  Keum-Shik Hong,et al.  fNIRS based dual movement control command generation using prefrontal brain activity , 2014, 2014 International Conference on Robotics and Emerging Allied Technologies in Engineering (iCREATE).

[43]  Keum-Shik Hong,et al.  Decoding Answers to Four-Choice Questions Using Functional near Infrared Spectroscopy , 2015 .

[44]  Keum-Shik Hong,et al.  Reduction of physiological effects in fNIRS waveforms for efficient brain-state decoding , 2014, Neuroscience Letters.

[45]  Keum-Shik Hong,et al.  Decoding of four movement directions using hybrid NIRS-EEG brain-computer interface , 2014, Front. Hum. Neurosci..

[46]  Keum-Shik Hong,et al.  Input shaping control of a nuclear power plant’s fuel transport system , 2014 .

[47]  S. Coyle,et al.  Brain–computer interfaces: a review , 2003 .

[48]  Keum-Shik Hong,et al.  Control Architecture of an Autonomous Material Handling Vehicle , 2013 .

[49]  K. Hong,et al.  Robust adaptive boundary control of an axially moving string under a spatiotemporally varying tension , 2004 .

[50]  Keum Shik Hong,et al.  Transverse Vibration Control of Axially Moving Membranes by Regulation of Axial Velocity , 2012, IEEE Transactions on Control Systems Technology.

[51]  Keum-Shik Hong,et al.  Noise reduction in functional near-infrared spectroscopy signals by independent component analysis. , 2013, The Review of scientific instruments.

[52]  Keum-Shik Hong,et al.  Modeling and Automatic Feedback Control of Tremor: Adaptive Estimation of Deep Brain Stimulation , 2013, PloS one.

[53]  K. Hong,et al.  Lateralization of music processing with noises in the auditory cortex: an fNIRS study , 2014, Front. Behav. Neurosci..

[54]  Keum-Shik Hong,et al.  Sliding-Mode Antisway Control of an Offshore , 2012 .

[55]  Keum-Shik Hong,et al.  Kalman estimator- and general linear model-based on-line brain activation mapping by near-infrared spectroscopy , 2010, Biomedical engineering online.

[56]  Keum-Shik Hong,et al.  Single-trial lie detection using a combined fNIRS-polygraph system , 2015, Front. Psychol..