A hierarchical structure for human behavior classification using STN local field potentials

BACKGROUND Classification of human behavior from brain signals has potential application in developing closed-loop deep brain stimulation (DBS) systems. This paper presents a human behavior classification using local field potential (LFP) signals recorded from subthalamic nuclei (STN). METHOD A hierarchical classification structure is developed to perform the behavior classification from LFP signals through a multi-level framework (coarse to fine). At each level, the time-frequency representations of all six signals from the DBS leads are combined through an MKL-based SVM classifier to classify five tasks (speech, finger movement, mouth movement, arm movement, and random segments). To lower the computational cost, we alternatively use the inter-hemispheric synchronization of the LFPs to make three pairs out of six bipolar signals. Three classifiers are separately trained at each level of the hierarchical approach, which lead to three labels. A fusion function is then developed to combine these three labels and determine the label of the corresponding trial. RESULTS Using all six LFPs with the proposed hierarchical approach improves the classification performance. Moreover, the synchronization-based method reduces the computational burden considerably while the classification performance remains relatively unchanged. COMPARISON WITH EXISTING METHODS Our experiments on two different datasets recorded from nine subjects undergoing DBS surgery show that the proposed approaches remarkably outperform other methods for behavior classification based on LFP signals. CONCLUSION The LFP signals acquired from STNs contain useful information for recognizing human behavior. This can be a precursor for designing the next generation of closed-loop DBS systems.

[1]  Adam O. Hebb,et al.  Task specific inter-hemispheric coupling in human subthalamic nuclei , 2014, Front. Hum. Neurosci..

[2]  Jun Jason Zhang,et al.  Adaptive learning of behavioral tasks for patients with Parkinson's disease using signals from deep brain stimulation , 2014, 2014 48th Asilomar Conference on Signals, Systems and Computers.

[3]  José del R. Millán,et al.  Noninvasive brain-actuated control of a mobile robot by human EEG , 2004, IEEE Transactions on Biomedical Engineering.

[4]  G. Pfurtscheller,et al.  Continuous EEG classification during motor imagery-simulation of an asynchronous BCI , 2004, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[5]  W. Grill,et al.  Closed-Loop Control of Deep Brain Stimulation: A Simulation Study , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[6]  Helge J. Ritter,et al.  BCI competition 2003-data set IIb: support vector machines for the P300 speller paradigm , 2004, IEEE Transactions on Biomedical Engineering.

[7]  N. Ince,et al.  Long-term recordings of local field potentials from implanted deep brain stimulation electrodes. , 2012, Neurosurgery.

[8]  Alexander Kraskov,et al.  MIC: Mutual Information Based Hierarchical Clustering , 2008, 0809.1605.

[9]  Ying Sun,et al.  Asynchronous P300 BCI: SSVEP-based control state detection , 2010, 2010 18th European Signal Processing Conference.

[10]  Peter Brown,et al.  Bilateral Functional Connectivity of the Basal Ganglia in Patients with Parkinson’s Disease and Its Modulation by Dopaminergic Treatment , 2013, PloS one.

[11]  G. Deuschl,et al.  Deep brain stimulation: Postoperative issues , 2006, Movement disorders : official journal of the Movement Disorder Society.

[12]  K. J. Miller,et al.  Transient and state modulation of beta power in human subthalamic nucleus during speech production and finger movement , 2012, Neuroscience.

[13]  Jie Li,et al.  A Prior Neurophysiologic Knowledge Free Tensor-Based Scheme for Single Trial EEG Classification , 2009, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[14]  Vera Kaiser,et al.  Fast set-up asynchronous brain-switch based on detection of foot motor imagery in 1-channel EEG , 2010, Medical & Biological Engineering & Computing.

[15]  Gert Pfurtscheller,et al.  EEG-based Brain-Computer Interface Using Subject-Specific Spatial Filters , 1999, IWANN.

[16]  Mohammad H. Mahoor,et al.  A Multiple Kernel Learning approach for human behavioral task classification using STN-LFP signal , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[17]  D J McFarland,et al.  Brain-computer interface research at the Wadsworth Center. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[18]  Gunnar Rätsch,et al.  Large Scale Multiple Kernel Learning , 2006, J. Mach. Learn. Res..

[19]  Mohammad H. Mahoor,et al.  An FFT-based synchronization approach to recognize human behaviors using STN-LFP signal , 2016, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[20]  Grant D. Huang,et al.  Pallidal versus subthalamic deep-brain stimulation for Parkinson's disease. , 2010, The New England journal of medicine.

[21]  M. Kloft,et al.  l p -Norm Multiple Kernel Learning , 2011 .

[22]  Klaus-Robert Müller,et al.  Combining Features for BCI , 2002, NIPS.

[23]  Mohammad H. Mahoor,et al.  Single trial behavioral task classification using subthalamic nucleus local field potential signals , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[24]  Touradj Ebrahimi,et al.  An efficient P300-based brain–computer interface for disabled subjects , 2008, Journal of Neuroscience Methods.

[25]  M. Mahoor,et al.  Facial expression recognition using lp-norm MKL multiclass-SVM , 2015 .

[26]  Gilles Blanchard,et al.  BCI competition 2003-data set IIa: spatial patterns of self-controlled brain rhythm modulations , 2004, IEEE Transactions on Biomedical Engineering.

[27]  R. Vaidyanathan,et al.  Movement decoding using neural synchronization and inter-hemispheric connectivity from deep brain local field potentials , 2015, Journal of neural engineering.

[28]  Banghua Yang,et al.  EEG Classification Based on Artificial Neural Network in Brain Computer Interface , 2010 .

[29]  Abdulhamit Subasi,et al.  Classification of EEG signals using neural network and logistic regression , 2005, Comput. Methods Programs Biomed..

[30]  G. Pfurtscheller,et al.  Rapid prototyping of an EEG-based brain-computer interface (BCI) , 2001, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[31]  Mohammad H. Mahoor,et al.  Motor task event detection using Subthalamic Nucleus Local Field Potentials , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[32]  P. Brown,et al.  Adaptive Deep Brain Stimulation In Advanced Parkinson Disease , 2013, Annals of neurology.

[33]  Jorge Iriarte,et al.  Coupling between Beta and High-Frequency Activity in the Human Subthalamic Nucleus May Be a Pathophysiological Mechanism in Parkinson's Disease , 2010, The Journal of Neuroscience.

[34]  Ethem Alpaydin,et al.  Multiple Kernel Learning Algorithms , 2011, J. Mach. Learn. Res..

[35]  John P. Donoghue,et al.  Decoding 3-D Reach and Grasp Kinematics From High-Frequency Local Field Potentials in Primate Primary Motor Cortex , 2010, IEEE Transactions on Biomedical Engineering.

[36]  P. Brown,et al.  Online prediction of self-paced hand-movements from subthalamic activity using neural networks in Parkinson’s disease , 2004, Journal of Neuroscience Methods.

[37]  Stefan Haufe,et al.  Single-trial analysis and classification of ERP components — A tutorial , 2011, NeuroImage.

[38]  Vladimir Bostanov,et al.  BCI competition 2003-data sets Ib and IIb: feature extraction from event-related brain potentials with the continuous wavelet transform and the t-value scalogram , 2004, IEEE Transactions on Biomedical Engineering.

[39]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[40]  Kaushik Majumdar Constraining Minimum-Norm Inverse by Phase Synchronization and Signal Power of the Scalp EEG Channels , 2009, IEEE Transactions on Biomedical Engineering.

[41]  Dennis J. McFarland,et al.  Electroencephalographic(EEG)-based communication: EEG control versus system performance in humans , 2003, Neuroscience Letters.

[42]  Y. Agid,et al.  Long‐term results of a multicenter study on subthalamic and pallidal stimulation in Parkinson's disease , 2010, Movement disorders : official journal of the Movement Disorder Society.

[43]  Yuanqing Li,et al.  A self-training semi-supervised SVM algorithm and its application in an EEG-based brain computer interface speller system , 2008, Pattern Recognit. Lett..

[44]  R Thull,et al.  Vergleichende Untersuchungen zur Eignung eines neuen Oberflächenkonditionierungsverfahrens (Airsonic Mini Sandblaster®) in der Klebebrückentechnik / Comparative Studies on the Applicability of a New Surface Conditioning System (Airsonic Mini Sandblaster®) in Adhesive Bridging Technic , 2004, Biomedizinische Technik. Biomedical engineering.

[45]  B. Blankertz,et al.  (C)overt attention and visual speller design in an ERP-based brain-computer interface , 2010, Behavioral and Brain Functions.

[46]  Alberto Priori,et al.  Subthalamic local field potentials after seven-year deep brain stimulation in Parkinson's disease , 2012, Experimental Neurology.

[47]  Yong Hoon Lim,et al.  Reprogramming guided by the fused images of MRI and CT in subthalamic nucleus stimulation in Parkinson disease , 2010, Clinical Neurology and Neurosurgery.

[48]  H. Bergman,et al.  Pathological synchronization in Parkinson's disease: networks, models and treatments , 2007, Trends in Neurosciences.

[49]  Patrick Celka,et al.  Statistical Analysis of the Phase-Locking Value , 2007, IEEE Signal Processing Letters.

[50]  I. Jolliffe Principal Component Analysis , 2002 .

[51]  Klaus-Robert Müller,et al.  Classifying Single Trial EEG: Towards Brain Computer Interfacing , 2001, NIPS.

[52]  Christa Neuper,et al.  An asynchronously controlled EEG-based virtual keyboard: improvement of the spelling rate , 2004, IEEE Transactions on Biomedical Engineering.

[53]  Mohammad H. Mahoor,et al.  Facial expression recognition using lp\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$${l}_{p}$$\end{document}-norm MKL , 2015, Machine Vision and Applications.

[54]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces , 2007, Journal of neural engineering.

[55]  S. Haber,et al.  Closed-Loop Deep Brain Stimulation Is Superior in Ameliorating Parkinsonism , 2011, Neuron.

[56]  Klaus-Robert Müller,et al.  Increase Information Transfer Rates in BCI by CSP Extension to Multi-class , 2003, NIPS.