Optimizing Time-Frequency Feature Extraction and Channel Selection through Gradient Backpropagation to Improve Action Decoding based on Subthalamic Local Field Potentials

Neural oscillating patterns, or time-frequency features, predicting voluntary motor intention, can be extracted from the local field potentials (LFPs) recorded from the sub-thalamic nucleus (STN) or thalamus of human patients implanted with deep brain stimulation (DBS) electrodes for the treatment of movement disorders. This paper investigates the optimization of signal conditioning processes using deep learning to augment time-frequency feature extraction from LFP signals, with the aim of improving the performance of real-time decoding of voluntary motor states. A brain-computer interface (BCI) pipeline capable of continuously classifying discrete pinch grip states from LFPs was designed in Pytorch, a deep learning framework. The pipeline was implemented offline on LFPs recorded from 5 different patients bilaterally implanted with DBS electrodes. Optimizing channel combination in different frequency bands and frequency domain feature extraction demonstrated improved classification accuracy of pinch grip detection and laterality of the pinch (either pinch of the left hand or pinch of the right hand). Overall, the optimized BCI pipeline achieved a maximal average classification accuracy of 79.67±10.02% when detecting all pinches and 67.06±10.14% when considering the laterality of the pinch.

[1]  Tipu Z. Aziz,et al.  Decoding voluntary movements and postural tremor based on thalamic LFPs as a basis for closed-loop stimulation for essential tremor , 2019, Brain Stimulation.

[2]  Huiling Tan,et al.  Towards Real-Time, Continuous Decoding of Gripping Force From Deep Brain Local Field Potentials , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[3]  R. Vaidyanathan,et al.  Movement decoding using neural synchronization and inter-hemispheric connectivity from deep brain local field potentials , 2015, Journal of neural engineering.

[4]  Jun Dai,et al.  Using High-Frequency Local Field Potentials From Multicortex to Decode Reaching and Grasping Movements in Monkey , 2019, IEEE Transactions on Cognitive and Developmental Systems.

[5]  Tipu Aziz,et al.  Complementary roles of different oscillatory activities in the subthalamic nucleus in coding motor effort in Parkinsonism☆ , 2013, Experimental Neurology.

[6]  C. Pacchetti,et al.  Back to the future: 30th anniversary of deep brain stimulation for Parkinson's disease. , 2017, Functional Neurology.

[7]  Joel Nothman,et al.  SciPy 1.0-Fundamental Algorithms for Scientific Computing in Python , 2019, ArXiv.

[8]  P. Brown,et al.  Subthalamic nucleus beta and gamma activity is modulated depending on the level of imagined grip force , 2017, Experimental Neurology.

[9]  Peter Brown,et al.  Decoding force from deep brain electrodes in Parkinsonian patients , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[10]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .