Deep Learning-Based Deep Brain Stimulation Targeting and Clinical Applications

Background The purpose of the present study was to evaluate deep learning-based image-guided surgical planning for deep brain stimulation (DBS). We developed deep learning semantic segmentation-based DBS targeting and prospectively applied the method clinically. Methods T2∗ fast gradient-echo images from 102 patients were used for training and validation. Manually drawn ground truth information was prepared for the subthalamic and red nuclei with an axial cut ∼4 mm below the anterior–posterior commissure line. A fully convolutional neural network (FCN-VGG-16) was used to ensure margin identification by semantic segmentation. Image contrast augmentation was performed nine times. Up to 102 original images and 918 augmented images were used for training and validation. The accuracy of semantic segmentation was measured in terms of mean accuracy and mean intersection over the union. Targets were calculated based on their relative distance from these segmented anatomical structures considering the Bejjani target. Results Mean accuracies and mean intersection over the union values were high: 0.904 and 0.813, respectively, for the 62 training images, and 0.911 and 0.821, respectively, for the 558 augmented training images when 360 augmented validation images were used. The Dice coefficient converted from the intersection over the union was 0.902 when 720 training and 198 validation images were used. Semantic segmentation was adaptive to high anatomical variations in size, shape, and asymmetry. For clinical application, two patients were assessed: one with essential tremor and another with bradykinesia and gait disturbance due to Parkinson’s disease. Both improved without complications after surgery, and microelectrode recordings showed subthalamic nuclei signals in the latter patient. Conclusion The accuracy of deep learning-based semantic segmentation may surpass that of previous methods. DBS targeting and its clinical application were made possible using accurate deep learning-based semantic segmentation, which is adaptive to anatomical variations.

[1]  Silvio Savarese,et al.  Generalized Intersection Over Union: A Metric and a Loss for Bounding Box Regression , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Nicolas Guizard,et al.  Investigation of morphometric variability of subthalamic nucleus, red nucleus, and substantia nigra in advanced Parkinson's disease patients using automatic segmentation and PCA‐based analysis , 2014, Human brain mapping.

[3]  Keyoumars Ashkan,et al.  Optimal MRI methods for direct stereotactic targeting of the subthalamic nucleus and globus pallidus , 2010, European Radiology.

[4]  Alastair J. Martin,et al.  Comparison of Deep Brain Stimulation Lead Targeting Accuracy and Procedure Duration between 1.5- and 3-Tesla Interventional Magnetic Resonance Imaging Systems: An Initial 12-Month Experience , 2016, Stereotactic and Functional Neurosurgery.

[5]  L. Bour,et al.  Can We Rely on Susceptibility-Weighted Imaging for Subthalamic Nucleus Identification in Deep Brain Stimulation Surgery? , 2016, Neurosurgery.

[6]  M. Jahanshahi,et al.  MRI-guided STN DBS in Parkinson's disease without microelectrode recording: efficacy and safety , 2010, Journal of Neurology, Neurosurgery & Psychiatry.

[7]  K. Ashkan,et al.  Localisation of DBS Electrodes Post-Implantation, to CT or MRI? Which Is the Best Option? , 2018, Stereotactic and Functional Neurosurgery.

[8]  S. Gill,et al.  Comparison of Atlas- and Magnetic-Resonance-Imaging-Based Stereotactic Targeting of the Subthalamic Nucleus in the Surgical Treatment of Parkinson’s Disease , 2008, Stereotactic and Functional Neurosurgery.

[9]  L. J. Hardies,et al.  An Optimized Individual Target Brain in the Talairach Coordinate System , 2002, NeuroImage.

[10]  A. Horn,et al.  Optimization and comparative evaluation of nonlinear deformation algorithms for atlas-based segmentation of DBS target nuclei , 2019, NeuroImage.

[11]  Karl Kiening,et al.  Spatial Distortion in MRI-Guided Stereotactic Procedures: Evaluation in 1.5-, 3- and 7-Tesla MRI Scanners , 2015, Stereotactic and Functional Neurosurgery.

[12]  S. Tisch,et al.  Deep brain stimulation in the posterior subthalamic area in the treatment of essential tremor , 2010, Movement disorders : official journal of the Movement Disorder Society.

[13]  Marwan I. Hariz,et al.  Safety and Risk of Microelectrode Recording in Surgery for Movement Disorders , 2003, Stereotactic and Functional Neurosurgery.

[14]  G Rees Cosgrove,et al.  Experience with Microelectrode Guided Subthalamic Nucleus Deep Brain Stimulation , 2006, Neurosurgery.

[15]  C. Chung,et al.  Postoperative seizure outcome-guided machine learning for interictal electrocorticography in neocortical epilepsy. , 2018, Journal of neurophysiology.

[16]  M. Jahanshahi,et al.  Long-term outcome of subthalamic nucleus deep brain stimulation for Parkinson's disease using an MRI-guided and MRI-verified approach , 2014, Journal of Neurology, Neurosurgery & Psychiatry.

[17]  Seyed-Ahmad Ahmadi,et al.  Hough-CNN: Deep learning for segmentation of deep brain regions in MRI and ultrasound , 2016, Comput. Vis. Image Underst..

[18]  M. Hariz,et al.  Variability of the subthalamic nucleus: The case for direct MRI guided targeting , 2007, British journal of neurosurgery.

[19]  Pablo Guillén-Rondon,et al.  Deep Brain Stimulation Signal Classification Using Deep Belief Networks , 2016, 2016 International Conference on Computational Science and Computational Intelligence (CSCI).

[20]  Geraint Rees,et al.  Clinically applicable deep learning for diagnosis and referral in retinal disease , 2018, Nature Medicine.

[21]  Benoit M Dawant,et al.  Fully automated targeting using nonrigid image registration matches accuracy and exceeds precision of best manual approaches to subthalamic deep brain stimulation targeting in Parkinson disease. , 2015, Neurosurgery.

[22]  C. Lee,et al.  Systematic Stereotactic Error Reduction Using a Calibration Technique in Single-Brain-Pass and Multitrack Deep Brain Stimulations. , 2018, Operative neurosurgery.

[23]  Alexandre Mendes,et al.  Intraoperative micro‐ and macrostimulation of the subthalamic nucleus in Parkinson's disease , 2002, Movement disorders : official journal of the Movement Disorder Society.

[24]  Mark Jenkinson,et al.  Automated segmentation of the substantia nigra, subthalamic nucleus and red nucleus in 7 T data at young and old age , 2016, NeuroImage.

[25]  Ron Kikinis,et al.  Fully automatic catheter segmentation in MRI with 3D convolutional neural networks: application to MRI-guided gynecologic brachytherapy , 2019, Physics in medicine and biology.

[26]  S. Tisch,et al.  Deep brain stimulation of the posterior subthalamic area in the treatment of movement disorders , 2012 .

[27]  S. Chiou,et al.  1.5T versus 3T MRI for targeting subthalamic nucleus for deep brain stimulation , 2014, British journal of neurosurgery.

[28]  Guillermo Sapiro,et al.  Microelectrode Recordings Validate the Clinical Visualization of Subthalamic-Nucleus Based on 7T Magnetic Resonance Imaging and Machine Learning for Deep Brain Stimulation Surgery , 2019, Neurosurgery.

[29]  Takashi Hanakawa,et al.  A novel composite targeting method using high-field magnetic resonance imaging for subthalamic nucleus deep brain stimulation. , 2009, Journal of neurosurgery.

[30]  P. Starr,et al.  Implantation of deep brain stimulators into the subthalamic nucleus: technical approach and magnetic resonance imaging-verified lead locations. , 2002, Journal of neurosurgery.

[31]  Thomas Foltynie,et al.  Improving Targeting in Image-Guided Frame-Based Deep Brain Stimulation , 2010, Neurosurgery.

[32]  C. Lee,et al.  Comparison of the Stereotactic Accuracies of Function-Guided Deep Brain Stimulation, Calculated Using Multitrack Target Locations Geometrically Inferred from Three-Dimensional Trajectory Rotations, and of Magnetic Resonance Imaging-Guided Deep Brain Stimulation and Outcomes. , 2017, World neurosurgery.

[33]  S. Gill,et al.  Bilateral stimulation of the caudal zona incerta nucleus for tremor control , 2007, Journal of Neurology, Neurosurgery, and Psychiatry.

[34]  Kemal Tuncali,et al.  Automatic Needle Segmentation and Localization in MRI With 3-D Convolutional Neural Networks: Application to MRI-Targeted Prostate Biopsy , 2019, IEEE Transactions on Medical Imaging.

[35]  R A Bakay,et al.  Magnetic resonance imaging-based stereotactic localization of the globus pallidus and subthalamic nucleus. , 1999, Neurosurgery.

[36]  Comparison of magnetic resonance imaging sequences for depicting the subthalamic nucleus for deep brain stimulation , 2014, Radiological Physics and Technology.

[37]  C. Naylor,et al.  On the Prospects for a (Deep) Learning Health Care System , 2018, JAMA.

[38]  Jean-Marc Constans,et al.  High-resolution 3-dimensional T2*-weighted angiography (HR 3-D SWAN): an optimized 3-T magnetic resonance imaging sequence for targeting the subthalamic nucleus. , 2014, Neurosurgery.

[39]  S. Ellias,et al.  Assessment of the variability in the anatomical position and size of the subthalamic nucleus among patients with advanced Parkinson’s disease using magnetic resonance imaging , 2010, Acta Neurochirurgica.

[40]  Sang Joon Kim,et al.  Three-dimensional fluid-attenuated inversion recovery sequence for visualisation of subthalamic nucleus for deep brain stimulation in Parkinson’s disease , 2015, Neuroradiology.

[41]  Purang Abolmaesumi,et al.  DeepInfer: open-source deep learning deployment toolkit for image-guided therapy , 2017, Medical Imaging.

[42]  Raghav Mehta,et al.  M-net: A Convolutional Neural Network for deep brain structure segmentation , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[43]  Chiung-Chu Chen,et al.  Indirect Targeting of Subthalamic Deep Brain Stimulation Guided by Stereotactic Computed Tomography and Microelectrode Recordings in Patients With Parkinson’s Disease , 2018, Front. Hum. Neurosci..

[44]  Marcus A. Badgeley,et al.  Variable generalization performance of a deep learning model to detect pneumonia in chest radiographs: A cross-sectional study , 2018, PLoS medicine.

[45]  Gary Marcus,et al.  Deep Learning: A Critical Appraisal , 2018, ArXiv.

[46]  C. Groden,et al.  Visualisation of the Zona Incerta for Deep Brain Stimulation at 3.0 Tesla , 2012, Clinical Neuroradiology.

[47]  Lars Gerigk,et al.  The subthalamic nucleus at 3.0 Tesla: choice of optimal sequence and orientation for deep brain stimulation using a standard installation protocol: clinical article. , 2012, Journal of neurosurgery.

[48]  L. R. Dice Measures of the Amount of Ecologic Association Between Species , 1945 .

[49]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[50]  Benoit M. Dawant,et al.  Towards Machine Learning Prediction of Deep Brain Stimulation (DBS) Intra-operative Efficacy Maps , 2019, Medical Imaging: Image Processing.

[51]  Guillermo Sapiro,et al.  Automatic Localization of the Subthalamic Nucleus on Patient-Specific Clinical MRI by Incorporating 7T MRI and Machine Learning: Application in Deep Brain Stimulation , 2018, bioRxiv.

[52]  Paul M. Thompson,et al.  An Optimized Individual Target Brain in the Talairach Coordinate System , 2002, NeuroImage.

[53]  Kyong Hwan Jin,et al.  Fast and robust segmentation of the striatum using deep convolutional neural networks , 2016, Journal of Neuroscience Methods.

[54]  Y. Agid,et al.  Bilateral subthalamic stimulation for Parkinson's disease by using three-dimensional stereotactic magnetic resonance imaging and electrophysiological guidance. , 2000, Journal of neurosurgery.

[55]  Gabriele Schackert,et al.  Accuracy of subthalamic nucleus targeting by T2, FLAIR and SWI-3-Tesla MRI confirmed by microelectrode recordings , 2015, Acta Neurochirurgica.

[56]  B. Forstmann,et al.  Can We Rely on Susceptibility-Weighted Imaging (SWI) for Subthalamic Nucleus Identification in Deep Brain Stimulation Surgery? , 2016, Neurosurgery.