DeLTA-BIT: an open-source probabilistic tractography-based deep learning framework for thalamic targeting in functional neurological disorders

In the last years there has been a growing interest in the applications of diffusion tractography for target identification in neurofunctional disorders for an increasingly tailored approach. The growing diffusion of well-established neurosurgical procedures as deep brain stimulation (DBS) and trans-cranial Magnetic Resonance-guided Focused Ultrasound (tcMRgFUS) favored this trend. Tractography can indeed provide more accurate, patient-specific, information about the targeted region if compared to stereotactic atlases. On the other hand, this tractography-based approachs is not very physician-friendly, and its heavily time consuming since needs several hours for Magnetic Resonance Imaging (MRI) data processing. In this study we propose a novel open-source deep learning framework called DeLTA-BIT (acronym of Deep-learning Local TrActography for BraIn Targeting) for reconstructing thalamic probabilistic tractography maps enabling a personalized (patient-specific) target identification for functional neurological disorders. The proposed framework exploits two convolutional neural networks (CNNs) to segment the thalamus and reconstruct the connectivity map between each voxel inside the thalamus and any user-specified target cortical or subcortical masks. These CNNs were trained, validated, and tested on the datasets from the Human Connectome Project (HCP) database. Our results are comparable with the state-of-the-art data-driven segmentation and probabilistic tractography and demonstrate the high performance of proposed networks for personalized thalamic target identification with a Dice coefficient of 0.93 +/- 0.01 for thalamus segmentation and a Dice Similarity Coefficient for the projection to the precentral gyrus from the thalamus of 0.80 +/- 0.06. The code of these models is freely available on GitHub.

[1]  M. Contarino,et al.  Perspectives of Implementation of Closed-Loop Deep Brain Stimulation: From Neurological to Psychiatric Disorders , 2023, Stereotactic and Functional Neurosurgery.

[2]  Joel Maamary,et al.  Outcomes of Focused Ultrasound Thalamotomy in Tremor Syndromes. , 2023, Movement disorders : official journal of the Movement Disorder Society.

[3]  J. Rissardo,et al.  Deep Brain Stimulation for the Management of Refractory Neurological Disorders: A Comprehensive Review , 2023, Medicina.

[4]  K. Hynynen,et al.  Safety of Bilateral Staged Magnetic Resonance‐Guided Focused Ultrasound Thalamotomy for Essential Tremor , 2023, Movement disorders clinical practice.

[5]  N. McDannold,et al.  Focused Ultrasound Thalamotomy for Tremor in Parkinson's Disease: Outcomes in a Large, Prospective Cohort , 2023, Movement disorders : official journal of the Movement Disorder Society.

[6]  J. Constans,et al.  Stereotactic robot-assisted MRI-guided laser interstitial thermal therapy thalamotomy for medically intractable Parkinson’s disease tremor: technical note and preliminary effects on 2 cases , 2023, Acta Neurochirurgica.

[7]  Kathryn N. Kearns,et al.  Patient-Reported Outcomes After Focused Ultrasound Thalamotomy for Tremor-Predominant Parkinson's Disease , 2023, Neurosurgery.

[8]  G. Menegaz,et al.  Thalamus Segmentation Using Deep Learning with Diffusion MRI Data: An Open Benchmark , 2023, Applied Sciences.

[9]  D. Agrawal,et al.  Role of Gamma Knife Radiosurgery in the Management of Functional Disorders – A Literature Review , 2023, Neurology India.

[10]  B. Bernhardt,et al.  Magnetic resonance‐guided laser interstitial thermal therapy for drug‐resistant epilepsy: A systematic review and individual participant data meta‐analysis , 2023, Epilepsia.

[11]  D. Jeanmonod,et al.  Magnetic resonance-guided focused ultrasound central lateral thalamotomy against chronic and therapy-resistant neuropathic pain: retrospective long-term follow-up analysis of 63 interventions. , 2023, Journal of neurosurgery.

[12]  Sarah R. Heilbronner,et al.  Proceedings of the 10th annual deep brain stimulation think tank: Advances in cutting edge technologies, artificial intelligence, neuromodulation, neuroethics, interventional psychiatry, and women in neuromodulation , 2023, Frontiers in Human Neuroscience.

[13]  Rajiv Chopra,et al.  Focused ultrasound using a novel targeting method four-tract tractography for magnetic resonance–guided high-intensity focused ultrasound targeting , 2022, Brain communications.

[14]  T. Taira,et al.  Magnetic resonance-guided focused ultrasound for the treatment of tremor , 2022, Expert review of neurotherapeutics.

[15]  L. Zrinzo,et al.  Stereotactic Radiofrequency Ablation for Treatment-Refractory Depression: A Systematic Review and Meta-Analysis , 2022, Brain sciences.

[16]  S. Bohlega,et al.  Tremor in Parkinson’s Disease: From Pathophysiology to Advanced Therapies , 2022, Tremor and other hyperkinetic movements.

[17]  M. Nazem-Zadeh,et al.  Transformer-Based Framework for Fiber Orientation Estimation & Tractography , 2022, SSRN Electronic Journal.

[18]  K. Hynynen,et al.  Magnetic resonance imaging–guided focused ultrasound thalamotomy for essential tremor: 5-year follow-up results , 2022, Journal of neurosurgery.

[19]  C. Blaha,et al.  Deep Brain Stimulation for Addictive Disorders—Where Are We Now? , 2022, Neurotherapeutics.

[20]  G. Deuschl,et al.  Proceedings of the Ninth Annual Deep Brain Stimulation Think Tank: Advances in Cutting Edge Technologies, Artificial Intelligence, Neuromodulation, Neuroethics, Pain, Interventional Psychiatry, Epilepsy, and Traumatic Brain Injury , 2022, Frontiers in Human Neuroscience.

[21]  L. Lopiano,et al.  Deep brain stimulation for atypical parkinsonism: A systematic review on efficacy and safety. , 2022, Parkinsonism & related disorders.

[22]  Itir Onal Ertugrul,et al.  Long-term ecological assessment of intracranial electrophysiology synchronized to behavioral markers in obsessive-compulsive disorder , 2021, Nature Medicine.

[23]  Taylor J. Abel,et al.  Stereotactic laser interstitial thermal therapy corpus callosotomy for the treatment of pediatric drug‐resistant epilepsy , 2021, Epilepsia open.

[24]  A. Bilgin,et al.  Convolutional Neural Network Based Frameworks for Fast Automatic Segmentation of Thalamic Nuclei from Native and Synthesized Contrast Structural MRI , 2021, Neuroinformatics.

[25]  J. Guridi,et al.  The role of tractography in the localisation of the Vim nucleus of the thalamus and the dentatorubrothalamic tract for the treatment of tremor. , 2021, Neurologia.

[26]  K. Chakravarthy,et al.  Latest Evidence-Based Application for Radiofrequency Neurotomy (LEARN): Best Practice Guidelines from the American Society of Pain and Neuroscience (ASPN) , 2021, Journal of pain research.

[27]  J. Volkmann,et al.  Deep Brain Stimulation for Tremor: Update on Long-Term Outcomes, Target Considerations and Future Directions , 2021, Journal of clinical medicine.

[28]  A. Ricci,et al.  Comparative evaluation of tractography-based direct targeting and atlas-based indirect targeting of the ventral intermediate (Vim) nucleus in MRgFUS thalamotomy , 2021, Scientific Reports.

[29]  M. Frye,et al.  Double blind randomized controlled trial of deep brain stimulation for obsessive-compulsive disorder: Clinical trial design , 2021, Contemporary clinical trials communications.

[30]  J. Yeatman,et al.  Diffusional Kurtosis Imaging in the Diffusion Imaging in Python Project , 2021, bioRxiv.

[31]  E. Storch,et al.  Harmonizing the Neurobiology and Treatment of Obsessive-Compulsive Disorder. , 2021, The American journal of psychiatry.

[32]  Cesare Gagliardo,et al.  Focused Ultrasound in Neuroscience. State of the Art and Future Perspectives , 2021, Brain sciences.

[33]  M. D’Amelio,et al.  Transcranial Magnetic Resonance Imaging-Guided Focused Ultrasound with a 1.5 Tesla Scanner: A Prospective Intraindividual Comparison Study of Intraoperative Imaging , 2021, Brain sciences.

[34]  Jens Petersen,et al.  nnU-Net: a self-configuring method for deep learning-based biomedical image segmentation , 2020, Nature Methods.

[35]  Pierre-Marc Jodoin,et al.  Track-To-Learn: A general framework for tractography with deep reinforcement learning , 2020, bioRxiv.

[36]  Joachim M. Buhmann,et al.  Entrack: Probabilistic Spherical Regression with Entropy Regularization for Fiber Tractography , 2020, International Journal of Computer Vision.

[37]  I. Parees,et al.  Gamma Knife® stereotactic radiosurgery as a treatment for essential and parkinsonian tremor: long-term experience. , 2020, Neurologia.

[38]  B. Rutt,et al.  Automated thalamic nuclei segmentation using multi-planar cascaded convolutional neural networks. , 2020, Magnetic resonance imaging.

[39]  Daniel J Blezek,et al.  MRI and tractography techniques to localize the ventral intermediate nucleus and dentatorubrothalamic tract for deep brain stimulation and MR-guided focused ultrasound: a narrative review and update. , 2020, Neurosurgical focus.

[40]  Jaime Fern'andez del R'io,et al.  Array programming with NumPy , 2020, Nature.

[41]  D. Blezek,et al.  Advanced MRI techniques for transcranial high intensity focused ultrasound targeting. , 2020, Brain : a journal of neurology.

[42]  C. Catalano,et al.  Intraoperative imaging findings in transcranial MR imaging-guided focused ultrasound treatment at 1.5T may accurately detect typical lesional findings correlated with sonication parameters , 2020, European Radiology.

[43]  E. Louis,et al.  Essential tremor pathology: neurodegeneration and reorganization of neuronal connections , 2020, Nature Reviews Neurology.

[44]  Jean-Philippe Thiran,et al.  Comparison of MRI-based automated segmentation methods and functional neurosurgery targeting with direct visualization of the Ventro-intermediate thalamic nucleus at 7T , 2019, Scientific Reports.

[45]  C. Catalano,et al.  Transcranial magnetic resonance-guided focused ultrasound surgery at 1.5T: a technical note , 2018, The neuroradiology journal.

[46]  Tammy Riklin-Raviv,et al.  DeepTract: A Probabilistic Deep Learning Framework for White Matter Fiber Tractography , 2018, MICCAI.

[47]  Suneil K. Kalia,et al.  Outcomes from stereotactic surgery for essential tremor , 2018, Journal of Neurology, Neurosurgery, and Psychiatry.

[48]  Stephen M. Smith,et al.  Using GPUs to accelerate computational diffusion MRI: From microstructure estimation to tractography and connectomes , 2018, NeuroImage.

[49]  Volker A. Coenen,et al.  HAMLET: Hierarchical Harmonic Filters for Learning Tracts from Diffusion MRI , 2018, ArXiv.

[50]  J. E. Iglesias,et al.  A probabilistic atlas of the human thalamic nuclei combining ex vivo MRI and histology , 2018, NeuroImage.

[51]  Peter F. Neher,et al.  Tract orientation mapping for bundle-specific tractography , 2018, MICCAI.

[52]  Peter F. Neher,et al.  TractSeg - Fast and accurate white matter tract segmentation , 2018, NeuroImage.

[53]  M. Wintermark,et al.  Diffusion MRI tractography for improved transcranial MRI-guided focused ultrasound thalamotomy targeting for essential tremor , 2018, NeuroImage: Clinical.

[54]  Joachim M. Buhmann,et al.  Data-driven fiber tractography with neural networks , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[55]  M. Knopp,et al.  Prospective Tractography-Based Targeting for Improved Safety of Focused Ultrasound Thalamotomy , 2018, Neurosurgery.

[56]  C. Catalano,et al.  Preliminary experience with a transcranial magnetic resonance-guided focused ultrasound surgery system integrated with a 1.5-T MRI unit in a series of patients with essential tremor and Parkinson's disease. , 2018, Neurosurgical focus.

[57]  N. Pouratian,et al.  The potential value of probabilistic tractography-based for MR-guided focused ultrasound thalamotomy for essential tremor , 2017, NeuroImage: Clinical.

[58]  Peter F. Neher,et al.  The challenge of mapping the human connectome based on diffusion tractography , 2017, Nature Communications.

[59]  Edward A. Monaco,et al.  Stereotactic radiosurgery for medically refractory multiple sclerosis-related tremor. , 2017, Journal of neurosurgery.

[60]  Peter F. Neher,et al.  Learn to Track: Deep Learning for Tractography , 2017, bioRxiv.

[61]  K. Bhatia,et al.  Unilateral cerebellothalamic tract ablation in essential tremor by MRI-guided focused ultrasound , 2017, Neurology.

[62]  G. Litjens,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[63]  Y. Higuchi,et al.  Gamma knife radiosurgery in movement disorders: Indications and limitations , 2017, Movement disorders : official journal of the Movement Disorder Society.

[64]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[65]  Dorit Merhof,et al.  Direct Estimation of Fiber Orientations Using Deep Learning in Diffusion Imaging , 2016, MLMI@MICCAI.

[66]  K. Hynynen,et al.  A Randomized Trial of Focused Ultrasound Thalamotomy for Essential Tremor. , 2016, The New England journal of medicine.

[67]  A. Lozano,et al.  Tractography‐Based Ventral Intermediate Nucleus Targeting: Novel Methodology and Intraoperative Validation , 2016, Movement disorders : official journal of the Movement Disorder Society.

[68]  T. Luo,et al.  Essential tremor is associated with disruption of functional connectivity in the ventral intermediate Nucleus—Motor Cortex—Cerebellum circuit , 2016, Human brain mapping.

[69]  Peter F. Neher,et al.  A Machine Learning Based Approach to Fiber Tractography Using Classifier Voting , 2015, MICCAI.

[70]  P. Brown,et al.  Distinguishing the Central Drive to Tremor in Parkinson's Disease and Essential Tremor , 2015, The Journal of Neuroscience.

[71]  D. Weaver Alzheimer's , 2014, Neurology.

[72]  Elan D. Louis,et al.  How Many People in the USA Have Essential Tremor? Deriving a Population Estimate Based on Epidemiological Data , 2014, Tremor and other hyperkinetic movements.

[73]  M. Wintermark,et al.  Imaging Findings in MR Imaging–Guided Focused Ultrasound Treatment for Patients with Essential Tremor , 2014, American Journal of Neuroradiology.

[74]  N. Tustison,et al.  Thalamic connectivity in patients with essential tremor treated with MR imaging-guided focused ultrasound: in vivo fiber tracking by using diffusion-tensor MR imaging. , 2014, Radiology.

[75]  Timothy Edward John Behrens,et al.  Effects of image reconstruction on fiber orientation mapping from multichannel diffusion MRI: Reducing the noise floor using SENSE , 2013, Magnetic resonance in medicine.

[76]  Essa Yacoub,et al.  The WU-Minn Human Connectome Project: An overview , 2013, NeuroImage.

[77]  Mark Jenkinson,et al.  The minimal preprocessing pipelines for the Human Connectome Project , 2013, NeuroImage.

[78]  John Gardner,et al.  A history of deep brain stimulation: Technological innovation and the role of clinical assessment tools , 2013, Social Studies of Science.

[79]  Jonathan Trinastic,et al.  Delineation of motor and somatosensory thalamic subregions utilizing probabilistic diffusion tractography and electrophysiology , 2013, Journal of magnetic resonance imaging : JMRI.

[80]  G. Deuschl,et al.  The oscillating central network of Essential tremor , 2012, Clinical Neurophysiology.

[81]  Morten L Kringelbach,et al.  Contrasting Connectivity of the Ventralis Intermedius and Ventralis Oralis Posterior Nuclei of the Motor Thalamus Demonstrated by Probabilistic Tractography , 2012, Neurosurgery.

[82]  Sang Ho Ahn,et al.  Dentatorubrothalamic tract in human brain: diffusion tensor tractography study , 2011, Neuroradiology.

[83]  V. Visser-Vandewalle,et al.  Double-blind clinical trial of thalamic stimulation in patients with Tourette syndrome. , 2011, Brain : a journal of neurology.

[84]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[85]  E. Louis,et al.  How common is the most common adult movement disorder? Update on the worldwide prevalence of essential tremor , 2010, Movement disorders : official journal of the Movement Disorder Society.

[86]  Mark W. Woolrich,et al.  Bayesian analysis of neuroimaging data in FSL , 2009, NeuroImage.

[87]  M. Catani,et al.  A diffusion tensor imaging tractography atlas for virtual in vivo dissections , 2008, Cortex.

[88]  J. Raethjen,et al.  Tremor , 2008, Der Nervenarzt.

[89]  Y. Kaji,et al.  Magnetic resonance-guided focused ultrasound surgery for uterine fibroids: relationship between the therapeutic effects and signal intensity of preexisting T2-weighted magnetic resonance images. , 2007, American journal of obstetrics and gynecology.

[90]  Mark W. Woolrich,et al.  Probabilistic diffusion tractography with multiple fibre orientations: What can we gain? , 2007, NeuroImage.

[91]  S. Rasmussen,et al.  The Brown Longitudinal Obsessive Compulsive Study: clinical features and symptoms of the sample at intake. , 2006, The Journal of clinical psychiatry.

[92]  Mark W. Woolrich,et al.  Advances in functional and structural MR image analysis and implementation as FSL , 2004, NeuroImage.

[93]  Timothy Edward John Behrens,et al.  Characterization and propagation of uncertainty in diffusion‐weighted MR imaging , 2003, Magnetic resonance in medicine.

[94]  Timothy Edward John Behrens,et al.  Non-invasive mapping of connections between human thalamus and cortex using diffusion imaging , 2003, Nature Neuroscience.

[95]  K. Kultas‐Ilinsky,et al.  Motor thalamic circuits in primates with emphasis on the area targeted in treatment of movement disorders , 2002, Movement disorders : official journal of the Movement Disorder Society.

[96]  M. Jenike Obsessive compulsive disorder. , 1983, Comprehensive psychiatry.

[97]  R. Young,et al.  Radiosurgical Pallidotomy for Parkinson's Disease. , 2018, Progress in neurological surgery.

[98]  T. Taira,et al.  Stereotactic Radiofrequency Lesioning for Movement Disorders. , 2018, Progress in neurological surgery.

[99]  Dorit Merhof,et al.  Reconstruction of Diffusion Anisotropies Using 3D Deep Convolutional Neural Networks in Diffusion Imaging , 2017 .

[100]  C. Catalano,et al.  Restoring Neurological Physiology: The Innovative Role of High-Energy MR-Guided Focused Ultrasound (HIMRgFUS). Preliminary Data from a New Method of Lesioning Surgery. , 2017, Acta neurochirurgica. Supplement.

[101]  M. Wintermark,et al.  Transcranial MR-Guided Focused Ultrasound: A Review of the Technology and Neuro Applications , 2015 .

[102]  P. Pal,et al.  Quality of life and its determinants in essential tremor. , 2013, Parkinsonism & related disorders.

[103]  M. Gelabert-González,et al.  [Deep brain stimulation in Parkinson's disease]. , 2013, Revista de neurologia.

[104]  D. Jeanmonod,et al.  Measurement of targeting accuracy in focused ultrasound functional neurosurgery. , 2012, Neurosurgical focus.

[105]  D. Marcus,et al.  Obscuring Surface Anatomy in Volumetric Imaging Data , 2012, Neuroinformatics.

[106]  J. Hubble,et al.  Essential tremor. , 1989, Clinical neuropharmacology.

[107]  N. Otsu A Threshold Selection Method from Gray-Level Histograms , 1979, IEEE Trans. Syst. Man Cybern..