Automatic cortical target point localisation in MRI for transcranial magnetic stimulation via a multi-resolution convolutional neural network

Transcranial magnetic stimulation (TMS) is a growing therapy for a variety of psychiatric and neurological disorders that arise from or are modulated by cortical regions of the brain represented by singular 3D target points. These target points are often determined manually with assistance from a pre-operative T1-weighted MRI, although there is growing interest in automatic target point localisation using an atlas. However, both approaches can be time-consuming which has an effect on the clinical workflow, and the latter does not take into account patient variability such as the varying number of cortical gyri where these targets are located. This paper proposes a multi-resolution convolutional neural network for point localisation in MR images for a priori defined points in increasingly finely resolved versions of the input image. This approach is both fast and highly memory efficient, allowing it to run in high-throughput centres, and has the capability of distinguishing between patients with high levels of anatomical variability. Preliminary experiments have found the accuracy of this network to be 7.26±5.30\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$7.26\pm 5.30$$\end{document} mm, compared to 9.39±4.63\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$9.39\pm 4.63$$\end{document} mm for deformable registration and 6.94±5.10\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$6.94\pm 5.10$$\end{document} mm for a human expert. For most treatment points, the human expert and proposed CNN statistically significantly outperform registration, but neither statistically significantly outperforms the other, suggesting that the proposed network has human-level performance. The human-level performance of this network indicates that it can improve TMS planning by automatically localising target points in seconds, avoiding more time-consuming registration or manual point localisation processes. This is particularly beneficial for out-of-hospital centres with limited computational resources where TMS is increasingly being administered.

[1]  B. Millet,et al.  Continuous theta burst stimulation over the supplementary motor area in refractory obsessive-compulsive disorder treatment: A randomized sham-controlled trial , 2019, Brain Stimulation.

[2]  Jeffery J. Summers,et al.  Bilateral and unilateral movement training on upper limb function in chronic stroke patients: A TMS study , 2007, Journal of the Neurological Sciences.

[3]  Hans-Peter Meinzer,et al.  Statistical shape models for 3D medical image segmentation: A review , 2009, Medical Image Anal..

[4]  John S. H. Baxter,et al.  Localisation of the subthalamic nucleus in MRI via convolutional neural networks for deep brain stimulation planning , 2020, Medical Imaging: Image-Guided Procedures.

[5]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[6]  S. Pridmore,et al.  Changes to somatosensory detection and pain thresholds following high frequency repetitive TMS of the motor cortex in individuals suffering from chronic pain , 2006, Pain.

[8]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  J. Brunelin,et al.  Impaired Modulation of Corticospinal Excitability in Drug-Free Patients With Major Depressive Disorder: A Theta-Burst Stimulation Study , 2019, Front. Hum. Neurosci..

[10]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[11]  Nam-Jong Paik,et al.  Neuronavigated vs. Conventional Repetitive Transcranial Magnetic Stimulation Method for Virtual Lesioning on the Broca's Area , 2014, Neuromodulation : journal of the International Neuromodulation Society.

[12]  Brian B. Avants,et al.  Symmetric diffeomorphic image registration with cross-correlation: Evaluating automated labeling of elderly and neurodegenerative brain , 2008, Medical Image Anal..

[13]  Thomas R. Knösche,et al.  A novel approach to localize cortical TMS effects , 2019, NeuroImage.

[14]  Alvaro Pascual-Leone,et al.  Noninvasive brain stimulation in Alzheimer's disease: Systematic review and perspectives for the future , 2011, Experimental Gerontology.

[15]  Dean C. Barratt,et al.  Automatic Multi-Organ Segmentation on Abdominal CT With Dense V-Networks , 2018, IEEE Transactions on Medical Imaging.

[16]  S. S. Ayache,et al.  Comparison of “standard” and “navigated” procedures of TMS coil positioning over motor, premotor and prefrontal targets in patients with chronic pain and depression , 2010, Neurophysiologie Clinique/Clinical Neurophysiology.

[17]  P. Fitzgerald,et al.  Optimal transcranial magnetic stimulation coil placement for targeting the dorsolateral prefrontal cortex using novel magnetic resonance image‐guided neuronavigation , 2010, Human brain mapping.

[18]  Thomas R. Knösche,et al.  A novel approach to localize cortical TMS effects , 2020, NeuroImage.

[19]  Mariagiovanna Cantone,et al.  Transcranial magnetic stimulation in Alzheimer’s disease: a neurophysiological marker of cortical hyperexcitability , 2011, Journal of Neural Transmission.