FCNN-based axon segmentation for convection-enhanced delivery optimization

PurposeGlioblastoma multiforme treatment is a challenging task in clinical oncology. Convection- enhanced delivery (CED) is showing encouraging but still suboptimal results due to drug leakages. Numerical models can predict drug distribution within the brain, but require retrieving brain physical properties, such as the axon diameter distribution (ADD), through axon architecture analysis. The goal of this work was to provide an automatic, accurate and fast method for axon segmentation in electronic microscopy images based on fully convolutional neural network (FCNN) as to allow automatic ADD computation.MethodsThe segmentation was performed using a residual FCNN inspired by U-Net and Resnet. The FCNN training was performed exploiting mini-batch gradient descent and the Adam optimizer. The Dice coefficient was chosen as loss function.ResultsThe proposed segmentation method achieved results comparable with already existing methods for axon segmentation in terms of Information Theoretic Scoring ($$0.98\%$$0.98%) with a faster training (5 h on the deployed GPU) and without requiring heavy post-processing (testing time was 0.2 s with a non-optimized code). The ADDs computed from the segmented and ground-truth images were statistically equivalent.ConclusionsThe algorithm proposed in this work allowed fast and accurate axon segmentation and ADD computation, showing promising performance for brain microstructure analysis for CED delivery optimization.

[1]  Julien Cohen-Adad,et al.  AxonDeepSeg: automatic axon and myelin segmentation from microscopy data using convolutional neural networks , 2017, Scientific Reports.

[2]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[3]  Hai Yan,et al.  Glioblastoma multiforme: a review of therapeutic targets , 2009, Expert opinion on therapeutic targets.

[4]  E. Kuhl,et al.  Mechanics of the brain: perspectives, challenges, and opportunities , 2015, Biomechanics and Modeling in Mechanobiology.

[5]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[6]  K. Hopkins,et al.  A novel implantable catheter system with transcutaneous port for intermittent convection-enhanced delivery of carboplatin for recurrent glioblastoma , 2016, Drug delivery.

[7]  Fabian Tschopp,et al.  Efficient convolutional neural networks for pixelwise classification on heterogeneous hardware systems , 2015, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[8]  Yuriy Mishchenko,et al.  Automation of 3D reconstruction of neural tissue from large volume of conventional serial section transmission electron micrographs , 2009, Journal of Neuroscience Methods.

[9]  Raghu Raghavan,et al.  Predictive models for pressure-driven fluid infusions into brain parenchyma , 2011, Physics in medicine and biology.

[10]  Joseph F. Murray,et al.  Convolutional Networks Can Learn to Generate Affinity Graphs for Image Segmentation , 2010, Neural Computation.

[11]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Joachim M. Buhmann,et al.  Crowdsourcing the creation of image segmentation algorithms for connectomics , 2015, Front. Neuroanat..

[13]  Joachim M. Buhmann,et al.  Neuron geometry extraction by perceptual grouping in ssTEM images , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  Christel Genoud,et al.  Is EM dead? , 2013, Journal of Cell Science.

[15]  Mirza Faisal Beg,et al.  A semi-automated method for identifying and measuring myelinated nerve fibers in scanning electron microscope images , 2011, Journal of Neuroscience Methods.

[16]  C. Genoud,et al.  Volume scanning electron microscopy for imaging biological ultrastructure , 2016, Biology of the cell.

[17]  Jill S. Barnholtz-Sloan,et al.  Epidemiologic and Molecular Prognostic Review of Glioblastoma , 2014, Cancer Epidemiology, Biomarkers & Prevention.

[18]  Kahkashan Perveen,et al.  Glioblastoma Multiforme: A Review of its Epidemiology and Pathogenesis through Clinical Presentation and Treatment , 2017, Asian Pacific journal of cancer prevention : APJCP.

[19]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[20]  Fred A Hamprecht,et al.  Multicut brings automated neurite segmentation closer to human performance , 2017, Nature Methods.

[21]  P R Fernandes,et al.  Permeability analysis of scaffolds for bone tissue engineering. , 2012, Journal of biomechanics.

[22]  Nina Kočevar,et al.  Glioma and glioblastoma - how much do we (not) know? , 2013, Molecular and clinical oncology.

[23]  Jan C Buckner,et al.  Central nervous system tumors. , 2007, Mayo Clinic proceedings.

[24]  M. Aghi,et al.  Convection-enhanced delivery in glioblastoma: a review of preclinical and clinical studies. , 2017, Journal of neurosurgery.

[25]  Ke Chen,et al.  Convolutional Low-Resolution Fine-Grained Classification , 2017, Pattern Recognit. Lett..

[26]  Ross T. Whitaker,et al.  Detection of neuron membranes in electron microscopy images using a serial neural network architecture , 2010, Medical Image Anal..

[27]  W. Ehlers,et al.  Multi-component modelling of human brain tissue: a contribution to the constitutive and computational description of deformation, flow and diffusion processes with application to the invasive drug-delivery problem , 2015, Computer methods in biomechanics and biomedical engineering.

[28]  Raghu Raghavan,et al.  Convection-enhanced delivery of therapeutics for brain disease, and its optimization. , 2006, Neurosurgical focus.

[29]  M. Woolley,et al.  Robot-guided convection-enhanced delivery of carboplatin for advanced brainstem glioma , 2013, Acta Neurochirurgica.

[30]  Nikos K. Logothetis,et al.  Distribution of axon diameters in cortical white matter: an electron-microscopic study on three human brains and a macaque , 2014, Biological Cybernetics.

[31]  S. Tatter,et al.  Convection-enhanced delivery for the treatment of brain tumors , 2009, Expert review of neurotherapeutics.

[32]  Won-Ki Jeong,et al.  FusionNet: A Deep Fully Residual Convolutional Neural Network for Image Segmentation in Connectomics , 2016, Frontiers in Computer Science.

[33]  Elena De Momi,et al.  Effective Diffusion and Tortuosity in Brain White Matter , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[34]  Luca Maria Gambardella,et al.  Deep Neural Networks Segment Neuronal Membranes in Electron Microscopy Images , 2012, NIPS.

[35]  Xi Chen,et al.  Deep contextual residual network for electron microscopy image segmentation in connectomics , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[36]  Edward A. White,et al.  An evaluation of the relationships between catheter design and tissue mechanics in achieving high-flow convection-enhanced delivery , 2011, Journal of Neuroscience Methods.

[37]  Hanchuan Peng,et al.  Deep models for brain EM image segmentation: novel insights and improved performance , 2016, Bioinform..

[38]  Raghu Raghavan,et al.  Delivering therapy to target: improving the odds for successful drug development. , 2016, Therapeutic delivery.

[39]  G. Iacob,et al.  Current data and strategy in glioblastoma multiforme , 2009, Journal of medicine and life.

[40]  Charles Nicholson,et al.  Brain Extracellular Space: The Final Frontier of Neuroscience. , 2017, Biophysical journal.

[41]  Elena De Momi,et al.  Blood vessel segmentation algorithms - Review of methods, datasets and evaluation metrics , 2018, Comput. Methods Programs Biomed..

[42]  Ullrich Köthe,et al.  Segmentation of SBFSEM Volume Data of Neural Tissue by Hierarchical Classification , 2008, DAGM-Symposium.

[43]  Peter Dickinson,et al.  Detection of infusate leakage in the brain using real-time imaging of convection-enhanced delivery. , 2008, Journal of neurosurgery.

[44]  P F Morrison,et al.  Convection-enhanced delivery of macromolecules in the brain. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[45]  Ting Liu,et al.  Watershed merge tree classification for electron microscopy image segmentation , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[46]  Joachim M. Buhmann,et al.  Anisotropic ssTEM Image Segmentation Using Dense Correspondence across Sections , 2012, MICCAI.