Multi-class segmentation of neuronal structures in electron microscopy images

BackgroundSerial block face scanning electron microscopy (SBFEM) is becoming a popular technology in neuroscience. We have seen in the last years an increasing number of works addressing the problem of segmenting cellular structures in SBFEM images of brain tissue. The vast majority of them is designed to segment one specific structure, typically membranes, synapses and mitochondria. Our hypothesis is that the performance of these algorithms can be improved by concurrently segmenting more than one structure using image descriptions obtained at different scales.ResultsWe consider the simultaneous segmentation of two structures, namely, synapses with mitochondria, and mitochondra with membranes. To this end we select three image stacks encompassing different SBFEM acquisition technologies and image resolutions. We introduce both a new Boosting algorithm to perform feature scale selection and the Jaccard Curve as a tool compare several segmentation results. We then experimentally study the gains in performance obtained when simultaneously segmenting two structures with properly selected image descriptor scales. The results show that by doing so we achieve significant gains in segmentation accuracy when compared to the best results in the literature.ConclusionsSimultaneously segmenting several neuronal structures described at different scales provides voxel classification algorithms with highly discriminating features that significantly improve segmentation accuracy.

[1]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[2]  Luis Baumela,et al.  Multi-class boosting with asymmetric binary weak-learners , 2014, Pattern Recognit..

[3]  E. Gordon,et al.  Brain Imaging Technologies: How, What, When and Why? , 1999, The Australian and New Zealand journal of psychiatry.

[4]  Ullrich Köthe,et al.  Ilastik: Interactive learning and segmentation toolkit , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[5]  K. Harris,et al.  Mitochondria detection in electron microscopy images , 2008 .

[6]  Vincent Lepetit,et al.  Fast Ray features for learning irregular shapes , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[7]  Mark H. Ellisman,et al.  Method: automatic segmentation of mitochondria utilizing patch classification, contour pair classification, and automatically seeded level sets , 2012, BMC Bioinformatics.

[8]  Pascal Fua,et al.  Learning Structured Models for Segmentation of 2-D and 3-D Imagery , 2015, IEEE Transactions on Medical Imaging.

[9]  Pushmeet Kohli,et al.  Non-parametric Higher-Order Random Fields for Image Segmentation , 2014, ECCV.

[10]  Joachim M. Buhmann,et al.  Crowdsourcing the creation of image segmentation algorithms for connectomics , 2015, Front. Neuroanat..

[11]  Antonio Criminisi,et al.  Regression forests for efficient anatomy detection and localization in computed tomography scans , 2013, Medical Image Anal..

[12]  Fred A. Hamprecht,et al.  Automated Detection and Segmentation of Synaptic Contacts in Nearly Isotropic Serial Electron Microscopy Images , 2011, PloS one.

[13]  Michael Levin,et al.  Automatic neuron segmentation and neural network analysis method for phase contrast microscopy images. , 2015, Biomedical optics express.

[14]  Ashutosh Kumar Singh,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction , 2010 .

[15]  Joseph F. Murray,et al.  Supervised Learning of Image Restoration with Convolutional Networks , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[16]  Javier DeFelipe,et al.  A Fast Method for the Segmentation of Synaptic Junctions and Mitochondria in Serial Electron Microscopic Images of the Brain , 2016, Neuroinformatics.

[17]  Javier DeFelipe,et al.  From the Connectome to the Synaptome: An Epic Love Story , 2010, Science.

[18]  W. Denk,et al.  Serial Block-Face Scanning Electron Microscopy to Reconstruct Three-Dimensional Tissue Nanostructure , 2004, PLoS biology.

[19]  Kunal K. Ghosh,et al.  Advances in light microscopy for neuroscience. , 2009, Annual review of neuroscience.

[20]  Tolga Tasdizen,et al.  Multi-Class Multi-Scale Series Contextual Model for Image Segmentation , 2013, IEEE Transactions on Image Processing.

[21]  Joachim M. Buhmann,et al.  Neuron geometry extraction by perceptual grouping in ssTEM images , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[22]  Pascal Fua,et al.  Supervoxel-Based Segmentation of Mitochondria in EM Image Stacks With Learned Shape Features , 2012, IEEE Transactions on Medical Imaging.

[23]  Olga Veksler,et al.  Fast approximate energy minimization via graph cuts , 2001, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[24]  Gareth Funka-Lea,et al.  Graph Cuts and Efficient N-D Image Segmentation , 2006, International Journal of Computer Vision.

[25]  Pascal Fua,et al.  Learning Context Cues for Synapse Segmentation , 2013, IEEE Transactions on Medical Imaging.

[26]  Pascal Fua,et al.  Exploiting Enclosing Membranes and Contextual Cues for Mitochondria Segmentation , 2014, MICCAI.

[27]  G. Knott,et al.  Serial Section Scanning Electron Microscopy of Adult Brain Tissue Using Focused Ion Beam Milling , 2008, The Journal of Neuroscience.

[28]  Paul M. Thompson,et al.  Brain Anatomical Structure Segmentation by Hybrid Discriminative/Generative Models , 2008, IEEE Transactions on Medical Imaging.

[29]  Ron Kohavi,et al.  The Case against Accuracy Estimation for Comparing Induction Algorithms , 1998, ICML.

[30]  Javier DeFelipe,et al.  Counting Synapses Using FIB/SEM Microscopy: A True Revolution for Ultrastructural Volume Reconstruction , 2009, Front. Neuroanat..

[31]  Luis Baumela,et al.  A Comparative Study of Feature Descriptors for Mitochondria and Synapse Segmentation , 2014, 2014 22nd International Conference on Pattern Recognition.

[32]  Ullrich Köthe,et al.  Automated segmentation of synapses in 3D EM data , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[33]  Pietro Perona,et al.  Integral Channel Features , 2009, BMVC.

[34]  Javier DeFelipe,et al.  Espina: A Tool for the Automated Segmentation and Counting of Synapses in Large Stacks of Electron Microscopy Images , 2011, Front. Neuroanat..

[35]  Amelio Vázquez Reina,et al.  Radon-Like features and their application to connectomics , 2010, CVPR Workshops.

[36]  S. Campello,et al.  Mitochondrial shape changes: orchestrating cell pathophysiology , 2010, EMBO reports.