Neuron Segmentation With High-Level Biological Priors

We present a novel approach to the problem of neuron segmentation in image volumes acquired by an electron microscopy. Existing methods, such as agglomerative or correlation clustering, rely solely on boundary evidence and have problems where such an evidence is lacking (e.g., incomplete staining) or ambiguous (e.g., co-located cell and mitochondria membranes). We investigate if these difficulties can be overcome by means of sparse region appearance cues that differentiate between pre- and postsynaptic neuron segments in mammalian neural tissue. We combine these cues with the traditional boundary evidence in the asymmetric multiway cut (AMWC) model, which simultaneously solves the partitioning and the semantic region labeling problems. We show that AMWC problems over superpixel graphs can be solved to global optimality with a cutting plane approach, and that the introduction of semantic class priors leads to significantly better segmentations.

[1]  Ullrich Köthe,et al.  Ilastik: Interactive learning and segmentation toolkit , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[2]  Amelio Vázquez Reina,et al.  Large-Scale Automatic Reconstruction of Neuronal Processes from Electron Microscopy Images , 2013, Medical Image Anal..

[3]  Mason R. Mackey,et al.  Multicolor Electron Microscopy for Simultaneous Visualization of Multiple Molecular Species. , 2016, Cell chemical biology.

[4]  Luca Maria Gambardella,et al.  Candidate Sampling for Neuron Reconstruction from Anisotropic Electron Microscopy Volumes , 2014, MICCAI.

[5]  Ullrich Köthe,et al.  Carving: Scalable Interactive Segmentation of Neural Volume Electron Microscopy Images , 2011, MICCAI.

[6]  Viren Jain,et al.  Deep and Wide Multiscale Recursive Networks for Robust Image Labeling , 2013, ICLR.

[7]  H. Sebastian Seung,et al.  Learning to Agglomerate Superpixel Hierarchies , 2011, NIPS.

[8]  Anirban Chakraborty,et al.  A Context-Aware Delayed Agglomeration Framework for Electron Microscopy Segmentation , 2014, PloS one.

[9]  Ronen Basri,et al.  Co-clustering of image segments using convex optimization applied to EM neuronal reconstruction , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  Joachim M. Buhmann,et al.  Anisotropic ssTEM Image Segmentation Using Dense Correspondence across Sections , 2012, MICCAI.

[11]  Srinivas C. Turaga,et al.  Space-time wiring specificity supports direction selectivity in the retina , 2014, Nature.

[12]  Ullrich Köthe,et al.  Improving 3D EM data segmentation by joint optimization over boundary evidence and biological priors , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[13]  Gerhard Reinelt,et al.  Higher-order segmentation via multicuts , 2013, Comput. Vis. Image Underst..

[14]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[15]  Louis K. Scheffer,et al.  Synaptic circuits and their variations within different columns in the visual system of Drosophila , 2015, Proceedings of the National Academy of Sciences.

[16]  Joseph F. Murray,et al.  Supervised Learning of Image Restoration with Convolutional Networks , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[17]  Jianbo Shi,et al.  Machine Learning of Hierarchical Clustering to Segment 2D and 3D Images , 2013, PloS one.

[18]  Eric L. Miller,et al.  Segmentation fusion for connectomics , 2011, 2011 International Conference on Computer Vision.

[19]  Pascal Fua,et al.  Modeling brain circuitry over a wide range of scales , 2015, Front. Neuroanat..

[20]  Fred A. Hamprecht,et al.  Automated Detection and Segmentation of Synaptic Contacts in Nearly Isotropic Serial Electron Microscopy Images , 2011, PloS one.

[21]  Jörg H. Kappes,et al.  OpenGM: A C++ Library for Discrete Graphical Models , 2012, ArXiv.

[22]  D. Mastronarde,et al.  Exploring the retinal connectome , 2011, Molecular vision.

[23]  Yoonsuck Choe,et al.  Cell tracking and segmentation in electron microscopy images using graph cuts , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[24]  Ullrich Köthe,et al.  Globally Optimal Closed-Surface Segmentation for Connectomics , 2012, ECCV.

[25]  Randal Burns,et al.  A resource from 3D electron microscopy of hippocampal neuropil for user training and tool development , 2015, Scientific Data.

[26]  Ting Liu,et al.  A modular hierarchical approach to 3D electron microscopy image segmentation , 2014, Journal of Neuroscience Methods.

[27]  Ross T. Whitaker,et al.  Detection of neuron membranes in electron microscopy images using a serial neural network architecture , 2010, Medical Image Anal..

[28]  G. Knott,et al.  Serial Section Scanning Electron Microscopy of Adult Brain Tissue Using Focused Ion Beam Milling , 2008, The Journal of Neuroscience.

[29]  Srinivas C. Turaga,et al.  Connectomic reconstruction of the inner plexiform layer in the mouse retina , 2013, Nature.

[30]  Ullrich Köthe,et al.  Segmentation of SBFSEM Volume Data of Neural Tissue by Hierarchical Classification , 2008, DAGM-Symposium.

[31]  Gerhard Reinelt,et al.  Globally Optimal Image Partitioning by Multicuts , 2011, EMMCVPR.

[32]  Tolga Tasdizen,et al.  Image Segmentation with Cascaded Hierarchical Models and Logistic Disjunctive Normal Networks , 2013, 2013 IEEE International Conference on Computer Vision.

[33]  Olga Veksler,et al.  Markov random fields with efficient approximations , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[34]  Pascal Fua,et al.  Learning Context Cues for Synapse Segmentation , 2013, IEEE Transactions on Medical Imaging.

[35]  William R. Gray Roncal,et al.  Saturated Reconstruction of a Volume of Neocortex , 2015, Cell.

[36]  Fred A Hamprecht,et al.  Multicut brings automated neurite segmentation closer to human performance , 2017, Nature Methods.

[37]  B. S. Manjunath,et al.  Segmenting Planar Superpixel Adjacency Graphs w.r.t. Non-planar Superpixel Affinity Graphs , 2013, EMMCVPR.

[38]  Luca Maria Gambardella,et al.  Deep Neural Networks Segment Neuronal Membranes in Electron Microscopy Images , 2012, NIPS.

[39]  Chao Chen,et al.  An efficient conditional random field approach for automatic and interactive neuron segmentation , 2016, Medical Image Anal..

[40]  Louis K. Scheffer,et al.  A visual motion detection circuit suggested by Drosophila connectomics , 2013, Nature.