Efficient Correction for EM Connectomics with Skeletal Representation

Machine vision techniques for automatic neuron reconstruction from electron microscopy (EM) volumes have made tremendous advances in recent years. Nonetheless, large-scale reconstruction from teravoxels of EM volumes retains both underand oversegmentation errors. In this paper, we present an efficient correction algorithm for EM neuron reconstruction. Each region in a 3D segmentation is represented by its skeleton. We employ deep convolutional networks to detect and correct false merge and split errors at the joints and endpoints of the skeletal representation. Our algorithm can achieve the same or close accuracy of the state-of-the-art error correction algorithm by querying only at a tiny fraction of the volume. A reduction of the search space by several orders of magnitude enables our approach to be scalable for terabyte or petabyte scale neuron reconstruction.

[1]  Louis K. Scheffer,et al.  Small Sample Learning of Superpixel Classifiers for EM Segmentation , 2014, MICCAI.

[2]  Ting Liu,et al.  SSHMT: Semi-supervised Hierarchical Merge Tree for Electron Microscopy Image Segmentation , 2016, ECCV.

[3]  H. Sebastian Seung,et al.  Recursive Training of 2D-3D Convolutional Networks for Neuronal Boundary Prediction , 2015, NIPS.

[4]  Ting Zhao,et al.  Automatic Neuron Type Identification by Neurite Localization in the Drosophila Medulla , 2014, ArXiv.

[5]  Alessandro Giusti,et al.  Efficient Classifier Training to Minimize False Merges in Electron Microscopy Segmentation , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[6]  William R. Gray Roncal,et al.  Saturated Reconstruction of a Volume of Neocortex , 2015, Cell.

[7]  Louis K. Scheffer,et al.  A connectome of a learning and memory center in the adult Drosophila brain , 2017, eLife.

[8]  Hanspeter Pfister,et al.  Anisotropic EM Segmentation by 3D Affinity Learning and Agglomeration , 2017, ArXiv.

[9]  Chandan Singh,et al.  A Deep Structured Learning Approach Towards Automating Connectome Reconstruction from 3D Electron Micrographs , 2017, ArXiv.

[10]  Masayuki Nakajima,et al.  TEASAR: tree-structure extraction algorithm for accurate and robust skeletons , 2000, Proceedings the Eighth Pacific Conference on Computer Graphics and Applications.

[11]  Ullrich Köthe,et al.  An Efficient Fusion Move Algorithm for the Minimum Cost Lifted Multicut Problem , 2016, ECCV.

[12]  Srinivas C. Turaga,et al.  Connectomic reconstruction of the inner plexiform layer in the mouse retina , 2013, Nature.

[13]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[14]  Eric L. Miller,et al.  Segmentation fusion for connectomics , 2011, 2011 International Conference on Computer Vision.

[15]  H. Sebastian Seung,et al.  Boundary Learning by Optimization with Topological Constraints , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  Matthew Cook,et al.  Efficient automatic 3D-reconstruction of branching neurons from EM data , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Nir Shavit,et al.  Morphological Error Detection in 3D Segmentations , 2017, ArXiv.

[18]  Ullrich Köthe,et al.  Globally Optimal Closed-Surface Segmentation for Connectomics , 2012, ECCV.

[19]  Jianbo Shi,et al.  Machine Learning of Hierarchical Clustering to Segment 2D and 3D Images , 2013, PloS one.

[20]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Larry Lindsey,et al.  High-precision automated reconstruction of neurons with flood-filling networks , 2017, Nature Methods.

[22]  Aljoscha Nern,et al.  The comprehensive connectome of a neural substrate for ‘ON’ motion detection in Drosophila , 2017, eLife.

[23]  Gregory D. Hager,et al.  VESICLE: Volumetric Evaluation of Synaptic Inferfaces using Computer Vision at Large Scale , 2014, BMVC.

[24]  G. Knott,et al.  Ultrastructurally-smooth thick partitioning and volume stitching for larger-scale connectomics , 2015, Nature Methods.

[25]  Quoc V. Le,et al.  Tiled convolutional neural networks , 2010, NIPS.

[26]  Jian Sun,et al.  Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Luca Maria Gambardella,et al.  Deep Neural Networks Segment Neuronal Membranes in Electron Microscopy Images , 2012, NIPS.

[28]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Peter H. Li,et al.  High-Precision Automated Reconstruction of Neurons with Flood-filling Networks , 2017 .

[30]  H. Sebastian Seung,et al.  An Error Detection and Correction Framework for Connectomics , 2017, NIPS.

[31]  H. Sebastian Seung,et al.  Superhuman Accuracy on the SNEMI3D Connectomics Challenge , 2017, ArXiv.

[32]  Ronen Basri,et al.  Co-clustering of image segments using convex optimization applied to EM neuronal reconstruction , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[33]  H. Sebastian Seung,et al.  Maximin affinity learning of image segmentation , 2009, NIPS.