Supervoxel-Based Segmentation of Mitochondria in EM Image Stacks With Learned Shape Features

It is becoming increasingly clear that mitochondria play an important role in neural function. Recent studies show mitochondrial morphology to be crucial to cellular physiology and synaptic function and a link between mitochondrial defects and neuro-degenerative diseases is strongly suspected. Electron microscopy (EM), with its very high resolution in all three directions, is one of the key tools to look more closely into these issues but the huge amounts of data it produces make automated analysis necessary. State-of-the-art computer vision algorithms designed to operate on natural 2-D images tend to perform poorly when applied to EM data for a number of reasons. First, the sheer size of a typical EM volume renders most modern segmentation schemes intractable. Furthermore, most approaches ignore important shape cues, relying only on local statistics that easily become confused when confronted with noise and textures inherent in the data. Finally, the conventional assumption that strong image gradients always correspond to object boundaries is violated by the clutter of distracting membranes. In this work, we propose an automated graph partitioning scheme that addresses these issues. It reduces the computational complexity by operating on supervoxels instead of voxels, incorporates shape features capable of describing the 3-D shape of the target objects, and learns to recognize the distinctive appearance of true boundaries. Our experiments demonstrate that our approach is able to segment mitochondria at a performance level close to that of a human annotator, and outperforms a state-of-the-art 3-D segmentation technique.

[1]  William M. Rand,et al.  Objective Criteria for the Evaluation of Clustering Methods , 1971 .

[2]  Gilbert D. Brum,et al.  Biology: Exploring Life , 1989 .

[3]  D. Greig,et al.  Exact Maximum A Posteriori Estimation for Binary Images , 1989 .

[4]  C. Mannella,et al.  Reconsidering mitochondrial structure: new views of an old organelle. , 1997, Trends in biochemical sciences.

[5]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  William A. Barrett,et al.  Interactive Segmentation with Intelligent Scissors , 1998, Graph. Model. Image Process..

[7]  Marie-Pierre Jolly,et al.  Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[8]  D. Mastronarde,et al.  Organellar relationships in the Golgi region of the pancreatic beta cell line, HIT-T15, visualized by high resolution electron tomography , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[9]  William T. Freeman,et al.  Understanding belief propagation and its generalizations , 2003 .

[10]  Hanan Samet,et al.  Properties of Embedding Methods for Similarity Searching in Metric Spaces , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Topi Mäenpää,et al.  The local binary pattern approach to texture analysis - extensions and applications , 2003 .

[12]  Nicolai Petkov,et al.  Distance sets for shape filters and shape recognition , 2003, IEEE Trans. Image Process..

[13]  Vladimir Kolmogorov,et al.  What energy functions can be minimized via graph cuts? , 2002, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Vladimir Kolmogorov,et al.  An experimental comparison of min-cut/max- flow algorithms for energy minimization in vision , 2001, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[16]  Vladimir Kolmogorov,et al.  What metrics can be approximated by geo-cuts, or global optimization of length/area and flux , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[17]  Tao Zhang,et al.  Interactive graph cut based segmentation with shape priors , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[18]  Luis Ibáñez,et al.  The ITK Software Guide , 2005 .

[19]  Andrew Zisserman,et al.  OBJ CUT , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[20]  Cordelia Schmid,et al.  IEEE Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2004, Washington, DC, USA, June 27 - July 2, 2004 , 2004, CVPR Workshops.

[21]  Jianguo Zhang,et al.  The PASCAL Visual Object Classes Challenge , 2006 .

[22]  Andrew W. Fitzgibbon,et al.  Learning Class-Specific Edges for Object Detection and Segmentation , 2006, ICVGIP.

[23]  Luc Van Gool,et al.  The 2005 PASCAL Visual Object Classes Challenge , 2005, MLCW.

[24]  Vladimir Kolmogorov,et al.  Minimizing Nonsubmodular Functions with Graph Cuts-A Review , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Doyun Lee,et al.  Target Cell-Specific Involvement of Presynaptic Mitochondria in Post-Tetanic Potentiation at Hippocampal Mossy Fiber Synapses , 2007, The Journal of Neuroscience.

[26]  Aly A. Farag,et al.  Graph Cuts Framework for Kidney Segmentation with Prior Shape Constraints , 2007, MICCAI.

[27]  Nikos Komodakis,et al.  Fast, Approximately Optimal Solutions for Single and Dynamic MRFs , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[28]  Joseph F. Murray,et al.  Supervised Learning of Image Restoration with Convolutional Networks , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[29]  G. Perkins,et al.  Mitochondrial fragmentation in neurodegeneration , 2008, Nature Reviews Neuroscience.

[30]  Anat Levin,et al.  Learning to Combine Bottom-Up and Top-Down Segmentation , 2006, International Journal of Computer Vision.

[31]  Angela C. Poole,et al.  The PINK1/Parkin pathway regulates mitochondrial morphology , 2008, Proceedings of the National Academy of Sciences.

[32]  Ullrich Köthe,et al.  Segmentation of SBFSEM Volume Data of Neural Tissue by Hierarchical Classification , 2008, DAGM-Symposium.

[33]  B. S. Manjunath,et al.  Graph cut segmentation of neuronal structures from transmission electron micrographs , 2008, 2008 15th IEEE International Conference on Image Processing.

[34]  Stefano Soatto,et al.  Quick Shift and Kernel Methods for Mode Seeking , 2008, ECCV.

[35]  K. Harris,et al.  Mitochondria detection in electron microscopy images , 2008 .

[36]  Qiang Ji,et al.  Shape-Driven Three-Dimensional Watersnake Segmentation of Biological Membranes in Electron Tomography , 2008, IEEE Transactions on Medical Imaging.

[37]  G. Knott,et al.  Serial Section Scanning Electron Microscopy of Adult Brain Tissue Using Focused Ion Beam Milling , 2008, The Journal of Neuroscience.

[38]  Tolga Tasdizen,et al.  Automatic markup of neural cell membranes using boosted decision stumps , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[39]  Vincent Lepetit,et al.  Fast Ray features for learning irregular shapes , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[40]  Yuri Boykov,et al.  Globally optimal segmentation of multi-region objects , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[41]  Alexander G. Gray,et al.  Automatic joint classification and segmentation of whole cell 3D images , 2009, Pattern Recognit..

[42]  Sven J. Dickinson,et al.  TurboPixels: Fast Superpixels Using Geometric Flows , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  Jens Rittscher,et al.  Spatio-temporal cell cycle phase analysis using level sets and fast marching methods , 2009, Medical Image Anal..

[44]  Amelio Vázquez Reina,et al.  Radon-Like features and their application to connectomics , 2010, CVPR Workshops.

[45]  Vincent Lepetit,et al.  A Fully Automated Approach to Segmentation of Irregularly Shaped Cellular Structures in EM Images , 2010, MICCAI.

[46]  Joost van de Weijer,et al.  Harmony potentials for joint classification and segmentation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[47]  Joachim M. Buhmann,et al.  Neuron geometry extraction by perceptual grouping in ssTEM images , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[48]  Ross T. Whitaker,et al.  Detection of neuron membranes in electron microscopy images using a serial neural network architecture , 2010, Medical Image Anal..

[49]  Vincent Lepetit,et al.  DAISY: An Efficient Dense Descriptor Applied to Wide-Baseline Stereo , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[50]  Cristian Sminchisescu,et al.  Constrained parametric min-cuts for automatic object segmentation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[51]  H. Sebastian Seung,et al.  Boundary Learning by Optimization with Topological Constraints , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[52]  Srinivas C. Turaga,et al.  Machines that learn to segment images: a crucial technology for connectomics , 2010, Current Opinion in Neurobiology.

[53]  Hanchuan Peng,et al.  V3D enables real-time 3D visualization and quantitative analysis of large-scale biological image data sets , 2010, Nature Biotechnology.

[54]  S. Süsstrunk,et al.  SLIC Superpixels ? , 2010 .

[55]  Paria Mehrani,et al.  Superpixels and Supervoxels in an Energy Optimization Framework , 2010, ECCV.

[56]  S. Campello,et al.  Mitochondrial shape changes: orchestrating cell pathophysiology , 2010, EMBO reports.

[57]  Joseph F. Murray,et al.  Convolutional Networks Can Learn to Generate Affinity Graphs for Image Segmentation , 2010, Neural Computation.

[58]  R. Achanta Finding Objects of Interest in Images using Saliency and Superpixels , 2011 .

[59]  Ullrich Köthe,et al.  Automated segmentation of synapses in 3D EM data , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[60]  Eric L. Miller,et al.  Segmentation fusion for connectomics , 2011, 2011 International Conference on Computer Vision.

[61]  智一 吉田,et al.  Efficient Graph-Based Image Segmentationを用いた圃場図自動作成手法の検討 , 2014 .