3D segmentation of cell boundaries from whole cell cryogenic electron tomography volumes.

Cryogenic electron tomography (cryo-ET) has gained increasing interest in recent years due to its ability to image whole cells and subcellular structures in 3D at nanometer resolution in their native environment. However, due to dose restrictions and the inability to acquire high tilt angle images, the reconstructed volumes are noisy and have missing information. Thus, features are unreliable, and precision extraction of the cell boundary is difficult, manual and time intensive. This paper presents an efficient recursive algorithm called BLASTED (Boundary Localization using Adaptive Shape and Texture Discovery) to automatically extract the cell boundary using a conditional random field (CRF) framework in which boundary points and shape are jointly inferred. The algorithm learns the texture of the boundary region progressively, and uses a global shape model and shape-dependent features to propose candidate boundary points on a slice of the membrane. It then updates the shape of that slice by accepting the appropriate candidate points using local spatial clustering, the global shape model, and trained boosted texture classifiers. The BLASTED algorithm segmented the cell membrane over an average of 93% of the length of the cell in 19 difficult cryo-ET datasets.

[1]  Qiang Ji,et al.  Shape-Driven Three-Dimensional Watersnake Segmentation of Biological Membranes in Electron Tomography , 2008, IEEE Transactions on Medical Imaging.

[2]  J A Sethian,et al.  A fast marching level set method for monotonically advancing fronts. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[3]  L. Shapiro,et al.  A Polymeric Protein Anchors the Chromosomal Origin/ParB Complex at a Bacterial Cell Pole , 2008, Cell.

[4]  Fernand Meyer,et al.  An Overview of Morphological Segmentation , 2001, Int. J. Pattern Recognit. Artif. Intell..

[5]  Mark H Ellisman,et al.  Transform-based backprojection for volume reconstruction of large format electron microscope tilt series. , 2006, Journal of structural biology.

[6]  Ramin Zabih,et al.  A segmentation algorithm for contrast-enhanced images , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[7]  Tamal K. Dey,et al.  An Adaptive MLS Surface for Reconstruction with Guarantees , 2022 .

[8]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  R. Zabih,et al.  Spatially coherent clustering using graph cuts , 2004, CVPR 2004.

[10]  Tamal K. Dey,et al.  Detecting undersampling in surface reconstruction , 2001, SCG '01.

[11]  Timothy F. Cootes,et al.  Active Shape Model Search using Local Grey-Level Models: A Quantitative Evaluation , 1993, BMVC.

[12]  Niels Volkmann,et al.  A novel three-dimensional variant of the watershed transform for segmentation of electron density maps. , 2002, Journal of structural biology.

[13]  Anchi Cheng,et al.  Automated molecular microscopy: the new Leginon system. , 2005, Journal of structural biology.

[14]  Irwin Edward Sobel,et al.  Camera Models and Machine Perception , 1970 .

[15]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[16]  Frédéric Jurie,et al.  Groups of Adjacent Contour Segments for Object Detection , 2008, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Andrew W. Fitzgibbon,et al.  Direct Least Square Fitting of Ellipses , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Rachel Smallridge,et al.  Cell adhesion: Making new contacts , 2003, Nature Reviews Molecular Cell Biology.

[19]  Luc Vincent,et al.  Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Daphne Koller,et al.  Shape-Based Object Localization for Descriptive Classification , 2008, International Journal of Computer Vision.

[21]  Gunilla Borgefors,et al.  Hierarchical Chamfer Matching: A Parametric Edge Matching Algorithm , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[23]  Achilleas S Frangakis,et al.  Segmentation of two- and three-dimensional data from electron microscopy using eigenvector analysis. , 2002, Journal of structural biology.

[24]  Dorit S. Hochbaum,et al.  An efficient algorithm for image segmentation, Markov random fields and related problems , 2001, JACM.

[25]  Djemel Ziou,et al.  Edge Detection Techniques-An Overview , 1998 .

[26]  Y. Freund,et al.  Discussion of the Paper \additive Logistic Regression: a Statistical View of Boosting" By , 2000 .

[27]  Judith Klumperman,et al.  Electron microscopy in cell biology: integrating structure and function. , 2003, Nature reviews. Molecular cell biology.

[28]  F. Natterer The Mathematics of Computerized Tomography , 1986 .

[29]  J Bernard Heymann,et al.  Bsoft: image processing and molecular modeling for electron microscopy. , 2007, Journal of structural biology.

[30]  Andrew Zisserman,et al.  Learning an Alphabet of Shape and Appearance for Multi-Class Object Detection , 2008, International Journal of Computer Vision.

[31]  Mark Horowitz,et al.  Markov random field based automatic image alignment for electron tomography. , 2007, Journal of structural biology.

[32]  Benjamin W. Wah,et al.  Wiley Encyclopedia of Computer Science and Engineering , 2009, Wiley Encyclopedia of Computer Science and Engineering.

[33]  John W Sedat,et al.  UCSF tomography: an integrated software suite for real-time electron microscopic tomographic data collection, alignment, and reconstruction. , 2007, Journal of structural biology.

[34]  K. Sandberg Methods for image segmentation in cellular tomography. , 2007, Methods in cell biology.

[35]  Wolfgang Baumeister,et al.  Electron tomography: towards visualizing the molecular organization of the cytoplasm. , 2002, Current opinion in structural biology.

[36]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Edgar Garduño,et al.  Segmentation of electron tomographic data sets using fuzzy set theory principles. , 2008, Journal of structural biology.

[38]  Grant J. Jensen,et al.  Molecular organization of Gram-negative peptidoglycan , 2008, Proceedings of the National Academy of Sciences.

[39]  David N Mastronarde,et al.  Automated electron microscope tomography using robust prediction of specimen movements. , 2005, Journal of structural biology.

[40]  Avinash C. Kak,et al.  Principles of computerized tomographic imaging , 2001, Classics in applied mathematics.

[41]  Guillermo Sapiro,et al.  An energy-based three-dimensional segmentation approach for the quantitative interpretation of electron tomograms , 2005, IEEE Transactions on Image Processing.

[42]  Julio O. Ortiz,et al.  Mapping 70S ribosomes in intact cells by cryoelectron tomography and pattern recognition. , 2006, Journal of structural biology.

[43]  K. Sandberg,et al.  Segmentation of thin structures in electron micrographs using orientation fields. , 2007, Journal of structural biology.

[44]  Marcel Worring,et al.  Watersnakes: Energy-Driven Watershed Segmentation , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[45]  Kenneth H Downing,et al.  Three-dimensional analysis of the structure and ecology of a novel, ultra-small archaeon , 2009, The ISME Journal.

[46]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[47]  Andrew McCallum,et al.  Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.

[48]  José-Jesús Fernández,et al.  A spectral estimation approach to contrast transfer function detection in electron microscopy , 1997 .

[49]  Sabine Pruggnaller,et al.  A visualization and segmentation toolbox for electron microscopy. , 2008, Journal of structural biology.

[50]  Chunming Li,et al.  Implicit Active Contours Driven by Local Binary Fitting Energy , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[51]  Jitendra Malik,et al.  Learning to detect natural image boundaries using local brightness, color, and texture cues , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.