Local Optimization Based Segmentation of Spatially-Recurring, Multi-Region Objects With Part Configuration Constraints

Incorporating prior knowledge into image segmentation algorithms has proven useful for obtaining more accurate and plausible results. Two important constraints, containment and exclusion of regions, have gained attention in recent years mainly due to their descriptive power. In this paper, we augment the level set framework with the ability to handle these two intuitive geometric relationships, containment and exclusion, along with a distance constraint between boundaries of multi-region objects. Level set's important property of automatically handling topological changes of evolving contours/surfaces enables us to segment spatially-recurring objects (e.g., multiple instances of multi-region cells in a large microscopy image) while satisfying the two aforementioned constraints. In addition, the level set approach gives us a very simple and natural way to compute the distance between contours/surfaces and impose constraints on it. The downside, however, is a local optimization framework in which the final segmentation solution depends on the initialization. In fact, here, we sacrifice the optimizability (local instead of global solution) in exchange for lower space complexity (less memory usage) and faster runtime (especially for large microscopic images) as well as no grid artifacts. Nevertheless, the result from validating our method on several biomedical applications showed the utility and advantages of this augmented level set framework (even with rough initialization that is distant from the desired boundaries). We also compared our framework with its counterpart methods in the discrete domain and reported the pros and cons of each of these methods in terms of metrication error and efficiency in memory usage and runtime.

[1]  Aaron Fenster,et al.  Efficient Global Optimization Based 3D Carotid AB-LIB MRI Segmentation by Simultaneously Evolving Coupled Surfaces , 2012, MICCAI.

[2]  Amar Mitiche,et al.  Variational and Level Set Methods in Image Segmentation , 2010 .

[3]  Ghassan Hamarneh,et al.  Adaptive Regularization for Image Segmentation Using Local Image Curvature Cues , 2010, ECCV.

[4]  Derek Hoiem,et al.  Learning CRFs Using Graph Cuts , 2008, ECCV.

[5]  Xiaodong Wu,et al.  Region Detection by Minimizing Intraclass Variance With Geometric Constraints, Global Optimality, and Efficient Approximation , 2011, IEEE Transactions on Medical Imaging.

[6]  Josiane Zerubia,et al.  A Level Set Model for Image Classification , 1999, International Journal of Computer Vision.

[7]  Sebastian Nowozin,et al.  On Parameter Learning in CRF-Based Approaches to Object Class Image Segmentation , 2010, ECCV.

[8]  W. Clem Karl,et al.  Coupled Shape Distribution-Based Segmentation of Multiple Objects , 2005, IPMI.

[9]  Ghassan Hamarneh,et al.  Multi-label MRF Optimization via a Least Squares s - t Cut , 2009, ISVC.

[10]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[11]  Isabelle Bloch,et al.  Integration of fuzzy spatial relations in deformable models - Application to brain MRI segmentation , 2006, Pattern Recognit..

[12]  Vladimir Kolmogorov,et al.  Computing geodesics and minimal surfaces via graph cuts , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[13]  J M Bland,et al.  Statistical methods for assessing agreement between two methods of clinical measurement , 1986 .

[14]  Feng Li,et al.  A Fast Convex Optimization Approach to Segmenting 3D Scar Tissue from Delayed-Enhancement Cardiac MR Images , 2012, MICCAI.

[15]  Shuo Li,et al.  Area prior constrained level set evolution for medical image segmentation , 2008, SPIE Medical Imaging.

[16]  Xiaodong Wu,et al.  Optimal Surface Segmentation in Volumetric Images-A Graph-Theoretic Approach , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Robert T. Schultz,et al.  Volumetric layer segmentation using coupled surfaces propagation , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[18]  Shishir K. Shah,et al.  Embedding Topic Discovery in Conditional Random Fields Model for Segmenting Nuclei Using Multispectral Data , 2012, IEEE Transactions on Biomedical Engineering.

[19]  Stephen Gould,et al.  Multi-Class Segmentation with Relative Location Prior , 2008, International Journal of Computer Vision.

[20]  Yuri Boykov,et al.  Hausdorff Distance Constraint for Multi-surface Segmentation , 2012, ECCV.

[21]  van Hc Hans Assen,et al.  LV Challenge LKEB Contribution: Fully Automated Myocardial Contour Detection , 2009, The MIDAS Journal.

[22]  Eric L. Miller,et al.  Multiphase geometric couplings for the segmentation of neural processes , 2009, CVPR.

[23]  Daniel Cremers,et al.  A Survey and Comparison of Discrete and Continuous Multi-label Optimization Approaches for the Potts Model , 2013, International Journal of Computer Vision.

[24]  Ghassan Hamarneh,et al.  Probabilistic Multi-shape Segmentation of Knee Extensor and Flexor Muscles , 2011, MICCAI.

[25]  José M. F. Moura,et al.  STACS: new active contour scheme for cardiac MR image segmentation , 2005, IEEE Transactions on Medical Imaging.

[26]  Hongsheng Li,et al.  Active Volume Models for Medical Image Segmentation , 2011, IEEE Transactions on Medical Imaging.

[27]  Ghassan Hamarneh,et al.  Segmentation of Cells with Partial Occlusion and Part Configuration Constraint Using Evolutionary Computation , 2013, MICCAI.

[28]  Hugues Talbot,et al.  4D Morphological segmentation and the MICCAI LV-segmentation grand challenge , 2009, The MIDAS Journal.

[29]  Ghassan Hamarneh,et al.  Convex multi-region probabilistic segmentation with shape prior in the isometric log-ratio transformation space , 2011, 2011 International Conference on Computer Vision.

[30]  Lin Yang,et al.  Automatic Image Analysis of Histopathology Specimens Using Concave Vertex Graph , 2008, MICCAI.

[31]  Daniel Cremers,et al.  Generalized ordering constraints for multilabel optimization , 2011, 2011 International Conference on Computer Vision.

[32]  Ghassan Hamarneh,et al.  Deformable Organisms for Automatic Medical Image Analysis , 2001, MICCAI.

[33]  Shuo Li,et al.  A Statistical Overlap Prior for Variational Image Segmentation , 2009, International Journal of Computer Vision.

[34]  Nikos Paragios,et al.  A Variational Approach for the Segmentation of the Left Ventricle in Cardiac Image Analysis , 2002, International Journal of Computer Vision.

[35]  Carlos Vázquez,et al.  Multiregion competition: A level set extension of region competition to multiple region image partitioning , 2006, Comput. Vis. Image Underst..

[36]  Terry M. Peters,et al.  Left ventricle segmentation in MRI via convex relaxed distribution matching , 2013, Medical Image Anal..

[37]  Dudley J. Pennell,et al.  Cardiovascular Magnetic Resonance , 2010, Circulation.

[38]  Ghassan Hamarneh,et al.  Bounded Labeling Function for Global Segmentation of Multi-part Objects with Geometric Constraints , 2013, 2013 IEEE International Conference on Computer Vision.

[39]  D. Louis Collins,et al.  Animal: Validation and Applications of Nonlinear Registration-Based Segmentation , 1997, Int. J. Pattern Recognit. Artif. Intell..

[40]  Ruzena Bajcsy,et al.  The Institute For Research In Cognitive Science Elastically Deforming a Three-Dimensional Atlas to Match Anatomical Brain Images , 1993 .

[41]  Vladimir Kolmogorov,et al.  Applications of parametric maxflow in computer vision , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[42]  Tony F. Chan,et al.  Active Contours without Edges for Vector-Valued Images , 2000, J. Vis. Commun. Image Represent..

[43]  Philip H. S. Torr,et al.  Efficient piecewise learning for conditional random fields , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[44]  Zhizhou Wang,et al.  Tensor Field Segmentation Using Region Based Active Contour Model , 2004, ECCV.

[45]  Ghassan Hamarneh,et al.  Is a Single Energy Functional Sufficient? Adaptive Energy Functionals and Automatic Initialization , 2007, MICCAI.

[46]  Adam Krzyzak,et al.  Fast and Robust Clinical Triple-Region Image Segmentation Using One Level Set Function , 2006, MICCAI.

[47]  Ghassan Hamarneh,et al.  Segmentation of Intra-Retinal Layers From Optical Coherence Tomography Images Using an Active Contour Approach , 2011, IEEE Transactions on Medical Imaging.

[48]  Pushmeet Kohli,et al.  Minimizing sparse higher order energy functions of discrete variables , 2009, CVPR.

[49]  Alexander Dick,et al.  Segmentation of Left Ventricle in Cardiac Cine MRI: An Automatic Image-Driven Method , 2009, FIMH.

[50]  R. Kimmel,et al.  Cortex segmentation - a fast variational geometric approach , 2001, Proceedings IEEE Workshop on Variational and Level Set Methods in Computer Vision.

[51]  Olga Veksler,et al.  Tiered scene labeling with dynamic programming , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[52]  Ghassan Hamarneh,et al.  Kinetic Modeling Based Probabilistic Segmentation for Molecular Images , 2008, MICCAI.

[53]  R. Bajcsy,et al.  Elastically Deforming 3D Atlas to Match Anatomical Brain Images , 1993, Journal of computer assisted tomography.

[54]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[55]  Ting Song,et al.  Multi-phase Three-Dimensional Level Set Segmentation of Brain MRI , 2004, MICCAI.

[56]  R. Courant,et al.  On the Partial Difference Equations, of Mathematical Physics , 2015 .

[57]  T. Chan,et al.  A Variational Level Set Approach to Multiphase Motion , 1996 .

[58]  Ghassan Hamarneh,et al.  Medial-Based Deformable Models in Nonconvex Shape-Spaces for Medical Image Segmentation , 2012, IEEE Transactions on Medical Imaging.

[59]  Paul F. Whelan,et al.  Segmenting the Left Ventricle in 3D Using a Coupled ASM and a Learned Non-Rigid Spatial Model , 2009, The MIDAS Journal.

[60]  Yousef Al-Kofahi,et al.  Improved Automatic Detection and Segmentation of Cell Nuclei in Histopathology Images , 2010, IEEE Transactions on Biomedical Engineering.

[61]  Olga Veksler,et al.  Graph cut with ordering constraints on labels and its applications , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[62]  Fredrik Kahl,et al.  An Efficient Optimization Framework for Multi-Region Segmentation Based on Lagrangian Duality , 2013, IEEE Transactions on Medical Imaging.

[63]  Xavier Bresson,et al.  A Variational Model for Object Segmentation Using Boundary Information and Shape Prior Driven by the Mumford-Shah Functional , 2006, International Journal of Computer Vision.

[64]  Yuri Boykov,et al.  Globally optimal segmentation of multi-region objects , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[65]  Peng Zhao,et al.  Supervised learning-based cell image segmentation for P53 immunohistochemistry , 2006, IEEE Transactions on Biomedical Engineering.

[66]  Tony F. Chan,et al.  A Multiphase Level Set Framework for Image Segmentation Using the Mumford and Shah Model , 2002, International Journal of Computer Vision.