Combining Geometric and Topological Information in Image Segmentation

A fundamental problem in computer vision is image segmentation, where the goal is to delineate the boundary of an object in the image. The focus of this work is on the segmentation of grayscale images and its purpose is two-fold. First, we conduct an in-depth study comparing active contour and topology-based methods in a statistical framework, two popular approaches for boundary detection of 2-dimensional images. Certain properties of the image dataset may favor one method over the other, both from an interpretability perspective as well as through evaluation of performance measures. Second, we propose the use of topological knowledge to assist an active contour method, which can potentially incorporate prior shape information. The latter is known to be extremely sensitive to algorithm initialization, and thus, we use a topological model to provide an automatic initialization. In addition, our proposed model can handle objects in images with more complex topological structures, including objects with holes and multiple objects within one image. We demonstrate this on artificially-constructed image datasets from computer vision, as well as real medical image data.

[1]  Facundo Mémoli,et al.  Topological Methods for the Analysis of High Dimensional Data Sets and 3D Object Recognition , 2007, PBG@Eurographics.

[2]  Rachid Deriche,et al.  Geodesic active regions for supervised texture segmentation , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[3]  Frédo Durand,et al.  A Topological Approach to Hierarchical Segmentation using Mean Shift , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Kelin Xia,et al.  Persistent homology analysis of protein structure, flexibility, and folding , 2014, International journal for numerical methods in biomedical engineering.

[5]  S. Kobayashi,et al.  The differences of clinical parameters between small multiple ischemic lesions and single lesion detected by diffusion‐weighted MRI , 2002, Acta neurologica Scandinavica.

[6]  Anuj Srivastava,et al.  Elastic shapes models for improving segmentation of object boundaries in synthetic aperture sonar images , 2013, Comput. Vis. Image Underst..

[7]  Rikard Berthilsson,et al.  A Statistical Theory of Shape , 1998, SSPR/SPR.

[8]  Robert Ghrist,et al.  Elementary Applied Topology , 2014 .

[9]  H. Späth,et al.  The minisum location problem for the Jaccard metric , 1981 .

[10]  Anuj Srivastava,et al.  Shape Analysis of Elastic Curves in Euclidean Spaces , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  P. Jaccard Distribution de la flore alpine dans le bassin des Dranses et dans quelques régions voisines , 1901 .

[12]  Tamal K. Dey,et al.  Approximating loops in a shortest homology basis from point data , 2010, SoCG '10.

[13]  Laurent Younes,et al.  Computable Elastic Distances Between Shapes , 1998, SIAM J. Appl. Math..

[14]  Y. J. Zhang,et al.  A survey on evaluation methods for image segmentation , 1996, Pattern Recognit..

[15]  Noel C. F. Codella,et al.  Skin lesion analysis toward melanoma detection: A challenge at the 2017 International symposium on biomedical imaging (ISBI), hosted by the international skin imaging collaboration (ISIC) , 2016, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[16]  Anuj Srivastava,et al.  Bayesian Active Contours with Affine-Invariant, Elastic Shape Prior , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Changhe Yuan,et al.  Optimal Topological Cycles and Their Application in Cardiac Trabeculae Restoration , 2017, IPMI.

[18]  Emerson G. Escolar,et al.  Hierarchical structures of amorphous solids characterized by persistent homology , 2015, Proceedings of the National Academy of Sciences.

[19]  Gunnar E. Carlsson,et al.  Topology and data , 2009 .

[20]  Sebastian Kurtek,et al.  Automatic Detection and Uncertainty Quantification of Landmarks on Elastic Curves , 2019, Journal of the American Statistical Association.

[21]  L. Wasserman Topological Data Analysis , 2016, 1609.08227.

[22]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[23]  Sivaraman Balakrishnan,et al.  Confidence sets for persistence diagrams , 2013, The Annals of Statistics.

[24]  K. Mardia,et al.  Size and shape analysis of landmark data , 1992 .

[25]  Anuj Srivastava,et al.  A Novel Representation for Riemannian Analysis of Elastic Curves in Rn , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Anuj Srivastava,et al.  Functional and Shape Data Analysis , 2016 .

[27]  Philippe Montesinos,et al.  From contours to ground truth: how to evaluate edge detectors by filtering , 2017 .

[28]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[29]  Anuj Srivastava,et al.  Intrinsic Bayesian Active Contours for Extraction of Object Boundaries in Images , 2009, International Journal of Computer Vision.

[30]  Herbert Edelsbrunner,et al.  Alpha, Betti and the Megaparsec Universe: On the Topology of the Cosmic Web , 2013, Trans. Comput. Sci..

[31]  K. Mardia,et al.  Statistical Shape Analysis , 1998 .

[32]  M. Gameiro,et al.  A topological measurement of protein compressibility , 2014, Japan Journal of Industrial and Applied Mathematics.

[33]  Charless C. Fowlkes,et al.  Contour Detection and Hierarchical Image Segmentation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Oge Marques,et al.  Practical Image and Video Processing Using MATLAB®: Marques/Practical Image Processing , 2011 .

[35]  Yizong Cheng,et al.  Mean Shift, Mode Seeking, and Clustering , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  Zhuowen Tu,et al.  Learning Context-Sensitive Shape Similarity by Graph Transduction , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Chao Chen,et al.  Segmenting the Papillary Muscles and the Trabeculae from High Resolution Cardiac CT through Restoration of Topological Handles , 2013, IPMI.

[38]  D. Kendall A Survey of the Statistical Theory of Shape , 1989 .

[39]  F. Bookstein Size and Shape Spaces for Landmark Data in Two Dimensions , 1986 .

[40]  Anuj Srivastava,et al.  Shadow Segmentation in SAS and SAR Using Bayesian Elastic Contours , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[41]  D. Kendall SHAPE MANIFOLDS, PROCRUSTEAN METRICS, AND COMPLEX PROJECTIVE SPACES , 1984 .

[42]  Guillermo Sapiro,et al.  Geodesic Active Contours , 1995, International Journal of Computer Vision.

[43]  Jason Fritts,et al.  Image Segmentation Using Topological Persistence , 2007, CAIP.

[44]  Qian Huang,et al.  Quantitative methods of evaluating image segmentation , 1995, Proceedings., International Conference on Image Processing.

[45]  Alan L. Yuille,et al.  Region Competition: Unifying Snakes, Region Growing, and Bayes/MDL for Multiband Image Segmentation , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[46]  Ralph Roskies,et al.  Fourier Descriptors for Plane Closed Curves , 1972, IEEE Transactions on Computers.

[47]  Anuj Srivastava,et al.  Statistical Modeling of Curves Using Shapes and Related Features , 2012 .

[48]  Anuj Srivastava,et al.  Analysis of planar shapes using geodesic paths on shape spaces , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.