Radial symmetries based decomposition of cell clusters in binary and gray level images

The segmentation of structures of complex cytological and histological images is a necessary intermediate step for image analysis that give rise to binary images. In many cases these binary images can be rather far away from a subsequent object specific quantification because biological structures digitized by optoelectronic devices may situated close together so that they appear as one fused object in the projective image. Such fusions of objects may become complex so that large clusters of biological structures emerge. To quantify individual objects of a cluster they must be separated. The shape, size and intensity variation of cells in complex organs like the brain may breed planar configurations that can be splitted only inadequate by common techniques, e.g., watershed separation or basic morphological processing of images. Considering iteratively object contours suitable features of saliency can be accumulated that give rise to markers of singular objects. Such significant markers may drive a separation process more effective than common approaches. The determination of markers by an iterative method should be scale, translation and rotation invariant and robust with regard to noise due to the variability of biological specimen. We realize a technique that splits cell clumps consisting of different cell sizes and shapes into meaningful parts. The multiscale method applied here is based on the analysis of the contour shape and the object area by iterative voting using oriented kernels. These cone-shaped kernels vote iteratively for the local center of mass of the components of an aggregation. The voting is performed along the gradient of the distance transformation of the binarized image of aggregates. Iterative voting is initialized by voting along the gradient direction where at each iteration the voting direction and shape of the kernel is refined, resp. the kernel topography is refined and reoriented iteratively. It turned out that the kernel topography is unique because it votes for the most likely set of grid points where the gravity center of an individual cluster component may be located. Furthermore, a new procedure is realized to use the local intensities of aggregations for kernel voting. The last voted iteration provides gravitation centers, resp. centers of mass of the clumped cells. These are extracted and used as markers to determine individual cell boundaries by a marker based watershed postprocessing. The subject of this paper is to highlight the basic algorithm of iterative kernel voting and expanding it to process intensities within clusters as well as contour information. The approach is applied to synthetic images that were modified systematically with regard to object topology. Natural aggregates of cells at the light microscopic level and cell clusters derived from high resolution flat bed scanning were splitted. In addition to these examples images from a benchmark databases were investigated. The splittings generated by the iterative voting approach were compared with expected splittings of test persons and with results of the watershed method. Especially the gray level based iterative voting method provides superior results for cell cluster separation in comparison to the watershed procedure.

[1]  Theodosios Pavlidis,et al.  Segmentation of Plane Curves , 1974, IEEE Transactions on Computers.

[2]  William E. Higgins,et al.  Shape Representation: Comparison between the Morphological Skeleton and Morphological Shape Decomposition , 1994, ICIP.

[3]  R. Eggers,et al.  Flat‐bed scanning as a tool for quantitative neuroimaging , 1999, Journal of microscopy.

[4]  John C. Russ,et al.  The Image Processing Handbook , 2016, Microscopy and Microanalysis.

[5]  H. Talbot,et al.  Elliptical Distance Transforms And Object Splitting , 2002 .

[6]  Remco C. Veltkamp,et al.  Polygon Decomposition Based on the Straight Line Skeleton , 2002, Theoretical Foundations of Computer Vision.

[7]  Thomas Martin Deserno,et al.  Scale-independent shape analysis for quantitative cytology using mathematical morphology , 2000, Comput. Biol. Medicine.

[8]  Guojun Lu,et al.  Review of shape representation and description techniques , 2004, Pattern Recognit..

[9]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[10]  Tianzi Jiang,et al.  Cell Image Segmentation with Kernel-Based Dynamic Clustering and an Ellipsoidal Cell Shape Model , 2001, J. Biomed. Informatics.

[11]  P.K Sahoo,et al.  A survey of thresholding techniques , 1988, Comput. Vis. Graph. Image Process..

[12]  Petr Dokládal,et al.  Modelling of Overlapping Circular Objects Based on Level Set Approach , 2004, ICIAR.

[13]  Martin D. Levine,et al.  Real-Time Attention for Robotic Vision , 1997, Real Time Imaging.

[14]  Terence M. Cronin,et al.  Visualizing concave and convex partitioning of 2D contours , 2003, Pattern Recognit. Lett..

[15]  Frédéric Cao,et al.  Geometric curve evolution and image processing , 2003, Lecture notes in mathematics.

[16]  A W Smeulders,et al.  Segmentation of tissue architecture by distance graph matching. , 1999, Cytometry.

[17]  T Greenland,et al.  Morphometric studies of cell nuclei by means of image analysis and computer data processing. , 1980, Gegenbaurs morphologisches Jahrbuch.

[18]  Petros Maragos,et al.  Morphological filters-Part II: Their relations to median, order-statistic, and stack filters , 1987, IEEE Trans. Acoust. Speech Signal Process..

[19]  Badrinath Roysam,et al.  An improved watershed algorithm for counting objects in noisy, anisotropic 3-D biological images , 1995, Proceedings., International Conference on Image Processing.

[20]  Yi Cui,et al.  Blob Analysis Using Watershed Transformation , 2000, IEA/AIE.

[21]  Yu Jin Zhang,et al.  Evaluation and comparison of different segmentation algorithms , 1997, Pattern Recognit. Lett..

[22]  Pepe Siy,et al.  Polygonal representation of digital planar curves through dominant point detection - a nonparametric algorithm , 2004, Pattern Recognit..

[23]  Bahram Parvin,et al.  BioSig: An Imaging Bioinformatic System for Studying Phenomic , 2002, Computer.

[24]  Sven Loncaric,et al.  A survey of shape analysis techniques , 1998, Pattern Recognit..

[25]  Ewert Bengtsson,et al.  Watershed segmentation of binary images using distance transformations , 1993, Electronic Imaging.

[26]  Linda G. Shapiro,et al.  Image Segmentation Techniques , 1984, Other Conferences.

[27]  Sebastiano B. Serpico,et al.  Merging Of Different Segmentation Techniques For Cell Image Recognition , 1989, Other Conferences.

[28]  Bahram Parvin,et al.  Localization of saliency through iterative voting , 2004, ICPR 2004.

[29]  J J Vaquero,et al.  Applying watershed algorithms to the segmentation of clustered nuclei. , 1998, Cytometry.

[30]  Abderrahim Elmoataz,et al.  Using active contours and mathematical morphology tools for quantification of immunohistochemical images , 1998, Signal Process..

[31]  Jung-Hee Kim,et al.  Efficient morphological segmentation for significantly overlapped particles , 1995, Electronic Imaging.

[32]  H. Talbot,et al.  ELLIPTICAL DISTANCE TRANSFORMS AND THE OBJECT SPLITTING PROBLEM , 2002 .

[33]  Sergey Ablameyko,et al.  Morphological segmentation of histology cell images , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[34]  Marco Bertamini,et al.  The shape of holes , 2003, Cognition.

[35]  Michael Brady,et al.  A New Technique for Local Symmetry Estimation , 2005, Scale-Space.

[36]  J. Feldman,et al.  Information along contours and object boundaries. , 2005, Psychological review.

[37]  Paul A. Yushkevich,et al.  Segmentation, registration, and measurement of shape variation via image object shape , 1999, IEEE Transactions on Medical Imaging.

[38]  M. Stella Atkins,et al.  New approach to measure border irregularity for melanocytic lesions , 2000, Medical Imaging: Image Processing.

[39]  Kristinn R. Thórisson,et al.  Simulated Perceptual Grouping: An Application to Human-Computer Interaction , 2019, Proceedings of the Sixteenth Annual Conference of the Cognitive Science Society.

[40]  Ze-Nian Li,et al.  Indentation and Protrusion Detection and Its Applications , 2001, Scale-Space.

[41]  John Goutsias,et al.  Centrum Voor Wiskunde En Informatica Reportrapport Multiresolution Signal Decomposition Schemes. Part 1: Linear and Morphological Pyramids Multiresolution Signal Decomposition Schemes. Part 1: Linear and Morphological Pyramids , 2022 .

[42]  R. Basri,et al.  The role of convexity in perceptual completion: beyond good continuation , 1999, Vision Research.

[43]  Yanxi Liu,et al.  A computational model for periodic pattern perception based on frieze and wallpaper groups , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[44]  O Schmitt,et al.  Systematic investigations of the contrast results of histochemical stainings of neurons and glial cells in the human brain by means of image analysis. , 1997, Micron.

[45]  Bülent Sankur,et al.  Survey over image thresholding techniques and quantitative performance evaluation , 2004, J. Electronic Imaging.

[46]  Badrinath Roysam,et al.  A hybrid 3D watershed algorithm incorporating gradient cues and object models for automatic segmentation of nuclei in confocal image stacks , 2003, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[47]  Luciano da Fontoura Costa,et al.  Shape Analysis and Classification: Theory and Practice , 2000 .

[48]  Ewert Bengtsson,et al.  A Feature Set for Cytometry on Digitized Microscopic Images , 2003, Analytical cellular pathology : the journal of the European Society for Analytical Cellular Pathology.

[49]  Steven A. Shafer,et al.  Morphological segmentation of multiprobe fluorescence images for immunophenotyping in melanoma tissue sections , 1993, Other Conferences.

[50]  Henk J. A. M. Heijmans,et al.  Nonlinear multiresolution signal decomposition schemes. I. Morphological pyramids , 2000, IEEE Trans. Image Process..

[51]  Qing Yang,et al.  Perceptual organization of radial symmetries , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[52]  Joakim Lindblad,et al.  Robust Cell Image Segmentation Methods , 2004 .

[53]  Guillaume-Alexandre Bilodeau,et al.  Part segmentation of objects in real images , 2002, Pattern Recognit..

[54]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[55]  Philippe Van Ham,et al.  Dynamic behavior analysis of in-vitro cancerous cells by means of an automatic image-processing device , 1996, Medical Imaging.

[56]  D J Foran,et al.  A method for quantitative image assessment based on redundant feature measurements and statistical reasoning. , 1994, Computer methods and programs in biomedicine.

[57]  Murat Kunt,et al.  Size-sensitive multiresolution decomposition of images with rank order based filters , 1992, Signal Process..

[58]  H. L. Resnikoff The illusion of reality , 1988 .

[59]  Joakim Lindblad,et al.  Image analysis for automatic segmentation of cytoplasms and classification of Rac1 activation , 2004, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[60]  C Wählby,et al.  Combining intensity, edge and shape information for 2D and 3D segmentation of cell nuclei in tissue sections , 2004, Journal of microscopy.

[61]  Bahram Parvin,et al.  Geometric Approach to Segmentation and Protein Localization in Cell Cultured Assays , 2005, ISVC.

[62]  Brian C. Lovell,et al.  Progress in the robust automated segmentation of real cell images , 1999, Smart Materials, Nano-, and Micro- Smart Systems.

[63]  J. Bigun,et al.  Optimal Orientation Detection of Linear Symmetry , 1987, ICCV 1987.

[64]  Sim Heng Ong,et al.  Clump splitting through concavity analysis , 1994, Pattern Recognit. Lett..

[65]  Bidyut Baran Chaudhuri,et al.  Semi-automatic segmentation of tissue cells from confocal microscope images , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[66]  Badrinath Roysam,et al.  Hierarchical, model‐based merging of multiple fragments for improved three‐dimensional segmentation of nuclei , 2005, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[67]  Hagit Hel-Or,et al.  Symmetry as a Continuous Feature , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[68]  Sankar K. Pal,et al.  A review on image segmentation techniques , 1993, Pattern Recognit..

[69]  H. Heijmans,et al.  Multiresolution signal decomposition schemes , 1998 .

[70]  Mandyam D. Srinath,et al.  Corner detection from chain-code , 1990, Pattern Recognit..

[71]  Alexander Zelinsky,et al.  Fast Radial Symmetry for Detecting Points of Interest , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[72]  Constantinos Loukas,et al.  Automated segmentation of cancer cell nuclei in complex tissue sections , 2001, European Conference on Biomedical Optics.

[73]  John R. Taylor,et al.  BioSig: a bioinformatic system for studying the mechanism of inter-cell signaling , 2000, Proceedings IEEE International Symposium on Bio-Informatics and Biomedical Engineering.

[74]  Yehezkel Yeshurun,et al.  Context-free attentional operators: The generalized symmetry transform , 1995, International Journal of Computer Vision.

[75]  Qing Yang,et al.  Harmonic cut and regularized centroid transform for localization of subcellular structures , 2003, IEEE Transactions on Biomedical Engineering.

[76]  Henk J. A. M. Heijmans,et al.  Mathematical Morphology as a Tool for Shape Description , 1994 .

[77]  Peter Stucki,et al.  Advanced image processing and modeling system for the analysis of cell micrographs in morphology , 1993, Electronic Imaging.

[78]  F. Attneave Some informational aspects of visual perception. , 1954, Psychological review.

[79]  Arnold W. M. Smeulders,et al.  Segmentation of cell clusters by nearest neighbour graphs , 1997 .

[80]  Til Aach,et al.  Morphological multiscale shape analysis of light micrographs , 2000, Electronic Imaging.

[81]  Hans Knutsson,et al.  Detecting rotational symmetries using normalized convolution , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[82]  D. Szarowski,et al.  Advances in automated 3-D image analyses of cell populations imaged by confocal microscopy. , 1996, Cytometry.

[83]  Jan Modersitzki,et al.  Videomicroscopy, image processing, and analysis of whole histologic sections of the human brain , 2005, Microscopy research and technique.

[84]  Yehezkel Yeshurun,et al.  Preprocessing of Face Images: Detection of Features and Pose Normalization , 1998, Comput. Vis. Image Underst..

[85]  A. Heyden,et al.  Segmentation of dense leukocyte clusters , 2001, IEEE Workshop on Mathematical Methods in Biomedical Image Analysis.

[86]  S. Sclaroff,et al.  Region segmentation via deformable model-guided split and merge , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[87]  Xiaohua Chen,et al.  Application of some valid methods in cell segmentation , 2001, International Symposium on Multispectral Image Processing and Pattern Recognition.

[88]  Ewert Bengtsson,et al.  Computerized Cell Image Analysis: Past, Present, and Future , 2003, SCIA.

[89]  J. Barba,et al.  A parametric fitting algorithm for segmentation of cell images , 1998, IEEE Transactions on Biomedical Engineering.

[90]  Jayasooriah,et al.  Image analysis of tissue sections , 1996, Comput. Biol. Medicine.

[91]  W. F. Clocksin,et al.  Automatic segmentation of overlapping nuclei with high background variation using robust estimation and flexible contour models , 2003, 12th International Conference on Image Analysis and Processing, 2003.Proceedings..

[92]  Ewert Bengtsson,et al.  Segmentation of Cell Nuclei in Tissue by Combining Seeded Watersheds with Gradient Information , 2003, SCIA.

[93]  Petros Maragos,et al.  Pattern Spectrum and Multiscale Shape Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[94]  Marc Salotti An efficient algorithm for the optimal polygonal approximation of digitized curves , 2001, Pattern Recognit. Lett..

[95]  Stan Sclaroff,et al.  Deformable Shape Detection and Description via Model-Based Region Grouping , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[96]  Jayant Shah Segmentation of Shapes , 2001, Scale-Space.

[97]  Donald D. Hoffman,et al.  Salience of visual parts , 1997, Cognition.

[98]  John C. Russ,et al.  Image Processing Handbook, Fourth Edition , 2002 .

[99]  R. Malladi Geometric methods in bio-medical image processing , 2002 .

[100]  H. Ross,et al.  Information Concentration along the Boundary Contours of Naturally Shaped Solid Objects , 2001, Perception.

[101]  Jos B. T. M. Roerdink,et al.  The Watershed Transform: Definitions, Algorithms and Parallelization Strategies , 2000, Fundam. Informaticae.

[102]  G. Buzsáki,et al.  Four modified silver methods for thick sections of formaldehyde-fixed mammalian central nervous tissue: ‘dark’ neurons, perikarya of all neurons, microglial cells and capillaries , 1993, Journal of Neuroscience Methods.

[103]  Stéphanie Portet,et al.  Quantitative analysis of cytokeratin network topology in the MCF7 cell line. , 1999, Cytometry.

[104]  Joan S. Weszka,et al.  A survey of threshold selection techniques , 1978 .

[105]  Paul L. Rosin Shape Partitioning by Convexity , 1999, BMVC.

[106]  Henk J. A. M. Heijmans,et al.  Algebraic Framework for Linear and Morphological Scale-Spaces , 2002, J. Vis. Commun. Image Represent..

[107]  Nelson D. A. Mascarenhas,et al.  Cell nuclei segmentation in noisy images using morphological watersheds , 1997, Optics & Photonics.

[108]  Jan Modersitzki,et al.  Numerical Methods for Image Registration , 2004 .

[109]  Peter H. Bartels,et al.  Scene segmentation in a machine vision system for histopathology , 1990, Photonics West - Lasers and Applications in Science and Engineering.

[110]  Jean Serra,et al.  Image Analysis and Mathematical Morphology , 1983 .

[111]  Jacob Feldman,et al.  Detection of change in shape: an advantage for concavities , 2003, Cognition.

[112]  K Siddiqi,et al.  Parts of Visual Form: Psychophysical Aspects , 1996, Perception.

[113]  Mohamed-Jalal Fadili,et al.  Fast Statistical Level Sets Image Segmentation for Biomedical Applications , 2001, Scale-Space.