Multifractal-based nuclei segmentation in fish images

The method for nuclei segmentation in fluorescence in-situ hybridization (FISH) images, based on the inverse multifractal analysis (IMFA) is proposed. From the blue channel of the FISH image in RGB format, the matrix of Holder exponents, with one-by-one correspondence with the image pixels, is determined first. The following semi-automatic procedure is proposed: initial nuclei segmentation is performed automatically from the matrix of Holder exponents by applying predefined hard thresholding; then the user evaluates the result and is able to refine the segmentation by changing the threshold, if necessary. After successful nuclei segmentation, the HER2 (human epidermal growth factor receptor 2) scoring can be determined in usual way: by counting red and green dots within segmented nuclei, and finding their ratio. The IMFA segmentation method is tested over 100 clinical cases, evaluated by skilled pathologist. Testing results show that the new method has advantages compared to already reported methods.

[1]  H. Netten,et al.  FISH and chips: automation of fluorescent dot counting in interphase cell nuclei. , 1997, Cytometry.

[2]  F del Pozo,et al.  Automated FISH spot counting in interphase nuclei: statistical validation and data correction. , 1998, Cytometry.

[3]  P. Grassberger.  Generalized dimensions of strange attractors , 1983 .

[4]  Jacques Lévy Véhel,et al.  Introduction to the Multifractal Analysis of Images , 1998 .

[5]  D. Alpár,et al.  State‐of‐the‐art FISHing: Automated analysis of cytogenetic aberrations in interphase nuclei , 2012, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[6]  M. Press,et al.  Determination of HER2 Gene Amplification by Fluorescence In situ Hybridization and Concordance with the Clinical Trials Immunohistochemical Assay in Women with Metastatic Breast Cancer Evaluated for Treatment with Trastuzumab , 2005, Breast Cancer Research and Treatment.

[7]  W. Gullick,et al.  OVEREXPRESSION OF THE c-erbB-2 ONCOPROTEIN IN HUMAN BREAST CARCINOMAS: IMMUNOHISTOLOGICAL ASSESSMENT CORRELATES WITH GENE AMPLIFICATION , 1987, The Lancet.

[8]  Boaz Lerner,et al.  INVESTIGATION OF THE K2 ALGORITHM IN LEARNING BAYESIAN NETWORK CLASSIFIERS , 2011, Appl. Artif. Intell..

[9]  Benoit B. Mandelbrot,et al.  Fractal Geometry of Nature , 1984 .

[10]  Irini Reljin,et al.  Application of multifractal analysis on microscopic images in the classification of metastatic bone disease , 2012, Biomedical microdevices.

[11]  Inti Zlobec,et al.  HER2 gene status in primary breast cancers and matched distant metastases , 2007, Breast Cancer Research.

[12]  R. Jensen,et al.  Direct determination of the f(α) singularity spectrum , 1989 .

[13]  Raimund Leitner,et al.  Spot Counting for Automated Analysis of Unmixed Hyper-Spectral M-FISH Images , 2008 .

[14]  B. Mandelbrot.  How Long Is the Coast of Britain? Statistical Self-Similarity and Fractional Dimension , 1967, Science.

[15]  I. Rakocevic,et al.  Multifractal analysis of gray-scale images , 2000, 2000 10th Mediterranean Electrotechnical Conference. Information Technology and Electrotechnology for the Mediterranean Countries. Proceedings. MeleCon 2000 (Cat. No.00CH37099).

[16]  Ioannis Pitas,et al.  Automated evaluation of her-2/neu status in breast tissue from fluorescent in situ hybridization images , 2005, IEEE Transactions on Image Processing.

[17]  Dietmar Saupe,et al.  Chaos and fractals - new frontiers of science (2. ed.) , 2004 .

[18]  H. G. E. Hentschel,et al.  The infinite number of generalized dimensions of fractals and strange attractors , 1983 .

[19]  Benoit B. Mandelbrot,et al.  Multifractal measures, especially for the geophysicist , 1989 .

[20]  W. McGuire,et al.  Human breast cancer: correlation of relapse and survival with amplification of the HER-2/neu oncogene. , 1987, Science.

[21]  Jean-Marc Guinebretière,et al.  SISH/CISH or qPCR as alternative techniques to FISH for determination of HER2 amplification status on breast tumors core needle biopsies: a multicenter experience based on 840 cases , 2013, BMC Cancer.

[22]  Rongchun Zhao,et al.  Adaptive Segmentation of Textured Images by Using the Coupled Markov Random Field Model , 2006, IEEE Transactions on Image Processing.

[23]  Eric L. Johnson,et al.  Impact of 2013 American Society of Clinical Oncology/College of American Pathologists (ASCO/CAP) guidelines on HER2 fluorescent in situ hybridization (FISH) testing in breast cancers: Experience from a national reference laboratory. , 2017 .

[24]  J. Ussher,et al.  Constructions of sex and intimacy after cancer: Q methodology study of people with cancer, their partners, and health professionals , 2013, BMC Cancer.

[25]  Claudio Delrieux,et al.  Multifractal characterisation and classification of bread crumb digital images , 2015, EURASIP J. Image Video Process..

[26]  J. Baak,et al.  Comparing subjective and digital image analysis HER2/neu expression scores with conventional and modified FISH scores in breast cancer , 2007, Journal of Clinical Pathology.

[27]  T. W. Ridler,et al.  Picture thresholding using an iterative selection method. , 1978 .

[28]  David J. Foran,et al.  Computer-assisted assessment of the Human Epidermal Growth Factor Receptor 2 immunohistochemical assay in imaged histologic sections using a membrane isolation algorithm and quantitative analysis of positive controls , 2008, BMC Medical Imaging.

[29]  J. Ross,et al.  The HER-2 receptor and breast cancer: ten years of targeted anti-HER-2 therapy and personalized medicine. , 2009, The oncologist.

[30]  Sameer Singh,et al.  Advanced Algorithmic Approaches to Medical Image Segmentation , 2002, Advances in Computer Vision and Pattern Recognition.

[31]  J. L. Véhel.  Fractal Approaches in Signal Processing , 1995 .

[32]  D. Huber,et al.  Micro fluorescence in situ hybridization (μFISH) for spatially multiplexed analysis of a cell monolayer , 2016, Biomedical microdevices.

[33]  Boaz Lerner.  Bayesian fluorescence in situ hybridisation signal classification , 2004, Artif. Intell. Medicine.

[34]  Martin Turner,et al.  Fractal geometry in digital imaging , 1998 .

[35]  Irini Reljin,et al.  Adaptation of multifractal analysis to segmentation of microcalcifications in digital mammograms , 2006 .

[36]  Rongchun Zhao,et al.  Morphology-based multifractal estimation for texture segmentation , 2006, IEEE Transactions on Image Processing.

[37]  James Theiler,et al.  Estimating fractal dimension , 1990 .

[38]  J. Suri,et al.  Advanced algorithmic approaches to medical image segmentation: state-of-the-art application in cardiology, neurology, mammography and pathology , 2001 .

[39]  S. Bull,et al.  neu/erbB-2 amplification identifies a poor-prognosis group of women with node-negative breast cancer. Toronto Breast Cancer Study Group. , 1998, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[40]  M Kozubek,et al.  High-resolution cytometry of FISH dots in interphase cell nuclei. , 1999, Cytometry.

[41]  T. Yamamoto,et al.  The product of the human c-erbB-2 gene: a 185-kilodalton glycoprotein with tyrosine kinase activity. , 1986, Science.

[42]  John M S Bartlett,et al.  HER2 testing: current status and future directions. , 2014, Cancer treatment reviews.

[43]  M Kozubek,et al.  Combined confocal and wide-field high-resolution cytometry of fluorescent in situ hybridization-stained cells. , 2001, Cytometry.

[44]  Marc Buyse,et al.  Adjuvant trastuzumab in HER2-positive breast cancer. , 2011, The New England journal of medicine.

[45]  Boaz Lerner,et al.  Classification of fluorescence in situ hybridization images using belief networks , 2004, Pattern Recognit. Lett..

[46]  Po-Whei Huang,et al.  Automatic Classification for Pathological Prostate Images Based on Fractal Analysis , 2009, IEEE Transactions on Medical Imaging.

[47]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .