Object Selection in Computer Vision: From Multi-thresholding to Percolation Based Scene Representation

We consider several approaches to the multi-threshold analysis of monochromatic images and consequent interpretation of its results in computer vision systems. The key aspect of our analysis is that it is based on a complete scene reconstruction leading to the object based scene representation inspired by principles from percolation theory. As a generalization of the conventional image segmentation, the proposed reconstruction leads to a multi-scale hierarchy of objects, thus allowing embedded objects to be represented at different scales. Using this reconstruction, we next suggest a direct approach to the object selection as a subset of the reconstructed scene based on a posteriori information obtained by multi-thresholding at the cost of the algorithm performance. We consider several geometric invariants as selection algorithm variables and validate our approach explicitly using prominent examples of synthetic models, remote sensing images, and microscopic data of biological samples.

[1]  A. Troy,et al.  An object‐oriented approach for analysing and characterizing urban landscape at the parcel level , 2008 .

[2]  Hermann Rohling,et al.  Radar CFAR Thresholding in Clutter and Multiple Target Situations , 1983, IEEE Transactions on Aerospace and Electronic Systems.

[3]  Mikhail I Bogachev,et al.  Shape anomaly detection under strong measurement noise: An analytical approach to adaptive thresholding. , 2015, Physical review. E, Statistical, nonlinear, and soft matter physics.

[4]  Sahil Gupta,et al.  Cell‐death assessment by fluorescent and nonfluorescent cytosolic and nuclear staining techniques , 2014, Journal of microscopy.

[5]  Anne E Carpenter,et al.  CellProfiler: image analysis software for identifying and quantifying cell phenotypes , 2006, Genome Biology.

[6]  Anne E Carpenter,et al.  Improved structure, function and compatibility for CellProfiler: modular high-throughput image analysis software , 2011, Bioinform..

[7]  Prasanta K. Panigrahi,et al.  Multilevel thresholding for image segmentation through a fast statistical recursive algorithm , 2006, Pattern Recognit. Lett..

[8]  Michael Habeck,et al.  Spatial statistics, image analysis and percolation theory , 2011 .

[9]  Polina Golland,et al.  CellProfiler Analyst: data exploration and analysis software for complex image-based screens , 2008, BMC Bioinformatics.

[10]  M. Shur,et al.  The relation between the critical exponents of percolation theory , 1975 .

[11]  Olaf Wittich,et al.  Randomized algorithms for statistical image analysis and site percolation on square lattices , 2011 .

[12]  A. Kayumov,et al.  Fast and simple tool for the quantification of biofilm-embedded cells sub-populations from fluorescent microscopic images , 2017, bioRxiv.

[13]  Oliwia Makarewicz,et al.  A Novel Computerized Cell Count Algorithm for Biofilm Analysis , 2016, PloS one.

[14]  E. Rozhina,et al.  Targeting microbial biofilms using Ficin, a nonspecific plant protease , 2017, Scientific Reports.

[15]  Mikhail I. Bogachev,et al.  Selection and Analysis of Objects in Multi-Threshold Image Processing , 2019, 2019 IEEE Conference of Russian Young Researchers in Electrical and Electronic Engineering (EIConRus).

[16]  Manuel Guizar-Sicairos,et al.  Three-Dimensional Structure Analysis and Percolation Properties of a Barrier Marine Coating , 2013, Scientific Reports.

[17]  Mohamed Bakry El Mashade PERFORMANCE IMPROVEMENT OF ADAPTIVE DETECTION OF RADAR TARGET IN AN INTERFERENCE SATURATED ENVIRONMENT , 2008 .

[18]  V. Y. Volkov Extraction of Extended Small-Scale Objects in Digital Images , 2015 .

[19]  Haiyan Gu,et al.  An Efficient Parallel Multi-Scale Segmentation Method for Remote Sensing Imagery , 2018, Remote. Sens..

[20]  P. Priyanka,et al.  A Multi Level Fuzzy Threshold Image Segmentation Method for Industrial Applications , 2017 .

[21]  Bostjan Likar,et al.  A Review of Methods for Correction of Intensity Inhomogeneity in MRI , 2007, IEEE Transactions on Medical Imaging.

[22]  Olaf Wittich,et al.  Detection of objects in noisy images and site percolation on square lattices , 2011, ArXiv.

[23]  Andrew Blake,et al.  Fusion Moves for Markov Random Field Optimization , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  M. B. El-Mashade PERFORMANCE IMPROVEMENT OF ADAPTIVE DETECTION OF RADAR TARGET IN AN INTERFERENCE SATURATED ENVIRONMENT , 2008 .

[25]  Jingfang Fan,et al.  Percolation framework of the Earth's topography. , 2018, Physical review. E.

[26]  Johannes E. Schindelin,et al.  Fiji: an open-source platform for biological-image analysis , 2012, Nature Methods.

[27]  Ming-Hsuan Yang,et al.  Fast and Accurate Online Video Object Segmentation via Tracking Parts , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[28]  Erik Cuevas,et al.  Multithreshold Segmentation by Using an Algorithm Based on the Behavior of Locust Swarms , 2015 .

[29]  Nikolai N. Medvedev,et al.  Geometrical analysis of the structure of simple liquids : percolation approach , 1991 .

[30]  Thomas Blaschke,et al.  Object based image analysis for remote sensing , 2010 .

[31]  S. Shandarin,et al.  Percolation analysis of nonlinear structures in scale-free two-dimensional simulations , 1992 .

[32]  Haluk Beyenal,et al.  Three-dimensional biofilm structure quantification. , 2004, Journal of microbiological methods.

[33]  Gui Gao,et al.  Statistical Modeling of SAR Images: A Survey , 2010, Sensors.

[34]  H. M. Finn,et al.  Adaptive detection mode with threshold control as a function of spatially sampled clutter level estimates , 1968 .

[35]  M. V. van Zandvoort,et al.  Microscopy tools for the investigation of intracellular lipid storage and dynamics , 2015, Molecular metabolism.

[36]  Airat R. Kayumov,et al.  Selection and Quantification of Objects in Microscopic Images: from Multi-Criteria to Multi-Threshold Analysis , 2018, BioNanoScience.

[37]  Anne E Carpenter,et al.  CellProfiler: free, versatile software for automated biological image analysis. , 2007, BioTechniques.

[38]  Yang Yang,et al.  K - means multi-threshold image segmentation based on firefly algorithm , 2013, ICMT 2013.

[39]  B. Ersbøll,et al.  Quantification of biofilm structures by the novel computer program COMSTAT. , 2000, Microbiology.

[40]  Dirk Tiede,et al.  Towards a GEOBIA 2.0 manifesto - achievements and open challenges in information & knowledge extraction from big Earth data , 2018 .

[41]  N. Jarvis,et al.  Connectivity and percolation of structural pore networks in a cultivated silt loam soil quantified by X-ray tomography , 2017 .

[42]  Jim Piper,et al.  Erosion and dilation of binary images by arbitrary structuring elements using interval coding , 1989, Pattern Recognit. Lett..

[43]  N. Xie,et al.  Percolation backbone structure analysis in electrically conductive carbon fiber reinforced cement composites , 2012 .

[44]  R. Meyer,et al.  Confocal microscopy imaging of the biofilm matrix. , 2017, Journal of microbiological methods.

[45]  S. Havlin,et al.  Fractals and Disordered Systems , 1991 .

[46]  Helge J. Ritter,et al.  Human vs. machine: evaluation of fluorescence micrographs , 2003, Comput. Biol. Medicine.

[47]  Michael Unser,et al.  DeconvolutionLab2: An open-source software for deconvolution microscopy. , 2017, Methods.