Directional Enlacement Histograms for the Description of Complex Spatial Configurations between Objects

The analysis of spatial relations between objects in digital images plays a crucial role in various application domains related to pattern recognition and computer vision. Classical models for the evaluation of such relations are usually sufficient for the handling of simple objects, but can lead to ambiguous results in more complex situations. In this article, we investigate the modeling of spatial configurations where the objects can be imbricated in each other. We formalize this notion with the term enlacement, from which we also derive the term interlacement, denoting a mutual enlacement of two objects. Our main contribution is the proposition of new relative position descriptors designed to capture the enlacement and interlacement between two-dimensional objects. These descriptors take the form of circular histograms allowing to characterize spatial configurations with directional granularity, and they highlight useful invariance properties for typical image understanding applications. We also show how these descriptors can be used to evaluate different complex spatial relations, such as the surrounding of objects. Experimental results obtained in the different application domains of medical imaging, document image analysis and remote sensing, confirm the genericity of this approach.

[1]  John Freeman,et al.  The modelling of spatial relations , 1975 .

[2]  Roberto Marcondes Cesar Junior,et al.  Modeling and measuring the spatial relation "along": Regions, contours and fuzzy sets , 2012, Pattern Recognit..

[3]  Nicole Vincent,et al.  Towards historical document indexing: extraction of drop cap letters , 2011, International Journal on Document Analysis and Recognition (IJDAR).

[4]  Matthew B. Blaschko,et al.  A Discriminatively Trained Fully Connected Conditional Random Field Model for Blood Vessel Segmentation in Fundus Images , 2017, IEEE Transactions on Biomedical Engineering.

[5]  Gwénolé Quellec,et al.  Automated early detection of diabetic retinopathy. , 2010, Ophthalmology.

[6]  Gang Wang,et al.  Exploring Local and Overall Ordinal Information for Robust Feature Description , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  T. McNamara Mental representations of spatial relations , 1986, Cognitive Psychology.

[8]  Arno Schäpe,et al.  Multiresolution Segmentation : an optimization approach for high quality multi-scale image segmentation , 2000 .

[9]  James F. Allen Maintaining knowledge about temporal intervals , 1983, CACM.

[10]  Roberto Marcondes Cesar Junior,et al.  Inexact graph matching using stochastic optimization techniques for facial feature recognition , 2002, Object recognition supported by user interaction for service robots.

[11]  Nicolas Passat,et al.  Extraction of complex patterns from multiresolution remote sensing images: A hierarchical top-down methodology , 2012, Pattern Recognit..

[12]  Nicolas Loménie,et al.  Point set morphological filtering and semantic spatial configuration modeling: Application to microscopic image and bio-structure analysis , 2012, Pattern Recognit..

[13]  Isabelle Bloch,et al.  A fuzzy definition of the spatial relation "surround" - Application to complex shapes , 2011, EUSFLAT Conf..

[14]  Ozy Sjahputera,et al.  The use of force histograms for affine-invariant relative position description , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Pascal Matsakis,et al.  Introducing the Φ-Descriptor - A Most Versatile Relative Position Descriptor , 2015, ICPRAM.

[16]  Isabelle Bloch,et al.  Fuzzy spatial relationships for image processing and interpretation: a review , 2005, Image Vis. Comput..

[17]  Isabelle Bloch,et al.  Integration of fuzzy spatial relations in deformable models - Application to brain MRI segmentation , 2006, Pattern Recognit..

[18]  Bunyarit Uyyanonvara,et al.  An Ensemble Classification-Based Approach Applied to Retinal Blood Vessel Segmentation , 2012, IEEE Transactions on Biomedical Engineering.

[19]  安藤 広志,et al.  20世紀の名著名論:David Marr:Vision:a Computational Investigation into the Human Representation and Processing of Visual Information , 2005 .

[20]  Roberto Marcondes Cesar Junior,et al.  On the ternary spatial relation "Between" , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[21]  Ozy Sjahputera,et al.  Linguistic description of relative positions in images , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[22]  Isabelle Bloch,et al.  Alignment and Parallelism for the Description of High-Resolution Remote Sensing Images , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Azriel Rosenfeld,et al.  Degree of adjacency or surroundedness , 1984, Pattern Recognit..

[24]  Max A. Viergever,et al.  Ridge-based vessel segmentation in color images of the retina , 2004, IEEE Transactions on Medical Imaging.

[25]  Pascal Matsakis,et al.  The fuzzy line between among and surround , 2002, 2002 IEEE World Congress on Computational Intelligence. 2002 IEEE International Conference on Fuzzy Systems. FUZZ-IEEE'02. Proceedings (Cat. No.02CH37291).

[26]  Isabelle Bloch,et al.  Fuzzy Relative Position Between Objects in Image Processing: A Morphological Approach , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  D. Dubois,et al.  Weighted fuzzy pattern matching , 1988 .

[28]  James M. Keller,et al.  A Memetic Algorithm for Matching Spatial Configurations With the Histograms of Forces , 2013, IEEE Transactions on Evolutionary Computation.

[29]  Pascal Matsakis,et al.  Relative Position Descriptors , 2015, ICPRAM 2015.

[30]  Laurent Wendling,et al.  A New Way to Represent the Relative Position between Areal Objects , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Laurent Wendling,et al.  Color and grey level object retrieval using a 3D representation of force histogram , 2003, Image Vis. Comput..

[32]  Pascal Matsakis,et al.  An equivalent definition of the histogram of forces: Theoretical and algorithmic implications , 2010, Pattern Recognit..

[33]  Laurent Wendling,et al.  A General Approach to the Fuzzy Modeling of Spatial Relationships , 2010, Methods for Handling Imperfect Spatial Information.

[34]  Isabelle Bloch,et al.  Fuzzy spatial relations for high resolution remote sensing image analysis: The case of “to go across” , 2009, 2009 IEEE International Geoscience and Remote Sensing Symposium.

[35]  Laurent Wendling,et al.  Color Object Recognition based on Spatial Relations between Image Layers , 2015, VISAPP.

[36]  Isabelle Bloch,et al.  Fuzzy sets for image processing and understanding , 2015, Fuzzy Sets Syst..

[37]  Pascal Matsakis,et al.  Relative Position Descriptors - A Review , 2015, ICPRAM.

[38]  Elli Angelopoulou,et al.  Retinal vessel segmentation by improved matched filtering: evaluation on a new high-resolution fundus image database , 2013, IET Image Process..

[39]  Éric Anquetil,et al.  Learning of fuzzy spatial relations between handwritten patterns , 2014, Int. J. Data Min. Model. Manag..

[40]  Anca L. Ralescu,et al.  Spatial organization in 2D segmented images: representation and recognition of primitive spatial relations , 1994, CVPR 1994.

[41]  Guojun Lu,et al.  Shape-based image retrieval using generic Fourier descriptor , 2002, Signal Process. Image Commun..

[42]  Isabelle Bloch,et al.  Directional relative position between objects in image processing: a comparison between fuzzy approaches , 2003, Pattern Recognit..

[43]  Zhanyi Hu,et al.  This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. IEEE TRANSACTION ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE 1 Rotationally Invariant Descript , 2011 .