Graph Consistency Checking: a Tool to Check the Semantic Consistency of a Segmentation

This paper describes an automatic process to check the semantic consistency of a segmentation. This process is made possible through the formalism of graphs. In this article we propose to apply this process to the checking of the relevancy of merging criteria used in an adaptive pyramid by matching the obtained segmentation with a conceptual graph describing the objects under consideration. This matching is performed by using a discrete relaxation method. It checks the arc-consistency with bilevel constraints of the chosen semantic graph. The efficiency of this approach is illustrated on synthetic and real images.

[1]  A. Damasio.  The feeling of what happens , 2001 .

[2]  Richard Lepage,et al.  Knowledge-Based Image Understanding Systems: A Survey , 1997, Comput. Vis. Image Underst..

[3]  Horst Bunke,et al.  Recent Advances in Graph Matching , 1997, Int. J. Pattern Recognit. Artif. Intell..

[4]  Jean-Michel Jolion,et al.  Building of Symbolic Hierarchical Graphs for Feature Extraction , 2003, GbRPR.

[5]  Christian Bessiere,et al.  Arc-Consistency and Arc-Consistency Again , 1993, Artif. Intell..

[6]  Yll Haxhimusa,et al.  Hierarchy of Partitions with Dual Graph Contraction , 2003, DAGM-Symposium.

[7]  Walter G. Kropatsch,et al.  A Minimal Line Property Preserving Representation of Line Images , 1999, Computing.

[8]  Horst Bunke,et al.  A graph distance metric based on the maximal common subgraph , 1998, Pattern Recognit. Lett..

[9]  Aline Deruyver,et al.  Arc-Consistency Checking with Bilevel Constraints: An Optimization , 2009, GbRPR.

[10]  Pascal Bertolino,et al.  Multiresolution segmentation using the irregular pyramid , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[11]  Atilla Baskurt,et al.  Image understanding and scene models: a generic framework integrating domain knowledge and Gestalt theory , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[12]  Aline Deruyver,et al.  A segmentation technique for cerebral NMR images , 1994, Proceedings of 1st International Conference on Image Processing.

[13]  Isabelle Bloch,et al.  Structure segmentation and recognition in images guided by structural constraint propagation , 2008, ECAI.

[14]  Christian Bauckhage,et al.  From Image Features To Symbols And Vice Versa - Using Graphs To Loop Data- And Model-Driven Processing In Visual Assembly Recognition , 2004, Int. J. Pattern Recognit. Artif. Intell..

[15]  Pierre-Antoine Champin,et al.  Measuring the Similarity of Labeled Graphs , 2003, ICCBR.

[16]  Pierre Vandergheynst,et al.  Multiresolution segmentation of natural images: from linear to nonlinear scale-space representations , 2004, IEEE Transactions on Image Processing.

[17]  Edwin R. Hancock,et al.  Structural Matching by Discrete Relaxation , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Pascal Van Hentenryck,et al.  A Generic Arc-Consistency Algorithm and its Specializations , 1992, Artif. Intell..

[19]  S. Sutherland.  Pictures in mind , 1984, Nature.

[20]  Alan C. Shaw,et al.  Parsing of Graph-Representable Pictures , 1970, JACM.

[21]  Peter Meer,et al.  Stochastic image pyramids , 1989, Comput. Vis. Graph. Image Process..

[22]  Jean-Michel Jolion,et al.  The adaptive pyramid: A framework for 2D image analysis , 1991, CVGIP Image Underst..

[23]  James V. Mahoney,et al.  Interpreting Sloppy Stick Figures by Graph Rectification and Constraint-Based Matching , 2001, GREC.

[24]  Aline Deruyver,et al.  Qualitative spatial relationships for image interpretation by using a conceptual graph , 2009, Image Vis. Comput..

[25]  Aline Deruyver,et al.  Constraint Satisfaction Problem with Bilevel Constraint: Application to Interpretation of Over-Segmented Images , 1997, Artif. Intell..

[26]  Malgorzata Sowinska,et al.  Watershed and adaptive pyramid for determining the apple's maturity state , 2002, Proceedings. International Conference on Image Processing.

[27]  Horst Bunke,et al.  Syntactic and Structural Pattern Recognition , 1988, NATO ASI Series.

[28]  Aline Deruyver,et al.  Image interpretation with a semantic graph: labeling over-segmented images and detection of unexpected objects , 1999, Defense, Security, and Sensing.

[29]  Keinosuke Fukunaga,et al.  Bayes Error Estimation Using Parzen and k-NN Procedures , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Josep Lladós Canet.  Combining graph matching and hough transform for hand drawn graphical document analysis. Application to architectural drawings , 1998 .

[31]  Abderrahim Elmoataz,et al.  Multi-scale image segmentation in a hierarchy of partitions , 2006, 2006 14th European Signal Processing Conference.

[32]  Hervé Le Men,et al.  The hierarchy of the cocoons of a graph and its application to image segmentation , 2003, Pattern Recognit. Lett..

[33]  Jean-Michel Jolion.  Stochastic pyramid revisited , 2003, Pattern Recognit. Lett..

[34]  J. Verne,et al.  A test to control a region growing process within a hierarchical graph , 2003 .

[35]  Refractor.  Vision , 2000, The Lancet.

[36]  Sven J. Dickinson,et al.  Generic model abstraction from examples , 2000, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Jr. Horacio Fabrega.  The Feeling of What Happens: Body and Emotion in the Making of Consciousness , 2000 .

[38]  Hichem Sahli,et al.  Multiscale gradient watersheds of color images , 2003, IEEE Trans. Image Process..

[39]  Horst Bunke,et al.  Syntactic and structural pattern recognition : theory and applications , 1990 .

[40]  Walter G. Kropatsch,et al.  Matching Segmentation Hierarchies , 2004, Int. J. Pattern Recognit. Artif. Intell..

[41]  Roberto Marcondes Cesar Junior,et al.  Inexact Graph Matching for Facial Feature Segmentation and Recognition in Video Sequences: Results on Face Tracking , 2003, CIARP.

[42]  Mario Vento,et al.  Thirty Years Of Graph Matching In Pattern Recognition , 2004, Int. J. Pattern Recognit. Artif. Intell..

[43]  Horst Bunke,et al.  On a relation between graph edit distance and maximum common subgraph , 1997, Pattern Recognit. Lett..

[44]  Marek R. Ogiela,et al.  Medical Image Understanding Technology - Artificial Intelligence and Soft-Computing for Image Understanding , 2004, Studies in Fuzziness and Soft Computing.

[45]  R S LEDLEY,et al.  HIGH-SPEED AUTOMATIC ANALYSIS OF BIOMEDICAL PICTURES. , 1964, Science.

[46]  Thomas C. Henderson,et al.  Arc and Path Consistency Revisited , 1986, Artif. Intell..

[47]  Luc Brun,et al.  Image interpretation with a conceptual graph: Labeling over-segmented images and detection of unexpected objects , 2009, Artif. Intell..