Automatic Contextual Pattern Modeling

An object/scene usually consists of several primitives among which various contextual relations are defined. In this work, an object/scene is defined as a contextual pattern and is represented by an attributed relational graph (ARG). We develop the methodology and theory for automatic contextual pattern modeling to automatically learn a probabilistic pattern ARG model from multiple sample ARGs. The maximum-likelihood parameters of the pattern ARG model are estimated via the Expectation-Maximization algorithm. Particularly, for Gaussian attributed distributions and Gaussian relational distributions, analytical expressions are derived to estimate the parameters of the distribution functions. The learned pattern ARG model characterizes both the appearance and the structure of the pattern, which is observed under various conditions. It can be used for information summarization and retrieval, improving graph matching, and pattern detection/recognition. We demonstrate the theory by applying it to the problem of unsupervised spatial pattern extraction from multiple images.

[1]  W. W. Bledsoe,et al.  Pattern recognition and reading by machine , 1959, IRE-AIEE-ACM '59 (Eastern).

[2]  Azriel Rosenfeld,et al.  Scene Labeling by Relaxation Operations , 1976, IEEE Transactions on Systems, Man, and Cybernetics.

[3]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[4]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[5]  King-Sun Fu,et al.  Error-Correcting Isomorphisms of Attributed Relational Graphs for Pattern Analysis , 1979, IEEE Transactions on Systems, Man, and Cybernetics.

[6]  Robert M. Haralick,et al.  Structural Descriptions and Inexact Matching , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Josef Kittler,et al.  Contextual classification of multispectral pixel data , 1984, Image Vis. Comput..

[8]  Thomas S. Huang,et al.  Image registration by matching relational structures , 1982, Pattern Recognit..

[9]  Olivier D. Faugeras,et al.  Shape Matching of Two-Dimensional Objects , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Shinji Umeyama,et al.  An Eigendecomposition Approach to Weighted Graph Matching Problems , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[12]  Stan Z. Li,et al.  Matching: Invariant to translations, rotations and scale changes , 1992, Pattern Recognit..

[13]  Salih O. Duffuaa,et al.  A Linear Programming Approach for the Weighted Graph Matching Problem , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  William J. Christmas,et al.  Structural Matching in Computer Vision Using Probabilistic Relaxation , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Tomás Lozano-Pérez,et al.  A Framework for Multiple-Instance Learning , 1997, NIPS.

[16]  Edwin R. Hancock,et al.  Structural Matching by Discrete Relaxation , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Daniel P. Huttenlocher,et al.  Image segmentation using local variation , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[18]  W. Eric L. Grimson,et al.  A framework for learning query concepts in image classification , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[19]  B. Huet,et al.  Inexact graph retrieval , 1999, Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries (CBAIVL'99).

[20]  Brendan J. Frey,et al.  Transformed component analysis: joint estimation of spatial transformations and image components , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[21]  Yang Li,et al.  Word concept model: a knowledge representation for dialogue agents , 2000, INTERSPEECH.

[22]  Thomas S. Huang,et al.  Learning patterns from images by combining soft decisions and hard decisions , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[23]  P. Hong,et al.  HIDE: Hybrid Intelligence-based Distance Education , 2001 .

[24]  Thomas S. Huang,et al.  Spatial pattern discovering by learning the isomorphic subgraph from multiple attributed relation graphs , 2001, Electron. Notes Theor. Comput. Sci..

[25]  Thomas S. Huang,et al.  Extracting the Recurring Patterns from Image , 2001 .

[26]  Ali N. Akansu,et al.  A Graph-Based Object Description for Information Retrieval in Digital Image and Video Libraries , 2002, J. Vis. Commun. Image Represent..