Probabilistic contour extraction using hierarchical shape representation

In this paper, we address the issue of extracting contour of the object with a specific shape. A hierarchical graphical model is proposed to represent shape variations. A complex shape is decomposed into several components which are described as principal component analysis (PCA) based models in various levels. The hierarchical representation allows for chain-like conditional dependency within a single level and bidirectional communication between different levels. Additionally, a sequential Monte-Carlo (SMC) based inference algorithm that can explore the graphical structure is proposed to estimate the contour. The experiments performed on real-world hand and face images show that the proposed method is effective in combating occlusion and cluttered background. Moreover, it is possible to isolate the localization error to an individual component of a shape attributed to the hierarchical representation.

[1]  Patrick Pérez,et al.  JetStream: probabilistic contour extraction with particles , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[2]  William T. Freeman,et al.  Nonparametric belief propagation , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[3]  Michael Werman,et al.  Similarity and Affine Invariant Distances Between 2D Point Sets , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Michael J. Black,et al.  Robust Parameterized Component Analysis , 2002, ECCV.

[5]  Eam Khwang Teoh,et al.  Bayesian shape model for facial feature extraction and recognition , 2003, Pattern Recognit..

[6]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[7]  L YuilleAlan,et al.  Feature extraction from faces using deformable templates , 1992 .

[8]  Michael I. Jordan.  Graphical Models , 2003 .

[9]  Sankar K. Pal,et al.  A review on image segmentation techniques , 1993, Pattern Recognit..

[10]  Alex Pentland,et al.  Probabilistic Visual Learning for Object Representation , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  A. Martínez,et al.  The AR face databasae , 1998 .

[12]  Michael J. Black,et al.  Robust parameterized component analysis: theory and applications to 2D facial appearance models , 2003, Comput. Vis. Image Underst..

[13]  Michael J. Black,et al.  Robust Parameterized Component Analysis Theory and Applications to 2D Facial Modeling , 2002, eccv 2002.

[14]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[15]  Tai Sing Lee,et al.  Hierarchical Bayesian inference in the visual cortex. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[16]  Aleix M. Martinez,et al.  The AR face database , 1998 .

[17]  William T. Freeman,et al.  Understanding belief propagation and its generalizations , 2003 .

[18]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[19]  Daniel Cremers,et al.  Diffusion Snakes: Introducing Statistical Shape Knowledge into the Mumford-Shah Functional , 2002, International Journal of Computer Vision.

[20]  Michael Isard,et al.  PAMPAS: real-valued graphical models for computer vision , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[21]  Pedro F. Felzenszwalb.  Representation and detection of deformable shapes , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[22]  Yanxi Liu,et al.  Representation and matching of articulated shapes , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[23]  Michael Isard,et al.  Contour Tracking by Stochastic Propagation of Conditional Density , 1996, ECCV.