An MRF and Gaussian Curvature Based Shape Representation for Shape Matching

Matching and registration of shapes is a key issue in Computer Vision, Pattern Recognition, and Medical Image Analysis. This paper presents a shape representation framework based on Gaussian curvature and Markov random fields (MRFs) for the purpose of shape matching. The method is based on a surface mesh model in R3, which is projected into a two-dimensional space and there modeled as an extended boundary closed Markov random field. The surface is homeomorphic to S2. The MRF encodes in the nodes entropy features of the corresponding similarities based on Gaussian curvature, and in the edges the spatial consistency of the meshes. Correspondence between two surface meshes is then established by performing probabilistic inference on the MRF via Gibbs sampling. The technique combines both geometric, topological, and probabilistic information, which can be used to represent shapes in three dimensional space, and can be generalized to higher dimensional spaces. As a result, the representation can be used for shape matching, registration, and statistical shape analysis.

[1]  Steven Gold,et al.  A Graduated Assignment Algorithm for Graph Matching , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Ping Liang,et al.  Representation and recognition of surface shapes in range images: A differential geometry approach , 1990, Comput. Vis. Graph. Image Process..

[3]  Josef Kittler,et al.  Indexing an image database by shape content using curvature scale space , 1996 .

[4]  Anand Rangarajan,et al.  Shape analysis using the Fisher-Rao Riemannian metric: unifying shape representation and deformation , 2006, 3rd IEEE International Symposium on Biomedical Imaging: Nano to Macro, 2006..

[5]  Farzin Mokhtarian,et al.  An Efficient Active Contour Model Through Curvature Scale Space Filtering , 2004, Multimedia Tools and Applications.

[6]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  C. Grimm,et al.  WUCSE-2004-9 : Improved Curvature Estimation on Triangular Meshes , 2003 .

[8]  Dongmei Zhang,et al.  Harmonic Shape Images: A 3D Free-form Surface Representation and Its Applications in Surface Matching , 1999 .

[9]  Gérard G. Medioni,et al.  Object modeling by registration of multiple range images , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[10]  Sen Wang,et al.  3D Surface Matching and Recognition Using Conformal Geometry , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[11]  J. Koenderink.  The structure of images , 2004, Biological Cybernetics.

[12]  Szymon Rusinkiewicz,et al.  Rotation Invariant Spherical Harmonic Representation of 3D Shape Descriptors , 2003, Symposium on Geometry Processing.

[13]  Stephen J. Maybank,et al.  Detection of image structures using the Fisher information and the Rao metric , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  John F. Hughes,et al.  Modeling surfaces of arbitrary topology using manifolds , 1995, SIGGRAPH.

[16]  Guido Gerig,et al.  Scale-Space on Image Profiles about an Object Boundary , 2003, Scale-Space.

[17]  Edwin R. Hancock,et al.  Structural Graph Matching Using the EM Algorithm and Singular Value Decomposition , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Songde Ma,et al.  Matching using Schwarz integrals , 1999, Pattern Recognit..

[19]  John K. Tsotsos,et al.  Shape Representation and Recognition from Multiscale Curvature , 1997, Comput. Vis. Image Underst..

[20]  Alexander M. Bronstein,et al.  Face Recognition from Facial Surface Metric , 2004, ECCV.

[21]  Donald D. Hoffman,et al.  Parts of recognition , 1984, Cognition.

[22]  Xiuwen Liu,et al.  A Computational Approach to Fisher Information Geometry with Applications to Image Analysis , 2005, EMMCVPR.

[23]  M. Spivak.  A comprehensive introduction to differential geometry , 1979 .

[24]  Guojun Lu,et al.  Content-based shape retrieval using different shape descriptors: a comparative study , 2001, IEEE International Conference on Multimedia and Expo, 2001. ICME 2001..

[25]  Stephen J. Maybank,et al.  The Fisher-Rao Metric for Projective Transformations of the Line , 2005, International Journal of Computer Vision.

[26]  Ronen Basri,et al.  Shape representation and classification using the Poisson equation , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[27]  Andrew E. Johnson,et al.  Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Josef Kittler,et al.  Robust and Efficient Shape Indexing through Curvature Scale Space , 1996, BMVC.

[29]  Dietmar Saupe,et al.  3D Model Retrieval with Spherical Harmonics and Moments , 2001, DAGM-Symposium.

[30]  Leonardo Vidal Batista,et al.  A new multiscale, curvature-based shape representation technique for image retrieval based on DSP techniques , 2005, Fifth International Conference on Hybrid Intelligent Systems (HIS'05).

[31]  Lewis D. Griffin,et al.  Scale Space Methods in Computer Vision , 2003, Lecture Notes in Computer Science.

[32]  Marc Pouget,et al.  Estimating differential quantities using polynomial fitting of osculating jets , 2003, Comput. Aided Geom. Des..

[33]  John M. Lee.  Introduction to Smooth Manifolds , 2002 .

[34]  Martial Hebert,et al.  A new approach to 3-D terrain mapping , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).

[35]  Conglin Lu,et al.  A Markov Random Field Approach to Multi-scale Shape Analysis , 2003, Scale-Space.

[36]  Michael Garland,et al.  Curvature maps for local shape comparison , 2005, International Conference on Shape Modeling and Applications 2005 (SMI' 05).

[37]  Reinhard Klette,et al.  A Comparative Study on 2D Curvature Estimators , 2007, 2007 International Conference on Computing: Theory and Applications (ICCTA'07).

[38]  Wageeh Boles,et al.  Recognition of 2D object contours using the wavelet transform zero-crossing representation , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  Gérard G. Medioni,et al.  Corner detection and curve representation using cubic B-splines , 1986, Proceedings. 1986 IEEE International Conference on Robotics and Automation.

[40]  Ralph Roskies,et al.  Fourier Descriptors for Plane Closed Curves , 1972, IEEE Transactions on Computers.

[41]  A. Lynn Abbott,et al.  A Shape Representation for Planar Curves by Shape Signature Harmonic Embedding , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[42]  Mohamed S. Kamel,et al.  Wavelet approximation-based affine invariant shape representation functions , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  Gerhard Winkler,et al.  Image Analysis, Random Fields and Markov Chain Monte Carlo Methods: A Mathematical Introduction , 2002 .

[44]  Tony Lindeberg,et al.  Scale-Space Theory in Computer Vision , 1993, Lecture Notes in Computer Science.

[45]  John Odentrantz,et al.  Markov Chains: Gibbs Fields, Monte Carlo Simulation, and Queues , 2000, Technometrics.

[46]  Miroslaw Bober,et al.  Curvature Scale Space Representation: Theory, Applications, and MPEG-7 Standardization , 2011, Computational Imaging and Vision.