3D face matching and registration based on hyperbolic Ricci flow

3D surface matching is fundamental for shape analysis. As a powerful method in geometric analysis, Ricci flow can flexibly design metrics by prescribed target curvature. In this paper we describe a novel approach for matching surfaces with complicated topologies based on hyperbolic Ricci flow. For surfaces with negative Euler characteristics, such as a human face with holes (eye contours), the canonical hyperbolic metric is conformal to the original and can be efficiently computed. Then the surface can be canonically decomposed to hyperbolic hexagons. By matching the corresponding hyperbolic hexagons, the matching between surfaces can be easily established. Compared to existing methods, hyperbolic Ricci flow induces diffeomorphisms between surfaces with complicated topologies with negative Euler characteristics, while avoiding singularities. Furthermore, all the boundaries are intrinsically mapped to hyperbolic lines as alignment constraints. Finally, we demonstrate the applicability of this intrinsic shape representation for 3D face matching and registration.

[1]  David Mumford,et al.  2D-Shape Analysis Using Conformal Mapping , 2004, CVPR.

[2]  Xianfeng Gu,et al.  Discrete Surface Ricci Flow: Theory and Applications , 2007, IMA Conference on the Mathematics of Surfaces.

[3]  Peter Schröder,et al.  Discrete conformal mappings via circle patterns , 2005, TOGS.

[4]  Alexander M. Bronstein,et al.  Rock, Paper, and Scissors: extrinsic vs. intrinsic similarity of non-rigid shapes , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[5]  Martial Hebert,et al.  Parts-based 3D object classification , 2004, CVPR 2004.

[6]  Nikos Paragios,et al.  Establishing Local Correspondences towards Compact Representations of Anatomical Structures , 2003, MICCAI.

[7]  Mongi A. Abidi,et al.  Surface matching by 3D point's fingerprint , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[8]  Bruno Lévy,et al.  Least squares conformal maps for automatic texture atlas generation , 2002, ACM Trans. Graph..

[9]  Yang Wang,et al.  Ricci Flow for 3D Shape Analysis , 2007, ICCV.

[10]  Xiangrong Zhou,et al.  A Fast 3D Correspondence Method for Statistical Shape Modeling , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Baba C. Vemuri,et al.  A fast level set based algorithm for topology-independent shape modeling , 1996, Journal of Mathematical Imaging and Vision.

[12]  Patrick J. Flynn,et al.  A Survey Of Free-Form Object Representation and Recognition Techniques , 2001, Comput. Vis. Image Underst..

[13]  Shing-Tung Yau,et al.  Global Conformal Parameterization , 2003, Symposium on Geometry Processing.

[14]  Alexander M. Bronstein,et al.  Expression-Invariant Representations of Faces , 2007, IEEE Transactions on Image Processing.

[15]  Jitendra Malik,et al.  Recognizing Objects in Range Data Using Regional Point Descriptors , 2004, ECCV.

[16]  B. Chow,et al.  The Ricci flow on surfaces , 2004 .

[17]  Dongmei Zhang,et al.  Harmonic maps and their applications in surface matching , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[18]  Demetri Terzopoulos,et al.  Constraints on Deformable Models: Recovering 3D Shape and Nonrigid Motion , 1988, Artif. Intell..

[19]  Xianfeng Gu,et al.  Computing surface hyperbolic structure and real projective structure , 2006, SPM '06.

[20]  B. Chow,et al.  COMBINATORIAL RICCI FLOWS ON SURFACES , 2002, math/0211256.

[21]  Seungyong Lee,et al.  Conformal Surface Parameterization Using Euclidean Ricci Flow , 2006 .

[22]  Sen Wang,et al.  High resolution tracking of non-rigid 3D motion of densely sampled data using harmonic maps , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[23]  Sen Wang,et al.  High Resolution Tracking of Non-Rigid Motion of Densely Sampled 3D Data Using Harmonic Maps , 2008, International Journal of Computer Vision.

[24]  T. Chan,et al.  Genus zero surface conformal mapping and its application to brain surface mapping. , 2004, IEEE transactions on medical imaging.

[25]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[26]  Bernard Chazelle,et al.  Shape distributions , 2002, TOGS.

[27]  JinMiao,et al.  Conformal Geometry and Its Applications on 3D Shape Matching, Recognition, and Stitching , 2007 .

[28]  Nick Barnes,et al.  An MRF and Gaussian Curvature Based Shape Representation for Shape Matching , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Linda G. Shapiro,et al.  A new paradigm for recognizing 3-D objects from range data , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[30]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Wei-Yang Lin,et al.  Fusion of Summation Invariants in 3D Human Face Recognition , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[32]  Jake K. Aggarwal,et al.  Curvature-based representation of objects from range data , 1986, Image Vis. Comput..

[33]  Paul M. Thompson,et al.  Mutual information-based 3D surface matching with applications to face recognition and brain mapping , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[34]  Richard S. Hamilton,et al.  The Ricci flow on surfaces , 1986 .

[35]  Reinhard Koch,et al.  Invariant-based registration of surface patches , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[36]  David P. Dobkin,et al.  A search engine for 3D models , 2003, TOGS.

[37]  Adrian Hilton,et al.  Correspondence labelling for wide-timeframe free-form surface matching , 2007, 2007 IEEE 11th International Conference on Computer Vision.