A Study of Shape Similarity for Temporal Surface Sequences of People

The problem of 3D shape matching is typically restricted to static objects to classify similarity for shape retrieval. In this paper we consider 3D shape matching in temporal sequences where the goal is instead to find similar shapes for a single time-varying object, here the human body. Local- feature distribution descriptors are adopted to provide a rich object description that is invariant to changes in surface topology. Two contributions are made, (i) a comparison of descriptors for shape similarity in temporal sequences of a dynamic free-form object and (ii) a quantitative evaluation based on the Receiver-Operator Characteristic (ROC) curve for the descriptors using a ground-truth data set for synthetic motion sequences. Shape Distribution [25], Spin Image [15], Shape Histogram [1] and Spherical Harmonic [17] descriptors are compared. The highest performance is obtained by volume-sampling shape-histogram descriptors. The descriptors also demonstrate relative in- sensitivity to parameter setting. The application is demonstrated in captured sequences of 3D human surface motion.

[1]  Sven J. Dickinson,et al.  Skeleton based shape matching and retrieval , 2003, 2003 Shape Modeling International..

[2]  Daniel A. Keim,et al.  Verfahren zur Ähnlichkeitssuche auf 3D-Objekten , 2001, Datenbank-Spektrum.

[3]  Thomas A. Funkhouser,et al.  Shape-based retrieval and analysis of 3d models , 2005, CACM.

[4]  Szymon Rusinkiewicz,et al.  Rotation Invariant Spherical Harmonic Representation of 3D Shape Descriptors , 2003, Symposium on Geometry Processing.

[5]  BENJAMIN BUSTOS,et al.  Feature-based similarity search in 3D object databases , 2005, CSUR.

[6]  Kiyoharu Aizawa,et al.  Motion Editing in 3D Video Database , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[7]  Touradj Ebrahimi,et al.  MESH: measuring errors between surfaces using the Hausdorff distance , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[8]  Chin Seng Chua,et al.  Point Signatures: A New Representation for 3D Object Recognition , 1997, International Journal of Computer Vision.

[9]  Hans-Peter Kriegel,et al.  3D Shape Histograms for Similarity Search and Classification in Spatial Databases , 1999, SSD.

[10]  Andrew E. Johnson,et al.  Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  R. Allen Miller,et al.  A database system of mechanical components based on geometric and topological similarity. Part I: representation , 2003, Comput. Aided Des..

[12]  Bernard Chazelle,et al.  Shape distributions , 2002, TOGS.

[13]  Bernard Chazelle,et al.  A Reflective Symmetry Descriptor , 2002, ECCV.

[14]  Ryutarou Ohbuchi,et al.  Shape-similarity search of 3D models by using enhanced shape functions , 2003, Proceedings of Theory and Practice of Computer Graphics, 2003..

[15]  Marcin Novotni,et al.  3D zernike descriptors for content based shape retrieval , 2003, SM '03.

[16]  Marc Rioux,et al.  Description of shape information for 2-D and 3-D objects , 2000, Signal Process. Image Commun..

[17]  Remco C. Veltkamp,et al.  A Survey of Content Based 3D Shape Retrieval Methods , 2004, SMI.

[18]  Jitendra Malik,et al.  Shape Context: A New Descriptor for Shape Matching and Object Recognition , 2000, NIPS.

[19]  R. Allen Miller,et al.  A database system of mechanical components based on geometric and topological similarity. Part II: indexing, retrieval, matching, and similarity assessment , 2003, Comput. Aided Des..

[20]  Adrian Hilton,et al.  Surface Capture for Performance-Based Animation , 2007, IEEE Computer Graphics and Applications.

[21]  K. Ramani,et al.  Three-dimensional shape searching : state-ofthe-art review and future trends , 2005 .

[22]  Marcel Körtgen,et al.  3D Shape Matching with 3D Shape Contexts , 2003 .

[23]  El-MehalawiMohamed,et al.  A database system of mechanical components based on geometric and topological similarity. Part II , 2003 .

[24]  Hao Zhang,et al.  A spectral approach to shape-based retrieval of articulated 3D models , 2007, Comput. Aided Des..

[25]  HebertMartial,et al.  Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes , 1999 .

[26]  W TangelderJohan,et al.  A survey of content based 3D shape retrieval methods , 2008 .

[27]  Martial Hebert,et al.  On 3D shape similarity , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[28]  Ming Ouhyoung,et al.  On Visual Similarity Based 3D Model Retrieval , 2003, Comput. Graph. Forum.

[29]  Lucas Kovar,et al.  Motion graphs , 2002, SIGGRAPH Classes.

[30]  Raphaëlle Chaine,et al.  Direct Spherical Harmonic Transform of a Triangulated Mesh , 2006, J. Graph. Tools.

[31]  Bruno Raffin,et al.  3D Skeleton-Based Body Pose Recovery , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[32]  Francoise J. Preteux,et al.  3D-shape-based retrieval within the MPEG-7 framework , 2001, IS&T/SPIE Electronic Imaging.

[33]  Karthik Ramani,et al.  Three-dimensional shape searching: state-of-the-art review and future trends , 2005, Comput. Aided Des..

[34]  Adrian Hilton,et al.  Video-based character animation , 2005, SCA '05.

[35]  Ron Kimmel,et al.  On Bending Invariant Signatures for Surfaces , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  Taku Komura,et al.  Topology matching for fully automatic similarity estimation of 3D shapes , 2001, SIGGRAPH.

[37]  Roddy MacLeod,et al.  Coarse Filters for Shape Matching , 2002, IEEE Computer Graphics and Applications.

[38]  Ali Shokoufandeh,et al.  Solid Model Databases: Techniques and Empirical Results , 2001, J. Comput. Inf. Sci. Eng..

[39]  Tsuhan Chen,et al.  Efficient feature extraction for 2D/3D objects in mesh representation , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).