Three-dimensional point cloud recognition via distributions of geometric distances

A geometric framework for the recognition of three-dimensional objects represented by point clouds is introduced in this paper. The proposed approach is based on comparing distributions of intrinsic measurements on the point cloud. In particular, intrinsic distances are exploited as signatures for representing the point clouds. The first signature we introduce is the histogram of pairwise diffusion distances between all points on the shape surface. These distances represent the probability of traveling from one point to another in a fixed number of random steps, the average intrinsic distances of all possible paths of a given number of steps between the two points. This signature is augmented by the histogram of the actual pairwise geodesic distances, as well as the distribution of the ratio between these two distances. These signatures are not only geometric but also invariant to bends. We further augment these signatures by the distribution of a curvature function and the distribution of a curvature weighted distance. These histograms are compared using the chi2 or other common distance metrics for distributions. The presentation of the framework is accompanied by theoretical justification and state-of-the-art experimental results with the standard Princeton 3D shape benchmark and ISDB datasets, as well as a detailed analysis of the particular relevance of each one of the different histogram-based signatures. Finally, we briefly discuss a more local approach where the histograms are computed for a number of overlapping patches from the object rather than the whole shape, thereby opening the door to partial shape comparisons.

[1]  Taku Komura,et al.  Topology matching for fully automatic similarity estimation of 3D shapes , 2001, SIGGRAPH.

[2]  Stéphane Lafon,et al.  Diffusion maps , 2006 .

[3]  Guillermo Sapiro,et al.  Three-dimensional point cloud recognition via distributions of geometric distances , 2009, Graph. Model..

[4]  Bernard Chazelle,et al.  Shape distributions , 2002, TOGS.

[5]  Markus H. Gross,et al.  Spectral processing of point-sampled geometry , 2001, SIGGRAPH.

[6]  Sebastian Thrun,et al.  SCAPE: shape completion and animation of people , 2005, SIGGRAPH 2005.

[7]  Vassilios Morellas,et al.  A Graph-Based Foreground Representation and its Application in Example Based People Matching in Video , 2007, 2007 IEEE International Conference on Image Processing.

[8]  Facundo Mémoli,et al.  Topological Methods for the Analysis of High Dimensional Data Sets and 3D Object Recognition , 2007, PBG@Eurographics.

[9]  Leonidas J. Guibas,et al.  Estimating surface normals in noisy point cloud data , 2004, Int. J. Comput. Geom. Appl..

[10]  B. Nadler,et al.  Diffusion maps, spectral clustering and reaction coordinates of dynamical systems , 2005, math/0503445.

[11]  Andrew Zisserman,et al.  Video Google: Efficient Visual Search of Videos , 2006, Toward Category-Level Object Recognition.

[12]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  David P. Dobkin,et al.  A search engine for 3D models , 2003, TOGS.

[14]  Leonidas J. Guibas,et al.  Probabilistic fingerprints for shapes , 2006, SGP '06.

[15]  Thomas A. Funkhouser,et al.  The Princeton Shape Benchmark , 2004, Proceedings Shape Modeling Applications, 2004..

[16]  Ron Kimmel,et al.  Bending invariant representations for surfaces , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[17]  Thomas A. Funkhouser,et al.  Partial matching of 3D shapes with priority-driven search , 2006, SGP '06.

[18]  Ariel Shamir,et al.  Pose-Oblivious Shape Signature , 2007, IEEE Transactions on Visualization and Computer Graphics.

[19]  Alexander M. Bronstein,et al.  Efficient Computation of Isometry-Invariant Distances Between Surfaces , 2006, SIAM J. Sci. Comput..

[20]  Marc Alexa,et al.  Point-based computer graphics , 2004, SIGGRAPH '04.

[21]  Alexander J. Smola,et al.  Learning with kernels , 1998 .

[22]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[23]  Gunnar E. Carlsson,et al.  Topological estimation using witness complexes , 2004, PBG.

[24]  N. Dyn,et al.  Adaptive thinning for bivariate scattered data , 2002 .

[25]  Mireille Boutin,et al.  On reconstructing n-point configurations from the distribution of distances or areas , 2003, Adv. Appl. Math..

[26]  Marc Levoy,et al.  QSplat: a multiresolution point rendering system for large meshes , 2000, SIGGRAPH.

[27]  Guillermo Sapiro,et al.  A Theoretical and Computational Framework for Isometry Invariant Recognition of Point Cloud Data , 2005, Found. Comput. Math..

[28]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[29]  Steven W. Zucker,et al.  Diffusion Maps and Geometric Harmonics for Automatic Target Recognition (ATR). Volume 2. Appendices , 2007 .

[30]  Hartmut Prautzsch,et al.  Local Versus Global Triangulations , 2001, Eurographics.

[31]  Martin Rumpf,et al.  Feature sensitive multiscale editing on surfaces , 2004, The Visual Computer.

[32]  A. Ben Hamza,et al.  Probabilistic shape descriptor for triangulated surfaces , 2005, IEEE International Conference on Image Processing 2005.

[33]  Flemming Topsøe,et al.  Jensen-Shannon divergence and Hilbert space embedding , 2004, International Symposium onInformation Theory, 2004. ISIT 2004. Proceedings..

[34]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[35]  Alexander M. Bronstein,et al.  Robust Expression-Invariant Face Recognition from Partially Missing Data , 2006, ECCV.

[36]  Bernhard Schölkopf,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2005, IEEE Transactions on Neural Networks.

[37]  Markus H. Gross,et al.  Efficient simplification of point-sampled surfaces , 2002, IEEE Visualization, 2002. VIS 2002..

[38]  Guillermo Sapiro,et al.  Distance Functions and Geodesics on Submanifolds of Rd and Point Clouds , 2005, SIAM J. Appl. Math..