Compact covariance descriptors in 3D point clouds for object recognition

One of the most important tasks for mobile robots is to sense their environment. Further tasks might include the recognition of objects in the surrounding environment. Three dimensional range finders have become the sensors of choice for mapping the environment of a robot. Recognizing objects in point clouds provided by such sensors is a difficult task. The main contribution of this paper is the introduction of a new covariance based point cloud descriptor for such object recognition. Covariance based descriptors have been very successful in image processing. One of the main advantages of these descriptors is their relatively small size. The comparisons between different covariance matrices can also be made very efficient. Experiments with real world and synthetic data will show the superior performance of the covariance descriptors on point clouds compared to state-of-the-art methods.

[1]  Ioannis Stamos,et al.  3D modeling of historic sites using range and image data , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[2]  H. Quynh Dinh,et al.  Multi-Resolution Spin-Images , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[3]  Alberto Del Bimbo,et al.  Content-Based Retrieval of 3-D Objects Using Spin Image Signatures , 2007, IEEE Transactions on Multimedia.

[4]  Andrew E. Johnson,et al.  Spin-Images: A Representation for 3-D Surface Matching , 1997 .

[5]  Stephen J. Maybank,et al.  Human Action Recognition under Log-Euclidean Riemannian Metric , 2009, ACCV.

[6]  Vassilios Morellas,et al.  Tensor Sparse Coding for Region Covariances , 2010, ECCV.

[7]  Andrew E. Johnson,et al.  Surface matching for object recognition in complex three-dimensional scenes , 1998, Image Vis. Comput..

[8]  Vassilios Morellas,et al.  Metric learning for semi-supervised clustering of Region Covariance Descriptors , 2009, 2009 Third ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC).

[9]  Fulvio Corno,et al.  DogOnt - Ontology Modeling for Intelligent Domotic Environments , 2008, SEMWEB.

[10]  W. Förstner,et al.  A Metric for Covariance Matrices , 2003 .

[11]  Jitendra Malik,et al.  Recognizing Objects in Range Data Using Regional Point Descriptors , 2004, ECCV.

[12]  Thomas S. Huang,et al.  Emotion Recognition from Arbitrary View Facial Images , 2010, ECCV.

[13]  Martial Hebert,et al.  Large data sets and confusing scenes in 3-D surface matching and recognition , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[14]  Afzal Godil,et al.  3D Part identification based on local shape descriptors , 2008, PerMIS.

[15]  Fatih Murat Porikli,et al.  Covariance Tracking using Model Update Based on Lie Algebra , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[16]  Fatih Murat Porikli,et al.  Region Covariance: A Fast Descriptor for Detection and Classification , 2006, ECCV.

[17]  N. Ayache,et al.  Log‐Euclidean metrics for fast and simple calculus on diffusion tensors , 2006, Magnetic resonance in medicine.

[18]  Andrew E. Johnson,et al.  Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  John K. Tsotsos,et al.  Shape Representation and Recognition from Multiscale Curvature , 1997, Comput. Vis. Image Underst..

[20]  Edwin R. Hancock,et al.  Refining Surface Curvature with Relaxation Labeling , 1997, ICIAP.

[21]  Satyandra K. Gupta,et al.  Retrieving Matching CAD Models by Using Partial 3D Point Clouds , 2007 .

[22]  Federico Tombari,et al.  Unique Signatures of Histograms for Local Surface Description , 2010, ECCV.

[23]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[24]  P. Forrester.  Eigenvalue distributions for some correlated complex sample covariance matrices , 2006, math-ph/0602001.

[25]  Remco C. Veltkamp,et al.  A survey of content based 3D shape retrieval methods , 2004, Proceedings Shape Modeling Applications, 2004..

[26]  Hans-Gerd Maas,et al.  3D BUILDING MODEL GENERATION FROM AIRBORNE LASER SCANNER DATA USING 2D GIS DATA AND ORTHOGONAL POINT CLOUD PROJECTIONS , 2005 .

[27]  Nico Blodow,et al.  Fast Point Feature Histograms (FPFH) for 3D registration , 2009, 2009 IEEE International Conference on Robotics and Automation.