Combining 3D Shape and Color for 3D Object Recognition

We present new results in object recognition based on color and 3D shape obtained from 3D cameras. Namely, we further exploit diffusion processes to represent shape and the use of color/texture as a perturbation to the diffusion process. Diffusion processes are an effective tool to replace shortest path distances in the characterization of 3D shapes. They also provide effective means for the seamlessly representation of color and shape, mainly because they provide information both the color and on their distribution over surfaces. While there have been different approaches for incorporating color information in the diffusion process, this is the first work that explores different parameterizations of color and their impact on recognition tasks. We present results using very challenging datasets, where we propose to recognize different instances of the same object class assuming a very limited a-priori knowledge on each individual object.

[1]  Dieter Fox,et al.  A large-scale hierarchical multi-view RGB-D object dataset , 2011, 2011 IEEE International Conference on Robotics and Automation.

[2]  Manuela M. Veloso,et al.  Multiple Hypothesis for Object Class Disambiguation from Multiple Observations , 2014, 2014 2nd International Conference on 3D Vision.

[3]  Aly A. Farag,et al.  Heat diffusion over weighted manifolds: A new descriptor for textured 3D non-rigid shapes , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Alexander M. Bronstein,et al.  Photometric Heat Kernel Signatures , 2011, SSVM.

[5]  Dieter Fox,et al.  Sparse distance learning for object recognition combining RGB and depth information , 2011, 2011 IEEE International Conference on Robotics and Automation.

[6]  Manuela M. Veloso,et al.  Global localization by soft object recognition from 3D Partial Views , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[7]  Martin A. Riedmiller,et al.  A learned feature descriptor for object recognition in RGB-D data , 2012, 2012 IEEE International Conference on Robotics and Automation.

[8]  Manuela M. Veloso,et al.  The Partial View Heat Kernel descriptor for 3D object representation , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).