Supervoxel-based saliency detection for large-scale colored 3D point clouds

Large-scale 3D point clouds have been actively used in many applications with the advent of capturing devices. In this paper, we propose a novel saliency detection algorithm for large-scale colored 3D point clouds which capture real-world scenes. We first voxelize an input point cloud, and then partition voxels into a supervoxel which corresponds to a clusters at the lowest level. We construct the supervoxel cluster hierarchy iteratively, where a high level cluster includes low level clusters which exhibit similar features to each other. We also estimate the saliency at each cluster by computing the distinctness of geometric and color features based on center-surround contrast. By averaging the multiscale saliency maps obtained at different levels of clusters, we obtain final saliency distribution. Experimental results demonstrate that the proposed algorithm extracts globally and locally salient regions from large-scale colored 3D point clouds faithfully by employing the geometric and photometric features together.

[1]  Sabine Süsstrunk,et al.  Saliency detection for content-aware image resizing , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[2]  Laurent Itti,et al.  Automatic foveation for video compression using a neurobiological model of visual attention , 2004, IEEE Transactions on Image Processing.

[3]  Ayellet Tal,et al.  Saliency Detection in Large Point Sets , 2013, 2013 IEEE International Conference on Computer Vision.

[4]  Martial Hebert,et al.  Segmentation of Salient Regions in Outdoor Scenes Using Imagery and 3-D Data , 2008, 2008 IEEE Workshop on Applications of Computer Vision.

[5]  Pieter P. Jonker,et al.  Computing Saliency Map from Spatial Information in Point Cloud Data , 2010, ACIVS.

[6]  Rongrong Ji,et al.  RGBD Salient Object Detection: A Benchmark and Algorithms , 2014, ECCV.

[7]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Nico Blodow,et al.  Fast Point Feature Histograms (FPFH) for 3D registration , 2009, 2009 IEEE International Conference on Robotics and Automation.

[9]  Ralph R. Martin,et al.  Mesh saliency via spectral processing , 2014, ACM Trans. Graph..

[10]  Federico Tombari,et al.  Unique Signatures of Histograms for Local Surface Description , 2010, ECCV.

[11]  Francesca Odone,et al.  Histogram intersection kernel for image classification , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[12]  Shi-Min Hu,et al.  Global contrast based salient region detection , 2011, CVPR 2011.

[13]  David W. Jacobs,et al.  Mesh saliency , 2005, SIGGRAPH 2005.

[14]  Ran Ju,et al.  Depth saliency based on anisotropic center-surround difference , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[15]  Andrew E. Johnson,et al.  Spin-Images: A Representation for 3-D Surface Matching , 1997 .

[16]  Junle Wang,et al.  Computational Model of Stereoscopic 3D Visual Saliency , 2013, IEEE Transactions on Image Processing.

[17]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[18]  Ayellet Tal,et al.  Surface Regions of Interest for Viewpoint Selection , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Chang-Su Kim,et al.  Large-Scale 3D Point Cloud Compression Using Adaptive Radial Distance Prediction in Hybrid Coordinate Domains , 2015, IEEE Journal of Selected Topics in Signal Processing.

[20]  Florentin Wörgötter,et al.  Voxel Cloud Connectivity Segmentation - Supervoxels for Point Clouds , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.