Segmentation of Salient Regions in Outdoor Scenes Using Imagery and 3-D Data

This paper describes a segmentation method for extracting salient regions in outdoor scenes using both 3-D laser scans and imagery information. Our approach is a bottom- up attentive process without any high-level priors, models, or learning. As a mid-level vision task, it is not only robust against noise and outliers but it also provides valuable information for other high-level tasks in the form of optimal segments and their ranked saliency. In this paper, we propose a new saliency definition for 3-D point clouds and we incorporate it with saliency features from color information.

[1]  Erich Rome,et al.  Simulating Perceptual Clustering by Gestalt Principles Erich Rome , 2001 .

[2]  Simone Frintrop,et al.  A Bimodal Laser-Based Attention System , 2005, Comput. Vis. Image Underst..

[3]  Michael Brady,et al.  Saliency, Scale and Image Description , 2001, International Journal of Computer Vision.

[4]  Nanning Zheng,et al.  Learning to Detect a Salient Object , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Harry Shum,et al.  Lazy snapping , 2004, ACM Trans. Graph..

[6]  P. Newman,et al.  Using Naturally Salient Regions for SLAM with 3 D Laser Data ∗ , 2005 .

[7]  Marie-Pierre Jolly,et al.  Interactive Graph Cuts for Optimal Boundary and Region Segmentation of Objects in N-D Images , 2001, ICCV.

[8]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[9]  Marie-Pierre Jolly,et al.  Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[10]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[11]  Daniel P. Huttenlocher,et al.  Efficient Belief Propagation for Early Vision , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[12]  William T. Freeman,et al.  Constructing free-energy approximations and generalized belief propagation algorithms , 2005, IEEE Transactions on Information Theory.

[13]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[14]  Christian Böhm,et al.  Robust information-theoretic clustering , 2006, KDD '06.

[15]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[16]  John K. Tsotsos,et al.  Saliency Based on Information Maximization , 2005, NIPS.