Saliency-Based Obstacle Detection and Ground-Plane Estimation for Off-Road Vehicles

Due to stringing time constraints, saliency models are becoming popular tools for building situated robotic systems requiring, for instance, object recognition and vision-based localisation capabilities. This paper contributes to this endeavour by applying saliency into two new tasks: modulation of stereo-based obstacle detection and ground-plane estimation, both to operate on-board off-road vehicles. To achieve this, a new biologically inspired saliency model, along with a set of adaptations to the task-specific algorithms, are proposed. Experimental results show a reduction in computational cost and an increase in both robustness and accuracy when saliency modulation is used.

[1]  T. Duckett,et al.  VOCUS : A Visual Attention System for Object Detection and Goal-directed Search , 2010 .

[2]  Paulo Santos,et al.  Cross-country obstacle detection: Space-variant resolution and outliers removal , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Christof Koch,et al.  Modeling attention to salient proto-objects , 2006, Neural Networks.

[4]  James J. Little,et al.  Curious George: An attentive semantic robot , 2008, Robotics Auton. Syst..

[5]  Alberto Broggi,et al.  The Single Frame Stereo Vision System for Reliable Obstacle Detection Used during the 2005 DARPA Grand Challenge on TerraMax , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[6]  John K. Tsotsos,et al.  Attention in Cognitive Systems, 5th International Workshop on Attention in Cognitive Systems, WAPCV 2008, Fira, Santorini, Greece, May 12, 2008, Revised Selected Papers , 2009, WAPCV.

[7]  Marc M. Van Hulle,et al.  Ground plane estimation based on dense stereo disparity , 2008 .

[8]  Henrik I. Christensen,et al.  Simultaneous Robot Localization and Mapping Based on a Visual Attention System , 2008, WAPCV.

[9]  Roberto Manduchi,et al.  Obstacle Detection and Terrain Classification for Autonomous Off-Road Navigation , 2005, Auton. Robots.

[10]  Gordon Cheng,et al.  Distributed visual attention on a humanoid robot , 2005, 5th IEEE-RAS International Conference on Humanoid Robots, 2005..

[11]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[12]  J. C. van den Heuvel,et al.  Stereo based Obstacle Detection with Uncertainty in Rough Terrain , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[13]  Gary R. Bradski,et al.  Learning OpenCV - computer vision with the OpenCV library: software that sees , 2008 .

[14]  Liqing Zhang,et al.  Saliency Detection: A Spectral Residual Approach , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Alexandre Bernardino,et al.  Multimodal saliency-based bottom-up attention a framework for the humanoid robot iCub , 2008, 2008 IEEE International Conference on Robotics and Automation.

[16]  Robert E. Mahony,et al.  Spatio-Temporal RANSAC for Robust Estimation of Ground Plane in Video Range Images for Automotive Applications , 2008, 2008 11th International IEEE Conference on Intelligent Transportation Systems.

[17]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[18]  P. Cavanagh,et al.  Looking ahead: the perceived direction of gaze shifts before the eyes move. , 2009, Journal of vision.

[19]  Robert C. Bolles,et al.  Outdoor Mapping and Navigation Using Stereo Vision , 2006, ISER.

[20]  Alex D. Hwang,et al.  A model of top-down attentional control during visual search in complex scenes. , 2009, Journal of vision.

[21]  Michael Brady,et al.  Saliency, Scale and Image Description , 2001, International Journal of Computer Vision.

[22]  Paul Newman,et al.  SLAM-Loop Closing with Visually Salient Features , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.