A Graphical Model for Rapid Obstacle Image-Map Estimation from Unmanned Surface Vehicles

Obstacle detection plays an important role in unmanned surface vehicles (USV). Continuous detection from images taken onboard the vessel poses a particular challenge due to the diversity of the environment and the obstacle appearance. An obstacle may be a floating piece of wood, a scuba diver, a pier, or some other part of a shoreline. In this paper we tackle this problem by proposing a new graphical model that affords a fast and continuous obstacle image-map estimation from a single video stream captured onboard a USV. The model accounts for the semantic structure of marine environment as observed from USV by imposing weak structural constraints. A Markov random field framework is adopted and a highly efficient algorithm for simultaneous optimization of model parameters and segmentation mask estimation is derived. Our approach does not require computationally intensive extraction of texture features and runs faster than real-time. We also present a new, challenging, dataset for segmentation and obstacle detection in marine environments, which is the largest annotated dataset of its kind. Results on this dataset show that our model compares favorably in accuracy to the related approaches, requiring a fraction of computational effort.

[1]  Olga Veksler,et al.  Tiered scene labeling with dynamic programming , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[2]  Gaurav S. Sukhatme,et al.  Obstacle detection from overhead imagery using self-supervised learning for Autonomous Surface Vehicles , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Theo Gevers,et al.  A Spatially Constrained Generative Model and an EM Algorithm for Image Segmentation , 2007, IEEE Transactions on Neural Networks.

[4]  Gareth Funka-Lea,et al.  Graph Cuts and Efficient N-D Image Segmentation , 2006, International Journal of Computer Vision.

[5]  Ronen Basri,et al.  Image Segmentation by Probabilistic Bottom-Up Aggregation and Cue Integration , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Yan Lu,et al.  Simplified markov random fields for efficient semantic labeling of 3D point clouds , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Bernt Schiele,et al.  A Dynamic Conditional Random Field Model for Joint Labeling of Object and Scene Classes , 2008, ECCV.

[8]  Larry Matthies,et al.  Daytime water detection based on color variation , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Sebastian Scherer,et al.  River mapping from a flying robot: state estimation, river detection, and obstacle mapping , 2012, Auton. Robots.

[10]  Peter Kontschieder,et al.  Structured class-labels in random forests for semantic image labelling , 2011, 2011 International Conference on Computer Vision.

[11]  Han Wang,et al.  A vision-based obstacle detection system for Unmanned Surface Vehicle , 2011, 2011 IEEE 5th International Conference on Robotics, Automation and Mechatronics (RAM).

[12]  J. Besag On the Statistical Analysis of Dirty Pictures , 1986 .

[13]  Chiemela Onunka,et al.  Autonomous marine craft navigation: On the study of radar obstacle detection , 2010, 2010 11th International Conference on Control Automation Robotics & Vision.

[14]  Dmitry B. Goldgof,et al.  Detection and tracking of marine vehicles in video , 2008, 2008 19th International Conference on Pattern Recognition.

[15]  Yan Lu,et al.  Trail following with omnidirectional vision , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Shih-Fu Chang,et al.  Segmentation using superpixels: A bipartite graph partitioning approach , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[18]  Gaurav S. Sukhatme,et al.  Obstacle detection and avoidance for an Autonomous Surface Vehicle using a profiling sonar , 2011, 2011 IEEE International Conference on Robotics and Automation.

[19]  Sebastian Thrun,et al.  Winning the DARPA Grand Challenge with an AI Robot , 2006, AAAI.

[20]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[21]  Tommy Chang,et al.  Fusing Ladar and Color Image Information for Mobile Robot Feature Detection and Tracking , 2002 .

[22]  Borko Furht,et al.  A Hybrid Color-Based Foreground Object Detection Method for Automated Marine Surveillance , 2005, ACIVS.

[23]  Mubarak Shah,et al.  Object based segmentation of video using color, motion and spatial information , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[24]  Peter G. Ifju,et al.  Vision-guided flight stability and control for micro air vehicles , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  Terrance L. Huntsberger,et al.  Stereo vision–based navigation for autonomous surface vessels , 2011, J. Field Robotics.

[26]  智一 吉田,et al.  Efficient Graph-Based Image Segmentationを用いた圃場図自動作成手法の検討 , 2014 .

[27]  Jitendra Malik,et al.  Learning a classification model for segmentation , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[28]  Andrew McCallum,et al.  Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.

[29]  Les Elkins,et al.  The Autonomous Maritime Navigation (AMN) project: Field tests, autonomous and cooperative behaviors, data fusion, sensors, and vehicles , 2010, J. Field Robotics.

[30]  José Barata,et al.  Water detection with segmentation guided dynamic texture recognition , 2012, 2012 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[31]  Sebastian Thrun,et al.  Self-supervised Monocular Road Detection in Desert Terrain , 2006, Robotics: Science and Systems.