Obstacle detection for lake-deployed autonomous surface vehicles using RGB imagery

We describe and test an obstacle-detection system for small, lake-deployed autonomous surface vehicles (ASVs) that relies on a low-cost, consumer-grade camera and runs on a single-board computer. A key feature of lakes that must be accounted for is the frequent presence of the shoreline in images as well as the land-sky boundary. These particularities, along with variable weather conditions, result in a wide range of scene variations, including the possible presence of glint. The implemented algorithm is based on two main steps. First, possible obstacles are detected using an innovative gradient-based image processing algorithm developed especially for a camera with a low viewing angle to the water (i.e., the situation for a small ASV). Then, true and false positives are differentiated using correlation-based multi-frame analysis. The algorithm was tested extensively on a small ASV deployed in Lake Geneva. Under operational conditions, the algorithm processed 640×480-pixel images from a Raspberry Pi Camera at about 3—4 Hz on a Raspberry Pi 3 Model B computer. The present algorithm demonstrates that single-board computers can be used for effective and low-cost obstacle detection systems for ASVs operating in variable lake conditions.

[1]  Jose Miguel Almeida,et al.  Radar based collision detection developments on USV ROAZ II , 2009, OCEANS 2009-EUROPE.

[2]  Marco Bibuli,et al.  Low cost optronic obstacle detection sensor for unmanned surface vehicles , 2015, 2015 IEEE Sensors Applications Symposium (SAS).

[3]  Sabine Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Yan Guo,et al.  Reactive path planning for autonomous sailboat using an omni-directional camera for obstacle detection , 2011, 2011 IEEE International Conference on Mechatronics.

[5]  Dmitry B. Goldgof,et al.  Detection and tracking of marine vehicles in video , 2008, 2008 19th International Conference on Pattern Recognition.

[6]  Oren Gal,et al.  Automatic Obstacle Detection for USV’s Navigation Using Vision Sensors , 2011 .

[7]  Matej Kristan,et al.  Fast Image-Based Obstacle Detection From Unmanned Surface Vehicles , 2015, IEEE Transactions on Cybernetics.

[8]  Anibal C. Matos,et al.  Raspberry PI based stereo vision for small size ASVs , 2013, 2013 OCEANS - San Diego.

[9]  D. A. Barry,et al.  A low-cost, autonomous mobile platform for limnological investigations, supported by high-resolution mesoscale airborne imagery , 2019, PloS one.

[10]  Ryan Halterman,et al.  Velodyne HDL-64E lidar for unmanned surface vehicle obstacle detection , 2010, Defense + Commercial Sensing.

[11]  Han Wang,et al.  Stereovision based obstacle detection system for unmanned surface vehicle , 2013, 2013 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[12]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[13]  Han Wang,et al.  A vision-based obstacle detection system for Unmanned Surface Vehicle , 2011, 2011 IEEE 5th International Conference on Robotics, Automation and Mechatronics (RAM).