Waterline and obstacle detection in images from low-cost autonomous boats for environmental monitoring

Abstract Waterline detection from images taken by cameras mounted on low-cost autonomous surface vehicles (ASVs) is a key process for obtaining a fast obstacle detection. Achieving an accurate waterline prediction is difficult due to the instability of the ASV on which the camera is mounted and the presence of reflections, illumination changes, and waves. In this work, we present a method for waterline and obstacle detection designed for low-cost ASVs employed in environmental monitoring. The proposed approach is made of two steps: (1) a pixel-wise segmentation of the current image is used to generate a binary mask separating water and non-water regions, (2) the mask is analyzed to infer the position of the waterline, which in turn is used for detecting obstacles. Experiments were carried out on two publicly available datasets containing floating obstacles such as buoys, sailing and motor boats, and swans moving near the ASV. Quantitative results show the effectiveness of the proposed approach with 98.8% pixel-wise segmentation accuracy running at 10 frames per second on an embedded GPU board.

[1]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[2]  Dumitru Erhan,et al.  Scalable Object Detection Using Deep Neural Networks , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Jürgen Schmidhuber,et al.  A Machine Learning Approach to Visual Perception of Forest Trails for Mobile Robots , 2016, IEEE Robotics and Automation Letters.

[4]  Li Li,et al.  Accelerating Minibatch Stochastic Gradient Descent Using Typicality Sampling , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[5]  Manuele Bicego,et al.  Unsupervised activity recognition for autonomous water drones , 2018, SAC.

[6]  Andres Huertas,et al.  Daytime Water Detection by Fusing Multiple Cues for Autonomous Off-Road Navigation , 2006 .

[7]  Daniel L. Codiga,et al.  A Marine Autonomous Surface Craft for Long-Duration, Spatially Explicit, Multidisciplinary Water Column Sampling in Coastal and Estuarine Systems , 2015 .

[8]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[9]  Abhinav Valada,et al.  Visual Obstacle Avoidance for Autonomous Watercraft u sing Smartphones , 2013 .

[10]  Daniele Nardi,et al.  Skin lesion image segmentation using Delaunay Triangulation for melanoma detection , 2016, Comput. Medical Imaging Graph..

[11]  Norio Akamatsu,et al.  A New Approach for Contrast Enhancement Using Sigmoid Function , 2004, Int. Arab J. Inf. Technol..

[12]  Manuele Bicego,et al.  Subspace clustering for situation assessment in aquatic drones , 2019, SAC.

[13]  Luis Perez,et al.  The Effectiveness of Data Augmentation in Image Classification using Deep Learning , 2017, ArXiv.

[14]  Brian Wyvill,et al.  Obstacle Detection for Image-Guided Surface Water Navigation , 2016, 2016 13th Conference on Computer and Robot Vision (CRV).

[15]  Luca Iocchi,et al.  A distributed approach for real-time multi-camera multiple object tracking , 2017, Machine Vision and Applications.

[16]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[17]  Ken-ichi Funahashi,et al.  On the approximate realization of continuous mappings by neural networks , 1989, Neural Networks.

[18]  Rich Caruana,et al.  Overfitting in Neural Nets: Backpropagation, Conjugate Gradient, and Early Stopping , 2000, NIPS.

[19]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[20]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Yuwei Zhang,et al.  Effective Waterline Detection of Unmanned Surface Vehicles Based on Optical Images , 2016, Sensors.

[22]  Tinne Tuytelaars,et al.  CNN-based single image obstacle avoidance on a quadrotor , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[23]  Nils J. Nilsson,et al.  A Formal Basis for the Heuristic Determination of Minimum Cost Paths , 1968, IEEE Trans. Syst. Sci. Cybern..

[24]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[25]  D A Barry,et al.  Obstacle detection for lake-deployed autonomous surface vehicles using RGB imagery , 2018, PloS one.

[26]  Matthew David Dunbabin,et al.  Quantifying Spatiotemporal Greenhouse Gas Emissions Using Autonomous Surface Vehicles , 2017, J. Field Robotics.

[27]  Vincenzo Manca,et al.  MP-GeneticSynth: inferring biological network regulations from time series , 2015, Bioinform..

[28]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[29]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.