Detecting Floodwater on Roadways from Image Data Using Mask-R-CNN

Object detection and segmentation algorithms evolved significantly in the last decade. Simultaneous object detection and segmentation paved the way for real-time applications such as autonomous driving. Detection and segmentation of (partially) flooded roadways are important inputs for vehicle routing and traffic management systems. This paper proposes an automatic floodwater detection and segmentation method utilizing the Mask-R-CNN algorithm - a deep learning algorithm belonging to Region-Based Convolutional Neural Networks (R-CNN) family of models for object detection and semantic segmentation. As the latest evolution in the R-CNN family, Mask-R-CNN fuses localization, classification, and segmentation in a compact and fast algorithm. To train the model, manually labeled images with urban, suburban, and natural settings are used. The performance of the algorithm is assessed in accurately detecting the floodwater captured in images. The results show that the proposed floodwater detection and segmentation perform better than previous studies.

[1]  Roland S. Zimmermann,et al.  Faster Training of Mask R-CNN by Focusing on Instance Boundaries , 2018, Comput. Vis. Image Underst..

[2]  Neil M. Robertson,et al.  Aerial image segmentation for flood risk analysis , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[3]  Jeremiah W. Johnson,et al.  Adapting Mask-RCNN for Automatic Nucleus Segmentation , 2018, ArXiv.

[4]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[5]  Khan M. Iftekharuddin,et al.  Detecting floodwater on roadways from image data with handcrafted features and deep transfer learning* , 2019, 2019 IEEE Intelligent Transportation Systems Conference (ITSC).

[6]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[7]  Xiangliang Zhang,et al.  Flash Flood Detection in Urban Cities Using Ultrasonic and Infrared Sensors , 2016, IEEE Sensors Journal.

[8]  William Sweet,et al.  From the extreme to the mean: Acceleration and tipping points of coastal inundation from sea level rise , 2014 .

[9]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Jinjun Xiong,et al.  Revisiting RCNN: On Awakening the Classification Power of Faster RCNN , 2018, ECCV.

[12]  M. I. Elbakary,et al.  Floodwater detection on roadways from crowdsourced images , 2018, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[13]  Feng Wang,et al.  Flood Detection in Gaofen-3 SAR Images via Fully Convolutional Networks , 2018, Sensors.