A Real-Time Detecting Method for Continuous Urban Flood Scenarios Based on Computer Vision on Block Scale

Due to the frequent and sudden occurrence of urban waterlogging, targeted and rapid risk monitoring is extremely important for urban management. To improve the efficiency and accuracy of urban waterlogging monitoring, a real-time determination method of urban waterlogging based on computer vision technology was proposed in this study. First, city images were collected and then identified using the ResNet algorithm to determine whether a waterlogging risk existed in the images. Subsequently, the recognition accuracy was improved by image augmentation and the introduction of an attention mechanism (SE-ResNet). The experimental results showed that the waterlogging recognition rate reached 99.50%. In addition, according to the actual water accumulation process, real-time images of the waterlogging area were obtained, and a threshold method using the inverse weight of the time interval (T-IWT) was proposed to determine the times of the waterlogging occurrences from the continuous images. The results showed that the time error of the waterlogging identification was within 30 s. This study provides an effective method for identifying urban waterlogging risks in real-time.

[1]  I. Demir,et al.  U-net-based semantic classification for flood extent extraction using SAR imagery and GEE platform: A case study for 2019 central US flooding. , 2023, The Science of the total environment.

[2]  Qihong Chen,et al.  A review of visual SLAM methods for autonomous driving vehicles , 2022, Eng. Appl. Artif. Intell..

[3]  M. A. Khan,et al.  A journey towards fully autonomous driving - fueled by a smart communication system , 2022, Veh. Commun..

[4]  Jaku Rabinder Rakshit Pally,et al.  Application of image processing and convolutional neural networks for flood image classification and semantic segmentation , 2021, Environmental Modelling & Software.

[5]  Kilian Q. Weinberger,et al.  Convolutional Networks with Dense Connectivity , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  R. Dhaya,et al.  Video Surveillance-Based Urban Flood Monitoring System Using a Convolutional Neural Network , 2022, Intelligent Automation & Soft Computing.

[7]  Tarunpreet Kaur,et al.  Deep Transfer Learning for Land Use and Land Cover Classification: A Comparative Study , 2021, Sensors.

[8]  Edgar A. Galan,et al.  Intelligent Microfluidics: The Convergence of Machine Learning and Microfluidics in Materials Science and Biomedicine , 2020, Matter.

[9]  U. Rajendra Acharya,et al.  Application of deep learning technique to manage COVID-19 in routine clinical practice using CT images: Results of 10 convolutional neural networks , 2020, Computers in Biology and Medicine.

[10]  Milan Sonka,et al.  Deep-COVID: Predicting COVID-19 from chest X-ray images using deep transfer learning , 2020, Medical Image Analysis.

[11]  Laura M. Heiser,et al.  How Machine Learning Will Transform Biomedicine , 2020, Cell.

[12]  M. Hodgson,et al.  Prototyping a Social Media Flooding Photo Screening System Based on Deep Learning , 2020, ISPRS Int. J. Geo Inf..

[13]  Xin He,et al.  Attacking Vision-based Perception in End-to-End Autonomous Driving Models , 2019, J. Syst. Archit..

[14]  Asifullah Khan,et al.  A survey of the recent architectures of deep convolutional neural networks , 2019, Artificial Intelligence Review.

[15]  Taghi M. Khoshgoftaar,et al.  A survey on Image Data Augmentation for Deep Learning , 2019, Journal of Big Data.

[16]  Dipti Prasad Mukherjee,et al.  A comprehensive survey on computer vision based approaches for automatic identification of products in retail store , 2019, Image Vis. Comput..

[17]  Anke Xue,et al.  Automatic Estimation of Urban Waterlogging Depths from Video Images Based on Ubiquitous Reference Objects , 2019, Remote. Sens..

[18]  Lijun Zhao,et al.  Remote Sensing Image Scene Classification Using CNN-CapsNet , 2019, Remote. Sens..

[19]  Suzana Dragicevic,et al.  Land-Use Change Detection with Convolutional Neural Network Methods , 2019, Environments.

[20]  Andreas Dengel,et al.  EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classification , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[21]  Cordelia Schmid,et al.  Long-Term Temporal Convolutions for Action Recognition , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  J. P. Leitão,et al.  floodX: urban flash flood experiments monitored with conventional and alternative sensors , 2017 .

[23]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[24]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[25]  Shi-Wei Lo,et al.  Visual Sensing for Urban Flood Monitoring , 2015, Sensors.

[26]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Fang Zhang,et al.  Application of Computer Vision Technology in Agricultural Field , 2013 .

[28]  Ming Yang,et al.  3D Convolutional Neural Networks for Human Action Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[30]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[31]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.