ICENET: A Semantic Segmentation Deep Network for River Ice by Fusing Positional and Channel-Wise Attentive Features

River ice monitoring is of great significance for river management, ship navigation and ice hazard forecasting in cold-regions. Accurate ice segmentation is one most important pieces of technology in ice monitoring research. It can provide the prerequisite information for the calculation of ice cover density, drift ice speed, ice cover distribution, change detection and so on. Unmanned aerial vehicle (UAV) aerial photography has the advantages of higher spatial and temporal resolution. As UAV technology has become more popular and cheaper, it has been widely used in ice monitoring. So, we focused on river ice segmentation based on UAV remote sensing images. In this study, the NWPU_YRCC dataset was built for river ice segmentation, in which all images were captured by different UAVs in the region of the Yellow River, the most difficult river to manage in the world. To the best of our knowledge, this is the first public UAV image dataset for river ice segmentation. Meanwhile, a semantic segmentation deep convolution neural network by fusing positional and channel-wise attentive features is proposed for river ice semantic segmentation, named ICENET. Experiments demonstrated that the proposed ICENET outperforms the state-of-the-art methods, achieving a superior result on the NWPU_YRCC dataset.

[1]  Andrei Kartoziia,et al.  Assessment of the Ice Wedge Polygon Current State by Means of UAV Imagery Analysis (Samoylov Island, the Lena Delta) , 2019, Remote. Sens..

[2]  Christian Haas,et al.  Brief Communication: Mapping river ice using drones and structure from motion , 2017 .

[3]  Marouane Temimi,et al.  An automated algorithm for river ice monitoring over the Susquehanna River using the MODIS data , 2014 .

[4]  R. Whaley,et al.  Identifying historic river ice breakup timing using MODIS and Google Earth Engine in support of operational flood monitoring in Northern Ontario , 2019, Remote Sensing of Environment.

[5]  Edgar Roman-Rangel,et al.  Fig Plant Segmentation from Aerial Images Using a Deep Convolutional Encoder-Decoder Network , 2019, Remote. Sens..

[6]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Gang Wang,et al.  Scene Segmentation with DAG-Recurrent Neural Networks , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  David A. Clausi,et al.  Unsupervised segmentation of synthetic aperture Radar sea ice imagery using a novel Markov random field model , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Yang Chen,et al.  Road Extraction from High-Resolution Remote Sensing Imagery Using Refined Deep Residual Convolutional Neural Network , 2019, Remote. Sens..

[11]  Gang Fu,et al.  Classification for High Resolution Remote Sensing Imagery Using a Fully Convolutional Network , 2017, Remote. Sens..

[12]  S. Beltaos.  RIVER ICE JAMS: THEORY, CASE STUDIES, AND APPLICATIONS , 1983 .

[13]  Hao He,et al.  Road Extraction by Using Atrous Spatial Pyramid Pooling Integrated Encoder-Decoder Network and Structural Similarity Loss , 2019, Remote. Sens..

[14]  Takashi Matsubara,et al.  Advantages of unmanned aerial vehicle (UAV) photogrammetry for landscape analysis compared with satellite data: A case study of postmining sites in Indonesia , 2018 .

[15]  Colin D. Rennie,et al.  Automated monitoring of river ice processes using shore-based imagery , 2017 .

[16]  Franz J. Meyer,et al.  Analyzing floating and bedfast lake ice regimes across Arctic Alaska using 25 years of space-borne SAR imagery , 2018 .

[17]  Tamlin M. Pavelsky,et al.  Spatial and temporal patterns in Arctic river ice breakup revealed by automated ice detection from MODIS imagery , 2016 .

[18]  Mohammed Dabboor,et al.  Towards sea ice classification using simulated RADARSAT Constellation Mission compact polarimetric SAR imagery , 2014 .

[19]  Jonathan P. Dash,et al.  Assessing very high resolution UAV imagery for monitoring forest health during a simulated disease outbreak , 2017 .

[20]  K. Lindenschmidt,et al.  Integration of space-borne and air-borne data in monitoring river ice processes in the Slave River, Canada , 2016 .

[21]  Piero Toscano,et al.  Intercomparison of UAV, Aircraft and Satellite Remote Sensing Platforms for Precision Viticulture , 2015, Remote. Sens..

[22]  Spyros Beltaos,et al.  Progress in the study and management of river ice jams , 2008 .

[23]  Juha A. Karvonen,et al.  Baltic Sea ice SAR segmentation and classification using modified pulse-coupled neural networks , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Jeffrey R. Key,et al.  Sea and Freshwater Ice Concentration from VIIRS on Suomi NPP and the Future JPSS Satellites , 2016, Remote. Sens..

[25]  Craig S. T. Daughtry,et al.  Acquisition of NIR-Green-Blue Digital Photographs from Unmanned Aircraft for Crop Monitoring , 2010, Remote. Sens..

[26]  David A. Clausi,et al.  Sea Ice Concentration Estimation During Melt From Dual-Pol SAR Scenes Using Deep Convolutional Neural Networks: A Case Study , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Peter Romanov,et al.  Global Multisensor Automated satellite-based Snow and Ice Mapping System (GMASI) for cryosphere monitoring , 2017 .

[28]  D. Selkowitz,et al.  Automated mapping of persistent ice and snow cover across the western U.S. with Landsat , 2016 .

[29]  Hua Su,et al.  Improving MODIS sea ice detectability using gray level co-occurrence matrix texture analysis method: A case study in the Bohai Sea , 2013 .

[30]  F. Hicks.  An overview of river ice problems: CRIPE07 guest editorial , 2009 .

[31]  Sidi Ahmed Mahmoudi,et al.  MRI Breast Tumor Segmentation Using Different Encoder and Decoder CNN Architectures , 2019, Comput..