Mask R-CNN based segmentation method for satellite imagery of photovoltaics generation systems

There is increasing interest in getting the precise locations and the corresponding sizes of installed photovoltaics. Previous and existing methods have been confirmed to be time-consuming, not robust or incomplete. Thus, we proposed a new method based on the satellite imagery, deep learning and image processing which can be used to collect the precise information of installed photovoltaic automatically. The information can be utilized to support the adoption and management of solar electricity. The method includes three main parts: the overlap-tile strategy, Mask R-CNN model and right-angle polygon fit algorithm. The overlap-tile strategy used here to improve the image edge segmentation ability of Mask R-CNN. The right-angle polygon fit algorithm is proposed to better fit the mask area generated by Mask R-CNN, which helps us get the much more precise locations and sizes of photovoltaics. The training and testing of our method were based on a satellite dataset with 3904 images annotated with ground truth regions of photovoltaics. The numerical and visual results clearly demonstrate that the accuracy and efficiency of our method is better than the previous reports.

[1]  Vladimir A. Golovko,et al.  Convolutional neural network based solar photovoltaic panel detection in satellite photos , 2017, 2017 9th IEEE International Conference on Intelligent Data Acquisition and Advanced Computing Systems: Technology and Applications (IDAACS).

[2]  Hiok Chai Quek,et al.  A novel framework for making dominant point detection methods non-parametric , 2012, Image Vis. Comput..

[3]  Nuno Vasconcelos,et al.  Cascade R-CNN: High Quality Object Detection and Instance Segmentation , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[5]  J. Koenderink Q… , 2014, Les noms officiels des communes de Wallonie, de Bruxelles-Capitale et de la communaute germanophone.

[6]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[7]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[9]  Yi-yong Yao,et al.  Recognition and location of solar panels based on machine vision , 2017, 2017 2nd Asia-Pacific Conference on Intelligent Robot Systems (ACIRS).

[10]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[12]  Margaret Lech,et al.  Using Deep Learning to Identify Potential Roof Spaces for Solar Panels , 2018, 2018 12th International Conference on Signal Processing and Communication Systems (ICSPCS).

[13]  Yan Sun,et al.  A Vision-Based Inspection Strategy for Large-Scale Photovoltaic Farms Using an Autonomous UAV , 2018, 2018 17th International Symposium on Distributed Computing and Applications for Business Engineering and Science (DCABES).

[14]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  D. Zhang,et al.  Aerial image analysis based on improved adaptive clustering for photovoltaic module inspection , 2017, 2017 International Smart Cities Conference (ISC2).

[17]  Jiangye Yuan,et al.  2016 Ieee International Conference on Big Data (big Data) Large-scale Solar Panel Mapping from Aerial Images Using Deep Convolutional Networks , 2022 .

[18]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Jiafan Yu,et al.  DeepSolar: A Machine Learning Framework to Efficiently Construct a Solar Deployment Database in the United States , 2018, Joule.

[20]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Jordan M. Malof,et al.  Image features for pixel-wise detection of solar photovoltaic arrays in aerial imagery using a random forest classifier , 2016, 2016 IEEE International Conference on Renewable Energy Research and Applications (ICRERA).

[23]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[24]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Azriel Rosenfeld,et al.  Angle Detection on Digital Curves , 1973, IEEE Transactions on Computers.