DeepSolar for Germany: A deep learning framework for PV system mapping from aerial imagery

The increasing availability of high-resolution aerial imagery and the recent deep learning-based advances in computer vision have made it possible to automatically map energy systems remotely at a large scale. In this paper, we focus on optimizing the existing DeepSolar framework for photovoltaics (PV) system classification. Specifically, we propose an efficient dataset creation methodology for aerial imagery which allows us to achieve state-of-the-art results, improving the previous model’s recall score by more than eight percentage points to 98% while keeping its precision almost constant at 92%. Furthermore, we show that our optimized model extends its superior classification performance to lower image resolutions. After re-training our optimized model on lower resolution imagery, we apply it to Germany’s most-populous state, North-Rhine Westphalia, and deliver a proof of concept for automatically validating, updating, and creating databases of renewable energy systems at a large scale. We conclude with a brief analysis of socio-economic factors correlating with PV system adoption.

[1]  Julian de Hoog,et al.  Using Satellite and Aerial Imagery for Identification of Solar PV: State of the Art and Research Opportunities , 2020, e-Energy.

[2]  Jordan M. Malof,et al.  A deep convolutional neural network, with pre-training, for solar photovoltaic array detection in aerial imagery , 2017, 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[3]  Jiangye Yuan,et al.  2016 Ieee International Conference on Big Data (big Data) Large-scale Solar Panel Mapping from Aerial Images Using Deep Convolutional Networks , 2022 .

[4]  Anthony K. H. Tung,et al.  Finding representative set from massive data , 2005, Fifth IEEE International Conference on Data Mining (ICDM'05).

[5]  Jordan M. Malof,et al.  Application of a semantic segmentation convolutional neural network for accurate automatic detection and mapping of solar photovoltaic arrays in aerial imagery , 2018, ArXiv.

[6]  Curt H. Davis,et al.  Automated Building Extraction from High-Resolution Satellite Imagery in Urban Areas Using Structural, Contextual, and Spectral Information , 2005, EURASIP J. Adv. Signal Process..

[7]  Lei Yin,et al.  SolarNet: A Deep Learning Framework to Map Solar Power Plants In China From Satellite Imagery , 2019, ArXiv.

[8]  Jordan M. Malof,et al.  Automatic solar photovoltaic panel detection in satellite imagery , 2015, 2015 International Conference on Renewable Energy Research and Applications (ICRERA).

[9]  Qihao Weng,et al.  A survey of image classification methods and techniques for improving classification performance , 2007 .

[10]  Subhransu Maji,et al.  DeepRoof: A Data-driven Approach For Solar Potential Estimation Using Rooftop Imagery , 2019, KDD.

[11]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[12]  Anders Krogh,et al.  A Simple Weight Decay Can Improve Generalization , 1991, NIPS.

[13]  Jordan M. Malof,et al.  Automatic Detection of Solar Photovoltaic Arrays in High Resolution Aerial Imagery , 2016, ArXiv.

[14]  Nathalie Japkowicz,et al.  The class imbalance problem: A systematic study , 2002, Intell. Data Anal..

[15]  Geoffrey E. Hinton,et al.  Learning to Detect Roads in High-Resolution Aerial Images , 2010, ECCV.

[16]  Xiaoqiang Lu,et al.  Remote Sensing Image Scene Classification: Benchmark and State of the Art , 2017, Proceedings of the IEEE.

[17]  Russell McKenna,et al.  Rooftop PV Potential Estimations: Automated Orthographic Satellite Image Recognition Based on Publicly Available Data , 2016 .

[18]  Jiafan Yu,et al.  DeepSolar: A Machine Learning Framework to Efficiently Construct a Solar Deployment Database in the United States , 2018, Joule.

[19]  Bertrand Le Saux,et al.  Semantic Segmentation of Earth Observation Data Using Multimodal and Multi-scale Deep Networks , 2016, ACCV.

[20]  Jordan M. Malof,et al.  A deep convolutional neural network and a random forest classifier for solar photovoltaic array detection in aerial imagery , 2016, 2016 IEEE International Conference on Renewable Energy Research and Applications (ICRERA).