Solar Panel Detection within Complex Backgrounds Using Thermal Images Acquired by UAVs

The installation of solar plants everywhere in the world increases year by year. Automated diagnostic methods are needed to inspect the solar plants and to identify anomalies within these photovoltaic panels. The inspection is usually carried out by unmanned aerial vehicles (UAVs) using thermal imaging sensors. The first step in the whole process is to detect the solar panels in those images. However, standard image processing techniques fail in case of low-contrast images or images with complex backgrounds. Moreover, the shades of power lines or structures similar to solar panels impede the automated detection process. In this research, two self-developed methods are compared for the detection of panels in this context, one based on classical techniques and another one based on deep learning, both with a common post-processing step. The first method is based on edge detection and classification, in contrast to the second method is based on training a region based convolutional neural networks to identify a panel. The first method corrects for the low contrast of the thermal image using several preprocessing techniques. Subsequently, edge detection, segmentation and segment classification are applied. The latter is done using a support vector machine trained with an optimized texture descriptor vector. The second method is based on deep learning trained with images that have been subjected to three different pre-processing operations. The postprocessing use the detected panels to infer the location of panels that were not detected. This step selects contours from detected panels based on the panel area and the angle of rotation. Then new panels are determined by the extrapolation of these contours. The panels in 100 random images taken from eleven UAV flights over three solar plants are labeled and used to evaluate the detection methods. The metrics for the new method based on classical techniques reaches a precision of 0.997, a recall of 0.970 and a F1 score of 0.983. The metrics for the method of deep learning reaches a precision of 0.996, a recall of 0.981 and a F1 score of 0.989. The two panel detection methods are highly effective in the presence of complex backgrounds.

[1]  J. Gee,et al.  The Insight ToolKit image registration framework , 2014, Front. Neuroinform..

[2]  Alessia Saggese,et al.  A deep learning based approach for detecting panels in photovoltaic plants , 2020, APPIS.

[3]  Yihua Hu,et al.  A Review for Solar Panel Fire Accident Prevention in Large-Scale PV Applications , 2020, IEEE Access.

[4]  Zainul Abdin Jaffery,et al.  Scheme for predictive fault diagnosis in photo-voltaic modules using thermal imaging , 2017 .

[5]  K C Liao,et al.  Using Matlab real-time image analysis for solar panel fault detection with UAV , 2020, Journal of Physics: Conference Series.

[6]  Ashutosh Kumar Singh,et al.  IoT Based Solar Panel Analysis using Thermal Imaging , 2020, 2020 IEEE International Students' Conference on Electrical,Electronics and Computer Science (SCEECS).

[8]  Alaa Tharwat,et al.  Classification assessment methods , 2020, Applied Computing and Informatics.

[9]  J. Park,et al.  Precise Inspection Method of Solar Photovoltaic Panel Using Optical and Thermal Infrared Sensor Image Taken by Drones , 2019, IOP Conference Series: Materials Science and Engineering.

[10]  Austin Thomas,et al.  Constructing statutory energy goal compliant wind and solar PV infrastructure pathways , 2020 .

[11]  Markus Reischl,et al.  Benchmarking in classification and regression , 2019, Wiley Interdiscip. Rev. Data Min. Knowl. Discov..

[12]  K. Jarrod Millman,et al.  Array programming with NumPy , 2020, Nat..

[13]  Ankita Pramanik,et al.  Deep Learning Techniques—R-CNN to Mask R-CNN: A Survey , 2019, Computational Intelligence in Pattern Recognition.

[14]  Hesham Ismail,et al.  Autonomous Detection of PV Panels Using a Drone , 2019 .

[15]  Seung Jae Lee,et al.  Detecting faulty solar panels based on thermal image processing , 2018, 2018 IEEE International Conference on Consumer Electronics (ICCE).

[16]  D. Chicco,et al.  The advantages of the Matthews correlation coefficient (MCC) over F1 score and accuracy in binary classification evaluation , 2020, BMC Genomics.

[17]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[18]  Bradley J. Bazuin,et al.  Unsupervised Fault Detection and Analysis for Large Photovoltaic Systems Using Drones and Machine Vision , 2018, Energies.

[19]  Marcelo A. Perez,et al.  Photovoltaic Modules Diagnosis Using Artificial Vision Techniques for Artifact Minimization , 2018, Energies.

[20]  Hong Wei Xu,et al.  Research on Solar Panels Online Defect Detecting Method , 2014 .

[21]  Lichi Zhang,et al.  cuRadiomics: A GPU-Based Radiomics Feature Extraction Toolkit , 2019, RNO-AI@MICCAI.

[22]  Andriy Fedorov,et al.  Computational Radiomics System to Decode the Radiographic Phenotype. , 2017, Cancer research.

[23]  Yuanfan Zheng,et al.  Modeling the Effect of Green Roof Systems and Photovoltaic Panels for Building Energy Savings to Mitigate Climate Change , 2020, Remote. Sens..

[24]  Amit Kumar Garg,et al.  A Mamdani Fuzzy Logic System to Enhance Solar Cell Micro-Cracks Image Processing , 2018, 3D Research.

[25]  Imene Yahyaoui,et al.  A practical technique for on-line monitoring of a photovoltaic plant connected to a single-phase grid , 2017 .

[26]  Dongho Lee,et al.  Development of Solar-Panel Monitoring Method Using Unmanned Aerial Vehicle and Thermal Infrared Sensor , 2019 .

[27]  C. Muniraj,et al.  Diagnosis of Photovoltaic (PV) Panel Defects Based on Testing and Evaluation of Thermal Image , 2019 .

[28]  Chenglian Liu,et al.  The efficiency and performance detection algorithm and system development for photovoltaic system through use of thermal image processing technology , 2018 .

[29]  Dong Ho Lee,et al.  Developing Inspection Methodology of Solar Energy Plants by Thermal Infrared Sensor on Board Unmanned Aerial Vehicles , 2019, Energies.

[30]  Ting Lie,et al.  Advances in Intelligent Systems and Computing , 2014 .

[31]  M. Dhimish,et al.  Photovoltaic Degradation Rate Affected by Different Weather Conditions: A Case Study Based on PV Systems in the UK and Australia , 2020, Electronics.

[32]  J. Meydbray,et al.  Fill Factor Loss in Fielded Photovoltaic Modules Due to Metallization Failures, Characterized by Luminescence and Thermal Imaging , 2019, 2019 IEEE 46th Photovoltaic Specialists Conference (PVSC).

[33]  Amit Doegar,et al.  Fault Identification in Electrical Equipment using Thermal Image Processing , 2018, 2018 International Conference on Computing, Power and Communication Technologies (GUCON).

[34]  João P. S. Catalão,et al.  Optimal self-scheduling of home energy management system in the presence of photovoltaic power generation and batteries , 2020 .

[35]  Ikhlas Abdel-Qader,et al.  Fault detection in photovoltaic system using SLIC and thermal images , 2017, 2017 8th International Conference on Information Technology (ICIT).

[36]  Mohammed Elhafyani,et al.  Management Strategy of Power Exchange in a Building Between Grid, Photovoltaic and Batteries , 2020 .

[37]  Luis Hernández-Callejo,et al.  Segmentation of Thermography Image of Solar Cells and Panels , 2019, ICSC-Cities.

[38]  Glen P. Abousleman,et al.  Automatic solar panel recognition and defect detection using infrared imaging , 2015, Defense + Security Symposium.

[39]  Mario Luca Bernardi,et al.  A UAV infrared measurement approach for defect detection in photovoltaic plants , 2017, 2017 IEEE International Workshop on Metrology for AeroSpace (MetroAeroSpace).

[40]  Diego González-Aguilera,et al.  Automatic Evaluation of Photovoltaic Power Stations from High-Density RGB-T 3D Point Clouds , 2017, Remote. Sens..

[41]  Minh-Quan Dang,et al.  New Monitoring System for Photovoltaic Power Plants’ Management , 2018, Energies.

[42]  Chris Henry,et al.  Automatic Detection System of Deteriorated PV Modules Using Drone with Thermal Camera , 2020, Applied Sciences.

[43]  V. Poulek,et al.  Monitoring of Defects of a Photovoltaic Power Plant Using a Drone , 2019, Energies.

[44]  Mihail Busu,et al.  Analyzing the Impact of the Renewable Energy Sources on Economic Growth at the EU Level Using an ARDL Model , 2020, Mathematics.