Photovoltaic plant condition monitoring using thermal images analysis by convolutional neural network-based structure

Abstract The size and the complexity of photovoltaic solar power plants are increasing, and it requires an advanced and robust condition monitoring systems for ensuring their reliability. This paper proposes a novel method for faults detection in photovoltaic panels employing a thermographic camera embedded in an unmanned aerial vehicle. The large amount of data generated by these systems must be processed and analyzed. This paper presents a novel approach to identify panels to detect hot spots, and to set their locations. Two novels region-based convolutional neural networks are unified to generate a robust detection structure. The main contribution is the combination of thermography and telemetry data to provide a response of the panel condition monitoring. The data are acquired and then automatically processed, allowing fault detection during the inspection. A detailed description of the methodology is presented, including the different stages to build the neural networks, i.e. the training process, the acquisition and processing of data and the outcomes generation. A thermographic inspection of a real photovoltaic solar plant is done to validate the proposed methodology. The accuracy, the efficiency and the performance of the approach under different real scenarios are evaluated statistically obtaining satisfactory results.

[1]  Fausto Pedro García Márquez,et al.  Optimal Maintenance Management of Offshore Wind Farms , 2016 .

[2]  Gabi Friesen,et al.  Review of Failures of Photovoltaic Modules , 2014 .

[3]  I. Colomina,et al.  Unmanned aerial systems for photogrammetry and remote sensing: A review , 2014 .

[4]  Daniela Michelle Reynoso Armenta Diagnosis of breast cancer through the processing of thermographic images and neural networks , 2017 .

[5]  Razvan Pascanu,et al.  On the difficulty of training recurrent neural networks , 2012, ICML.

[6]  J. A. Tsanakas,et al.  Passive and Active Thermographic Assessment as a Tool for Condition-Based Performance Monitoring of Photovoltaic Modules , 2011 .

[7]  Martijn Wisse,et al.  Team Delft's Robot Winner of the Amazon Picking Challenge 2016 , 2016, RoboCup.

[8]  Fausto Pedro García Márquez,et al.  Applied RCM2 algorithms based on statistical methods , 2007, Int. J. Autom. Comput..

[9]  C.-C. Jay Kuo Understanding convolutional neural networks with a mathematical model , 2016, J. Vis. Commun. Image Represent..

[10]  Silvano Vergura,et al.  Thermographic Analysis of Photovoltaic Panels , 2010 .

[11]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Kim,et al.  Automatic Photovoltaic Panel Area Extraction from UAV Thermal Infrared Images , 2016 .

[13]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[14]  Fausto Pedro García Márquez,et al.  A pattern recognition and data analysis method for maintenance management , 2012, Int. J. Syst. Sci..

[15]  Hyeonseok Lee,et al.  A field-applicable health monitoring method for photovoltaic system , 2019, Reliab. Eng. Syst. Saf..

[16]  Ayman Faza A probabilistic model for estimating the effects of photovoltaic sources on the power systems reliability , 2018, Reliab. Eng. Syst. Saf..

[17]  Harley Denio,et al.  Aerial solar Thermography and condition monitoring of photovoltaic systems , 2012, 2012 38th IEEE Photovoltaic Specialists Conference.

[18]  Fausto Pedro García Márquez,et al.  Principal component analysis applied to filtered signals for maintenance management , 2010, Qual. Reliab. Eng. Int..

[19]  Christoph J. Brabec,et al.  Reliability of IR-imaging of PV-plants under operating conditions , 2012 .

[20]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Meng Yang,et al.  Large-Margin Softmax Loss for Convolutional Neural Networks , 2016, ICML.

[22]  Matthew J. Hausknecht,et al.  Beyond short snippets: Deep networks for video classification , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Pradip M. Jawandhiya,et al.  Review of Unmanned Aircraft System (UAS) , 2013 .

[24]  Bahram Parvin,et al.  Detection of nuclei in H&E stained sections using convolutional neural networks , 2017, 2017 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI).

[25]  Fausto Pedro García Márquez,et al.  Ice detection using thermal infrared radiometry on wind turbine blades , 2016 .

[26]  Yichuan Tang,et al.  Deep Learning using Linear Support Vector Machines , 2013, 1306.0239.

[27]  Fausto Pedro García Márquez An Approach to Remote Condition Monitoring Systems Management , 2006 .

[28]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[29]  Li-Jia Li,et al.  Multi-view Face Detection Using Deep Convolutional Neural Networks , 2015, ICMR.

[30]  Elad Hoffer,et al.  Train longer, generalize better: closing the generalization gap in large batch training of neural networks , 2017, NIPS.

[31]  Mayorkinos Papaelias,et al.  Optimal Dynamic Analysis of Electrical/Electronic Components in Wind Turbines , 2017 .

[32]  Fausto Pedro García Márquez,et al.  Linear and nonlinear features and machine learning for wind turbine blade ice detection and diagnosis , 2019, Renewable Energy.

[33]  Mayorkinos Papaelias,et al.  Identification of critical components of wind turbines using FTA over the time , 2016 .

[34]  Diego J. Pedregal,et al.  New methods for the condition monitoring of level crossings , 2015, Int. J. Syst. Sci..

[35]  Isaac Segovia Ramírez,et al.  Condition monitoring system for solar power plants with radiometric and thermographic sensors embedded in unmanned aerial vehicles , 2019, Measurement.

[36]  Geoffrey E. Hinton,et al.  Replicated Softmax: an Undirected Topic Model , 2009, NIPS.

[37]  Mustapha Hatti Operation and Maintenance Methods in Solar Power Plants , 2014 .

[38]  Fausto Pedro García Márquez,et al.  Dirt and mud detection and diagnosis on a wind turbine blade employing guided waves and supervised learning classifiers , 2018, Reliab. Eng. Syst. Saf..

[39]  Mohammadreza Aghaei,et al.  Unmanned Aerial Vehicles in Photovoltaic Systems Monitoring Applications , 2014 .

[40]  Benjamin Lev,et al.  Optimal decision-making via binary decision diagrams for investments under a risky environment , 2017, Int. J. Prod. Res..

[41]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[42]  Jitendra Malik,et al.  R-CNNs for Pose Estimation and Action Detection , 2014, ArXiv.

[43]  Belhassen Bayar,et al.  Design Principles of Convolutional Neural Networks for Multimedia Forensics , 2017, Media Watermarking, Security, and Forensics.

[44]  Ricard Boqué Martí,et al.  Incertidumbre y precisión , 2001 .

[45]  Changyoon Kim,et al.  AUTOMATIC FAULT RECOGNITION OF PHOTOVOLTAIC MODULES BASED ON STATISTICAL ANALYSIS OF UAV THERMOGRAPHY , 2017 .

[46]  Fausto Pedro García Márquez,et al.  Wavelet transforms and pattern recognition on ultrasonic guides waves for frozen surface state diagnosis , 2018 .

[47]  Andy Walker PV O&M Cost Model and Cost Reduction , 2017 .

[48]  Diego J. Pedregal,et al.  An algorithmic approach for maintenance management based on advanced state space systems and harmonic regressions , 2009, Ann. Oper. Res..

[49]  Rita Ebner,et al.  Non-destructive techniques for quality control of PV modules: Infrared thermography, electro- and photoluminescence imaging , 2013, IECON 2013 - 39th Annual Conference of the IEEE Industrial Electronics Society.

[50]  John A. Tsanakas,et al.  Advanced inspection of photovoltaic installations by aerial triangulation and terrestrial georeferencing of thermal/visual imagery , 2017 .

[51]  Jien Ma,et al.  Identifying PV Module Mismatch Faults by a Thermography-Based Temperature Distribution Analysis , 2014, IEEE Transactions on Device and Materials Reliability.

[52]  Luis Marroyo,et al.  An investigation into hot‐spots in two large grid‐connected PV plants , 2008 .

[53]  Jitendra Malik,et al.  Simultaneous Detection and Segmentation , 2014, ECCV.

[54]  Fausto Pedro García Márquez,et al.  A survey of artificial neural network in wind energy systems , 2018, Applied Energy.