Building an Online Defect Detection System for Large-scale Photovoltaic Plants

The power efficiency of photovoltaic modules is highly correlated with their health status. Under dynamically changing environments, photovoltaic defects could spontaneously form and develop into fatal faults during the daily operation of photovoltaic plants. To facilitate defect detection with less human intervention, a nondestructive and contactless visual inspection system with the help of unmanned aerial vehicles and edge computing is proposed in this work. Limited by the resources of edge devices and the availability of images of photovoltaic defects for training, we developed an online solution combined with deep learning, data argumentation and transfer learning to properly address the issues of running resource hungry applications on edge devices and lack of training samples faced by the deep learning approaches used in the field. With the reduction of the network depth of the deep convolutional neural network model and the transfer of features from the learned defects, the resource consumption of our proposed approach is significantly reduced, and thus can be used on a wide range of edge devices to complete defect detection in a timely manner with high accuracy. To study the performance of our design, a testbed was built from open source hardware and software, and field trials were carried out in three photovoltaic plants. The experimental results clearly demonstrate the practicality and effectiveness of our design for detecting visible defects on photovoltaic modules.

[1]  Tao Zhang,et al.  Fog and IoT: An Overview of Research Opportunities , 2016, IEEE Internet of Things Journal.

[2]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[3]  Jing Dong,et al.  Learning and transferring representations for image steganalysis using convolutional neural network , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[4]  Ravi Kiran Sarvadevabhatla,et al.  A Taxonomy of Deep Convolutional Neural Nets for Computer Vision , 2016, Front. Robot. AI.

[5]  Martin K. Patel,et al.  GIS-based assessment of photovoltaic (PV) and concentrated solar power (CSP) generation potential in West Africa , 2018 .

[6]  Ying Sun,et al.  Reliable fault detection and diagnosis of photovoltaic systems based on statistical monitoring approaches , 2018 .

[7]  Quoc V. Le,et al.  Domain Adaptive Transfer Learning with Specialist Models , 2018, ArXiv.

[8]  Mohsen Guizani,et al.  Deep Learning for IoT Big Data and Streaming Analytics: A Survey , 2017, IEEE Communications Surveys & Tutorials.

[9]  Fei Jiang,et al.  Big data issues in smart grid – A review , 2017 .

[10]  Mohd Abdullah,et al.  Micro-crack detection of multicrystalline solar cells featuring an improved anisotropic diffusion filter and image segmentation technique , 2014, EURASIP Journal on Image and Video Processing.

[11]  Qiang Yang,et al.  Deep Learning Based Module Defect Analysis for Large-Scale Photovoltaic Farms , 2019, IEEE Transactions on Energy Conversion.

[12]  Xinbo Gao,et al.  Objective Video Quality Assessment Combining Transfer Learning With CNN , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[13]  Paul Gill,et al.  Electrical Power Equipment Maintenance and Testing , 1997 .

[14]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Ivan Laptev,et al.  Learning and Transferring Mid-level Image Representations Using Convolutional Neural Networks , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Shivkumar Kalyanaraman,et al.  DeepSolarEye: Power Loss Prediction and Weakly Supervised Soiling Localization via Fully Convolutional Networks for Solar Panels , 2017, 2018 IEEE Winter Conference on Applications of Computer Vision (WACV).

[18]  Yuliya Voronko,et al.  Outdoor detection and visualization of hailstorm damages of photovoltaic plants , 2018 .

[19]  Jordan J. Bird,et al.  A Study on CNN Transfer Learning for Image Classification , 2018, UKCI.

[20]  Mahadev Satyanarayanan,et al.  The Emergence of Edge Computing , 2017, Computer.

[21]  Yincheng Qi,et al.  Multi-patch deep features for power line insulator status classification from aerial images , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[22]  Christian Riess,et al.  Automatic Classification of Defective Photovoltaic Module Cells in Electroluminescence Images , 2018, Solar Energy.

[23]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[24]  Qiang Yang,et al.  IET Renewable Power Generation Special Issue: Performance Assessment and Condition Monitoring of Photovoltaic Systems for Improved Energy Yield Visible defects detection based on UAV-based inspection in large-scale photovoltaic systems , 2020 .

[25]  E. Kaplani Degradation in Field-aged Crystalline Silicon Photovoltaic Modules and Diagnosis using Electroluminescence Imaging , 2016 .

[26]  Yi Pan,et al.  Edge Computing for the Internet of Things , 2018, IEEE Netw..

[27]  Paulo F. Pires,et al.  On Enabling Sustainable Edge Computing with Renewable Energy Resources , 2018, IEEE Communications Magazine.

[28]  D. H. Kim,et al.  Artificial intelligence in fracture detection: transfer learning from deep convolutional neural networks. , 2017, Clinical radiology.

[29]  Qiang Yang,et al.  Transfer Learning based Photovoltaic Module Defect Diagnosis using Aerial Images , 2018, 2018 International Conference on Power System Technology (POWERCON).

[30]  Djemel Ziou,et al.  Is there a relationship between peak-signal-to-noise ratio and structural similarity index measure? , 2013, IET Image Process..

[31]  Roberto Pierdicca,et al.  DEEP CONVOLUTIONAL NEURAL NETWORK FOR AUTOMATIC DETECTION OF DAMAGED PHOTOVOLTAIC CELLS , 2018, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[32]  Chunhua Shen,et al.  Adversarial Generation of Training Examples: Applications to Moving Vehicle License Plate Recognition , 2017 .

[33]  Abhishek Das,et al.  Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[34]  Santiago Silvestre Strategies for Fault Detection and Diagnosis of PV Systems , 2018 .