Detection of photovoltaic installations in RGB aerial imaging: a comparative study

In this work, we compare four different approaches for detecting photovoltaic installations from RGB aerial images. Our client, an electricity grid administrator, wants to hunt down fraud with unregistered illegal solar panel installations by detecting installations in aerial imagery and checking these against their database of registered installations. The detection of solar panels in these RGB images is a difficult task. Reasons are the relatively low resolution (at 25 cm/pixel an individual solar panel only measures about 9�7 pixels), the undiscriminating colour properties of the object (due to in-class variance and specular effects) and the apparent shape variability (rotation and skew due to the different roofs slant angles). Therefore, straightforward object segmentation techniques do not yield a satisfying solution, as proven in this paper. We compared four state-of-the-art object detection approaches for this task. First we experimented with a machine learning object detection technique based on pixel-based support vector machine classification. Secondly we developed an approach using MSER based colour segmentation and shape analysis. Finally a dual approach based on object categorization using the boosted cascade classifier technique of Viola & Jones and the aggregate channel features technique of Doll´ar et al., is introduced, learning a combination of colour and gradient feature based classifiers from a given training set. We successfully evaluate these four different approaches on a fully labelled test set of a 8000 � 8000 pixel, 4 square km zone containing 315 solar panel installations with in total more than 10.000 individual panels.

[1]  Yoav Freund,et al.  A Short Introduction to Boosting , 1999 .

[2]  David A. McAllester,et al.  Cascade object detection with deformable part models , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  Pietro Perona,et al.  Integral Channel Features , 2009, BMVC.

[4]  Toon Goedemé,et al.  Visual detection and species classification of orchid flowers , 2015, 2015 14th IAPR International Conference on Machine Vision Applications (MVA).

[5]  Shengcai Liao,et al.  Learning Multi-scale Block Local Binary Patterns for Face Recognition , 2007, ICB.

[6]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[7]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[8]  Bart Vanrumste,et al.  Automated walking aid detector based on indoor video recordings , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[9]  Terrence Fong,et al.  Vehicle detection from aerial imagery , 2011, 2011 IEEE International Conference on Robotics and Automation.

[10]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Stefan Hinz,et al.  Automatic extraction of urban road networks from multi-view aerial imagery , 2003 .

[12]  Du-Ming Tsai,et al.  Wavelet-based defect detection in solar wafer images with inhomogeneous texture , 2012, Pattern Recognit..

[13]  Pietro Perona,et al.  Fast Feature Pyramids for Object Detection , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Du-Ming Tsai,et al.  Defect Detection in Solar Modules Using ICA Basis Images , 2013, IEEE Transactions on Industrial Informatics.

[15]  Toon Goedemé,et al.  Open Framework for Combined Pedestrian Detection , 2015, VISAPP.

[16]  Helmut Mayer,et al.  Automatic Object Extraction from Aerial Imagery - A Survey Focusing on Buildings , 1999, Comput. Vis. Image Underst..

[17]  P. Sánchez‐Friera,et al.  Analysis of degradation mechanisms of crystalline silicon PV modules after 12 years of operation in Southern Europe , 2011 .