UAV image analysis for leakage detection in district heating systems using machine learning

Abstract In this paper, we propose automatic energy leakage detection in underground pipes of district heating systems based on Infrared (IR) images, captured by an Unmanned Aerial Vehicle (UAV). Hot water or steam is distributed to homes and industries through underground pipes from a central power plan. Leakages in underground pipes pose a very common problem, which can occur for many reasons, e.g. unprofessional installation and end of service life. Potentially, a leakage remains undiscovered for a very long period of time. Therefore, it is of great interest for power supply companies to monitor district heating networks to identify leakages. In this paper, the original IR images are captured in a 16 bit format by a UAV. On ground, potential leakages are extracted using a region extraction algorithm. Thereafter a Convolutional Neural Network (CNN) as well as eight conventional Machine Learning (ML) classifiers are applied on these regions to classify whether or not it is a leakage. In total, twelve UAV sequences are captured at different cities in Denmark. Based on these, around 13.4 million samples of image patches of district heating systems are extracted. Eleven sequences are used for training and the remaining one for testing. This was performed on all splits in the leave-one-out testing. The deep learning CNN achieved an average weighted accuracy of 0.872 with a false positive and negative rate of 12.7 % and 10.4 %, respectively. This CNN model detected around 98.6 % of the true leakages. In comparison, conventional ML classifiers, i.e. Adaboost (AB), Random Forest (RF), etc. provide lower average weighted accuracy, but on the other hand they require less computational resources. We have compared our method with a state-of-art method and the result shows that the proposed method is very competitive.

[1]  Gui-Song Xia,et al.  Pipeline leakage detection for district heating systems using multisource data in mid- and high-latitude regions , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[2]  M. Rosengren,et al.  Aerial Thermography - A Tool For Detecting Heat Losses And Defective Insulation In Building Attics And District Heating Networks , 1987, Other Conferences.

[3]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[4]  Jörgen Ahlberg,et al.  Classifying district heating network leakages in aerial thermal imagery , 2014 .

[5]  Zheng O'Neill,et al.  A review of leakage detection methods for district heating networks , 2018 .

[6]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[7]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[8]  Michael Felsberg,et al.  Enhanced analysis of thermographic images for monitoring of district heat pipe networks , 2016, Pattern Recognit. Lett..

[9]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[10]  Maria E. Olsson Long-Term Thermal Performance of Polyurethane-Insulated District Heating Pipes , 2001 .

[11]  David G. Stork,et al.  Pattern Classification , 1973 .

[12]  Erfu Yang,et al.  UAV first view landmark localization with active reinforcement learning , 2019, Pattern Recognit. Lett..

[13]  Benny Bøhm,et al.  A Comparison of Different Methods for In-situ Determination of Heat Losses from District Heating Pipes , 1996 .

[14]  Panos M. Pardalos,et al.  k-Nearest Neighbor Classification , 2009 .

[15]  Bilal Alsalam,et al.  Autonomous UAVs wildlife detection using thermal imaging, predictive navigation and computer vision , 2016, 2016 IEEE Aerospace Conference.

[16]  Ola Friman,et al.  Methods for Large-Scale Monitoring of District Heating Systems Using Airborne Thermography , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[17]  S. Axelsson Thermal modeling for the estimation of energy losses from municipal heating networks using infrared thermography , 1988 .

[18]  Simo Puntanen Linear Regression Analysis: Theory and Computing by Xin Yan, Xiao Gang Su , 2010 .

[19]  Christian Riess,et al.  Automatic Classification of Defective Photovoltaic Module Cells in Electroluminescence Images , 2018, Solar Energy.

[20]  Morgan Fröling Environmental and Thermal Performance of District Heating Pipes , 2002 .

[21]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..