A GCN-Based Method for Extracting Power Lines and Pylons From Airborne LiDAR Data

Extracting the power lines and pylons automatically and accurately from airborne LiDAR data is a critical step in inspecting the routine power line, especially in the remote mountainous areas. However, challenges arise in using existing methods to extract the targets from large scenarios of remote mountainous areas since the terrain is undulating, and the features are difficult to distinguish. In this article, to overcome these challenges, we propose a graph convolutional network (GCN)-based method to extract power lines and pylons from Airborne LiDAR point clouds. First, data augmentation and near-ground filtering methods are developed to overcome the problems of insufficient and imbalanced samples in the LiDAR data. Then, a GCN-based framework is proposed to extract the power lines and pylons, which consist of two main modules, i.e., the neighborhood dimension information (NDI) module and the neighborhood geometry information aggregation (NGIA) module. These two modules are designed to strengthen the model’s ability to portray local geometric details. Besides, an attention fusion module is investigated to further improve the NDI and NGIA features. Finally, a line structure constraint algorithm is proposed to identify individual power lines, where the power corridor is reconstructed using a polynomial-based algorithm. Numerical experiments are conducted based on two different power line scenarios acquired in mountainous areas. The results demonstrate the superior performances of the proposed method over several existing algorithms, where the $F_{1}$ score and quality of the power line are 99.3% and 98.6%, and the results of the pylon are 96% and 92.4%, respectively. The identification rate of power line identification is above 98%.

[1]  Juha Hyyppä,et al.  Power line mapping technique using all-terrain mobile laser scanning , 2019, Automation in Construction.

[2]  Silvio Savarese,et al.  3D Semantic Parsing of Large-Scale Indoor Spaces , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Juha Hyyppä,et al.  Fully-Automated Power Line Extraction from Airborne Laser Scanning Point Clouds in Forest Areas , 2014, Remote. Sens..

[4]  Robert Jenssen,et al.  Automatic autonomous vision-based power line inspection: A review of current status and the potential role of deep learning , 2018, International Journal of Electrical Power & Energy Systems.

[5]  Kai Li,et al.  Supervised Classification of Power Lines from Airborne LiDAR Data in Urban Areas , 2017, Remote. Sens..

[6]  Yin Zhou,et al.  VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[7]  Sheng Xu,et al.  Power Line Extraction From Mobile LiDAR Point Clouds , 2019, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[8]  In-So Kweon,et al.  AttentionNet: Aggregating Weak Directions for Accurate Object Detection , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[9]  Matthias Nießner,et al.  ScanNet: Richly-Annotated 3D Reconstructions of Indoor Scenes , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Fuxin Li,et al.  PointConv: Deep Convolutional Networks on 3D Point Clouds , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Yu Wang,et al.  Extraction of Urban Power Lines from Vehicle-Borne LiDAR Data , 2014, Remote. Sens..

[12]  Leonidas J. Guibas,et al.  PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Mohammed Bennamoun,et al.  Deep Learning for 3D Point Clouds: A Survey , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Manohar Yadav,et al.  Extraction of power lines using mobile LiDAR data of roadway environment , 2017 .

[15]  Xiaogang Wang,et al.  Residual Attention Network for Image Classification , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Yoonseok Jwa,et al.  AUTOMATIC 3D POWERLINE RECONSTRUCTION USING AIRBORNE LiDAR DATA , 2009 .

[17]  Rushikesh K. Joshi,et al.  High Level Event Ontology for Multiarea Power System , 2012, IEEE Transactions on Smart Grid.

[18]  Cyrill Stachniss,et al.  SemanticKITTI: A Dataset for Semantic Scene Understanding of LiDAR Sequences , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[19]  Marc Pollefeys,et al.  Semantic3D.net: A new Large-scale Point Cloud Classification Benchmark , 2017, ArXiv.

[20]  Bela Stantic,et al.  VOXEL-BASED EXTRACTION OF INDIVIDUAL PYLONS AND WIRES FROM LIDAR POINT CLOUD DATA , 2019, ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[21]  Cheng Wang,et al.  Learning sequential slice representation with an attention-embedding network for 3D shape recognition and retrieval in MLS point clouds , 2020 .

[22]  Ruofei Zhong,et al.  Joint Discriminative Dictionary and Classifier Learning for ALS Point Cloud Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Gernot Riegler,et al.  OctNet: Learning Deep 3D Representations at High Resolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Leonidas J. Guibas,et al.  PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space , 2017, NIPS.

[26]  Jie Yang,et al.  Multi-Scale and Multi-Task Deep Learning Framework for Automatic Road Extraction , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Jason J. Ford,et al.  Toward automated power line corridor monitoring using advanced aircraft control and multisource feature fusion , 2012, J. Field Robotics.

[28]  Xiao Xiang Zhu,et al.  Buildings Detection in VHR SAR Images Using Fully Convolution Neural Networks , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Hamid Hamraz,et al.  Deep learning for conifer/deciduous classification of airborne LiDAR 3D point clouds representing individual trees , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[30]  Wuming Zhang,et al.  An Easy-to-Use Airborne LiDAR Data Filtering Method Based on Cloth Simulation , 2016, Remote. Sens..

[31]  Juha Hyyppä,et al.  Remote sensing methods for power line corridor surveys , 2016 .

[32]  Xiaojun Shen,et al.  An automatic extraction algorithm of high voltage transmission lines from airborne LIDAR point cloud data , 2018 .

[33]  Qingquan Li,et al.  An Improved Method for Power-Line Reconstruction from Point Cloud Data , 2016, Remote. Sens..

[34]  Yue Wang,et al.  Dynamic Graph CNN for Learning on Point Clouds , 2018, ACM Trans. Graph..

[35]  Subhransu Maji,et al.  Multi-view Convolutional Neural Networks for 3D Shape Recognition , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[36]  Fan Zhang,et al.  Classification of airborne laser scanning data using JointBoost , 2015 .

[37]  G. Sohn,et al.  Point-based Classification of Power Line Corridor Scene Using Random Forests , 2013 .

[38]  Martial Hebert,et al.  Natural terrain classification using three‐dimensional ladar data for ground robot mobility , 2006, J. Field Robotics.

[39]  Xiao Xiang Zhu,et al.  Vehicle Instance Segmentation From Aerial Image and Video Using a Multitask Learning Residual Fully Convolutional Network , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[40]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[41]  Li Li,et al.  A Novel Octree-Based 3-D Fully Convolutional Neural Network for Point Cloud Classification in Road Environment , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[42]  Arun Kumar Sangaiah,et al.  Systematic Comparison of Power Line Classification Methods from ALS and MLS Point Cloud Data , 2018, Remote. Sens..

[43]  Cheng Wang,et al.  Learning high-level features by fusing multi-view representation of MLS point clouds for 3D object recognition in road environments , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[44]  P. Axelsson DEM Generation from Laser Scanner Data Using Adaptive TIN Models , 2000 .

[45]  Jinhai Cai,et al.  Evaluation of Aerial Remote Sensing Techniques for Vegetation Management in Power-Line Corridors , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[46]  Jaehoon Jung,et al.  Automated and efficient powerline extraction from laser scanning data using a voxel-based subsampling with hierarchical approach , 2020 .

[47]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[48]  Juntao Yang,et al.  Voxel-Based Extraction of Transmission Lines From Airborne LiDAR Point Cloud Data , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[49]  Jie Geng,et al.  SAR Image Classification via Deep Recurrent Encoding Neural Networks , 2018, IEEE Transactions on Geoscience and Remote Sensing.