Rail Track Detection and Projection-Based 3D Modeling from UAV Point Cloud

The expansion of the railway industry has increased the demand for the three-dimensional modeling of railway tracks. Due to the increasing development of UAV technology and its application advantages, in this research, the detection and 3D modeling of rail tracks are investigated using dense point clouds obtained from UAV images. Accordingly, a projection-based approach based on the overall direction of the rail track is proposed in order to generate a 3D model of the railway. In order to extract the railway lines, the height jump of points is evaluated in the neighborhood to select the candidate points of rail tracks. Then, using the RANSAC algorithm, line fitting on these candidate points is performed, and the final points related to the rail are identified. In the next step, the pre-specified rail piece model is fitted to the rail points through a projection-based process, and the orientation parameters of the model are determined. These parameters are later improved by fitting the Fourier curve, and finally a continuous 3D model for all of the rail tracks is created. The geometric distance of the final model from rail points is calculated in order to evaluate the modeling accuracy. Moreover, the performance of the proposed method is compared with another approach. A median distance of about 3 cm between the produced model and corresponding point cloud proves the high quality of the proposed 3D modeling algorithm in this study.

[1]  Konrad Schindler,et al.  A model-based method for building reconstruction , 2003, First IEEE International Workshop on Higher-Level Knowledge in 3D Modeling and Motion Analysis, 2003. HLK 2003..

[2]  Airong Chen,et al.  Three-Dimensional Reconstruction of Structural Surface Model of Heritage Bridges Using UAV-Based Photogrammetric Point Clouds , 2019, Remote. Sens..

[3]  Mostafa Arastounia.  An Enhanced Algorithm for Concurrent Recognition of Rail Tracks and Power Cables from Terrestrial and Airborne LiDAR Point Clouds , 2017 .

[4]  Andrew Zisserman,et al.  MLESAC: A New Robust Estimator with Application to Estimating Image Geometry , 2000, Comput. Vis. Image Underst..

[5]  Aleksandar Miltenović,et al.  INTELLIGENT MACHINE VISION BASED RAILWAY INFRASTRUCTURE INSPECTION AND MONITORING USING UAV , 2019 .

[6]  Francesco Carlo Nex,et al.  UAV-Based Structural Damage Mapping: A Review , 2019, ISPRS Int. J. Geo Inf..

[7]  M. Westoby,et al.  ‘Structure-from-Motion’ photogrammetry: A low-cost, effective tool for geoscience applications , 2012 .

[8]  Yoonseok Jwa,et al.  KALMAN FILTER BASED RAILWAY TRACKING FROM MOBILE LIDAR DATA , 2015 .

[9]  Archana Singh,et al.  Vision based rail track extraction and monitoring through drone imagery , 2017, ICT Express.

[10]  Peter Reinartz,et al.  Building Reconstruction Using DSM and Orthorectified Images , 2013, Remote. Sens..

[11]  David H. Douglas,et al.  ALGORITHMS FOR THE REDUCTION OF THE NUMBER OF POINTS REQUIRED TO REPRESENT A DIGITIZED LINE OR ITS CARICATURE , 1973 .

[12]  Scarlett Liu,et al.  A review of applications of visual inspection technology based on image processing in the railway industry , 2019, Transportation Safety and Environment.

[13]  Luis Fonseca,et al.  Video based system for railroad collision warning , 2012, 2012 IEEE International Carnahan Conference on Security Technology (ICCST).

[14]  Jan Dirk Wegner,et al.  Contour Detection in Unstructured 3D Point Clouds , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Zhongli Wang,et al.  Geometry constraints-based visual rail track extraction , 2016, 2016 12th World Congress on Intelligent Control and Automation (WCICA).

[16]  Mehdi Mokhtarzade,et al.  Window Detection from UAS-Derived Photogrammetric Point Cloud Employing Density-Based Filtering and Perceptual Organization , 2018, Remote. Sens..

[17]  S. J. Oude Elberink,et al.  RAIL TRACK DETECTION AND MODELLING IN MOBILE LASER SCANNER DATA , 2013 .

[18]  Robert Hecht,et al.  Data fusion of extremely high resolution aerial imagery and LiDAR data for automated railroad centre line reconstruction , 2011 .

[19]  Majidreza Nazem,et al.  A Review on Existing Sensors and Devices for Inspecting Railway Infrastructure , 2019, Jurnal Kejuruteraan.

[20]  Juha Hyyppä,et al.  The Use of Airborne and Mobile Laser Scanning for Modeling Railway Environments in 3D , 2014, Remote. Sens..

[21]  I. Dowman,et al.  Data fusion of high-resolution satellite imagery and LiDAR data for automatic building extraction * , 2007 .

[22]  Peter Freere,et al.  The effective use of the exhaustive search block matching algorithm in railway line tracking , 2017, 2017 IEEE AFRICON.

[23]  Hao Wu,et al.  Real time railway extraction by angle alignment measure , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[24]  Mostafa Arastounia,et al.  Automated Recognition of Railroad Infrastructure in Rural Areas from LIDAR Data , 2015, Remote. Sens..

[25]  F. Alidoost,et al.  Comparison of Uas-Based Photogrammetry Software for 3d Point Cloud Generation: a Survey Over a Historical Site , 2017 .

[26]  Levente Tamas,et al.  Railway track following with the AR.Drone using vanishing point detection , 2014, 2014 IEEE International Conference on Automation, Quality and Testing, Robotics.

[27]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[28]  Yong Shi,et al.  Efficient railway tracks detection and turnouts recognition method using HOG features , 2012, Neural Computing and Applications.

[29]  Liming Li,et al.  Railway track gauge inspection method based on computer vision , 2012, 2012 IEEE International Conference on Mechatronics and Automation.

[30]  Mostafa Arastounia,et al.  Application of Template Matching for Improving Classification of Urban Railroad Point Clouds , 2016, Sensors.

[31]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[32]  Salvador Senent,et al.  Structure from Motion photogrammetry to characterize underground rock masses: Experiences from two real tunnels , 2019, Tunnelling and Underground Space Technology.