Obstacle Distance Measurement Under Varying Illumination Conditions Based on Monocular Vision Using a Cable Inspection Robot

Obstacle distance measurement is one of the key technologies for autonomous navigation of high-voltage transmission line inspection robots. To address the robustness of obstacle distance measurement under varying illumination conditions, this article develops a research method that fuses image enhancement with robot monocular vision so that the robot can adapt to various levels of illumination running along the transmission line. During the inspection of high-voltage transmission lines in such an overexposed (excessively bright) environment, a specular highlight suppression method is proposed to suppress the specular reflections in an image; when scene illumination is insufficient, a robust low-light image enhancement method based on a tone mapping algorithm with weighted guided filtering is presented. Based on the monocular vision measurement principle, the error generation mechanism is analyzed through experiments, and we introduce the parameter modification mechanism. The two proposed image enhancement methods outperform other state-of-the-art enhancement algorithms in qualitative and quantitative analyses. The experimental results show that the measurement error is less than 3% for static distance measurements and less than 5% for dynamic distance measurements within 6 m. The proposed method can meet the requirements of high-accuracy positioning, real-time performance and strong robustness. This method greatly contributes to the sustainable development of inspection robots in the power industry.

[1]  Sebastian Bodenstedt,et al.  Generative adversarial networks for specular highlight removal in endoscopic images , 2018, Medical Imaging.

[2]  Shree K. Nayar,et al.  Separation of Reflection Components Using Color and Polarization , 1997, International Journal of Computer Vision.

[3]  Steven A. Shafer,et al.  Using color to separate reflection components , 1985 .

[4]  Joonki Paik,et al.  Spatially Adaptive Histogram Equalization for Single Image-Based Ghost-free High Dynamic Range Imaging , 2014 .

[5]  黄乐 Huang Le,et al.  Obstacle Identification Under Low-Light Conditions of Transmission Line Inspection Robot , 2018 .

[6]  Qingwu Li,et al.  Bionic Vision-Based Intelligent Power Line Inspection System , 2017, Comput. Math. Methods Medicine.

[7]  Zia-ur Rahman,et al.  A multiscale retinex for bridging the gap between color images and the human observation of scenes , 1997, IEEE Trans. Image Process..

[8]  Xiaochun Cao,et al.  Robust Separation of Reflection from Multiple Images , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Ke Shao,et al.  Recursive sliding mode control with adaptive disturbance observer for a linear motor positioner , 2021 .

[10]  Xiaojie Guo,et al.  LIME: A Method for Low-light IMage Enhancement , 2016, ACM Multimedia.

[11]  Katsushi Ikeuchi,et al.  Separating reflection components of textured surfaces using a single image , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Zia-ur Rahman,et al.  Properties and performance of a center/surround retinex , 1997, IEEE Trans. Image Process..

[13]  San Kim,et al.  Fault Diagnosis of Power Transmission Lines Using a UAV-Mounted Smart Inspection System , 2020, IEEE Access.

[14]  Jie Ma,et al.  A Pipeline Neural Network for Low-Light Image Enhancement , 2019, IEEE Access.

[15]  Narendra Ahuja,et al.  Real-Time Specular Highlight Removal Using Bilateral Filtering , 2010, ECCV.

[16]  Hui-Liang Shen,et al.  Real-time highlight removal using intensity ratio. , 2013, Applied optics.

[17]  Zhihong Man,et al.  Tracking Control of a Linear Motor Positioner Based on Barrier Function Adaptive Sliding Mode , 2021, IEEE Transactions on Industrial Informatics.

[18]  Guy Godin,et al.  Separation of diffuse and specular components of surface reflection by use of polarization and statistical analysis of images , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Jianfeng Huang,et al.  The Comprehensive Benefit Evaluation Model of Manual Inspection in Transmission Line , 2016 .

[20]  Hwang Soo Lee,et al.  Adaptive local tone mapping based on retinex for high dynamic range images , 2013, 2013 IEEE International Conference on Consumer Electronics (ICCE).

[21]  João Carlos Mendes Carvalho,et al.  Review and Latest Trends in Mobile Robots Used on Power Transmission Lines , 2013 .

[22]  Yu Li,et al.  LIME: Low-Light Image Enhancement via Illumination Map Estimation , 2017, IEEE Transactions on Image Processing.

[23]  Kun Zhou,et al.  Specular Highlight Removal in Facial Images , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Juha Hyyppä,et al.  Power line mapping technique using all-terrain mobile laser scanning , 2019, Automation in Construction.

[25]  Li Cheng,et al.  Obstacles detection and depth estimation from monocular vision for inspection robot of high voltage transmission line , 2017, Cluster Computing.

[26]  Sung-Jea Ko,et al.  Image Contrast Enhancement Based on a Multi-Cue Histogram , 2015 .

[27]  Masanobu Shimada,et al.  Forest cover maps of China in 2010 from multiple approaches and data sources: PALSAR, Landsat, MODIS, FRA, and NFI , 2015 .

[28]  Chunxia Xiao,et al.  Specular Highlight Removal for Real‐world Images , 2019, Comput. Graph. Forum.

[29]  Haiming Shen,et al.  Power transmission line inspection robots: A review, trends and challenges for future research , 2020 .

[30]  Delu Zeng,et al.  A fusion-based enhancing method for weakly illuminated images , 2016, Signal Process..

[31]  Wen Gao,et al.  A Bio-Inspired Multi-Exposure Fusion Framework for Low-light Image Enhancement , 2017, ArXiv.

[32]  Honggang Zhang,et al.  Chromaticity-based separation of reflection components in a single image , 2008, Pattern Recognit..

[33]  Takayuki Okatani,et al.  Separation of Reflection Components by Sparse Non-negative Matrix Factorization , 2014, ACCV.

[34]  Gongping Wu,et al.  A Novel Method to Reconstruct Overhead High-Voltage Power Lines Using Cable Inspection Robot LiDAR Data , 2017, Remote. Sens..

[35]  Jia Xu,et al.  Learning to See in the Dark , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[36]  Joonki Paik,et al.  Variational framework for low-light image enhancement using optimal transmission map and combined ℓ2 and ℓ2-minimization , 2017, Signal Process. Image Commun..

[37]  Stephen Marshall,et al.  Removal of specular reflections from image sequences using feature correspondences , 2017, Machine Vision and Applications.

[38]  Yan Ma,et al.  Visual Meterstick: Preceding Vehicle Ranging Using Monocular Vision Based on the Fitting Method , 2019, Symmetry.

[39]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[40]  Shiqian Wu,et al.  Weighted Guided Image Filtering , 2016, IEEE Transactions on Image Processing.

[41]  Qi Cao,et al.  Obstacle distance measurement based on binocular vision for high-voltage transmission lines using a cable inspection robot , 2020, Science progress.