Detection of morphology defects in pipeline based on 3D active stereo omnidirectional vision sensor

There are many kinds of defects in pipes, which are difficult to detect with a low degree of automation. In this work, a novel omnidirectional vision inspection system for detection of the morphology defects is presented. An active stereo omnidirectional vision sensor is designed to obtain the texture and depth information of the inner wall of the pipeline in real time. The camera motion is estimated and the space location information of the laser points are calculated accordingly. Then, the faster region proposal convolutional neural network (Faster R-CNN) is applied to train a detection network on their image database of pipe defects. Experimental results demonstrate that system can measure and reconstruct the 3D space of pipe with high quality and the retrained Faster R-CNN achieves fine detection results in terms of both speed and accuracy.

[1]  Juho Kannala,et al.  Measuring and modelling sewer pipes from video , 2007, Machine Vision and Applications.

[2]  Osama Moselhi,et al.  Automated detection of surface defects in water and sewer pipes , 1999 .

[3]  Pei Liu,et al.  Feature Extraction of Sewer Pipe Defects Using Wavelet Transform and Co-Occurrence Matrix , 2011, Int. J. Wavelets Multiresolution Inf. Process..

[4]  Soo-Yeong Yi,et al.  Real-time omni-directional distance measurement with active panoramic vision , 2007 .

[5]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Roland Siegwart,et al.  A Toolbox for Easily Calibrating Omnidirectional Cameras , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  H. Ogi,et al.  An SH-wave EMAT technique for gas pipeline inspection , 1999 .

[8]  Atsushi Yamashita,et al.  3-D Shape Reconstruction of Pipe with Omni-Directional Laser and Omni-Directional Camera , 2009 .

[9]  Tomás Pajdla,et al.  Estimation of omnidirectional camera model from epipolar geometry , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[10]  Ming-Der Yang,et al.  Systematic image quality assessment for sewer inspection , 2011, Expert Syst. Appl..

[11]  Qing Wang,et al.  Design of Vertically Aligned Binocular Omnistereo Vision Sensor , 2010, EURASIP J. Image Video Process..

[12]  Yasushi Yagi,et al.  Obstacle detection with omnidirectional image sensor HyperOmni Vision , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[13]  Ming-Der Yang,et al.  Automated diagnosis of sewer pipe defects based on machine learning approaches , 2008, Expert Syst. Appl..

[14]  Kaspar Althoefer,et al.  Automated Pipe Defect Detection and Categorization Using Camera/Laser-Based Profiler and Artificial Neural Network , 2007, IEEE Transactions on Automation Science and Engineering.

[15]  Li Jiang-xiong New inner surface profile sensor for mini-diameter pipes , 2006 .

[16]  Wang Jianlin Optoelectronic inspection of in-pipe surfaces , 2008 .