Automated Pipe Defect Detection and Categorization Using Camera/Laser-Based Profiler and Artificial Neural Network

Closed-circuit television (CCTV) is currently used in many inspection applications, such as the inspection of nonaccessible pipe surfaces. This human-oriented approach based on offline analysis of the raw images is highly subjective and prone to error because of the exorbitant amount of data to be assessed. Laser profilers have been recently proposed to project well-defined light patterns, improving the illumination of standard CCTV systems as well as enhancing the capability of automating the assessment process. This research shows that positional (geometrical) as well as intensity information, related to potential defects, can be extracted from the acquired laser projections. While most researchers focus on the analysis of positional information obtained from the acquired profiler signals, here the intensity information contained within the reflected light is also exploited for the purpose of defect classification and visualization. This paper describes novel strategies created for the automation of defect classification in tubular structures and explores new methods to fuse intensity and positional information, achieving improved multivariable defect classification. The acquired camera/laser images are processed in order to extract signal information for the purpose of visualization and map creation for further assessment. Then, a two-stage approach based on image processing and artificial neural networks is used to classify the images. First, a binary classifier identifies defective pipe sections, and then in a second stage, the defects are classified into different types, such as holes, cracks, and protruding obstacles. Experimental results are provided. Note to Practitioners-The method presented in this paper aims to automate the inspection of nonaccessible pipe surfaces. The method was thought to be employed in the inspection of sewers; however, it could be used in many other industrial applications and could also be extended to other shapes rather than tubular structures. A laser ring profiler, consisting, for instance, of a laser diode and a ring projector, can be easily integrated into existing closed-circuit television systems. The proposed algorithm identifies defective areas and categorizes the types of defects, analyzing the successive recorded camera images that will contain the reflected ring of light. The algorithm, that can be used online, makes use of the deformation of the reflected laser ring together with its changes in intensity. The fact of combining the two kinds of data using artificial-intelligent algorithms makes the method robust enough to work in harsh environments

[1]  Sheng-Luen Chung,et al.  Failure diagnosis: a case study on modeling and analysis by Petri nets , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[2]  Osama Moselhi,et al.  Classification of Defects in Sewer Pipes Using Neural Networks , 2000 .

[3]  S. Hyakin,et al.  Neural Networks: A Comprehensive Foundation , 1994 .

[4]  Toshimitsu Ushio,et al.  Fault detection based on Petri net models with faulty behaviors , 1998, SMC'98 Conference Proceedings. 1998 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.98CH36218).

[5]  Dimitri Lefebvre,et al.  Firing and enabling sequences estimation for timed Petri nets , 2001, IEEE Trans. Syst. Man Cybern. Part A.

[6]  Antonio Ramírez-Treviño,et al.  Diagnosability of discrete event systems: a Petri net based approach , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[7]  Alessandro Giua,et al.  Observability of place/transition nets , 2002, IEEE Trans. Autom. Control..

[8]  Martin Fodslette Møller,et al.  A scaled conjugate gradient algorithm for fast supervised learning , 1993, Neural Networks.

[9]  Kaspar Althoefer,et al.  Automated sewer inspection using image processing and a neural classifier , 2002, Proceedings of the 2002 International Joint Conference on Neural Networks. IJCNN'02 (Cat. No.02CH37290).

[10]  Kunihiko Hiraishi,et al.  Analysis and control of discrete event systems represented by petri nets , 1988 .

[11]  Helge-Björn Kuntze,et al.  Experiences with the development of a robot for smart multisensoric pipe inspection , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[12]  Kaspar Althoefer,et al.  State of the art in sensor technologies for sewer inspection , 2002 .

[13]  L.D. Seneviratne,et al.  Laser profiler model for robot-based pipe inspection , 2004, Proceedings World Automation Congress, 2004..

[14]  Dimitri Lefebvre,et al.  Structural sensitivity for the conflicts analysis in Petri nets , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[15]  Kaspar Althoefer,et al.  Pipe inspection using a laser-based transducer and automated analysis techniques , 2003 .

[16]  John Mashford,et al.  PIRAT—A System for Quantitative Sewer Pipe Assessment , 2000, Int. J. Robotics Res..

[17]  Fakhri Karray,et al.  Classification of underground pipe scanned images using feature extraction and neuro-fuzzy algorithm , 2002, IEEE Trans. Neural Networks.

[18]  Kaspar Althoefer,et al.  Experiments using a laser-based transducer and automated analysis techniques for pipe inspection , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[19]  Kaspar Althoefer,et al.  Automated pipe inspection using ANN and laser data fusion , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[20]  Joachim Hertzberg,et al.  Towards autonomous sewer robots: the MAKRO project , 1999 .