Vision-Based Corrosion Detection Assisted by a Micro-Aerial Vehicle in a Vessel Inspection Application

Vessel maintenance requires periodic visual inspection of the hull in order to detect typical defective situations of steel structures such as, among others, coating breakdown and corrosion. These inspections are typically performed by well-trained surveyors at great cost because of the need for providing access means (e.g., scaffolding and/or cherry pickers) that allow the inspector to be at arm’s reach from the structure under inspection. This paper describes a defect detection approach comprising a micro-aerial vehicle which is used to collect images from the surfaces under inspection, particularly focusing on remote areas where the surveyor has no visual access, and a coating breakdown/corrosion detector based on a three-layer feed-forward artificial neural network. As it is discussed in the paper, the success of the inspection process depends not only on the defect detection software but also on a number of assistance functions provided by the control architecture of the aerial platform, whose aim is to improve picture quality. Both aspects of the work are described along the different sections of the paper, as well as the classification performance attained.

[1]  Roland Siegwart,et al.  Towards Autonomous Indoor Micro VTOL , 2005, Auton. Robots.

[2]  Malik Yousef,et al.  One-class document classification via Neural Networks , 2007, Neurocomputing.

[3]  Gordon Cheng,et al.  Supervised Autonomy: A Framework for Human-Robot Systems Development , 2001, Auton. Robots.

[4]  Yoshihiko Hamamoto,et al.  A Method for Crack Detection on a Concrete Structure , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[5]  Massimo Caccia,et al.  First steps towards a roboticized visual inspection system for vessels , 2010, 2010 IEEE 15th Conference on Emerging Technologies & Factory Automation (ETFA 2010).

[6]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[7]  Ronald C. Arkin,et al.  An Behavior-based Robotics , 1998 .

[8]  Gerd Hirzinger,et al.  Energy-efficient Autonomous Four-rotor Flying Robot Controlled at 1 kHz , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[9]  Shujian Xu,et al.  A new approach to estimate fractal dimensions of corrosion images , 2006, Pattern Recognit. Lett..

[10]  Dario Floreano,et al.  Quadrotor Using Minimal Sensing For Autonomous Indoor Flight , 2007 .

[11]  Wolfram Burgard,et al.  A Fully Autonomous Indoor Quadrotor , 2012, IEEE Transactions on Robotics.

[12]  Klaus-Robert Müller,et al.  Efficient BackProp , 2012, Neural Networks: Tricks of the Trade.

[13]  Shuji Hashimoto,et al.  Fast crack detection method for large-size concrete surface images using percolation-based image processing , 2010, Machine Vision and Applications.

[14]  Ruiyu Liang,et al.  The system of copper strips surface defects inspection based on intelligent fusion , 2008, 2008 IEEE International Conference on Automation and Logistics.

[15]  Rami Alnaqeib,et al.  Towards Corrosion Detection System , 2010 .

[16]  Voicu Groza,et al.  Feature-Based Neural Network Approach for Oscillometric Blood Pressure Estimation , 2011, IEEE Transactions on Instrumentation and Measurement.

[17]  Anthony H. Dekker,et al.  Kohonen neural networks for optimal colour quantization , 1994 .

[18]  Massimo Satler,et al.  Towards an autonomous flying robot for inspections in open and constrained spaces , 2014, 2014 IEEE 11th International Multi-Conference on Systems, Signals & Devices (SSD14).

[19]  B. Ripley,et al.  Pattern Recognition , 1968, Nature.

[20]  Atif Bin Mansoor,et al.  A New Approach to Aircraft Surface Inspection Based on Directional Energies of Texture , 2010, 2010 20th International Conference on Pattern Recognition.

[21]  Majid Mirmehdi,et al.  Ceramic tile inspection for colour and structural defects , 1995 .

[22]  Gang Ji,et al.  The Corroded Defect Rating System of Coating Material Based on Computer Vision , 2012, Trans. Edutainment.

[23]  Gregg Podnar,et al.  Robotic assistants for aircraft inspectors , 1998 .

[24]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[25]  K. Shadan,et al.  Available online: , 2012 .

[26]  Alberto Ortiz,et al.  Visual Inspection of Vessels by Means of a Micro-Aerial Vehicle: An Artificial Neural Network Approach for Corrosion Detection , 2015, ROBOT.

[27]  Frank Kirchner,et al.  A Robot Application for Marine Vessel Inspection , 2014, J. Field Robotics.

[28]  Jizhong Xiao,et al.  An open-source navigation system for micro aerial vehicles , 2013, Auton. Robots.

[29]  Gabriel Oliver,et al.  On the use of the overlapping area matrix for image segmentation evaluation: A survey and new performance measures , 2006, Pattern Recognit. Lett..

[30]  Roland Siegwart,et al.  Visual industrial inspection using aerial robots , 2014, Proceedings of the 2014 3rd International Conference on Applied Robotics for the Power Industry.

[31]  Christian Igel,et al.  Empirical evaluation of the improved Rprop learning algorithms , 2003, Neurocomputing.

[32]  Kotaro Hirasawa,et al.  Genetic algorithm optimization of a convolutional neural network for autonomous crack detection , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[33]  José Martínez-Aroza,et al.  A measure of quality for evaluating methods of segmentation and edge detection , 2001, Pattern Recognit..

[34]  Chun-Lung Chang,et al.  An intelligent defect inspection technique for color filter , 2005, IEEE International Conference on Mechatronics, 2005. ICM '05..

[35]  S. F. Masri,et al.  Effect of Color Space, Color Channels, and Sub-Image Block Size on the Performance of Wavelet-Based Texture Analysis Algorithms: An Application to Corrosion Detection on Steel Structures , 2013 .

[36]  Michael Gervautz,et al.  A simple method for color quantization: octree quantization , 1990 .

[37]  Gerasimos Theotokatos,et al.  Inspection capabilities for enhanced ship safety , 2015 .

[38]  Bernard Widrow,et al.  Improving the learning speed of 2-layer neural networks by choosing initial values of the adaptive weights , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[39]  Alberto Ortiz,et al.  A probabilistic approach for defect detection based on saliency mechanisms , 2014, Proceedings of the 2014 IEEE Emerging Technology and Factory Automation (ETFA).

[40]  Hiroshi Tokutake,et al.  Navigation of Small and Lightweight Helicopter , 2005 .

[41]  Daniel Thalmann,et al.  New Trends in Computer Graphics: Proceedings of Cg International 88 , 1988 .

[42]  Sergei Vassilvitskii,et al.  k-means++: the advantages of careful seeding , 2007, SODA '07.

[43]  Paul S. Heckbert Color image quantization for frame buffer display , 1982, SIGGRAPH.

[44]  Peter I. Corke,et al.  Inspection of pole-like structures using a vision-controlled VTOL UAV and shared autonomy , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[45]  Andreas Zell,et al.  Automatic Take Off, Tracking and Landing of a Miniature UAV on a Moving Carrier Vehicle , 2011, J. Intell. Robotic Syst..

[46]  Girish Chowdhary,et al.  GPS‐denied Indoor and Outdoor Monocular Vision Aided Navigation and Control of Unmanned Aircraft , 2013, J. Field Robotics.

[47]  Alberto Ortiz,et al.  Semi-autonomous visual inspection of vessels assisted by an unmanned Micro Aerial Vehicle , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[48]  Marc Pollefeys,et al.  Vision-based autonomous mapping and exploration using a quadrotor MAV , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[49]  Helen C. Shen,et al.  Texture inspection for defects using neural networks and support vector machines , 2002, Proceedings. International Conference on Image Processing.

[50]  João Rogério Caldas Pinto,et al.  NN Automated Defect Detection Based on Optimized Thresholding , 2006, ICIAR.

[51]  L. Marconi,et al.  Applying aerial robotics for inspections of power and petrochemical facilities , 2012, 2012 2nd International Conference on Applied Robotics for the Power Industry (CARPI).

[52]  Alberto Ortiz,et al.  A Micro-Aerial platform for vessel visual inspection based on supervised autonomy , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[53]  Bernard C. Jiang,et al.  Logistic regression tree applied to classify PCB golden finger defects , 2004 .

[54]  Michael T. Orchard,et al.  Color quantization of images , 1991, IEEE Trans. Signal Process..

[55]  Tongqing Wang,et al.  Anisotropic clustering on surfaces for crack extraction , 2015, Machine Vision and Applications.

[56]  Toshiyuki Amano Correlation Based Image Defect Detection , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[57]  Roland Siegwart,et al.  MAV navigation through indoor corridors using optical flow , 2010, 2010 IEEE International Conference on Robotics and Automation.

[58]  Marc Pollefeys,et al.  PIXHAWK: A micro aerial vehicle design for autonomous flight using onboard computer vision , 2012, Auton. Robots.

[59]  Nicholas Roy,et al.  RANGE - robust autonomous navigation in GPS-denied environments , 2010, 2010 IEEE International Conference on Robotics and Automation.

[60]  Yi Lu Murphey,et al.  An intelligent real-time vision system for surface defect detection , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[61]  Daniel Cremers,et al.  Scale-aware navigation of a low-cost quadrocopter with a monocular camera , 2014, Robotics Auton. Syst..

[62]  Wolfram Burgard,et al.  Improved Techniques for Grid Mapping With Rao-Blackwellized Particle Filters , 2007, IEEE Transactions on Robotics.

[63]  J. van Leeuwen,et al.  Neural Networks: Tricks of the Trade , 2002, Lecture Notes in Computer Science.

[64]  R. Siegwart,et al.  Aerial service robots for visual inspection of thermal power plant boiler systems , 2012, 2012 2nd International Conference on Applied Robotics for the Power Industry (CARPI).