Development of an Image Processing Module for Autonomous Underwater Vehicles through Integration of Visual Recognition with Stereoscopic Image Reconstruction

This study investigated the development of visual recognition and stereoscopic imaging technology, applying them to the construction of an image processing system for autonomous underwater vehicles (AUVs). For the proposed visual recognition technology, a Hough transform was combined with an optical flow algorithm to detect the linear features and movement speeds of dynamic images; the proposed stereoscopic imaging technique employed a Harris corner detector to estimate the distance of the target. A physical AUV was constructed with a wide-angle lens camera and a binocular vision device mounted on the bow to provide image input. Subsequently, a simulation environment was established in Simscape Multibody and used to control the post-driver system of the stern, which contained horizontal and vertical rudder planes as well as the propeller. In static testing at National Cheng Kung University, physical targets were placed in a stability water tank; the study compared the analysis results obtained from various brightness and turbidity conditions in out-of-water and underwater environments. Finally, the dynamic testing results were combined with a fuzzy controller to output the real-time responses of the vehicle regarding the angles, rates of the rudder planes, and the propeller revolution speeds at various distances.

[1]  Sandro Barone,et al.  Experimentation of structured light and stereo vision for underwater 3D reconstruction , 2011 .

[2]  Robert Ivor John,et al.  Fuzzy Logic Control System for Autonomous Sailboats , 2007, 2007 IEEE International Fuzzy Systems Conference.

[3]  Takeshi Yamakawa Electronic circuits dedicated to fuzzy logic controller , 2011, Sci. Iran..

[4]  Lionel Lapierre,et al.  Nonlinear guidance and fuzzy control for three-dimensional path following of an underactuated autonomous underwater vehicle , 2017 .

[5]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[6]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Tamaki Ura,et al.  Vision based autonomous underwater vehicle navigation: underwater cable tracking , 1997, Oceans '97. MTS/IEEE Conference Proceedings.

[8]  Juan Manuel Sáez,et al.  Entropy Minimization SLAM Using Stereo Vision , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[9]  Younggun Cho,et al.  Channel invariant online visibility enhancement for visual SLAM in a turbid environment , 2018, J. Field Robotics.

[10]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[11]  Peng Yao,et al.  Three-Dimensional Path Planning for AUV Based on Interfered Fluid Dynamical System Under Ocean Current (June 2018) , 2018, IEEE Access.

[12]  Dana H. Ballard,et al.  Generalizing the Hough transform to detect arbitrary shapes , 1981, Pattern Recognit..

[13]  Yonina C. Eldar,et al.  A probabilistic Hough transform , 1991, Pattern Recognit..

[14]  Shahriar Negahdaripour,et al.  Direct estimation of motion from sea floor images for automatic station-keeping of submersible platforms , 1999 .

[15]  Michael Kaess,et al.  Through-Water Stereo SLAM With Refraction Correction for AUV Localization , 2019, IEEE Robotics and Automation Letters.

[16]  Subhrajit Bhattacharya,et al.  Optimal Path Planning in Time-Varying Flows Using Adaptive Discretization , 2018, IEEE Robotics and Automation Letters.

[17]  Yu-Hsien Lin,et al.  Applying the stereo-vision detection technique to the development of underwater inspection task with PSO-based dynamic routing algorithm for autonomous underwater vehicles , 2017 .

[18]  Lei Yang,et al.  Based on soft-threshold wavelet de-noising combining with Prewitt operator edge detection algorithm , 2010, 2010 2nd International Conference on Education Technology and Computer.

[19]  Yu-Hsien Lin,et al.  The initial study of LLS-based binocular stereo-vision system on underwater 3D image reconstruction in the laboratory , 2017 .

[20]  S. Weber A general concept of fuzzy connectives, negations and implications based on t-norms and t-conorms , 1983 .

[21]  Timothy Prestero,et al.  Verification of a six-degree of freedom simulation model for the REMUS autonomous underwater vehicle , 2001 .

[22]  Andrew Hogue,et al.  Underwater 3D SLAM through entropy minimization , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[23]  R. Dony,et al.  Edge detection on color images using RGB vector angles , 1999, Engineering Solutions for the Next Millennium. 1999 IEEE Canadian Conference on Electrical and Computer Engineering (Cat. No.99TH8411).

[24]  Lei Wan,et al.  Object detection and tracking method of AUV based on acoustic vision , 2012 .

[25]  Shuo Zhang,et al.  A fuzzy-PID method to improve the depth control of AUV , 2013, 2013 IEEE International Conference on Mechatronics and Automation.

[26]  Stefano Caselli,et al.  Integration of a stereo vision system into an autonomous underwater vehicle for pipe manipulation tasks , 2017, Comput. Electr. Eng..

[27]  Jun-Ho Oh,et al.  Experiments on vision guided docking of an autonomous underwater vehicle using one camera , 2009 .

[28]  Tamaki Ura,et al.  Vision-based underwater cable detection and following using AUVs , 2002, OCEANS '02 MTS/IEEE.

[29]  Alexander Zelinsky,et al.  Development of a visually-guided autonomous underwater vehicle , 1998, IEEE Oceanic Engineering Society. OCEANS'98. Conference Proceedings (Cat. No.98CH36259).

[30]  Josef Kittler,et al.  A survey of the hough transform , 1988, Comput. Vis. Graph. Image Process..

[31]  Emanuele Garone,et al.  Constrained Control of UAVs in Geofencing Applications , 2018, 2018 26th Mediterranean Conference on Control and Automation (MED).

[32]  N. Kanopoulos,et al.  Design of an image edge detection filter using the Sobel operator , 1988, IEEE J. Solid State Circuits.

[33]  Simon X. Yang,et al.  An Optimized Fuzzy Control Algorithm for Three-Dimensional AUV Path Planning , 2018, Int. J. Fuzzy Syst..

[34]  Hong Huo,et al.  Camera calibration method with checkerboard pattern under complicated illumination , 2018, J. Electronic Imaging.

[35]  D.B. Edwards,et al.  AUV navigation in the presence of a magnetic disturbance with an extended Kalman filter , 2010, OCEANS'10 IEEE SYDNEY.

[36]  Gian Luca Foresti,et al.  Autonomous underwater vehicle guidance by integrating neural networks and geometric reasoning , 1999, Int. J. Imaging Syst. Technol..

[37]  Franz S. Hover,et al.  Multibeam Data Processing for Underwater Mapping , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).