Autonomous underwater robot : vision and control

Autonomous underwater vehicles have been an important tool for many undersea applications including scientific, commercial, and military applications, such as exploring the ocean floor, studying marine life, and inspection and repairing underwater structures. Vision is an important resource that enable autonomous underwater vehicle to do several tasks. Vision is particularly useful for underwater navigation since it can provide accurate depth measurements at short ranges. This thesis is concerned with the development of a visually-guided autonomous underwater vehicle. The goals for this visually-guided robot are to be able to visually track and maintain a fixed position relative to a stationary target, and to visually track and swim after a dynamic target. These tasks, where vision is used to provide feedback to the controller, are usually called visual servo. The implementation of the system consists of the development of many modules, namely: the vehicle model and vehicle controller, the thruster model and thruster controller, and the vision system and visual servo controller. The developed vehicle model uses Euler parameters for attitude representation, and thus avoids singularities, that occurs with the use of conventional Euler angles, in the system’s kinematic equations. A computed torque controller is developed based on the knowledge of the system dynamics. The good performance of the developed computed torque controller is demonstrated through a simulation study. Thruster dynamics have been neglected in the development of the vehicle model and vehicle controller. For thrust control, a steady-state thruster model has been adopted. This thruster model is demonstrated to give good thrust estimates at steady-state as well as reasonably good thrust estimates during the transient response. The steady-state thruster model is hence used in the design and implementation of the thruster controller, as there are no raw thrust measurement data available. A nonlinear PI control using saturation type integrator has been proposed, in conjunction with the steady-state thrust model, for thrust control to overcome the integral-windup phenomenon. The resulting thrust control system shows a good performance in controlling the estimated thrust. The vision system consists of a pair of stereo cameras which, once calibrated, give accurate 3D information. Normalized cross-correlation target tracking has been developed to locate and track targets. The target position is estimated with information from the stereo cameras, and sent back to the vehicle control system. The integration of all subsystems provides visual servo control system. In the current implementation, some sensors have not yet been implemented into the system, which led to the use of a slightly modified control scheme (PI plus gravity control) instead of computed torque control. This controller receives only the visual position feedback and sensory attitude feedback. The result is a blend of a direct position-based visual servo structure for position control, and a dynamic look-andmove structure for orientation control. The direct position-based visual servo control in position control is an achievement for autonomous underwater vehicles research, since most underwater vehicles use some sort of sensory feedback other than vision for position control. The vehicle successfully performs visual servo with both stationary and moving targets. The vehicle can maintain a fixed distance to the stationary target as well as move around it. In chasing a moving target, the vehicle can visually track the target and move along with the target as it moves. In summary this thesis provides two major contributions: 1) a visual servo control system for autonomous underwater vehicle that can track and follow dynamic targets as well as keep stationary with fixed targets, and 2) a direct position-based visual servo control that uses only visual feedback for position control. Acknowledgements My two years at the Robotic System Labs will always be a wonderful experience. I have spent much of my time in the past two years in the Lab doing my first research degree in English. A lot of people have helped me trough the research. I would like to thank my supervisors David Wettergreen and Samer Abdallah, who introduced me to such a great project, Kambara the yellow submarine; who have been helping and guiding me through my research; who have been teaching and guiding me a lot in writing this thesis as well as other papers. Kambara will be an unforgettable project. I joined the group of submariners when Kambara was about one year old. It could not swim until it was almost three years old. We have spent a lot of time in get it up and running (swimming). Another thank you to my advisor Thomas Brinsmead for helping me finishing up this research and drafting my thesis. I cannot forget Peter Brown, our software engineer. Without his great effort, Kambara would still be a baby submarine that cannot swim. A big thank you to him. Thank you to our Lab leader, Alex Zelinsky, who has been waiting patiently for this project to come to the point where it is today. And thank you to everybody else in the lab who have been so kindly supportive: James Ashton who has always been a great sys. admin.; Jenni and Rita who support everyone in the lab; Chris, Matthew, Ian, Jordan, Sunil, and Terence who were once on the same yellow boat. Thank you to all my Thai friends in Canberra who have always been there when I needed company and friendship, in particular, P’Ying, Om, Muay, Tip, Tui, Pom, Chap, Praew, and N’Jayne. Lastly, to my parents and family, I would like to thank them for such a great support.

[1]  Michael Isard,et al.  Active Contours , 2000, Springer London.

[2]  Asgeir J. Sørensen,et al.  A New Method of Thruster Control in Positioning of Ships Based on Power Control , 1997 .

[3]  David S. Wettergreen,et al.  Development of Autonomous Underwater Vehicle towards Visual Servo Control , 2000 .

[4]  Alexander Zelinsky,et al.  Development of a visually-guided autonomous underwater vehicle , 1998, IEEE Oceanic Engineering Society. OCEANS'98. Conference Proceedings (Cat. No.98CH36259).

[5]  Dana R. Yoerger,et al.  Determination of the hydrodynamic parameters of an underwater vehicle during small scale, nonuniform, 1-dimensional translation , 1993, Proceedings of OCEANS '93.

[6]  Frank L. Lewis,et al.  Control of Robot Manipulators , 1993 .

[7]  M. Caccia,et al.  Modeling and identification of open-frame variable configuration unmanned underwater vehicles , 2000, IEEE Journal of Oceanic Engineering.

[8]  Emanuele Trucco,et al.  Uncalibrated vision for 3-D underwater applications , 1998, IEEE Oceanic Engineering Society. OCEANS'98. Conference Proceedings (Cat. No.98CH36259).

[9]  S. D. Fleischer,et al.  Station keeping of an ROV using vision technology , 1997, Oceans '97. MTS/IEEE Conference Proceedings.

[10]  Francis L. Merat,et al.  Introduction to robotics: Mechanics and control , 1987, IEEE J. Robotics Autom..

[11]  Gian Luca Foresti,et al.  A vision-based system for autonomous underwater vehicle navigation , 1998, IEEE Oceanic Engineering Society. OCEANS'98. Conference Proceedings (Cat. No.98CH36259).

[12]  Dana R. Yoerger,et al.  Preliminary experiments in model-based thruster control for underwater vehicle positioning , 1999 .

[13]  Thor I. Fossen,et al.  Adaptive control of nonlinear underwater robotic systems , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[14]  Meyer Nahon Determination of undersea vehicle hydrodynamic derivatives using the USAF Datcom , 1993, Proceedings of OCEANS '93.

[15]  Jean-Jacques E. Slotine,et al.  The influence of thruster dynamics on underwater vehicle behavior and their incorporation into control system design , 1990 .

[16]  Tamaki Ura,et al.  Autonomous target tracking by underwater robots based on vision , 1998, Proceedings of 1998 International Symposium on Underwater Technology.

[17]  H. C. Longuet-Higgins,et al.  A computer algorithm for reconstructing a scene from two projections , 1981, Nature.

[18]  Alexander Zelinsky,et al.  Preliminary experiments in visual servo control for autonomous underwater vehicle , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[19]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[20]  Yasuo Kuniyoshi,et al.  Robust real-time tracking on an active vision head , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.

[21]  A. J. Healey,et al.  Adaptive sliding mode control of autonomous underwater vehicles in the dive plane , 1990 .

[22]  Katsuhiko Ogata,et al.  Modern Control Engineering , 1970 .

[23]  Primo Zingaretti,et al.  Underwater imaging system to support ROV guidance , 1998, IEEE Oceanic Engineering Society. OCEANS'98. Conference Proceedings (Cat. No.98CH36259).

[24]  M.A. Grosenbaugh,et al.  An accurate four-quadrant nonlinear dynamical model for marine thrusters: theory and experimental validation , 2000, IEEE Journal of Oceanic Engineering.

[25]  David Wettergreen,et al.  Autonomous Guidance and Control for an Underwater Robotic Vehicle , 1999 .

[26]  Michael Isard,et al.  The CONDENSATION Algorithm - Conditional Density Propagation and Applications to Visual Tracking , 1996, NIPS.

[27]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[28]  Junku Yuh,et al.  On-Board Sensor-Based Adaptive Control of Small UUVS in Very Shallow Water , 1998 .

[29]  A. J. Healey,et al.  Model Based Predictive Control of AUVs for Station Keeping in a Shallow Water Wave Environment , 1998 .

[30]  Thor I. Fossen,et al.  Sliding control of MIMO nonlinear systems , 1991 .

[31]  Emanuele Trucco,et al.  Introductory techniques for 3-D computer vision , 1998 .

[32]  Junku Yuh,et al.  On‐board sensor‐based adaptive control of small UUVs in very shallow water* , 2000 .

[33]  Emanuele Trucco,et al.  Making good features track better , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[34]  A. J. Healey,et al.  Multivariable sliding mode control for autonomous diving and steering of unmanned underwater vehicles , 1993 .

[35]  R. L. Marks,et al.  Real-time video mosaicking of the ocean floor , 1994, Proceedings of IEEE Symposium on Autonomous Underwater Vehicle Technology (AUV'94).

[36]  R. L. Marks,et al.  Automatic visual station keeping of an underwater robot , 1994, Proceedings of OCEANS'94.

[37]  David Wettergreen,et al.  3-D Vision for an Autonomous Underwater Vehicle , 2000 .

[38]  William Lord,et al.  DC Servomotors-Modeling and Parameter Determination , 1977, IEEE Transactions on Industry Applications.

[39]  R. L. Marks,et al.  Automatic object tracking for an unmanned underwater vehicle using real-time image filtering and correlation , 1993, Proceedings of IEEE Systems Man and Cybernetics Conference - SMC.

[40]  Dana R. Yoerger,et al.  Development, comparison, and preliminary experimental validation of nonlinear dynamic thruster models , 1999 .

[41]  Dana R. Yoerger,et al.  Fine-Scale Three-Dimensional Mapping of a Deep-Sea Hydrothermal Vent Site Using the Jason ROV System , 2000, Int. J. Robotics Res..

[42]  Shahriar Negahdaripour,et al.  Direct estimation of motion from sea floor images for automatic station-keeping of submersible platforms , 1999 .

[43]  Emanuele Trucco,et al.  Robust feature tracking in underwater video sequences , 1998, IEEE Oceanic Engineering Society. OCEANS'98. Conference Proceedings (Cat. No.98CH36259).

[44]  Jean-Jacques E. Slotine,et al.  Robust trajectory control of underwater vehicles , 1985 .

[45]  Stephen M. Rock,et al.  Toward an improved understanding of thruster dynamics for underwater vehicles , 1994, Proceedings of IEEE Symposium on Autonomous Underwater Vehicle Technology (AUV'94).

[46]  Thor I. Fossen,et al.  Robust Adaptive Control of Underwater Vehicles: A Comparative Study , 1995 .

[47]  John N. Lygouras DC Thruster Controller Implementation with Integral Anti-wind up Compensator for Underwater ROV , 1999, J. Intell. Robotic Syst..

[48]  Stephen M. Rock,et al.  EXPERIMENTAL VALIDATION OF A REAL-TIME VISION SENSOR AND NAVIGATION SYSTEM FOR INTELLIGENT UNDERWATER VEHICLES , 1998 .

[49]  Dana R. Yoerger,et al.  Comparative experiments in the dynamics and model-based control of marine thrusters , 1995, 'Challenges of Our Changing Global Environment'. Conference Proceedings. OCEANS '95 MTS/IEEE.

[50]  Alexander Zelinsky,et al.  Robust Camera Calibration for an Autonomous Underwater Vehicle , 2000 .