Improving the energy efficiency of autonomous underwater vehicles by learning to model disturbances

Energy efficiency is one of the main challenges for long-term autonomy of AUVs (Autonomous Underwater Vehicles). We propose a novel approach for improving the energy efficiency of AUV controllers based on the ability to learn which external disturbances can safely be ignored. The proposed learning approach uses adaptive oscillators that are able to learn online the frequency, amplitude and phase of zero-mean periodic external disturbances. Such disturbances occur naturally in open water due to waves, currents, and gravity, but also can be caused by the dynamics and hydrodynamics of the AUV itself. We formulate the theoretical basis of the approach, and demonstrate its abilities on a number of input signals. Further experimental evaluation is conducted using a dynamic model of the Girona 500 AUV in simulation on two important underwater scenarios: hovering and trajectory tracking. The proposed approach shows significant energy-saving capabilities while at the same time maintaining high controller gains. The approach is generic and applicable not only for AUV control, but also for other type of control where periodic disturbances exist and could be accounted for by the controller.

[1]  F. Hackenberger Balancing Central Pattern Generator based Humanoid Robot Gait using Reinforcement Learning , 2007 .

[2]  Konstantinos Kyriakopoulos,et al.  Persistent Autonomy: the Challenges of the PANDORA Project , 2012 .

[3]  Jürgen Kurths,et al.  Synchronization - A Universal Concept in Nonlinear Sciences , 2001, Cambridge Nonlinear Science Series.

[4]  A. Ijspeert,et al.  Frequency Analysis with coupled nonlinear Oscillators , 2008 .

[5]  A. Ijspeert,et al.  Dynamic hebbian learning in adaptive frequency oscillators , 2006 .

[6]  Ludovic Righetti,et al.  Programmable central pattern generators: an application to biped locomotion control , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[7]  Darwin G. Caldwell,et al.  On-line identification of autonomous underwater vehicles through global derivative-free optimization , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Darwin G. Caldwell,et al.  Towards improved AUV control through learning of periodic signals , 2013, 2013 OCEANS - San Diego.

[9]  Darwin G. Caldwell,et al.  Autonomous robotic valve turning: A hierarchical learning approach , 2013, 2013 IEEE International Conference on Robotics and Automation.

[10]  A. Ijspeert,et al.  From Dynamic Hebbian Learning for Oscillators to Adaptive Central Pattern Generators , 2005 .

[11]  Aude Billard,et al.  Proceedings of the Eighth International Conference on the Simulation of Adaptive Behavior, From Animals to Animats 8 (SAB 2004) , 2004 .

[12]  Scott Willcox,et al.  The Wave Glider: A persistent platform for ocean science , 2010, OCEANS'10 IEEE SYDNEY.

[13]  Joshua Grady Graver,et al.  UNDERWATER GLIDERS: DYNAMICS, CONTROL AND DESIGN , 2005 .

[14]  Nicola Vitiello,et al.  Oscillator-based walking assistance: A model-free approach , 2011, 2011 IEEE International Conference on Rehabilitation Robotics.

[15]  Aude Billard,et al.  A Simple, Adaptive Locomotion Toy-System , 2004 .