Results from the Robocademy ITN: Autonomy, Disturbance Rejection and Perception for Advanced Marine Robotics

Marine and Underwater resources are important part of the economy of many countries. This requires significant financial resources into their construction and maintentance. Robotics is expected to fill this void, by automating and/or removing humans from hostile environments in order to easily perform maintenance tasks. The Robocademy Marie Sklodowska-Curie Initial Training Network was funded by the European Union's FP7 research program in order to train 13 Fellows into world-leading researchers in Marine and Underwater Robotics. The fellows developed guided research into three areas of key importance: Autonomy, Disturbance Rejection, and Perception. This paper presents a summary of the fellows' research in the three action lines. 71 scientific publications were the primary result of this project, with many other publications currently in the pipeline. Most of the fellows have found employment in Europe, which shows the high demand for this kind of experts. We believe the results from this project are already having an impact in the marine robotics industry, as key technologies are being adopted already.

[1]  Maarja Kruusmaa,et al.  Current velocity estimation using a lateral line probe , 2015 .

[2]  Robert Hickling,et al.  Analysis of Echoes from a Solid Elastic Sphere in Water , 1962 .

[3]  Ke Chen,et al.  Estimation of Flow Turbulence Metrics With a Lateral Line Probe and Regression , 2017, IEEE Transactions on Instrumentation and Measurement.

[4]  Mario Michael Krell,et al.  Online model identification for underwater vehicles through incremental support vector regression , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[5]  Charalampos P. Bechlioulis,et al.  Trajectory Tracking With Prescribed Performance for Underactuated Underwater Vehicles Under Model Uncertainties and External Disturbances , 2017, IEEE Transactions on Control Systems Technology.

[6]  G C Gaunaurd,et al.  Signal processing of the echo signatures returned by submerged shells insonified by dolphin "clicks:" active classification. , 1998, The Journal of the Acoustical Society of America.

[7]  Kartic Subr,et al.  CAD-model-based 3D video mapping , 2017, OCEANS 2017 – Anchorage.

[8]  Kostas J. Kyriakopoulos,et al.  A self-triggered Model Predictive Control framework for the cooperation of distributed nonholonomic agents , 2013, 52nd IEEE Conference on Decision and Control.

[9]  Kartic Subr,et al.  Underwater 3D structures as semantic landmarks in SONAR mapping , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[10]  Anibal Matos,et al.  Survey on advances on terrain based navigation for autonomous underwater vehicles , 2017 .

[11]  Kostas J. Kyriakopoulos,et al.  A Model Predictive Control Approach for Vision-Based Object Grasping via Mobile Manipulator , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[12]  Hugh Griffiths,et al.  Rendezvous Point Technique for Multivehicle Mine Countermeasure Operations in Communication-Constrained Environments , 2016 .

[13]  Dimos V. Dimarogonas,et al.  A Robust Force Control Approach for Underwater Vehicle Manipulator Systems , 2016 .

[14]  Gabriele Ferri,et al.  An Acoustic Network Navigation System , 2017, J. Field Robotics.

[15]  Matias Valdenegro-Toro.  Improving sonar image patch matching via deep learning , 2017, 2017 European Conference on Mobile Robots (ECMR).

[16]  M. Pebody,et al.  Autosub Long Range: A long range deep diving AUV for ocean monitoring , 2012, 2012 IEEE/OES Autonomous Underwater Vehicles (AUV).

[17]  Charalampos P. Bechlioulis,et al.  Cooperative Impedance Control for Multiple Underwater Vehicle Manipulator Systems Under Lean Communication , 2021, IEEE Journal of Oceanic Engineering.

[18]  Paolo Braca,et al.  Cooperative robotic networks for underwater surveillance: an overview , 2017 .

[19]  Viorela Ila,et al.  Fast Incremental Bundle Adjustment with Covariance Recovery , 2017, 2017 International Conference on 3D Vision (3DV).

[20]  Hugh Griffiths,et al.  Synchronous rendezvous technique for multi-vehicle mine countermeasure operations , 2015, OCEANS 2015 - MTS/IEEE Washington.

[21]  Forrest N. Iandola,et al.  SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <1MB model size , 2016, ArXiv.

[22]  Matias Valdenegro-Toro,et al.  Submerged marine debris detection with autonomous underwater vehicles , 2016, 2016 International Conference on Robotics and Automation for Humanitarian Applications (RAHA).

[23]  Dimos V. Dimarogonas,et al.  A self-triggered visual servoing model predictive control scheme for under-actuated underwater robotic vehicles , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[24]  Kostas J. Kyriakopoulos,et al.  A robust self triggered Image Based Visual Servoing Model Predictive Control scheme for small autonomous robots , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[25]  Pere Ridao,et al.  Autonomous Seabed Inspection for Environmental Monitoring , 2015, ROBOT.

[26]  Maarja Kruusmaa,et al.  Underwater vehicle speedometry using differential pressure sensors: Preliminary results , 2016, 2016 IEEE/OES Autonomous Underwater Vehicles (AUV).

[27]  Yvan Petillot,et al.  Underwater 3D reconstruction using BlueView imaging sonar , 2015, OCEANS 2015 - Genova.

[28]  Kostas J. Kyriakopoulos,et al.  A Distributed Predictive Control Approach for Cooperative Manipulation of Multiple Underwater Vehicle Manipulator Systems , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[29]  Charalampos P. Bechlioulis,et al.  Robust Image-Based Visual Servoing With Prescribed Performance Under Field of View Constraints , 2019, IEEE Transactions on Robotics.

[30]  Forrest N. Iandola,et al.  SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <1MB model size , 2016, ArXiv.

[31]  Douglas L. Jones,et al.  Distant touch hydrodynamic imaging with an artificial lateral line , 2006, Proceedings of the National Academy of Sciences.

[32]  Veronika Yordanova,et al.  Intelligent adaptive underwater sensor networks , 2018 .

[33]  Maarja Kruusmaa,et al.  Pressure Sensitive Lateral Line for Underwater Robot , 2013 .

[34]  Mario Michael Krell,et al.  Learning coupled dynamic models of underwater vehicles using Support Vector Regression , 2017, OCEANS 2017 - Aberdeen.

[35]  D. Coughlin,et al.  Rainbow trout Oncorhynchus mykiss consume less energy when swimming near obstructions. , 2010, Journal of fish biology.

[36]  Eduard Vidal,et al.  Online View Planning for Inspecting Unexplored Underwater Structures , 2017, IEEE Robotics and Automation Letters.

[37]  F. Allgöwer,et al.  Nonlinear Model Predictive Control: From Theory to Application , 2004 .

[38]  Eric Rogers,et al.  Co-operative Use of Marine Autonomous Systems to Enhance Navigational Accuracy of Autonomous Underwater Vehicles , 2016, TAROS.

[39]  Matias Valdenegro-Toro,et al.  Object recognition in forward-looking sonar images with Convolutional Neural Networks , 2016, OCEANS 2016 MTS/IEEE Monterey.

[40]  Panos Marantos,et al.  A Robust Model Predictive Control Approach for Autonomous Underwater Vehicles Operating in a Constrained Workspace , 2017, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[41]  Xiaobo Tan,et al.  An artificial lateral line system using IPMC sensor arrays , 2012 .

[42]  M. Kruusmaa,et al.  Differential Pressure Sensors for Underwater Speedometry in Variable Velocity and Acceleration Conditions , 2018, IEEE Journal of Oceanic Engineering.

[43]  Maarja Kruusmaa,et al.  Map-based localization in structured underwater environment using simulated hydrodynamic maps and an artificial lateral line , 2017, 2017 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[44]  Douglas L. Jones,et al.  Multisensor Processing Algorithms for Underwater Dipole Localization and Tracking Using MEMS Artificial Lateral-Line Sensors , 2006, EURASIP J. Adv. Signal Process..

[45]  Maarja Kruusmaa,et al.  Hydrodynamic pressure sensing with an artificial lateral line in steady and unsteady flows , 2012, Bioinspiration & biomimetics.

[46]  Rafael García,et al.  Mission-time 3D reconstruction with quality estimation , 2017, OCEANS 2017 - Aberdeen.

[47]  Maarja Kruusmaa,et al.  Flow velocity estimation using a fish-shaped lateral line probe with product-moment correlation features and a neural network , 2017 .

[48]  Alexander B. Phillips,et al.  Autosub long range 1500: An ultra-endurance AUV with 6000 Km range , 2017, OCEANS 2017 - Aberdeen.

[49]  Dimos V. Dimarogonas,et al.  Robust Trajectory Tracking Control for Underactuated Autonomous Underwater Vehicles , 2019, 2019 IEEE 58th Conference on Decision and Control (CDC).

[50]  Eduard Vidal,et al.  Autonomous Underwater Navigation and Optical Mapping in Unknown Natural Environments , 2016, Sensors.

[51]  Shahabodin Heshmati Alamdari,et al.  Cooperative and interaction control for underwater robotic vehicles , 2018 .

[52]  Dimos V. Dimarogonas,et al.  Decentralized abstractions and timed constrained planning of a general class of coupled multi-agent systems , 2017, 2017 IEEE 56th Annual Conference on Decision and Control (CDC).

[53]  Matias Valdenegro-Toro.  Real-time convolutional networks for sonar image classification in low-power embedded systems , 2017, ESANN.

[54]  David M. Lane,et al.  Adaptive Bio-inspired Signals for Better Object Characterisation , 2015, Living Machines.

[55]  S. Dijkgraaf.  THE FUNCTIONING and SIGNIFICANCE OF THE LATERAL‐LINE ORGANS , 1963, Biological reviews of the Cambridge Philosophical Society.

[56]  Gang Qiao,et al.  Underwater cylindrical shell in different thickness recognition using biomimetic dolphin clicks , 2016, OCEANS 2016 MTS/IEEE Monterey.

[57]  Douglas L. Jones,et al.  Artificial lateral line with biomimetic neuromasts to emulate fish sensing , 2010, Bioinspiration & biomimetics.

[58]  Charalampos P. Bechlioulis,et al.  Sonar-based chain following using an autonomous underwater vehicle , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[59]  Kostas J. Kyriakopoulos,et al.  Robustness analysis of model predictive control for constrained Image-Based Visual Servoing , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[60]  J. Engel,et al.  From artificial hair cell sensor to artificial lateral line system: Development and application , 2007, 2007 IEEE 20th International Conference on Micro Electro Mechanical Systems (MEMS).

[61]  David M. Lane,et al.  Object classification with convolution neural network based on the time-frequency representation of their echo , 2017, 2017 IEEE 27th International Workshop on Machine Learning for Signal Processing (MLSP).

[62]  Milica Stojanovic,et al.  Underwater Acoustic Communications and Networking: Recent Advances and Future Challenges , 2008 .

[63]  Matias Valdenegro-Toro.  Objectness Scoring and Detection Proposals in Forward-Looking Sonar Images with Convolutional Neural Networks , 2016, ANNPR.

[64]  Duc Truong Pham,et al.  A nonlinear model predictive control scheme , 1999 .

[65]  James Annin.  The Rainbow Trout , 1882 .

[66]  Dimos V. Dimarogonas,et al.  A Nonlinear Model Predictive Control scheme for cooperative manipulation with singularity and collision avoidance , 2017, 2017 25th Mediterranean Conference on Control and Automation (MED).

[67]  Joni-Kristian Kämäräinen,et al.  Joint Estimation of Bulk Flow Velocity and Angle Using a Lateral Line Probe , 2016, IEEE Transactions on Instrumentation and Measurement.

[68]  J. Engel,et al.  Artificial Lateral Line And Hydrodynamic Object Tracking , 2006, 19th IEEE International Conference on Micro Electro Mechanical Systems.

[69]  Jack Chen,et al.  Institute of Physics Publishing Journal of Micromechanics and Microengineering Design and Fabrication of Artificial Lateral Line Flow Sensors 1. Underwater Flow Sensing , 2022 .

[70]  Bilal Wehbe,et al.  Experimental evaluation of various machine learning regression methods for model identification of autonomous underwater vehicles , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[71]  Yan Pailhas,et al.  Analysis and classification of broadband echoes using bio-inspired dolphin pulses. , 2010, The Journal of the Acoustical Society of America.

[72]  David M. Lane,et al.  A Hidden Markov Model application with Gaussian Mixture emissions for fault detection and diagnosis on a simulated AUV platform , 2016, OCEANS 2016 MTS/IEEE Monterey.

[73]  Eric Rogers,et al.  Terrain‐aided navigation for long‐endurance and deep‐rated autonomous underwater vehicles , 2018, J. Field Robotics.

[74]  Dimos V. Dimarogonas,et al.  A robust interaction control approach for underwater vehicle manipulator systems , 2018, Annu. Rev. Control..

[75]  Maarja Kruusmaa,et al.  Flow-relative control of an underwater robot , 2013, Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[76]  Xiaobo Tan,et al.  Localization of a moving dipole source underwater using an artificial lateral line , 2012, Smart Structures and Materials + Nondestructive Evaluation and Health Monitoring.

[77]  Helen F. Hastie,et al.  Navigation-Based learning for survey trajectory classification in autonomous underwater vehicles , 2017, 2017 IEEE 27th International Workshop on Machine Learning for Signal Processing (MLSP).

[78]  David M. Lane,et al.  Classification of spherical objects based on the form function of acoustic echoes , 2019, ArXiv.

[79]  Helder Araújo,et al.  Robust image-based visual servoing using invariant visual information , 2013, Robotics Auton. Syst..

[80]  Charalampos P. Bechlioulis,et al.  Prescribed performance image based visual servoing under field of view constraints , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[81]  Matias Valdenegro-Toro,et al.  End-to-end object detection and recognition in forward-looking sonar images with convolutional neural networks , 2016, 2016 IEEE/OES Autonomous Underwater Vehicles (AUV).

[82]  Hugh Griffiths,et al.  Rendezvous Planning for Multiple Autonomous Underwater Vehicles using a Markov Decision Process , 2017 .

[83]  Charalampos P. Bechlioulis,et al.  Decentralized Impedance Control for Cooperative Manipulation of Multiple Underwater Vehicle Manipulator Systems under Lean Communication , 2018, 2018 IEEE/OES Autonomous Underwater Vehicle Workshop (AUV).

[84]  Turker Turker,et al.  A Robust Predictive Current Controller for PMSM Drives , 2016, IEEE Transactions on Industrial Electronics.

[85]  Sun Fuchun,et al.  A Robust Model Predictive Control Based on Reachable Sets , 2011 .

[86]  Eric Rogers,et al.  Terrain Aided Navigation for Long Range AUV operations at arctic latitudes , 2016, 2016 IEEE/OES Autonomous Underwater Vehicles (AUV).

[87]  Dimos V. Dimarogonas,et al.  Self-triggered Model Predictive Control for nonholonomic systems , 2013, 2013 European Control Conference (ECC).

[88]  Maarja Kruusmaa,et al.  Flow-Sensitive Robotic Fish: From Concept to Experiments. Voolutundlik robotkala: ideest katsetusteni , 2015 .

[89]  Panos Marantos,et al.  A Robust Predictive Control Approach for Underwater Robotic Vehicles , 2020, IEEE Transactions on Control Systems Technology.