Testing an Underwater Robot Executing Transect Missions in Mayotte

In this paper, we present an approach to test underwater robots with a mission perspective. We propose five classes of oracle mission properties, used to perform test verification and evaluation: mission phases, time, energy, safety and localization. We study how these properties can be used, using data from the generated logs and analyzing the set of measurements. We apply this methodology on our semi-AUV prototype which executes autonomously biologic observation protocols in the Mayotte lagoon. For that we use an offline oracle property checker, and we focus on the issues of test acceptance criteria and ground truth despite low cost localization sensors. Results and lessons learned from this experiment are presented.

[1]  David Velasco,et al.  Validation of a new generation DVL for underwater vehicle navigation , 2016, 2016 IEEE/OES Autonomous Underwater Vehicles (AUV).

[2]  David Mouillot,et al.  Bright spots among the world’s coral reefs , 2016, Nature.

[3]  Adam Jacoff,et al.  Development of standard test methods for evaluation of ROV/AUV performance for emergency response applications , 2015, OCEANS 2015 - MTS/IEEE Washington.

[4]  Riki Lamont,et al.  Real-time Vision-only Perception for Robotic Coral Reef Monitoring and Management , 2019 .

[5]  L. Lapierre,et al.  An Approach for Fault Tolerant and Performance Guarantee Autonomous Robotic Mission , 2019, 2019 NASA/ESA Conference on Adaptive Hardware and Systems (AHS).

[6]  Jonathan C. Howland,et al.  The Nereus hybrid underwater robotic vehicle , 2009 .

[7]  G. A. Ramadass,et al.  Development and Performance Validation of a Navigation System for an Underwater Vehicle , 2016 .

[8]  John J. Leonard,et al.  Cooperative AUV Navigation using a Single Maneuvering Surface Craft , 2010, Int. J. Robotics Res..

[9]  Stefan B. Williams,et al.  Monitoring of Benthic Reference Sites: Using an Autonomous Underwater Vehicle , 2012, IEEE Robotics & Automation Magazine.

[10]  Hélène Waeselynck,et al.  The virtual lands of Oz: testing an agribot in simulation , 2020, Empirical Software Engineering.

[11]  Jérémie Guiochet,et al.  Can Robot Navigation Bugs Be Found in Simulation? An Exploratory Study , 2017, 2017 IEEE International Conference on Software Quality, Reliability and Security (QRS).

[12]  Geoffrey A. Hollinger,et al.  Ocean deployment and testing of a semi-autonomous underwater vehicle , 2016, OCEANS 2016 MTS/IEEE Monterey.

[13]  Carl E. Landwehr,et al.  Basic concepts and taxonomy of dependable and secure computing , 2004, IEEE Transactions on Dependable and Secure Computing.