Performance measures to improve evaluation of teams in the euRathlon 2014 sea robotics competition

Abstract Sea robotics competitions have been happening for almost twenty years. Teams have been improving and performing better and better each year. Therefore, the need of assessing their performance through means of fair comparison and rigorous metrics arises. Benchmarking the results is important to understand how teams performed compared to each other but also overall. In this article, we discuss the performance measures used to evaluate the teams of the euRathlon 2014 sea robotics competition and how benchmarking can be applied in this case.