Performance measures framework for unmanned systems (PerMFUS): initial perspective

The performance of intelligent unmanned systems (UMSs) must be able to be measured to ensure that they can meet the operational requirements. A generic framework to enable capturing and organizing the performance metrics is highly desirable. In this framework, unmanned system (UMS) performance can be attributed to the missions that it is commanded to perform, the environments that the missions are to be performed in, and the capabilities of the system itself. These attributes constitute a "three-axis" UMS performance metrics model. This framework, once further populated, can benefit the UMS community by allowing capture of the UMS performance, from the technical and operational perspective.

[1]  Adam Jacoff,et al.  Traversability Metrics for Urban Search and Rescue Robots on Rough Terrain | NIST , 2007 .

[2]  Anas N. Al-Rabadi,et al.  A comparison of modified reconstructability analysis and Ashenhurst‐Curtis decomposition of Boolean functions , 2004 .

[3]  Tommy Chang,et al.  Performance Evaluation of a Terrain Traversability Learning Algorithm in the DARPA LAGR Program , 2009 .

[4]  John E. Gaffney,et al.  Software Function, Source Lines of Code, and Development Effort Prediction: A Software Science Validation , 1983, IEEE Transactions on Software Engineering.

[5]  Craig Schlenoff,et al.  Ontological perspectives for autonomy performance , 2008, PerMIS.

[6]  Hui-Min Huang,et al.  Autonomy Levels For Unmanned Systems (ALFUS) framework, volume I :: terminology version 2.1 , 2008 .

[7]  Elizabeth K. Bailey,et al.  Software Measurement for DoD Systems: Recommendations for Initial Core Measures. , 1992 .

[8]  James S. Albus,et al.  4DRCS :: a reference model architecture for unmanned vehicle systems version 2.0 , 2002 .

[9]  Paolo Giorgini,et al.  Goal-oriented requirement analysis for data warehouse design , 2005, DOLAP '05.

[10]  Andreas Birk,et al.  Determining Map Quality through an Image Similarity Metric , 2009, RoboCup.

[11]  Adam Jacoff,et al.  Urban search and rescue robot performance standards: progress update , 2007, SPIE Defense + Commercial Sensing.

[12]  Sebastian Thrun,et al.  Learning Metric-Topological Maps for Indoor Mobile Robot Navigation , 1998, Artif. Intell..

[13]  Brian A. Weiss,et al.  Evolution of the SCORE framework to enhance field-based performance evaluations of emerging technologies , 2008, PerMIS.

[14]  E.R. Messina,et al.  Measuring the Performance of Urban Search and Rescue Robots , 2007, 2007 IEEE Conference on Technologies for Homeland Security.

[15]  Catherine A. Remley,et al.  Standards Development for Wireless Communications for Urban Search and Rescue Robots | NIST , 2007 .