Towards predicting robot team performance

In this paper we develop a method for predicting the performance of human-robot teams consisting of a single user and multiple robots. To predict the performance of a team, we first measure the neglect tolerance and interface efficiency of the interaction schemes employed by the team. We then describe a method that shows how these measurements can be used to estimate the team's performance. We validate the performance prediction algorithm by comparing predictions to actual results when a user guides three robots in an exploration and goal-finding mission; comparisons are made for various system configurations.

[1]  David Kortenkamp,et al.  Adjustable Autonomy for Human-Centered Autonomous Systems on Mars , 1998 .

[2]  M. Goodrich,et al.  Measuring the Intelligence of a Robot and its Interface , 2003 .

[3]  Alan C. Schultz,et al.  Goal tracking in a natural language interface: towards achieving adjustable autonomy , 1999, Proceedings 1999 IEEE International Symposium on Computational Intelligence in Robotics and Automation. CIRA'99 (Cat. No.99EX375).

[4]  Abderrahmane Kheddar,et al.  Multi-robots teleoperation - analysis and prognosis , 1997, Proceedings 6th IEEE International Workshop on Robot and Human Communication. RO-MAN'97 SENDAI.

[5]  Ronald C. Arkin,et al.  Multiagent Teleautonomous Behavioral Control , 1997 .

[6]  Dan R. Olsen,et al.  Metrics for Evaluating Human-Robot Interactions , 2003 .

[7]  Milind Tambe,et al.  Towards Adjustable Autonomy for the Real World , 2002, J. Artif. Intell. Res..

[8]  Milind Tambe,et al.  Why the elf acted autonomously: towards a theory of adjustable autonomy , 2002, AAMAS '02.

[9]  Kenneth Y. Goldberg,et al.  Collaborative teleoperation via the Internet , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[10]  Christopher D. Wickens,et al.  A model for types and levels of human interaction with automation , 2000, IEEE Trans. Syst. Man Cybern. Part A.