Lessons learned from usability tests with a collaborative cognitive workspace for human-robot teams

Use of new robotics technologies is challenged by issues of system trust, unknowns regarding how the system will, can, and should be used, and possibilities for human error that may cause harm to the human operator, system, or environment. This paper discusses initial usability tests of a mixed-initiative robotic system. Participants were asked to search a building using a robot equipped with multiple levels of autonomy to identify 3 targets in pre-specified locations. The experiment showed a significant difference between novice and experienced robotic operators especially regarding willingness to use the autonomous capabilities of the robot. Users unfamiliar with teleoperation were more willing to utilize the autonomous capabilities of the robot, while skilled teleoperators preferred and were more efficient when in direct control. Users were almost always able to successfully complete the search task. However, feedback indicates that users, having been given only a cursory explanation of the system, were sometimes confused by robot initiative even though the interface supplied textual explanations. The experiment shows that mixed-initiative interaction may exceed the limitations of either fully autonomous or teleoperated control; however, potential benefits can easily be overshadowed by control challenges inherent to deploying robot-human teams.

[1]  J. Alberto Espinosa,et al.  Coming to the wrong decision quickly: why awareness tools must be matched with appropriate tasks , 2000, CHI.

[2]  Audris Mockus,et al.  Shared Mental Models and Coordination in Large-Scale, Distributed Software Development , 2001, ICIS.

[3]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[4]  Rapid Thermal Multiprocessor,et al.  Supervisory Control of a , 1993 .

[5]  Thomas B. Sheridan,et al.  Human and Computer Control of Undersea Teleoperators , 1978 .

[6]  Thomas B. Sheridan.  Supervisory Control of Remote Manipulators, Vehicles and Dynamic Processes: Experiments in Command and Display Aiding , 1983 .

[7]  Donald D. Dudenhoeffer,et al.  Mixed-initiative control for remote characterization of hazardous environments , 2003, 36th Annual Hawaii International Conference on System Sciences, 2003. Proceedings of the.

[8]  John Yen,et al.  CAST: Collaborative Agents for Simulating Teamwork , 2001, IJCAI.

[9]  Donald D. Dudenhoeffer,et al.  Evaluation of supervisory vs. peer-peer interaction with human-robot teams , 2004, 37th Annual Hawaii International Conference on System Sciences, 2004. Proceedings of the.

[10]  C. Wickens.  Engineering psychology and human performance, 2nd ed. , 1992 .

[11]  S. M. Casey,et al.  Set Phasers on Stun: And Other True Tales of Design, Technology, and Human Error , 1998 .

[12]  Donald D. Dudenhoeffer,et al.  Dynamic-Autonomy for Remote Robotic Sensor Deployment , 2002 .

[13]  Christopher D. Wickens,et al.  An introduction to human factors engineering , 1997 .