How training and experience affect the benefits of autonomy in a dirty-bomb experiment

A dirty-bomb experiment conducted at the INL is used to evaluate the effectiveness and suitability of three different modes of robot control. The experiment uses three distinct user groups to understand how participants' background and training affect the way in which they use and benefit from autonomy. The results show that the target mode, which involves automated mapping and plume tracing together with a point and click tasking tool, provides the best performance for each group. This is true for objective performance such as source detection and localization accuracy as well as subjective measures such as perceived workload, frustration and preference. The best overall performance is achieved by the Explosive Ordinance Disposal group which has experience in both robot teleoperation and dirty bomb response. The user group that benefits least from autonomy is the Nuclear Engineers that have no experience with either robot operation or dirty bomb response. The group that benefits most from autonomy is the Weapons of Mass Destruction Civil Support Team that has extensive experience related to the task, but no robot training.

[1]  Jean Scholtz,et al.  Beyond usability evaluation: analysis of human-robot interaction at a major robotics competition , 2004 .

[2]  Jean Scholtz,et al.  Human-Robot Interactions: Creating Synergistic Cyber Forces , 2002 .

[3]  Ronald L. Boring,et al.  Shared understanding for collaborative control , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[4]  B. Zimmerman,et al.  Self-regulated learning and academic achievement: Theory, research, and practice. , 1989 .

[5]  William D. Smart,et al.  Supporting Complex Robot Behaviors with Simple Interaction Tools , 2007 .

[6]  Michael A. Goodrich,et al.  Comparing the usefulness of video and map information in navigation tasks , 2006, HRI '06.

[7]  Reid G. Simmons,et al.  Coordinated Multiagent Teams and Sliding Autonomy for Large-Scale Assembly , 2006, Proceedings of the IEEE.

[8]  Donald D. Dudenhoeffer,et al.  Mixed-initiative control for remote characterization of hazardous environments , 2003, 36th Annual Hawaii International Conference on System Sciences, 2003. Proceedings of the.

[9]  B. Zimmerman,et al.  Self-regulated learning and academic achievement : theoretical perspectives , 2001 .

[10]  Ann L. Brown,et al.  How people learn: Brain, mind, experience, and school. , 1999 .

[11]  Kurt Konolige,et al.  Large-Scale Map-Making , 2004, AAAI.

[12]  Curtis W. Nielsen,et al.  Hiding the System from the User: Moving from Complex Mental Models to Elegant Metaphors , 2007, RO-MAN 2007 - The 16th IEEE International Symposium on Robot and Human Interactive Communication.

[13]  Marianne LaFrance,et al.  The quality of expertise: implications of expert-novice differences for knowledge acquisition , 1989, SGAR.

[14]  Vladimir J. Lumelsky,et al.  Final report for the DARPA/NSF interdisciplinary study on human-robot interaction , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).