Moonlight in Miami : A Field Study of Human-Robot Interaction in the Context of an Urban Search and Rescue Disaster Response Training Exercise

This article explores human-robot interaction during a 16-hr, high-fidelity urban search and rescue disaster response drill with teleoperated robots. This article examines operator situation awareness and technical search team interaction using communication analysis. It analyzes situation awareness, team communication, and the interaction of these constructs using a systematic coding scheme designed for this research. The findings indicate that operators spent significantly more time gathering information about the state of the robot and the state of the environment than they did navigating the robot. Operators had difficulty integrating the robot's view into their understanding of the search and rescue site. They compensated for this lack of situation awareness by communicating with team members at the site, attempting to gather information that would provide a more complete mental model of the site. They also worked with team members to develop search strategies. The article concludes with suggestions for design and future research.

[1]  S. O. Parsons,et al.  Human Factors Society , 1966 .

[2]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[3]  Mica R. Endsley,et al.  Design and Evaluation for Situation Awareness Enhancement , 1988 .

[4]  M R Endsley,et al.  Sources of situation awareness errors in aviation. , 1996, Aviation, space, and environmental medicine.

[5]  Eduardo Salas,et al.  Planning, Shared Mental Models, and Coordinated Performance: An Empirical Link Is Established , 1999, Hum. Factors.

[6]  O. Brock,et al.  Robots in Human Environments: Basic Autonomous Capabilities , 1999, Int. J. Robotics Res..

[7]  J. V. Draper,et al.  Next Generation Munitions Handler: Human-Machine Interface and Preliminary Performance Evaluation , 1999 .

[8]  Richard Alan Peters,et al.  Designing for human‐robot symbiosis , 1999 .

[9]  Diane H. Sonnenwald,et al.  Information behavior in dynamic group work contexts: interwoven situational awareness, dense social networks and contested collaboration in command and control , 2000, Inf. Process. Manag..

[10]  Don R. Lyon,et al.  Using Observer Ratings to Assess Situation Awareness , 2000 .

[11]  C. Breazeal.  Sociable Machines: Expressive Social Ex-change Between Humans and Robots , 2000 .

[12]  L P Noldus,et al.  The Observer Video-Pro: New software for the collection, management, and presentation of time-structured data from videotapes and digital media files , 2000, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[13]  J. Sachs.  Using a Small Sample Q Sort to Identify Item Groups , 2000, Psychological reports.

[14]  Robin R. Murphy,et al.  Introduction to AI Robotics , 2000 .

[15]  Mica R. Endsley,et al.  Theoretical Underpinnings of Situation Awareness, A Critical Review , 2000 .

[16]  Terrence Fong,et al.  Collaboration, Dialogue, and Human-Robot Interaction , 2001 .

[17]  Monica N. Nicolescu,et al.  Learning and interacting in human-robot domains , 2001, IEEE Trans. Syst. Man Cybern. Part A.

[18]  Heinz Wörn,et al.  Human–Robot Cooperation Using Multi-Agent-Systems , 2001, J. Intell. Robotic Syst..

[19]  Ben Willems,et al.  CONTROLLER-TO-CONTROLLER COMMUNICATION AND COORDINATION TAXONOMY , 2001 .

[20]  Linda M. Peterson,et al.  Controller-to-ControllerCommunication and Coordination Taxonomy (C 4 T) , 2001 .

[21]  Robin R. Murphy,et al.  Human-Robot Interaction Final Report for DARPA/NSF Study on Human-Robot Interaction , 2002 .

[22]  Mark Micire.  ANALYSIS OF THE ROBOTIC-ASSISTED SEARCH AND RESCUE RESPONSE TO THE WORLD TRADE CENTER DISASTER , 2002 .

[23]  Robin R. Murphy,et al.  Workflow study on human-robot interaction in USAR , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[24]  Ben Willems,et al.  The Moderator Effects of Taskload on the Interplay Between En Route Intra-Sector Team Communications, Situation Awareness, and Mental Workload , 2002 .

[25]  Sara B. Kiesler,et al.  Mental models of robotic assistants , 2002, CHI Extended Abstracts.

[26]  Pamela J. Hinds,et al.  Extreme work teams: using SWAT teams as a model for coordinating distributed robots , 2002, CSCW '02.

[27]  Jun Ota,et al.  Human-supervised multiple mobile robot system , 2002, IEEE Trans. Robotics Autom..

[28]  Robin R. Murphy.  Rats, Robots, and Rescue , 2002, IEEE Intell. Syst..

[29]  Robin R. Murphy,et al.  Human-robot interactions during the robot-assisted urban search and rescue response at the World Trade Center , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[30]  Cynthia Breazeal,et al.  Toward sociable robots , 2003, Robotics Auton. Syst..

[31]  Masahiro Fujita,et al.  An ethological and emotional basis for human-robot interaction , 2003, Robotics Auton. Syst..

[32]  Jean Scholtz,et al.  Theory and evaluation of human robot interactions , 2003, 36th Annual Hawaii International Conference on System Sciences, 2003. Proceedings of the.

[33]  Robert E. Kraut,et al.  Visual Information as a Conversational Resource in Collaborative Physical Tasks , 2003, Hum. Comput. Interact..

[34]  Thomas B. Sheridan,et al.  Telerobotics, Automation, and Human Supervisory Control , 2003 .

[35]  Phongchai Nilas,et al.  An agent-based architecture for an adaptive human-robot interface , 2003, 36th Annual Hawaii International Conference on System Sciences, 2003. Proceedings of the.

[36]  Fredrik Rehnmark,et al.  Robonaut: A Robot Designed to Work with Humans in Space , 2003, Auton. Robots.

[37]  Anders Green,et al.  Social and collaborative aspects of interaction with a service robot , 2003, Robotics Auton. Syst..

[38]  Vladimir J. Lumelsky,et al.  Final report for the DARPA/NSF interdisciplinary study on human-robot interaction , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).