On the Human–Machine Interaction of Unmanned Aerial System Mission Specialists

This paper surveys the human-machine interaction technologies supporting the Mission Specialist role in unmanned aerial systems (UASs). The Mission Specialist role is one of three formal human team member roles extracted from the UAS-related literature (the others are Flight Director and Pilot), but unlike the Pilot role, the interface needs have not been established. The interfaces used by 17 micro, small, medium altitude long endurance (MALE) and high altitude long endurance (HALE) platforms are examined to determine (1) what type of user interface technologies are present and/or available; (2) how the Mission Specialist currently or could interact with the user interface technology; and (3) what are the perceived positive and negative aspects of this user interface technology in the context of the UAS human-robot team roles. Micro and small UAVs pose significant user interface limitations for the Mission Specialist role and may produce unintentional interaction conflicts between the Mission Specialist role and the Pilot, potentially resulting in suboptimal performance and loss of robustness. The survey is expected to serve as a reference for future design and refinement of user interfaces for UAS and a foundation for better understanding human-robot interaction in UAS.

[1]  Robin R. Murphy,et al.  Cooperative use of unmanned sea surface and micro aerial vehicles at Hurricane Wilma , 2008 .

[2]  Mary L. Cummings,et al.  Managing Multiple UAVs through a Timeline Display , 2005 .

[3]  Alan Hobbs,et al.  Unmanned Aircraft Systems , 2010 .

[4]  Julian Vince,et al.  Unmanned Aerial Vehicles for Maritime Patrol: Human Factors Issues , 2006 .

[5]  Florian Segor,et al.  Towards Autonomous Micro UAV Swarms , 2011, J. Intell. Robotic Syst..

[6]  Michael J. Barnes,et al.  Crew Systems Analysis of Unmanned Aerial Vehicle (UAV) Future Job and Tasking Environments , 2000 .

[7]  Michael A. Goodrich,et al.  Towards combining UAV and sensor operator roles in UAV-enabled visual search , 2008, 2008 3rd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[8]  Anthony P Tvaryanas,et al.  Human systems integration in remotely piloted aircraft operations. , 2006, Aviation, space, and environmental medicine.

[9]  Stanley R. Herwitz,et al.  Collection of Ultra High Spatial and Spectral Resolution Image Data over California Vineyards with a Small UAV , 2003 .

[10]  M.A. Goodrich,et al.  Using a Mini-UAV to Support Wilderness Search and Rescue: Practices for Human-Robot Teaming , 2007, 2007 IEEE International Workshop on Safety, Security and Rescue Robotics.

[11]  Polona Vilar,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction (5th edition) , 2010, J. Assoc. Inf. Sci. Technol..

[12]  Robin R. Murphy,et al.  Crew roles and operational protocols for rotary-wing micro-UAVs in close urban environments , 2008, 2008 3rd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[13]  Michael J. Barnes,et al.  Modeling the effects of crew size and crew fatigue on the control of tactical unmanned aerial vehicles (TUAVs) , 2000, 2000 Winter Simulation Conference Proceedings (Cat. No.00CH37165).

[14]  Jeffrey E. Herrick,et al.  Development of an Operational UAV / Remote Sensing Capability for Rangeland Management , 2008 .

[15]  Ryan Hruska.  Small UAV-Acquired, High-resolution, Georeferenced Still Imagery , 2005 .

[16]  Robin R. Murphy,et al.  From remote tool to shared roles , 2008, IEEE Robotics & Automation Magazine.

[17]  Robert M. Taylor.  Human Automation Integration for Supervisory Control of UAVs , 2006 .

[18]  Michael A. Goodrich,et al.  Cognitive Task Analysis for Developing Unmanned Aerial Vehicle Wilderness Search Support , 2009 .

[19]  Michael A. Goodrich,et al.  Supporting wilderness search and rescue using a camera‐equipped mini UAV , 2008, J. Field Robotics.

[20]  Jason M. Blazakis.  Border Security and Unmanned Aerial Vehicles , 2006 .

[21]  Patricia A. LeDuc,et al.  9. Human Factors in U.S. Military Unmanned Aerial Vehicle Accidents , 2006 .

[22]  Robin R. Murphy,et al.  Mission specialist interfaces in unmanned aerial systems , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[23]  Joseph L. Weeks.  Unmanned Aerial Vehicle Operator Qualifications , 2000 .

[24]  Nancy Cooke,et al.  Lessons learned from human-robotic interactions on the ground and in the air , 2010 .

[25]  Nancy J. Cooke,et al.  20. Acquiring Team-Level Command and Control Skill for UAV Operation , 2006 .

[26]  Mary L. Cummings,et al.  Automation Architecture for Single Operator, Multiple UAV Command and Control, , 2007 .

[27]  Michael A. Goodrich,et al.  Integrating critical interface elements for intuitive single-display aviation control of UAVs , 2006, SPIE Defense + Commercial Sensing.

[28]  Elizabeth L. Martin,et al.  Impact of Prior Flight Experience on Learning Predator UAV Operator Skills , 2002 .

[29]  Randal W. Beard,et al.  Multiple UAV Coalitions for a Search and Prosecute Mission , 2011, J. Intell. Robotic Syst..