UAV-guided navigation for ground robot tele-operation in a military reconnaissance environment

A military reconnaissance environment was simulated to examine the performance of ground robotics operators who were instructed to utilise streaming video from an unmanned aerial vehicle (UAV) to navigate his/her ground robot to the locations of the targets. The effects of participants' spatial ability on their performance and workloadwere also investigated. Results showed that participants' overall performance (speed and accuracy) was better when she/he had access to images from larger UAVs with fixed orientations, compared with other UAV conditions (baseline- no UAV, micro air vehicle and UAV with orbiting views). Participants experienced the highest workload when the UAV was orbiting. Those individuals with higher spatial ability performed significantly better and reported less workload than those with lower spatial ability. The results of the current study will further understanding of ground robot operators' target search performance based on streaming video from UAVs. The results will also facilitate the implementation of ground/air robots in military environments and will be useful to the future military system design and training community.

[1]  Lindsey K. McIntire,et al.  Operator Selection for Unmanned Aerial Vehicle Operators: A Comparison of Video Game Players and Manned Aircraft Pilots , 2009 .

[2]  B. Roskos-Ewoldsen,et al.  THE RELATIONS AMONG WAYFINDING STRATEGY USE, SENSE OF DIRECTION, SEX, FAMILIARITY, AND WAYFINDING ABILITY , 2000 .

[3]  Cher Carney,et al.  Human Factors Design Guidelines for Advanced Traveler Information Systems (ATIS) and Commercial Vehicle Operations (CVO) , 1998 .

[4]  Anthony E. Richardson,et al.  Development of a self-report measure of environmental spatial ability. , 2002 .

[5]  Jessie Y. C. Chen,et al.  Human Performance Issues and User Interface Design for Teleoperated Robots , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[6]  Paula J. Durlach,et al.  Human–Robot Interaction in the Context of Simulated Route Reconnaissance Missions , 2008 .

[7]  Lisa C. Thomas,et al.  Effects of Display Frames of Reference on Spatial Judgments and Change Detection , 2000 .

[8]  Patrick H. Wiley,et al.  The Development of a Virtual McKenna Military Operations in Urban Terrain (MOUT) Site for Command, Control, Communication, Computing, Intelligence, Surveillance, and Reconnaissance (C4ISR) Studies , 2007 .

[9]  Lisa C. Thomas,et al.  Visual Displays and Cognitive Tunneling: Frames of Reference Effects on Spatial Judgments and Change Detection , 2001 .

[10]  Anthony J. Aretz.  The Design of Electronic Map Displays , 1991 .

[11]  M R Tracey,et al.  The interaction of spatial ability and motor learning in the transfer of training from a simulator to a real task. , 2001, Studies in health technology and informatics.

[12]  Alan Natapoff,et al.  Influence of perspective-taking and mental rotation abilities in space teleoperation , 2007, 2007 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[13]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[14]  K. Morrin,et al.  Gender Differences in Pointing Accuracy in Computer-Simulated 3D Mazes , 1999 .

[15]  Zakiya Alexandra Tomlinson,et al.  Influence of spatial abilities on primary and secondary space telerobotics operator performance , 2009 .

[16]  L. Gugerty,et al.  Reference-frame misalignment and cardinal direction judgments: group differences and strategies. , 2004, Journal of experimental psychology. Applied.

[17]  Earl Hunt,et al.  Spatial Representations of Virtual Mazes: The Role of Visual Fidelity and Individual Differences , 2001, Hum. Factors.

[18]  Troy D. Kelley,et al.  The Effects of Communication Style on Robot Navigation Performance , 2009 .

[19]  Carla T. Joyner,et al.  Concurrent Performance of Gunner's and Robotics Operator's Tasks in a Multitasking Environment , 2009 .

[20]  Christopher D. Wickens,et al.  Tactical Displays for Combat Awareness: An Examination of Dimensionality and Frame of Reference Concepts and the Application of Cognitive Engineering , 2000 .

[21]  Corinna E. Lathan,et al.  The Effects of Operator Spatial Perception and Sensory Feedback on Human-Robot Teleoperation Performance , 2002, Presence: Teleoperators & Virtual Environments.

[22]  Jessie Y.C. Chen,et al.  Effects of imperfect automation and individual differences on concurrent performance of military and robotics tasks in a simulated multitasking environment , 2009, Ergonomics.

[23]  Rudy Darken,et al.  Map usage in virtual environments: orientation issues , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[24]  Gerald E. Larson,et al.  The ECAT Battery , 1997 .

[25]  Jan M Noyes,et al.  A self-analysis of the NASA-TLX workload measure , 2007, Ergonomics.

[26]  Roger A. Chadwick,et al.  Spatial Disorientation in Remote Ground Vehicle Operations: Target Localization Errors , 2007 .

[27]  R Eyal,et al.  Spatial ability and learning the use of an angled laparoscope in a virtual environment. , 2001, Studies in health technology and informatics.

[28]  Stephen M. Casner,et al.  The Effects of GPS and Moving Map Displays on Pilot Navigational Awareness While Flying Under VFR , 2007 .

[29]  Jessie Y. C. Chen,et al.  Supervisory Control of Robots Using RoboLeader , 2010 .

[30]  Steffen Werner.  Cognitive Reference Systems and Their Role in Designing Spatial Information Displays , 2002, Künstliche Intell..

[31]  C.M.M. Hurts.  Effects of Spatial Intelligence and Gender on Wayfinding Strategy and Performance , 2006 .

[32]  G Salvendy,et al.  Information visualization; assisting low spatial individuals with information access tasks through the use of visual mediators. , 1995, Ergonomics.

[33]  Mary Czerwinski,et al.  Individual differences in virtual environments - Introduction and overview , 2000, J. Am. Soc. Inf. Sci..

[34]  Marlin L. Gendron,et al.  Demonstration of a moving-map system for improved precise lane navigation of amphibious vehicles and landing craft , 2003, Oceans 2003. Celebrating the Past ... Teaming Toward the Future (IEEE Cat. No.03CH37492).

[35]  Carryl L. Baldwin,et al.  Individual Differences in Route-Learning Strategy and Associated Working Memory Resources , 2009, Hum. Factors.

[36]  J Y C Chen,et al.  Effects of tactile cueing on concurrent performance of military and robotics tasks in a simulated multitasking environment , 2008, Ergonomics.