Human-Drone-Interaction: A Case Study to Investigate the Relation Between Autonomy and User Experience

Autonomous robots effectively support the human workforce in a variety of industries such as logistics or health care. With an increasing level of system autonomy humans normally have to give up control and rely on the system to react appropriately. We wanted to investigate the effects of different levels of autonomy on the User Experience (UX) and ran a case study involving autonomous flying drones. In a student competition, four teams developed four drone prototypes with varying levels of autonomy. We evaluated the resulting UX in 24 semi-structured interviews in a setting with high perceived workload (competition, autonomous vs. manual) and a non-competition setting (autonomous). The case study showed that the level of autonomy has various influences on UX, particularly in situations with high perceived workload. Based on our findings, we derive recommendations for the UX-oriented development of autonomous drones.

[1]  James A. Landay,et al.  Drone & me: an exploration into natural human-drone interaction , 2015, UbiComp.

[2]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[3]  Elli Angelopoulou,et al.  Autonomous Approach and Landing for a Low-Cost Quadrotor Using Monocular Cameras , 2014, ECCV Workshops.

[4]  Kwang Nam Choi,et al.  Autonomous flight system using marker recognition on drone , 2015, 2015 21st Korea-Japan Joint Workshop on Frontiers of Computer Vision (FCV).

[5]  Jean Scholtz,et al.  Common metrics for human-robot interaction , 2006, HRI '06.

[6]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[7]  Bilge Mutlu,et al.  Communicating Directionality in Flying Robots , 2015, 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[8]  Pascal Mettes,et al.  Nature Conservation Drones for Automatic Localization and Counting of Animals , 2014, ECCV Workshops.

[9]  Scott S Potter,et al.  Subjective Workload Assessment Technique (SWAT): A User's Guide , 1989 .

[10]  Shaogang Gong,et al.  Investigating Open-World Person Re-identification Using a Drone , 2014, ECCV Workshops.

[11]  Richard O. Duda,et al.  Use of the Hough transformation to detect lines and curves in pictures , 1972, CACM.

[12]  J. H. Gilmore,et al.  Welcome to the experience economy. , 1998, Harvard business review.

[13]  James S. Albus,et al.  Outline for a theory of intelligence , 1991, IEEE Trans. Syst. Man Cybern..

[14]  Christopher D. Wickens,et al.  A model for types and levels of human interaction with automation , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[15]  S S Stevens,et al.  HUMAN ENGINEERING FOR AN EFFECTIVE AIR-NAVIGATION AND TRAFFIC-CONTROL SYSTEM, AND APPENDIXES 1 THRU 3 , 1951 .

[16]  Pedro Núñez Trujillo,et al.  Engaging human-to-robot attention using conversational gestures and lip-synchronization , 2012 .

[17]  Marc Hassenzahl,et al.  Convenient, clean, and efficient?: the experiential costs of everyday automation , 2014, NordiCHI.

[18]  Martin Schrepp,et al.  Construction and Evaluation of a User Experience Questionnaire , 2008, USAB.

[19]  S. Gregor,et al.  Measuring Human-Computer Trust , 2000 .

[20]  Wayne Madsen.  Changes proposed to FOIA , 2000 .

[21]  James R. Lewis,et al.  IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use , 1995, Int. J. Hum. Comput. Interact..

[22]  Marc Hassenzahl,et al.  User experience (UX): towards an experiential perspective on product quality , 2008, IHM '08.

[23]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[24]  Michael A. Goodrich,et al.  Validating human-robot interaction schemes in multitasking environments , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[25]  Manfred Tscheligi,et al.  Towards Autonomous Cars: The Effect of Autonomy Levels on Acceptance and User Experience , 2014, AutomotiveUI.

[26]  Luca Maria Gambardella,et al.  Human Control of UAVs using Face Pose Estimates and Hand Gestures , 2014, 2014 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[27]  Thomas B. Sheridan,et al.  Human and Computer Control of Undersea Teleoperators , 1978 .

[28]  Roland Siegwart,et al.  Automatic detection of checkerboards on blurred and distorted images , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[29]  Alin Albu-Schäffer,et al.  A human-centered approach to robot gesture based communication within collaborative working processes , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[30]  Ehud Sharlin,et al.  Collocated interaction with flying robots , 2011, 2011 RO-MAN.

[31]  Kennon M. Sheldon,et al.  What is satisfying about satisfying events? Testing 10 candidate psychological needs. , 2001, Journal of personality and social psychology.

[32]  Ehud Sharlin,et al.  Designing social greetings in human robot interaction , 2014, Conference on Designing Interactive Systems.

[33]  Sandra G. Hart,et al.  Nasa-Task Load Index (NASA-TLX); 20 Years Later , 2006 .

[34]  Raja Parasuraman,et al.  Designing for Flexible Interaction Between Humans and Automation: Delegation Interfaces for Supervisory Control , 2007, Hum. Factors.

[35]  Michael A. Goodrich,et al.  Human-Robot Interaction: A Survey , 2008, Found. Trends Hum. Comput. Interact..

[36]  Dorin Comaniciu,et al.  Real-time tracking of non-rigid objects using mean shift , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[37]  Henry Hexmoor,et al.  Types and Limits of Agent Autonomy , 2003, Agents and Computational Autonomy.