Design and evaluation of a graphical user interface for facilitating expert knowledge transfer: a teleoperation case study

Nowadays, teleoperation systems are increasingly used for the training of specific skills to carry out complex tasks in dangerous environments. One of the challenges of these systems is to ensure that the time it takes for users to acquire these skills is as short as possible. For this, the user interface must be intuitive and easy to use. This document describes the design and evaluation of a graphical user interface so that a non-expert user could use a teleoperated system intuitively and without excessive training time. To achieve our goal, we use a user-centered design process model. To evaluate the interface, we use our own methodology and the results allow improving its usability.

[1]  A. Moniz,et al.  Robots Working with Humans or Humans Working with Robots? Searching for Social Dimensions in New Human-Robot Interaction in Industry , 2016 .

[2]  Claude Sammut,et al.  Effective user interface design for rescue robotics , 2006, HRI '06.

[3]  Holly A. Yanco,et al.  Multi-touch interaction for robot control , 2009, IUI.

[4]  Robin Jeffries,et al.  User interface evaluation in the real world: a comparison of four techniques , 1991, CHI.

[5]  F. J. R. Sedano,et al.  Strategies for Haptic-Robotic Teleoperation in Board Games : Playing checkers with Baxter , 2016 .

[6]  Terry Winograd,et al.  Understanding computers and cognition - a new foundation for design , 1987 .

[7]  Aude Billard,et al.  PDA Interface for Humanoid Robots , 2003 .

[8]  G. Maddern,et al.  A Systematic Review of Skills Transfer After Surgical Simulation Training , 2008, Annals of surgery.

[9]  Terrence Fong,et al.  Advanced Interfaces for Vehicle Teleoperation: Collaborative Control, Sensor Fusion Displays, and Remote Driving Tools , 2001, Auton. Robots.

[10]  Elizabeth S. Kim,et al.  Social Robots as Embedded Reinforcers of Social Behavior in Children with Autism , 2012, Journal of Autism and Developmental Disorders.

[11]  Eugene S. Lee,et al.  Training with simulation improves residents' endovascular procedure skills. , 2007, Journal of vascular surgery.

[12]  Jean Scholtz,et al.  Theory and evaluation of human robot interactions , 2003, 36th Annual Hawaii International Conference on System Sciences, 2003. Proceedings of the.

[13]  Gerard Jounghyun Kim,et al.  Effects of haptic feedback, stereoscopy, and image resolution on performance and presence in remote navigation , 2008, Int. J. Hum. Comput. Stud..

[14]  Abhilash Pandya,et al.  Improved Telemanipulator Navigation During Display-Control Misalignments Using Augmented Reality Cues , 2010, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[15]  R. Satava,et al.  Virtual Reality Training Improves Operating Room Performance: Results of a Randomized, Double-Blinded Study , 2002, Annals of surgery.

[16]  David D. Woods,et al.  Envisioning human-robot coordination in future operations , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[17]  K. Dautenhahn,et al.  Comparing human robot interaction scenarios using live and video based methods: towards a novel methodological approach , 2006, 9th IEEE International Workshop on Advanced Motion Control, 2006..

[18]  Francisco J. García-Peñalvo,et al.  Improving the information society skills: Is knowledge accessible for all? , 2017, Universal Access in the Information Society.

[19]  Manfred Tscheligi,et al.  User perception of usability aspects in indirect HRI - a chain of translations , 2010, 19th International Symposium in Robot and Human Interactive Communication.

[20]  J Vertut,et al.  Teleoperation and robotics :: applications and technology , 1987 .

[21]  Kerstin Dautenhahn,et al.  Empirical results from using a comfort level device in human-robot interaction studies , 2006, HRI '06.

[22]  T. Igarashi,et al.  TouchMe : An Augmented Reality Based Remote Robot Manipulation , 2011 .

[23]  Metin Sitti,et al.  Teleoperated touch feedback from the surfaces at the nanoscale: modeling and experiments , 2003 .

[24]  Manfred Tscheligi,et al.  A methodological adaptation for heuristic evaluation of HRI , 2010, 19th International Symposium in Robot and Human Interactive Communication.

[25]  Martina Ziefle,et al.  Effects of Display Resolution on Visual Performance , 1998, Hum. Factors.

[26]  E. C. Morley,et al.  The Matrix of Confusion—a Classification of Robot Movement , 1996 .

[27]  Antonio Franchi,et al.  Human-Centered Design and Evaluation of Haptic Cueing for Teleoperation of Multiple Mobile Robots , 2013, IEEE Transactions on Cybernetics.

[28]  David B. Kaber,et al.  The Effect of Automated Compensation for Incongruent Axes on Teleoperator Performance , 1998, Hum. Factors.

[29]  Kevin Kunkler,et al.  The role of medical simulation: an overview , 2006, The international journal of medical robotics + computer assisted surgery : MRCAS.

[30]  Cathleen Wharton,et al.  Cognitive Walkthroughs: A Method for Theory-Based Evaluation of User Interfaces , 1992, Int. J. Man Mach. Stud..

[31]  Parvati Dev,et al.  Comparison of training on two laparoscopic simulators and assessment of skills transfer to surgical performance. , 2005, Journal of the American College of Surgeons.

[32]  Susan E. Newman,et al.  Cognitive Apprenticeship: Teaching the Craft of Reading, Writing, and Mathematics. Technical Report No. 403. , 1987 .

[33]  Matthew B. Miles,et al.  Qualitative Data Analysis: An Expanded Sourcebook , 1994 .

[34]  Paul M. Fitts,et al.  Perceptual-Motor Skill Learning1 , 1964 .

[35]  S. Adamovich,et al.  Integrated arm and hand training using adaptive robotics and virtual reality simulations , 2010 .

[36]  Shumin Zhai,et al.  Collaboration Meets Fitts' Law: Passing Virtual Objects with and without Haptic Force Feedback , 2003, INTERACT.

[37]  Ted Boren,et al.  Thinking aloud: reconciling theory and practice , 2000 .

[38]  Stefan Kopp,et al.  Generation and Evaluation of Communicative Robot Gesture , 2012, Int. J. Soc. Robotics.

[39]  T. H. Song,et al.  A study on usability of human-robot interaction using a mobile computer and a human interface device , 2007, Mobile HCI.

[40]  Dirk Heylen,et al.  Robotic Rabbit Companions: amusing or a nuisance? , 2011, Journal on Multimodal User Interfaces.

[41]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[42]  Philippe Coiffet,et al.  Teleoperation and robotics , 1986 .

[43]  Robert D. Swanson,et al.  Soldier evaluation of the virtual reality Iraq. , 2009, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[44]  Pere Ponsa,et al.  Creation of an Ergonomic Guideline for Supervisory Control Interface Design , 2007, HCI.

[45]  Abhilash Pandya,et al.  Joystick mapped Augmented Reality Cues for End-Effector controlled Tele-operated Robots , 2007, 2007 IEEE Virtual Reality Conference.

[46]  Stefanos Nikolaidis,et al.  Human-robot cross-training: Computational formulation, modeling and evaluation of a human team training strategy , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[47]  Alicia Casals,et al.  Design and Development of a Guideline for Ergonomic Haptic Interaction , 2012 .

[48]  Holly A. Yanco,et al.  Evolving interface design for robot search tasks , 2007, J. Field Robotics.