Comparative usability and performance evaluation of surgeon interfaces in laser phonomicrosurgery

Robot-assisted surgical procedures, such as Laser Phonomicrosurgery (LP), suffer from susceptibility to variation in surgeon skill and equipment characteristics. Ergonomic and human-centered approaches acquire increased importance in the design of surgeon-machine interfaces. This paper proposes a protocol for comparative evaluation of surgeon-machine interfaces based on two criteria: (i) the subjective evaluation of their usability using questionnaires, and (ii) the objective evaluation of their performance using an imaging-based feature extraction method. Two interfaces in LP, the traditional (“AcuBlade”) interface and the novel (“Virtual Scalpel”) interface, were evaluated to demonstrate the effectiveness of the proposed scheme. A series of experimental trials were conducted using the interfaces in surgery-like tasks in a controlled environment. The subjective evaluation pointed to the superiority of the Virtual Scalpel interface (score: 83.06) in terms of confidence and ease of use, and learnability, over the AcuBlade interface (score: 65.56). The objective evaluation showed the Virtual Scalpel interface having an overall score (55.96) significantly superior to the AcuBlade (51.37). It is thus shown that the multidimensional evaluation approach allowed to clearly distinguish between levels of perceived usability and effective performance of surgeon-machine interfaces from a user-centered perspective.

[1]  Welch Bl THE GENERALIZATION OF ‘STUDENT'S’ PROBLEM WHEN SEVERAL DIFFERENT POPULATION VARLANCES ARE INVOLVED , 1947 .

[2]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[3]  Mats Lind,et al.  Time Estimation as a Measure of Mental Workload , 2007, HCI.

[4]  Sandra Martelli,et al.  Criteria of interface evaluation for computer assisted surgery systems , 2003, Int. J. Medical Informatics.

[5]  Giulio Dagnino,et al.  Imaging based metrics for performance assessment in laser phonomicrosurgery , 2013, 2013 IEEE International Conference on Robotics and Automation.

[6]  Martin G. Helander,et al.  A guide to human factors and ergonomics (2. ed.) , 2006 .

[7]  David Kerr,et al.  A methodology for design and appraisal of surgical robotic systems , 2009, Robotica.

[8]  H Das,et al.  Evaluation of a telerobotic system to assist surgeons in microsurgery. , 1999, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[9]  Ergonomic requirements for office work with visual display terminals ( VDTs ) — Part 11 : Guidance on usability , 1998 .

[10]  S. Serefoglou,et al.  Multimodal user interface for a semi-robotic visual assistance system for image guided neurosurgery , 2005 .

[11]  Russell H. Taylor,et al.  Control and evaluation of a 7-axis surgical robot for laparoscopy , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[12]  Giulio Dagnino,et al.  A virtual scalpel system for computer-assisted laser microsurgery , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Mamoru Mitsuishi,et al.  Design of intuitive user interface for Multi-DOF forceps for laparoscopic surgery , 2011, 2011 IEEE International Conference on Robotics and Automation.

[14]  Darwin G. Caldwell,et al.  Next-generation micromanipulator for computer-assisted laser phonomicrosurgery , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[15]  Thomas E. Nygren,et al.  Psychometric Properties of Subjective Workload Measurement Techniques: Implications for Their Use in the Assessment of Perceived Mental Workload , 1991 .

[16]  Giulio Dagnino,et al.  New software tools for enhanced precision in robot-assisted laser phonomicrosurgery , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[17]  C. A. Boneau,et al.  The effects of violations of assumptions underlying the test. , 1960, Psychological bulletin.

[18]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .