A Usability Study of a Gesture Recognition System Applied During the Surgical Procedures

Within an operating room, surgeons need to interact with a large amount of patient’s medical information and data. In order to avoid misunderstandings among the staff and protecting the patient safety, the medical staff may use a touchless interaction system that allows the surgeons to directly interact with digital devices that visualize digital images. The RISO project aims to create a gesture recognition system for the visualization and manipulation of medical images, useful for the surgeons even during the surgical procedures. In this paper we show the main findings from a usability study carried out with the aim to evaluate, among others, the learnability of the system and the memorability of the gestures employed for the interaction.

[1]  Mario Ciampi,et al.  Controller-free exploration of medical image data: Experiencing the Kinect , 2011, 2011 24th International Symposium on Computer-Based Medical Systems (CBMS).

[2]  Juan Pablo Wachs,et al.  Intention, Context and Gesture Recognition for Sterile MRI Navigation in the Operating Room , 2012, CIARP.

[3]  Ulrich G. Hofmann,et al.  Touch- and marker-free interaction with medical software , 2009 .

[4]  R. Röhrig,et al.  Computer Keyboard and Mouse as a Reservoir of Pathogens in an Intensive Care Unit , 2003, Journal of Clinical Monitoring and Computing.

[5]  Osman Ratib,et al.  OsiriX: An Open-Source Software for Navigating in Multidimensional DICOM Images , 2004, Journal of Digital Imaging.

[6]  Yael Edan,et al.  A Real-Time Hand Gesture Interface for Medical Visualization Applications , 2006 .

[7]  Joachim Hornegger,et al.  3-D gesture-based scene navigation in medical imaging applications using Time-of-Flight cameras , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[8]  Oscar Mauricio Serrano Jaimes,et al.  EVALUACION DE LA USABILIDAD EN SITIOS WEB, BASADA EN EL ESTANDAR ISO 9241-11 (International Standard (1998) Ergonomic requirements For office work with visual display terminals (VDTs)-Parts II: Guidance on usability , 2012 .

[9]  Rajkumar Roy,et al.  Applications of Soft Computing , 2009 .

[10]  Guilherme C. S. Ruppert,et al.  Touchless gesture user interface for interactive image visualization in urological surgery , 2012, World Journal of Urology.

[11]  Lars C. Ebert,et al.  Invisible touch—Control of a DICOM viewer with finger gestures using the Kinect depth camera , 2013 .

[12]  Michael J Thali,et al.  You Can’t Touch This , 2012, Surgical innovation.