Workload assessment of surgeons: correlation between NASA TLX and blinks

BackgroundBlinks are known as an indicator of visual attention and mental stress. In this study, surgeons’ mental workload was evaluated utilizing a paper assessment instrument (National Aeronautics and Space Administration Task Load Index, NASA TLX) and by examining their eye blinks. Correlation between these two assessments was reported.MethodsSurgeons’ eye motions were video-recorded using a head-mounted eye-tracker while the surgeons performed a laparoscopic procedure on a virtual reality trainer. Blink frequency and duration were computed using computer vision technology. The level of workload experienced during the procedure was reported by surgeons using the NASA TLX.ResultsA total of 42 valid videos were recorded from 23 surgeons. After blinks were computed, videos were divided into two groups based on the blink frequency: infrequent group (≤6 blinks/min) and frequent group (more than 6 blinks/min). Surgical performance (measured by task time and trajectories of tool tips) was not significantly different between these two groups, but NASA TLX scores were significantly different. Surgeons who blinked infrequently reported a higher level of frustration (46 vs. 34, P = 0.047) and higher overall level of workload (57 vs. 47, P = 0.045) than those who blinked more frequently. The correlation coefficients (Pearson test) between NASA TLX and the blink frequency and duration were −0.17 and 0.446.ConclusionReduction of blink frequency and shorter blink duration matched the increasing level of mental workload reported by surgeons. The value of using eye-tracking technology for assessment of surgeon mental workload was shown.

[1]  Joel S. Warm,et al.  Perceptual Distortions Produce Multidimensional Stress Profiles in Novice Users of an Endoscopic Surgery Simulator , 2008, Hum. Factors.

[2]  A. Cuschieri Visual Displays and Visual Perception in Minimal Access Surgery , 1995, Seminars in laparoscopic surgery.

[3]  Kilseop Ryu,et al.  Evaluation of mental workload with a combined measure based on physiological indices during a dual task of tracking and mental arithmetic , 2005 .

[4]  M. Hegarty,et al.  Spatial ability, experience, and skill in laparoscopic surgery. , 2004, American journal of surgery.

[5]  Ramon Berguer,et al.  A comparison of the physical effort required for laparoscopic and open surgical techniques. , 2003, Archives of surgery.

[6]  Simone Benedetto,et al.  Driver workload and eye blink duration , 2011 .

[7]  Colin Swindells,et al.  Surgeon's vigilance in the operating room. , 2011, American journal of surgery.

[8]  W. B. Seales,et al.  Assessing Mental Workload During Laparoscopic Surgery , 2005, Surgical innovation.

[9]  C. Cao,et al.  Guiding navigation in colonoscopy , 2007, Surgical Endoscopy.

[10]  Bin Zheng,et al.  Measuring mental workload during the performance of advanced laparoscopic tasks , 2009, Surgical Endoscopy.

[11]  P. Caffier,et al.  Experimental evaluation of eye-blink parameters as a drowsiness measure , 2003, European Journal of Applied Physiology.

[12]  Mubarak Shah,et al.  Monitoring head/eye motion for driver alertness with one camera , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[13]  D. Gaba,et al.  Trainee fatigue: Are new limits on work hours enough? , 2004, Canadian Medical Association Journal.

[14]  Sandra P Marshall,et al.  Identifying cognitive state from eye metrics. , 2007, Aviation, space, and environmental medicine.

[15]  Franklin Dexter,et al.  Holiday and Weekend Operating Room On-Call Staffing Requirements , 2006, Anesthesia and analgesia.

[16]  Warren D. Smith,et al.  An ergonomic comparison of robotic and laparoscopic technique: the influence of surgeon experience and task complexity. , 2003, The Journal of surgical research.

[17]  J. Andreassi Psychophysiology: Human Behavior and Physiological Response , 1980 .

[18]  Adrian Park,et al.  Quantifying mental workloads of surgeons performing natural orifice transluminal endoscopic surgery (NOTES) procedures , 2011, Surgical Endoscopy.

[19]  Joseph J. Tecce Psychophysiology: human behavior and physiological response (4th ed.) , 2001 .

[20]  Daniel B. Jones,et al.  Construct and face validity and task workload for laparoscopic camera navigation: virtual reality versus videotrainer systems at the SAGES Learning Center , 2007, Surgical Endoscopy.

[21]  C. Cao,et al.  How much feedback is necessary for learning to suture? , 2008, Surgical Endoscopy.

[22]  Lawrence W. Stark,et al.  Sensing and Manipulation Problems in Endoscopic Surgery: Experiment, Analysis, and Observation , 1993, Presence: Teleoperators & Virtual Environments.

[23]  Warren D. Smith,et al.  Performing laparoscopic surgery is significantly more stressful for the surgeon than open surgery , 2001, Surgical Endoscopy.

[24]  J. Veltman,et al.  Physiological workload reactions to increasing levels of task difficulty. , 1998, Ergonomics.