Classification of surgical processes using dynamic time warping

In the creation of new computer-assisted intervention systems, Surgical Process Models (SPMs) are an emerging concept used for analyzing and assessing surgical interventions. SPMs represent Surgical Processes (SPs) which are formalized as symbolic structured descriptions of surgical interventions using a pre-defined level of granularity and a dedicated terminology. In this context, one major challenge is the creation of new metrics for the comparison and the evaluation of SPs. Thus, correlations between these metrics and pre-operative data are used to classify surgeries and highlight specific information on the surgery itself and on the surgeon, such as his/her level of expertise. In this paper, we explore the automatic classification of a set of SPs based on the Dynamic Time Warping (DTW) algorithm. DTW is used to compute a similarity measure between two SPs that focuses on the different types of activities performed during surgery and their sequencing, by minimizing time differences. Indeed, it turns out to be a complementary approach to the classical methods that only focus on differences in the time and the number of activities. Experiments were carried out on 24 lumbar disk herniation surgeries to discriminate the surgeons level of expertise according to a prior classification of SPs. Supervised and unsupervised classification experiments have shown that this approach was able to automatically identify groups of surgeons according to their level of expertise (senior and junior), and opens many perspectives for the creation of new metrics for comparing and evaluating surgeries.

[1]  Gero Strauß,et al.  Acquisition of Process Descriptions from Surgical Interventions , 2006, DEXA.

[2]  Kaspar Althoefer,et al.  IEEE INT CONF ROBOT & AUTOMAT , 2003 .

[3]  Pierre Jannin,et al.  Effects of low dose protocols in neurointerventional procedures: a workflow analysis study , 2011 .

[4]  Jenny Dankelman,et al.  Analysis of the quality and efficiency in learning laparoscopic skills , 2009, Surgical Endoscopy.

[5]  L. MacKenzie,et al.  Hierarchical decomposition of laparoscopic surgery: a human factors approach to investigating the operating room environment , 2001, Minimally invasive therapy & allied technologies : MITAT : official journal of the Society for Minimally Invasive Therapy.

[6]  Ulrich Kohler,et al.  Sequence Analysis with Stata , 2006 .

[7]  Thomas Neumuth,et al.  Linking Top-Level Ontologies and Surgical Workflows , 2006 .

[8]  Jones Mark,et al.  Surgeon specific mortality in adult cardiac surgery: comparison between crude and risk stratified data , 2003, BMJ : British Medical Journal.

[9]  John Kenneth Salisbury,et al.  The Intuitive/sup TM/ telesurgery system: overview and application , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[10]  Vimla L. Patel,et al.  Toward automated workflow analysis and visualization in clinical environments , 2011, J. Biomed. Informatics.

[11]  A. Darzi,et al.  The use of electromagnetic motion tracking analysis to objectively measure open surgical skill in the laboratory-based model. , 2001, Journal of the American College of Surgeons.

[12]  W. J. Howe Organizational Management in Workflow Applications – Issues and Perspectives , 2003 .

[13]  J. Doyle,et al.  A universal global rating scale for the evaluation of technical skills in the operating room. , 2007, American journal of surgery.

[14]  S. T. Buckland,et al.  An Introduction to the Bootstrap. , 1994 .

[15]  T. Neumuth,et al.  Structured recording of intraoperative surgical workflows , 2006, SPIE Medical Imaging.

[16]  Roque Marín,et al.  Temporal similarity measures for querying clinical workflows , 2009, Artif. Intell. Medicine.

[17]  Activité ad‐hoc Types de tâches Introduction to BPMN , 2004 .

[18]  Nassir Navab,et al.  Modeling and Segmentation of Surgical Workflow from Laparoscopic Video , 2010, MICCAI.

[19]  Thomas Neumuth,et al.  Analysis of surgical intervention populations using generic surgical process models , 2010, International Journal of Computer Assisted Radiology and Surgery.

[20]  S. Chiba,et al.  Dynamic programming algorithm optimization for spoken word recognition , 1978 .

[21]  Nassir Navab,et al.  On-line Recognition of Surgical Activity for Monitoring in the Operating Room , 2008, AAAI.

[22]  Wil M. P. van der Aalst,et al.  Beyond Process Mining: From the Past to Present and Future , 2010, CAiSE.

[23]  P S White,et al.  Using human reliability analysis to detect surgical error in endoscopic DCR surgery. , 2003, Clinical otolaryngology and allied sciences.

[24]  Pierre Gançarski,et al.  A global averaging method for dynamic time warping, with applications to clustering , 2011, Pattern Recognit..

[25]  Stefani Scherer,et al.  Early Career Patterns - A Comparison of Great Britain and West Germany , 2001 .

[26]  Nassir Navab,et al.  Statistical modeling and recognition of surgical workflow , 2012, Medical Image Anal..

[27]  J Dankelman,et al.  Systems for tracking minimally invasive surgical instruments , 2007, Minimally invasive therapy & allied technologies : MITAT : official journal of the Society for Minimally Invasive Therapy.

[28]  Peter Fu-Ming Hu,et al.  Real-Time Identification of Operating Room State from Video , 2007, AAAI.

[29]  Henry C. Lin,et al.  Review of methods for objective surgical skill evaluation , 2011, Surgical Endoscopy.

[30]  Alfred Cuschieri,et al.  The performance of master surgeons on the Advanced Dundee Endoscopic Psychomotor Tester: contrast validity study. , 2002, Archives of surgery.

[32]  Pierre Jannin,et al.  Surgical models for computer-assisted neurosurgery , 2007, NeuroImage.

[33]  Anil K. Jain Data clustering: 50 years beyond K-means , 2008, Pattern Recognit. Lett..

[34]  Gero Strauß,et al.  Research Paper: Validation of Knowledge Acquisition for Surgical Process Models , 2009, J. Am. Medical Informatics Assoc..

[35]  A. Darzi,et al.  Objective assessment of technical skills in surgery , 2003, BMJ : British Medical Journal.

[36]  Hinrich Schütze,et al.  Book Reviews: Foundations of Statistical Natural Language Processing , 1999, CL.

[37]  Guang-Zhong Yang,et al.  Eye-Gaze Driven Surgical Workflow Segmentation , 2007, MICCAI.

[38]  Blake Hannaford,et al.  Markov modeling of minimally invasive surgery based on tool/tissue interaction and force/torque signatures for evaluating surgical skills , 2001, IEEE Transactions on Biomedical Engineering.

[39]  Wil M. P. van der Aalst,et al.  Process Mining - Discovery, Conformance and Enhancement of Business Processes , 2011 .

[40]  P. Jannin,et al.  Model of Surgical Procedures for Multimodal Image-Guided Neurosurgery , 2003, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[41]  T. Neumuth,et al.  Recording of Surgical Processes: A Study Comparing Senior and Junior Neurosurgeons During Lumbar Disc Herniation Surgery , 2010, Neurosurgery.

[42]  R. Reznick,et al.  Testing technical skill via an innovative "bench station" examination. , 1997, American journal of surgery.

[43]  M. Ceschia,et al.  An observation support system with an adaptive ontology-driven user interface for the modeling of complex behaviors during surgical interventions , 2010, Behavior research methods.

[44]  Chitta Baral,et al.  Fuzzy C-means Clustering with Prior Biological Knowledge , 2022 .

[45]  Jenny Dankelman,et al.  Discovery of high-level tasks in the operating room , 2011, J. Biomed. Informatics.