Automatic Detection of the Uterus and Fallopian Tube Junctions in Laparoscopic Images

We present a method for the automatic detection of the uterus and the Fallopian tube/Uterus junctions (FU-junctions) in a monocular laparoscopic image. The main application is to perform automatic registration and fusion between preoperative radiological images of the uterus and laparoscopic images for image-guided surgery. In the broader context of computer assisted intervention, our method is the first that detects an organ and registration landmarks from laparoscopic images without manual input. Our detection problem is challenging because of the large inter-patient anatomical variability and pathologies such as uterine fibroids. We solve the problem using learned contextual geometric constraints that statistically model the positions and orientations of the FU-junctions relative to the uterus' body. We train the uterus detector using a modern part-based approach and the FU-junction detector using junction-specific context-sensitive features. We have trained and tested on a database of 95 uterus images with cross validation, and successfully detected the uterus with Recall = 0.95 and average Number of False Positives per Image (NFPI) = 0.21, and FU-junctions with Recall = 0.80 and NFPI = 0.50. Our experimental results show that the contextual constraints are fundamental to achieve high quality detection.

[1]  Nazim Haouchine,et al.  Automatic Alignment of Pre and Intraoperative Data Using Anatomical Landmarks for Augmented Laparoscopic Liver Surgery , 2014, ISBMS.

[2]  Luc Van Gool,et al.  The 2005 PASCAL Visual Object Classes Challenge , 2005, MLCW.

[3]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[4]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[5]  Ross B. Girshick,et al.  From rigid templates to grammars: object detection with structured models , 2012 .

[6]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Ping Chen,et al.  Automated detection of fetal nuchal translucency based on hierarchical structural model , 2010, 2010 IEEE 23rd International Symposium on Computer-Based Medical Systems (CBMS).

[8]  Sébastien Ourselin,et al.  Toward Detection and Localization of Instruments in Minimally Invasive Surgery , 2013, IEEE Transactions on Biomedical Engineering.

[9]  Guojun Lu,et al.  Robust Image Corner Detection Based on the Chord-to-Point Distance Accumulation Technique , 2008, IEEE Transactions on Multimedia.

[10]  Guillaume Bouchard,et al.  Hierarchical part-based visual object categorization , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[11]  Nazim Haouchine,et al.  Image-guided simulation of heterogeneous tissue deformation for augmented reality during hepatic surgery , 2013, 2013 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[12]  Russell H. Taylor,et al.  Augmented reality during robot-assisted laparoscopic partial nephrectomy: toward real-time 3D-CT to stereoscopic video registration. , 2009, Urology.

[13]  Julie Delon,et al.  Accurate Junction Detection and Characterization in Natural Images , 2013, International Journal of Computer Vision.

[14]  Anand Rangarajan,et al.  The Softassign Procrustes Matching Algorithm , 1997, IPMI.

[15]  Daniel Pizarro-Perez,et al.  Realtime Wide-Baseline Registration of the Uterus in Laparoscopic Videos Using Multiple Texture Maps , 2013, AE-CAI.

[16]  Jianguo Zhang,et al.  The PASCAL Visual Object Classes Challenge , 2006 .

[17]  R. Abugharbieh,et al.  Towards multi-modal image-guided tumour identification in robot-assisted partial nephrectomy , 2014, 2nd Middle East Conference on Biomedical Engineering.

[18]  Daniel Pizarro-Perez,et al.  Computer-Assisted Laparoscopic myomectomy by augmenting the uterus with pre-operative MRI data , 2014, 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[19]  Heng Huang,et al.  Lung Nodule Classification With Multilevel Patch-Based Context Analysis , 2014, IEEE Transactions on Biomedical Engineering.

[20]  H. Meinzer,et al.  Augmented reality visualization during laparoscopic radical prostatectomy. , 2011, Journal of endourology.