Segmenting the Uterus in Monocular Laparoscopic Images without Manual Input

Automatically segmenting organs in monocular laparoscopic images is an important and challenging research objective in computer-assisted intervention. For the uterus this is difficult because of high inter-patient variability in tissue appearance and low-contrast boundaries with the surrounding peritoneum. We present a framework to segment the uterus which is completely automatic, requires only a single monocular image, and does not require a 3D model. Our idea is to use a patient-independent uterus detector to roughly localize the organ, which is then used as a supervisor to train a patient-specific organ segmenter. The segmenter uses a physically-motivated organ boundary model designed specifically for illumination in laparoscopy, which is fast to compute and gives strong segmentation constraints. Our segmenter uses a lightweight CRF that is solved quickly and globally with a single graphcut. On a dataset of 220 images our method obtains a mean DICE score of 92.9%.

[1]  Daniel Pizarro-Perez,et al.  Realtime Wide-Baseline Registration of the Uterus in Laparoscopic Videos Using Multiple Texture Maps , 2013, AE-CAI.

[2]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Scott Cohen,et al.  Geodesic graph cut for interactive image segmentation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[4]  Marie-Pierre Jolly,et al.  Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[5]  Ghassan Hamarneh,et al.  Efficient Multi-organ Segmentation in Multi-view Endoscopic Videos Using Pre-operative Priors , 2014, MICCAI.

[6]  Adrien Bartoli,et al.  Live image parsing in uterine laparoscopy , 2014, 2014 IEEE 11th International Symposium on Biomedical Imaging (ISBI).

[7]  Vladimir Vezhnevets,et al.  “GrowCut” - Interactive Multi-Label N-D Image Segmentation By Cellular Automata , 2005 .

[8]  Daniel Pizarro-Perez,et al.  Computer-Assisted Laparoscopic myomectomy by augmenting the uterus with pre-operative MRI data , 2014, 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[9]  Adrien Bartoli,et al.  Automatic Detection of the Uterus and Fallopian Tube Junctions in Laparoscopic Images , 2015, IPMI.

[10]  Adrien Bartoli,et al.  Template-Based Conformal Shape-from-Motion-and-Shading for Laparoscopy , 2012, IPCAI.

[11]  Adrien Bartoli,et al.  Towards Live Monocular 3D Laparoscopy Using Shading and Specularity Information , 2012, IPCAI.

[12]  François Fleuret,et al.  Exact Acceleration of Linear Object Detectors , 2012, ECCV.

[13]  Marie-Pierre Jolly,et al.  Interactive Graph Cuts for Optimal Boundary and Region Segmentation of Objects in N-D Images , 2001, ICCV.

[14]  Sébastien Ourselin,et al.  2D-3D Pose Tracking of Rigid Instruments in Minimally Invasive Surgery , 2014, IPCAI.

[15]  Chunming Li,et al.  Distance Regularized Level Set Evolution and Its Application to Image Segmentation , 2010, IEEE Transactions on Image Processing.

[16]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..