Closed Contour Specular Reflection Segmentation in Laparoscopic Images

Segmentation of specular reflections is an essential step in endoscopic image analysis; it affects all further processing steps including segmentation, classification, and registration tasks. The dichromatic reflectance model, which is often used for specular reflection modeling, is made for dielectric materials and not for human tissue. Hence, most recent segmentation approaches rely on thresholding techniques. In this work, we first demonstrate the limited accuracy that can be achieved by thresholding techniques and propose a hybrid method which is based on closed contours and thresholding. The method has been evaluated on 269 specular reflections in 49 images which were taken from 27 real laparoscopic interventions. Our method improves the average sensitivity by 16% compared to the state-of-the-art thresholding methods.

[1]  Steven A. Shafer,et al.  Anatomy of a color histogram , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[2]  Steven A. Shafer,et al.  Using color to separate reflection components , 1985 .

[3]  Farida Cheriet,et al.  Detection and correction of specular reflections for automatic surgical tool segmentation in thoracoscopic images , 2007, Machine Vision and Applications.

[4]  Jung-Hwan Oh,et al.  Informative frame classification for endoscopy video , 2007, Medical Image Anal..

[5]  Avinash C. Kak,et al.  A truncated least squares approach to the detection of specular highlights in color images , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[6]  Gerard Lacey,et al.  Automatic Segmentation and Inpainting of Specular Highlights for Endoscopic Imaging , 2010, EURASIP J. Image Video Process..

[7]  Theo Gevers,et al.  Classifying color edges in video into shadow-geometry, highlight, or material transitions , 2003, IEEE Trans. Multim..

[8]  Takeo Kanade,et al.  The measurement of highlights in color images , 1988, International Journal of Computer Vision.

[9]  Claude L. Fennema,et al.  Scene Analysis Using Regions , 1970, Artif. Intell..

[10]  Marc Ebner,et al.  Color Constancy , 2007, Computer Vision, A Reference Guide.

[11]  Heinrich Niemann,et al.  Highlight substitution in light fields , 2002, Proceedings. International Conference on Image Processing.

[12]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Joseph A. Izatt,et al.  Automatic segmentation of closed-contour features in ophthalmic images using graph theory and dynamic programming , 2012, Biomedical optics express.

[14]  Dmitry Chetverikov,et al.  A Survey of Specularity Removal Methods , 2011, Comput. Graph. Forum.

[15]  Stephen Lin,et al.  Highlight removal by illumination-constrained inpainting , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[16]  Thomas Stehle Specular Reflection Removal in Endoscopic Images , 2006 .

[17]  Othmane El Meslouhi,et al.  Automatic detection and inpainting of specular reflections for colposcopic images , 2011, Central European Journal of Computer Science.

[18]  Guang-Zhong Yang,et al.  Removing specular reflection components for robotic assisted laparoscopic surgery , 2005, IEEE International Conference on Image Processing 2005.

[19]  P. Jaccard,et al.  Etude comparative de la distribution florale dans une portion des Alpes et des Jura , 1901 .

[20]  Loong Fah Cheong,et al.  Active segmentation with fixation , 2009, 2009 IEEE 12th International Conference on Computer Vision.