SLIM (slit lamp image mosaicing): handling reflection artifacts

PurposeThe slit lamp is an essential instrument for eye care. It is used in navigated laser treatment with retina mosaicing to assist diagnosis. Specifics of the imaging setup introduce bothersome illumination artifacts. They not only degrade the quality of the mosaic but may also affect the diagnosis. Existing solutions in SLIM manage to deal with strong glares which corrupt the retinal content entirely while leaving aside the correction of semitransparent specular highlights and lens flare. This introduces ghosting and information loss.MethodsWe propose an effective technique to detect and correct light reflections of different degrees in SLIM. We rely on the specular-free image concept to obtain glare-free image and use it coupled with a contextually driven probability map to segment the visible part of the retina in every frame before image mosaicing. We then perform the image blending on a subset of all spatially aligned frames. We detect the lens flare and label each pixel as ‘flare’ or ‘non flare’ using a probability map. We then invoke an adequate blending method. We also introduce a new quantitative measure for global photometric quality.ResultsWe tested on a set of video sequences obtained from slit lamp examination sessions of 11 different patients presenting healthy and unhealthy retinas. The segmentation of glare and visible retina was evaluated and compared to state-of-the-art methods. The correction of lens flare and semitransparent highlight with content-aware blending was applied and its performance was evaluated qualitatively and quantitatively.ConclusionThe experiments demonstrated that integrating the proposed method to the mosaicing framework significantly improves the global photometric quality of the mosaics and outperforms existing works in SLIM.

[1]  J W Berger,et al.  Mosaicking and enhancement of slit lamp biomicroscopic fundus images , 2001, The British journal of ophthalmology.

[2]  In-So Kweon,et al.  Specular Reflection Separation Using Dark Channel Prior , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Farida Cheriet,et al.  Detection and correction of specular reflections for automatic surgical tool segmentation in thoracoscopic images , 2007, Machine Vision and Applications.

[4]  Adrien Bartoli,et al.  Automatic Detection of the Uterus and Fallopian Tube Junctions in Laparoscopic Images , 2015, IPMI.

[5]  Guanghui Liu,et al.  Automatic Reflection Removal using Gradient Intensity and Motion Cues , 2016, ACM Multimedia.

[6]  E. Reinhard Photographic Tone Reproduction for Digital Images , 2002 .

[7]  Yongbing Zhang,et al.  Accurate image specular highlight removal based on light field imaging , 2015, 2015 Visual Communications and Image Processing (VCIP).

[8]  Adrien Bartoli,et al.  A comparative study of transformation models for the sequential mosaicing of long retinal sequences of slit-lamp images obtained in a closed-loop motion , 2016, International Journal of Computer Assisted Radiology and Surgery.

[9]  Adrien Bartoli,et al.  Live image parsing in uterine laparoscopy , 2014, 2014 IEEE 11th International Symposium on Biomedical Imaging (ISBI).

[10]  Holger Lange,et al.  Automatic glare removal in reflectance imagery of the uterine cervix , 2005, SPIE Medical Imaging.

[11]  Adrien Bartoli,et al.  Reducing Drift in Mosaicing Slit-Lamp Retinal Images , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[12]  Russell H. Taylor,et al.  Fundus Image Mosaicking for Information Augmentation in Computer-Assisted Slit-Lamp Imaging , 2014, IEEE Transactions on Medical Imaging.

[13]  Ruigang Yang,et al.  A Uniform Framework for Estimating Illumination Chromaticity, Correspondence, and Specular Reflection , 2011, IEEE Transactions on Image Processing.

[14]  Luc Van Gool,et al.  Robust aerial object tracking in images with lens flare , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[15]  Christoph Tappeiner,et al.  Retinal slit lamp video mosaicking , 2016, International Journal of Computer Assisted Radiology and Surgery.

[16]  Sébastien Ourselin,et al.  Toward Detection and Localization of Instruments in Minimally Invasive Surgery , 2013, IEEE Transactions on Biomedical Engineering.

[17]  Honggang Zhang,et al.  Chromaticity-based separation of reflection components in a single image , 2008, Pattern Recognit..

[18]  Marie-Pierre Jolly,et al.  Interactive Organ Segmentation Using Graph Cuts , 2000, MICCAI.

[19]  Katsushi Ikeuchi,et al.  Separating Reflection Components of Textured Surfaces Using a Single Image , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Narendra Ahuja,et al.  Real-Time Specular Highlight Removal Using Bilateral Filtering , 2010, ECCV.