A video stream processor for real-time detection and correction of specular reflections in endoscopic images

This paper presents the architecture and FPGA implementation of a video processor for detection and correction of specular reflections in endoscopic images by using an inpainting algorithm. Stream processing and parallelism are used to exceed real-time performance on NTSC format video without the need for an external memory. The system was implemented in a XC2VP30 FPGA and uses 91% of available slices. Image quality is significantly enhanced.

[1]  C. T. Johnston.  Implementing Image Processing Algorithms on FPGAs , 2005 .

[2]  F. Ortiz,et al.  Automatic detection and elimination of specular reflectance in color images by means of MS diagram and vector connected filters , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[3]  Wang Yongtian,et al.  Navigating System for Endoscopic Sinus Surgery Based on Augmented Reality , 2007, 2007 IEEE/ICME International Conference on Complex Medical Engineering.

[4]  Jisnu Bhattacharyya,et al.  Detecting and Removing Specularities and Shadows in Images , 2004 .

[5]  Danny Crookes,et al.  Parallel architectures for image processing , 1998 .

[6]  Tobias Ortmaier,et al.  Reconstruction of Image Structure in Presence of Specular Reflections , 2001, DAGM-Symposium.

[7]  Guillermo Sapiro,et al.  Navier-stokes, fluid dynamics, and image and video inpainting , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[8]  Farida Cheriet,et al.  Detection and correction of specular reflections for automatic surgical tool segmentation in thoracoscopic images , 2007, Machine Vision and Applications.