Chromaticity based smoke removal in endoscopic images

In minimally invasive surgery, image quality is a critical pre-requisite to ensure a surgeons ability to perform a procedure. In endoscopic procedures, image quality can deteriorate for a number of reasons such as fogging due to the temperature gradient after intra-corporeal insertion, lack of focus and due to smoke generated when using electro-cautery to dissect tissues without bleeding. In this paper we investigate the use of vision processing techniques to remove surgical smoke and improve the clarity of the image. We model the image formation process by introducing a haze medium to account for the degradation of visibility. For simplicity and computational efficiency we use an adapted dark-channel prior method combined with histogram equalization to remove smoke artifacts to recover the radiance image and enhance the contrast and brightness of the final result. Our initial results on images from robotic assisted procedures are promising and show that the proposed approach may be used to enhance image quality during surgery without additional suction devices. In addition, the processing pipeline may be used as an important part of a robust surgical vision pipeline that can continue working in the presence of smoke.

[1]  Robby T. Tan,et al.  Visibility in bad weather from a single image , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Tingting Zhang,et al.  Real-time enhancement of the image clarity for traffic video monitoring systems in haze , 2014, 2014 7th International Congress on Image and Signal Processing.

[3]  Guang-Zhong Yang,et al.  Intra-Operative Visualizations: Perceptual Fidelity and Human Factors , 2008, Journal of Display Technology.

[4]  Lena Maier-Hein,et al.  Comparative Validation of Single-Shot Optical Techniques for Laparoscopic 3-D Surface Reconstruction , 2014, IEEE Transactions on Medical Imaging.

[5]  Brenda C Ulmer,et al.  The hazards of surgical smoke. , 2008, AORN journal.

[6]  Hans-Peter Seidel,et al.  3D-modeling by ortho-image generation from image sequences , 2008, ACM Trans. Graph..

[7]  G. C. S.,et al.  Beiträge zur Physik der freien Atmosphäre , 1905, Nature.

[8]  Danail Stoyanov,et al.  Surgical Vision , 2011, Annals of Biomedical Engineering.

[9]  Kay Ball,et al.  Surgical smoke evacuation guidelines: compliance among perioperative nurses. , 2010, AORN journal.

[10]  Xiaoou Tang,et al.  Single Image Haze Removal Using Dark Channel Prior , 2011 .

[11]  Shree K. Nayar,et al.  Vision in bad weather , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[12]  Jizhou Sun,et al.  Local albedo-insensitive single image dehazing , 2010, The Visual Computer.

[13]  Raanan Fattal,et al.  Single image dehazing , 2008, ACM Trans. Graph..

[14]  Theo Gevers,et al.  Color Constancy Using Natural Image Statistics and Scene Semantics , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.