Real-time computerized video enhancement for minimally invasive fetoscopic surgery.

Background The only definitive treatment for twin-to-twin transfusion syndrome is minimally invasive fetoscopic surgery for the selective coagulation of placental blood vessels. Fetoscopic surgery is a technically challenging operation, mainly due to the poor visibility conditions in the uterine environment. We present the design of an algorithm for the computerized enhancement of fetoscopic video and show that the enhanced video increases the ability of human users to identify blood vessels within fetoscopic video rapidly and accurately. Methods A computer algorithm for the enhancement of fetoscopic video frames was created. First, optical fiber artifacts were removed via a modification of unsharp masking. Second, image contrast was increased via Contrast Limited Adaptive Histogram Equalization (CLAHE). Third, the effect of contrast enhancements on stationary features was removed by normalizing to a windowed mean of the video frames. Fourth, color information was reincorporated by combining the mean-normalized result with the unnormalized contrast enhanced image using the soft light blending algorithm. Medical trainees (n = 16) were recruited into a study to validate the algorithm. Subjects were shown enhanced or unenhanced fetoscopic video frames on a screen and were asked to identify whether a randomly placed marker fell on a blood vessel or on background. The accuracy of their responses was recorded. Results On the subset of images where subjects had the lowest mean accuracy in identifying the placement of the marker, subjects performed better when viewing video frames enhanced by the computer (accuracy 74.27%; SE 0.97) than when viewing unenhanced video frames (accuracy 63.78%; SE 2.79). This result was statistically significant (p < 0.01). Conclusion Real-time computerized enhancement of fetoscopic video has the potential to ease the readability of video in poor lighting conditions, thus providing a benefit to the surgeon intraoperatively.

[1]  G. Taylor.  Sharpening the image. , 2003, AJR. American journal of roentgenology.

[2]  S. Ourselin,et al.  Computer‐assisted surgical planning and intraoperative guidance in fetal surgery: a systematic review† , 2015, Prenatal diagnosis.

[3]  Guang Deng,et al.  A Generalized Unsharp Masking Algorithm , 2011, IEEE Transactions on Image Processing.

[4]  Benjamin E Padilla,et al.  Minimally Invasive Fetal Surgery. , 2017, Clinics in perinatology.

[5]  Ali M. Reza,et al.  Realization of the Contrast Limited Adaptive Histogram Equalization (CLAHE) for Real-Time Image Enhancement , 2004, J. VLSI Signal Process..

[6]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[7]  Jin U. Kang,et al.  Pixelation effect removal from fiber bundle probe based optical coherence tomography imaging , 2010, Optics express.

[8]  Feng Zhao,et al.  Iterative l(1)-min algorithm for fixed pattern noise removal in fiber-bundle-based endoscopic imaging. , 2016, Journal of the Optical Society of America. A, Optics, image science, and vision.

[9]  D. Skupski,et al.  The North American Fetal Therapy Network consensus statement: prenatal surveillance of uncomplicated monochorionic gestations. , 2015, Obstetrics and gynecology.

[10]  Sos S. Agaian,et al.  Nonlinear Unsharp Masking for Mammogram Enhancement , 2011, IEEE Transactions on Information Technology in Biomedicine.

[11]  Bradley M. Hemminger,et al.  Contrast Limited Adaptive Histogram Equalization image processing to improve the detection of simulated spiculations in dense mammograms , 1998, Journal of Digital Imaging.

[12]  S. Pizer,et al.  An evaluation of the effectiveness of adaptive histogram equalization for contrast enhancement. , 1988, IEEE transactions on medical imaging.

[13]  D. Skupski,et al.  The North American Fetal Therapy Network Consensus Statement: prenatal management of uncomplicated monochorionic gestations. , 2015, Obstetrics and gynecology.