Enhanced video indirect ophthalmoscopy (VIO) via robust mosaicing

Indirect ophthalmoscopy (IO) is the standard of care for evaluation of the neonatal retina. When recorded on video from a head-mounted camera, IO images have low quality and narrow Field of View (FOV). We present an image fusion methodology for converting a video IO recording into a single, high quality, wide-FOV mosaic that seamlessly blends the best frames in the video. To this end, we have developed fast and robust algorithms for automatic evaluation of video quality, artifact detection and removal, vessel mapping, registration, and multi-frame image fusion. Our experiments show the effectiveness of the proposed methods.

[1]  E. Peli.  Contrast in complex images. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[2]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using unit quaternions , 1987 .

[3]  S. T. Clay,et al.  Computerized analysis of retinal vessel width and tortuosity in premature infants. , 2008, Investigative ophthalmology & visual science.

[4]  Y. Heyden,et al.  Robust statistics in data analysis — A review: Basic concepts , 2007 .

[5]  Joseph Y. Lo,et al.  Efficient Fourier-Wavelet Super-Resolution , 2010, IEEE Transactions on Image Processing.

[6]  Mario Dagenais,et al.  Focus and edge detection algorithms and their relevance to the development of an optical overlay calibration standard , 1999, Advanced Lithography.

[7]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[9]  Francis K. H. Quek,et al.  A review of vessel extraction techniques and algorithms , 2004, CSUR.

[10]  K. M. Simonson,et al.  A Statistics-Based Approach to Binary Image Registration with Uncertainty Analysis , 2007 .

[11]  A. Fulton,et al.  Diagnosis of plus disease in retinopathy of prematurity using Retinal Image multiScale Analysis. , 2005, Investigative ophthalmology & visual science.

[12]  George Wolberg,et al.  Robust image registration using log-polar transform , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[13]  William J. Christmas,et al.  Fast robust correlation , 2005, IEEE Transactions on Image Processing.

[14]  Jing Li Wang,et al.  Color image segmentation: advances and prospects , 2001, Pattern Recognit..

[15]  Michael F Chiang,et al.  Agreement among pediatric ophthalmologists in diagnosing plus and pre-plus disease in retinopathy of prematurity. , 2008, Journal of AAPOS : the official publication of the American Association for Pediatric Ophthalmology and Strabismus.

[16]  Peyman Milanfar,et al.  Optimal Registration Of Aliased Images Using Variable Projection With Applications To Super-Resolution , 2008, Comput. J..

[17]  Changming Sun,et al.  De-interlacing of video images using a shortest path technique , 2001, IEEE Trans. Consumer Electron..

[18]  B. N. Chatterji,et al.  An FFT-based technique for translation, rotation, and scale-invariant image registration , 1996, IEEE Trans. Image Process..

[19]  Frédéric Zana,et al.  A multimodal registration algorithm of eye fundus images using vessels detection and Hough transform , 1999, IEEE Transactions on Medical Imaging.

[20]  Roberto Marcondes Cesar Junior,et al.  Retinal vessel segmentation using the 2-D Gabor wavelet and supervised classification , 2005, IEEE Transactions on Medical Imaging.

[21]  Fionn Murtagh,et al.  Gray and color image contrast enhancement by the curvelet transform , 2003, IEEE Trans. Image Process..

[22]  Henk A. van der Vorst,et al.  Bi-CGSTAB: A Fast and Smoothly Converging Variant of Bi-CG for the Solution of Nonsymmetric Linear Systems , 1992, SIAM J. Sci. Comput..

[23]  Jan Flusser,et al.  A new wavelet-based measure of image focus , 2002, Pattern Recognit. Lett..

[24]  Chia-Ling Tsai,et al.  The dual-bootstrap iterative closest point algorithm with application to retinal image registration , 2003, IEEE Transactions on Medical Imaging.

[25]  Joseph A. Izatt,et al.  Interlaced spectrally encoded confocal scanning laser ophthalmoscopy and spectral domain optical coherence tomography , 2010, Biomedical optics express.

[26]  Tinku Acharya,et al.  Image Processing: Principles and Applications , 2005, J. Electronic Imaging.

[27]  Lei Zhang,et al.  Automated Retinal Vessel Segmentation Using Gabor Filters and Scale Multiplication , 2006, IPCV.

[28]  Max A. Viergever,et al.  Ridge-based vessel segmentation in color images of the retina , 2004, IEEE Transactions on Medical Imaging.

[29]  Edward H. Adelson,et al.  A multiresolution spline with application to image mosaics , 1983, TOGS.

[30]  Michael T Trese,et al.  Retinopathy of prematurity: the life of a lifetime disease. , 2006, American journal of ophthalmology.

[31]  Zheen Zhao,et al.  COMPUTER-ASSISTED ASSESSMENT OF PLUS DISEASE IN RETINOPATHY OF PREMATURITY USING VIDEO INDIRECT OPHTHALMOSCOPY IMAGES , 2008, Retina.

[32]  M. Goldbaum,et al.  Detection of blood vessels in retinal images using two-dimensional matched filters. , 1989, IEEE transactions on medical imaging.

[33]  Sebastian Weik,et al.  Registration of 3-D partial surface models using luminance and depth information , 1997, Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134).

[34]  Alexander Wong,et al.  Efficient Multi-Modal Least-Squares Alignment of Medical Images Using Quasi-Orientation Maps , 2006, IPCV.

[35]  Muralidhara Subbarao,et al.  Selecting the Optimal Focus Measure for Autofocusing and Depth-From-Focus , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  V.R.S Mani,et al.  Survey of Medical Image Registration , 2013 .

[37]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[38]  Shmuel Peleg,et al.  Seamless image stitching by minimizing false edges , 2006, IEEE Transactions on Image Processing.

[39]  Liang-Gee Chen,et al.  Motion adaptive interpolation with horizontal motion detection for deinterlacing , 2003, IEEE Trans. Consumer Electron..

[40]  D. Wallace,et al.  A pilot study using "ROPtool" to quantify plus disease in retinopathy of prematurity. , 2007, Journal of AAPOS : the official publication of the American Association for Pediatric Ophthalmology and Strabismus.

[41]  Katherine M. Simonson,et al.  A Statistics-Based Approach to Binary Image Registration with Uncertainty Analysis , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[43]  R. Fletcher.  Conjugate gradient methods for indefinite systems , 1976 .

[44]  Max A. Viergever,et al.  A survey of medical image registration , 1998, Medical Image Anal..

[45]  Ying Zhang,et al.  A new focus measure method using moments , 2000, Image Vis. Comput..

[46]  C.-C. Chou,et al.  A fast focus measure for video display inspection , 2003, Machine Vision and Applications.

[47]  S. Farsiu,et al.  Constrained, globally optimal, multi-frame motion estimation , 2005, IEEE/SP 13th Workshop on Statistical Signal Processing, 2005.

[48]  Bernard Besserer,et al.  High Quality deinterlacing using Inpainting and shutter-Model Directed Temporal interpolation , 2004, ICCVG.

[49]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.