Ocular multi-spectral imaging deblurring via regularization of mutual information

Abstract Multi-Spectral Imaging is one non-invasive technique recently introduced in ocular disease diagnosis. Its performance significantly correlates with the imaging quality. We observed that various degenerations including motion and out-of-focus blurry effects had degraded the quality of ocular MSI images. Bearing this in mind, we propose a multi-modality, multi-image deblurring framework through integrating the information from the aligned images since the accurate correspondence between each sequence of the ocular images need to be constructed simultaneously. The smoothness of ocular MSI image and its corresponding blur kernel are simultaneously taken as regularization terms. Meanwhile, to leverage the complementary information within a set of ocular MSI images, the mutual information between each pair of ocular MSI images is also exploited as a vital regularization term in the presented optimization framework. To evaluate the performance of the proposed approach, we conducted comparison experiments between the state-of-the-art techniques and ours. Experimental results show that the proposed technique outperforms state-of-the-art deblurring methods quantitatively and visually.

[1]  C. Fraser,et al.  Automatic Detection of Residential Buildings Using LIDAR Data and Multispectral Imagery , 2010 .

[2]  Frédo Durand,et al.  Efficient marginal likelihood optimization in blind deconvolution , 2011, CVPR 2011.

[3]  Yong He,et al.  Application of image texture for the sorting of tea categories using multi-spectral imaging technique and support vector machine , 2008 .

[4]  Jian Lian,et al.  Measuring Spectral Inconsistency of Multispectral Images for Detection and Segmentation of Retinal Degenerative Changes , 2017, Scientific Reports.

[5]  Ankit Gupta,et al.  Single Image Deblurring Using Motion Density Functions , 2010, ECCV.

[6]  Qi Zhang,et al.  Multi-modal and Multi-spectral Registration for Natural Images , 2014, ECCV.

[7]  S. Serra-Capizzano,et al.  Improved image deblurring with anti-reflective boundary conditions and re-blurring , 2006 .

[8]  S. Serra-Capizzano A Note on Antireflective Boundary Conditions and Fast Deblurring Models , 2003 .

[9]  Pablo J. Zarco-Tejada,et al.  Thermal and Narrowband Multispectral Remote Sensing for Vegetation Monitoring From an Unmanned Aerial Vehicle , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[10]  L. Wald,et al.  Fusion of high spatial and spectral resolution images : The ARSIS concept and its implementation , 2000 .

[11]  Emanuele Trucco,et al.  Retinal Vessel Classification Based on Maximization of Squared-Loss Mutual Information , 2016 .

[12]  Jerome Sherman,et al.  New insights into Stargardt disease with multimodal imaging. , 2015, Ophthalmic surgery, lasers & imaging retina.

[13]  Claus Brenner,et al.  Extraction of buildings and trees in urban environments , 1999 .

[14]  Rob Fergus,et al.  Blind deconvolution using a normalized sparsity measure , 2011, CVPR 2011.

[15]  William T. Freeman,et al.  Removing camera shake from a single photograph , 2006, SIGGRAPH 2006.

[16]  Dianne P. O'Leary,et al.  Restoring Images Degraded by Spatially Variant Blur , 1998, SIAM J. Sci. Comput..

[17]  Andrew Zisserman,et al.  Deblurring Shaken and Partially Saturated Images , 2011, International Journal of Computer Vision.

[18]  K Bailey Freund,et al.  Multimodal imaging in a severe case of hydroxychloroquine toxicity. , 2015, Ophthalmic surgery, lasers & imaging retina.

[19]  Liang Xiao,et al.  Two-stage image deblurring with L0 gradient minimization and non-local refinement , 2015, Pattern Recognition and Image Analysis.

[20]  Jerry L. Prince,et al.  Multimodal Registration via Mutual Information Incorporating Geometric and Spatial Context , 2015, IEEE Transactions on Image Processing.

[21]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.

[22]  Seungyong Lee,et al.  Handling outliers in non-blind image deconvolution , 2011, 2011 International Conference on Computer Vision.

[23]  Karen O. Egiazarian,et al.  BM3D Frames and Variational Image Deblurring , 2011, IEEE Transactions on Image Processing.

[24]  Yaoyao Sun,et al.  In Vivo Study of Retinal Transmission Function in Different Sections of the Choroidal Structure Using Multispectral Imaging. , 2015, Investigative ophthalmology & visual science.

[25]  Mateu Sbert,et al.  Medical Image Segmentation Based on Mutual Information Maximization , 2004, MICCAI.

[26]  Yanning Zhang,et al.  Multi-image Blind Deblurring Using a Coupled Adaptive Sparse Prior , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Jian-Feng Cai,et al.  Blind motion deblurring using multiple images , 2009, J. Comput. Phys..

[28]  Hongyuan Zha,et al.  A Matrix Decomposition Perspective to Multiple Graph Matching , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[29]  M. Bertero,et al.  Image deblurring with Poisson data: from cells to galaxies , 2009 .

[30]  Junchi Yan,et al.  Visual Saliency Detection via Sparsity Pursuit , 2010, IEEE Signal Processing Letters.

[31]  Shmuel Peleg,et al.  Two motion-blurred images are better than one , 2005, Pattern Recognit. Lett..

[32]  Jun Wang,et al.  Consistency-Driven Alternating Optimization for Multigraph Matching: A Unified Approach , 2015, IEEE Transactions on Image Processing.

[33]  M. Cannon Blind deconvolution of spatially invariant image blurs with phase , 1976 .

[34]  Roberto Gallego-Pinazo,et al.  Choroidal lesions in neurofibromatosis detected by multispectral imaging. , 2013, Retinal cases & brief reports.

[35]  Simon R. Arridge,et al.  A Nonrigid Registration Framework Using Spatially Encoded Mutual Information and Free-Form Deformations , 2011, IEEE Transactions on Medical Imaging.

[36]  James G. Nagy,et al.  Iterative Methods for Image Deblurring: A Matlab Object-Oriented Approach , 2004, Numerical Algorithms.

[37]  I B Styles,et al.  Multispectral retinal image analysis: a novel non-invasive tool for retinal imaging , 2011, Eye.

[38]  Yuanjie Zheng,et al.  Groupwise registration of sequential images from multispectral imaging (MSI) of the retina and choroid. , 2016, Optics express.

[39]  Jiaya Jia,et al.  High-quality motion deblurring from a single image , 2008, SIGGRAPH 2008.

[40]  Haichao Zhang,et al.  Intra-frame deblurring by leveraging inter-frame camera motion , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[41]  Peyman Milanfar,et al.  Robust Multichannel Blind Deconvolution via Fast Alternating Minimization , 2012, IEEE Transactions on Image Processing.

[42]  Anat Levin,et al.  Blind Motion Deblurring Using Image Statistics , 2006, NIPS.

[43]  Jian Lian,et al.  Deep indicator for fine-grained classification of banana’s ripening stages , 2018, EURASIP Journal on Image and Video Processing.

[44]  Adam Świtoński,et al.  Ophthalmic diagnosis based on multispectral imaging , 2011 .

[45]  Hongyuan Zha,et al.  Multi-Graph Matching via Affinity Optimization with Graduated Consistency Regularization , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[46]  Junchi Yan,et al.  Adaptive Discrete Hypergraph Matching , 2018, IEEE Transactions on Cybernetics.

[47]  K. Chao,et al.  Chicken Heart Disease Characterization by Multi-spectral Imaging , 2001 .

[48]  Jun Wang,et al.  Multi-View Point Registration via Alternating Optimization , 2015, AAAI.

[49]  Qionghai Dai,et al.  Exploring aligned complementary image pair for blind motion deblurring , 2011, CVPR 2011.

[50]  Jian Lian,et al.  Deblurring retinal optical coherence tomography via a convolutional neural network with anisotropic and double convolution layer , 2018, IET Comput. Vis..

[51]  Cheryl N. Zimmer,et al.  A case study of choroideremia carrier – Use of multi-spectral imaging in highlighting clinical features , 2016, American journal of ophthalmology case reports.

[52]  E. Claridge,et al.  Multispectral imaging of the ocular fundus using light emitting diode illumination. , 2010, The Review of scientific instruments.

[53]  Jian Lian,et al.  Deblurring sequential ocular images from multi-spectral imaging (MSI) via mutual information , 2017, Medical & Biological Engineering & Computing.

[54]  Jian Lian,et al.  Quick response barcode deblurring via doubly convolutional neural network , 2018, Multimedia Tools and Applications.

[55]  Xiang Zhu,et al.  Deconvolving PSFs for a Better Motion Deblurring Using Multiple Images , 2012, ECCV.

[56]  Rob Fergus,et al.  Fast Image Deconvolution using Hyper-Laplacian Priors , 2009, NIPS.

[57]  Mila Nikolova,et al.  Efficient Minimization Methods of Mixed l2-l1 and l1-l1 Norms for Image Restoration , 2005, SIAM J. Sci. Comput..

[58]  Murat Akçakaya,et al.  Classification Active Learning Based on Mutual Information , 2016, Entropy.

[59]  Max A. Viergever,et al.  Mutual-information-based registration of medical images: a survey , 2003, IEEE Transactions on Medical Imaging.

[60]  In-So Kweon,et al.  Complementary Sets of Shutter Sequences for Motion Deblurring , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).