Correction of mosaicking artifacts in multimodal images caused by uneven illumination

Recent advances in nonlinear multimodal imaging, eg, the combination of coherent anti‐Stokes Raman scattering, 2‐photon excited autofluorescence, and second‐harmonic generation, have shown the great potential of this imaging technique for medical diagnostics. To extract reliable diagnostic information from these multimodal images, a complex image‐processing pipeline is necessary. A major part of this image‐processing pipeline is the elimination of the mosaicking artifact caused by an uneven illumination within the images. While this problem is well known in image processing of photographic images and methods to solve it were developed, their direct application to multimodal images does not yield satisfactory results. This fact results from the nonlinearity of the measurement modalities and characteristics of the multimodal images itself. In this contribution, different approaches to correct the mosaicking are considered and adapted to multimodal images. In this tutorial article, an investigation and comparative analysis of correction methods were performed, and practical recommendations for the application of different methods are given. The results of this paper can be applied to the development of complete or partial automatic software for medical diagnostics using nonlinear multimodal imaging techniques.

[1]  Serge Pelet,et al.  A rapid and effective vignetting correction for quantitative microscopy , 2014 .

[2]  Wilhelm Burger,et al.  Digital Image Processing - An Algorithmic Introduction using Java , 2008, Texts in Computer Science.

[3]  F J W-M Leong,et al.  Correction of uneven illumination (vignetting) in digital microscopy images , 2003, Journal of clinical pathology.

[4]  Viergever,et al.  Retrospective shading correction based on entropy minimization , 2000, Journal of microscopy.

[5]  William Hollingworth,et al.  A systematic review of geographical variation in access to chemotherapy , 2015, BMC Cancer.

[6]  P. So,et al.  Handbook of Biomedical Nonlinear Optical Microscopy , 2009 .

[7]  Edward H. Adelson,et al.  A multiresolution spline with application to image mosaics , 1983, TOGS.

[8]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[9]  Yunpeng Li,et al.  CIDRE: an illumination-correction method for optical microscopy , 2015, Nature Methods.

[10]  Anne E Carpenter,et al.  Pipeline for illumination correction of images for high-throughput microscopy , 2014, Journal of microscopy.

[11]  Dan B. Goldman,et al.  Vignette and exposure calibration and compensation , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[12]  Rafael C. González,et al.  Digital image processing using MATLAB , 2006 .

[13]  Jürgen Popp,et al.  From molecular structure to tissue architecture: collagen organization probed by SHG microscopy , 2013, Journal of biophotonics.

[14]  Orhan Bulan,et al.  Correcting illumination variations in photomicrograph mosaics of daguerreotypes , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[15]  Jürgen Popp,et al.  Multimodal nonlinear microscopy of head and neck carcinoma — toward surgery assisting frozen section analysis , 2016, Head & neck.

[16]  Jürgen Popp,et al.  Beyond endoscopic assessment in inflammatory bowel disease: real-time histology of disease activity by non-linear multimodal imaging , 2016, Scientific Reports.

[17]  Ines Latka,et al.  Towards multimodal nonlinear optical tomography – experimental methodology , 2011 .

[18]  Jürgen Popp,et al.  Multimodal Imaging Spectroscopy of Tissue. , 2015, Annual review of analytical chemistry.

[19]  S. Laffray,et al.  In vivo optical monitoring of tissue pathologies and diseases with vibrational contrast , 2009, Journal of biophotonics.

[20]  Ryan M Burke,et al.  Two-Photon and Second Harmonic Microscopy in Clinical and Translational Cancer Research , 2012, Annals of Biomedical Engineering.

[21]  C H A N G M I N G S U N,et al.  Mosaicing of microscope images with global geometric and radiometric corrections , 2005 .

[22]  Jirí Jan,et al.  Retrospective Illumination Correction of Retinal Images , 2010, Int. J. Biomed. Imaging.

[23]  D. Shepard.  A two-dimensional interpolation function for irregularly-spaced data , 1968, ACM National Conference.

[24]  G. Jemec,et al.  Diagnosis of Nonmelanoma Skin Cancer/Keratinocyte Carcinoma: A Review of Diagnostic Accuracy of Nonmelanoma Skin Cancer Diagnostic Tests and Technologies , 2007, Dermatologic surgery : official publication for American Society for Dermatologic Surgery [et al.].

[25]  Jane A Dickerson,et al.  Current Applications of Liquid Chromatography / Mass Spectrometry in Pharmaceutical Discovery After a Decade of Innovation , 2008 .

[26]  Sumeet Mahajan,et al.  Coherent anti-Stokes Raman scattering for label-free biomedical imaging , 2013 .

[27]  Bruce J Tromberg,et al.  In situ multiphoton optical tomography of hair follicles in mice. , 2007, Journal of biomedical optics.

[28]  B Dietzek,et al.  Multimodal mapping of human skin , 2013, The British journal of dermatology.

[29]  Alessandro Bevilacqua,et al.  Manual Stage Acquisition and Interactive Display of Digital Slides in Histopathology , 2014, IEEE Journal of Biomedical and Health Informatics.

[30]  Chris Dainty,et al.  Illumination correction of retinal images using Laplace interpolation. , 2012, Applied optics.

[31]  B. Dietzek,et al.  Detection and Discrimination of Non-Melanoma Skin Cancer by Multimodal Imaging , 2013, Healthcare.

[32]  T Meyer,et al.  Seamless stitching of tile scan microscope images , 2015, Journal of microscopy.

[33]  Jürgen Popp,et al.  Pseudo-HE images derived from CARS/TPEF/SHG multimodal imaging in combination with Raman-spectroscopy as a pathological screening tool , 2016, BMC Cancer.

[34]  Jürgen Popp,et al.  Three-dimensional molecular mapping of a multiple emulsion by means of CARS microscopy. , 2008, The journal of physical chemistry. B.

[35]  Jürgen Popp,et al.  Multimodal nonlinear microscopic investigations on head and neck squamous cell carcinoma: Toward intraoperative imaging , 2013, Head & neck.

[36]  Marc Pollefeys,et al.  Robust Radiometric Calibration and Vignetting Correction , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  N. Bendsøe,et al.  Multimodal imaging to study the morphochemistry of basal cell carcinoma , 2010, Journal of biophotonics.

[38]  Richard Szeliski,et al.  Computer Vision - Algorithms and Applications , 2011, Texts in Computer Science.