Color calibration and fusion of lens-free and mobile-phone microscopy images for high-resolution and accurate color reproduction

Lens-free holographic microscopy can achieve wide-field imaging in a cost-effective and field-portable setup, making it a promising technique for point-of-care and telepathology applications. However, due to relatively narrow-band sources used in holographic microscopy, conventional colorization methods that use images reconstructed at discrete wavelengths, corresponding to e.g., red (R), green (G) and blue (B) channels, are subject to color artifacts. Furthermore, these existing RGB colorization methods do not match the chromatic perception of human vision. Here we present a high-color-fidelity and high-resolution imaging method, termed “digital color fusion microscopy” (DCFM), which fuses a holographic image acquired at a single wavelength with a color-calibrated image taken by a low-magnification lens-based microscope using a wavelet transform-based colorization method. We demonstrate accurate color reproduction of DCFM by imaging stained tissue sections. In particular we show that a lens-free holographic microscope in combination with a cost-effective mobile-phone-based microscope can generate color images of specimens, performing very close to a high numerical-aperture (NA) benchtop microscope that is corrected for color distortions and chromatic aberrations, also matching the chromatic response of human vision. This method can be useful for wide-field imaging needs in telepathology applications and in resource-limited settings, where whole-slide scanning microscopy systems are not available.

[1]  Henry R. Kang,et al.  Neural network applications to the color scanner and printer calibrations , 1992, J. Electronic Imaging.

[2]  Adrian Stern,et al.  Recovery of partially occluded objects by applying compressive Fresnel holography. , 2012, Optics letters.

[3]  Aydogan Ozcan,et al.  Wide-field computational color imaging using pixel super-resolved on-chip microscopy. , 2013, Optics express.

[4]  L. Tian,et al.  Transport of Intensity phase-amplitude imaging with higher order intensity derivatives. , 2010, Optics express.

[5]  Yibo Zhang,et al.  Wide-field pathology imaging using on-chip microscopy , 2015, Virchows Archiv.

[6]  Alexander Wilkie,et al.  Novel color printer characterization model , 2003, J. Electronic Imaging.

[7]  Henrique S. Malvar,et al.  High-quality linear interpolation for demosaicing of Bayer-patterned color images , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[8]  Derek K. Tseng,et al.  Detection of waterborne parasites using field-portable and cost-effective lensfree microscopy. , 2010, Lab on a chip.

[9]  R. Gerchberg A practical algorithm for the determination of phase from image and diffraction plane pictures , 1972 .

[10]  Po-chieh Hung,et al.  Colorimetric calibration for scanners and media , 1991, Electronic Imaging.

[11]  Alain Trémeau,et al.  Color calibration of an RGB camera mounted in front of a microscope with strong color distortion. , 2013, Applied optics.

[12]  J R Fienup,et al.  Phase retrieval algorithms: a comparison. , 1982, Applied optics.

[13]  Pasquale Memmolo,et al.  Recent advances in holographic 3D particle tracking , 2015 .

[14]  Shuxue Quan,et al.  Digital camera filter design for colorimetric and spectral accuracy , 2001 .

[15]  Dani Lischinski,et al.  Colorization using optimization , 2004, SIGGRAPH 2004.

[16]  Keith Jack Chapter 3 – Color Spaces , 2005 .

[17]  M. Teague Deterministic phase retrieval: a Green’s function solution , 1983 .

[18]  A. Ozcan,et al.  Holographic pixel super-resolution in portable lensless on-chip microscopy using a fiber-optic array. , 2011, Lab on a chip.

[19]  Aydogan Ozcan,et al.  Imaging without lenses: achievements and remaining challenges of wide-field on-chip microscopy , 2012, Nature Methods.

[20]  Yibo Zhang,et al.  Wide-field computational imaging of pathology slides using lens-free on-chip microscopy , 2014, Science Translational Medicine.

[21]  Derek Tseng,et al.  Compact, light-weight and cost-effective microscope based on lensless incoherent holography for telemedicine applications. , 2010, Lab on a chip.

[22]  Aydogan Ozcan,et al.  On-chip differential interference contrast microscopy using lensless digital holography , 2010, Optics express.

[23]  Yun Zhang,et al.  Wavelet based image fusion techniques — An introduction, review and comparison , 2007 .

[24]  J R Fienup,et al.  Reconstruction of an object from the modulus of its Fourier transform. , 1978, Optics letters.

[25]  D. D. Doye,et al.  Image denoising using wavelet transform , 2010, 2010 International Conference on Mechanical and Electrical Technology.

[26]  Philippe Colantoni,et al.  High‐end colorimetric display characterization using an adaptive training set , 2011 .

[27]  Vittorio Bianco,et al.  Lensless Digital Holography Improves Fire Safety , 2013 .

[28]  A. Ozcan,et al.  Maskless imaging of dense samples using pixel super-resolution based multi-height lensfree on-chip microscopy , 2012, Optics Express.

[29]  K. Matsushima Formulation of the rotational transformation of wave fields and their application to digital holography. , 2008, Applied optics.

[30]  A. Ozcan,et al.  Lensfree on-chip microscopy over a wide field-of-view using pixel super-resolution , 2010, Optics express.

[31]  Raja Bala,et al.  Two-dimensional transforms for device color correction and calibration , 2005, IEEE Transactions on Image Processing.

[32]  Vittorio Bianco,et al.  Extended field of view space-time digital holograms for lab-on-a-chip microfluidic imaging , 2015, Optical Metrology.

[33]  S. Mallat A wavelet tour of signal processing , 1998 .

[34]  Aydogan Ozcan,et al.  Field-Portable Pixel Super-Resolution Colour Microscope , 2013, PloS one.

[35]  Navid Farahani,et al.  whole slide imaging in pathology: advantages, limitations, and emerging perspectives , 2015 .

[36]  Aydogan Ozcan,et al.  Increased space-bandwidth product in pixel super-resolved lensfree on-chip microscopy , 2013, Scientific Reports.

[37]  Francesco Merola,et al.  Investigation on specific solutions of Gerchberg–Saxton algorithm , 2014 .

[38]  Patrick Jackman,et al.  Robust colour calibration of an imaging system using a colour space transform and advanced regression modelling. , 2012, Meat science.

[39]  A. Ozcan,et al.  Synthetic aperture-based on-chip microscopy , 2015, Light: Science & Applications.

[40]  Aydogan Ozcan,et al.  Field-portable wide-field microscopy of dense samples using multi-height pixel super-resolution based lensfree imaging. , 2012, Lab on a chip.

[41]  Leslie J. Allen,et al.  Phase retrieval from series of images obtained by defocus variation , 2001 .

[42]  Aydogan Ozcan,et al.  Lensfree on-chip tomographic microscopy employing multi-angle illumination and pixel super-resolution. , 2012, Journal of visualized experiments : JoVE.

[43]  Adrian Stern,et al.  Sparse synthetic aperture with Fresnel elements (S-SAFE) using digital incoherent holograms. , 2015, Optics express.

[44]  F. Wyrowski,et al.  Fast calculation method for optical diffraction on tilted planes by use of the angular spectrum of plane waves. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.