Snapshot hyperspectral retinal imaging using compact spectral resolving detector array

Hyperspectral retinal imaging captures the light spectrum from each imaging pixel. It provides spectrally encoded retinal physiological and morphological information, which could potentially benefit diagnosis and therapeutic monitoring of retinal diseases. The key challenges in hyperspectral retinal imaging are how to achieve snapshot imaging to avoid motions between the images from multiple spectral bands, and how to design a compact snapshot imager suitable for clinical use. Here, we developed a compact, snapshot hyperspectral fundus camera for rodents using a novel spectral resolving detector array (SRDA), on which a thin-film Fabry-Perot cavity filter was monolithically fabricated on each imaging pixel. We achieved hyperspectral retinal imaging with 16 wavelength bands (460 to 630 nm) at 20 fps. We also demonstrated false-color vessel contrast enhancement and retinal oxygen saturation (sO2 ) measurement through spectral analysis. This work could potentially bring hyperspectral retinal imaging from bench to bedside.

[1]  Rutger M. Schols,et al.  Advanced intraoperative imaging methods for laparoscopic anatomy navigation: an overview , 2012, Surgical Endoscopy.

[2]  G Muyo,et al.  Spectral imaging of the retina , 2011, Eye.

[3]  Catherine Pellé,et al.  Color filters including infrared cut-off integrated on CMOS image sensor. , 2011, Optics express.

[4]  S. Downes,et al.  Colour photographs for screening in neovascular age-related macular degeneration: are they necessary? , 2011, Eye.

[5]  M. Dewhirst,et al.  Hyperspectral imaging of hemoglobin saturation in tumor microvasculature and tumor hypoxia development. , 2005, Journal of biomedical optics.

[6]  Guy E. Artzner,et al.  Microlens arrays for Shack-Hartmann wavefront sensors , 1992 .

[7]  Paul Jerram,et al.  Back-thinned CMOS sensor optimization , 2010, OPTO.

[8]  Arthur D. Broadbent,et al.  A critical review of the development of the CIE1931 RGB color-matching functions , 2004 .

[9]  Hongying Zhu,et al.  Optical imaging techniques for point-of-care diagnostics. , 2013, Lab on a chip.

[10]  Hao Li,et al.  Investigating the influence of chromatic aberration and optical illumination bandwidth on fundus imaging in rats , 2015, Journal of biomedical optics.

[11]  Dan Fu,et al.  Hyperspectral imaging with stimulated Raman scattering by chirped femtosecond lasers. , 2013, The journal of physical chemistry. B.

[12]  Na Wang,et al.  Narrow transmission band of one-dimensional photonic crystals with a defect layer , 2007 .

[13]  Shuliang Jiao,et al.  Accuracy of retinal oximetry: a Monte Carlo investigation , 2013, Journal of biomedical optics.

[14]  R. Gillies,et al.  Systemic effects of shock and resuscitation monitored by visible hyperspectral imaging. , 2003, Diabetes technology & therapeutics.

[15]  Larry Kagemann,et al.  A review of methods for human retinal oximetry. , 2003, Ophthalmic surgery, lasers & imaging : the official journal of the International Society for Imaging in the Eye.

[16]  J. Chin,et al.  Evaluation of hyperspectral technology for assessing the presence and severity of peripheral artery disease. , 2011, Journal of vascular surgery.

[17]  M. Meister,et al.  The Light Response of Retinal Ganglion Cells Is Truncated by a Displaced Amacrine Circuit , 1997, Neuron.

[18]  Ji Yi,et al.  Visible-light optical coherence tomography for retinal oximetry. , 2013, Optics letters.

[19]  Daniel W. Wilson,et al.  Snapshot hyperspectral imaging in ophthalmology. , 2007, Journal of biomedical optics.

[20]  Dietrich Schweitzer,et al.  Light paths in retinal vessel oximetry , 2001, IEEE Transactions on Biomedical Engineering.

[21]  Jennifer H. Acton,et al.  Recovery of macular pigment spectrum in vivo using hyperspectral image analysis. , 2011, Journal of biomedical optics.

[22]  Joseph A. Izatt,et al.  True color scanning laser ophthalmoscopy and optical coherence tomography handheld probe. , 2014, Biomedical optics express.

[23]  Liang Gao,et al.  Snapshot hyperspectral retinal camera with the Image Mapping Spectrometer (IMS) , 2011, Biomedical optics express.

[24]  Jean Bennett,et al.  Oxygen distribution and vascular injury in the mouse eye measured by phosphorescence-lifetime imaging. , 2004, Applied optics.

[25]  D. Ferris,et al.  Multimodal Hyperspectral Imaging for the Noninvasive Diagnosis of Cervical Neoplasia , 2001, Journal of lower genital tract disease.

[26]  R. Linsenmeier,et al.  Retinal hypoxia in long-term diabetic cats. , 1998, Investigative ophthalmology & visual science.

[27]  Hao F. Zhang,et al.  Visible light optical coherence tomography measures retinal oxygen metabolic response to systemic oxygenation , 2015, Light: Science & Applications.

[28]  Stephen R. Forrest,et al.  Improved light out-coupling in organic light emitting diodes employing ordered microlens arrays , 2002 .

[29]  H. A. Macleod,et al.  Turning Value Monitoring of Narrow-band All-dielectric Thin-film Optical Filters , 1972 .

[30]  Ji Yi,et al.  Imaging a full set of optical scattering properties of biological tissue by inverse spectroscopic optical coherence tomography. , 2012, Optics letters.

[31]  Yan Liu,et al.  Design and fabrication of narrow-frequency sharp angular filters. , 2005, Applied optics.

[32]  E. Gordy,et al.  Spectrophotometric studies. XVI. Determination of the oxygen saturation of blood by a simplified technique, applicable to standard equipment. , 1957, The Journal of biological chemistry.

[33]  Steve S. Lee,et al.  Hand-carried cardiac ultrasound enhances healthcare delivery in developing countries. , 2004, The American journal of cardiology.

[34]  Mark S. Humayun,et al.  Hyperspectral Computed Tomographic Imaging Spectroscopy of Vascular Oxygen Gradients in the Rabbit Retina In Vivo , 2011, PloS one.

[35]  Dan Savastru,et al.  Hyperspectral Imaging in the Medical Field: Present and Future , 2014 .

[36]  David H Sliney,et al.  Maximum permissible exposures for ocular safety (ANSI 2000), with emphasis on ophthalmic devices. , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.

[37]  N. M. Anderson,et al.  STUDIES ON THE LIGHT TRANSMISSION OF NONHEMOLYZED WHOLE BLOOD. DETERMINATION OF OXYGEN SATURATION. , 1965, The Journal of laboratory and clinical medicine.

[38]  Shuliang Jiao,et al.  Fundus Camera Guided Photoacoustic Ophthalmoscopy , 2013, Current eye research.

[39]  R. Tsai,et al.  Crosstalk and microlens study in a color CMOS image sensor , 2003 .

[40]  Dietrich Schweitzer,et al.  Retinal vessel oximetry-calibration, compensation for vessel diameter and fundus pigmentation, and reproducibility. , 2008, Journal of biomedical optics.

[41]  Matija Milanič,et al.  Vessel contrast enhancement in hyperspectral images , 2015, Photonics West - Biomedical Optics.

[42]  Amani A. Fawzi,et al.  Imaging Characteristics of Dry Age-Related Macular Degeneration , 2011, Seminars in ophthalmology.

[43]  Ji Yi,et al.  A combined method to quantify the retinal metabolic rate of oxygen using photoacoustic ophthalmoscopy and optical coherence tomography , 2014, Scientific Reports.

[44]  Edmund Koch,et al.  Hyperspectral imaging - A new modality for eye diagnostics , 2012 .

[45]  Peter Wiedemann,et al.  Optical properties of retinal tissue and the potential of adaptive optics to visualize retinal ganglion cells in vivo , 2013, Cell and Tissue Research.

[46]  Guolan Lu,et al.  Medical hyperspectral imaging: a review , 2014, Journal of biomedical optics.

[47]  M. C. Butler,et al.  A Novel, Real-Time, In Vivo Mouse Retinal Imaging System. , 2015, Investigative ophthalmology & visual science.

[48]  Liang Gao,et al.  Image mapping spectrometry: calibration and characterization , 2012, Optical engineering.

[49]  Marco Augustin,et al.  Multidisciplinary Ophthalmic Imaging Melanin Pigmentation in Rat Eyes : In Vivo Imaging by Polarization-Sensitive Optical Coherence Tomography and Comparison to Histology , 2015 .

[50]  Amicia D Elliott,et al.  Real-time hyperspectral fluorescence imaging of pancreatic &bgr;-cell dynamics with the image mapping spectrometer , 2012, Journal of Cell Science.

[51]  Michael W. Kudenov,et al.  Review of snapshot spectral imaging technologies , 2013, Optics and Precision Engineering.

[52]  Dirk J. Faber,et al.  A literature review and novel theoretical approach on the optical properties of whole blood , 2013, Lasers in Medical Science.

[53]  P E Stanga,et al.  High-resolution hyperspectral imaging of the retina with a modified fundus camera. , 2010, Journal francais d'ophtalmologie.