Full-range, solar-reflected hyperspectral microscopy to support earth remote sensing research

Abstract. Over the past 20 years, hyperspectral microscopy has grown into a robust field of analysis for a number of applications. The visible to near-infrared (VNIR; 400 to 1000 nm) region of the spectrum has demonstrated utility for the characterization of healthy and diseased tissue and of biomolecular indicators at the cellular level. Here, we describe the development of a hyperspectral imaging (HSI) microscope that is aimed at material characterization to complement traditional stand-off, earth remote sensing with hyperspectral sensors. We combine commercial off the shelf technology to build an HSI microscope to collect spectral data with illumination provided by a tunable laser. Hyperspectral imaging microscopy (HIM) facilitates detailed examination of target materials at the subcentimeter spatial scale. The custom-built, laser illumination HSI microscope covers the NIR to shortwave infrared (NIR/SWIR; 900 to 2500 nm) solar-reflected spectral range. It is combined with a separate VNIR sensor (400 to 900 nm) that utilizes quartz–tungsten–halogen lamps for illumination. The combined sensors provide a means to collect >10,000  s of spectra in the full VNIR/SWIR spectral range from both pure substances and precisely engineered linear and nonlinear mixtures. The large abundance of spectra allows for a more detailed understanding of the variability and multivariate probability distributions of spectral signatures. This additional information aids in understanding the variability observed in ground truth spectra collected from portable spectrometers, and it greatly enhances sample description and metadata content. In addition, HIM data cubes can serve as proxies, as “microscenes,” for systems engineering applications such as trade studies for HSI acquired by air- and space-borne sensors.

[1]  J. Bibring,et al.  Micromega/IR: Design and status of a near-infrared spectral microscope for in situ analysis of Mars samples , 2009 .

[2]  Bosoon Park,et al.  Rapid and early detection of Salmonella serotypes with hyperspectral microscopy and multivariate data analysis. , 2015, Journal of food protection.

[3]  A. Zayats,et al.  Hyperspectral imaging with scanning near-field optical microscopy: applications in plasmonics. , 2010, Optics express.

[4]  Andrew Bodkin,et al.  Snapshot hyperspectral imaging: the hyperpixel array camera , 2009, Defense + Commercial Sensing.

[5]  N. Pitsianis,et al.  Static two-dimensional aperture coding for multimodal, multiplex spectroscopy. , 2006, Applied optics.

[6]  S. Patskovsky,et al.  Hyperspectral reflected light microscopy of plasmonic Au/Ag alloy nanoparticles incubated as multiplex chromatic biomarkers with cancer cells. , 2014, The Analyst.

[7]  B. Hapke Bidirectional reflectance spectroscopy: 1. Theory , 1981 .

[8]  Guolan Lu,et al.  Medical hyperspectral imaging: a review , 2014, Journal of biomedical optics.

[9]  David W. Allen,et al.  A microscene approach to the evaluation of hyperspectral system level performance , 2013, Defense, Security, and Sensing.

[10]  Amit Banerjee,et al.  Mapping intimate mixtures using an adaptive kernel-based technique , 2011, 2011 3rd Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[11]  Robert S. Rand,et al.  An analysis of the nonlinear spectral mixing of didymium and soda-lime glass beads using hyperspectral imagery (HSI) microscopy , 2014, Defense + Security Symposium.

[12]  Anna Fedorova,et al.  Development of a mast or robotic arm-mounted infrared AOTF spectrometer for surface Moon and Mars probes , 2015, SPIE Optical Engineering + Applications.

[13]  M. Turner,et al.  LANDSCAPE ECOLOGY : The Effect of Pattern on Process 1 , 2002 .

[14]  E. Abbe Beiträge zur Theorie des Mikroskops und der mikroskopischen Wahrnehmung , 1873 .

[15]  Stefano Selci,et al.  Living Matter Observations with a Novel Hyperspectral Supercontinuum Confocal Microscope for VIS to Near-IR Reflectance Spectroscopy , 2013, Sensors.

[16]  María Del Pilar Sosa Peña,et al.  Identification of Metal Oxide Nanoparticles in Histological Samples by Enhanced Darkfield Microscopy and Hyperspectral Mapping , 2015, Journal of visualized experiments : JoVE.

[17]  Luma V. Halig,et al.  Hyperspectral imaging and quantitative analysis for prostate cancer detection. , 2012, Journal of biomedical optics.

[18]  Kristian Kersting,et al.  Hyperspectral phenotyping on the microscopic scale: towards automated characterization of plant-pathogen interactions , 2015, Plant Methods.

[19]  Yongqi Xue,et al.  Study on microscope hyperspectral medical imaging method for biomedical quantitative analysis , 2008 .

[20]  P. Treado,et al.  Near-Infrared Acousto-Optic Filtered Spectroscopic Microscopy: A Solid-State Approach to Chemical Imaging , 1992 .

[21]  C. Pilorget,et al.  NIR reflectance hyperspectral microscopy for planetary science: Application to the MicrOmega instrument , 2013 .

[22]  Anne-Katrin Mahlein,et al.  Recent advances in sensing plant diseases for precision crop protection , 2012, European Journal of Plant Pathology.

[23]  D. Elder,et al.  Differentiation of normal skin and melanoma using high resolution hyperspectral imaging , 2006, Cancer biology & therapy.

[24]  K. N. Dollman,et al.  - 1 , 1743 .

[25]  Joseph N. Wilson,et al.  Using physics-based macroscopic and microscopic mixture models for hyperspectral pixel unmixing , 2012, Defense + Commercial Sensing.

[26]  Anne-Katrin Mahlein Plant Disease Detection by Imaging Sensors - Parallels and Specific Demands for Precision Agriculture and Plant Phenotyping. , 2016, Plant disease.

[27]  Frances Westall,et al.  Testing the ability of the ExoMars 2018 payload to document geological context and potential habitability on Mars , 2015 .

[28]  Howland D. T. Jones,et al.  Hyperspectral confocal microscope. , 2006, Applied optics.

[29]  T. Painter,et al.  Reflectance quantities in optical remote sensing - definitions and case studies , 2006 .

[30]  Thomas D. Nielsen,et al.  Hyperspectral imaging: a novel approach for microscopic analysis. , 2001, Cytometry.

[31]  J Anderson,et al.  Differentiation of live‐viable versus dead bacterial endospores by calibrated hyperspectral reflectance microscopy , 2008, Journal of microscopy.

[32]  Jie Chen,et al.  Nonlinear Unmixing of Hyperspectral Data Based on a Linear-Mixture/Nonlinear-Fluctuation Model , 2013, IEEE Transactions on Signal Processing.

[33]  Mark R Wiesner,et al.  Detection, characterization, and abundance of engineered nanoparticles in complex waters by hyperspectral imagery with enhanced Darkfield microscopy. , 2012, Environmental science & technology.

[34]  John P. Kerekes,et al.  Hyperspectral Imaging System Modeling , 2003 .

[35]  Liang Gao,et al.  Snapshot Image Mapping Spectrometer (IMS) with high sampling density for hyperspectral microscopy , 2010, Optics express.

[36]  Jessica A. Faust,et al.  Imaging Spectroscopy and the Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) , 1998 .

[37]  David M. Haaland,et al.  Hyperspectral imaging of biological targets: the difference a high resolution spectral dimension and multivariate analysis can make , 2004, 2004 2nd IEEE International Symposium on Biomedical Imaging: Nano to Macro (IEEE Cat No. 04EX821).

[38]  John Schlager,et al.  Hyperspectral microscopy for characterization of gold nanoparticles in biological media and cells for toxicity assessment. , 2013, Methods in molecular biology.

[39]  Monika Mortimer,et al.  Potential of hyperspectral imaging microscopy for semi-quantitative analysis of nanoparticle uptake by protozoa. , 2014, Environmental science & technology.

[40]  Walter J. Riker A Review of J , 2010 .

[41]  A. Siddiqi,et al.  Use of hyperspectral imaging to distinguish normal, precancerous, and cancerous cells , 2008, Cancer.

[42]  Anne-Katrin Mahlein,et al.  Hyperspectral imaging for small-scale analysis of symptoms caused by different sugar beet diseases , 2012, Plant Methods.

[43]  Sahil Tahiliani,et al.  Hyperspectral microscopy as an analytical tool for nanomaterials. , 2015, Wiley interdisciplinary reviews. Nanomedicine and nanobiotechnology.

[44]  A. Giebel,et al.  Early detection of Fusarium infection in wheat using hyper-spectral imaging , 2011 .

[45]  Kurt C. Lawrence,et al.  AOTF hyperspectral microscopic imaging for foodborne pathogenic bacteria detection , 2011, Defense + Commercial Sensing.

[46]  T. Gansler,et al.  Characterization of human breast biopsy specimens with near-IR Raman spectroscopy. , 1994, Analytical chemistry.

[47]  M.L. Huebschman,et al.  Characteristics and capabilities of the hyperspectral imaging microscope , 2002, IEEE Engineering in Medicine and Biology Magazine.

[48]  Silas J. Leavesley,et al.  An Approach for Characterizing and Comparing Hyperspectral Microscopy Systems , 2013, Sensors.

[49]  Vincent Baeten,et al.  Hyperspectral Imaging Applications in Agriculture and Agro-Food Product Quality and Safety Control: A Review , 2013 .

[50]  Alfred O. Hero,et al.  Nonlinear Unmixing of Hyperspectral Images: Models and Algorithms , 2013, IEEE Signal Processing Magazine.

[51]  E. Frenkel,et al.  Molecular profiling of individual tumor cells by hyperspectral microscopic imaging. , 2012, Translational research : the journal of laboratory and clinical medicine.

[52]  Jonathan D. Suter,et al.  Hyperspectral microscopy using an external cavity quantum cascade laser and its applications for explosives detection , 2012, OPTO.

[53]  María Del Pilar Sosa Peña,et al.  Hyperspectral imaging of nanoparticles in biological samples: Simultaneous visualization and elemental identification , 2016, Microscopy research and technique.

[54]  H. Garner,et al.  Quantitative immunophenotyping of circulating tumor cells in blood using microfluidic screening chip integrated with hyperspectral microscope , 2009, TRANSDUCERS 2009 - 2009 International Solid-State Sensors, Actuators and Microsystems Conference.

[55]  Keith A. Lidke,et al.  Exploring membrane protein dynamics by multicolor single quantum dot imaging using wide field, TIRF, and hyperspectral microscopy , 2007, SPIE BiOS.