Snapshot Hyperspectral Volumetric Microscopy

The comprehensive analysis of biological specimens brings about the demand for capturing the spatial, temporal and spectral dimensions of visual information together. However, such high-dimensional video acquisition faces major challenges in developing large data throughput and effective multiplexing techniques. Here, we report the snapshot hyperspectral volumetric microscopy that computationally reconstructs hyperspectral profiles for high-resolution volumes of ~1000 μm × 1000 μm × 500 μm at video rate by a novel four-dimensional (4D) deconvolution algorithm. We validated the proposed approach with both numerical simulations for quantitative evaluation and various real experimental results on the prototype system. Different applications such as biological component analysis in bright field and spectral unmixing of multiple fluorescence are demonstrated. The experiments on moving fluorescent beads and GFP labelled drosophila larvae indicate the great potential of our method for observing multiple fluorescent markers in dynamic specimens.

[1]  F. Del Bene,et al.  Optical Sectioning Deep Inside Live Embryos by Selective Plane Illumination Microscopy , 2004, Science.

[2]  S. Shoham,et al.  Hybrid Multiphoton Volumetric Functional Imaging of Large Scale Bioengineered Neuronal Networks , 2014, Nature Communications.

[3]  Xiaobai Sun,et al.  Video rate spectral imaging using a coded aperture snapshot spectral imager. , 2009, Optics express.

[4]  Serge Charpak,et al.  Spectral Unmixing: Analysis of Performance in the Olfactory Bulb In Vivo , 2009, PloS one.

[5]  Xosé Luís Deán-Ben,et al.  Adding fifth dimension to optoacoustic imaging: volumetric time-resolved spectrally enriched tomography , 2014, Light: Science & Applications.

[6]  Takeshi Naemura,et al.  Blind Depth-variant Deconvolution of 3D Data in Wide-field Fluorescence Microscopy , 2015, Scientific Reports.

[7]  Aaron S. Andalman,et al.  Wave optics theory and 3-D deconvolution for the light field microscope. , 2013, Optics express.

[8]  L. Shepp,et al.  Maximum Likelihood Reconstruction for Emission Tomography , 1983, IEEE Transactions on Medical Imaging.

[9]  Min H. Kim,et al.  3D imaging spectroscopy for measuring hyperspectral patterns on solid objects , 2012, ACM Trans. Graph..

[10]  Sabine Süsstrunk,et al.  What is the space of spectral sensitivity functions for digital color cameras? , 2013, 2013 IEEE Workshop on Applications of Computer Vision (WACV).

[11]  Rainer Heintzmann,et al.  Resolving a misconception about structured illumination , 2014, Nature Photonics.

[12]  Jason Cong,et al.  EM+TV Based Reconstruction for Cone-Beam CT with Reduced Radiation , 2011, ISVC.

[13]  M E Dickinson,et al.  Multi-spectral imaging and linear unmixing add a whole new dimension to laser scanning fluorescence microscopy. , 2001, BioTechniques.

[14]  R. Prevedel,et al.  Brain-wide 3D imaging of neuronal activity in Caenorhabditis elegans with sculpted light , 2013, Nature Methods.

[15]  M. Levoy,et al.  Light field microscopy , 2006, SIGGRAPH 2006.

[16]  R. Mann,et al.  Swept confocally-aligned planar excitation (SCAPE) microscopy for high speed volumetric imaging of behaving organisms , 2014, Nature Photonics.

[17]  H. Kataura,et al.  Large-scale single-chirality separation of single-wall carbon nanotubes by simple gel chromatography , 2011, Nature communications.

[18]  Philipp J. Keller,et al.  Whole-brain functional imaging at cellular resolution using light-sheet microscopy , 2013, Nature Methods.

[19]  M. Bawendi,et al.  A colloidal quantum dot spectrometer , 2015, Nature.

[20]  Aydogan Ozcan,et al.  Imaging without lenses: achievements and remaining challenges of wide-field on-chip microscopy , 2012, Nature Methods.

[21]  A. Zewail,et al.  4D Electron Tomography , 2010, Science.

[22]  E. Boyden,et al.  Simultaneous whole-animal 3D-imaging of neuronal activity using light-field microscopy , 2014, Nature Methods.

[23]  Qionghai Dai,et al.  Camera array based light field microscopy. , 2015, Biomedical optics express.

[24]  Antony Orth,et al.  Gigapixel multispectral microscopy , 2015 .

[25]  Ji-Song Guan,et al.  In vivo imaging of immediate early gene expression reveals layer-specific memory traces in the mammalian brain , 2014, Proceedings of the National Academy of Sciences.

[26]  P. Davidovits,et al.  Scanning Laser Microscope , 1969, Nature.

[27]  Tinsu Pan,et al.  Four-dimensional computed tomography: image formation and clinical protocol. , 2005, Medical physics.

[28]  Benjamin R. Arenkiel,et al.  In Vivo Light-Induced Activation of Neural Circuitry in Transgenic Mice Expressing Channelrhodopsin-2 , 2007, Neuron.

[29]  Stephen Lin,et al.  Acquisition of High Spatial and Spectral Resolution Video with a Hybrid Camera System , 2014, International Journal of Computer Vision.

[30]  Daniel G. Aliaga,et al.  Fast high-resolution appearance editing using superimposed projections , 2012, TOGS.

[31]  J. Sanes,et al.  Improved tools for the Brainbow toolbox. , 2013, Nature methods.

[32]  Rolf B. Saager,et al.  Polarization-Sensitive Hyperspectral Imaging in vivo: A Multimode Dermoscope for Skin Analysis , 2014, Scientific Reports.

[33]  Qionghai Dai,et al.  Supplementary Document : Spatial-spectral Encoded Compressive Hyperspectral Imaging , 2014 .

[34]  Benjamin Schmid,et al.  Hyperspectral light sheet microscopy , 2015, Nature Communications.

[35]  Sefaattin Tongay,et al.  Visualizing nanoscale excitonic relaxation properties of disordered edges and grain boundaries in monolayer molybdenum disulfide , 2015, Nature Communications.

[36]  Nicola C. Reading,et al.  In vivo imaging and tracking of host–microbiota interactions via metabolic labeling of gut anaerobic bacteria , 2015, Nature Medicine.