Computational multispectral video imaging [Invited].

Multispectral imagers reveal information unperceivable to humans and conventional cameras. Here, we demonstrate a compact single-shot multispectral video-imaging camera by placing a micro-structured diffractive filter in close proximity to the image sensor. The diffractive filter converts spectral information to a spatial code on the sensor pixels. Following a calibration step, this code can be inverted via regularization-based linear algebra to compute the multispectral image. We experimentally demonstrated spectral resolution of 9.6 nm within the visible band (430-718 nm). We further show that the spatial resolution is enhanced by over 30% compared with the case without the diffractive filter. We also demonstrate Vis-IR imaging with the same sensor. Because no absorptive color filters are utilized, sensitivity is preserved as well. Finally, the diffractive filters can be easily manufactured using optical lithography and replication techniques.

[1]  Laura Waller,et al.  Multiplexed phase-space imaging for 3D fluorescence microscopy. , 2017, Optics express.

[2]  Rajesh Menon,et al.  Chromatic-aberration-corrected diffractive lenses for ultra-broadband focusing , 2016, Scientific Reports.

[3]  Alistair Gorman,et al.  Generalization of the Lyot filter and its application to snapshot spectral imaging. , 2010, Optics express.

[4]  Aswin C. Sankaranarayanan,et al.  FlatCam: Thin, Bare-Sensor Cameras using Coded Aperture and Computation , 2015, ArXiv.

[5]  Nahum Gat,et al.  Development of four-dimensional imaging spectrometers (4D-IS) , 2006, SPIE Optics + Photonics.

[6]  Oliver Cossairt,et al.  Spectral Focal Sweep: Extended depth of field from chromatic aberrations , 2010, 2010 IEEE International Conference on Computational Photography (ICCP).

[7]  Rajesh Menon,et al.  A new class of multi‐bandgap high‐efficiency photovoltaics enabled by broadband diffractive optics , 2015 .

[8]  Michael J Rust,et al.  Sub-diffraction-limit imaging by stochastic optical reconstruction microscopy (STORM) , 2006, Nature Methods.

[9]  Peng Wang,et al.  Optical microlithography on oblique and multiplane surfaces using diffractive phase masks , 2015 .

[10]  B·H·W·亨德里克斯,et al.  Hyperspectral imaging system having a camera probe guide , 2014 .

[11]  Sergey Chernouss,et al.  Hyperspectral all-sky imaging of auroras. , 2012, Optics express.

[12]  V. Micó,et al.  Sub-wavelength and non-periodic holes array based fully lensless imager , 2011 .

[13]  Neelam Gupta,et al.  Miniature snapshot multispectral imager , 2011 .

[14]  Brandon Redding,et al.  High-resolution and broadband all-fiber spectrometers , 2014 .

[15]  Yifan Peng,et al.  The diffractive achromat full spectrum computational imaging with diffractive optics , 2016, ACM Trans. Graph..

[16]  M. Schmid.  Principles Of Optics Electromagnetic Theory Of Propagation Interference And Diffraction Of Light , 2016 .

[17]  Brandon Redding,et al.  All-fiber spectrometer based on speckle pattern reconstruction. , 2013, Optics express.

[18]  R. Menon,et al.  Optimization of periodic nanostructures for enhanced light-trapping in ultra-thin photovoltaics. , 2013, Optics express.

[19]  Ashwin A. Wagadarikar,et al.  Single disperser design for coded aperture snapshot spectral imaging. , 2008, Applied optics.

[20]  Nahum Gat,et al.  Imaging spectroscopy using tunable filters: a review , 2000, SPIE Defense + Commercial Sensing.

[21]  B. Shen,et al.  An integrated-nanophotonics polarization beamsplitter with 2.4 × 2.4 μm2 footprint , 2015, Nature Photonics.

[22]  Hans Joachim Quenzer,et al.  Micro-optic fabrication using one-level gray-tone lithography , 1997, Photonics West.

[23]  Hsin-Yu Tsai,et al.  Confining Light to Deep Subwavelength Dimensions to Enable Optical Nanopatterning , 2009, Science.

[24]  Carl G Ebeling,et al.  Increased localization precision by interference fringe analysis. , 2015, Nanoscale.

[25]  Liang Gao,et al.  Real-time snapshot hyperspectral imaging endoscope. , 2011, Journal of biomedical optics.

[26]  Harry A Atwater,et al.  Plasmonic color filters for CMOS image sensor applications. , 2012, Nano letters.

[27]  Rajesh Menon,et al.  An ultra-small three dimensional computational microscope , 2014 .

[28]  Michael W Kudenov,et al.  White-light Sagnac interferometer for snapshot multispectral imaging. , 2010, Applied optics.

[29]  J. Lippincott-Schwartz,et al.  Imaging Intracellular Fluorescent Proteins at Nanometer Resolution , 2006, Science.

[30]  L Jay Guo.  Recent progress in nanoimprint technology and its applications , 2004 .

[31]  G. Hunt.  SPECTRAL SIGNATURES OF PARTICULATE MINERALS IN THE VISIBLE AND NEAR INFRARED , 1977 .

[32]  P. Hansen.  Discrete Inverse Problems: Insight and Algorithms , 2010 .

[33]  P. Genevet,et al.  Multiwavelength achromatic metasurfaces by dispersive phase compensation , 2014, Science.

[34]  S. Hell.  Microscopy and its focal switch , 2008, Nature Methods.

[35]  S. Hell,et al.  Breaking the diffraction resolution limit by stimulated emission: stimulated-emission-depletion fluorescence microscopy. , 1994, Optics letters.

[36]  Michael W. Kudenov,et al.  Review of snapshot spectral imaging technologies , 2013, Optics and Precision Engineering.

[37]  William E. Ortyn,et al.  Distinguishing Modes of Cell Death Using ImageStream ® Multispectral Imaging Cytometry , 2004 .

[38]  Daniel W. Wilson,et al.  Snapshot hyperspectral imaging in ophthalmology. , 2007, Journal of biomedical optics.

[39]  I. Yamaguchi,et al.  Simultaneous acquisition of spectral image information. , 1991, Optics letters.

[40]  E. Dereniak,et al.  Compact real-time birefringent imaging spectrometer. , 2012, Optics express.

[41]  Rajesh Menon,et al.  Computational spectrometer based on a broadband diffractive optic. , 2014, Optics express.

[42]  H. Cao,et al.  Compact spectrometer based on a disordered photonic chip , 2013, Nature Photonics.

[43]  Laura Waller,et al.  DiffuserCam: Lensless Single-exposure 3D Imaging , 2017, ArXiv.

[44]  David A Basiji,et al.  Distinguishing modes of cell death using the ImageStream® multispectral imaging flow cytometer , 2004, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[45]  P Mouroulis,et al.  Design of pushbroom imaging spectrometers for optimum recovery of spectroscopic and spatial information. , 2000, Applied optics.

[46]  Ravindra Athale,et al.  Flexible multimodal camera using a light field architecture , 2009, 2009 IEEE International Conference on Computational Photography (ICCP).

[47]  Peng Wang,et al.  Computational spectroscopy via singular-value decomposition and regularization. , 2014, Optics express.

[48]  Philip Lewis,et al.  Hyperspectral remote sensing of foliar nitrogen content , 2012, Proceedings of the National Academy of Sciences.

[49]  V. Micó,et al.  One-dimensional wavelength multiplexed microscope without objective lens , 2009 .

[50]  Peng Wang,et al.  Ultra-high-sensitivity color imaging via a transparent diffractive-filter array and computational optics , 2015 .

[51]  T. Ebbesen,et al.  Plasmonic photon sorters for spectral and polarimetric imaging , 2008 .

[52]  S Collins,et al.  Narrowband multispectral filter set for visible band. , 2012, Optics express.

[53]  Zeev Zalevsky,et al.  DOE-based wavelength multiplexing system for a single-mode image transmission , 1997, Other Conferences.