A Prism-Mask System for Multispectral Video Acquisition.

In this paper, we propose a prism-based system for capturing multispectral videos. The system consists of a triangular prism, a monochrome camera, and an occlusion mask. Incoming light beams from the scene are sampled by the occlusion mask, dispersed into their constituent spectra by the triangular prism, and then captured by the monochrome camera. Our system is capable of capturing videos of high spectral resolution. It also allows for different tradeoffs between spectral and spatial resolution by adjusting the focal length of the camera. We demonstrate the effectiveness of our system with several applications, including human skin detection, physical material recognition, and RGB video generation.

[1]  S. Mende,et al.  Hadamard spectroscopy with a two-dimensional detecting array. , 1993, Applied optics.

[2]  Shree K. Nayar,et al.  Multispectral Imaging Using Multiplexed Illumination , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[3]  Jessica A. Faust,et al.  Imaging Spectroscopy and the Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) , 1998 .

[4]  Demetri Psaltis,et al.  Volume holographic spectral imaging , 2005, SPIE BiOS.

[5]  M. Descour,et al.  Computed-tomography imaging spectrometer: experimental calibration and reconstruction results. , 1995, Applied optics.

[6]  Esko Herrala,et al.  Imaging spectrometer for process industry applications , 1994, Other Conferences.

[7]  I. Yamaguchi,et al.  Simultaneous Acquisition of Spectral and Spatial Intensity Distribution , 1993 .

[8]  Nathan Hagen,et al.  Analysis of computed tomographic imaging spectrometers. I. Spatial and spectral resolution. , 2008, Applied optics.

[9]  David J. Brady,et al.  Compressive imaging spectrometers using coded apertures , 2006, SPIE Defense + Commercial Sensing.

[10]  James B. Breckinridge,et al.  Image slicer for integral field spectroscopy with NGST , 1998 .

[11]  Wojciech Matusik,et al.  Statistics of Infrared Images , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Eustace L. Dereniak,et al.  Maximizing the resolution of a CTIS instrument , 2006, SPIE Optics + Photonics.

[13]  Ashwin A. Wagadarikar,et al.  Single disperser design for coded aperture snapshot spectral imaging. , 2008, Applied optics.

[14]  Demetri Psaltis,et al.  Volume holographic hyperspectral imaging. , 2004, Applied optics.

[15]  M E Gehm,et al.  Single-shot compressive spectral imaging with a dual-disperser architecture. , 2007, Optics express.

[16]  Eustace L. Dereniak,et al.  Reconfigurable liquid crystal dispersing element for a computed tomography imaging spectrometer , 2007, SPIE Defense + Commercial Sensing.

[17]  M. Rosen,et al.  Lippman 2000: a spectral image database under construction , 1999 .

[18]  Hideaki Haneishi,et al.  High-fidelity video and still-image communication based on spectral information: natural vision system and its applications , 2006, Electronic Imaging.

[19]  Andrew R. Harvey,et al.  Real-time imaging with a hyperspectral fovea , 2005 .

[20]  Ramesh Raskar,et al.  Agile Spectrum Imaging: Programmable Wavelength Modulation for Cameras and Projectors , 2008, Comput. Graph. Forum.

[21]  Jonathan Martin Mooney,et al.  High-throughput hyperspectral infrared camera , 1997 .

[22]  Andrew R. Harvey,et al.  Spectral Imaging: Instrumentation, Applications, and Analysis , 2000 .

[23]  Elli Angelopoulou,et al.  Understanding the color of human skin , 2001, IS&T/SPIE Electronic Imaging.

[24]  N. Pitsianis,et al.  Static two-dimensional aperture coding for multimodal, multiplex spectroscopy. , 2006, Applied optics.

[25]  Graham D. Finlayson,et al.  Using the SpectraCube to Build a Multispectral Image Database , 2004, CGIV.

[26]  Roger Haynes,et al.  New developments in integral field spectroscopy , 1998, Astronomical Telescopes and Instrumentation.

[27]  M. Descour,et al.  Demonstration of a computed-tomography imaging spectrometer using a computer-generated hologram disperser. , 1997, Applied optics.

[28]  K. Kidono,et al.  Visibility Estimation under Night-time Conditions using a Multiband Camera , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[29]  Patrick J. Treado,et al.  Imaging Spectrometers for Fluorescence and Raman Microscopy: Acousto-Optic and Liquid Crystal Tunable Filters , 1994 .

[30]  Nahum Gat,et al.  Imaging spectroscopy using tunable filters: a review , 2000, SPIE Defense + Commercial Sensing.

[31]  Shree K. Nayar,et al.  Generalized Mosaicing: Wide Field of View Multispectral Imaging , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Andrew R. Harvey,et al.  Spectral imaging in a snapshot , 2000, SPIE BiOS.

[33]  D. Arndt-Jovin,et al.  Three‐dimensional spectral imaging by Hadamard transform spectroscopy in a programmable array microscope , 2000, Journal of microscopy.

[34]  Daniel W. Wilson,et al.  Spatial-spectral modulating snapshot hyperspectral imager. , 2006, Applied optics.

[35]  Xiaobai Sun,et al.  Video rate spectral imaging using a coded aperture snapshot spectral imager. , 2009, Optics express.