Prediction accuracy of color imagery from hyperspectral imagery

In this paper we present the utilization of high-spectral resolution imagery for improving low-spectral resolution imagery. In our analysis, we assume that an acquisition of high spectral resolution images provides more accurate spectral predictions of low spectral resolution images than a direct acquisition of low spectral resolution images. We illustrate the advantages by focusing on a specific case of images acquired by a hyperspectral (HS) camera and a color (red, green, and blue or RGB) camera. First, we identify two directions for utilization of HS images, such as (a) evaluation and calibration of RGB colors acquired from commercial color cameras, and (b) color quality improvement by achieving sub-spectral resolution. Second, we elaborate on challenges of RGB color calibration using HS information due to non-ideal illumination sources and non-ideal hyperspectral camera characteristics. We describe several adjustment (calibration) approaches to compensate for wavelength and spatial dependencies of real acquisition systems. Finally, we evaluate two color cameras by establishing ground truth RGB values from hyperspectral imagery and by defining pixel-based, correlation-based and histogram-based error metrics. Our experiments are conducted with three illumination sources (fluorescent light, Oriel Xenon lamp and incandescent light); with one HS Opto-Knowledge Systems camera and two color (RGB) cameras, such as Sony and Canon. We show a data-driven color-calibration as a method for improving image color quality. The applications of the developed techniques for HS to RGB image calibrations and sub-spectral resolution predictions are related to real-time model-based scene classification and scene simulation.

[1]  Glenn Healey,et al.  Invariant recognition in hyperspectral images , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[2]  Shree K. Nayar,et al.  Reflectance and texture of real-world surfaces , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  Erzsébet Merényi,et al.  MAPPING COLORADO RIVER ECOSYSTEM RESOURCES IN GLEN CANYON: ANALYSIS OF HYPERSPECTRAL LOW-ALTITUDE AVIRIS IMAGERYT , 2006 .

[4]  Shree K. Nayar,et al.  Correlation model for 3D texture , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[5]  S. Shapiro,et al.  THE JOHNSON SYSTEM: SELECTION AND PARAMETER ESTIMATION , 1980 .

[6]  Peter Bajcsy,et al.  Methodology for evaluating statistically predicted versus measured imagery , 2005, SPIE Defense + Commercial Sensing.

[7]  W.E. Snyder,et al.  Color image processing pipeline , 2005, IEEE Signal Processing Magazine.

[8]  Phil Brodatz,et al.  Textures: A Photographic Album for Artists and Designers , 1966 .

[9]  László Pásztor,et al.  Spectral band selection for the characterization of salinity status of soils , 1993 .

[10]  Peter Bajcsy,et al.  Multisensor scene modeling using statistical models for bidirectional texture functions , 2004, SPIE Defense + Commercial Sensing.

[11]  Andrew Zisserman,et al.  Classifying Images of Materials: Achieving Viewpoint and Illumination Independence , 2002, ECCV.

[12]  Y. Yamagata.  Unmixing with Subspace Method and Application to Hyper Spectral Image , 1996 .

[13]  Johannes R. Sveinsson,et al.  Classification and feature extraction of AVIRIS data , 1995, IEEE Trans. Geosci. Remote. Sens..

[14]  P. Groves,et al.  Methodology For Hyperspectral Band Selection , 2004 .

[15]  Nahum Gat,et al.  Imaging spectroscopy using tunable filters: a review , 2000, SPIE Defense + Commercial Sensing.

[16]  Kristin J. Dana,et al.  Correlation Model for 3 D Texture , 2003 .