Resolution enhancement of hyperspectral imagery using coincident panchromatic imagery and a stochastic mixing model

A maximum a posteriori (MAP) estimation approach to the hyperspectral resolution enhancement problem is described for enhancing the spatial resolution of a hyperspectral image using a higher resolution, coincident, panchromatic image. The approach makes use of a stochastic mixing model (SMM) of the underlying spectral scene content to develop a cost function that simultaneously optimizes the estimated hyperspectral scene relative to the observed hyperspectral and panchromatic imagery, as well as the local statistics of the spectral mixing model. The incorporation of the stochastic mixing model is found to be the key ingredient to reconstructing subpixel spectral information in that it provides the necessary constraints that lead to a well-conditioned linear system of equations for the high resolution hyperspectral image estimate. The mathematical formulation of the method is described, and enhancement results are provided for a synthetically-generated hyperspectral image data set and compared to prior methods. In general, it is found that the MAP/SMM method is able to reconstruct sub-pixel information in several principal components of the high resolution hyperspectral image estimate, while the enhancement for conventional methods, like those based on least-squares estimation, is limited primarily to the first principal component (i.e., the intensity component).

[1]  Robert A. Schowengerdt,et al.  Synthesis of imagery with high spatial and spectral resolution from multiple image sources , 1994 .

[2]  Russell C. Hardie,et al.  Initialization and convergence of the stochastic mixing model , 2004, SPIE Optics + Photonics.

[3]  H. Kaufmann,et al.  A new technique for merging multispectral and panchromatic images revealing sub-pixel spectral variation , 1995, 1995 International Geoscience and Remote Sensing Symposium, IGARSS '95. Quantitative Remote Sensing for Science and Applications.

[4]  John R. Schott,et al.  Application of spatial resolution enhancement and spectral mixture analysis to hyperspectral images , 1996, Optics + Photonics.

[5]  John R. Schott,et al.  Application of Spectral Mixture Analysis and Image Fusion Techniques for Image Sharpening , 1998 .

[6]  William M. Rappoport,et al.  The HYDICE instrument design and its application to planetary instruments , 1993 .

[7]  John R. Schott,et al.  Evaluation of Two Applications of Spectral Mixing Models to Image Fusion , 2000 .

[8]  Michael E. Winter,et al.  Physics-based resolution enhancement of hyperspectral data , 2002, SPIE Defense + Commercial Sensing.

[9]  W. J. Carper,et al.  The use of intensity-hue-saturation transformations for merging SPOT panchromatic and multispectral image data , 1990 .

[10]  J. Schott,et al.  Incorporation of a time-dependent thermodynamic model and a radiation propagation model into IR 3D synthetic image generation , 1992 .

[11]  V. K. Shettigara,et al.  A generalized component substitution technique for spatial enhancement of multispectral images using , 1992 .

[12]  Boris Zhukov,et al.  A multiresolution multisensor technique for satellite remote sensing , 1995, 1995 International Geoscience and Remote Sensing Symposium, IGARSS '95. Quantitative Remote Sensing for Science and Applications.

[13]  Wojciech Pieczynski,et al.  SEM algorithm and unsupervised statistical segmentation of satellite images , 1993, IEEE Trans. Geosci. Remote. Sens..

[14]  L. Wald,et al.  Fusion of high spatial and spectral resolution images : The ARSIS concept and its implementation , 2000 .

[15]  Ryuei Nishii,et al.  Enhancement of low spatial resolution image based on high resolution-bands , 1996, IEEE Trans. Geosci. Remote. Sens..

[16]  James R. Lersch,et al.  Adaptive image sharpening using multiresolution representations , 1994, Defense, Security, and Sensing.

[17]  Alan P. Schaum,et al.  Application of stochastic mixing models to hyperspectral detection problems , 1997, Defense, Security, and Sensing.

[18]  J. C. Price,et al.  Combining panchromatic and multispectral imagery dual resolution satellite instruments , 1987 .

[19]  J. Schott,et al.  Resolution enhancement of multispectral image data to improve classification accuracy , 1993 .