A super-resolution reconstruction algorithm for hyperspectral images

The spatial resolution of a hyperspectral image is often coarse because of the limitations of the imaging hardware. Super-resolution reconstruction (SRR) is a promising signal post-processing technique for hyperspectral image resolution enhancement. This paper proposes a maximum a posteriori (MAP) based multi-frame super-resolution algorithm for hyperspectral images. Principal component analysis (PCA) is utilized in both parts of the proposed algorithm: motion estimation and image reconstruction. A simultaneous motion estimation method with the first few principal components, which contain most of the information of a hyperspectral image, is proposed to reduce computational load and improve motion field accuracy. In the image reconstruction part, different image resolution enhancement techniques are applied to different groups of components, to reduce computational load and simultaneously remove noise. The proposed algorithm is tested on both synthetic images and real image sequences. The experimental results and comparative analyses verify the effectiveness of this algorithm.

[1]  Robert L. Stevenson,et al.  Extraction of high-resolution frames from video sequences , 1996, IEEE Trans. Image Process..

[2]  Avideh Zakhor,et al.  Resolution enhancement of color video sequences , 1999, IEEE Trans. Image Process..

[3]  Bjørn K. Alsberg,et al.  Superresolution of hyperspectral images , 2006 .

[4]  Raymond H. Chan,et al.  Wavelet Algorithms for High-Resolution Image Reconstruction , 2002, SIAM J. Sci. Comput..

[5]  I. Jolliffe.  Principal Component Analysis , 2002 .

[6]  Michael Elad,et al.  Superresolution restoration of an image sequence: adaptive filtering approach , 1999, IEEE Trans. Image Process..

[7]  Aggelos K. Katsaggelos,et al.  Resolution enhancement of monochrome and color video using motion compensation , 2001, IEEE Trans. Image Process..

[8]  Shmuel Peleg,et al.  Efficient super-resolution and applications to mosaics , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[9]  A. Murat Tekalp,et al.  Superresolution video reconstruction with arbitrary sampling lattices and nonzero aperture time , 1997, IEEE Trans. Image Process..

[10]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[11]  Roger Y. Tsai,et al.  Multiframe image restoration and registration , 1984 .

[12]  Michal Irani,et al.  Improving resolution by image registration , 1991, CVGIP Graph. Model. Image Process..

[13]  Liangpei Zhang,et al.  Classification and Extraction of Spatial Features in Urban Areas Using High-Resolution Multispectral Imagery , 2007, IEEE Geoscience and Remote Sensing Letters.

[14]  José M. Bioucas-Dias,et al.  Adaptive total variation image deconvolution: A majorization-minimization approach , 2006, 2006 14th European Signal Processing Conference.

[15]  Yücel Altunbasak,et al.  Super-resolution reconstruction of hyperspectral images , 2005 .

[16]  Russell C. Hardie,et al.  Hyperspectral resolution enhancement using high-resolution multispectral imagery with arbitrary response functions , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Liangpei Zhang,et al.  Adaptive Multiple-Frame Image Super-Resolution Based on U-Curve , 2010, IEEE Transactions on Image Processing.

[18]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[19]  Michael Elad,et al.  Restoration of a single superresolution image from several blurred, noisy, and undersampled measured images , 1997, IEEE Trans. Image Process..

[20]  T. Chan,et al.  Wavelet deblurring algorithms for spatially varying blur from high-resolution image reconstruction , 2003 .

[21]  Michael K. Ng,et al.  Wavelet algorithms for deblurring models , 2004, Int. J. Imaging Syst. Technol..

[22]  C. Vogel.  Computational Methods for Inverse Problems , 1987 .

[23]  Michael Elad,et al.  Advances and challenges in super‐resolution , 2004, Int. J. Imaging Syst. Technol..

[24]  Russell C. Hardie,et al.  Application of the stochastic mixing model to hyperspectral resolution enhancement , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Seunghyeon Rhee,et al.  Discrete cosine transform based regularized high-resolution image reconstruction algorithm , 1999 .

[26]  Liangpei Zhang,et al.  A MAP Approach for Joint Motion Estimation, Segmentation, and Super Resolution , 2007, IEEE Transactions on Image Processing.

[27]  Ye Zhang,et al.  Super-Resolution Challenges in Hyperspectral Imagery , 2008 .

[28]  Daniel Gross,et al.  Improved resolution from subpixel shifted pictures , 1992, CVGIP Graph. Model. Image Process..

[29]  Liangpei Zhang,et al.  A super-resolution reconstruction algorithm for surveillance images , 2010, Signal Process..

[30]  Nirmal K. Bose,et al.  Recursive reconstruction of high resolution image from noisy undersampled multiframes , 1990, IEEE Trans. Acoust. Speech Signal Process..

[31]  H Stark,et al.  High-resolution image recovery from image-plane arrays, using convex projections. , 1989, Journal of the Optical Society of America. A, Optics and image science.

[32]  Guangyi Chen,et al.  Denoising of Hyperspectral Imagery Using Principal Component Analysis and Wavelet Shrinkage , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Stephen J. Roberts,et al.  Bayesian Image Super-resolution, Continued , 2006, NIPS.