A hierarchical approach to superresolution of multispectral images with different spatial resolutions

In this paper, we focus the attention on the superresolution of multispectral (MS) multiresolution images (e.g., Sentinel 2, Aster, MODIS). By taking advantage of the high spatial resolution bands, we minimize an objective function containing a quadratic data fitting term, an edge preserving regularizer, and a patch-based plug-and play prior promoting self-similar images. To cope with the ill-posedness of the problem we i) exploit the fact that the images are approximately low-rank, and ii) propose a hierarchical method which sharpens in the first place the medium resolution bands and then the coarse resolution ones. The optimization is solved with the alternating direction method of multipliers (ADMM), yielding a fast, flexible, and effective solver, named Superresolution MUltiband multireSolution Hierarchical approach (SMUSH). Quantitative and qualitative results obtained on simulated and real Sentinel 2 (S2) images show the SMUSH effectiveness.

[1]  Naoto Yokoya,et al.  Hyperspectral Pansharpening: A Review , 2015, IEEE Geoscience and Remote Sensing Magazine.

[2]  Jocelyn Chanussot,et al.  Improving MODIS Spatial Resolution for Snow Mapping Using Wavelet Fusion and ARSIS Concept , 2008, IEEE Geoscience and Remote Sensing Letters.

[3]  Simon J. Godsill,et al.  Multiband Image Fusion Based on Spectral Unmixing , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[4]  José M. Bioucas-Dias,et al.  An Augmented Lagrangian Approach to the Constrained Optimization Formulation of Imaging Inverse Problems , 2009, IEEE Transactions on Image Processing.

[5]  Wenzhong Shi,et al.  Fusion of Sentinel-2 images , 2016 .

[6]  Karen O. Egiazarian,et al.  BM3D Frames and Variational Image Deblurring , 2011, IEEE Transactions on Image Processing.

[7]  K. Karantzalos,et al.  Pansharpening on the Narrow Vnir and SWIR Spectral Bands of SENTINEL-2 , 2016 .

[8]  Bruno Aiazzi,et al.  Hyper-Sharpening: A First Approach on SIM-GA Data , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[9]  Brendt Wohlberg,et al.  Plug-and-Play priors for model based reconstruction , 2013, 2013 IEEE Global Conference on Signal and Information Processing.

[10]  K. Itten,et al.  Advanced radiometry measurements and Earth science applications with the Airborne Prism Experiment (APEX) , 2015 .