Noise adaptive super-resolution from single image via non-local mean and sparse representation

Abstract Super-resolution from a single image is a challenging task, more so, in presence of noise with unknown strength. We propose a robust super-resolution algorithm which adapts itself based on the noise-level in the image. We observe that dependency among the gradient values of relatively smoother patches diminishes with increasing strength of noise. Such a dependency is quantified using the ratio of first two singular values computed from local image gradients. The ratio is inversely proportional to the strength of noise. The number of patches with smaller ratio increases with increasing strength of noise. This behavior is used to formulate some parameters that are used in two ways in a sparse-representation based super-resolution approach: i) in computing an adaptive threshold, used in estimating the sparse coefficient vector via the iterative thresholding algorithm, ii) in choosing between the components representing image details and non-local means of similar patches. Furthermore, our approach constructs dictionaries by coarse-to-fine processing of the input image, and hence does not require any external training images. Additionally, an edge preserving constraint helps in better edge retention. As compared to state-of-the-art approaches, our method demonstrates better efficacy for optical and range images under different types and strengths of noise.