Convergence analysis for image interpolation in terms of the cSSIM

Assessing the similarity of two images is a complex task that has attracted significant efforts in the image processing community. The widely used Structural Similarity Index Measure (SSIM) addresses this problem by quantifying a perceptual structural similarity. In this paper we consider a recently introduced continuous SSIM (cSSIM), which allows one to analyze sequences of images of increasingly fine resolutions. We prove that this index includes the classical SSIM as a special case, and we provide a precise connection between image similarity measured by the cSSIM and by the L2 norm. Using this connection, we derive bounds on the cSSIM by means of bounds on the L2 error, and we even prove that the two error measures are equivalent in certain circumstances. We exploit these results to obtain precise rates of convergence with respect to the cSSIM for several concrete image interpolation methods, and we further validate these findings by many numerical experiments. This newly established connection paves the way to obtain novel insights into the features and limitations of the SSIM. *francesco.marchetti@math.unipd.it, orcid.org/0000-00031087-7589 †gsantin@fbk.eu, orcid.org/0000-0001-6959-1070

[1]  Takio Kurita,et al.  Fast and Accurate Image Super Resolution by Deep CNN with Skip Connection and Network in Network , 2017, ICONIP.

[2]  Zhou Wang,et al.  Geodesics of the Structural Similarity index , 2012, Appl. Math. Lett..

[3]  Zhou Wang,et al.  Complex Wavelet Structural Similarity: A New Image Similarity Index , 2009, IEEE Transactions on Image Processing.

[4]  P. R. Smith,et al.  Bilinear interpolation of digital images , 1981 .

[5]  Abdul Rehman Gilal,et al.  Efficient Edge-Based Image Interpolation Method Using Neighboring Slope Information , 2019, IEEE Access.

[6]  Hwang Soo Lee,et al.  Adaptive image interpolation based on local gradient features , 2004, IEEE Signal Process. Lett..

[7]  Z. Jane Wang,et al.  A Rotation-Invariant Convolutional Neural Network for Image Enhancement Forensics , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[8]  Bodhaswar T. Maharaj,et al.  Optimization of image interpolation based on nearest neighbour algorithm , 2014, 2014 International Conference on Computer Vision Theory and Applications (VISAPP).

[9]  Weikuan Jia,et al.  Single image super-resolution using a polymorphic parallel CNN , 2018, Applied Intelligence.

[10]  Zhou Wang,et al.  On the Mathematical Properties of the Structural Similarity Index , 2012, IEEE Transactions on Image Processing.

[11]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[12]  W. McLean Strongly Elliptic Systems and Boundary Integral Equations , 2000 .

[13]  F. Marchetti Convergence rate in terms of the continuous SSIM (cSSIM) index in RBF interpolation , 2021 .

[14]  S. de Marchi,et al.  Jumping with variably scaled discontinuous kernels (VSDKs) , 2020 .

[15]  Holger Wendland,et al.  Approximate Interpolation with Applications to Selecting Smoothing Parameters , 2005, Numerische Mathematik.

[16]  Pascal Getreuer,et al.  Linear Methods for Image Interpolation , 2011, Image Process. Line.

[17]  Emma Perracchione,et al.  Shape-Driven Interpolation With Discontinuous Kernels: Error Analysis, Edge Extraction, and Applications in Magnetic Particle Imaging , 2020, SIAM J. Sci. Comput..

[18]  Guang Deng,et al.  Edge-aware smoothing through adaptive interpolation , 2018, Signal Image Video Process..

[19]  F. Marchetti,et al.  Spectral filtering for the reduction of the Gibbs phenomenon for polynomial approximation methods on Lissajous curves with applications in MPI , 2017 .

[20]  Nan Jiang,et al.  Quantum image scaling using nearest neighbor interpolation , 2015, Quantum Inf. Process..

[21]  Tieniu Tan,et al.  Wavelet-SRNet: A Wavelet-Based CNN for Multi-scale Face Super Resolution , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[22]  Kai Zeng,et al.  Display device-adapted video quality-of-experience assessment , 2015, Electronic Imaging.

[23]  Wan-Chi Siu,et al.  Review of image interpolation and super-resolution , 2012, Proceedings of The 2012 Asia Pacific Signal and Information Processing Association Annual Summit and Conference.