Image fidelity estimation from received embedded bitstream

Despite the fact that mean squared error (MSE) is the most widely used image/video fidelity criterion, it requires the availability of original image and large computational resources for its computation. The non-availability of original images limits the use of MSE as a quality metric in many practical scenarios. This paper proposes to use MSE reduction (MSER) with reference to null image for estimating the fidelity of images decoded from embedded bitstreams without the original image. MSER is generally used for rate allocation, optimal error protection, etc. However, MSER gives information about the improvement in fidelity of decoded image, rather than its absolute value. It is proposed to estimate MSE from $${\textit{MSER}}_f$$ MSER f (MSE reduction in lossless bitstream) and $${\textit{MSER}}_d$$ MSER d (MSE reduction at desired bitrate/fidelity). The $${\textit{MSER}}_d$$ MSER d can be calculated at decoder side while decoding the embedded bitstream at desired rate. $${\textit{MSER}}_f$$ MSER f is fixed and independent of bitrate, calculated at the encoder side and is embedded in the bitstream as side information. It has been suggested that knowing the values of $${\textit{MSER}}_f$$ MSER f and $${\textit{MSER}}_d$$ MSER d , the MSE of decoded image is simply their difference. Simulation results demonstrate that the proposed method is fairly simple and highly accurate.

[1]  Zhou Wang,et al.  Applications of Objective Image Quality Assessment Methods [Applications Corner] , 2011, IEEE Signal Processing Magazine.

[2]  Meisam Rakhshanfar,et al.  Sparsity-based no-reference image quality assessment for automatic denoising , 2018, Signal Image Video Process..

[3]  Xiuhua Jiang,et al.  No-reference PSNR Estimation Based on HEVC Coding , 2018, 2018 13th APCA International Conference on Control and Soft Computing (CONTROLO).

[4]  Dong-Gyu Sim,et al.  No-reference peak signal to noise ratio estimation based on generalized Gaussian modeling of transform coefficient distributions , 2012 .

[5]  Saeed Mahmoudpour,et al.  No-reference image quality assessment in complex-shearlet domain , 2016, Signal Image Video Process..

[6]  Sangyoun Lee,et al.  SSIM-based distortion metric for film grain noise in HEVC , 2018, Signal Image Video Process..

[7]  Susu Yao,et al.  Just noticeable distortion model and its applications in video coding , 2005, Signal Process. Image Commun..

[8]  Jie Li,et al.  No-reference image quality assessment using Prewitt magnitude based on convolutional neural networks , 2016, Signal Image Video Process..

[9]  Wujie Zhou,et al.  Blind screen content image quality measurement based on sparse feature learning , 2018, Signal Image Video Process..

[10]  Jussi Parkkinen,et al.  Image quality assessment using block-based weighted SVD , 2018, Signal Image Video Process..

[11]  Wenjun Zhang,et al.  Using Free Energy Principle For Blind Image Quality Assessment , 2015, IEEE Transactions on Multimedia.

[12]  Mohammed Ghanbari,et al.  Scope of validity of PSNR in image/video quality assessment , 2008 .

[13]  Boban Bondzulic,et al.  Performance of peak signal-to-noise ratio quality assessment in video streaming with packet losses , 2016 .

[14]  Alireza Alaei,et al.  Image quality assessment based on regions of interest , 2017, Signal Image Video Process..

[15]  Athar Ali Moinuddin,et al.  No-reference image quality assessment of wavelet coded images , 2010, 2010 IEEE International Conference on Image Processing.

[16]  William A. Pearlman,et al.  Set Partition Coding: Part I of Set Partition Coding and Image Wavelet Coding Systems , 2008, Found. Trends Signal Process..

[17]  Damon M. Chandler,et al.  Reduced-reference image quality assessment based on distortion families of local perceived sharpness , 2017, Signal Process. Image Commun..

[18]  Paolo Napoletano,et al.  On the use of deep learning for blind image quality assessment , 2016, Signal Image Video Process..

[19]  Dirk Staehle,et al.  Low-Complexity No-Reference PSNR Estimation for H.264/AVC Encoded Video , 2013, 2013 20th International Packet Video Workshop.

[20]  Gerald Schaefer,et al.  UCID: an uncompressed color image database , 2003, IS&T/SPIE Electronic Imaging.

[21]  Munchurl Kim,et al.  No-Reference PSNR Estimation for HEVC Encoded Video , 2013, IEEE Transactions on Broadcasting.

[22]  Weisi Lin,et al.  Analysis of Distortion Distribution for Pooling in Image Quality Prediction , 2016, IEEE Transactions on Broadcasting.

[23]  Jie Li,et al.  No-reference image quality assessment based on hybrid model , 2017, Signal Image Video Process..

[24]  Athar Ali Moinuddin,et al.  Efficient algorithm for very low bit rate embedded image coding , 2008 .

[25]  Jin Li,et al.  An embedded still image coder with rate-distortion optimization , 1999, IEEE Trans. Image Process..

[26]  Zhou Wang,et al.  Modern Image Quality Assessment , 2006, Modern Image Quality Assessment.

[27]  Alan C. Bovik,et al.  Mean squared error: Love it or leave it? A new look at Signal Fidelity Measures , 2009, IEEE Signal Processing Magazine.

[28]  Weisi Lin,et al.  No-Reference Image Sharpness Assessment in Autoregressive Parameter Space , 2015, IEEE Transactions on Image Processing.

[29]  Zhou Wang,et al.  Objective Image Quality Assessment: Facing The Real-World Challenges , 2016, IQSP.

[30]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[31]  F.W. Wheeler,et al.  Low-memory packetized SPIHT image compression , 1999, Conference Record of the Thirty-Third Asilomar Conference on Signals, Systems, and Computers (Cat. No.CH37020).

[32]  Ke Gu,et al.  Content-weighted mean-squared error for quality assessment of compressed images , 2016, Signal Image Video Process..

[33]  Abdul Rehman,et al.  Reduced-reference SSIM estimation , 2010, 2010 IEEE International Conference on Image Processing.

[34]  William A. Pearlman,et al.  A new, fast, and efficient image codec based on set partitioning in hierarchical trees , 1996, IEEE Trans. Circuits Syst. Video Technol..

[35]  Michael W. Marcellin,et al.  Distortion Estimators for Bitplane Image Coding , 2009, IEEE Transactions on Image Processing.

[36]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[37]  Akshay Gore,et al.  Objective color image quality assessment based on Sobel magnitude , 2017, Signal Image Video Process..