Image quality assessment based on regions of interest

Most methods in the literature of image quality assessment (IQA) use whole image information for measuring image quality. However, human perception does not always use this criterion to assess the quality of images. Individuals usually provide their opinions by considering only some parts of an image, called regions of interest. Based on this hypothesis, in this research work, a segmentation technique is initially employed to obtain a bi-level image map composed of the foreground and background information. A patch selection strategy is then proposed to choose some particular patches based on the foreground information as the regions of interest for IQA. Three recent IQA methods in the literature are considered to demonstrate the improvement in IQA when using only the extracted regions of interest. To evaluate the impact of the proposed patch selection strategy in various IQA metrics, three publicly available datasets were used for experiments. Experimental results have revealed that our proposal, based on the regions of interest, can improve quality measures of three IQA methods.

[1]  Neil W. Bergmann,et al.  An automatic image quality assessment technique incorporating higher level perceptual factors , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[2]  Lei Zhang,et al.  Learning without Human Scores for Blind Image Quality Assessment , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Junle Wang,et al.  Quantifying how the combination of blur and disparity affects the perceived depth , 2011, Electronic Imaging.

[4]  Wen Gao,et al.  Visual attention based image quality assessment , 2011, 2011 18th IEEE International Conference on Image Processing.

[5]  Judith Redi,et al.  Studying the effect of optimizing image quality in salient regions at the expense of background content , 2013, J. Electronic Imaging.

[6]  Ingrid Heynderickx,et al.  How Does Image Content Affect the Added Value of Visual Attention in Objective Image Quality Assessment? , 2013, IEEE Signal Processing Letters.

[7]  Hubert Konik,et al.  Full Reference Image Quality Assessment Based on Saliency Map Analysis , 2010 .

[8]  Judith Redi,et al.  Interactions of visual attention and quality perception , 2011, Electronic Imaging.

[9]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Zhou Wang,et al.  Embedded foveation image coding , 2001, IEEE Trans. Image Process..

[11]  Alan C. Bovik,et al.  Automatic prediction of saliency on JPEG distorted images , 2011, 2011 Third International Workshop on Quality of Multimedia Experience.

[12]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[13]  Azeddine Beghdadi,et al.  A survey of perceptual image processing methods , 2013, Signal Process. Image Commun..

[14]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[15]  Ke Gu,et al.  Content-weighted mean-squared error for quality assessment of compressed images , 2016, Signal Image Video Process..

[16]  Lei Zhang,et al.  Gradient Magnitude Similarity Deviation: A Highly Efficient Perceptual Image Quality Index , 2013, IEEE Transactions on Image Processing.

[17]  Judith Redi,et al.  An efficient no-reference metric for perceived blur , 2011, 3rd European Workshop on Visual Information Processing.

[18]  Patrick Le Callet,et al.  Does where you Gaze on an Image Affect your Perception of Quality? Applying Visual Attention to Image Quality Metric , 2007, 2007 IEEE International Conference on Image Processing.

[19]  Junle Wang,et al.  Quantifying the relationship between visual salience and visual importance , 2010, Electronic Imaging.

[20]  Nikolay N. Ponomarenko,et al.  TID2008 – A database for evaluation of full-reference visual quality assessment metrics , 2004 .

[21]  Patrick Le Callet,et al.  Visual Attention and Applications in Multimedia Technologies , 2013, Proceedings of the IEEE.

[22]  Kevin Barraclough,et al.  I and i , 2001, BMJ : British Medical Journal.

[23]  Jie Li,et al.  No-reference image quality assessment using Prewitt magnitude based on convolutional neural networks , 2016, Signal Image Video Process..

[24]  D. Chandler.  Seven Challenges in Image Quality Assessment: Past, Present, and Future Research , 2013 .

[25]  Narendra Ahuja,et al.  Segmentation-based Perceptual Image Quality Assessment (SPIQA) , 2008, 2008 15th IEEE International Conference on Image Processing.

[26]  Patrick Le Callet,et al.  Perceived interest and overt visual attention in natural images , 2015, Signal Process. Image Commun..

[27]  Alireza Alaei,et al.  A new scheme for unconstrained handwritten text-line segmentation , 2011, Pattern Recognit..

[28]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[29]  Judith Redi,et al.  How to apply spatial saliency into objective metrics for JPEG compressed images? , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[30]  Driss Aboutajdine,et al.  Reduced reference image quality assessment based on statistics in empirical mode decomposition domain , 2014, Signal Image Video Process..