Optimal region-of-interest based visual quality assessment

Visual content typically exhibits regions that particularly attract the viewer's attention, usually referred to as regions-of-interest (ROI). In the context of visual quality one may expect that distortions occurring in the ROI are perceived more annoyingly than distortions in the background (BG). This is especially true given that the human visual system is highly space variant in sampling visual signals. However, this phenomenon of visual attention is only seldom taken into account in visual quality metric design. In this paper, we thus provide a framework for incorporation of visual attention into the design of an objective quality metric by means of regionbased segmentation of the image. To support the metric design we conducted subjective experiments to both quantify the subjective quality of a set of distorted images and also to identify ROI in a set of reference images. Multiobjective optimization is then applied to find the optimal weighting of the ROI and BG quality metrics. It is shown that the ROI based metric design allows to increase quality prediction performance of the considered metric and also of two other contemporary quality metrics.

[1]  Yacov Y. Haimes,et al.  Approach to performance and sensitivity multiobjective optimization: The goal attainment method , 1975 .

[2]  David J. Sakrison,et al.  The effects of a visual fidelity criterion of the encoding of images , 1974, IEEE Trans. Inf. Theory.

[3]  James Hu,et al.  DVQ: A digital video quality metric based on human vision , 2001 .

[4]  Tubagus Maulana Kusuma,et al.  On the development of a reduced-reference perceptual image quality metric , 2005, 2005 Systems Communications (ICW'05, ICHSN'05, ICMCS'05, SENET'05).

[5]  Alan C. Bovik,et al.  Image information and visual quality , 2006, IEEE Trans. Image Process..

[6]  Bernice E. Rogowitz,et al.  Human Vision and Electronic Imaging II , 1997 .

[7]  Damon M. Chandler,et al.  A Bayesian approach to predicting the perceived interest of objects , 2008, 2008 15th IEEE International Conference on Image Processing.

[8]  Patrick Le Callet,et al.  Does where you Gaze on an Image Affect your Perception of Quality? Applying Visual Attention to Image Quality Metric , 2007, 2007 IEEE International Conference on Image Processing.

[9]  Thrasyvoulos N. Pappas,et al.  Perceptual criteria for image quality evaluation , 2005 .

[10]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.

[11]  A. M. Rohaly,et al.  Automatic detection of regions of interest in complex video sequences , 2001, IS&T/SPIE Electronic Imaging.

[12]  Joyce E. Farrell,et al.  Handbook of Image Quality: Characterization and Prediction , 2004 .

[13]  M. Ehrgott Multiobjective Optimization , 2008, AI Mag..

[14]  Anthony J. Maeder The image importance approach to human vision based image quality characterization , 2005, Pattern Recognit. Lett..

[15]  Christophe De Vleeschouwer,et al.  Fuzzy logic system able to detect interesting areas of a video sequence , 1997, Electronic Imaging.

[16]  Z. L. Budrikis,et al.  Picture Quality Prediction Based on a Visual Model , 1982, IEEE Trans. Commun..

[17]  Stefan Winkler,et al.  A no-reference perceptual blur metric , 2002, Proceedings. International Conference on Image Processing.

[18]  Jens-Rainer Ohm Multimedia Communication Technology: Representation,Transmission and Identification of Multimedia Signals , 2004 .

[19]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .

[20]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[21]  Jens-Rainer Ohm,et al.  Multimedia Communication Technology , 2004 .

[22]  Alan C. Bovik,et al.  Unifying analysis of full reference image quality assessment , 2008, 2008 15th IEEE International Conference on Image Processing.

[23]  Hong Ren Wu,et al.  Digital Video Image Quality and Perceptual Coding , 2005 .

[24]  Huib de Ridder Minkowski-metrics as a combination rule for digital-image-coding impairments , 1992 .

[25]  Claudio M. Privitera,et al.  Algorithms for Defining Visual Regions-of-Interest: Comparison with Eye Fixations , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  A. L. I︠A︡rbus Eye Movements and Vision , 1967 .

[27]  R. Vemuri,et al.  An analysis on the effect of image features on lossy coding performance , 2000, IEEE Signal Processing Letters.

[28]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[29]  Lotfi A. Zadeh,et al.  Optimality and non-scalar-valued performance criteria , 1963 .

[30]  Hans-Jürgen Zepernick,et al.  Pareto optimalweighting of structural impairments for wireless imaging quality assessment , 2008, 2008 15th IEEE International Conference on Image Processing.

[31]  Zhou Wang,et al.  No-reference perceptual quality assessment of JPEG compressed images , 2002, Proceedings. International Conference on Image Processing.

[32]  Tsuhan Chen,et al.  DISCOV: A Framework for Discovering Objects in Video , 2008, IEEE Transactions on Multimedia.

[33]  Jean-Bernard Martens,et al.  Multidimensional modeling of image quality , 2002, Proc. IEEE.

[34]  Scott J. Daly,et al.  Visible differences predictor: an algorithm for the assessment of image fidelity , 1992, Electronic Imaging.