Towards Video Quality Metrics Based on Colour Fractal Geometry

Vision is a complex process that integrates multiple aspects of an image: spatial frequencies, topology and colour. Unfortunately, so far, all these elements were independently took into consideration for the development of image and video quality metrics, therefore we propose an approach that blends together all of them. Our approach allows for the analysis of the complexity of colour images in the RGB colour space, based on the probabilistic algorithm for calculating the fractal dimension and lacunarity. Given that all the existing fractal approaches are defined only for gray-scale images, we extend them to the colour domain. We show how these two colour fractal features capture the multiple aspects that characterize the degradation of the video signal, based on the hypothesis that the quality degradation perceived by the user is directly proportional to the modification of the fractal complexity. We claim that the two colour fractal measures can objectively assess the quality of the video signal and they can be used as metrics for the user-perceived video quality degradation and we validated them through experimental results obtained for an MPEG-4 video streaming application; finally, the results are compared against the ones given by unanimously-accepted metrics and subjective tests.

[1]  C. Allain,et al.  Characterizing the lacunarity of random and deterministic fractal sets. , 1991, Physical review. A, Atomic, molecular, and optical physics.

[2]  C. Sparrow The Fractal Geometry of Nature , 1984 .

[3]  M. Ivanovici,et al.  Fractal dimension and lacunarity of psoriatic lesions: a colour approach , 2009 .

[4]  David T. Rohrbaugh,et al.  Lacunarity definition for ramified data sets based on optimal cover , 2003 .

[5]  Benoit B. Mandelbrot,et al.  Fractal Geometry of Nature , 1984 .

[6]  Zhou Wang,et al.  Quantifying color image distortions based on adaptive spatio-chromatic signal decompositions , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[7]  Kuntal Ghosh,et al.  Complexity in Human Perception of Brightness: A Historical Review on the Evolution of the Philosophy of Visual Perception , 2010 .

[8]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[9]  Mihai Ivanovici,et al.  Fractal Dimension of Colour Fractal Images , 2010 .

[10]  Andrzej Bargiela,et al.  Fuzzy fractal dimensions and fuzzy modeling , 2003, Inf. Sci..

[11]  D. Chandler,et al.  Supplement to “ VSNR : A Visual Signal-to-Noise Ratio for Natural Images Based on Near-Threshold and Suprathreshold Vision ” , 2007 .

[12]  Kenneth Falconer,et al.  Fractal Geometry: Mathematical Foundations and Applications , 1990 .

[13]  Stefan Winkler,et al.  Digital Video Quality: Vision Models and Metrics , 2005 .

[14]  Stefan Winkler,et al.  Issues in vision modeling for perceptual video quality assessment , 1999, Signal Process..

[15]  Christine Fernandez-Maloigne Fundamental Study for Evaluating Image Quality , 2008 .

[16]  Mihai Ivanovici,et al.  Fractal Dimension of Color Fractal Images , 2011, IEEE Transactions on Image Processing.

[17]  Sheila S. Hemami,et al.  Suprathreshold image compression based on contrast allocation and global precedence , 2003, IS&T/SPIE Electronic Imaging.

[18]  Richard P. Taylor,et al.  The Visual Complexity of Pollock’s Dripped Fractals , 2008 .

[19]  James M. Keller,et al.  Texture description and segmentation through fractal geometry , 1989, Comput. Vis. Graph. Image Process..

[20]  K. O. Niemann,et al.  Simulation and quantification of the fine-scale spatial pattern and heterogeneity of forest canopy structure: A lacunarity-based method designed for analysis of continuous canopy heights , 2005 .

[21]  Christine Fernandez-Maloigne,et al.  Objective Quality Measurement Based on Anisotropic Contrast Perception , 2008, CGIV/MCS.

[22]  E. Weibel,et al.  Fractals in Biology and Medicine , 1994 .

[23]  Zhou Wang,et al.  Complex Wavelet Structural Similarity: A New Image Similarity Index , 2009, IEEE Transactions on Image Processing.

[24]  Yung-Chang Chen,et al.  Ultrasonic Liver Tissues Classification by Fractal Feature Vector Based on M-band Wavelet Transform , 2001, IEEE Trans. Medical Imaging.

[25]  Chih-Ming Hsieh,et al.  Algorithms to estimating fractal dimension of textured images , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[26]  Petros Maragos,et al.  Measuring the Fractal Dimension of Signals: Morphological Covers and Iterative Optimization , 1993, IEEE Trans. Signal Process..

[27]  D. Field,et al.  Human discrimination of fractal images. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[28]  Christine Fernandez-Maloigne,et al.  No-Reference Metric based on the color feature: Application to quality assessment of Displays , 2008, CGIV/MCS.

[29]  Alan C. Bovik,et al.  Mean squared error: Love it or leave it? A new look at Signal Fidelity Measures , 2009, IEEE Signal Processing Magazine.

[30]  Mihai Ivanovici,et al.  Colour Covering Blanket , 2010, IPCV.

[31]  Frederick David Abraham,et al.  The Use of Fractals for the Study of the Psychology of Perception , 2003 .

[32]  W. Hargrove,et al.  Lacunarity analysis: A general technique for the analysis of spatial patterns. , 1996, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[33]  Alex Pentland,et al.  Fractal-Based Description of Natural Scenes , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Julien Clinton Sprott,et al.  Automatic generation of strange attractors , 1993, Comput. Graph..

[35]  Stefan Winkler,et al.  Visual fidelity and perceived quality: toward comprehensive metrics , 2001, IS&T/SPIE Electronic Imaging.

[36]  R. SheikhH.,et al.  No-reference quality assessment using natural scene statistics , 2005 .

[37]  Alan C. Bovik,et al.  No-reference quality assessment using natural scene statistics: JPEG2000 , 2005, IEEE Transactions on Image Processing.

[38]  M. Ivanovici,et al.  User-Perceived Quality Assessment for Multimedia Applications , 2006 .

[39]  Matthias Malkowski,et al.  Performance of Video Telephony Services in UMTS using Live Measurements and Network Emulation , 2008, Wirel. Pers. Commun..

[40]  Sheila S. Hemami,et al.  Effects of spatial correlations and global precedence on the visual fidelity of distorted images , 2006, Electronic Imaging.

[41]  R. Voss Random Fractals: characterization and measurement , 1991 .

[42]  Stefan Winkler,et al.  Perceptual Video Quality and Blockiness Metrics for Multimedia Streaming Applications , 2001 .

[43]  J. Cutting,et al.  Fractal curves and complexity , 1987, Perception & psychophysics.

[44]  Noël Richard,et al.  No-reference perceptual quality assessment of colour image , 2006, 2006 14th European Signal Processing Conference.

[45]  Nick G. Kingsbury,et al.  A distortion measure for blocking artifacts in images based on human visual sensitivity , 1995, IEEE Trans. Image Process..

[46]  M.-C. Larabi,et al.  Comparison of subjective assessment protocols for digital cinema applications , 2009, Electronic Imaging.

[47]  M. Serizawa,et al.  REDUCED-REFERENCE BASED VIDEO QUALITY-METRICS USING REPRESENTATIVE-LUMINANCE VALUES , 2007 .

[48]  Aglaia G. Manousaki,et al.  Use of color texture in determining the nature of melanocytic skin lesions - a qualitative and quantitative approach , 2006, Comput. Biol. Medicine.

[49]  Patrick C. Teo,et al.  Perceptual image distortion , 1994, Electronic Imaging.

[50]  Mihai Ivanovici,et al.  Colour Fractal Image Generation , 2009, IPCV.

[51]  D. Chandler,et al.  Effects of natural images on the detectability of simple and compound wavelet subband quantization distortions. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[52]  Thrasyvoulos N. Pappas,et al.  Perceptual criteria for image quality evaluation , 2005 .

[53]  Edgar E. Peters Fractal Market Analysis: Applying Chaos Theory to Investment and Economics , 1994 .

[54]  Mihai Ivanovici,et al.  The lacunarity of colour fractal images , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[55]  J. A. Wise,et al.  Perceptual and physiological responses to the visual complexity of fractal patterns. , 2005, Nonlinear dynamics, psychology, and life sciences.

[56]  Zhou Wang,et al.  Perceptual quality assessment of color images using adaptive signal representation , 2010, Electronic Imaging.

[57]  Mihai Ivanovici,et al.  Correlating Quality of Experience and Quality of Service for Network Applications , 2010 .