Reduced-Reference Video Quality Assessment Using Discriminative Local Harmonic Strength With Motion Consideration

This paper presents a reduced-reference objective picture quality measurement tool of compressed video. We have used a discriminative analysis of harmonic strength computed from edge-detected pictures to create harmonics gain and loss information that could be associated with the picture. The harmonics gain/loss are derived through the harmonic analysis of the compressed and source pictures to be incorporated in the reduced-reference video quality meter. This information corresponds with the two most prominent compression distortions, namely blockiness and blurriness. We have also studied the impact of motion in a video sequence on these compression distortions and the way they should be weighted and combined to give the best objective quality metric model. The model has been calibrated using several video sequences with dominant blockiness and blurriness. Validation of the model is performed by applying the model to the 50 Hz video sequences of VQEG Test Phase-I. Our results show that the proposed model achieves good correlations with the subjective evaluations of the VQEG datasets and its performance is comparable to those of the full-reference models in the literature.

[1]  Steven G. Johnson,et al.  The Design and Implementation of FFTW3 , 2005, Proceedings of the IEEE.

[2]  Jerome R. Cox,et al.  Experimental evaluation of psychophysical distortion metrics for JPEG-encoded images , 1995, J. Electronic Imaging.

[3]  Pasi Fränti.  Blockwise distortion measure for statistical and structural errors in digital images , 1998, Signal Process. Image Commun..

[4]  Sanjit K. Mitra,et al.  Perceptual contributions of blocky, blurry and noisy artifacts to overall annoyance , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[5]  Alan C. Bovik,et al.  41 OBJECTIVE VIDEO QUALITY ASSESSMENT , 2003 .

[6]  Stephen D. Voran,et al.  Objective video quality assessment system based on human perception , 1993, Electronic Imaging.

[7]  A. Bovik,et al.  OBJECTIVE VIDEO QUALITY ASSESSMENT , 2003 .

[8]  Martin Cadík,et al.  FFT and Convolution Performance in Image Filtering on GPU , 2006, Tenth International Conference on Information Visualisation (IV'06).

[9]  Stephen Wolf.  The Relationship Between Performance and Spatial-Temporal Region Size for Reduced-Reference, In-Service Video Quality Monitoring Systems , 2001 .

[10]  Li Dong,et al.  Visual distortion gauge based on discrimination of noticeable contrast changes , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Weisi Lin,et al.  LOW BIT RATE VIDEO QUALITY ASSESSMENT BASED ON PERCEPTUAL CHARACTERISTICS , 2003 .

[12]  Stefan Winkler,et al.  A no-reference perceptual blur metric , 2002, Proceedings. International Conference on Image Processing.

[13]  Norman B. Nill,et al.  A Visual Model Weighted Cosine Transform for Image Compression and Quality Assessment , 1985, IEEE Trans. Commun..

[14]  Mohammed Ghanbari,et al.  Standard Codecs: Image Compression to Advanced Video Coding , 2003 .

[15]  Alexander K.G. Worner.  A Real Time Single Ended Algorithm for Objective Quality Monitoring of Compressed Video Signals , 2002 .

[16]  Mohammed Ghanbari,et al.  Blockiness detection for MPEG2-coded video , 2000, IEEE Signal Processing Letters.

[17]  Mohammed Ghanbari,et al.  Image quality assessment based on harmonics gain/loss information , 2005, IEEE International Conference on Image Processing 2005.

[18]  Zhenghua Yu,et al.  Vision-model-based impairment metric to evaluate blocking artifacts in digital video , 2002, Proc. IEEE.

[19]  Zhou Wang,et al.  Video quality assessment based on structural distortion measurement , 2004, Signal Process. Image Commun..

[20]  Michael Yuen,et al.  A survey of hybrid MC/DPCM/DCT video coding distortions , 1998, Signal Process..

[21]  Weisi Lin,et al.  Visual distortion assessment with emphasis on spatially transitional regions , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[22]  Brian A. Wandell,et al.  Color image fidelity metrics evaluated using image distortion maps , 1998, Signal Process..

[23]  J. Lubin.  A human vision system model for objective picture quality measurements , 1997 .

[24]  Stanley A. Klein,et al.  Seven models of masking , 1997, Electronic Imaging.

[25]  John O. Limb,et al.  Distortion Criteria of the Human Viewer , 1979, IEEE Transactions on Systems, Man, and Cybernetics.

[26]  Judith Dijk,et al.  A New Sharpness Measure Based on Gaussian Lines and Edges , 2003, CAIP.

[27]  Steven W. Zucker,et al.  Local Scale Control for Edge Detection and Blur Estimation , 1996, ECCV.

[28]  Chiou-Ting Hsu,et al.  Mosaics of video sequences with moving objects , 2004, Signal Process. Image Commun..

[29]  H.M. Wechsler,et al.  Digital image processing, 2nd ed. , 1981, Proceedings of the IEEE.

[30]  David J. Sakrison,et al.  The effects of a visual fidelity criterion of the encoding of images , 1974, IEEE Trans. Inf. Theory.

[31]  J. Baina,et al.  Objective methods for assessment of video quality : state of the art , 1997, IEEE Trans. Broadcast..

[32]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[33]  Ahmet M. Eskicioglu,et al.  Quality measurement for monochrome compressed images in the past 25 years , 2000, 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100).

[34]  Anil K. Jain,et al.  Displacement Measurement and Its Application in Interframe Image Coding , 1981, IEEE Trans. Commun..

[35]  Mohammed Ghanbari,et al.  A multi-metric objective picture-quality measurement model for MPEG video , 2000, IEEE Trans. Circuits Syst. Video Technol..

[36]  Mohammed Ghanbari,et al.  Measuring blocking artefacts using harmonic analysis , 1999 .

[37]  Stefan Winkler,et al.  Digital Video Quality: Vision Models and Metrics , 2005 .

[38]  Yafan Zhao.  Complexity management for video encoders , 2002, MULTIMEDIA '02.