Performance Analysis of PSNR and SSIM against Frame Drop and its Subjective Score

Due to ever growing needs of multimedia data for various applications like video conferencing and streaming, which involves human subjects, it is often desired to have good resumed perceptual quality of videos, thus arises the need of quality assessment. This paper discusses involved steps during subjective quality assessment and various available objective quality metrics like peak signal to noise ratio (PSNR) and structural similarity index (SSIM) along with their performance with respect to human visual system (HVS) models. This paper presents an HVS model which incorporates frame drop distortion and its impact over subjective score. Simulation results show that PSNR and SSIM are inefficient to analyse the quality deterioration due to frame drop.

[1]  Christian Keimel,et al.  No-reference video quality evaluation for high-definition video , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[2]  Jianfei Cai,et al.  Cross-Dimensional Perceptual Quality Assessment for Low Bit-Rate Videos , 2008, IEEE Transactions on Multimedia.

[3]  Rajiv Soundararajan,et al.  Study of Subjective and Objective Quality Assessment of Video , 2010, IEEE Transactions on Image Processing.

[4]  Rosziati Ibrahim,et al.  A New Digital Watermarking Algorithm Using Combination of Least Significant Bit (LSB) and Inverse Bit , 2011, ArXiv.

[5]  Gregory W. Cermak,et al.  HDTV Subjective Quality of H.264 vs. MPEG-2, With and Without Packet Loss , 2010, IEEE Transactions on Broadcasting.

[6]  Alan C. Bovik,et al.  41 OBJECTIVE VIDEO QUALITY ASSESSMENT , 2003 .

[7]  Vikas Saxena,et al.  A performance analysis of objective video quality metrics for digital video watermarking , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[8]  A. Bovik,et al.  OBJECTIVE VIDEO QUALITY ASSESSMENT , 2003 .

[9]  Stephen R. Gulliver,et al.  The Perceptual and Attentive Impact of Delay and Jitter in Multimedia Delivery , 2007, IEEE Transactions on Broadcasting.

[10]  Pasquale Pace,et al.  Fast and Accurate PQoS Estimation over 802.11g Wireless Network , 2008, 2008 IEEE International Conference on Communications.

[11]  Bernd Girod,et al.  Analysis of video transmission over lossy channels , 2000, IEEE Journal on Selected Areas in Communications.

[12]  Sheila S. Hemami,et al.  No-reference image and video quality estimation: Applications and human-motivated design , 2010, Signal Process. Image Commun..

[13]  Michael Yuen,et al.  A survey of hybrid MC/DPCM/DCT video coding distortions , 1998, Signal Process..

[14]  Yulin Wang,et al.  Blind MPEG-2 video watermarking robust against geometric attacks: a set of approaches in DCT domain , 2006, IEEE Transactions on Image Processing.

[15]  Martin Reisslein,et al.  Objective Video Quality Assessment Methods: A Classification, Review, and Performance Comparison , 2011, IEEE Transactions on Broadcasting.

[16]  Alan C. Bovik,et al.  Motion Tuned Spatio-Temporal Quality Assessment of Natural Videos , 2010, IEEE Transactions on Image Processing.

[17]  Rosario El-Feghali,et al.  Video Quality Metric for Bit Rate Control via Joint Adjustment of Quantization and Frame Rate , 2007, IEEE Transactions on Broadcasting.

[18]  Margaret H. Pinson,et al.  A new standardized method for objectively measuring video quality , 2004, IEEE Transactions on Broadcasting.

[19]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[20]  Alan C. Bovik,et al.  Wireless Video Quality Assessment: A Study of Subjective Scores and Objective Algorithms , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[21]  Alan C. Bovik,et al.  Image information and visual quality , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[22]  Ze-Nian Li,et al.  Fundamentals of Multimedia , 2014, Texts in Computer Science.

[23]  Bernd Girod,et al.  What's wrong with mean-squared error? , 1993 .

[24]  Elisa Drelie Gelasca,et al.  Full-reference objective quality metrics for video watermarking, video segmentation and 3D model watermarking , 2005 .

[25]  Zhou Wang,et al.  Video quality assessment based on structural distortion measurement , 2004, Signal Process. Image Commun..

[26]  Fengping Zhao,et al.  Improved Denoising Method of Two Dimensional Gel Electrophoresis Images , 2012 .

[27]  Alan C. Bovik,et al.  The Essential Guide to Image Processing , 2009, J. Electronic Imaging.

[28]  Stefan Winkler,et al.  The Evolution of Video Quality Measurement: From PSNR to Hybrid Metrics , 2008, IEEE Transactions on Broadcasting.

[29]  Jianhua Li,et al.  A Novel Real-Time MPEG-2 Video Watermarking Scheme in Copyright Protection , 2008, IWDW.

[30]  Mislav Grgic,et al.  Comparison of Video Coding Standards Used in Mobile Applications , 2008 .

[31]  Vikas Saxena,et al.  A Full Reference Algorithm for Dropped Frames Identification in Uncompressed Video Using Genetic Algorithm , 2012 .

[32]  D. S. Hands,et al.  A basic multimedia quality model , 2004, IEEE Transactions on Multimedia.

[33]  Guangxue Chen,et al.  A New Digital Halftoning Algorithm by Integrating Modified Pulse- Coupled Neural Network with Random Number Generator , 2012 .

[34]  Changhoon Yim,et al.  Evaluation of temporal variation of video quality in packet loss networks , 2011, Signal Process. Image Commun..