Blind Sharpness Prediction for Ultrahigh-Definition Video Based on Human Visual Resolution

We explore a no-reference sharpness assessment model for predicting the perceptual sharpness of ultrahigh-definition (UHD) videos through analysis of visual resolution variation in terms of viewing geometry and scene characteristics. The quality and sharpness of UHD videos are influenced by viewer perception of the spatial resolution afforded by the UHD display, which depends on viewing geometry parameters including display resolution, display size, and viewing distance. In addition, viewers may perceive different degrees of quality and sharpness according to the statistical behavior of the visual signals, such as the motion, texture, and edge, which vary over both spatial and temporal domains. The model also accounts for the resolution variation associated with fixation and foveal regions, which is another important factor affecting the sharpness prediction of UHD video over the spatial domain and which is caused by the nonuniform distribution of the photoreceptors. We calculate the transition of the visually salient statistical characteristics resulting from changing the display’s screen size and resolution. Moreover, we calculated the temporal variation in sharpness over consecutive frames in order to evaluate the temporal sharpness perception of UHD video. We verify that the proposed model outperforms other sharpness models in both spatial and temporal sharpness assessments.

[1]  Yuhong Yang Elements of Information Theory (2nd ed.). Thomas M. Cover and Joy A. Thomas , 2008 .

[2]  Vijayan K. Asari,et al.  No-Reference Video Quality Assessment Based on Artifact Measurement and Statistical Analysis , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Alan C. Bovik,et al.  Video Quality Pooling Adaptive to Perceptual Distortion Severity , 2013, IEEE Transactions on Image Processing.

[4]  D. Regan,et al.  Visual perception of changing size: The effect of object size , 1979, Vision Research.

[5]  Weisi Lin,et al.  Estimating Just-Noticeable Distortion for Video , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Snjezana Rimac-Drlje,et al.  Influence of temporal pooling method on the objective video quality evaluation , 2009, 2009 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting.

[7]  Arun Ross,et al.  Score normalization in multimodal biometric systems , 2005, Pattern Recognit..

[8]  Wei-Ying Ma,et al.  Blur determination in the compressed domain using DCT information , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[9]  Sean T. McCarthy,et al.  Quantitative Evaluation of Human Visual Perception for Multiple Screens and Multiple Codecs , 2012 .

[10]  Gerard de Haan,et al.  Low Cost Robust Blur Estimator , 2006, 2006 International Conference on Image Processing.

[11]  Chun-Hsien Chou,et al.  A perceptually tuned subband image coder based on the measure of just-noticeable-distortion profile , 1994, Proceedings of 1994 IEEE International Symposium on Information Theory.

[12]  J. H. van Hateren,et al.  Modelling the Power Spectra of Natural Images: Statistics and Information , 1996, Vision Research.

[13]  Nuno Vasconcelos,et al.  Spatiotemporal Saliency in Dynamic Scenes , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Colin Bailey,et al.  Model and Performance of a No-Reference Quality Assessment Metric for Video Streaming , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Alan C. Bovik,et al.  Saliency Prediction on Stereoscopic Videos , 2014, IEEE Transactions on Image Processing.

[16]  A. Vladár,et al.  Image sharpness measurement in the scanning electron-microscope--part III. , 2006, Scanning.

[17]  Zhou Wang,et al.  Video quality assessment using a statistical model of human visual speed perception. , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.

[18]  Michael J. Black,et al.  Secrets of optical flow estimation and their principles , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[19]  Glen P. Abousleman,et al.  A no-reference perceptual image sharpness metric based on saliency-weighted foveal pooling , 2008, 2008 15th IEEE International Conference on Image Processing.

[20]  Lina J. Karam,et al.  A No-Reference Image Blur Metric Based on the Cumulative Probability of Blur Detection (CPBD) , 2011, IEEE Transactions on Image Processing.

[21]  Kenichiro Masaoka,et al.  Image Quality Management for the Super Hi-Vision System at the Kyushu National Museum , 2006, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[22]  Alan C. Bovik,et al.  No-Reference Sharpness Assessment of Camera-Shaken Images by Analysis of Spectral Structure , 2014, IEEE Transactions on Image Processing.

[23]  Weisi Lin,et al.  Improved estimation for just-noticeable visual distortion , 2005, Signal Process..

[24]  Alan L. Yuille,et al.  Region Competition: Unifying Snakes, Region Growing, and Bayes/MDL for Multiband Image Segmentation , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Hong Yan,et al.  Image segmentation using fuzzy rules derived from K-means clusters , 1995, J. Electronic Imaging.

[26]  John D. Villasenor,et al.  Visibility of wavelet quantization noise , 1997, IEEE Transactions on Image Processing.

[27]  Franco Oberti,et al.  A new sharpness metric based on local kurtosis, edge and energy information , 2004, Signal Process. Image Commun..

[28]  Alan C. Bovik,et al.  Multimodal Interactive Continuous Scoring of Subjective 3D Video Quality of Experience , 2014, IEEE Transactions on Multimedia.

[29]  Damon M. Chandler,et al.  ${\bf S}_{3}$: A Spectral and Spatial Measure of Local Perceived Sharpness in Natural Images , 2012, IEEE Transactions on Image Processing.

[30]  Peyman Milanfar,et al.  Static and space-time visual saliency detection by self-resemblance. , 2009, Journal of vision.

[31]  Wilson S. Geisler,et al.  Real-time foveated multiresolution system for low-bandwidth video communication , 1998, Electronic Imaging.

[32]  Lina J. Karam,et al.  A No-Reference Objective Image Sharpness Metric Based on the Notion of Just Noticeable Blur (JNB) , 2009, IEEE Transactions on Image Processing.

[33]  Tao Liu,et al.  A Novel Video Quality Metric for Low Bit-Rate Video Considering Both Coding and Packet-Loss Artifacts , 2009, IEEE Journal of Selected Topics in Signal Processing.

[34]  Clark C. Guest,et al.  Perceptual Sharpness Metric (PSM) for Compressed Video , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[35]  Stefan Winkler,et al.  A no-reference perceptual blur metric , 2002, Proceedings. International Conference on Image Processing.

[36]  Steven W. Zucker,et al.  Local Scale Control for Edge Detection and Blur Estimation , 1996, ECCV.

[37]  Marios S. Pattichis,et al.  Foveated video compression with optimal rate control , 2001, IEEE Trans. Image Process..

[38]  Pietro Perona,et al.  On the usefulness of attention for object recognition , 2004 .

[39]  Kalpana Seshadrinathan,et al.  ASSESSING MOTION BLUR WITHOUT REFERENCE , 2013 .

[40]  Zhenzhong Chen,et al.  Video Quality Assessment Based on Measuring Perceptual Noise From Spatial and Temporal Perspectives , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[41]  M. Barkowsky,et al.  Perceptually motivated spatial and temporal integration of pixel based video quality measures , 2007 .

[42]  Masaki Emoto,et al.  Research on Human Factors in Ultrahigh-Definition Television (UHDTV) to Determine its Specifications , 2008 .