Blind Sharpness Prediction Based on Image-Based Motion Blur Analysis

For high bit rate video, it is important to acquire the video contents with high resolution, the quality of which may be degraded due to the motion blur from the movement of an object(s) or the camera. However, conventional sharpness assessments are designed to find focal blur caused either by defocusing or by compression distortion targeted for low bit rates. To overcome this limitation, we present a no-reference framework of a visual sharpness assessment (VSA) for high-resolution video based on the motion and scene classification. In the proposed framework, the accuracy of the sharpness estimation can be improved via pooling weighted by the visual perception from the object and camera movements and by the strong influence from the region with the highest sharpness. Based on the motion blur characteristics, the variance and the contrast over the spectral domain are used to quantify the perceived sharpness. Moreover, for the VSA, we extract the highly influential sharper regions and emphasize them by utilizing the scene adaptive pooling. Based on the subjective results, we demonstrate that the VSA can measure the video sharpness more accurately than other sharpness measurements for high-resolution video.

[1]  Wilson S. Geisler,et al.  Real-time foveated multiresolution system for low-bandwidth video communication , 1998, Electronic Imaging.

[2]  Stephen T. Hammett PII: S0042-6989(97)00059-X , 2002 .

[3]  J. H. van Hateren,et al.  Modelling the Power Spectra of Natural Images: Statistics and Information , 1996, Vision Research.

[4]  Sheila S. Hemami,et al.  A metric for continuous quality evaluation of compressed video with severe distortions , 2004, Signal Process. Image Commun..

[5]  Zhou Wang,et al.  Image Sharpness Assessment Based on Local Phase Coherence , 2013, IEEE Transactions on Image Processing.

[6]  Lina J. Karam,et al.  A No-Reference Objective Image Sharpness Metric Based on the Notion of Just Noticeable Blur (JNB) , 2009, IEEE Transactions on Image Processing.

[7]  Sanghoon Lee,et al.  Increasing Throughput and QoS Using Bandwidth and Region Division with Frequency Overlay over Multicell Environments , 2009, IEICE Trans. Commun..

[8]  M J Morgan,et al.  Motion deblurring in human vision , 1997, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[9]  Qiang Wu,et al.  Directional high-pass filter for blurry image analysis , 2012, Signal Process. Image Commun..

[10]  Alan C. Bovik,et al.  No-Reference Sharpness Assessment of Camera-Shaken Images by Analysis of Spectral Structure , 2014, IEEE Transactions on Image Processing.

[11]  Gabriel-Miro Muntean,et al.  Subjective Assessment of Region of Interest-Aware Adaptive Multimedia Streaming Quality , 2009, IEEE Transactions on Broadcasting.

[12]  B. Wandell Foundations of vision , 1995 .

[13]  Franco Oberti,et al.  A new sharpness metric based on local kurtosis, edge and energy information , 2004, Signal Process. Image Commun..

[14]  Martin Reisslein,et al.  Objective Video Quality Assessment Methods: A Classification, Review, and Performance Comparison , 2011, IEEE Transactions on Broadcasting.

[15]  Gabriel-Miro Muntean,et al.  Objective Assessment of Region of Interest-Aware Adaptive Multimedia Streaming Quality , 2009, IEEE Transactions on Broadcasting.

[16]  Michael J. Black,et al.  The Robust Estimation of Multiple Motions: Parametric and Piecewise-Smooth Flow Fields , 1996, Comput. Vis. Image Underst..

[17]  Alan C. Bovik,et al.  The Essential Guide to Image Processing , 2009, J. Electronic Imaging.

[18]  Sanghoon Lee,et al.  Dynamic Bandwidth and Carrier Allocation for Video Broadcast/Multicast Over Multi-Cell Environments , 2012, Wireless Personal Communications.

[19]  Mark D. Fairchild,et al.  Sharpness Rules , 2000, Color Imaging Conference.

[20]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[21]  Pierre Bretillon,et al.  Objective quality monitoring issues in digital broadcasting networks , 2005, IEEE Transactions on Broadcasting.

[22]  Shigeyuki Sakazawa,et al.  Objective perceptual picture quality measurement method for high-definition video based on full reference framework , 2009, Electronic Imaging.

[23]  Stefan Winkler,et al.  A no-reference perceptual blur metric , 2002, Proceedings. International Conference on Image Processing.

[24]  Arun Ross,et al.  Score normalization in multimodal biometric systems , 2005, Pattern Recognit..

[25]  A. T. Smith,et al.  Sharpening of drifting, blurred images , 1995, Vision Research.

[26]  M. Georgeson,et al.  Motion blur and motion sharpening: temporal smear and local contrast non-linearity , 1998, Vision Research.

[27]  Philip J. Corriveau,et al.  Study of Rating Scales for Subjective Quality Assessment of High-Definition Video , 2011, IEEE Transactions on Broadcasting.

[28]  Lina J. Karam,et al.  A No-Reference Image Blur Metric Based on the Cumulative Probability of Blur Detection (CPBD) , 2011, IEEE Transactions on Image Processing.

[29]  Stefan Winkler,et al.  The Evolution of Video Quality Measurement: From PSNR to Hybrid Metrics , 2008, IEEE Transactions on Broadcasting.

[30]  Alan C. Bovik,et al.  Multimodal Interactive Continuous Scoring of Subjective 3D Video Quality of Experience , 2014, IEEE Transactions on Multimedia.

[31]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[32]  Sanghoon Lee,et al.  Cooperative and joint video multicast over MIMO-OFDM networks , 2014, Digit. Signal Process..

[33]  Christopher Batten Autofocusing and Astigmatism Correction in the Scanning Electron Microscope , 2000 .

[34]  Sanghoon Lee,et al.  Implementation of Multimode-Multilevel Block Truncation Coding for LCD Overdrive , 2012, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[35]  Antonio Torralba,et al.  Statistics of natural image categories , 2003, Network.

[36]  Marios S. Pattichis,et al.  Foveated video quality assessment , 2002, IEEE Trans. Multim..

[37]  Seong-Ik Jang,et al.  A real-time identification method on motion and out-of focus blur for a video camera , 1994 .

[38]  Alan C. Bovik,et al.  Video Quality Pooling Adaptive to Perceptual Distortion Severity , 2013, IEEE Transactions on Image Processing.

[39]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[40]  Liam Murphy,et al.  Toward Deployable Methods for Assessment of Quality for Scalable IPTV Services , 2013, IEEE Transactions on Broadcasting.

[41]  Mansour Jamzad,et al.  Motion blur identification in noisy images using mathematical models and statistical measures , 2007, Pattern Recognit..

[42]  Wen Gao,et al.  No-reference perceptual image quality metric using gradient profiles for JPEG2000 , 2010, Signal Process. Image Commun..

[43]  Nuno Vasconcelos,et al.  Spatiotemporal Saliency in Dynamic Scenes , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[44]  J. Moran,et al.  Sensation and perception , 1980 .

[45]  A. Vladár,et al.  Image sharpness measurement in the scanning electron-microscope--part III. , 2006, Scanning.