No-Reference Sharpness Assessment of Camera-Shaken Images by Analysis of Spectral Structure

The tremendous explosion of image-, video-, and audio-enabled mobile devices, such as tablets and smart-phones in recent years, has led to an associated dramatic increase in the volume of captured and distributed multimedia content. In particular, the number of digital photographs being captured annually is approaching 100 billion in just the U.S. These pictures are increasingly being acquired by inexperienced, casual users under highly diverse conditions leading to a plethora of distortions, including blur induced by camera shake. In order to be able to automatically detect, correct, or cull images impaired by shake-induced blur, it is necessary to develop distortion models specific to and suitable for assessing the sharpness of camera-shaken images. Toward this goal, we have developed a no-reference framework for automatically predicting the perceptual quality of camera-shaken images based on their spectral statistics. Two kinds of features are defined that capture blur induced by camera shake. One is a directional feature, which measures the variation of the image spectrum across orientations. The second feature captures the shape, area, and orientation of the spectral contours of camera shaken images. We demonstrate the performance of an algorithm derived from these features on new and existing databases of images distorted by camera shake.

[1]  Mansour Jamzad,et al.  Motion blur identification in noisy images using mathematical models and statistical measures , 2007, Pattern Recognit..

[2]  Marios S. Pattichis,et al.  Foveated video compression with optimal rate control , 2001, IEEE Trans. Image Process..

[3]  Seungyong Lee,et al.  Fast motion deblurring , 2009, ACM Trans. Graph..

[4]  Lina J. Karam,et al.  A No-Reference Objective Image Sharpness Metric Based on the Notion of Just Noticeable Blur (JNB) , 2009, IEEE Transactions on Image Processing.

[5]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .

[6]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[7]  A. Vladár,et al.  Image sharpness measurement in the scanning electron-microscope--part III. , 2006, Scanning.

[8]  Alan C. Bovik,et al.  No-reference quality assessment using natural scene statistics: JPEG2000 , 2005, IEEE Transactions on Image Processing.

[9]  Michael J. Black,et al.  Secrets of optical flow estimation and their principles , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  Sanghoon Lee,et al.  Dynamic Bandwidth and Carrier Allocation for Video Broadcast/Multicast Over Multi-Cell Environments , 2012, Wireless Personal Communications.

[11]  Dan Kalman The Most Marvelous Theorem in Mathematics , 2008 .

[12]  Anil K. Bera,et al.  Efficient tests for normality, homoscedasticity and serial independence of regression residuals , 1980 .

[13]  Alan C. Bovik,et al.  Blind Image Quality Assessment: From Natural Scene Statistics to Perceptual Quality , 2011, IEEE Transactions on Image Processing.

[14]  Rajiv Soundararajan,et al.  Study of Subjective and Objective Quality Assessment of Video , 2010, IEEE Transactions on Image Processing.

[15]  Glen P. Abousleman,et al.  A no-reference perceptual image sharpness metric based on saliency-weighted foveal pooling , 2008, 2008 15th IEEE International Conference on Image Processing.

[16]  Alan C. Bovik,et al.  Optimal Channel Adaptation of Scalable Video Over a Multicarrier-Based Multicell Environment , 2009, IEEE Transactions on Multimedia.

[17]  Stefan Winkler,et al.  A no-reference perceptual blur metric , 2002, Proceedings. International Conference on Image Processing.

[18]  Sanghoon Lee,et al.  Cooperative and joint video multicast over MIMO-OFDM networks , 2014, Digit. Signal Process..

[19]  No-Cheol Park,et al.  Development of Small Sized Actuator With Compliant Mechanism for Optical Image Stabilization , 2010, IEEE Transactions on Magnetics.

[20]  Gerard de Haan,et al.  Low Cost Robust Blur Estimator , 2006, 2006 International Conference on Image Processing.

[21]  Shree K. Nayar,et al.  Motion-based motion deblurring , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Andreas E. Savakis,et al.  Blur identification by residual spectral matching , 1993, IEEE Trans. Image Process..

[23]  Alan C. Bovik,et al.  Video Quality Pooling Adaptive to Perceptual Distortion Severity , 2013, IEEE Transactions on Image Processing.

[24]  Sylvain Paris,et al.  Blur kernel estimation using the radon transform , 2011, CVPR 2011.

[25]  Mark D. Fairchild,et al.  Sharpness Rules , 2000, Color Imaging Conference.

[26]  H. Joel Trussell,et al.  Identification and restoration of spatially variant motion blurs in sequential images , 1992, IEEE Trans. Image Process..

[27]  Ashish Kapoor,et al.  Learning a blind measure of perceptual image quality , 2011, CVPR 2011.

[28]  Sanghoon Lee,et al.  Implementation of Multimode-Multilevel Block Truncation Coding for LCD Overdrive , 2012, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[29]  Antonio Torralba,et al.  Statistics of natural image categories , 2003, Network.

[30]  Christophe Charrier,et al.  Blind Image Quality Assessment: A Natural Scene Statistics Approach in the DCT Domain , 2012, IEEE Transactions on Image Processing.

[31]  Lina J. Karam,et al.  A No-Reference Image Blur Metric Based on the Cumulative Probability of Blur Detection (CPBD) , 2011, IEEE Transactions on Image Processing.

[32]  Wei-Ying Ma,et al.  Blur determination in the compressed domain using DCT information , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[33]  A. T. Smith,et al.  Sharpening of drifting, blurred images , 1995, Vision Research.

[34]  Damon M. Chandler,et al.  ${\bf S}_{3}$: A Spectral and Spatial Measure of Local Perceived Sharpness in Natural Images , 2012, IEEE Transactions on Image Processing.

[35]  Stephen T. Hammett PII: S0042-6989(97)00059-X , 2002 .

[36]  Zhou Wang,et al.  No-reference image sharpness assessment based on local phase coherence measurement , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[37]  Bernhard Schölkopf,et al.  Recording and Playback of Camera Shake: Benchmarking Blind Deconvolution with a Real-World Database , 2012, ECCV.

[38]  Huei-Yung Lin,et al.  Motion blur removal and its application to vehicle speed detection , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[39]  M. Georgeson,et al.  Motion blur and motion sharpening: temporal smear and local contrast non-linearity , 1998, Vision Research.

[40]  Andrew W. Fitzgibbon,et al.  Ellipse-specific direct least-square fitting , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[41]  Li Xu,et al.  Two-Phase Kernel Estimation for Robust Motion Deblurring , 2010, ECCV.

[42]  Franco Oberti,et al.  A new sharpness metric based on local kurtosis, edge and energy information , 2004, Signal Process. Image Commun..

[43]  Jie Shao,et al.  Real-time image stabilization for arbitrary motion blurred image based on opto-electronic hybrid joint transform correlator. , 2011, Optics express.

[44]  J. H. van Hateren,et al.  Modelling the Power Spectra of Natural Images: Statistics and Information , 1996, Vision Research.

[45]  Steven W. Zucker,et al.  Local Scale Control for Edge Detection and Blur Estimation , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[46]  G. Box NON-NORMALITY AND TESTS ON VARIANCES , 1953 .

[47]  T. S. Cho,et al.  Motion blur removal with orthogonal parabolic exposures , 2010, 2010 IEEE International Conference on Computational Photography (ICCP).

[48]  Wen Gao,et al.  No-reference perceptual image quality metric using gradient profiles for JPEG2000 , 2010, Signal Process. Image Commun..

[49]  Ulrich Schwanecke,et al.  Blind Image Deconvolution of Linear Motion Blur , 2011, ICCV 2011.