A Spectral and Spatial Approach of Coarse-to-Fine Blurred Image Region Detection

Blur exists in many digital images, it can be mainly categorized into two classes: defocus blur which is caused by optical imaging systems and motion blur which is caused by the relative motion between camera and scene objects. In this letter, we propose a simple yet effective automatic blurred image region detection method. Based on the observation that blur attenuates high-frequency components of an image, we present a blur metric based on the log averaged spectrum residual to get a coarse blur map. Then, a novel iterative updating mechanism is proposed to refine the blur map from coarse to fine by exploiting the intrinsic relevance of similar neighbor image regions. The proposed iterative updating mechanism can partially resolve the problem of differentiating an in-focus smooth region and a blurred smooth region. In addition, our iterative updating mechanism can be integrated into other image blurred region detection algorithms to refine the final results. Both quantitative and qualitative experimental results demonstrate that our proposed method is more reliable and efficient compared to various state-of-the-art methods.

[1]  Wen Gao,et al.  Spatially variant defocus blur map estimation and deblurring from a single image , 2016, J. Vis. Commun. Image Represent..

[2]  J. H. van Hateren,et al.  Modelling the Power Spectra of Natural Images: Statistics and Information , 1996, Vision Research.

[3]  Damon M. Chandler,et al.  ${\bf S}_{3}$: A Spectral and Spatial Measure of Local Perceived Sharpness in Natural Images , 2012, IEEE Transactions on Image Processing.

[4]  Philip Birch,et al.  Depth from structured defocus that is independent of the object reflectivity function. , 2011, Optics letters.

[5]  Jianping Shi,et al.  Just noticeable defocus blur detection and estimation , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Chunping Hou,et al.  Depth recovery and refinement from a single image using defocus cues , 2015 .

[7]  Fatih Murat Porikli,et al.  Region Covariance: A Fast Descriptor for Detection and Classification , 2006, ECCV.

[8]  Peng Jiang,et al.  Salient Region Detection by UFO: Uniqueness, Focusness and Objectness , 2013, 2013 IEEE International Conference on Computer Vision.

[9]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Shijian Lu,et al.  Blurred image region detection and classification , 2011, ACM Multimedia.

[11]  Chunping Hou,et al.  Defocus map estimation from a single image via spectrum contrast. , 2013, Optics letters.

[12]  Seungkyu Lee,et al.  Time-of-Flight Depth Camera Motion Blur Detection and Deblurring , 2014, IEEE Signal Processing Letters.

[13]  Hanghang Tong,et al.  Blur detection for digital images using wavelet transform , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[14]  Changick Kim,et al.  Blurred image region detection and segmentation , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[15]  Terence Sim,et al.  Defocus map estimation from a single image , 2011, Pattern Recognit..

[16]  Eero P. Simoncelli,et al.  On Advances in Statistical Modeling of Natural Images , 2004, Journal of Mathematical Imaging and Vision.

[17]  Xavier Pennec,et al.  A Riemannian Framework for Tensor Computing , 2005, International Journal of Computer Vision.

[18]  Sabine Süsstrunk,et al.  Non-Parametric Blur Map Regression for Depth of Field Extension , 2016, IEEE Transactions on Image Processing.

[19]  Li Xu,et al.  Discriminative Blur Detection Features , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Qionghai Dai,et al.  Absolute Depth Estimation From a Single Defocused Image , 2013, IEEE Transactions on Image Processing.

[21]  William T. Freeman,et al.  Analyzing spatially-varying blur , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[22]  Xin Yu,et al.  Handling noise in single image defocus map estimation by using directional filters. , 2014, Optics letters.

[23]  Tae-Sun Choi,et al.  Depth from focus based on combinatorial optimization. , 2010, Optics letters.

[24]  Alex ChiChung Kot,et al.  A novel approach for partial blur detection and segmentation , 2013, 2013 IEEE International Conference on Multimedia and Expo (ICME).

[25]  Richard P. Wildes,et al.  Dynamic scene understanding: The role of orientation features in space and time in scene classification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Xin Yi,et al.  LBP-Based Segmentation of Defocus Blur , 2016, IEEE Transactions on Image Processing.

[27]  Patricia Ladret,et al.  The blur effect: perception and estimation with a new no-reference perceptual blur metric , 2007, Electronic Imaging.

[28]  Jiaya Jia,et al.  Single Image Motion Deblurring Using Transparency , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  François Goudail,et al.  Increase in depth of field taking into account deconvolution by optimization of pupil mask. , 2009, Optics letters.

[30]  D. Ruderman The statistics of natural images , 1994 .

[31]  Frédo Durand,et al.  Defocus Magnification , 2007, Comput. Graph. Forum.

[32]  Tien Tsin,et al.  Image Partial Blur Detection and Classification , 2013 .

[33]  Anat Levin,et al.  Blind Motion Deblurring Using Image Statistics , 2006, NIPS.