Focus and Blurriness Measure Using Reorganized DCT Coefficients for an Autofocus Application

In this paper, two metrics for measuring image sharpness are presented and used for an autofocus (AF) application. Both measures exploit reorganized discrete cosine transform (DCT) representation. The first metric is a focus measure, which involves optimal high- and middle-frequency coefficients to evaluate relative sharpness. It is robust to noise while remaining sensitive to the best focus position. A psychometric function-based metric is introduced to quantify the focus measure. The second metric is a no-reference blurriness metric, which is used to measure absolute blurriness. It first constructs multiscale DCT edge maps using directional energy information and then determines image blurriness by combining change information in edge structures with image contrast. This metric gives predictions that are closely correlated with subjective perceived scores and shows performance comparable with that of state-of-the-art methods, especially for noisy images. For noisy situations, the two metrics are adjusted adaptively according to the estimated noise level. To prevent the introduction of extra computational load, an efficient noise-level estimation algorithm based on median absolute deviation is presented. This algorithm exploits only the available reorganized DCT coefficients. With the focus and blurriness measures, an AF method for which the two metrics play an important role was developed. Because of their high-quality performance, the realized AF function is able to locate the best focus position swiftly and reliably.

[1]  Bing Zeng,et al.  Directional Discrete Cosine Transforms—A New Framework for Image Coding , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Joseph W. Goodman,et al.  A mathematical analysis of the DCT coefficient distributions for images , 2000, IEEE Trans. Image Process..

[3]  Zhou Wang,et al.  Image Sharpness Assessment Based on Local Phase Coherence , 2013, IEEE Transactions on Image Processing.

[4]  Lina J. Karam,et al.  An improved perception-based no-reference objective image sharpness metric using iterative edge refinement , 2008, 2008 15th IEEE International Conference on Image Processing.

[5]  Stefan Winkler,et al.  Perceptual blur and ringing metrics: application to JPEG2000 , 2004, Signal Process. Image Commun..

[6]  Yu Liu,et al.  Robust Sharpness Metrics Using Reorganized DCT Coefficients for Auto-Focus Application , 2014, ACCV.

[7]  Z. Xiong,et al.  A DCT-based embedded image coder , 1996, IEEE Signal Processing Letters.

[8]  Brian C. Lovell,et al.  Face Recognition from Still Images to Video Sequences: A Local-Feature-Based Framework , 2011, EURASIP J. Image Video Process..

[9]  Jooheung Lee,et al.  Scalable FPGA-based architecture for DCT computation using dynamic partial reconfiguration , 2009, TECS.

[10]  Rey-Chue Hwang,et al.  A passive auto-focus camera control system , 2010, Appl. Soft Comput..

[11]  Damon M. Chandler,et al.  ${\bf S}_{3}$: A Spectral and Spatial Measure of Local Perceived Sharpness in Natural Images , 2012, IEEE Transactions on Image Processing.

[12]  Jan Flusser,et al.  A new wavelet-based measure of image focus , 2002, Pattern Recognit. Lett..

[13]  Jing-Yu Yang,et al.  Estimation of Signal-Dependent Noise Level Function in Transform Domain via a Sparse Recovery Model , 2015, IEEE Transactions on Image Processing.

[14]  Nasser Kehtarnavaz,et al.  A new auto-focus sharpness function for digital and smart-phone cameras , 2011, 2011 IEEE International Conference on Consumer Electronics (ICCE).

[15]  Yuan Yan Tang,et al.  Characterization of Dirac-structure edges with wavelet transform , 2000, IEEE Trans. Syst. Man Cybern. Part B.

[16]  Matej Kristan,et al.  A Bayes-spectral-entropy-based measure of camera focus using a discrete cosine transform , 2006, Pattern Recognit. Lett..

[17]  Wei-Ying Ma,et al.  Blur determination in the compressed domain using DCT information , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[18]  Dan Schonfeld,et al.  Associative processors for video coding applications , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[19]  Nasser Kehtarnavaz,et al.  Development and real-time implementation of a rule-based auto-focus algorithm , 2003, Real Time Imaging.

[20]  Wen Gao,et al.  Morphological representation of DCT coefficients for image compression , 2002, IEEE Trans. Circuits Syst. Video Technol..

[21]  Nikolay N. Ponomarenko,et al.  TID2008 – A database for evaluation of full-reference visual quality assessment metrics , 2004 .

[22]  Lina J. Karam,et al.  A No-Reference Image Blur Metric Based on the Cumulative Probability of Blur Detection (CPBD) , 2011, IEEE Transactions on Image Processing.

[23]  Gwendoline Blanchet,et al.  Measuring the Global Phase Coherence of an image , 2008, 2008 15th IEEE International Conference on Image Processing.

[24]  Eric C. Larson,et al.  Most apparent distortion: full-reference image quality assessment and the role of strategy , 2010, J. Electronic Imaging.

[25]  Franco Oberti,et al.  A new sharpness metric based on local kurtosis, edge and energy information , 2004, Signal Process. Image Commun..

[26]  J. Robson,et al.  Probability summation and regional variation in contrast sensitivity across the visual field , 1981, Vision Research.

[27]  Eric Dubois,et al.  Fast and reliable structure-oriented video noise estimation , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[28]  David L. Donoho,et al.  De-noising by soft-thresholding , 1995, IEEE Trans. Inf. Theory.

[29]  Sung-Jea Ko,et al.  New autofocusing technique using the frequency selective weighted median filter for video cameras , 1999, 1999 Digest of Technical Papers. International Conference on Consumer Electronics (Cat. No.99CH36277).

[30]  Muralidhara Subbarao,et al.  Selecting the Optimal Focus Measure for Autofocusing and Depth-From-Focus , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Zhiliang Hong,et al.  Modified fast climbing search auto-focus algorithm with adaptive step size searching technique for digital camera , 2003, IEEE Trans. Consumer Electron..

[32]  Marcelo H. Ang,et al.  Practical issues in pixel-based autofocusing for machine vision , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[33]  Christophe Charrier,et al.  Blind Image Quality Assessment: A Natural Scene Statistics Approach in the DCT Domain , 2012, IEEE Transactions on Image Processing.

[34]  Alex ChiChung Kot,et al.  A Fast Approach for No-Reference Image Sharpness Assessment Based on Maximum Local Variation , 2014, IEEE Signal Processing Letters.

[35]  Lina J. Karam,et al.  A No-Reference Objective Image Sharpness Metric Based on the Notion of Just Noticeable Blur (JNB) , 2009, IEEE Transactions on Image Processing.

[36]  Nikolay N. Ponomarenko,et al.  Color image database TID2013: Peculiarities and preliminary results , 2013, European Workshop on Visual Information Processing (EUVIP).

[37]  Fan Zhang,et al.  Reduced-Reference Image Quality Assessment Using Reorganized DCT-Based Image Representation , 2011, IEEE Transactions on Multimedia.

[38]  C. Ortiz de Solórzano,et al.  Evaluation of autofocus functions in molecular cytogenetic analysis , 1997, Journal of microscopy.

[39]  Sei-Wang Chen,et al.  A non-parametric blur measure based on edge analysis for image processing applications , 2004, IEEE Conference on Cybernetics and Intelligent Systems, 2004..

[40]  Glen P. Abousleman,et al.  A no-reference perceptual image sharpness metric based on saliency-weighted foveal pooling , 2008, 2008 15th IEEE International Conference on Image Processing.

[41]  Soo-Won Kim,et al.  Enhanced Autofocus Algorithm Using Robust Focus Measure and Fuzzy Reasoning , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[42]  Xinhao Liu,et al.  Noise level estimation using weak textured patches of a single noisy image , 2012, 2012 19th IEEE International Conference on Image Processing.

[43]  Hanghang Tong,et al.  Blur detection for digital images using wavelet transform , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[44]  Alan C. Bovik,et al.  No-reference image blur assessment using multiscale gradient , 2009, QOMEX 2009.

[45]  Joonki Paik,et al.  Robust focus measure for unsupervised auto-focusing based on optimum discrete cosine transform coefficients , 2011, IEEE Transactions on Consumer Electronics.

[46]  Homer H. Chen,et al.  Robust focus measure for low-contrast images , 2006, 2006 Digest of Technical Papers International Conference on Consumer Electronics.

[47]  Ingeborg Tastl,et al.  Sharpness measure: towards automatic image enhancement , 2005, IEEE International Conference on Image Processing 2005.

[48]  Shen-Chuan Tai,et al.  Fast and reliable image-noise estimation using a hybrid approach , 2010, J. Electronic Imaging.

[49]  Xuelong Li,et al.  Image Quality Assessment Based on Multiscale Geometric Analysis , 2009, IEEE Transactions on Image Processing.

[50]  A. Foi,et al.  Noise variance estimation in nonlocal transform domain , 2009, 2009 International Workshop on Local and Non-Local Approximation in Image Processing.