A Closed-Form Focus Profile Model for Conventional Digital Cameras

According to the thin lens model, the classic depth of field (DOF) is defined as the distance range at which objects in front of a camera are in focus. However, the thin lens poses important practical limitations for modeling the camera focus due to its dependence on internal parameters, such as the focal length, numerical aperture and effective pixel size. In this paper, a new model for describing the focus of conventional digital cameras is proposed. The focus is modeled as the energy of the point-spread-function of the imaging system and describes the joint effect of defocus, diffraction and digitization. Experiments conducted on different acquisition devices show that the proposed model conforms accurately to the behavior of real systems and outperforms the most similar alternatives in the state-of-the-art. In addition, in contrast to the classic DOF model, the proposed approach can be used to predict the changes in the focus of conventional digital cameras when changing focus, zoom, and aperture by means of a simple calibration process.

[1]  Kiriakos N. Kutulakos,et al.  Light-Efficient Photography , 2011, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Janne Heikkilä,et al.  A four-step camera calibration procedure with implicit image correction , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  W. Cathey,et al.  Defocus transfer function for circularly symmetric pupils. , 1997, Applied optics.

[4]  Muralidhara Subbarao,et al.  Selecting the Optimal Focus Measure for Autofocusing and Depth-From-Focus , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  E. R. Cohen An Introduction to Error Analysis: The Study of Uncertainties in Physical Measurements , 1998 .

[6]  Marcelo H. Ang,et al.  Practical issues in pixel-based autofocusing for machine vision , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[7]  Bernd Jähne,et al.  Practical handbook on image processing for scientific and technical applications , 2004 .

[8]  R. S. Longhurst Geometrical and Physical Optics , 1967 .

[9]  Sophie Triantaphillidou,et al.  The Manual of Photography , 2010 .

[10]  Tae-Sun Choi,et al.  A heuristic approach for finding best focused shape , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Q. M. Jonathan Wu,et al.  Shape from focus using fast discrete curvelet transform , 2011, Pattern Recognit..

[12]  Kazuya Kodama,et al.  Simple and Fast All-in-Focus Image Reconstruction Based on Three-Dimensional/Two-Dimensional Transform and Filtering , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[13]  W. Cody,et al.  Rational Chebyshev approximations for the error function , 1969 .

[14]  Zhiliang Hong,et al.  Modified fast climbing search auto-focus algorithm with adaptive step size searching technique for digital camera , 2003, IEEE Trans. Consumer Electron..

[15]  Feng-qing Qin Blind image super-resolution reconstruction based on PSF estimation , 2010, The 2010 IEEE International Conference on Information and Automation.

[16]  Berthold K. P. Horn Robot vision , 1986, MIT electrical engineering and computer science series.

[17]  Tae-Sun Choi,et al.  Recovering 3D Shape of Weak Textured Surfaces , 2009, 2009 International Conference on Computational Science and Its Applications.

[18]  Jay Martin Tenenbaum,et al.  Accommodation in computer vision , 1971 .

[19]  L. Remón Computational Fourier Optics Simulation using a virtual laboratory , 2015 .

[20]  Reinhard Koch,et al.  Self-Calibration and Metric Reconstruction Inspite of Varying and Unknown Intrinsic Camera Parameters , 1999, International Journal of Computer Vision.

[21]  Homer H. Chen,et al.  Focus Profile Modeling , 2016, IEEE Transactions on Image Processing.

[22]  Pietro Ferraro,et al.  An interferometric method for measuring short focal length refractive lenses and diffractive lenses , 1999 .

[23]  Okan K. Ersoy,et al.  Diffraction, Fourier Optics and Imaging , 2006 .

[24]  Homer H. Chen,et al.  Reciprocal Focus Profile , 2012, IEEE Transactions on Image Processing.

[25]  Robert D. Fiete,et al.  Modeling the Imaging Chain of Digital Cameras , 2010 .

[26]  Kiriakos N. Kutulakos,et al.  Light-Efficient Photography , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Richard Szeliski,et al.  PSF estimation using sharp edge prediction , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[28]  Aswin C. Sankaranarayanan,et al.  Compressive epsilon photography for post-capture control in digital imaging , 2014, ACM Trans. Graph..

[29]  Sundaresh Ram,et al.  Removing Camera Shake from a Single Photograph , 2009 .

[30]  Alex Pentland,et al.  A New Sense for Depth of Field , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Mark D. Semon,et al.  POSTUSE REVIEW: An Introduction to Error Analysis: The Study of Uncertainties in Physical Measurements , 1982 .

[32]  E. Wolf,et al.  Principles of Optics (7th Ed) , 1999 .

[33]  T. Williams The Optical Transfer Function of Imaging Systems , 1998 .

[34]  Paolo Favaro,et al.  Shape from Focus and Defocus: Convexity, Quasiconvexity and Defocus-Invariant Textures , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[35]  Tae-Sun Choi,et al.  Sampling for Shape from Focus in Optical Microscopy , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Tae-Sun Choi,et al.  Shape From Focus Using Optimization Technique , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[37]  J. Goodman Introduction to Fourier optics , 1969 .

[38]  Tae-Sun Choi,et al.  Nonlinear Approach for Enhancement of Image Focus Volume in Shape From Focus , 2012, IEEE Transactions on Image Processing.

[39]  Richard Szeliski,et al.  Automatic Estimation and Removal of Noise from a Single Image , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Domenec Puig,et al.  Analysis of focus measure operators for shape-from-focus , 2013, Pattern Recognit..

[41]  Glenn Healey,et al.  Radiometric CCD camera calibration and noise estimation , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[42]  Jay M. Enoch,et al.  Handbook of Optics, Third Edition Volume I: Geometrical and Physical Optics, Polarized Light, Components and Instruments(set) , 2009 .

[43]  Andrea Fusiello,et al.  Generation of All-in-Focus Images by Noise-Robust Selective Fusion of Limited Depth-of-Field Images , 2013, IEEE Transactions on Image Processing.

[44]  Joonki Paik,et al.  Fully digital auto-focusing system with automatic focusing region selection and point spread function estimation , 2010, IEEE Transactions on Consumer Electronics.

[45]  Larry N Thibos Retinal image quality for virtual eyes generated by a statistical model of ocular wavefront aberrations , 2009, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[46]  Murali Subbarao,et al.  Depth from defocus: A spatial domain approach , 1994, International Journal of Computer Vision.

[47]  Joonki Paik,et al.  Robust focus measure for unsupervised auto-focusing based on optimum discrete cosine transform coefficients , 2011, IEEE Transactions on Consumer Electronics.

[48]  Shengyong Chen,et al.  Finding Optimal Focusing Distance and Edge Blur Distribution for Weakly Calibrated 3-D Vision , 2013, IEEE Transactions on Industrial Informatics.

[49]  Tae-Sun Choi,et al.  Shape from focus using multilayer feedforward neural networks , 2000, IEEE Trans. Image Process..

[50]  G. Mather,et al.  Blur Discrimination and its Relation to Blur-Mediated Depth Perception , 2002, Perception.

[51]  Domenec Puig,et al.  Efficient Focus Sampling Through Depth-of-Field Calibration , 2014, International Journal of Computer Vision.

[52]  Shree K. Nayar,et al.  Are textureless scenes recoverable? , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[53]  Richard Szeliski,et al.  Computer Vision - Algorithms and Applications , 2011, Texts in Computer Science.

[54]  P. Stokseth Properties of a Defocused Optical System , 1969 .

[55]  A. N. Rajagopalan,et al.  Depth From Motion and Optical Blur With an Unscented Kalman Filter , 2012, IEEE Transactions on Image Processing.

[56]  Tae-Sun Choi,et al.  Focus measure based on the energy of high-frequency components in the S transform. , 2010, Optics letters.

[57]  Emil Wolf,et al.  Principles of Optics: Contents , 1999 .

[58]  Nasser Kehtarnavaz,et al.  A new auto-focus sharpness function for digital and smart-phone cameras , 2011, 2011 IEEE International Conference on Consumer Electronics (ICCE).

[59]  Dimitri Van De Ville,et al.  Model-Based 2.5-D Deconvolution for Extended Depth of Field in Brightfield Microscopy , 2008, IEEE Transactions on Image Processing.

[60]  H. H. Hopkins The frequency response of a defocused optical system , 1955, Proceedings of the Royal Society of London. Series A. Mathematical and Physical Sciences.

[61]  Okan K. Ersoy,et al.  Diffraction, Fourier Optics and Imaging: Ersoy/Diffraction, Fourier Optics and Imaging , 2007 .

[62]  Stefano Soatto,et al.  A geometric approach to shape from defocus , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[63]  F. Lei,et al.  Measuring the focal length of optical systems by grating shearing interferometry. , 1994, Applied optics.

[64]  Tae-Sun Choi,et al.  A novel iterative shape from focus algorithm based on combinatorial optimization , 2010, Pattern Recognit..

[65]  Chih-Li Huo,et al.  PSO-based estimation for Gaussian blur in blind image deconvolution problem , 2011, 2011 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE 2011).

[66]  Madhuri Thakur,et al.  Measurement of focal length of lens using phase shifting Lau phase interferometry , 2005 .

[67]  Muralidhara Subbarao,et al.  Accurate Recovery of Three-Dimensional Shape from Image Focus , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[68]  Jean-François Giovannelli,et al.  Deconvolutionwith gaussian blur parameter and hyperparameters estimation , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[69]  Shree K. Nayar,et al.  Shape from Focus , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[70]  John F. Hart,et al.  Computer Approximations , 1978 .

[71]  A. Watson,et al.  Predicting visual acuity from wavefront aberrations. , 2008, Journal of vision.

[72]  Nasser Kehtarnavaz,et al.  Development and real-time implementation of a rule-based auto-focus algorithm , 2003, Real Time Imaging.

[73]  Kang Wang,et al.  Robust Image Deblurring With an Inaccurate Blur Kernel , 2012, IEEE Transactions on Image Processing.

[74]  Yao Zhao,et al.  Edge-based Blur Metric for Tamper Detection , 2010, J. Inf. Hiding Multim. Signal Process..