Optimal depth estimation by combining focus measures using genetic programming

Three-dimensional (3D) shape reconstruction is a fundamental problem in machine vision applications. Shape From Focus (SFF) is one of the passive optical methods for 3D shape recovery that uses degree of focus as a cue to estimate 3D shape. In this approach, usually a single focus measure operator is applied to measure the focus quality of each pixel in the image sequence. However, the applicability of a single focus measure is limited to estimate accurately the depth map for diverse type of real objects. To address this problem, we develop Optimal Composite Depth (OCD) function through genetic programming (GP) for accurate depth estimation. The OCD function is constructed by optimally combining the primary information extracted using one/or more focus measures. The genetically developed composite function is then used to compute the optimal depth map of objects. The performance of the developed nonlinear function is investigated using both the synthetic and the real world image sequences. Experimental results demonstrate that the proposed estimator is more useful in computing accurate depth maps as compared to the existing SFF methods. Moreover, it is found that the heterogeneous function is more effective than homogeneous function.

[1]  Bradley J Nelson,et al.  Autofocusing in computer microscopy: Selecting the optimal focus algorithm , 2004, Microscopy research and technique.

[2]  Muralidhara Subbarao,et al.  Selecting the Optimal Focus Measure for Autofocusing and Depth-From-Focus , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Asifullah Khan,et al.  Combination and optimization of classifiers in gender classification using genetic programming , 2005 .

[4]  William B. Langdon,et al.  Size fair and homologous tree genetic programming crossovers , 1999 .

[5]  Asifullah Khan,et al.  Combination of support vector machines using genetic programming , 2006, Int. J. Hybrid Intell. Syst..

[6]  Tae-Sun Choi,et al.  Shape from focus using multilayer feedforward neural networks , 2000, IEEE Trans. Image Process..

[7]  P. Yap,et al.  Image focus measure based on Chebyshev moments , 2004 .

[8]  Tae-Sun Choi,et al.  A heuristic approach for finding best focused shape , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Ponnuthurai N. Suganthan,et al.  Ensemble strategies with adaptive evolutionary programming , 2010, Inf. Sci..

[10]  Tae-Sun Choi,et al.  Focus measure based on the energy of high-frequency components in the S transform. , 2010, Optics letters.

[11]  Thomas Bräunl,et al.  Dynamic population variation in genetic programming , 2009, Inf. Sci..

[12]  Ying Zhang,et al.  A new focus measure method using moments , 2000, Image Vis. Comput..

[13]  Jefersson Alex dos Santos,et al.  A relevance feedback method based on genetic programming for classification of remote sensing images , 2011, Inf. Sci..

[14]  Andrea Thelen,et al.  Improvements in Shape-From-Focus for Holographic Reconstructions With Regard to Focus Operators, Neighborhood-Size, and Height Value Interpolation , 2009, IEEE Transactions on Image Processing.

[15]  Yibin Tian,et al.  Performance of focus measures in the presence of nondefocus aberrations. , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.

[16]  Tae-Sun Choi,et al.  Comparison of Polymers: A New Application of Shape From Focus , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[17]  Matej Kristan,et al.  A Bayes-spectral-entropy-based measure of camera focus using a discrete cosine transform , 2006, Pattern Recognit. Lett..

[18]  Tae-Sun Choi,et al.  Application of Three Dimensional Shape from Image Focus in LCD/TFT Displays Manufacturing , 2007, IEEE Transactions on Consumer Electronics.

[19]  Tae-Sun Choi,et al.  A novel algorithm for estimation of depth map using image focus for 3D shape recovery in the presence of noise , 2008, Pattern Recognit..

[20]  Eric Krotkov,et al.  Focusing , 2004, International Journal of Computer Vision.

[21]  Tae-Sun Choi,et al.  PCA‐based method for 3D shape recovery of microscopic objects from image focus using discrete cosine transform , 2008, Microscopy research and technique.

[22]  Markus Niederoest,et al.  Automatic 3D reconstruction and visualization of microscopic objects from a monoscopic multifocus image sequence , 2003 .

[23]  Tae-Sun Choi,et al.  Consideration of illumination effects and optimization of window size for accurate calculation of depth map for 3D shape recovery , 2007, Pattern Recognit..

[24]  J. F. Brenner,et al.  An automated microscope for cytologic research a preliminary evaluation. , 1976, The journal of histochemistry and cytochemistry : official journal of the Histochemistry Society.

[25]  S. Scherer,et al.  Adaptive shape from focus with an error estimation in light microscopy , 2001, ISPA 2001. Proceedings of the 2nd International Symposium on Image and Signal Processing and Analysis. In conjunction with 23rd International Conference on Information Technology Interfaces (IEEE Cat..

[26]  William B. Langdon,et al.  Size Fair and Homologous Tree Crossovers for Tree Genetic Programming , 2000, Genetic Programming and Evolvable Machines.

[27]  Manjunath.V Prof.Shubhangi D.C Universal Impulse Noise Filter Based on Genetic Programming , 2012 .

[28]  Tae-Sun Choi,et al.  Accurate shape from focus based on focus adjustment in optical microscopy , 2009, Microscopy research and technique.

[29]  C. Ortiz de Solórzano,et al.  Evaluation of autofocus functions in molecular cytogenetic analysis , 1997, Journal of microscopy.

[30]  John R. Koza,et al.  Routine high-return human-competitive automated problem-solving by means of genetic programming , 2008, Inf. Sci..

[31]  Tae-Sun Choi,et al.  Focusing techniques , 1992, Other Conferences.

[32]  Tae-Sun Choi,et al.  Application of Passive Techniques for Three Dimensional Cameras , 2007, IEEE Transactions on Consumer Electronics.

[33]  Y. J. Tejwani,et al.  Robot vision , 1989, IEEE International Symposium on Circuits and Systems,.

[34]  Lining Sun,et al.  Construction and evaluation of a wavelet‐based focus measure for microscopy imaging , 2007, Microscopy research and technique.

[35]  I T Young,et al.  A comparison of different focus functions for use in autofocus algorithms. , 1985, Cytometry.

[36]  Muralidhara Subbarao,et al.  Accurate Recovery of Three-Dimensional Shape from Image Focus , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  T. Choi,et al.  Shape from focus using principal component analysis in discrete wavelet transform , 2009 .

[38]  Shree K. Nayar,et al.  Shape from Focus , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  B. C. Brookes,et al.  Information Sciences , 2020, Cognitive Skills You Need for the 21st Century.

[40]  Abdul Majid,et al.  Optimization and Combination of Classifiers Using Genetic Programming. , 2006 .

[41]  Raveendran Paramesran,et al.  Measure of image sharpness using eigenvalues , 2007, Inf. Sci..

[42]  Jay Martin Tenenbaum,et al.  Accommodation in computer vision , 1971 .

[43]  Fabio Caparrelli,et al.  Computer vision methods for optical microscopes , 2007, Image Vis. Comput..

[44]  Tae-Sun Choi,et al.  Three-dimensional shape recovery from focused image surface , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[45]  Alex Pentland,et al.  A New Sense for Depth of Field , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.