Intelligent Autofocus

We demonstrate that deep learning methods can determine the best focus position from 1-2 image samples, enabling 5-10x faster focus than traditional search-based methods. In contrast with phase detection methods, deep autofocus does not require specialized hardware. In further constrast with conventional methods, which assume a static "best focus," AI methods can generate scene-based focus trajectories that optimize synthesized image quality for dynamic and three dimensional scenes.

[1]  J.,et al.  Parallel cameras , 2018 .

[2]  Bolei Zhou,et al.  Learning Deep Features for Scene Recognition using Places Database , 2014, NIPS.

[3]  Mongi A. Abidi,et al.  Evaluation of sharpness measures and search algorithms for the auto focusing of high-magnification images , 2006, SPIE Defense + Commercial Sensing.

[4]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[5]  Xu Guo,et al.  Fast auto-focusing search algorithm for a high-speed and high-resolution camera based on the image histogram feature function. , 2018, Applied optics.

[6]  Zhihai Xu,et al.  Fast auto-focus scheme based on optical defocus fitting model , 2018 .

[7]  William T. Freeman,et al.  Learning the Depths of Moving People by Watching Frozen People , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Yiling Xu,et al.  A Dual Camera System for High Spatiotemporal Resolution Video Acquisition , 2020, IEEE transactions on pattern analysis and machine intelligence.

[9]  Peter van Beek,et al.  An autofocus heuristic for digital cameras based on supervised machine learning , 2015, J. Heuristics.

[10]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[11]  Nasser Kehtarnavaz,et al.  Performance metrics for auto-focus in digital and cell-phone cameras , 2010, 2010 Digest of Technical Papers International Conference on Consumer Electronics (ICCE).

[12]  Huazhong Yang,et al.  Scene-Adaptive Image Acquisition for Focus Stacking , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[13]  Soo-Won Kim,et al.  Enhanced Autofocus Algorithm Using Robust Focus Measure and Fuzzy Reasoning , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Nasser Kehtarnavaz,et al.  A filter-switching auto-focus framework for consumer camera imaging systems , 2012, IEEE Transactions on Consumer Electronics.

[15]  Chen Guojin,et al.  The image auto-focusing method based on artificial neural networks , 2010, 2010 IEEE International Conference on Computational Intelligence for Measurement Systems and Applications.

[16]  Natasha Gelfand,et al.  Generalized autofocus , 2011, 2011 IEEE Workshop on Applications of Computer Vision (WACV).

[17]  Siavash Yazdanfar,et al.  Simple and robust image-based autofocusing for digital microscopy. , 2008, Optics express.

[18]  Kiriakos N. Kutulakos,et al.  Time-constrained photography , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[19]  Xiaohua Qiu,et al.  Guided filter-based multi-focus image fusion through focus region detection , 2019, Signal Process. Image Commun..

[20]  Shaowei Jiang,et al.  Transform- and multi-domain deep learning for single-frame rapid autofocusing in whole slide imaging. , 2018, Biomedical optics express.

[21]  C. Ortiz de Solórzano,et al.  Evaluation of autofocus functions in molecular cytogenetic analysis , 1997, Journal of microscopy.

[22]  Yu Liu,et al.  Multi-focus image fusion with a deep convolutional neural network , 2017, Inf. Fusion.

[23]  Rey-Chue Hwang,et al.  A passive auto-focus camera control system , 2010, Appl. Soft Comput..

[24]  Shesheng Gao,et al.  Image Segmentation-Based Multi-Focus Image Fusion Through Multi-Scale Convolutional Neural Network , 2017, IEEE Access.

[25]  Z M Wu,et al.  Bilateral prediction and intersection calculation autofocus method for automated microscopy , 2012, Journal of microscopy.

[26]  Sung-Jea Ko,et al.  A novel training based auto-focus for mobile-phone cameras , 2011, IEEE Transactions on Consumer Electronics.

[27]  Peter van Beek,et al.  Improved image selection for focus stacking in digital photography , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[28]  Yi Li,et al.  Convolutional Neural Networks for No-Reference Image Quality Assessment , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Nasser Kehtarnavaz,et al.  Development and real-time implementation of a rule-based auto-focus algorithm , 2003, Real Time Imaging.

[30]  Chang-Yeong Kim,et al.  Fast and accurate auto focusing algorithm based on two defocused images using discrete cosine transform , 2008, Electronic Imaging.

[31]  Eirikur Agustsson,et al.  NTIRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[32]  Jinde Cao,et al.  Fully Convolutional Network-Based Multifocus Image Fusion , 2018, Neural Computation.

[33]  Ling Wei,et al.  Neural network control of focal position during time-lapse microscopy of cells , 2018, Scientific Reports.

[34]  Eric Krotkov,et al.  Focusing , 2004, International Journal of Computer Vision.

[35]  Zhiliang Hong,et al.  Modified fast climbing search auto-focus algorithm with adaptive step size searching technique for digital camera , 2003, IEEE Trans. Consumer Electron..

[36]  Guoyin Wang,et al.  Pixel convolutional neural network for multi-focus image fusion , 2017, Inf. Sci..

[37]  Nasser Kehtarnavaz,et al.  A new auto-focus sharpness function for digital and smart-phone cameras , 2011, 2011 IEEE International Conference on Consumer Electronics (ICCE).

[38]  Edmund Y. Lam,et al.  Learning-based nonparametric autofocusing for digital holography , 2018 .

[39]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[40]  Luc Van Gool,et al.  A Benchmark Dataset and Evaluation Methodology for Video Object Segmentation , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[41]  Lee F. Hovela Learning how to focus: adaptive control of an autofocus camera , 1992, Electronic Imaging.