Acceleration of autofocusing with improved edge extraction using structure tensor and Schatten norm.

Determining the optimal focal plane amongst a stack of blurred images in a short response time is a non-trivial task in optical imaging like microscopy and photography. An autofocusing algorithm, or in other words, a focus metric, is key to effectively dealing with such problem. In previous work, we proposed a structure tensor-based autofocusing algorithm for coherent imaging, i.e., digital holography. In this paper, we further extend the realm of this method in more imaging modalities. With an optimized computation scheme of structure tensor, a significant acceleration of about fivefold in computation speed without sacrificing the autofocusing accuracy is achieved by using the Schatten matrix norm instead of the vector norm. Besides, we also demonstrate its edge extraction capability by retrieving the intermediate tensor image. Synthesized and experimental data acquired in various imaging scenarios such as incoherent microscopy and photography are demonstrated to verify the efficacy of this method.

[1]  Bradley J Nelson,et al.  Autofocusing in computer microscopy: Selecting the optimal focus algorithm , 2004, Microscopy research and technique.

[2]  Henry Pinkard,et al.  Deep learning for single-shot autofocus microscopy , 2019, Optica.

[3]  Muralidhara Subbarao,et al.  Selecting the Optimal Focus Measure for Autofocusing and Depth-From-Focus , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Shaowei Jiang,et al.  Transform- and multi-domain deep learning for single-frame rapid autofocusing in whole slide imaging. , 2018, Biomedical optics express.

[5]  Anne E Carpenter,et al.  Workflow and Metrics for Image Quality Control in Large-Scale High-Content Screens , 2012, Journal of biomolecular screening.

[6]  Reiner Lenz,et al.  Generalized Pareto Distributions—Application to Autofocus in Automated Microscopy , 2016, IEEE Journal of Selected Topics in Signal Processing.

[7]  D. Dirksen,et al.  Autofocusing in digital holographic phase contrast microscopy on pure phase objects for live cell imaging. , 2008, Applied optics.

[8]  Yang Xu,et al.  Review of optical coherence tomography in oncology , 2017, Journal of biomedical optics.

[9]  Raveendran Paramesran,et al.  Measure of image sharpness using eigenvalues , 2007, Inf. Sci..

[10]  Edmund Y Lam,et al.  Automatic focusing for multisectional objects in digital holography using the structure tensor. , 2017, Optics letters.

[11]  Jesús Angulo,et al.  Structure Tensor Image Filtering using Riemannian L_1 and L_∞ Center-of-Mass , 2014 .

[12]  Ting-Chung Poon,et al.  Blind sectional image reconstruction for optical scanning holography. , 2009, Optics letters.

[13]  Edmund Y Lam,et al.  Extended focused imaging and depth map reconstruction in optical scanning holography. , 2016, Applied optics.

[14]  Pierre Weiss,et al.  Structure Tensor Based Analysis of Cells and Nuclei Organization in Tissues , 2016, IEEE Transactions on Medical Imaging.

[15]  I T Young,et al.  A comparison of different focus functions for use in autofocus algorithms. , 1985, Cytometry.

[16]  Petros Maragos,et al.  Structure Tensor Total Variation , 2015, SIAM J. Imaging Sci..

[17]  P. Yap,et al.  Image focus measure based on Chebyshev moments , 2004 .

[18]  Yalin Ding,et al.  Analysis of image motion on autofocus precision for aerial cameras , 2015 .

[19]  George Lee,et al.  Image analysis and machine learning in digital pathology: Challenges and opportunities , 2016, Medical Image Anal..

[20]  Edmund Y. Lam,et al.  Learning-based nonparametric autofocusing for digital holography , 2018 .

[21]  Anne E Carpenter,et al.  Annotated high-throughput microscopy image sets for validation , 2012, Nature Methods.

[22]  Edmund Y. Lam,et al.  End-to-end deep learning framework for digital holographic reconstruction , 2019, Advanced Photonics.

[23]  Jing Xu,et al.  Accelerating wavefront-sensing-based autofocusing using pixel reduction in spatial and frequency domains. , 2019, Applied optics.

[24]  Zibang Zhang,et al.  Single-frame rapid autofocusing for brightfield and fluorescence whole slide imaging. , 2016, Biomedical optics express.

[25]  Domenec Puig,et al.  Analysis of focus measure operators for shape-from-focus , 2013, Pattern Recognit..

[26]  Joachim Weickert,et al.  Coherence-Enhancing Diffusion Filtering , 1999, International Journal of Computer Vision.

[27]  Michael Unser,et al.  Hessian Schatten-Norm Regularization for Linear Inverse Problems , 2012, IEEE Transactions on Image Processing.

[28]  I.E. Abdou,et al.  Quantitative design and evaluation of enhancement/thresholding edge detectors , 1979, Proceedings of the IEEE.

[29]  Li Xi,et al.  Autofocusing of ISAR images based on entropy minimization , 1999 .