Autonomous Electron Tomography Reconstruction Using Bayesian Optimization.

Modern electron tomography has progressed to higher resolution at lower doses by leveraging compressed sensing methods that minimize total variation (TV). However, these sparsity-emphasized reconstruction algorithms introduce tunable parameters that greatly influence the reconstruction quality. Here, Pareto front analysis shows that high-quality tomograms are reproducibly achieved when TV minimization is heavily weighted. However, in excess, compressed sensing tomography creates overly smoothed 3D reconstructions. Adding momentum into the gradient descent during reconstruction reduces the risk of over-smoothing and better ensures that compressed sensing is well behaved. For simulated data, the tedious process of tomography parameter selection is efficiently solved using Bayesian optimization with Gaussian processes. In combination, Bayesian optimization with momentum-based compressed sensing greatly reduces the required compute time$-$an 80% reduction was observed for the 3D reconstruction of SrTiO$_3$ nanocubes. Automated parameter selection is necessary for large scale tomographic simulations that enable the 3D characterization of a wider range of inorganic and biological materials.

[1]  Huihuo Zheng,et al.  Real-time 3D analysis during electron tomography using tomviz , 2022, Nature Communications.

[2]  R. Vasudevan,et al.  Bayesian Active Learning for Scanning Probe Microscopy: from Gaussian Processes to Hypothesis Learning , 2022, ACS nano.

[3]  Michael C. Cao,et al.  Automatic parameter selection for electron ptychography via Bayesian optimization , 2022, Scientific Reports.

[4]  Kevin M. Roccapriore,et al.  Physics Discovery in Nanoplasmonic Systems via Autonomous Experiments in Scanning Transmission Electron Microscopy , 2021, Advanced science.

[5]  J. Maxson,et al.  Aberration Corrector Tuning with Machine-Learning-Based Emittance Measurements and Bayesian Optimization , 2021, Microscopy and Microanalysis.

[6]  Janardhan Rao Doppa,et al.  Bayesian optimization of nanoporous materials , 2021, Molecular Systems Design & Engineering.

[7]  Tonio Buonassisi,et al.  Benchmarking the performance of Bayesian optimization across multiple experimental materials science domains , 2021, npj Computational Materials.

[8]  M. Hanwell,et al.  Dynamic Compressed Sensing for Real-time Tomographic Reconstruction , 2020, Microscopy and Microanalysis.

[9]  J. Sonke,et al.  Pareto frontier analysis of spatio-temporal total-variation based four-dimensional cone-beam CT , 2019, Biomedical Physics & Engineering Express.

[10]  S. Ermon,et al.  Bayesian Optimization of a Free-Electron Laser. , 2019, Physical review letters.

[11]  Françoise Peyrin,et al.  Evaluation of noise and blur effects with SIRT-FISTA-TV reconstruction algorithm: Application to fast environmental transmission electron tomography. , 2018, Ultramicroscopy.

[12]  Yi Jiang,et al.  Sampling Limits for Electron Tomography with Sparsity-exploiting Reconstructions , 2018, Ultramicroscopy.

[13]  D. Muller,et al.  A Simple Preparation Method for Full-Range Electron Tomography of Nanoparticles and Fine Powders , 2017, Microscopy and Microanalysis.

[14]  Colin Ophus,et al.  Nanomaterial datasets to advance tomography in scanning transmission electron microscopy , 2016, Scientific Data.

[15]  Deshan Yang,et al.  Accelerated fast iterative shrinkage thresholding algorithms for sparsity-regularized cone-beam CT image reconstruction. , 2016, Medical physics.

[16]  J. Miao,et al.  Three-dimensional coordinates of individual atoms in materials revealed by electron tomography. , 2015, Nature materials.

[17]  Stephen P. Boyd,et al.  Proximal Algorithms , 2013, Found. Trends Optim..

[18]  Rowan Leary,et al.  Compressed sensing electron tomography. , 2013, Ultramicroscopy.

[19]  Xin-She Yang,et al.  A literature survey of benchmark functions for global optimisation problems , 2013, Int. J. Math. Model. Numer. Optimisation.

[20]  Ohad Shamir,et al.  Stochastic Gradient Descent for Non-smooth Optimization: Convergence Results and Optimal Averaging Schemes , 2012, ICML.

[21]  J. Miao,et al.  Electron tomography at 2.4-ångström resolution , 2012, Nature.

[22]  A. V. Schaik,et al.  L1 regularization method in electrical impedance tomography by using the L1-curve (Pareto frontier curve) , 2012 .

[23]  Nando de Freitas,et al.  Portfolio Allocation for Bayesian Optimization , 2010, UAI.

[24]  Marc Teboulle,et al.  Fast Gradient-Based Algorithms for Constrained Total Variation Image Denoising and Deblurring Problems , 2009, IEEE Transactions on Image Processing.

[25]  E. Sidky,et al.  Image reconstruction in circular cone-beam computed tomography by constrained, total-variation minimization , 2008, Physics in medicine and biology.

[26]  E. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[27]  M. Malac,et al.  Radiation damage in the TEM and SEM. , 2004, Micron.

[28]  P. Midgley,et al.  3D electron microscopy in the physical sciences: the development of Z-contrast and EFTEM tomography. , 2003, Ultramicroscopy.

[29]  I. Daubechies,et al.  An iterative thresholding algorithm for linear inverse problems with a sparsity constraint , 2003, math/0307152.

[30]  Jonas Mockus,et al.  Application of Bayesian approach to numerical methods of global and stochastic optimization , 1994, J. Glob. Optim..

[31]  J. Mockus Bayesian Approach to Global Optimization: Theory and Applications , 1989 .

[32]  W Hoppe,et al.  Three-dimensional reconstruction of individual negatively stained yeast fatty-acid synthetase molecules from tilt series in the electron microscope. , 1974, Hoppe-Seyler's Zeitschrift fur physiologische Chemie.

[33]  A. KLUG,et al.  Three-dimensional Image Reconstruction from the Viewpoint of information Theory , 1972, Nature.

[34]  P. Gilbert Iterative methods for the three-dimensional reconstruction of an object from projections. , 1972, Journal of theoretical biology.

[35]  G. Herman,et al.  Algebraic reconstruction techniques (ART) for three-dimensional electron microscopy and x-ray photography. , 1970, Journal of theoretical biology.

[36]  D. J. De Rosier,et al.  Reconstruction of Three Dimensional Structures from Electron Micrographs , 1968, Nature.

[37]  Tanja Hueber,et al.  Gaussian Processes For Machine Learning , 2016 .

[38]  Gitta Kutyniok Compressed Sensing , 2012 .

[39]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[40]  Y. Nesterov A method for solving the convex programming problem with convergence rate O(1/k^2) , 1983 .

[41]  Boris Polyak Some methods of speeding up the convergence of iteration methods , 1964 .