Dynamic compressed sensing for real-time tomographic reconstruction.

Electron tomography has achieved higher resolution and quality at reduced doses with recent advances in compressed sensing. Compressed sensing (CS) exploits the inherent sparse signal structure to efficiently reconstruct three-dimensional (3D) volumes at the nanoscale from undersampled measurements. However, the process bottlenecks 3D reconstruction with computation times that run from hours to days. Here we demonstrate a framework for dynamic compressed sensing that produces a 3D specimen structure that updates in real-time as new specimen projections are collected. Researchers can begin interpreting 3D specimens as data is collected to facilitate high-throughput and interactive analysis. Using scanning transmission electron microscopy (STEM), we show that dynamic compressed sensing accelerates the convergence speed by ~3-fold while also reducing its error by 27% for a Au/SrTiO3 nanoparticle specimen. Before a tomography experiment is completed, the 3D tomogram has interpretable structure within ~33% of completion and fine details are visible as early as ~66%. Upon completion of an experiment, a high-fidelity 3D visualization is produced without further delay. Additionally, reconstruction parameters that tune data fidelity can be manipulated throughout the computation without re-running the entire process.

[1]  Wojciech Czaja,et al.  Compressed Sensing Electron Tomography for Determining Biological Structure , 2016, Scientific Reports.

[2]  Li Liu,et al.  Fast alternating projection methods for constrained tomographic reconstruction , 2017, PloS one.

[3]  Françoise Peyrin,et al.  Evaluation of noise and blur effects with SIRT-FISTA-TV reconstruction algorithm: Application to fast environmental transmission electron tomography. , 2018, Ultramicroscopy.

[4]  G. Herman,et al.  Algebraic reconstruction techniques (ART) for three-dimensional electron microscopy and x-ray photography. , 1970, Journal of theoretical biology.

[5]  Colin Ophus,et al.  Nanomaterial datasets to advance tomography in scanning transmission electron microscopy , 2016, Scientific Data.

[6]  Yi Jiang,et al.  Sampling Limits for Electron Tomography with Sparsity-exploiting Reconstructions , 2018, Ultramicroscopy.

[7]  D. Muller,et al.  A Simple Preparation Method for Full-Range Electron Tomography of Nanoparticles and Fine Powders , 2017, Microscopy and Microanalysis.

[8]  A. Kak,et al.  Simultaneous Algebraic Reconstruction Technique (SART): A Superior Implementation of the Art Algorithm , 1984, Ultrasonic imaging.

[9]  E. Sidky,et al.  Accurate image reconstruction from few-views and limited-angle data in divergent-beam CT , 2009, 0904.4495.

[10]  Per Christian Hansen,et al.  Multicore Performance of Block Algebraic Iterative Reconstruction Methods , 2014, SIAM J. Sci. Comput..

[11]  L. Xing,et al.  Metal artifact reduction in x-ray computed tomography (CT) by constrained optimization. , 2011, Medical physics.

[12]  Rolf Hempel,et al.  The MPI Message Passing Interface Standard , 1994 .

[13]  Veit Elser,et al.  Hierarchical Porous Polymer Scaffolds from Block Copolymers , 2013, Science.

[14]  Ya-Xiang Yuan,et al.  A Nonlinear Conjugate Gradient Method with a Strong Global Convergence Property , 1999, SIAM J. Optim..

[15]  V. Lučić,et al.  Quantitative analysis of the native presynaptic cytomatrix by cryoelectron tomography , 2010, The Journal of cell biology.

[16]  Mirko Holler,et al.  Alignment methods for nanotomography with deep subpixel accuracy. , 2019, Optics express.

[17]  E. Sidky,et al.  Image reconstruction in circular cone-beam computed tomography by constrained, total-variation minimization , 2008, Physics in medicine and biology.

[18]  Ian T. Foster,et al.  Rapid Tomographic Image Reconstruction via Large-Scale Parallelization , 2015, Euro-Par.

[19]  Per Christian Hansen,et al.  Semi-convergence properties of Kaczmarz’s method , 2014 .

[20]  P. Midgley,et al.  Three-dimensional morphology of iron oxide nanoparticles with reactive concave surfaces. A compressed sensing-electron tomography (CS-ET) approach. , 2011, Nano letters.

[21]  R. Vershynin,et al.  A Randomized Kaczmarz Algorithm with Exponential Convergence , 2007, math/0702226.

[22]  P. Midgley,et al.  3D electron microscopy in the physical sciences: the development of Z-contrast and EFTEM tomography. , 2003, Ultramicroscopy.

[23]  Xiaochuan Pan,et al.  A constrained, total-variation minimization algorithm for low-intensity x-ray CT. , 2010, Medical physics.

[24]  Yi Jiang,et al.  Removing Stripes, Scratches, and Curtaining with Nonrecoverable Compressed Sensing , 2019, Microscopy and Microanalysis.

[25]  D. Muller,et al.  Three-Dimensional Measurement of Line Edge Roughness in Copper Wires Using Electron Tomography , 2009, Microscopy and Microanalysis.

[26]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[27]  Yitong Liu,et al.  A joint deep learning model to recover information and reduce artifacts in missing-wedge sinograms for electron tomography and beyond , 2019, Scientific Reports.

[28]  D. L. Donoho,et al.  Compressed sensing , 2006, IEEE Trans. Inf. Theory.

[29]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[30]  Yonina C. Eldar,et al.  Structured Compressed Sensing: From Theory to Applications , 2011, IEEE Transactions on Signal Processing.

[31]  D. J. De Rosier,et al.  Reconstruction of Three Dimensional Structures from Electron Micrographs , 1968, Nature.

[32]  P. Gilbert Iterative methods for the three-dimensional reconstruction of an object from projections. , 1972, Journal of theoretical biology.

[33]  Dirk A. Lorenz,et al.  Testable uniqueness conditions for empirical assessment of undersampling levels in total variation-regularized X-ray CT , 2014, ArXiv.

[34]  Robert Hovden,et al.  Three-dimensional tracking and visualization of hundreds of Pt-Co fuel cell nanocatalysts during electrochemical aging. , 2012, Nano letters.

[35]  L. Dagum,et al.  OpenMP: an industry standard API for shared-memory programming , 1998 .

[36]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[37]  S. Kaczmarz Approximate solution of systems of linear equations , 1993 .

[38]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[39]  Jeffrey A. Fessler,et al.  Generalizing the Optimized Gradient Method for Smooth Convex Minimization , 2016, SIAM J. Optim..