Fast reconstruction of atomic-scale STEM-EELS images from sparse sampling

This paper discusses the reconstruction of partially sampled spectrum-images to accelerate the acquisition in scanning transmission electron microscopy (STEM). The problem of image reconstruction has been widely considered in the literature for many imaging modalities, but only a few attempts handled 3D data such as spectral images acquired by STEM electron energy loss spectroscopy (EELS). Besides, among the methods proposed in the microscopy literature, some are fast but inaccurate while others provide accurate reconstruction but at the price of a high computation burden. Thus none of the proposed reconstruction methods fulfills our expectations in terms of accuracy and computation complexity. In this paper, we propose a fast and accurate reconstruction method suited for atomic-scale EELS. This method is compared to popular solutions such as beta process factor analysis (BPFA) which is used for the first time on STEM-EELS images. Experiments based on real as synthetic data will be conducted.

[1]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[2]  Sergei V. Kalinin,et al.  Compressive Sensing on Diverse STEM Scans: Real-time Feedback, Low-dose and Dynamic Range , 2018, Microscopy and Microanalysis.

[3]  Tim Dahmen,et al.  Exemplar-Based Inpainting Based on Dictionary Learning for Sparse Scanning Electron Microscopy , 2018, Microscopy and Microanalysis.

[4]  Truong Q. Nguyen,et al.  Accelerating GMM-Based Patch Priors for Image Restoration: Three Ingredients for a $100{\times}$ Speed-Up , 2019, IEEE Transactions on Image Processing.

[5]  Karin Schnass,et al.  Fast dictionary learning from incomplete data , 2018, EURASIP J. Adv. Signal Process..

[6]  Lawrence Carin,et al.  Tensor-Dictionary Learning with Deep Kruskal-Factor Analysis , 2016, AISTATS.

[7]  Nicolas Dobigeon,et al.  Reconstruction of Partially Sampled Multiband Images—Application to STEM-EELS Imaging , 2018, IEEE Transactions on Computational Imaging.

[8]  B. L. Mehdi,et al.  A sub-sampled approach to extremely low-dose STEM , 2018 .

[9]  Jocelyn Chanussot,et al.  A Convex Formulation for Hyperspectral Image Superresolution via Subspace-Based Regularization , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Tim Dahmen,et al.  Feature Adaptive Sampling for Scanning Electron Microscopy , 2016, Scientific Reports.

[11]  Hyrum S. Anderson,et al.  Sparse imaging for fast electron microscopy , 2013, Electronic Imaging.

[12]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[13]  Sergei V. Kalinin,et al.  Compressed Sensing of Scanning Transmission Electron Microscopy (STEM) With Nonrectangular Scans , 2018, Microscopy and Microanalysis.

[14]  Philipp Slusallek,et al.  How should a fixed budget of dwell time be spent in scanning electron microscopy to optimize image quality? , 2018, Ultramicroscopy.

[15]  Karin Schnass,et al.  Dictionary learning from incomplete data for efficient image restoration , 2017, 2017 25th European Signal Processing Conference (EUSIPCO).

[16]  José M. Bioucas-Dias,et al.  Fast Hyperspectral Image Denoising and Inpainting Based on Low-Rank and Sparse Representations , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[17]  M. Kowalski.  Sparse regression using mixed norms , 2009 .

[18]  Patrick Pérez,et al.  Region filling and object removal by exemplar-based image inpainting , 2004, IEEE Transactions on Image Processing.

[19]  Phillip G Post,et al.  A Phenomenological Investigation of Gymnasts' Lived Experience of Imagery , 2012 .

[20]  P. Midgley,et al.  Practical Implementation of Compressive Sensing for High Resolution STEM , 2016, Microscopy and Microanalysis.

[21]  Bart Goris,et al.  Development of a fast electromagnetic beam blanker for compressed sensing in scanning transmission electron microscopy , 2015, 1509.06656.

[22]  Wolfgang Dahmen,et al.  Compressed Sensing and Electron Microscopy , 2010 .

[23]  N. Keshava,et al.  Distance metrics and band selection in hyperspectral processing with applications to material identification and spectral libraries , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Karim Bouzehouane,et al.  Direct Mapping of Phase Separation across the Metal-Insulator Transition of NdNiO3. , 2018, Nano letters.

[25]  N. Browning,et al.  Implementing an accurate and rapid sparse sampling approach for low-dose atomic resolution STEM imaging , 2016 .

[26]  Michael P. Friedlander,et al.  Probing the Pareto Frontier for Basis Pursuit Solutions , 2008, SIAM J. Sci. Comput..

[27]  Klaus Diepold,et al.  Analysis Operator Learning and its Application to Image Reconstruction , 2012, IEEE Transactions on Image Processing.

[28]  Guillermo Sapiro,et al.  Dictionary Learning for Noisy and Incomplete Hyperspectral Images , 2012, SIAM J. Imaging Sci..

[29]  Alfred O. Hero,et al.  Joint Bayesian Endmember Extraction and Linear Unmixing for Hyperspectral Imagery , 2009, IEEE Transactions on Signal Processing.

[30]  Michael Elad,et al.  Sparse Representation for Color Image Restoration , 2008, IEEE Transactions on Image Processing.

[31]  Truong Q. Nguyen,et al.  Accelerating GMM-based patch priors for image restoration: Three ingredients for a 100x speed-up , 2020 .

[32]  Yair Weiss,et al.  From learning models of natural image patches to whole image restoration , 2011, 2011 International Conference on Computer Vision.

[33]  R. Sibson,et al.  A brief description of natural neighbor interpolation , 1981 .

[34]  Alan C. Bovik,et al.  Mean squared error: Love it or leave it? A new look at Signal Fidelity Measures , 2009, IEEE Signal Processing Magazine.

[35]  Qiang Zhang,et al.  Joint segmentation and reconstruction of hyperspectral data with compressed measurements. , 2011, Applied optics.

[36]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[37]  Yan Zhang,et al.  Reduced Electron Exposure for Energy-Dispersive Spectroscopy using Dynamic Sampling , 2017, Ultramicroscopy.

[38]  Guoqiang Han,et al.  Optimal sampling and reconstruction of undersampled atomic force microscope images using compressive sensing. , 2018, Ultramicroscopy.

[39]  A. Ms.PatilV..  Region Filling and Object Removal by Exemplar-Based Image Inpainting , 2012 .

[40]  Les Allen,et al.  Modeling Nanoscale Imaging in Electron Microscopy , 2012 .

[41]  José M. Bioucas-Dias,et al.  HYCA: A New Technique for Hyperspectral Compressive Sensing , 2015, IEEE Trans. Geosci. Remote. Sens..

[42]  N. S. Rebello,et al.  Supervised and Unsupervised Spectral Angle Classifiers , 2002 .

[43]  Julien Mairal,et al.  Proximal Methods for Hierarchical Sparse Coding , 2010, J. Mach. Learn. Res..

[44]  M. Malac,et al.  Radiation damage in the TEM and SEM. , 2004, Micron.

[45]  Guillermo Sapiro,et al.  Online dictionary learning for sparse coding , 2009, ICML '09.

[46]  Charles A. Bouman,et al.  A Framework for Dynamic Image Sampling Based on Supervised Learning , 2017, IEEE Transactions on Computational Imaging.

[47]  L. Carin,et al.  The potential for Bayesian compressive sensing to significantly reduce electron dose in high-resolution STEM images. , 2014, Microscopy.

[48]  Alberto Zobelli,et al.  Spatial and spectral dynamics in STEM hyperspectral imaging using random scan patterns. , 2019, Ultramicroscopy.

[49]  Y. C. Pati,et al.  Orthogonal matching pursuit: recursive function approximation with applications to wavelet decomposition , 1993, Proceedings of 27th Asilomar Conference on Signals, Systems and Computers.

[50]  P. Bayle-Guillemaud,et al.  Multivariate Analysis and Compressed Sensing Methods for Spectroscopic Electron Tomography of Semiconductor Devices , 2018, Microscopy and Microanalysis.

[51]  Jean-Yves Tourneret,et al.  Fast Fusion of Multi-Band Images Based on Solving a Sylvester Equation , 2015, IEEE Transactions on Image Processing.

[52]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[53]  Eirik Endeve,et al.  Dynamic scan control in STEM: spiral scans , 2016, Advanced Structural and Chemical Imaging.

[55]  Nicolas Dobigeon,et al.  Reconstruction Of Partially Sampled EELS Images , 2018, 2018 9th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[56]  L. Carin,et al.  Compressive STEM-EELS , 2016, Microscopy and Microanalysis.

[57]  V. Dravid,et al.  High speed/low dose analytical electron microscopy with dynamic sampling. , 2018, Micron.

[58]  Yi Ma,et al.  A non-negative sparse promoting algorithm for high resolution hyperspectral imaging , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[59]  Nicolas Dobigeon,et al.  Spectral mixture analysis of EELS spectrum-images. , 2012, Ultramicroscopy.