Reconstruction of partially sampled multi-band images - Application to EELS microscopy

Electron microscopy has shown to be a very powerful tool to map the chemical nature of samples at various scales down to atomic resolution. However, many samples can not be analyzed with an acceptable signal-to-noise ratio because of the radiation damage induced by the electron beam. This is particularly crucial for electron energy loss spectroscopy (EELS) which acquires spectral-spatial data and requires high beam intensity. Since scanning transmission electron microscopes (STEM) are able to acquire data cubes by scanning the electron probe over the sample and recording a spectrum for each spatial position, it is possible to design the scan pattern and to sample only specific pixels. As a consequence, partial acquisition schemes are now conceivable, provided a reconstruction of the full data cube is conducted as a post-processing step. This paper proposes two reconstruction algorithms for multi-band images acquired by STEM-EELS which exploits the spectral structure and the spatial smoothness of the image. The performance of the proposed schemes is illustrated thanks to experiments conducted on a realistic phantom dataset as well as real EELS spectrum-images.

[1]  L. Reimer.  Electron Energy‐Loss Spectroscopy in the Electron Microscope , 1997 .

[2]  Guillermo Sapiro,et al.  Image inpainting , 2000, SIGGRAPH.

[3]  N. S. Rebello,et al.  Supervised and Unsupervised Spectral Angle Classifiers , 2002 .

[4]  N. Keshava,et al.  Distance metrics and band selection in hyperspectral processing with applications to material identification and spectral libraries , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[5]  ANTONIN CHAMBOLLE,et al.  An Algorithm for Total Variation Minimization and Applications , 2004, Journal of Mathematical Imaging and Vision.

[6]  M. Malac,et al.  Radiation damage in the TEM and SEM. , 2004, Micron.

[7]  José M. Bioucas-Dias,et al.  Vertex component analysis: a fast algorithm to unmix hyperspectral data , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[9]  Tony F. Chan,et al.  Total Variation Wavelet Inpainting , 2006, Journal of Mathematical Imaging and Vision.

[10]  Jean-Luc Starck,et al.  Compressed Sensing in Astronomy , 2008, IEEE Journal of Selected Topics in Signal Processing.

[11]  Xavier Mestre,et al.  Improved Estimation of Eigenvalues and Eigenvectors of Covariance Matrices Using Their Sample Estimates , 2008, IEEE Transactions on Information Theory.

[12]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[13]  Brendt Wohlberg,et al.  A generalized vector-valued total variation algorithm , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[14]  José M. Bioucas-Dias,et al.  A variable splitting augmented Lagrangian approach to linear spectral unmixing , 2009, 2009 First Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing.

[15]  Emmanuel J. Candès,et al.  A Singular Value Thresholding Algorithm for Matrix Completion , 2008, SIAM J. Optim..

[16]  Pablo A. Parrilo,et al.  Guaranteed Minimum-Rank Solutions of Linear Matrix Equations via Nuclear Norm Minimization , 2007, SIAM Rev..

[17]  Wolfgang Dahmen,et al.  Compressed Sensing and Electron Microscopy , 2010 .

[18]  José M. Bioucas-Dias,et al.  Alternating direction algorithms for constrained sparse regression: Application to hyperspectral unmixing , 2010, 2010 2nd Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing.

[19]  Karl Kunisch,et al.  Total Generalized Variation , 2010, SIAM J. Imaging Sci..

[20]  Jean-Yves Tourneret,et al.  Bayesian compressed sensing in ultrasound imaging , 2011, 2011 4th IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP).

[21]  Horst Bischof,et al.  TGV-Fusion , 2011, Rainbow of Computer Science.

[22]  Nicolas Dobigeon,et al.  Spectral mixture analysis of EELS spectrum-images. , 2012, Ultramicroscopy.

[23]  Antonio J. Plaza,et al.  Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-Based Approaches , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[24]  Pierre Vandergheynst,et al.  Hyperspectral image compressed sensing via low-rank and joint-sparse matrix recovery , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[25]  Alex Chen.  The inpainting of hyperspectral images: a survey and adaptation to hyperspectral data , 2012, Remote Sensing.

[26]  Liangpei Zhang,et al.  Hyperspectral Image Restoration Using Low-Rank Matrix Recovery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Pierre Weiss,et al.  An Algorithm for Variable Density Sampling with Block-Constrained Acquisition , 2014, SIAM J. Imaging Sci..

[28]  L. Carin,et al.  The potential for Bayesian compressive sensing to significantly reduce electron dose in high-resolution STEM images. , 2014, Microscopy.

[29]  Jean-Yves Tourneret,et al.  Hyperspectral and Multispectral Image Fusion Based on a Sparse Representation , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Jean-Yves Tourneret,et al.  Fast Fusion of Multi-Band Images Based on Solving a Sylvester Equation , 2015, IEEE Transactions on Image Processing.

[31]  Jian-Feng Cai,et al.  Accelerated NMR spectroscopy with low-rank reconstruction. , 2015, Angewandte Chemie.

[32]  L. Carin,et al.  Applying compressive sensing to TEM video: a substantial frame rate increase on any camera , 2015, Advanced Structural and Chemical Imaging.

[33]  Jean-Yves Tourneret,et al.  Bayesian Fusion of Multi-Band Images , 2013, IEEE Journal of Selected Topics in Signal Processing.

[34]  Martin Benning,et al.  Reduced-dose and high-speed acquisition strategies for multi-dimensional electron microscopy , 2015, Advanced Structural and Chemical Imaging.

[35]  Bart Goris,et al.  Development of a fast electromagnetic beam blanker for compressed sensing in scanning transmission electron microscopy , 2015, 1509.06656.

[36]  A. Basarab,et al.  Fast Single Image Super-resolution using a New Analytical Solution for l2-l2 Problems. , 2016, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[37]  P. Midgley,et al.  Practical Implementation of Compressive Sensing for High Resolution STEM , 2016, Microscopy and Microanalysis.

[38]  Nicolas Dobigeon,et al.  Linear and nonlinear unmixing in hyperspectral imaging , 2016 .

[39]  M. Daudon,et al.  Topography, Composition and Structure of Incipient Randall Plaque at the Nanoscale Level. , 2016, The Journal of urology.

[40]  L. Carin,et al.  Compressive STEM-EELS , 2016, Microscopy and Microanalysis.

[41]  Kevin Miller,et al.  Pre-processing and classification of hyperspectral imagery via selective inpainting , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[42]  Jocelyn Chanussot,et al.  Hyperspectral image inpainting based on collaborative total variation , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[43]  Nicolas Dobigeon,et al.  Reconstruction Of Partially Sampled EELS Images , 2018, 2018 9th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[44]  José M. Bioucas-Dias,et al.  Fast Hyperspectral Image Denoising and Inpainting Based on Low-Rank and Sparse Representations , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.