Dynamic Image Sampling Using a Novel Variance Based Probability Mass Function

Incremental sampling can be applied in scientific imaging techniques whenever the measurements are taken incrementally, i.e., one pixel position is measured at a time. It can be used to reduce the measurement time as well as the dose impinging onto a specimen. For incremental sampling, the choice of the sampling pattern plays a major role in order to achieve a high reconstruction quality. Besides using static incremental sampling patterns, it is also possible to dynamically adapt the sampling pattern based on the already measured data. This is called dynamic sampling and allows for a higher reconstruction quality, as the inhomogeneity of the sampled image content can be taken into account. Several approaches for dynamic sampling have been published in the literature. However, they share the common drawback that homogeneous regions are sampled too late. This reduces the reconstruction quality as fine details can be missed. We overcome this drawback using a novel probabilistic approach to dynamic image sampling (PADIS). It is based on a data driven probability mass function which uses a local variance map. In our experiments, we evaluate the reconstruction quality for scanning electron microscopy images as well as for natural image content. For scanning electron microscopy images with a sampling density of 35% and frequency selective reconstruction, our approach achieves a PSNR gain of +0.92 dB compared to other dynamic sampling approaches and +1.42 dB compared to the best static patterns. For natural images, even higher gains are achieved. Experiments with additional measurement noise show that for our method the sampling patterns are more stable. Moreover, the runtime is faster than for the other methods.

[1]  Peyman Milanfar,et al.  Kernel Regression for Image Processing and Reconstruction , 2007, IEEE Transactions on Image Processing.

[2]  Tim Dahmen,et al.  Feature Adaptive Sampling for Scanning Electron Microscopy , 2016, Scientific Reports.

[3]  Hyrum S. Anderson,et al.  Sparse imaging for fast electron microscopy , 2013, Electronic Imaging.

[4]  André Kaup,et al.  Design Techniques for Incremental Non-Regular Image Sampling Patterns , 2018, 2018 IEEE International Conference on Imaging Systems and Techniques (IST).

[5]  Nicola Asuni,et al.  TESTIMAGES: a Large-scale Archive for Testing Visual Devices and Basic Image Processing Algorithms , 2014, STAG.

[6]  Sean B Andersson,et al.  Towards the low-dose characterization of beam sensitive nanostructures via implementation of sparse image acquisition in scanning transmission electron microscopy , 2017 .

[7]  Bart Goris,et al.  Development of a fast electromagnetic beam blanker for compressed sensing in scanning transmission electron microscopy , 2015, 1509.06656.

[8]  Dong Hye Ye,et al.  Dynamic Sparse Sampling for Confocal Raman Microscopy. , 2018, Analytical chemistry.

[9]  André Kaup,et al.  Resampling Images to a Regular Grid From a Non-Regular Subset of Pixel Positions Using Frequency Selective Reconstruction , 2015, IEEE Transactions on Image Processing.

[10]  N. Browning,et al.  Implementing an accurate and rapid sparse sampling approach for low-dose atomic resolution STEM imaging , 2016 .

[11]  Joachim Weickert,et al.  Beyond pure quality: Progressive modes, region of interest coding, and real time video decoding for PDE-based image compression , 2015, J. Vis. Commun. Image Represent..

[12]  Mark A. Z. Dippé,et al.  Antialiasing through stochastic sampling , 1985, SIGGRAPH.

[13]  Pascal Peter,et al.  Fast Inpainting-Based Compression: Combining Shepard Interpolation with Joint Inpainting and Prediction , 2019, 2019 IEEE International Conference on Image Processing (ICIP).

[14]  Felix J. Herrmann,et al.  Irregular sampling: from aliasing to noise , 2007 .

[15]  Charles A. Bouman,et al.  A model-based framework for fast dynamic image sampling , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[16]  M. Malac,et al.  Radiation damage in the TEM and SEM. , 2004, Micron.

[17]  Michael Lindenbaum,et al.  Blind Adaptive Sampling of Images , 2012, IEEE Transactions on Image Processing.

[18]  Yan Zhang,et al.  SLADS-Net: Supervised Learning Approach for Dynamic Sampling using Deep Neural Networks , 2018, Computational Imaging.

[19]  Jelena Kovacevic,et al.  An adaptive multirate algorithm for acquisition of fluorescence microscopy data sets , 2005, IEEE Transactions on Image Processing.

[20]  Charles A. Bouman,et al.  A Supervised Learning Approach for Dynamic Sampling , 2016, Computational Imaging.

[21]  Eric Jones,et al.  SciPy: Open Source Scientific Tools for Python , 2001 .

[22]  T. Dahmen,et al.  Sparse and Adaptive Sampling in Scanning Electron Microscopy , 2019, Microscopy and Microanalysis.

[23]  Charles A. Bouman,et al.  A Framework for Dynamic Image Sampling Based on Supervised Learning , 2017, IEEE Transactions on Computational Imaging.

[24]  Lucy Y. Pao,et al.  Non-raster sampling in atomic force microscopy: A compressed sensing approach , 2012, 2012 American Control Conference (ACC).

[25]  Farokh Marvasti,et al.  Adaptive Sparse Image Sampling and Recovery , 2017, IEEE Transactions on Computational Imaging.

[26]  Sean B Andersson,et al.  A continuous sampling pattern design algorithm for atomic force microscopy images. , 2019, Ultramicroscopy.