Improving in situ data acquisition using training images and a Bayesian mixture model

Estimating the spatial distribution of physical processes using a minimum number of samples is of vital importance in earth science applications where sampling is costly. In recent years, training image-based methods have received a lot of attention for interpolation and simulation. However, training images have never been employed to optimize spatial sampling process. In this paper, a sequential compressive sampling method is presented which decides the location of new samples based on a training image. First, a Bayesian mixture model is developed based on the training patterns. Then, using this model, unknown values are estimated based on a limited number of random samples. Since the model is probabilistic, it allows estimating local uncertainty conditionally to the available samples. Based on this, new samples are sequentially extracted from the locations with maximum uncertainty. Experiments show that compared to a random sampling strategy, the proposed supervised sampling method significantly reduces the number of samples needed to achieve the same level of accuracy, even when the training image is not optimally chosen. The method has the potential to reduce the number of observations necessary for the characterization of environmental processes. HighlightsA training image-based method is developed for sampling design.The method has a sequential nature.New samples are extracted from highly uncertain areas.A Bayesian mixture model is employed for estimating uncertainty values.The method significantly reduced the number of samples required for reconstruction of a field.

[1]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[2]  K. Faez,et al.  Stochastic simulation of patterns using Bayesian pattern modeling , 2013, Computational Geosciences.

[3]  Guillermo Sapiro,et al.  Learning to Sense Sparse Signals: Simultaneous Sensing Matrix and Sparsifying Dictionary Optimization , 2009, IEEE Transactions on Image Processing.

[4]  Peter M. Atkinson,et al.  Defining an optimal size of support for remote sensing investigations , 1995, IEEE Trans. Geosci. Remote. Sens..

[5]  Sebastien Strebelle,et al.  Conditional Simulation of Complex Geological Structures Using Multiple-Point Statistics , 2002 .

[6]  Mohamed S. Kamel,et al.  Kernelized Supervised Dictionary Learning , 2012, IEEE Transactions on Signal Processing.

[7]  Alexandre Boucher,et al.  Geostatistical Solutions for Super-Resolution Land Cover Mapping , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Laure Malherbe,et al.  Optimal spatial design for air quality measurement surveys , 2014 .

[9]  André Stumpf,et al.  Adaptive spatial sampling with active random forest for object-oriented landslide mapping , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[10]  Pierre Goovaerts,et al.  Second-Phase Sampling Designs for Non-Stationary Spatial Variables. , 2009, Geoderma.

[11]  Peter M. Atkinson,et al.  Multiple-point geostatistical simulation for post-processing a remotely sensed land cover classification , 2013 .

[12]  E.J. Candes,et al.  An Introduction To Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[13]  David B. Dunson,et al.  Compressive Sensing on Manifolds Using a Nonparametric Mixture of Factor Analyzers: Algorithm and Performance Bounds , 2010, IEEE Transactions on Signal Processing.

[14]  Kjersti Engan,et al.  Method of optimal directions for frame design , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[15]  G. Heuvelink,et al.  Optimization of sample patterns for universal kriging of environmental variables , 2007 .

[16]  Amit Ashok,et al.  Information optimal Compressive X-ray Threat Detection , 2015 .

[17]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[18]  Gabriel Peyré,et al.  Manifold models for signals and images , 2009, Comput. Vis. Image Underst..

[19]  Jarvis D. Haupt,et al.  Learning sparse representations for adaptive compressive sensing , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[20]  Feng Liu,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries in Wavelet Domain , 2009, 2009 Fifth International Conference on Image and Graphics.

[21]  Mark A Neifeld,et al.  Recognition using information-optimal adaptive feature-specific imaging. , 2009, Journal of the Optical Society of America. A, Optics, image science, and vision.

[22]  J. Caers,et al.  Conditional Simulation with Patterns , 2007 .

[23]  William J. Emery,et al.  Active Learning Methods for Remote Sensing Image Classification , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Chenghu Zhou,et al.  Spatial Sampling Design for Estimating Regional GPP With Spatial Heterogeneities , 2014, IEEE Geoscience and Remote Sensing Letters.

[25]  Tom Dhaene,et al.  Exposure assessment of mobile phone base station radiation in an outdoor environment using sequential surrogate modeling , 2013, Bioelectromagnetics.

[26]  Stéphane Mallat,et al.  Solving Inverse Problems With Piecewise Linear Estimators: From Gaussian Mixture Models to Structured Sparsity , 2010, IEEE Transactions on Image Processing.

[27]  Michael Elad,et al.  Optimized Projections for Compressed Sensing , 2007, IEEE Transactions on Signal Processing.

[28]  Philippe Renard,et al.  Spatiotemporal reconstruction of gaps in multivariate fields using the direct sampling approach , 2012 .

[29]  Guillermo Sapiro,et al.  Nonparametric image interpolation and dictionary learning using spatially-dependent Dirichlet and beta process priors , 2010, 2010 IEEE International Conference on Image Processing.

[30]  Christopher M. Bishop,et al.  Non-linear Bayesian Image Modelling , 2000, ECCV.

[31]  J. Caers,et al.  Stochastic Simulation of Patterns Using Distance-Based Pattern Modeling , 2010 .

[32]  David J. Field,et al.  Sparse coding with an overcomplete basis set: A strategy employed by V1? , 1997, Vision Research.

[33]  R. Muise,et al.  Object Specific Image Reconstruction using a Compressive Sensing Architecture for Application in Surveillance Systems , 2009, IEEE Transactions on Aerospace and Electronic Systems.

[34]  SapiroGuillermo,et al.  Learning to sense sparse signals , 2009 .

[35]  Karim Faez,et al.  Fast direct sampling for multiple-point stochastic simulation , 2014, Arabian Journal of Geosciences.

[36]  Tom Dhaene,et al.  Assessment of outdoor radiofrequency electromagnetic field exposure through hotspot localization using kriging-based sequential sampling. , 2013, Environmental research.

[37]  D. J. Brus,et al.  Random sampling or geostatistical modelling? Choosing between design-based and model-based sampling strategies for soil (with discussion) , 1997 .

[38]  J. W. Groenigen,et al.  Constrained optimisation of soil sampling for minimisation of the kriging variance , 1999 .

[39]  Guillermo Sapiro,et al.  Ieee Transactions on Signal Processing Task-driven Adaptive Statistical Compressive Sensing of Gaussian Mixture Models Ieee Transactions on Signal Processing 2 , 2022 .

[40]  Mohammad J. Abdollahifard,et al.  Fast multiple-point simulation using a data-driven path and an efficient gradient-based search , 2016, Comput. Geosci..

[41]  Charles F. Harvey,et al.  When good statistical models of aquifer heterogeneity go bad: A comparison of flow, dispersion, and mass transfer in connected and multivariate Gaussian hydraulic conductivity fields , 2003 .

[42]  Gerard B. M. Heuvelink,et al.  Sampling design optimization for multivariate soil mapping , 2010 .

[43]  Dara Entekhabi,et al.  Conditioning Stochastic Rainfall Replicates on Remote Sensing Data , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[44]  Emmanuel J. Candès,et al.  On the Fundamental Limits of Adaptive Sensing , 2011, IEEE Transactions on Information Theory.

[45]  Amit Ashok,et al.  Object reconstruction from adaptive compressive measurements in feature-specific imaging. , 2010, Applied optics.

[46]  Lawrence Carin,et al.  Bayesian Compressive Sensing , 2008, IEEE Transactions on Signal Processing.

[47]  Rama Chellappa,et al.  Design of Non-Linear Kernel Dictionaries for Object Recognition , 2013, IEEE Transactions on Image Processing.

[48]  Anthony Griffin,et al.  Compressed sensing of audio signals using multiple sensors , 2008, 2008 16th European Signal Processing Conference.

[49]  Joseph F. Murray,et al.  Dictionary Learning Algorithms for Sparse Representation , 2003, Neural Computation.

[50]  Mohammad J. Abdollahifard,et al.  Reconstruction of binary geological images using analytical edge and object models , 2016, Comput. Geosci..

[51]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[52]  Guillermo Sapiro,et al.  Statistical Compressed Sensing of Gaussian Mixture Models , 2011, IEEE Transactions on Signal Processing.

[53]  CarinLawrence,et al.  Compressive sensing on manifolds using a nonparametric mixture of factor analyzers , 2010 .

[54]  Amit Ashok,et al.  Information optimal compressive sensing: static measurement design. , 2013, Journal of the Optical Society of America. A, Optics, image science, and vision.

[55]  H. Vogel,et al.  On the reconstruction of structural and functional properties in random heterogeneous media , 2011 .

[56]  Laure Malherbe,et al.  Sampling design for air quality measurement surveys: An optimization approach , 2011 .

[57]  Akram Aldroubi,et al.  Sequential adaptive compressed sampling via Huffman codes , 2008, ArXiv.

[58]  Amit Ashok,et al.  Compressive imaging system design using task-specific information. , 2008, Applied optics.

[59]  G. Mariéthoz,et al.  Demonstration of a geostatistical approach to physically consistent downscaling of climate modeling simulations , 2013 .

[60]  D. Allard,et al.  Clustering geostatistical data , 2000 .

[61]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.