Markov chain Monte Carlo simulation using the DREAM software package: Theory, concepts, and MATLAB implementation

© 2015 Elsevier Ltd. Bayesian inference has found widespread application and use in science and engineering to reconcile Earth system models with data, including prediction in space (interpolation), prediction in time (forecasting), assimilation of observations and deterministic/stochastic model output, and inference of the model parameters. Bayes theorem states that the posterior probability, p(H|Y~) of a hypothesis, H is proportional to the product of the prior probability, p( H) of this hypothesis and the likelihood, L(H|Y~) of the same hypothesis given the new observations, Y~, or p(H|Y~)∝p(H)L(H|Y~). In science and engineering, H often constitutes some numerical model, ℱ(x) which summarizes, in algebraic and differential equations, state variables and fluxes, all knowledge of the system of interest, and the unknown parameter values, x are subject to inference using the data Y~. Unfortunately, for complex system models the posterior distribution is often high dimensional and analytically intractable, and sampling methods are required to approximate the target. In this paper I review the basic theory of Markov chain Monte Carlo (MCMC) simulation and introduce a MATLAB toolbox of the DiffeRential Evolution Adaptive Metropolis (DREAM) algorithm developed by Vrugt et al. (2008a, 2009a) and used for Bayesian inference in fields ranging from physics, chemistry and engineering, to ecology, hydrology, and geophysics. This MATLAB toolbox provides scientists and engineers with an arsenal of options and utilities to solve posterior sampling problems involving (among others) bimodality, high-dimensionality, summary statistics, bounded parameter spaces, dynamic simulation models, formal/informal likelihood functions (GLUE), diagnostic model evaluation, data assimilation, Bayesian model averaging, distributed computation, and informative/noninformative prior distributions. The DREAM toolbox supports parallel computing and includes tools for convergence analysis of the sampled chain trajectories and post-processing of the results. Seven different case studies illustrate the main capabilities and functionalities of the MATLAB toolbox.

[1]  Benjamin Peirce,et al.  Criterion for the rejection of doubtful observations , 1852 .

[2]  H. Vereecken,et al.  Inverse modelling of in situ soil water dynamics: accounting for heteroscedastic, autocorrelated, and non-Gaussian distributed residuals , 2015 .

[3]  A. C. Hinnell,et al.  Improved extraction of hydrologic information from geophysical data through coupled hydrogeophysical inversion , 2010 .

[4]  George Kuczera,et al.  Pitfalls and improvements in the joint inference of heteroscedasticity and autocorrelation in hydrological model calibration , 2013 .

[5]  Andrew Gelman,et al.  General methods for monitoring convergence of iterative simulations , 1998 .

[6]  Cajo J. F. ter Braak,et al.  Differential Evolution Markov Chain with snooker updater and fewer chains , 2008, Stat. Comput..

[7]  June W. Lau,et al.  Structural and magnetic etch damage in CoFeB , 2014 .

[8]  Johan A. Huisman,et al.  Inversion and sensitivity analysis of Ground Penetrating Radar data with waveguide dispersion using deterministic and Markov Chain Monte Carlo methods , 2011 .

[9]  A. Cleland,et al.  Electron spin resonance of nitrogen-vacancy centers in optically trapped nanodiamonds , 2012, Proceedings of the National Academy of Sciences.

[10]  George Kuczera,et al.  Understanding predictive uncertainty in hydrologic modeling: The challenge of identifying input and structural errors , 2010 .

[11]  David J. Nott,et al.  Generalized likelihood uncertainty estimation (GLUE) and approximate Bayesian computation: What's the connection? , 2012 .

[12]  Henrik Madsen,et al.  Generalized likelihood uncertainty estimation (GLUE) using adaptive Markov Chain Monte Carlo sampling , 2008 .

[13]  E. Toth,et al.  Calibration of hydrological models in the spectral domain: An opportunity for scarcely gauged basins? , 2007 .

[14]  P. Green.  Reversible jump Markov chain Monte Carlo computation and Bayesian model determination , 1995 .

[15]  Arnaud Doucet,et al.  An adaptive sequential Monte Carlo method for approximate Bayesian computation , 2011, Statistics and Computing.

[16]  K M Søndergaard,et al.  [Understanding statistics?]. , 1995, Ugeskrift for laeger.

[17]  J. Vrugt,et al.  Information content of incubation experiments for inverse estimation of pools in the Rothamsted carbon model: a Bayesian perspective , 2009 .

[18]  D. Rubin,et al.  Inference from Iterative Simulation Using Multiple Sequences , 1992 .

[19]  Yuqiong Liu,et al.  Reconciling theory with observations: elements of a diagnostic approach to model evaluation , 2008 .

[20]  Art B Owen,et al.  A quasi-Monte Carlo Metropolis algorithm. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[21]  L. Bauwens,et al.  Estimating and forecasting structural breaks in financial time series , 2011 .

[22]  Amir AghaKouchak,et al.  Entropy–Copula in Hydrology and Climatology , 2014 .

[23]  George Kuczera,et al.  Bayesian analysis of input uncertainty in hydrological modeling: 1. Theory , 2006 .

[24]  Cajo J. F. ter Braak,et al.  Treatment of input uncertainty in hydrologic modeling: Doing hydrology backward with Markov chain Monte Carlo simulation , 2008 .

[25]  A. Rinaldo,et al.  Modelling cholera epidemics: the role of waterways, human mobility and sanitation , 2012, Journal of The Royal Society Interface.

[26]  Johan Alexander Huisman,et al.  Integrated analysis of waveguide dispersed GPR pulses using deterministic and Bayesian inversion methods , 2012 .

[27]  A. Gelman,et al.  Weak convergence and optimal scaling of random walk Metropolis algorithms , 1997 .

[28]  D. Kavetski,et al.  Towards a Bayesian total error analysis of conceptual rainfall-runoff models: Characterising model error using storm-dependent parameters , 2006 .

[29]  Andrew Binley,et al.  GLUE: 20 years on , 2014 .

[30]  C. Robert,et al.  ABC likelihood-free methods for model choice in Gibbs random fields , 2008, 0807.2767.

[31]  Eric Laloy,et al.  Mass conservative three‐dimensional water tracer distribution from Markov chain Monte Carlo inversion of time‐lapse ground‐penetrating radar data , 2012 .

[32]  Christophe Andrieu,et al.  Model criticism based on likelihood-free inference, with an application to protein network evolution , 2009, Proceedings of the National Academy of Sciences.

[33]  Klaus Holliger,et al.  Systematic evaluation of sequential geostatistical resampling within MCMC for posterior sampling of near-surface geophysical inverse problems , 2015 .

[34]  G. Roberts,et al.  Convergence of adaptive direction sampling , 1994 .

[35]  Øyvind Kaste,et al.  Bayesian uncertainty assessment of a semi-distributed integrated catchment model of phosphorus transport. , 2014, Environmental science. Processes & impacts.

[36]  J. Vrugt,et al.  Corruption of accuracy and efficiency of Markov chain Monte Carlo simulation by inaccurate numerical implementation of conceptual hydrologic models , 2010 .

[37]  S. Sorooshian,et al.  A Shuffled Complex Evolution Metropolis algorithm for optimization and uncertainty assessment of hydrologic model parameters , 2002 .

[38]  Christian P. Robert,et al.  Monte Carlo Statistical Methods , 2005, Springer Texts in Statistics.

[39]  Van Genuchten,et al.  A closed-form equation for predicting the hydraulic conductivity of unsaturated soils , 1980 .

[40]  Sanjay Shukla,et al.  Eddy covariance‐based evapotranspiration for a subtropical wetland , 2014 .

[41]  Behnam Jafarpour.  Wavelet Reconstruction of Geologic Facies From Nonlinear Dynamic Flow Measurements , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[42]  Paul Marjoram,et al.  Statistical Applications in Genetics and Molecular Biology Approximately Sufficient Statistics and Bayesian Computation , 2011 .

[43]  Johan Alexander Huisman,et al.  Bayesian model averaging using particle filtering and Gaussian mixture modeling: Theory, concepts, and simulation experiments , 2012 .

[44]  M. Trosset,et al.  Bayesian recursive parameter estimation for hydrologic models , 2001 .

[45]  Albert Tarantola,et al.  Monte Carlo sampling of solutions to inverse problems , 1995 .

[46]  Markus Reichstein,et al.  Modeling the vertical soil organic matter profile using Bayesian parameter estimation , 2012 .

[47]  D. D. Awschalom,et al.  Measurement and Control of Single Nitrogen-Vacancy Center Spins above 600 K , 2012, 1201.4420.

[48]  Xiao-Lin Sun,et al.  Dealing with spatial outliers and mapping uncertainty for evaluating the effects of urbanization on soil: A case study of soil pH and particle fractions in Hong Kong , 2013 .

[49]  M. Gabriela M. Gomes,et al.  A Bayesian Framework for Parameter Estimation in Dynamical Models , 2011, PloS one.

[50]  C. Diks,et al.  Improved treatment of uncertainty in hydrologic modeling: Combining the strengths of global optimization and data assimilation , 2005 .

[51]  Vivek K. Goyal,et al.  Compressed History Matching: Exploiting Transform-Domain Sparsity for Regularization of Nonlinear Dynamic Data Integration Problems , 2010 .

[52]  Xiao-Li Meng,et al.  Simulating Normalizing Constants: From Importance Sampling to Bridge Sampling to Path Sampling , 1998 .

[53]  Martyn P. Clark,et al.  Ensemble Bayesian model averaging using Markov Chain Monte Carlo sampling , 2008 .

[54]  J. Vrugt,et al.  Toward diagnostic model calibration and evaluation: Approximate Bayesian computation , 2013 .

[55]  D. Mallants,et al.  Efficient posterior exploration of a high‐dimensional groundwater model from two‐stage Markov chain Monte Carlo simulation and polynomial chaos expansion , 2013 .

[56]  Taufiquar Khan,et al.  Physically based regularization of hydrogeophysical inverse problems for improved imaging of process‐driven systems , 2013 .

[57]  Jasper A Vrugt,et al.  Improved evolutionary optimization from genetically adaptive multimethod search , 2007, Proceedings of the National Academy of Sciences.

[58]  Huldrych F. Günthard,et al.  Using an Epidemiological Model for Phylogenetic Inference Reveals Density Dependence in HIV Transmission , 2013, Molecular biology and evolution.

[59]  Soroosh Sorooshian,et al.  Model Parameter Estimation Experiment (MOPEX): An overview of science strategy and major results from the second and third workshops , 2006 .

[60]  B. Bates,et al.  A Markov Chain Monte Carlo Scheme for parameter estimation and inference in conceptual rainfall‐runoff modeling , 2001 .

[61]  Chao Yang,et al.  Learn From Thy Neighbor: Parallel-Chain and Regional Adaptive MCMC , 2009 .

[62]  William Chauvenet,et al.  A manual of spherical and practical astronomy , 1891 .

[63]  Nina Buchmann,et al.  Carbon isotope discrimination during branch photosynthesis of Fagus sylvatica: a Bayesian modelling approach. , 2014, Plant, cell & environment.

[64]  Wei Leong Khong,et al.  Enhancement of Markov Chain Monte Carlo Convergence Speed in Vehicle Tracking Using Genetic Operator , 2012, 2012 Fourth International Conference on Computational Intelligence, Modelling and Simulation.

[65]  Vivek K. Goyal,et al.  Transform-domain sparsity regularization for inverse problems in geosciences , 2009, GEOPHYSICS.

[66]  Michael Herbst,et al.  UvA-DARE ( Digital Academic Repository ) Inverse modelling of in situ soil water dynamics : investigating the effect of different prior distributions of the soil hydraulic parameters , 2011 .

[67]  H. Haario,et al.  An adaptive Metropolis algorithm , 2001 .

[68]  D. Cox,et al.  An Analysis of Transformations , 1964 .

[69]  F. E. Grubbs.  Sample Criteria for Testing Outlying Observations , 1950 .

[70]  E. Abt.  Understanding statistics 3 , 2010, Evidence-Based Dentistry.

[71]  J. A. Vrugt,et al.  Distributed Soil Moisture from Crosshole Ground‐Penetrating Radar Travel Times using Stochastic Inversion , 2013, 1701.01634.

[72]  A. Rinaldo,et al.  Reassessment of the 2010–2011 Haiti cholera outbreak and rainfall-driven multiseason projections , 2012, Proceedings of the National Academy of Sciences.

[73]  Q. Duana,et al.  Model Parameter Estimation Experiment (MOPEX): An overview of science strategy and major results from the second and third workshops , 2006 .

[74]  M. Schaap,et al.  Neural network analysis for hierarchical prediction of soil hydraulic properties , 1998 .

[75]  K. Beven,et al.  Bayesian Estimation of Uncertainty in Runoff Prediction and the Value of Data: An Application of the GLUE Approach , 1996 .

[76]  S. Chib.  Marginal Likelihood from the Gibbs Output , 1995 .

[77]  Richard J. Beckman,et al.  A Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output From a Computer Code , 2000, Technometrics.

[78]  Toshichika Iizumi,et al.  Dependency of parameter values of a crop model on the spatial scale of simulation , 2014 .

[79]  Kristofer Davis,et al.  Fast solution of geophysical inversion using adaptive mesh, space-filling curves and wavelet compression , 2011 .

[80]  Bryan A. Tolson,et al.  Uncertainty-based multi-criteria calibration of rainfall-runoff models: a comparative study , 2014, Stochastic Environmental Research and Risk Assessment.

[81]  Hoon Kim,et al.  Monte Carlo Statistical Methods , 2000, Technometrics.

[82]  Adrian F. M. Smith,et al.  Sampling-Based Approaches to Calculating Marginal Densities , 1990 .

[83]  S. Sorooshian,et al.  Stochastic parameter estimation procedures for hydrologie rainfall‐runoff models: Correlated and heteroscedastic error cases , 1980 .

[84]  Elena Volpi,et al.  The stationarity paradigm revisited: Hypothesis testing using diagnostics, summary metrics, and DREAM(ABC) , 2015 .

[85]  M. Schaap,et al.  ROSETTA: a computer program for estimating soil hydraulic parameters with hierarchical pedotransfer functions , 2001 .

[86]  Heikki Haario,et al.  DRAM: Efficient adaptive MCMC , 2006, Stat. Comput..

[87]  Xiao-Li Meng,et al.  SIMULATING RATIOS OF NORMALIZING CONSTANTS VIA A SIMPLE IDENTITY: A THEORETICAL EXPLORATION , 1996 .

[88]  Keith Beven,et al.  A manifesto for the equifinality thesis , 2006 .

[89]  Permalink.  Markov chain Monte Carlo simulation using the DREAM software package: Theory, concepts, and MATLAB implementation , 2015 .

[90]  Dmitri Kavetski,et al.  Ancient numerical daemons of conceptual hydrological modeling: 1. Fidelity and efficiency of time stepping schemes , 2010 .

[91]  George Kuczera,et al.  A limited‐memory acceleration strategy for MCMC sampling in hierarchical Bayesian calibration of hydrological models , 2010 .

[92]  M. Clark,et al.  Ancient numerical daemons of conceptual hydrological modeling: 2. Impact of time stepping schemes on model analysis and prediction , 2010 .

[93]  Andrew Gelman,et al.  Inference from Simulations and Monitoring Convergence , 2011 .

[94]  Jasper A. Vrugt,et al.  Inverse modelling of cloud-aerosol interactions – Part 2: Sensitivity tests on liquid phase clouds using a Markov chain Monte Carlo based simulation approach , 2011 .

[95]  J. A. Vrugt,et al.  Approximate Bayesian Computation in hydrologic modeling: equifinality of formal and informal approaches , 2013 .

[96]  Jasper A. Vrugt,et al.  High‐dimensional posterior exploration of hydrologic models using multiple‐try DREAM(ZS) and high‐performance computing , 2012 .

[97]  David L Masica,et al.  Neutron reflectometry studies of the adsorbed structure of the amelogenin, LRAP. , 2013, The journal of physical chemistry. B.

[98]  Heikki Haario,et al.  Adaptive proposal distribution for random walk Metropolis algorithm , 1999, Comput. Stat..

[99]  Bruce A. Robinson,et al.  Treatment of uncertainty using ensemble methods: Comparison of sequential data assimilation and Bayesian model averaging , 2007 .

[100]  Brandon M. Turner,et al.  Approximate Bayesian computation with differential evolution , 2012 .

[101]  J. Vrugt,et al.  Approximate Bayesian Computation using Markov Chain Monte Carlo simulation: DREAM(ABC) , 2014 .

[102]  Jasper A. Vrugt,et al.  UvA-DARE ( Digital Academic Repository ) DREAM ( D ) : An adaptive Markov chain Monte Carlo simulation algorithm to solve discrete , noncontinuous , and combinatorial posterior parameter estimation problems , 2011 .

[103]  J. Vrugt,et al.  Summary statistics from training images as prior information in probabilistic inversion , 2015, 1701.01376.

[104]  Budiman Minasny,et al.  Confronting uncertainty in model-based geostatistics using Markov Chain Monte Carlo simulation , 2011 .

[105]  Lan Zhang,et al.  Bivariate Rainfall and Runoff Analysis Using Entropy and Copula Theories , 2012, Entropy.

[106]  John Geweke,et al.  Evaluating the accuracy of sampling-based approaches to the calculation of posterior moments , 1991 .

[107]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[108]  J. A. Vrugt,et al.  Towards inverse modeling of cloud-aerosol interactions - Part 1: A detailed response surface analysis , 2011 .

[109]  J. A. Vrugt,et al.  Two-dimensional probabilistic inversion of plane-wave electromagnetic data: Methodology, model constraints and joint inversion with electrical resistivity data , 2014, 1701.02540.

[110]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[111]  D. Higdon,et al.  Accelerating Markov Chain Monte Carlo Simulation by Differential Evolution with Self-Adaptive Randomized Subspace Sampling , 2009 .

[112]  Jasper A. Vrugt,et al.  Multiresponse multilayer vadose zone model calibration using Markov chain Monte Carlo simulation and field water retention data , 2011 .

[113]  J. Rosenthal,et al.  Coupling and Ergodicity of Adaptive Markov Chain Monte Carlo Algorithms , 2007, Journal of Applied Probability.

[114]  W. Nowak,et al.  Model selection on solid ground: Rigorous comparison of nine ways to evaluate Bayesian model evidence , 2014, Water resources research.

[115]  Adrian E. Raftery,et al.  [Practical Markov Chain Monte Carlo]: Comment: One Long Run with Diagnostics: Implementation Strategies for Markov Chain Monte Carlo , 1992 .

[116]  Thomas Baur,et al.  The diel imprint of leaf metabolism on the δ13 C signal of soil respiration under control and drought conditions. , 2011, The New phytologist.

[117]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.

[118]  D. Madigan,et al.  Bayesian Model Averaging for Linear Regression Models , 1997 .

[119]  M. Hooten,et al.  A general science-based framework for dynamical spatio-temporal models , 2010 .

[120]  Walter R. Gilks,et al.  Strategies for improving MCMC , 1995 .

[121]  Cajo J. F. ter Braak,et al.  A Markov Chain Monte Carlo version of the genetic algorithm Differential Evolution: easy Bayesian computing for real parameter spaces , 2006, Stat. Comput..

[122]  George Kuczera,et al.  Bayesian analysis of input uncertainty in hydrological modeling: 2. Application , 2006 .

[123]  Jun S. Liu,et al.  The Multiple-Try Method and Local Optimization in Metropolis Sampling , 2000 .

[124]  A. Raftery,et al.  Using Bayesian Model Averaging to Calibrate Forecast Ensembles , 2005 .

[125]  Hoshin Vijai Gupta,et al.  The soil water characteristic as new class of closed-form parametric expressions for the flow duration curve , 2016 .

[126]  T. Hansen,et al.  Inverse problems with non-trivial priors: efficient solution through sequential Gibbs sampling , 2012, Computational Geosciences.

[127]  Pavan Bhargava,et al.  Phase segregation of sulfonate groups in Nafion interface lamellae, quantified via neutron reflectometry fitting techniques for multi-layered structures. , 2014, Soft matter.

[128]  Eric Laloy,et al.  Probabilistic inference of multi‐Gaussian fields from indirect hydrological data using circulant embedding and dimensionality reduction , 2015 .

[129]  Walter R. Gilks,et al.  Adaptive Direction Sampling , 1994 .

[130]  J. Vrugt,et al.  Probabilistic electrical resistivity tomography of a CO2 sequestration analog , 2014 .

[131]  Brian J. Kirby,et al.  Depth-resolved magnetization reversal in nanoporous perpendicular anisotropy multilayers , 2013 .

[132]  Tyler Smith,et al.  Development of a formal likelihood function for improved Bayesian inference of ephemeral catchments , 2010 .

[133]  Jasper A. Vrugt,et al.  Hydrologic data assimilation using particle Markov chain Monte Carlo simulation: Theory, concepts and applications (online first) , 2012 .

[134]  Ming Ye,et al.  A computer program for uncertainty analysis integrating regression and Bayesian methods , 2014, Environ. Model. Softw..

[135]  Bernard Bodson,et al.  Parameter identification of the STICS crop model, using an accelerated formal MCMC approach , 2014, Environ. Model. Softw..

[136]  Keith Beven,et al.  The future of distributed models: model calibration and uncertainty prediction. , 1992 .

[137]  Jon P. Owejan,et al.  Solid Electrolyte Interphase in Li-Ion Batteries: Evolving Structures Measured In situ by Neutron Reflectometry , 2012 .

[138]  Bruce M. Clemens,et al.  Porous Mg formation upon dehydrogenation of MgH2 thin films , 2011 .

[139]  Markus Reichstein,et al.  Reconciling 14C and minirhizotron‐based estimates of fine‐root turnover with survival functions , 2014 .

[140]  Keith Beven,et al.  Equifinality, data assimilation, and uncertainty estimation in mechanistic modelling of complex environmental systems using the GLUE methodology , 2001 .

[141]  Jasper A. Vrugt,et al.  Significant variation in vegetation characteristics and dynamics from ecohydrological optimality of net carbon profit , 2009 .

[142]  P. Diggle,et al.  Monte Carlo Methods of Inference for Implicit Statistical Models , 1984 .

[143]  A. Raftery,et al.  Estimating Bayes Factors via Posterior Simulation with the Laplace—Metropolis Estimator , 1997 .

[144]  J. Vrugt,et al.  A formal likelihood function for parameter and predictive inference of hydrologic models with correlated, heteroscedastic, and non‐Gaussian errors , 2010 .

[145]  Costas Meghir,et al.  Mismatch, Sorting and Wage Dynamics , 2013 .

[146]  G. Kuczera.  Improved parameter inference in catchment models: 1. Evaluating parameter uncertainty , 1983 .

[147]  F. Gosselin,et al.  Tree species diversity and abundance as indicators of understory diversity in French mountain forests: Variations of the relationship in geographical and ecological space , 2014 .

[148]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[149]  Christopher Holmes,et al.  Bayesian Methods for Nonlinear Classification and Regressing , 2002 .

[150]  Joseph H. A. Guillaume,et al.  Using a parallelized MCMC algorithm in R to identify appropriate likelihood functions for SWAT , 2013, Environ. Model. Softw..

[151]  Q. Kang,et al.  Optimization and uncertainty assessment of strongly nonlinear groundwater models with high parameter dimensionality , 2010 .

[152]  Kristopher L. Kuhlman,et al.  Core‐scale solute transport model selection using Monte Carlo analysis , 2013, 1304.6738.

[153]  Heikki Haario,et al.  Componentwise adaptation for high dimensional MCMC , 2005, Comput. Stat..

[154]  Kenneth W. Harrison,et al.  Quantifying the change in soil moisture modeling uncertainty from remote sensing observations using Bayesian inference techniques , 2012 .

[155]  George Kuczera,et al.  Toward a reliable decomposition of predictive uncertainty in hydrological modeling: Characterizing rainfall errors using conditional simulation , 2011 .

[156]  Cajo J. F. ter Braak,et al.  Equifinality of formal (DREAM) and informal (GLUE) Bayesian approaches in hydrologic modeling? , 2009 .

[157]  P. Whittle,et al.  Estimation and information in stationary time series , 1953 .

[158]  Jeremy Lise,et al.  On-the-Job Search and Precautionary Savings , 2013 .

[159]  Bob B. Buckley,et al.  All-optical control of a solid-state spin using coherent dark states , 2013, Proceedings of the National Academy of Sciences.

[160]  W. K. Hastings,et al.  Monte Carlo Sampling Methods Using Markov Chains and Their Applications , 1970 .

[161]  J. Vrugt,et al.  Inverse Modeling of Subsurface Flow and Transport Properties: A Review with New Developments , 2008 .