Sequential information gathering schemes for spatial risk and decision analysis applications

Several risk and decision analysis applications are characterized by spatial elements: there are spatially dependent uncertain variables of interest, decisions are made at spatial locations, and there are opportunities for spatial data acquisition. Spatial dependence implies that the data gathered at one coordinate could inform and assist a decision maker at other locations as well, and one should account for this learning effect when analyzing and comparing information gathering schemes. In this paper, we present concepts and methods for evaluating sequential information gathering schemes in spatial decision situations. Static and sequential information gathering schemes are outlined using the decision theoretic notion of value of information, and we use heuristics for approximating the value of sequential information in large-size spatial applications. We illustrate the concepts using a Bayesian network example motivated from risks associated with CO2 sequestration. We present a case study from mining where there are risks of rock hazard in the tunnels, and information about the spatial distribution of joints in the rocks may lead to a better allocation of resources for choosing rock reinforcement locations. In this application, the spatial variables are modeled by a Gaussian process. In both examples there can be large values associated with adaptive information gathering.

[1]  Rakesh K. Sarin,et al.  Measurable Multiattribute Value Functions , 1979, Oper. Res..

[2]  Warren B. Powell,et al.  Approximate Dynamic Programming - Solving the Curses of Dimensionality , 2007 .

[3]  Sarah E. Gergel,et al.  Collecting Spatial Data at Broad Scales , 2002 .

[4]  Tapan Mukerji,et al.  The Value of Information in Portfolio Problems with Dependent Projects , 2013, Decis. Anal..

[5]  Iain Wright,et al.  In Salah CO2 Storage JIP: CO2 sequestration monitoring and verification technologies applied at Krechba, Algeria , 2011 .

[6]  Ronald A. Howard,et al.  The Foundations of Decision Analysis , 1968, IEEE Trans. Syst. Sci. Cybern..

[7]  Hui Wang,et al.  Bayesian approach to contaminant source characterization in water distribution systems: adaptive sampling framework , 2013, Stochastic Environmental Research and Risk Assessment.

[8]  J. Eidsvik,et al.  Information Gathering in Bayesian Networks Applied to Petroleum Prospecting , 2016, Mathematical Geosciences.

[9]  Herbert H. Einstein,et al.  Decision Analysis Applied to Tunnel Exploration Planning. I: Principles and Case Study , 2007 .

[10]  Don L. Stevens,et al.  Sparse sampling: Spatial design for monitoring stream networks , 2008, 0808.4057.

[11]  Zachary A. Collier,et al.  Value of information analysis: the state of application , 2014, Environment Systems and Decisions.

[12]  Mike Rees,et al.  5. Statistics for Spatial Data , 1993 .

[13]  Barrett W. Thomas,et al.  A rollout algorithm framework for heuristic solutions to finite-horizon stochastic dynamic programs , 2017, Eur. J. Oper. Res..

[14]  James E. Smith,et al.  Optimal Sequential Exploration: Bandits, Clairvoyants, and Wildcats , 2013, Oper. Res..

[15]  Jacek Malczewski,et al.  GIS‐based multicriteria decision analysis: a survey of the literature , 2006, Int. J. Geogr. Inf. Sci..

[16]  Jo Eidsvik,et al.  Dynamic exploration designs for graphical models using clustering with applications to petroleum exploration , 2014, Knowl. Based Syst..

[17]  Andreas Krause,et al.  Submodular Surrogates for Value of Information , 2015, AAAI.

[18]  J. Eidsvik,et al.  The value of information for correlated GLMs , 2017 .

[19]  Allen C Miller,et al.  The Value of Sequential Information , 1975 .

[20]  David Ginsbourger,et al.  Quantifying Uncertainties on Excursion Sets Under a Gaussian Random Field Prior , 2015, SIAM/ASA J. Uncertain. Quantification.

[21]  Warren B. Powell,et al.  “Approximate dynamic programming: Solving the curses of dimensionality” by Warren B. Powell , 2007, Wiley Series in Probability and Statistics.

[22]  J. Eidsvik,et al.  Local and Spatial Joint Frequency Uncertainty and its Application to Rock Mass Characterisation , 2009 .

[23]  Noel A Cressie,et al.  Statistics for Spatio-Temporal Data , 2011 .

[24]  Andreas Krause,et al.  Adaptive Submodularity: Theory and Applications in Active Learning and Stochastic Optimization , 2010, J. Artif. Intell. Res..

[25]  Jo Eidsvik,et al.  Dynamic decision making for graphical models applied to oil exploration , 2012, Eur. J. Oper. Res..

[26]  Howard Raiffa,et al.  Decision analysis: introductory lectures on choices under uncertainty. 1968. , 1969, M.D.Computing.

[27]  Tapan Mukerji,et al.  The Value of Information in Spatial Decision Making , 2010 .

[28]  J. Chilès,et al.  Geostatistics: Modeling Spatial Uncertainty , 1999 .

[29]  J. Eidsvik,et al.  Building Bayesian networks from basin modeling , 2012 .

[30]  Ronald A. Howard,et al.  Information Value Theory , 1966, IEEE Trans. Syst. Sci. Cybern..

[31]  Fumie Yokota,et al.  Value of Information Literature Analysis: A Review of Applications in Health Risk Management , 2004, Medical decision making : an international journal of the Society for Medical Decision Making.

[32]  L. Robin Keller,et al.  Decision Analysis with Geographically Varying Outcomes: Preference Models and Illustrative Applications , 2014, Oper. Res..

[33]  Andreas Krause,et al.  Optimal Value of Information in Graphical Models , 2009, J. Artif. Intell. Res..

[34]  Lars Rosén,et al.  Framework for Value of Information Analysis in Rock Mass Characterization for Grouting Purposes , 2011 .

[35]  W W Daniel,et al.  An introduction to decision analysis. , 1978, The Journal of nursing administration.

[36]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[37]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[38]  Reidar Brumer Bratvold,et al.  Value of Information in the Oil and Gas Industry: Past, Present, and Future , 2009 .

[39]  Tapan Mukerji,et al.  Value of information of seismic amplitude and CSEM resistivity , 2008 .

[40]  Rafael Muñoz-Carpena,et al.  Design of optimal ecosystem monitoring networks: hotspot detection and biodiversity patterns , 2015, Stochastic Environmental Research and Risk Assessment.

[41]  Fumie Yokota,et al.  Value of Information Analysis in Environmental Health Risk Management Decisions: Past, Present, and Future , 2004, Risk analysis : an official publication of the Society for Risk Analysis.

[42]  Noel A Cressie,et al.  Statistics for Spatial Data. , 1992 .

[43]  James V. Zidek,et al.  Statistical Analysis of Environmental Space-Time Processes , 2006 .

[44]  Mathieu Bonneau,et al.  Reinforcement learning-based design of sampling policies under cost constraints in Markov random fields: Application to weed map reconstruction , 2014, Comput. Stat. Data Anal..

[45]  Tapan Mukerji,et al.  Value of Information in the Earth Sciences: Integrating Spatial Modeling and Decision Analysis , 2016 .

[46]  H Raiffa,et al.  Decision Analysis: Introductory Lectures on Choices under Uncertainty. , 1969 .

[47]  Sean R Eddy,et al.  What is dynamic programming? , 2004, Nature Biotechnology.

[48]  Andreas Krause,et al.  Information-Theoretic Regret Bounds for Gaussian Process Optimization in the Bandit Setting , 2009, IEEE Transactions on Information Theory.

[49]  J. Eidsvik,et al.  Bayesian networks for prospect analysis in the North Sea , 2011 .

[50]  J. Eidsvik,et al.  Norges Teknisk-naturvitenskapelige Universitet Information Gathering in Bayesian Networks Information Gathering in Bayesian Networks , 2022 .

[51]  Gianluca Baio,et al.  Bayesian Methods in Health Economics , 2012 .