Managing the collection of information under uncertainty using information economics

An important element of successful engineering design is the effective management of resources to support design decisions. Design decisions can be thought of as having two phases-a formulation phase and a solution phase. As part of the formulation phase, engineers must decide what information to collect and use to support the design decision. Since information comes at a cost, a cost-benefit tradeoff must be made. Previous work has considered such tradeoffs in cases in which all relevant probability distributions were precisely known. However, engineers frequently must characterize these distributions by gathering sample data during the information collection phase of the decision process. This characterization is crucial in high-risk design problems where uncommon events with severe consequences play a significant role in decisions. In this paper, we introduce the principles of information economics to guide decisions on information collection. We investigate how designers can bound the value of information in the case of distributions with unknown parameters by using imprecise probabilities to characterize the current state of information. We explore the basic performance, subtleties, and limitations of the approach in the context of characterizing the strength of a novel material for the design of a pressure vessel.

[1]  J. Berger Statistical Decision Theory and Bayesian Analysis , 1988 .

[2]  L. J. Savage,et al.  The Foundation of Statistics , 1956 .

[3]  Marc Lieberman,et al.  Introduction to Economics , 1999 .

[4]  Isaac Levi,et al.  Extensions of Expected Utility Theory and Some Limitations of Pairwise Comparisons , 2003, ISIPTA.

[5]  G. Hazelrigg Systems Engineering: An Approach to Information-Based Design , 1996 .

[6]  S. Ferson,et al.  Different methods are needed to propagate ignorance and variability , 1996 .

[7]  P. Walley Statistical Reasoning with Imprecise Probabilities , 1990 .

[8]  Michael Grüninger,et al.  Ontologies for Integrating Engineering Applications , 2001, J. Comput. Inf. Sci. Eng..

[9]  Robert C. Williamson,et al.  Probabilistic arithmetic. I. Numerical methods for calculating convolutions and dependency bounds , 1990, Int. J. Approx. Reason..

[10]  B. D. Finetti,et al.  Foresight: Its Logical Laws, Its Subjective Sources , 1992 .

[11]  Scott Ferson,et al.  Probability bounds analysis , 1998 .

[12]  Jacob Marschak,et al.  Economic Information, Decision, and Prediction , 1974 .

[13]  Z. Kmietowicz,et al.  Decision theory, linear partial information and statistical dominance , 1984 .

[14]  Z. W. Kmietowicz,et al.  Decision Theory and Incomplete Knowledge , 1981 .

[15]  Alice M. Agogino,et al.  An Intelligent Real Time Design Methodology for Component Selection: An Approach to Managing Uncertainty , 1994 .

[16]  Ram D. Sriram,et al.  The Role of Knowledge in Next-generation Product Development Systems , 2001, J. Comput. Inf. Sci. Eng..

[17]  Averill M. Law,et al.  Simulation Modeling and Analysis , 1982 .

[18]  W. Warmuth De Finetti, B.: Theory of Probability - A Critical Introductory Treatment, Volume 2. John Wiley & Sons, London-New York-Sydney-Toronto 1975. XIV, 375 S., £ 10.50 , 1977 .

[19]  S Kafandaris,et al.  The Economic Value of Information , 2001, J. Oper. Res. Soc..

[20]  James E. Matheson,et al.  The Economic Value of Analysis and Computation , 1968, IEEE Trans. Syst. Sci. Cybern..

[21]  Robert M. Hayes Information Economics and policy in the U.S.: by Michael Rogers Rubin. Littleton, Colorado: Libraries Unlimited, Inc., 1983. 340 pp. $35.00 (U.S.); $42.00 (elsewhere). ISBN 0-87287-378-1. LC 83-17498 , 1984 .

[22]  C. Paredis,et al.  The Value of Using Imprecise Probabilities in Engineering Design , 2006 .

[23]  Ronald A. Howard,et al.  Bayesian Decision Models for System Engineering , 1965, IEEE Trans. Syst. Sci. Cybern..

[24]  Satyandra K. Gupta,et al.  Estimating the Optimal Number of Alternatives to Be Explored in Large Design Spaces: A Step Towards Incorporating Decision Making Cost in Design Decision Models , 2002 .

[25]  Jason Matthew Aughenbaugh,et al.  APPLYING INFORMATION ECONOMICS AND IMPRECISE PROBABILITIES TO DATA COLLECTION IN DESIGN , 2005 .

[26]  Alan C. Stockman Introduction to Economics , 1995 .

[27]  Daniel A. McAdams,et al.  A Methodology for Model Selection in Engineering Design , 2005 .

[28]  M Cliff Joslyn and Jane Booker,et al.  Generalized Information Theory for Engineering Modeling and Simulation , 2004 .

[29]  Bipin Chadha,et al.  The business community adopted process based metho gies in the early 1990 ’ s through the work of , 2001 .

[30]  Amy Sundermier,et al.  Interconnection of Distributed Components: An Overview of Current Middleware Solutions , 2001, J. Comput. Inf. Sci. Eng..

[31]  Hisashi Kobayashi,et al.  Modeling and analysis , 1978 .

[32]  Rakesh K. Sarin,et al.  ELICITATION OF SUBJECTIVE PROBABILITIES IN THE CONTEXT OF DECISION-MAKING * , 1978 .

[33]  Thomas Müller-Bohn,et al.  Cost-Benefit Analysis , 2015 .

[34]  Jacob Marschak,et al.  Economic information, decision, and prediction : selected essays , 1974 .

[35]  Ronald A. Howard,et al.  Information Value Theory , 1966, IEEE Trans. Syst. Sci. Cybern..

[36]  K. Vind A foundation for statistics , 2003 .

[37]  Deborah L Thurston,et al.  Subjective design evaluation with multiple attributes , 1990 .

[38]  Judy M. Vance,et al.  Assessment of VR Technology and its Applications to Engineering Problems , 2001, J. Comput. Inf. Sci. Eng..

[39]  Robert L. Winkler,et al.  Uncertainty in probabilistic risk assessment , 1996 .