Exploring Stakeholder Value Models via Interactive Visualization

Abstract In the design of complex systems, models can be used to predict a future system's performance as well as approximate stakeholder preferences on performance. This paper examines the problem of model truthfulness and the challenge of trusting models, with a focus on value models and how they are used to predict stakeholder preferences. A framework is proposed for the analysis of these issues (truthfulness and trust), which is used to discuss the relationship between models and decision outcomes. Interactive visualization is proposed as an efficient and effective method for increasing model truthfulness and model trust, and hence making better decisions. An interactive visualization tool is also presented, and an application of the tool to a complex decision case is discussed.

[1]  Jerzy Neyman,et al.  Joint Statistical Papers , 1967 .

[2]  Joseph E. Harrington,et al.  Economics of Regulation and Antitrust, 4th Edition , 2000 .

[3]  Averill M. Law,et al.  Simulation Modeling and Analysis , 1982 .

[4]  J. Neumann,et al.  Theory of games and economic behavior , 1945, 100 Years of Math Milestones.

[5]  Herbert A. Simon,et al.  The Sciences of the Artificial , 1970 .

[6]  B. Fischhoff,et al.  Value elicitation: Is there anything in there? , 1991 .

[7]  J. Vernon,et al.  Economics of regulation and antitrust , 1992 .

[8]  Jerzy Neyman,et al.  The testing of statistical hypotheses in relation to probabilities a priori , 1933, Mathematical Proceedings of the Cambridge Philosophical Society.

[9]  Wolter J. Fabrycky,et al.  Systems engineering and analysis , 1981 .

[10]  A. Tversky,et al.  Choices, Values, and Frames , 2000 .

[11]  A. Copeland.  Book Review: Theory of games and economic behavior , 1945 .

[12]  N. McGlynn.  Thinking fast and slow. , 2014, Australian veterinary journal.

[13]  Hugh McManus,et al.  UNDERSTANDING THE ORBITAL TRANSFER VEHICLE TRADE SPACE , 2003 .

[14]  T. Saaty.  Decision making — the Analytic Hierarchy and Network Processes (AHP/ANP) , 2004 .

[15]  R. L. Keeney,et al.  Decisions with Multiple Objectives: Preferences and Value Trade-Offs , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[16]  E. Rowland.  Theory of Games and Economic Behavior , 1946, Nature.

[17]  Adam M. Ross,et al.  Combining Attributes for Systems of Systems in Multi-Attribute Tradespace Exploration , 2010 .

[18]  A. D. Hall,et al.  Metasystems methodology : a new synthesis and unification , 1989 .

[19]  Matthew Edward Fitzgerald.  Managing uncertainty in systems with a Valuation Approach for Strategic Changeability , 2012 .

[20]  Adam M. Ross,et al.  Five aspects of engineering complex systems emerging constructs and methods , 2010, 2010 IEEE International Systems Conference.

[21]  Genevieve Flanagan,et al.  Key challenges to model-based design : distinguishing model confidence from model validation , 2012 .

[22]  P. Slovic.  The Construction of Preference , 1995 .

[23]  K. Holyoak,et al.  The Cambridge handbook of thinking and reasoning , 2005 .

[24]  John B. Kidd,et al.  Decisions with Multiple Objectives—Preferences and Value Tradeoffs , 1977 .