Systematic analysis of framing bias in missile defense: Implications toward visualization design

Abstract This paper examines the effects of framing on decision making in a homeland missile defense context across three tasks of varying complexity. Mathematically, each task was modeled as abstractions from a common resource allocation task. Logically, therefore, the effects of framing on human subjects should have been consistent across all the tasks. In the first experiment, a simple lottery was used to determine risk postures in a single-attribute case of missile defense. Results showed that, consistent with Prospect Theory, positive framing promotes risk-averse behavior whereas negative framing promotes risk-seeking behavior. In the second experiment, we used the Analytic Hierarchy Process to determine subject rankings in a multi-attribute case of missile defense. Results suggest that subjects’ performances under positive framing were significantly better than performances under negative framing. In the third experiment, we used a human-in-the-loop simulation to elicit human decisions in a missile defense resource allocation task. In comparison to the other experiments, the framing effect in the third experiment was diminished. We submit that decision biases detected in a simple choice task cannot be assumed to carry over to tasks of greater complexity even if the underlying mathematical formulation for all the tasks is the same. Moreover, we submit that the design of the graphical interface has a greater influence on human judgment bias than framing in tasks of higher complexity.

[1]  A. Tversky,et al.  The framing of decisions and the psychology of choice. , 1981, Science.

[2]  Kim J. Vicente,et al.  Human – computer interface design can reduce misperceptions of feedback , 2000 .

[3]  Kim J. Vicente,et al.  Ecological interface design: theoretical foundations , 1992, IEEE Trans. Syst. Man Cybern..

[4]  Patricia L. McDermott,et al.  The Presentation of Risk and Uncertainty in the Context of National Missile Defense Simulations , 2003 .

[5]  L. J. Savage,et al.  The Foundation of Statistics , 1956 .

[6]  T. Saaty,et al.  The Analytic Hierarchy Process , 1985 .

[7]  Xin Yao,et al.  Co-Evolution in Iterated Prisoner's Dilemma with Intermediate Levels of Cooperation: Application to Missile Defense , 2002, Int. J. Comput. Intell. Appl..

[8]  S. Sunder,et al.  Professional Traders as Intuitive Bayesians , 1995 .

[9]  A. Tversky,et al.  Prospect theory: analysis of decision under risk , 1979 .

[10]  Robert H. Ashton,et al.  Evidence-responsiveness in professional judgment: Effects of positive versus negative evidence and presentation mode , 1990 .

[11]  Thomas E. Nygren,et al.  Framing of Task Performance Strategies: Effects on Performance in a Multiattribute Dynamic Decision Making Environment , 1997, Hum. Factors.

[12]  L. J. Chapman Illusory correlation in observational report. , 1967 .

[13]  H. Simon,et al.  Theories of Decision-Making in Economics and Behavioural Science , 1966 .

[14]  Dean A. Wilkening,et al.  A simple model for calculating ballistic missile defense effectiveness , 2000 .

[15]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[16]  A. Tversky,et al.  Prospect Theory : An Analysis of Decision under Risk Author ( s ) : , 2007 .

[17]  Carol H. Daniel Using models and simulations to visualize NMD C3: lessons learned , 1997, Proceedings International Conference and Workshop on Engineering of Computer-Based Systems.

[18]  Jason R. W. Merrick,et al.  Multiobjective decision analysis of theater missile defense architectures , 2001 .

[19]  B. Fischhoff,et al.  Judged frequency of lethal events , 1978 .

[20]  P. Slovic,et al.  Dominance of accuracy information and neglect of base rates in probability estimation , 1976 .

[21]  E. Brunswik Representative design and probabilistic theory in a functional psychology. , 1955, Psychological review.

[22]  G. Klein,et al.  Decision Making in Action: Models and Methods , 1993 .

[23]  William B. Rouse,et al.  Modeling the dynamics of mental workload and human performance in complex systems , 1993, IEEE Trans. Syst. Man Cybern..

[24]  Arthur D. Fisk,et al.  Supporting Perception in the Service of Dynamic Decision Making , 1996, Hum. Factors.

[25]  Kenneth R Hammond,et al.  Judgement and Decision Making in Dynamic Tasks , 1988 .

[26]  K B Bennett,et al.  Graphical Displays: Implications for Divided Attention, Focused Attention, and Problem Solving , 1992, Human factors.

[27]  R. L. Keeney,et al.  Decisions with Multiple Objectives: Preferences and Value Trade-Offs , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[28]  T. Saaty Fundamentals of Decision Making and Priority Theory With the Analytic Hierarchy Process , 2000 .

[29]  L. Cosmides,et al.  Are humans good intuitive statisticians after all? Rethinking some conclusions from the literature on judgment under uncertainty , 1996, Cognition.

[30]  H. Simon,et al.  A Behavioral Model of Rational Choice , 1955 .

[31]  Bao U. Nguyen,et al.  An engagement model to optimize defense against a multiple attack assuming perfect kill assessment , 1997 .

[32]  P. Wason On the Failure to Eliminate Hypotheses in a Conceptual Task , 1960 .

[33]  Josef Perner,et al.  Framing decisions: Hypothetical and real , 2002 .