Inference in the Wild: A Framework for Human Situation Assessment and a Case Study of Air Combat

Situation awareness is a key construct in human factors and arises from a process of situation assessment (SA). SA comprises the perception of information, its integration with existing knowledge, the search for new information, and the prediction of the future state of the world, including the consequences of planned actions. Causal models implemented as Bayesian networks (BNs) are attractive for modeling all of these processes within a single, unified framework. We elicited declarative knowledge from two Royal Australian Air Force (RAAF) fighter pilots about the information sources used in the identification (ID) of airborne entities and the causal relationships between these sources. This knowledge was represented in a BN (the declarative model) that was evaluated against the performance of 19 RAAF fighter pilots in a low-fidelity simulation. Pilot behavior was well predicted by a simple associative model (the behavioral model) with only three attributes of ID. Search for information by pilots was largely compensatory and was near-optimal with respect to the behavioral model. The average revision of beliefs in response to evidence was close to Bayesian, but there was substantial variability. Together, these results demonstrate the value of BNs for modeling human SA.

[1]  Gerd Gigerenzer,et al.  Heuristic decision making. , 2011, Annual review of psychology.

[2]  Amy Perfors,et al.  Bayesian Models of Cognition Revisited: Setting Optimality Aside and Letting Data Drive Psychological Theory , 2017, Psychological review.

[3]  B. Love,et al.  The myth of computational level theory and the vacuity of rational analysis , 2011, Behavioral and Brain Sciences.

[4]  Denis Cousineau,et al.  Confidence intervals in within-subject designs: A simpler solution to Loftus and Masson's method , 2005 .

[5]  Edwin Hutchins.  How a Cockpit Remembers Its Speeds , 1995 .

[6]  J. Bain,et al.  PSYCHOLOGICAL SCIENCE Research Article How Many Variables Can Humans Process? , 2022 .

[7]  Mica R. Endsley,et al.  Measurement of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[8]  Benjamin M. Rottman,et al.  Reasoning about causal relationships: Inferences on causal networks. , 2014, Psychological bulletin.

[9]  S. Sloman,et al.  Decision makers conceive of their choices as interventions. , 2009, Journal of experimental psychology. General.

[10]  John K. Kruschke,et al.  The Cambridge Handbook of Computational Psychology: Models of Categorization , 2008 .

[11]  David M. Sobel,et al.  A theory of causal learning in children: causal maps and Bayes nets. , 2004, Psychological review.

[12]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[13]  Ulrich Hoffrage,et al.  Inferences under time pressure: how opportunity costs affect strategy selection. , 2008, Acta psychologica.

[14]  W. Edwards,et al.  Conservatism in a simple probability inference task. , 1966, Journal of experimental psychology.

[15]  Gerd Gigerenzer,et al.  How to Improve Bayesian Reasoning Without Instruction: Frequency Formats , 1995 .

[16]  B. Newell,et al.  Search strategies in decision making: the success of “success” , 2004 .

[17]  John R. Anderson,et al.  The Adaptive Nature of Human Categorization. , 1991 .

[18]  S. Sloman,et al.  Causality in thought. , 2015, Annual review of psychology.

[19]  S. Sloman,et al.  The causal psycho-logic of choice , 2006, Trends in Cognitive Sciences.