A Functional Model of Sensemaking in a Neurocognitive Architecture

Sensemaking is the active process of constructing a meaningful representation (i.e., making sense) of some complex aspect of the world. In relation to intelligence analysis, sensemaking is the act of finding and interpreting relevant facts amongst the sea of incoming reports, images, and intelligence. We present a cognitive model of core information-foraging and hypothesis-updating sensemaking processes applied to complex spatial probability estimation and decision-making tasks. While the model was developed in a hybrid symbolic-statistical cognitive architecture, its correspondence to neural frameworks in terms of both structure and mechanisms provided a direct bridge between rational and neural levels of description. Compared against data from two participant groups, the model correctly predicted both the presence and degree of four biases: confirmation, anchoring and adjustment, representativeness, and probability matching. It also favorably predicted human performance in generating probability distributions across categories, assigning resources based on these distributions, and selecting relevant features given a prior probability distribution. This model provides a constrained theoretical framework describing cognitive biases as arising from three interacting factors: the structure of the task environment, the mechanisms and limitations of the cognitive architecture, and the use of strategies to adapt to the dual constraints of cognition and the environment.

[1]  D. Ja,et al.  Scales for perceived egocentric distance in a large open field: comparison of three psychophysical methods. , 1985 .

[2]  Walter Warwick,et al.  A Comparative Approach to Understanding General Intelligence: Predicting Cognitive Performance in an Open-ended Dynamic Task , 2009 .

[3]  K. Holyoak,et al.  The Cambridge handbook of thinking and reasoning , 2005 .

[4]  Ralph Norman Haber,et al.  Visual angle as a determinant of perceived interobject distance , 1993, Perception & psychophysics.

[5]  Valerie L. Shalin,et al.  Cognitive task analysis , 2000 .

[6]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[7]  S. Kosslyn Image and Brain: The Resolution of the Imagery Debate , 1994, Journal of Cognitive Neuroscience.

[8]  G. Ryle,et al.  The concept of mind. , 2004, The International journal of psycho-analysis.

[9]  D Marr,et al.  Simple memory: a theory for archicortex. , 1971, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[10]  J A Da Silva,et al.  Scales for perceived egocentric distance in a large open field: comparison of three psychophysical methods. , 1985, The American journal of psychology.

[11]  J. Klayman,et al.  Confirmation, Disconfirmation, and Informa-tion in Hypothesis Testing , 1987 .

[12]  Richards J. Heuer,et al.  Psychology of Intelligence Analysis , 1999 .

[13]  G. Kane Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol 1: Foundations, vol 2: Psychological and Biological Models , 1994 .

[14]  Gregorio Convertino,et al.  Collaborative Intelligence Analysis with CACHE : Bias Reduction and Information Coverage , 2006 .

[15]  M. Posner,et al.  Perceived distance and the classification of distorted patterns. , 1967, Journal of experimental psychology.

[16]  Elton H. Matsushima,et al.  Visual angle as determinant factor for relative distance perception , 2005 .

[17]  Christian Lebiere,et al.  Cognition and Multi-Agent Interaction: From Cognitive Modeling to Social Simulation , 2006 .

[18]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[19]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[20]  John R. Anderson,et al.  Error Modeling in the ACT-R Production System , 2019, Proceedings of the Sixteenth Annual Conference of the Cognitive Science Society.

[21]  John R. Anderson,et al.  Rules of the Mind , 1993 .

[22]  Alexander Klippel,et al.  Pictorial Representations of Routes: Chunking Route Segments during Comprehension , 2003, Spatial Cognition.

[23]  John R. Anderson,et al.  SAL: an explicitly pluralistic cognitive architecture , 2008, J. Exp. Theor. Artif. Intell..

[24]  Paul E. Lehner,et al.  Expert decision-making in evolving situations , 1989, IEEE Trans. Syst. Man Cybern..

[25]  Christian Lebiere,et al.  Constraining Bayesian Inference with Cognitive Architectures: An Updated Associative Learning Mechanism in ACT-R , 2013, CogSci.

[26]  N. Epley,et al.  The Anchoring-and-Adjustment Heuristic , 2006, Psychological science.

[27]  H A Simon,et al.  How Big Is a Chunk? , 1974, Science.

[28]  D. Medin,et al.  Decision making from a cognitive perspective , 1995 .

[29]  Stuart K. Card,et al.  The cost structure of sensemaking , 1993, INTERCHI.

[30]  Brenda Dervin,et al.  From the mind’s eye of the user: The sense-making qualitative-quantitative methodology. , 1992 .

[31]  R. Nickerson Confirmation Bias: A Ubiquitous Phenomenon in Many Guises , 1998 .

[32]  Michael K. Martin,et al.  Instance-Based Decision Making Model of Repeated Binary Choice , 2007 .

[33]  W. Wiest,et al.  Stevens's exponent for psychophysical scaling of perceived, remembered, and inferred distance. , 1985, Psychological bulletin.

[34]  P. Wason On the Failure to Eliminate Hypotheses in a Conceptual Task , 1960 .

[35]  Paul E. Lehner,et al.  Confirmation Bias in Complex Analyses , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[36]  P. Pirolli,et al.  The Sensemaking Process and Leverage Points for Analyst Technology as Identified Through Cognitive Task Analysis , 2007 .

[37]  R. Hutton,et al.  Applied cognitive task analysis (ACTA): a practitioner's toolkit for understanding cognitive task demands. , 1998, Ergonomics.

[38]  F. Gregory Ashby,et al.  Complex decision rules in categorization : contrasting novice and experienced performance , 1992 .

[39]  Peter Pirolli,et al.  Information Foraging , 2009, Encyclopedia of Database Systems.

[40]  F. Gregory Ashby,et al.  Complex decision rules in categorization : contrasting novice and experienced performance , 1992 .

[41]  J. Klayman Varieties of Confirmation Bias , 1995 .

[42]  John R. Anderson,et al.  The Role of the Basal Ganglia - Anterior Prefrontal Circuit as a Biological Instruction Interpreter , 2010, BICA.

[43]  Christian Lebiere,et al.  The dynamics of cognition: An ACT-R model of cognitive arithmetic , 1999, Kognitionswissenschaft.

[44]  C. Wickens Engineering psychology and human performance, 2nd ed. , 1992 .

[45]  K. Fernow New York , 1896, American Potato Journal.

[46]  David Reitter Metacognition and Multiple Strategies in a Cognitive Model of Online Control , 2010, J. Artif. Gen. Intell..

[47]  John R. Anderson,et al.  A Connectionist Implementation of the ACT-R Production System , 2008 .

[48]  John R. Anderson,et al.  Modeling paradigms in ACT-R , 2006 .

[49]  Gary Klein,et al.  Making Sense of Sensemaking 2: A Macrocognitive Model , 2006, IEEE Intelligent Systems.

[50]  Pieter R Roelfsema,et al.  Surfing the attentional waves during visual curve tracing: evidence from the sustained posterior contralateral negativity. , 2011, Psychophysiology.

[51]  John R Anderson,et al.  An integrated theory of the mind. , 2004, Psychological review.

[52]  Walter C. Gogel,et al.  A two-process theory of the response to size and distance , 1987, Perception & Psychophysics.

[53]  G. A. Miller THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[54]  Alvin E. Roth,et al.  A choice prediction competition: Choices from experience and from description , 2010 .

[55]  Elton H. Matsushima,et al.  One-Dimensional and Multi-Dimensional Studies of the Exocentric Distance Estimates in Frontoparallel Plane, Virtual Space, and Outdoor Open Field , 2006, The Spanish Journal of Psychology.

[56]  Seth A. Herd,et al.  The Leabra Cognitive Architecture: How to Play 20 Principles with Nature and Win! , 2012 .

[57]  Susan G. Hutchins,et al.  Section 1, What Makes Intelligence Analysis Difficult? A Cognitive Task Analysis of Intelligence Analysts , 2007 .

[58]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[59]  D. Wallach,et al.  Conscious and unconscious knowledge: Mapping to the symbolic and subsymbolic levels of a hybrid architecture , 2003 .

[60]  Cleotilde Gonzalez,et al.  Instance-based learning in dynamic decision making , 2003, Cogn. Sci..

[61]  John R. Anderson The Adaptive Character of Thought , 1990 .

[62]  Richard Reviewer-Granger Unified Theories of Cognition , 1991, Journal of Cognitive Neuroscience.

[63]  Gary Klein,et al.  Making Sense of Sensemaking 1: Alternative Perspectives , 2006, IEEE Intelligent Systems.

[64]  John R. Anderson How Can the Human Mind Occur in the Physical Universe , 2007 .

[65]  D. Kahneman,et al.  A model of heuristic judgment , 2005 .

[66]  John R. Anderson Acquisition of cognitive skill. , 1982 .

[67]  Kevin Burns,et al.  Integrated Cognitive-neuroscience Architectures for Understanding Sensemaking (ICArUS): A Computational Basis for ICArUS Challenge Problem Design , 2014 .

[68]  C. Lebiere,et al.  The Atomic Components of Thought , 1998 .

[69]  K. Burns,et al.  Mental Models and Normal Errors , 2000 .