Supporting Representation Management in Intelligence Analysis through Automated Decision Aids

Intelligence analysts—overloaded with complex and disparate data—must incorporate information into cohesive and convincing narratives and explanations. For analysts, data overload can result in developing premature conclusions and limit their ability to effectively conduct comprehensive analyses. Historically, automated decision aids designed to help with these processes have largely failed analysts in managing a fundamental work tradeoff between analytic narrowing and broadening because software tools too often attempt to supplant analyst reasoning, rather than support the iterative process as a whole. Instead of such brittle approaches, previous research suggests analysts would benefit from automation that supports a collaborative partnership throughout the analysis process. The research and development described in this work began with a cognitive analysis of practicing analysts, entailing literature review, interviews, and walkthroughs with a software prototype. Findings from the cognitive analysis were translated into design requirements for decision aids that support representation management across multiple intelligence products. The findings provide insight into under-supported cognitive and collaborative work in modern intelligence analysis with implications for the future design of useful automated decision aids.

[1]  Emilie M. Roth,et al.  Using Cognitive Task Analysis (CTA) to Seed Design Concepts for Intelligence Analysts Under Data Overload , 2001 .

[2]  Michael Farry,et al.  The Mutual Support Function Model , 2011 .

[3]  Emily S. Patterson,et al.  Challenges for Cognition in Intelligence Analysis , 2007 .

[4]  Emilie M. Roth,et al.  Predicting Vulnerabilities in Computer-Supported Inferential Analysis under Data Overload , 2001, Cognition, Technology & Work.

[5]  Ann M. Bisantz,et al.  Analysis of Cognitive Work , 2007 .

[6]  Jiajie Zhang,et al.  Representations in Distributed Cognitive Tasks , 1994, Cogn. Sci..

[7]  William C. Elm,et al.  Finding Decision Support Requirements for Effective Intelligence Analysis Tools , 2005 .

[8]  Emily S. Patterson,et al.  Team Cognition in Intelligence Analysis , 2007 .

[9]  Anne-Claire Boury-Brisset,et al.  Managing Semantic Big Data for Intelligence , 2013, STIDS.

[10]  Sean Guarino,et al.  Framing and Contextualizing Information Requests: Problem Formulation as Part of the Intelligence Analysis Process , 2010 .

[11]  John B. Black,et al.  Scripts in memory for text , 1979, Cognitive Psychology.

[12]  R. Nickerson Confirmation Bias: A Ubiquitous Phenomenon in Many Guises , 1998 .

[13]  Keith J Holyoak,et al.  Pragmatic reasoning schemas , 1985, Cognitive Psychology.

[14]  P. Feltovich,et al.  Issues of expert flexibility in contexts characterized by complexity and change , 1997 .

[15]  Emilie M. Roth,et al.  Can We Ever Escape from Data Overload? A Cognitive Systems Diagnosis , 1999, Cognition, Technology & Work.

[16]  Emilie M. Roth,et al.  Modeling human reasoning about meta-information , 2009, Int. J. Approx. Reason..

[17]  Paul J. Feltovich,et al.  Common Ground and Coordination in Joint Activity , 2005 .