Supporting Reasoning with Different Types of Evidence in Intelligence Analysis

The aim of intelligence analysis is to make sense of information that is often conflicting or incomplete, and to weigh competing hypotheses that may explain a situation. This imposes a high cognitive load on analysts, and there are few automated tools to aid them in their task. In this paper, we present an agent-based tool to help analysts in acquiring, evaluating and interpreting information in collaboration with others. Agents assist analysts in reasoning with different types of evidence to identify what happened and why, what is credible, and how to obtain further evidence. Argumentation schemes lie at the heart of the tool, and sensemaking agents assist analysts in structuring evidence and identifying plausible hypotheses. A crowdsourcing agent is used to reason about structured information explicitly obtained from groups of contributors, and provenance is used to assess the credibility of hypotheses based on the origins of the supporting information.

[1]  Chris Reed,et al.  Argumentation Schemes , 2008 .

[2]  P. Pirolli,et al.  Collaborative Intelligence Analysis with CACHE and its Effects on Information Gathering and Cognitive Bias , 2006 .

[3]  Daren C. Brabham.  Crowdsourcing as a Model for Problem Solving , 2008 .

[4]  Javier R. Movellan,et al.  Whose Vote Should Count More: Optimal Integration of Labels from Labelers of Unknown Expertise , 2009, NIPS.

[5]  James Llinas,et al.  Challenges in Information Fusion Technology Capabilities for Modern Intelligence and Security Problems , 2013, 2013 European Intelligence and Security Informatics Conference.

[6]  Richards J. Heuer,et al.  Psychology of Intelligence Analysis , 1999 .

[7]  Yolanda Gil,et al.  PROV-DM: The PROV Data Model , 2013 .

[8]  Chris Reed,et al.  TOAST: Online ASPIC+ implementation , 2012, COMMA.

[9]  Henry Prakken,et al.  Towards a Formal Account of Reasoning about Evidence: Argumentation Schemes and Generalisations , 2003, Artificial Intelligence and Law.

[10]  Audun Jøsang,et al.  Dirichlet Reputation Systems , 2007, The Second International Conference on Availability, Reliability and Security (ARES'07).

[11]  Chris Reed,et al.  Araucaria: Software for Argument Analysis, Diagramming and Representation , 2004, Int. J. Artif. Intell. Tools.

[12]  Simon Buckingham Shum,et al.  Contested Collective Intelligence: Rationale, Technologies, and a Human-Machine Annotation Study , 2012, Computer Supported Cooperative Work (CSCW).

[13]  Elizabeth Sklar,et al.  Argumentation-based reasoning in agents with varying degrees of trust , 2011, AAMAS.

[14]  Mani B. Srivastava,et al.  Argumentation-based collaborative intelligence analysis in CISpaces , 2014, COMMA.

[15]  Katia P. Sycara,et al.  Distributed Intelligent Agents , 1996, IEEE Expert.

[16]  Eric Horvitz,et al.  Combining human and machine intelligence in large-scale crowdsourcing , 2012, AAMAS.

[17]  Henry Prakken,et al.  The ASPIC+ framework for structured argumentation: a tutorial , 2014, Argument Comput..

[18]  Mani B. Srivastava,et al.  Truth Discovery in Crowdsourced Detection of Spatial Events , 2016, IEEE Trans. Knowl. Data Eng..

[19]  Tim van Gelder,et al.  The rationale for Rationale , 2007 .

[20]  Iyad Rahwan,et al.  Laying the foundations for a World Wide Argument Web , 2007, Artif. Intell..

[21]  Mary Czerwinski,et al.  Interactions with big data analytics , 2012, INTR.

[22]  P. Pirolli,et al.  The Sensemaking Process and Leverage Points for Analyst Technology as Identified Through Cognitive Task Analysis , 2007 .

[23]  Phan Minh Dung,et al.  On the Acceptability of Arguments and its Fundamental Role in Nonmonotonic Reasoning, Logic Programming and n-Person Games , 1995, Artif. Intell..

[24]  Floris Bex,et al.  Solving a Murder Case by Asking Critical Questions: An Approach to Fact-Finding in Terms of Argumentation and Story Schemes , 2012 .

[25]  Henry Prakken,et al.  An abstract framework for argumentation with structured arguments , 2010, Argument Comput..

[26]  Nir Oren,et al.  Making Informed Decisions with Provenance and Argumentation Schemes , 2014 .

[27]  Olaf Hartig,et al.  Using Web Data Provenance for Quality Assessment , 2009, SWPM.