Rationale Visualization for Safety and Security

In safety and security domains where objects of interest (OOI), such as people, vessels, or transactions, are continuously monitored, automated reasoning is required due to their sheer number and volume of information. We present a method to visually explain the rationale of a reasoning engine that raises an alarm if a certain situation is reached. Based both on evidence from heterogeneous and possibly unreliable sources, and on a domain specific reasoning structure, this engine concludes with a certain probability that, e.g., the OOI is suspected of smuggling. To support decision making, we visualize the rationale, an abstraction of the complicated reasoning structure. The evidence is displayed in a color‐coded matrix that easily reveals if and where observations contradict. In it, domain and operational experts can quickly understand and find complicated patterns and relate them to real‐world situations. Also, two groups of these experts evaluate our system through maritime use cases based on real data.

[1]  Russell G. Almond,et al.  Graphical Explanation in Belief Networks , 1997 .

[2]  Peter Novák,et al.  An Integrated Reconfigurable System for Maritime Situational Awareness , 2014, ECAI.

[3]  Bruce G. Buchanan,et al.  The MYCIN Experiments of the Stanford Heuristic Programming Project , 1985 .

[4]  Peter J. F. Lucas,et al.  A Decision Support Model for Uncertainty Reasoning in Safety and Security Tasks , 2013, 2013 IEEE International Conference on Systems, Man, and Cybernetics.

[5]  D. Legát,et al.  Matrix Visualization , 2005 .

[6]  William S. Cleveland,et al.  Visualizing Data , 1993 .

[7]  Thomas G. Dietterich,et al.  Interacting meaningfully with machine learning systems: Three experiments , 2009, Int. J. Hum. Comput. Stud..

[8]  Arjen Hommersom,et al.  A Probabilistic Logic-based Model for Fusing Attribute Information of Objects Under Surveillance , 2012 .

[9]  Eugene Zhang,et al.  Visualization of Diversity in Large Multivariate Data Sets , 2010, IEEE Transactions on Visualization and Computer Graphics.

[10]  Richard May,et al.  Scalable visual reasoning: Supporting collaboration through distributed analysis , 2007, 2007 International Symposium on Collaborative Technologies and Systems.

[11]  M. Henrion,et al.  Using scenarios to explain probabilistic inference , 1990 .

[12]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[13]  Edward H. Shortliffe,et al.  Rule Based Expert Systems: The Mycin Experiments of the Stanford Heuristic Programming Project (The Addison-Wesley series in artificial intelligence) , 1984 .

[14]  Kathleen Ellen Moffitt,et al.  An empirical test of expert system explanation facility effects on incidental learning and decision-making , 1989 .

[15]  Cynthia A. Brewer,et al.  ColorBrewer.org: An Online Tool for Selecting Colour Schemes for Maps , 2003 .

[16]  Jarke J. van Wijk,et al.  Contour based visualization of vessel movement predictions , 2014, Int. J. Geogr. Inf. Sci..

[17]  Colin Ware,et al.  Information Visualization: Perception for Design , 2000 .

[18]  Herman Chernoff,et al.  The Use of Faces to Represent Points in k- Dimensional Space Graphically , 1973 .

[19]  Gregory F. Cooper,et al.  Hierarchical explanation of inference in Bayesian networks that represent a population of independent agents , 2008, ECAI.

[20]  Chris North,et al.  Semantic Interaction for Sensemaking: Inferring Analytical Reasoning for Model Steering , 2012, IEEE Transactions on Visualization and Computer Graphics.

[21]  Robert Spence Information Visualization: An Introduction , 2014 .

[22]  Marina Velikova,et al.  Metis: An Integrated Reference Architecture for Addressing Uncertainty in Decision-support Systems , 2015 .

[23]  Van Vuuren Jh,et al.  Prerequisites for the design of a maritime law enforcement resource assignment decision support system , 2013 .

[24]  Pierre Dragicevic,et al.  Assessing the Effect of Visualizations on Bayesian Reasoning through Crowdsourcing , 2012, IEEE Transactions on Visualization and Computer Graphics.

[25]  The rationale for RationaleTM , 2007 .

[26]  Tim van Gelder,et al.  The rationale for Rationale , 2007 .

[27]  Hans Wehn,et al.  Maritime situation analysis , 2013, 2013 IEEE International Conference on Intelligence and Security Informatics.

[28]  Peter L. Brooks,et al.  Visualizing data , 1997 .

[29]  Mitsuhiko Toda,et al.  Methods for Visual Understanding of Hierarchical System Structures , 1981, IEEE Transactions on Systems, Man, and Cybernetics.

[30]  G F Cooper,et al.  An evaluation of explanations of probabilistic inference. , 1993, Computers and biomedical research, an international journal.

[31]  Nancy Argüelles,et al.  Author ' s , 2008 .

[32]  Teun Hendriks,et al.  METIS: Dependable Cooperative Systems for Public Safety , 2013, CSER.

[33]  Alfred Inselberg,et al.  Parallel coordinates: a tool for visualizing multi-dimensional geometry , 1990, Proceedings of the First IEEE Conference on Visualization: Visualization `90.