The importance of visualization and interaction in the anomaly detection process

Large volumes of heterogeneous data from multiple sources need to be analyzed during the surveillance of large sea, air, and land areas. Timely detection and identification of anomalous behavior or any threat activity is an important objective for enabling homeland security. While it is worth acknowledging that many existing mining applications support identification of anomalous behavior, autonomous anomaly detection systems for area surveillance are rarely used in the real world since these capabilities and applications present two critical challenges: they need to provide adequate user support and they need to involve the user in the underlying detection process. Visualization and interaction play a crucial role in providing adequate user support and involving the user in the detection process. Therefore, this chapter elaborates on the role of visualization and interaction in the anomaly detection process, using the surveillance of sea areas as a case study. After providing a brief description of how operators identify conflict traffic situations and anomalies, the anomaly detection problem is characterized from a data mining point of view, suggesting how operators may enhance the process through visualization and interaction. Maria Riveiro Informatics Research Centre, University of Skövde, Skövde, Sweden

[1]  Stefan Axelsson,et al.  Understanding Intrusion Detection Through Visualization , 2006, Advances in Information Security.

[2]  Yang Cai,et al.  Interactive Visualization of Network Anomalous Events , 2009, ICCS.

[3]  Finn Verner Jensen,et al.  Sensitivity Analysis in Bayesian Networks , 1995, ECSQARU.

[4]  Florian Mansmann,et al.  Visual analysis of network traffic: interactive monitoring, detection, and interpretation of security threats , 2008 .

[5]  V. Kharchenko,et al.  Application of the intellectual decision making system for vessel traffic control , 2002, 14th International Conference on Microwaves, Radar and Wireless Communications. MIKON - 2002. Conference Proceedings (IEEE Cat.No.02EX562).

[6]  Tom Ziemke,et al.  VISAD: an interactive and visual analytical tool for the detection of behavioral anomalies in maritime traffic data , 2009, Defense + Commercial Sensing.

[7]  Lars Niklasson,et al.  Trajectory clustering for coastal surveillance , 2007, 2007 10th International Conference on Information Fusion.

[8]  Tom Ziemke,et al.  Improving maritime anomaly detection and situation awareness through interactive visualization , 2008, 2008 11th International Conference on Information Fusion.

[9]  Georges G. Grinstein,et al.  Visualization for enhancing the data mining process , 2001, SPIE Defense + Commercial Sensing.

[10]  Shalin Hai-Jew,et al.  Packaging Digital Information for Enhanced Learning and Analysis: Data Visualization, Spatialization, and Multidimensionality , 2013 .

[11]  B.J. Rhodes,et al.  Maritime situation monitoring and awareness using learning mechanisms , 2005, MILCOM 2005 - 2005 IEEE Military Communications Conference.

[12]  Daniel A. Keim,et al.  Information Visualization and Visual Data Mining , 2002, IEEE Trans. Vis. Comput. Graph..

[13]  Jung-Min Park,et al.  An overview of anomaly detection techniques: Existing solutions and latest technological trends , 2007, Comput. Networks.

[14]  Chris North,et al.  Workshop report: information visualization-human-centered issues in visual representation, interaction, and evalution , 2007 .

[15]  Allen M. Waxman,et al.  Cognitively-Inspired Motion Pattern Learning & Analysis Algorithms for Higher-Level Fusion and Automated Scene Understanding , 2007, MILCOM 2007 - IEEE Military Communications Conference.

[16]  Egils Sviestins,et al.  Rule-based situation assessment for sea surveillance , 2006, SPIE Defense + Commercial Sensing.

[17]  James B. Kraiman,et al.  Automated anomaly detection processor , 2002, SPIE Defense + Commercial Sensing.

[18]  Ali A. Ghorbani,et al.  A novel visualization technique for network anomaly detection , 2004, PST.

[19]  Jean Roy,et al.  Anomaly detection in the maritime domain , 2008, SPIE Defense + Commercial Sensing.

[20]  F. Johansson,et al.  Detection of vessel anomalies - a Bayesian network approach , 2007, 2007 3rd International Conference on Intelligent Sensors, Sensor Networks and Information.

[21]  Allen M. Waxman,et al.  Associative Learning of Vessel Motion Patterns for Maritime Situation Awareness , 2006, 2006 9th International Conference on Information Fusion.

[22]  George H. John Enhancements to the data mining process , 1997 .

[23]  Jarke J. van Wijk,et al.  Eurographics/ Ieee-vgtc Symposium on Visualization 2009 Visualization of Vessel Movements , 2022 .

[24]  Göran Falkman,et al.  Anomaly detection in sea traffic - A comparison of the Gaussian Mixture Model and the Kernel Density Estimator , 2009, 2009 12th International Conference on Information Fusion.

[25]  Bradley J. Rhodes,et al.  Probabilistic associative learning of vessel motion patterns at multiple spatial scales for maritime situation awareness , 2007, 2007 10th International Conference on Information Fusion.

[26]  Anil Aggarwal,et al.  Managing Big Data Integration in the Public Sector , 2015 .

[27]  Xiujun Ma,et al.  Space-Time Behavior Survey for Smart Travel Planning in Beijing, China , 2014 .

[28]  Amir A. Khwaja Modeling Big Data Analytics with a Real-Time Executable Specification Language , 2015 .

[29]  Michael Bosse,et al.  SeeCoast port surveillance , 2006, SPIE Defense + Commercial Sensing.

[30]  Kwan-Liu Ma,et al.  Combining visual and automated data mining for near-real-time anomaly detection and analysis in BGP , 2004, VizSEC/DMSEC '04.

[31]  Daniel A. Keim,et al.  Visual analytics: how much visualization and how much analytics? , 2010, SKDD.

[32]  Penny Rheingans,et al.  Visualizing high-dimensional predictive model quality , 2000 .

[33]  Mark R. Morelande,et al.  Statistical analysis of motion patterns in AIS Data: Anomaly detection and motion prediction , 2008, 2008 11th International Conference on Information Fusion.

[34]  Tomoharu Iwata,et al.  Visualisation of Anomaly Using Mixture Model , 2004, KES.

[35]  Rikard Laxhammar,et al.  Anomaly detection for sea surveillance , 2008, 2008 11th International Conference on Information Fusion.

[36]  Maria Riveiro,et al.  Explanation Methods for Bayesian Networks : review and application to a maritime scenario , 2009 .

[37]  Dario Bruzzese,et al.  Visual Mining of Association Rules , 2008, Visual Data Mining.

[38]  Robert Gibson,et al.  Utilizing Augmented Reality in Library Information Search , 2014 .

[39]  Urska Demsar,et al.  Data mining of geospatial data: combining visual and automatic methods , 2006 .