Modeling of Expert Knowledge for Maritime Situation Assessment

In today’s surveillance systems, there is a need for enhancing the situation awareness of an operator. Supporting the situation assessment process can be done by extending the system with a module for automatic interpretation of the observed environment. In this article, the information flow in intelligent surveillance systems is described and a detailed modeling of the situation assessment process is presented. The main contribution of this article is a probabilistic modeling of situations of interest. The result of this modeling is a Situational Dependency Network (SDN), which represents the dependencies between several situations of different abstraction levels. The focus is on a top-down approach, i.e., the modeling is done in a human-understandable way and can be done by maritime experts. As especially critical situations can change very fast in their characteristics and also they do not happen very often, the machine learning approach is not appropriate for detecting such situations, even if they are very powerful. Therefore, we present an approach, where expert knowledge can be included into a Dynamic Bayesian Network (DBN). In this article, we will show how a DBN can be generated automatically from the SDN. We mainly focus on the determination of the parameters of the model, as this is the crucial point. The resulting DBN can then be applied to vessel tracks and the probability of the modeled situations of interest can be inferred over time. Finally, we present an example in the maritime domain and show that the probabilistic model yields the expected results. Keywords—surveillance system; situation awareness; situation assessment; data fusion; dynamic Bayesian networks; probabilistic reasoning.

[1]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[2]  Paulo Cesar G. da Costa,et al.  Modeling a probabilistic ontology for Maritime Domain Awareness , 2011, 14th International Conference on Information Fusion.

[3]  Alan N. Steinberg,et al.  Revisions to the JDL data fusion model , 1999, Defense, Security, and Sensing.

[4]  Giovanni Pilato,et al.  Integration of Ontologies and Bayesian Networks for Maritime Situation Awareness , 2012, 2012 IEEE Sixth International Conference on Semantic Computing.

[5]  Ronnie Johansson,et al.  Multiple sensor fusion for effective abnormal behaviour detection in counter-piracy operations , 2010, 2010 International WaterSide Security Conference.

[6]  Jürgen Beyerer,et al.  Defining dynamic Bayesian networks for probabilistic situation assessment , 2012, 2012 15th International Conference on Information Fusion.

[7]  J. Beyerer,et al.  Acceptance of automatic situation assessment in surveillance systems , 2012, 2012 IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision Support.

[8]  Kathryn B. Laskey,et al.  Bayesian semantics for the semantic web , 2005 .

[9]  Wolfram Burgard,et al.  Probabilistic situation recognition for vehicular traffic scenarios , 2009, 2009 IEEE International Conference on Robotics and Automation.

[10]  Paulo Cesar G. da Costa,et al.  PR-OWL 2 Case Study: A Maritime Domain Probabilistic Ontology , 2011, STIDS.

[11]  Max Krüger,et al.  A generic Bayesian Network for identification and assessment of objects in maritime surveillance , 2012, 2012 15th International Conference on Information Fusion.

[12]  Mieczyslaw M. Kokar,et al.  Situation Awareness and Cognitive Modeling , 2012, IEEE Intelligent Systems.

[13]  Mieczyslaw M. Kokar,et al.  Ontology-based situation awareness , 2009, Inf. Fusion.

[14]  Jean Roy,et al.  Exploitation of maritime domain ontologies for anomaly detection and threat analysis , 2010, 2010 International WaterSide Security Conference.

[15]  Kevin P. Murphy,et al.  Machine learning - a probabilistic perspective , 2012, Adaptive computation and machine learning series.

[16]  Uwe D. Hanebeck,et al.  Data association in a world model for autonomous systems , 2010, 2010 IEEE Conference on Multisensor Fusion and Integration.

[17]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[18]  Michael Arens,et al.  Automatic Behavior Understanding in Crisis Response Control Rooms , 2012, AmI.

[19]  J. Beyerer,et al.  Ontologies for probabilistic situation assessment in the maritime domain , 2013, 2013 IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision Support (CogSIMA).

[20]  Nir Friedman,et al.  Probabilistic Graphical Models - Principles and Techniques , 2009 .

[21]  Miguel A. Patricio,et al.  On the representation and exploitation of context knowledge in a harbor surveillance scenario , 2011, 14th International Conference on Information Fusion.

[22]  Alexander Bauer,et al.  Object-oriented sensor data fusion for wide maritime surveillance , 2010, 2010 International WaterSide Security Conference.

[23]  A. Bauer,et al.  A conceptual framework for automatic situation assessment , 2011, 2011 IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision Support (CogSIMA).

[24]  Hauke Vagts,et al.  An Architecture for a Task-Oriented Surveillance System: A Service- and Event-Based Approach , 2010, 2010 Fifth International Conference on Systems.

[25]  Stuart J. Russell,et al.  Dynamic bayesian networks: representation, inference and learning , 2002 .

[26]  D. van Halsema,et al.  Improving maritime situational awareness by fusing sensor information and intelligence , 2011, 14th International Conference on Information Fusion.

[27]  D. L. Hall,et al.  Mathematical Techniques in Multisensor Data Fusion , 1992 .

[28]  Simon A. Dobson,et al.  Situation identification techniques in pervasive computing: A review , 2012, Pervasive Mob. Comput..

[29]  Anders Dahlbom Petri nets for situation recognition , 2011 .

[30]  Aldo Napoli,et al.  An enhanced spatial reasoning ontology for maritime anomaly detection , 2012, 2012 7th International Conference on System of Systems Engineering (SoSE).

[31]  Kathryn B. Laskey MEBN: A language for first-order Bayesian knowledge bases , 2008, Artif. Intell..

[32]  Mauricio Soto,et al.  Bayesian Tracking for Video Analytics ( An overview ) , 2010 .

[33]  W. Hafner,et al.  Service-based situational awareness on the Semantic Web , 2013, 2013 IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision Support (CogSIMA).

[34]  Jürgen Beyerer,et al.  A Top-Down-View on Intelligent Surveillance Systems , 2012, ICONS 2012.