Enhancing Automatic Maritime Surveillance Systems With Visual Information

Automatic surveillance systems for the maritime domain are becoming more and more important due to a constant increase of naval traffic and to the simultaneous reduction of crews on decks. However, available technology still provides only a limited support to this kind of applications. In this paper, a modular system for intelligent maritime surveillance, capable of fusing information from heterogeneous sources, is described. The system is designed to enhance the functions of the existing vessel traffic services systems and to be deployable in populated areas, where radar-based systems cannot be used due to the high electromagnetic radiation emissions. A quantitative evaluation of the proposed approach has been carried out on a large and publicly available data set of images and videos, which are collected from multiple real sites, with different light, weather, and traffic conditions.

[1]  Daniele Nardi,et al.  Integrated Visual Information for Maritime Surveillance , 2015 .

[2]  Zigmund Orlov,et al.  Robust layer-based boat detection and multi-target-tracking in maritime environments , 2010, 2010 International WaterSide Security Conference.

[3]  Luca Iocchi,et al.  Automatic Maritime Surveillance with Visual Target Detection , 2011 .

[4]  Daniele Nardi,et al.  Disambiguating localization symmetry through a Multi-Clustered Particle Filtering , 2015, 2015 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI).

[5]  Jesús García,et al.  Robust sensor fusion in real maritime surveillance scenarios , 2010, 2010 13th International Conference on Information Fusion.

[6]  Michael Teutsch,et al.  Detection and classification of man-made offshore objects in TerraSAR-X and RapidEye imagery: Selected results of the DeMarine-DEKO project , 2011, OCEANS 2011 IEEE - Spain.

[7]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[8]  Dmitry B. Goldgof,et al.  Tracking Ships from Fast Moving Camera through Image Registration , 2010, 2010 20th International Conference on Pattern Recognition.

[9]  Mubarak Shah,et al.  Visual surveillance in maritime port facilities , 2008, SPIE Defense + Commercial Sensing.

[10]  Luca Iocchi,et al.  PTracking: Distributed Multi-Agent Multi-Object Tracking through Multi-Clustered Particle Filtering , 2015, 2015 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI).

[11]  Jesús García,et al.  Fusion of sensor data and intelligence in FITS , 2013, Proceedings of the 16th International Conference on Information Fusion.

[12]  Jing Zhang,et al.  Framework for Performance Evaluation of Face, Text, and Vehicle Detection and Tracking in Video: Data, Metrics, and Protocol , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  VARUN CHANDOLA,et al.  Anomaly detection: A survey , 2009, CSUR.

[14]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[15]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[16]  Luca Iocchi,et al.  Argos - a Video Surveillance System for boat Traffic Monitoring in Venice , 2009, Int. J. Pattern Recognit. Artif. Intell..

[17]  Miguel A. Patricio,et al.  Information fusion as input source for improving multi-agent system autonomous decision-making in maritime surveillance scenarios , 2014, 17th International Conference on Information Fusion (FUSION).

[18]  Frédéric Bouchara,et al.  Uncertainty fusion based object recognition and tracking in maritime scenes using spatiotemporal active contours , 2015, 2014 International Conference on Computer Vision Theory and Applications (VISAPP).

[19]  Bin Dai,et al.  Fast detection of small infrared objects in maritime scenes using local minimum patterns , 2011, 2011 18th IEEE International Conference on Image Processing.

[20]  Simon J. Godsill,et al.  On sequential Monte Carlo sampling methods for Bayesian filtering , 2000, Stat. Comput..

[21]  Abhijit Sinha,et al.  Study on Persistent Monitoring of Maritime, Great Lakes and St. Lawrence Seaway Border Regions , 2011 .

[22]  Luca Iocchi,et al.  ARGOS-Venice Boat Classification , 2015, 2015 12th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[23]  Fouad Bousetouane,et al.  Off-the-Shelf CNN Features for Fine-Grained Classification of Vessels in a Maritime Environment , 2015, ISVC.

[24]  Yishay Mansour,et al.  Policy Gradient Methods for Reinforcement Learning with Function Approximation , 1999, NIPS.

[25]  Alejandro Bordallo,et al.  Counterfactual reasoning about intent for interactive navigation in dynamic environments , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[26]  Fatih Murat Porikli,et al.  Pedestrian Detection via Classification on Riemannian Manifolds , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[28]  Dmitry B. Goldgof,et al.  Detection and tracking of ships in open sea with rapidly moving buoy-mounted camera system , 2012 .

[29]  Hai Wei,et al.  Automated intelligent video surveillance system for ships , 2009, Defense + Commercial Sensing.