Multi-sensor target detection and tracking system for sea ground borders surveillance

Border safety is a critical part of national and European security. This paper presents a vision-based system for ground and maritime surveillance using fixed and moving PTZ cameras. This system is intended to be used as an early warning system by local authorities. For the ground surveillance scenario, we introduce a stable human tracker able to efficiently cope with the trade-off between model stability and adaptability. More specifically, we adopt probabilistic mixture models like the Gaussian Mixture Models (GMMs) which exploit geometric properties for background modelling. Then, we integrate iterative motion information methods, concerned by shape and time properties, to estimate image regions of high confidence for updating the background model. For the maritime surveillance scenario for ship detecting and tracking, the system incorporates a visual attention method exploiting low-level image features with an online adaptable neural network tracker. No assumptions about environmental or visual conditions are made. System performance was evaluated in real time for robustness compared to dynamically changing visual conditions with videos from cameras placed at a test area near Athens for the ground scenario and at Venetian port of Chania.

[1]  Fabio Roli,et al.  Information fusion for computer security: State of the art and open issues , 2009, Inf. Fusion.

[2]  Ashraf M. Aziz,et al.  Fuzzy track-to-track association and track fusion approach in distributed multisensor-multitarget multiple-attribute environment , 2007, Signal Process..

[3]  Horst Bischof,et al.  Semi-supervised On-Line Boosting for Robust Tracking , 2008, ECCV.

[4]  Gérard G. Medioni,et al.  Online Tracking and Reacquisition Using Co-trained Generative and Discriminative Trackers , 2008, ECCV.

[5]  Geoff A. W. West,et al.  Vision-based attention in maritime environments , 2011, 2011 8th International Conference on Information, Communications & Signal Processing.

[6]  Ramakant Nevatia,et al.  Global data association for multi-object tracking using network flows , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Shai Avidan,et al.  Support Vector Tracking , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[8]  Luc Van Gool,et al.  Beyond semi-supervised tracking: Tracking should be as simple as detection, but not simpler than recognition , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[9]  Alexei Makarenko,et al.  Decentralized Bayesian algorithms for active sensor networks , 2006, Inf. Fusion.

[10]  Pramod K. Varshney,et al.  Decentralized M-ary detection via hierarchical binary decision fusion , 2001, Inf. Fusion.

[11]  Ashraf M. Aziz,et al.  A fuzzy approach for multiple-receiver digital communication systems with data fusion , 2011 .

[12]  Rui Caseiro,et al.  Globally optimal solution to multi-object tracking with merged measurements , 2011, 2011 International Conference on Computer Vision.

[13]  Nikolaos Doulamis,et al.  Local Geometrically Enriched Mixtures for Stable and Robust Human Tracking in Detecting Falls , 2013 .

[14]  Moshe Kam,et al.  Distributed M-ary hypothesis testing with binary local decisions , 2004, Inf. Fusion.

[15]  Vincent Lepetit,et al.  Randomized trees for real-time keypoint recognition , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[16]  Ramakant Nevatia,et al.  Robust Object Tracking by Hierarchical Association of Detection Responses , 2008, ECCV.

[17]  Stefanos D. Kollias,et al.  An efficient fully unsupervised video object segmentation scheme using an adaptive neural-network classifier architecture , 2003, IEEE Trans. Neural Networks.

[18]  Ning Xiong,et al.  Multi-sensor management for information fusion: issues and approaches , 2002, Inf. Fusion.

[19]  Hendrik Van Brussel,et al.  A multilevel information fusion approach for visual quality inspection , 2012, Inf. Fusion.

[20]  Ashraf M. Aziz,et al.  A new nearest-neighbor association approach based on fuzzy clustering , 2013 .

[21]  Paul D. Gader,et al.  Feature and decision level sensor fusion of electromagnetic induction and ground penetrating radar sensors for landmine detection with hand-held units , 2002, Inf. Fusion.

[22]  Nikolaos D. Doulamis,et al.  Vision-based maritime surveillance system using fused visual attention maps and online adaptable tracker , 2013, 2013 14th International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS).

[23]  Geoff A. W. West,et al.  Visual Maritime Attention Using Multiple Low-Level Features and Naïve Bayes Classification , 2011, 2011 International Conference on Digital Image Computing: Techniques and Applications.

[24]  Katerina Fragkiadaki,et al.  Two-Granularity Tracking: Mediating Trajectory and Detection Graphs for Tracking under Occlusions , 2012, ECCV.

[25]  P.K. Varshney,et al.  Fault detection in dynamic systems via decision fusion , 2008, IEEE Transactions on Aerospace and Electronic Systems.

[26]  Pramod K. Varshney,et al.  Distributed detection in a large wireless sensor network , 2006, Inf. Fusion.

[27]  R. Collins,et al.  On-line selection of discriminative tracking features , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[28]  M. Teal,et al.  Target identification in a complex maritime scene , 1999 .

[29]  Ales Leonardis,et al.  An adaptive coupled-layer visual model for robust visual tracking , 2011, 2011 International Conference on Computer Vision.

[30]  Qi Zhao,et al.  Co-Tracking Using Semi-Supervised Support Vector Machines , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[31]  Rob G. J. Wijnhoven,et al.  Online learning for ship detection in maritime surveillance , 2010 .

[32]  Borko Furht,et al.  A Hybrid Color-Based Foreground Object Detection Method for Automated Marine Surveillance , 2005, ACIVS.

[33]  G. Ferrari,et al.  Decentralized binary detection with noisy communication links , 2006, IEEE Transactions on Aerospace and Electronic Systems.

[34]  Shihong Lao,et al.  Multi-object tracking through occlusions by local tracklets filtering and global tracklets association with detection responses , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[35]  Mubarak Shah,et al.  Visual surveillance in maritime port facilities , 2008, SPIE Defense + Commercial Sensing.

[36]  Geoff A. W. West,et al.  Multiple Views Tracking of Maritime Targets , 2010, 2010 International Conference on Digital Image Computing: Techniques and Applications.

[37]  Zygmunt L. Szpak,et al.  Maritime surveillance: Tracking ships inside a dynamic background using a fast level-set , 2011, Expert Syst. Appl..

[38]  Uwe Aickelin,et al.  Information fusion in the immune system , 2010, Inf. Fusion.

[39]  Takahiro Ishikawa,et al.  The template update problem , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.