Robust moving ship detection using context-based motion analysis and occlusion handling

This paper proposes an original moving ship detection approach in video surveillance systems, especially con- centrating on occlusion problems among ships and vegetation using context information. Firstly, an over- segmentation is performed to divide and classify by SVM (Support Vector Machine) segments into water or non-water, while exploiting the context that ships move only in water. We assume that the ship motion to be characterized by motion saliency and consistency, such that each ship distinguish itself. Therefore, based on the water context model, non-water segments are merged into regions with motion similarity. Then, moving ships are detected by measuring the motion saliency of those regions. Experiments on real-life surveillance videos prove the accuracy and robustness of the proposed approach. We especially pay attention to testing in the cases of severe occlusions between ships and between ship and vegetation. The proposed algorithm outperforms, in terms of precision and recall, our earlier work and a proposal using SVM-based ship detection.

[1]  Hai Wei,et al.  Automated intelligent video surveillance system for ships , 2009, Defense + Commercial Sensing.

[2]  Frank Nielsen,et al.  Statistical region merging , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Ce Liu,et al.  Exploring new representations and applications for motion analysis , 2009 .

[4]  Borko Furht,et al.  A Hybrid Color-Based Foreground Object Detection Method for Automated Marine Surveillance , 2005, ACIVS.

[5]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[6]  Peter H. N. de With,et al.  Ship detection in port surveillance based on context and motion saliency analysis , 2013, Electronic Imaging.

[7]  Dmitry B. Goldgof,et al.  Tracking Ships from Fast Moving Camera through Image Registration , 2010, 2010 20th International Conference on Pattern Recognition.

[8]  Paul Scheunders,et al.  Advanced Concepts for Intelligent Vision Systems , 2012, Lecture Notes in Computer Science.

[9]  Jacob Yadegar,et al.  A semantic based video indexing and retrieval system for maritime surveillance , 2009, Defense + Commercial Sensing.

[10]  Peter H. N. de With,et al.  Water Region Detection Supporting Ship Identification in Port Surveillance , 2012, ACIVS.

[11]  Jong-Nam Kim,et al.  Multiple Ship Detection and Tracking Using Background Registration and Morphological Operations , 2010, FGIT-SIP/MulGraB.

[12]  Mubarak Shah,et al.  Visual surveillance in maritime port facilities , 2008, SPIE Defense + Commercial Sensing.

[13]  Vincent Charvillat,et al.  Context modeling in computer vision: techniques, implications, and applications , 2010, Multimedia Tools and Applications.

[14]  Rob G. J. Wijnhoven,et al.  Online learning for ship detection in maritime surveillance , 2010 .