Maritime surveillance: Tracking ships inside a dynamic background using a fast level-set

Research highlights? Existing vision-based tracking methods are not suitable for the maritime domain. ? We derive a suitable tracking method by combining and modifying existing methods. ? Our method can track tiny targets. ? Our method is validated on several test sequences and two live field trials. Surveillance in a maritime environment is indispensable in the fight against a wide range of criminal activities, including pirate attacks, unlicensed fishing trailers and human trafficking. Computer vision systems can be a useful aid in the law enforcement process, by for example tracking and identifying moving vessels on the ocean. However, the maritime domain poses many challenges for the design of an effective maritime surveillance system. One such challenge is the tracking of moving vessels in the presence of a moving dynamic background (the ocean). We present techniques that address this particular problem. We use a background subtraction method and employ a real-time approximation of level-set-based curve evolution to demarcate the outline of moving vessels in the ocean. We report promising results on both small and large vessels, based on two field trials.

[1]  K. R. Ramakrishnan,et al.  Stability and convergence of the level set method in computer vision , 2007, Pattern Recognit. Lett..

[2]  Suk Ho Lee,et al.  Level set-based bimodal segmentation with stationary global minimum , 2006, IEEE Transactions on Image Processing.

[3]  Stan Sclaroff,et al.  Segmenting foreground objects from a dynamic textured background via a robust Kalman filter , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[4]  Donald E. Knuth,et al.  The art of computer programming. Vol.2: Seminumerical algorithms , 1981 .

[5]  B. Uma Shankar,et al.  Fast mean filtering technique (FMFT) , 2007, Pattern Recognit..

[6]  M. Teal,et al.  Target identification in a complex maritime scene , 1999 .

[7]  P.K Sahoo,et al.  A survey of thresholding techniques , 1988, Comput. Vis. Graph. Image Process..

[8]  Tim Ellis,et al.  Characterisation of a complex maritime scene using Fourier space analysis to identify small craft , 1999 .

[9]  Zygmunt L. Szpak.  FURTHER OPTIMIZATIONS FOR THE CHAN-VESE ACTIVE CONTOUR MODEL , 2008 .

[10]  Dar-Shyang Lee,et al.  Effective Gaussian mixture learning for video background subtraction , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Antoine Manzanera,et al.  A Robust and Computationally Efficient Motion Detection Algorithm Based on Sigma-Delta Background Estimation , 2004, ICVGIP.

[12]  W. Clem Karl,et al.  A Real-Time Algorithm for the Approximation of Level-Set-Based Curve Evolution , 2008, IEEE Transactions on Image Processing.

[13]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[14]  Shireen Elhabian,et al.  Moving Object Detection in Spatial Domain using Background Removal Techniques - State-of-Art , 2008 .

[15]  J. Sethian,et al.  A Fast Level Set Method for Propagating Interfaces , 1995 .

[16]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[17]  Konrad Schindler,et al.  Smooth Foreground-Background Segmentation for Video Processing , 2006, ACCV.

[18]  George Hripcsak,et al.  Technical Brief: Agreement, the F-Measure, and Reliability in Information Retrieval , 2005, J. Am. Medical Informatics Assoc..

[19]  Smith,et al.  Identification and tracking of maritime objects in near-infrared image sequences for collision avoidance , 1999 .

[20]  Pascal Fua,et al.  Making Background Subtraction Robust to Sudden Illumination Changes , 2008, ECCV.

[21]  Antoine Manzanera,et al.  A new motion detection algorithm based on Sigma-Delta background estimation , 2007, Pattern Recognit. Lett..

[22]  J. Hartigan,et al.  The Dip Test of Unimodality , 1985 .

[23]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[24]  Atsushi Shimada,et al.  Dynamic Control of Adaptive Mixture-of-Gaussians Background Model , 2006, 2006 IEEE International Conference on Video and Signal Based Surveillance.

[25]  Larry S. Davis,et al.  Non-parametric Model for Background Subtraction , 2000, ECCV.

[26]  Massimo Piccardi,et al.  Background subtraction techniques: a review , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[27]  Niels Chr. Overgaard,et al.  Initialization Techniques for Segmentation with the Chan-Vese Model , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[28]  Alex Pentland,et al.  Pfinder: Real-Time Tracking of the Human Body , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Nigel J. B. McFarlane,et al.  Segmentation and tracking of piglets in images , 1995, Machine Vision and Applications.

[30]  J. Douglas Birdwell,et al.  Efficient Implementation of the Chan-Vese Models Without Solving PDEs , 2006, 2006 IEEE Workshop on Multimedia Signal Processing.

[31]  Borko Furht,et al.  A Hybrid Color-Based Foreground Object Detection Method for Automated Marine Surveillance , 2005, ACIVS.

[32]  Ferdinand van der Heijden,et al.  Efficient adaptive density estimation per image pixel for the task of background subtraction , 2006, Pattern Recognit. Lett..

[33]  Qi Tian,et al.  Foreground object detection from videos containing complex background , 2003, MULTIMEDIA '03.

[34]  M. K. Teal,et al.  Nautical Scene Segmentation Using Variable Size Image Windows and Feature Space Reclustering , 2000, ECCV.

[35]  Kap Luk Chan,et al.  An Improved Real-Time Contour Tracking Algorithm Using Fast Level Set Method , 2006, PSIVT.

[36]  N. Na.  THE SCIENCE OF COLOR , 1952 .