Classification of small boats in infrared images for maritime surveillance

Autonomous round-the-clock observation of wide critical maritime areas can be a powerful support for border protection agencies to avoid criminal acts like illegal immigration, piracy or drug trafficking. These criminal acts are often accomplished by using small boats to decrease the probability of being uncovered. In this paper, we present an image exploitation approach to detect and classify maritime objects in infrared image sequences recorded from an autonomous platform. We focus on high robustness and generality with respect to variations of boat appearance, image quality, and environmental condition. A fusion of three different detection algorithms is performed to create reliable alarm hypotheses. In the following, a set of well-investigated features is extracted from the alarm hypotheses and evaluated using a two-stage-classification with support vector machines (SVMs) in order to distinguish between three object classes: clutter, irrelevant objects and suspicious boats. On the given image data we achieve a rate of 97 % correct classifications.

[1]  Mohammad Moinul Islam,et al.  Anomaly based vessel detection in visible and infrared images , 2009, Electronic Imaging.

[2]  Axel Korn,et al.  Toward a Symbolic Representation of Intensity Changes in Images , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Alexander Bauer,et al.  Object-oriented sensor data fusion for wide maritime surveillance , 2010, 2010 International WaterSide Security Conference.

[4]  V. Asari,et al.  Long-Range Target Classification in a Cluttered Environment Using Multi-Sensor Image Sequences , 2007, 2007 3rd International Conference on Recent Advances in Space Technologies.

[5]  Dmitry B. Goldgof,et al.  Toward detection of marine vehicles on horizon from buoy camera , 2007, SPIE Security + Defence.

[6]  B. S. Manjunath,et al.  Introduction to MPEG-7: Multimedia Content Description Interface , 2002 .

[7]  Heng Li,et al.  Automatic Recognition of Ship Types from Infrared Images Using Support Vector Machines , 2008, 2008 International Conference on Computer Science and Software Engineering.

[8]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Fei Wang,et al.  A new method for ship classification and recognition , 2005, International Symposium on Multispectral Image Processing and Pattern Recognition.

[10]  Barbara Essendorfer,et al.  Maritime surveillance with integrated systems , 2010, 2010 International WaterSide Security Conference.

[11]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Taghi M. Khoshgoftaar,et al.  Classification of Ships in Surveillance Video , 2006, 2006 IEEE International Conference on Information Reuse & Integration.

[13]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[14]  Gianluca Marsiglia,et al.  Techniques for detection of multiple, extended, and low contrast targets in infrared maritime scenarios , 2006 .

[15]  Zigmund Orlov,et al.  Robust layer-based boat detection and multi-target-tracking in maritime environments , 2010, 2010 International WaterSide Security Conference.

[16]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[17]  Lawrence D. Stone,et al.  Bayesian Multiple Target Tracking , 1999 .

[18]  Yajun Li,et al.  Reforming the theory of invariant moments for pattern recognition , 1992, Pattern Recognit..

[19]  Neil C. Rowe,et al.  Robust Recognition of Ship Types from an Infrared Silhouette , 2004 .

[20]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.