Marine object detection in UAV full-motion video

Recent years have seen an increased use of Unmanned Aerial Vehicles (UAV) with video-recording capability for Maritime Domain Awareness (MDA) and other surveillance operations. In order for these e orts to be effective, there is a need to develop automated algorithms to process the full-motion videos (FMV) captured by UAVs in an efficient and timely manner to extract meaningful information that can assist human analysts and decision makers. This paper presents a generalizeable marine object detection system that is specifically designed to process raw video footage streaming from UAVs in real-time. Our approach does not make any assumptions about the object and/or background characteristics because, in the MDA domain, we encounter varying background and foreground characteristics such as boats, bouys and ships of varying sizes and shapes, wakes, white caps on water, glint from the sun, to name but a few. Our efforts rely on basic signal processing and machine learning approaches to develop a generic object detection system that maintains a high level of performance without making prior assumptions about foreground-background characteristics and does not experience abrupt performance degradation when subjected to variations in lighting, background characteristics, video quality, abrupt changes in video perspective, size, appearance and number of the targets. In the following report, in addition to our marine object detection system, we present representative object detection results on some real-world UAV full-motion video data.

[1]  Sergiy Fefilatyev Detection of Marine Vehicles in Images and Video of Open Sea , 2008 .

[2]  M. Eichner,et al.  Autonomous Real-time Vehicle Detection from a Medium-Level UAV , 2009 .

[3]  John Stastny,et al.  Enhanced ship detection from overhead imagery , 2008, SPIE Defense + Commercial Sensing.

[4]  Hui Cheng,et al.  Vehicle and Person Tracking in Aerial Videos , 2007, CLEAR.

[5]  Toby P. Breckon,et al.  Real-time people and vehicle detection from UAV imagery , 2011, Electronic Imaging.

[6]  D. Ruppert The Elements of Statistical Learning: Data Mining, Inference, and Prediction , 2004 .

[7]  Mennatullah Siam,et al.  Robust autonomous visual detection and tracking of moving targets in UAV imagery , 2012, 2012 IEEE 11th International Conference on Signal Processing.

[8]  Phillip Malinoski Object detection and recognition for UAV , 2012 .

[9]  Elan Sharghi,et al.  Ship detection and classification from overhead imagery , 2007, SPIE Optical Engineering + Applications.

[10]  Pascal Vasseur,et al.  A Vision Algorithm for Dynamic Detection of Moving Vehicles with a UAV , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[11]  Xiaoli Yu,et al.  Comparative performance analysis of adaptive multispectral detectors , 1993, IEEE Trans. Signal Process..

[12]  P. Yip,et al.  Discrete Cosine Transform: Algorithms, Advantages, Applications , 1990 .

[13]  Dongliang Zhang,et al.  Ship Tracking Using Background Subtraction and Inter-Frame Correlation , 2009, 2009 2nd International Congress on Image and Signal Processing.