Automatic target tracking in FLIR image sequences using intensity variation function and template modeling

A novel automatic target tracking (ATT) algorithm for tracking targets in forward-looking infrared (FLIR) image sequences is proposed in this paper. The proposed algorithm efficiently utilizes the target intensity feature, surrounding background, and shape information for tracking purposes. This algorithm involves the selection of a suitable subframe and a target window based on the intensity and shape of the known reference target. The subframe size is determined from the region of interest and is constrained by target size, target motion, and camera movement. Then, an intensity variation function (IVF) is developed to model the target intensity profile. The IVF model generates the maximum peak value where the reference target intensity variation is similar to the candidate target intensity variation. In the proposed algorithm, a control module has been incorporated to evaluate IVF results and to detect a false alarm (missed target). Upon detecting a false alarm, the controller triggers another algorithm, called template model (TM), which is based on the shape knowledge of the reference target. By evaluating the outputs from the IVF and TM techniques, the tracker determines the real coordinates of one or more targets. The proposed technique also alleviates the detrimental effects of camera motion, by appropriately adjusting the subframe size. Experimental results using real-life long-wave and medium-wave infrared image sequences are shown to validate the robustness of the proposed technique.

[1]  Abhijit Mahalanobis,et al.  Signal-to-clutter measure for measuring automatic target recognition performance using complimentary eigenvalue distribution analysis , 2003 .

[2]  Jake K. Aggarwal,et al.  MODEEP: a motion-based object detection and pose estimation method for airborne FLIR sequences , 2000, Machine Vision and Applications.

[3]  Donat-Peter Häder Image analysis : methods and applications , 2001 .

[4]  Leszek Wojnar,et al.  Image Analysis , 1998 .

[5]  Mohammad A. Karim,et al.  Multiple target detection using a modified fringe-adjusted joint transform correlator , 1994 .

[6]  Heesung Kwon,et al.  Adaptive multisensor target detection using feature-based fusion , 2002 .

[7]  Mohammad S. Alam,et al.  Infrared image registration and high-resolution reconstruction using multiple translationally shifted aliased video frames , 2000, IEEE Trans. Instrum. Meas..

[8]  J. Aggarwal,et al.  Detecting moving objects in airborne forward looking infra-red sequences , 1999, Proceedings IEEE Workshop on Computer Vision Beyond the Visible Spectrum: Methods and Applications (CVBVS'99).

[9]  HyunWook Park,et al.  Automatic target recognition using boundary partitioning and invariant features in forward-looking infrared images , 2003 .

[10]  A. Yilmaz,et al.  TARGET-TRACKING IN FLIR IMAGERY USING MEAN-SHIFT AND GLOBAL MOTION COMPENSATION , 2001 .

[11]  Eliezer Oron,et al.  Precision tracking with segmentation for imaging sensors , 1993 .

[12]  Mubarak Shah,et al.  Target tracking in airborne forward looking infrared imagery , 2003, Image Vis. Comput..

[13]  Marc Acheroy,et al.  Multilevel data fusion for the detection of targets using multispectral image sequences , 1998 .