IR and Visible Video Fusion for Surveillance

Infrared (IR) imagery offers a promising alternative to visible imagery and is extensively used in military, surveillance and other applications. IR, however, has limitations of not detecting thermal variations after heavy rains when the temperature of the surrounding becomes uniform with the object of interest. Due to this fact, the relevant information from visible and IR videos are combined into one fused video. This paper aims to develop an efficient algorithm in order to fuse videos captured using infrared and visible cameras using different types of transforms and evaluate its performance measures. Tracking of single or multiple objects/people from the fused result has been further undertaken specifically for night vision using Background Subtraction[BS] and Kalman filtering.

[1]  Jitendra R. Raol,et al.  Multi-Sensor Data Fusion with MATLAB® , 2009 .

[2]  Toet Alexander,et al.  TNO Image Fusion Dataset , 2014 .

[3]  Harmandeep Kaur,et al.  Image fusion on digital images using Laplacian pyramid with DWT , 2015, 2015 Third International Conference on Image Information Processing (ICIIP).

[4]  David A. Landgrebe,et al.  Decision fusion approach for multitemporal classification , 1999, IEEE Trans. Geosci. Remote. Sens..

[5]  Anil K. Jain,et al.  A Markov random field model for classification of multisource satellite imagery , 1996, IEEE Trans. Geosci. Remote. Sens..

[6]  Khalid Saeed,et al.  Moving Object Detection Using Background Subtraction , 2014, SpringerBriefs in Computer Science.

[7]  Asad Abdul Malik,et al.  Object Detection and Tracking using Background Subtraction and Connected Component Labeling , 2013 .

[8]  Gang Xiao,et al.  A new tracking approach for visible and infrared sequences based on tracking-before-fusion , 2014, International Journal of Dynamics and Control.

[9]  Henry Leung,et al.  Neural data fusion algorithms based on a linearly constrained least square method , 2002, IEEE Trans. Neural Networks.

[10]  Tianjiao Zeng,et al.  Image Fusion Using Laplacian Pyramid Transform , 2014 .

[11]  Zhu Mengyu,et al.  A New Image Fusion Algorithm Based on Fuzzy Logic , 2008, 2008 International Conference on Intelligent Computation Technology and Automation (ICICTA).

[12]  Daljit Kaur,et al.  REVIEW ON IMAGE FUSION , 2016 .

[13]  Jorge S. Marques,et al.  New Performance Evaluation Metrics for Object Detection Algorithms , 2004 .

[14]  Hyo Jong Lee,et al.  Moving Object Detection Based on Background Subtraction , 2016 .

[15]  C. Sureshkumar,et al.  Background subtraction based on threshold detection using modified K-means algorithm , 2013, 2013 International Conference on Pattern Recognition, Informatics and Mobile Engineering.