Segmentation of moving objects in visible and thermal videos

Segmentation of moving objects is one of the fundamental tasks in computer vision applications. Many of the proposed segmentation algorithms work well for visible spectrum but fail to work for night vision thermal videos primarily due to the halo effect surrounding the object of interest. For video analytics and security applications, it is essential that the solution works round the clock or 24x7. In this paper we present an efficient technique for segmenting moving objects from visible and thermal videos. We present an approach that makes use of block matching algorithm for differentiating between background and moving objects. The full search or the exhaustive search being computationally expensive, we propose a threshold based strategy that reduces the computational complexity to a large extent to make the solution suitable for real-time applications. The reduced computational complexity makes it suitable for deploying on any low cost desktop computer.

[1]  A. Ercil,et al.  Robust Vehicle Detection Algorithm , 2007, 2007 IEEE 15th Signal Processing and Communications Applications.

[2]  Kai-Kuang Ma,et al.  A new diamond search algorithm for fast block-matching motion estimation , 2000, IEEE Trans. Image Process..

[3]  Jian-Gang Wang,et al.  Facial Feature Extraction in an Infrared Image by Proxy With a Visible Face Image , 2007, IEEE Transactions on Instrumentation and Measurement.

[4]  Liang-Gee Chen,et al.  Survey on Block Matching Motion Estimation Algorithms and Architectures with New Results , 2006, J. VLSI Signal Process..

[5]  Xuan Jing,et al.  An efficient three-step search algorithm for block motion estimation , 2004, IEEE Transactions on Multimedia.

[6]  P. KaewTrakulPong,et al.  An Improved Adaptive Background Mixture Model for Real-time Tracking with Shadow Detection , 2002 .

[7]  Mohammad Gharavi-Alkhansari,et al.  A fast globally optimal algorithm for template matching using low-resolution pruning , 2001, IEEE Trans. Image Process..

[8]  Kentaro Toyama,et al.  Wallflower: principles and practice of background maintenance , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[9]  Jue Wu,et al.  Multimodal Brain Image Registration Based on Wavelet Transform Using SAD and MI , 2004, MIAR.

[10]  T Koga,et al.  MOTION COMPENSATED INTER-FRAME CODING FOR VIDEO CONFERENCING , 1981 .

[11]  Lai-Man Po,et al.  A novel four-step search algorithm for fast block motion estimation , 1996, IEEE Trans. Circuits Syst. Video Technol..

[12]  Nikolaos Papanikolopoulos,et al.  Clustering of Vehicle Trajectories , 2010, IEEE Transactions on Intelligent Transportation Systems.

[13]  Dan Schonfeld,et al.  Fast object tracking using adaptive block matching , 2005, IEEE Transactions on Multimedia.

[14]  Zhen Yu,et al.  A real-time motion detection algorithm for traffic monitoring systems based on consecutive temporal difference , 2009, 2009 7th Asian Control Conference.

[15]  Abbas El Gamal,et al.  Optical flow estimation using temporally oversampled video , 2005, IEEE Transactions on Image Processing.

[16]  Lan Yao,et al.  An effective detection algorithm for moving object with complex background , 2005, 2005 International Conference on Machine Learning and Cybernetics.

[17]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[18]  Pubudu N. Pathirana,et al.  Simultaneous estimation of optical flow and object state: A modified approach to optical flow calculation , 2007, 2007 IEEE International Conference on Networking, Sensing and Control.

[19]  Kenzo Nonami,et al.  Optic flow-based vision system for autonomous 3D localization and control of small aerial vehicles , 2009, Robotics Auton. Syst..