Pedestrian tracking for infrared image sequence based on trajectory manifold of spatio-temporal slice

The research of pedestrian tracking in infrared image sequences is a curial part of video surveillance. Considering the particular characteristics of the infrared image, such as low contrast, fuzzy edge and unknown noises interference, the study of infrared pedestrian tracking algorithm becomes a great challenge. Spatio-temporal slice method is effective due to considering both spatial and time scale. It can extract the trajectory of moving targets, reflecting the trajectory manifold variations of targets along the time, to provide ways to depict the regions of targets. However, traditional spatio-temporal based methods only consider the horizontal slice analysis and usually require a large amount of calculation time; this paper proposes a spatio-temporal tracking algorithm to infrared image sequences, using both horizontal and vertical multi-layer slices to obtain the integral trajectory manifold. The integral trajectory is analyzed to obtain the target boundary and position information, with which the target can be tracked in each frame. The experimental results show that the proposed method has a relatively high tracking accuracy with a fast computing speed. Moreover, it can perform effectively in different infrared image sequences with various motion modes by single pedestrian from OTCBVS/05 Terravic Motion IR Database.

[1]  Ming Tang,et al.  Robust tracking via weakly supervised ranking SVM , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Patrick Bouthemy,et al.  Real-Time Tracking of Moving Persons by Exploiting Spatio-Temporal Image Slices , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Etienne Corvée,et al.  Body Parts Detection for People Tracking Using Trees of Histogram of Oriented Gradient Descriptors , 2010, 2010 7th IEEE International Conference on Advanced Video and Signal Based Surveillance.

[4]  Tonghai Jiang,et al.  An Method for Vehicle-Flow Detection and Tracking in Real-Time Based on Gaussian Mixture Distribution , 2013 .

[5]  Chih-Hsien Hsia,et al.  Fast Background Subtraction Based on a Multilayer Codebook Model for Moving Object Detection , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Hideo Fukamachi,et al.  “Night View System” with Pedestrian Detection Using Near-Infrared Light , 2008 .

[7]  Xiaohong Su,et al.  Fast Pedestrian Detection Using Slice-Based Motion Analysis , 2010, 2010 First International Conference on Pervasive Computing, Signal Processing and Applications.

[8]  Antti Oulasvirta,et al.  Interactive Markerless Articulated Hand Motion Tracking Using RGB and Depth Data , 2013, 2013 IEEE International Conference on Computer Vision.

[9]  Jiwen Lu,et al.  Summarizing surveillance videos with local-patch-learning-based abnormality detection, blob sequence optimization, and type-based synopsis , 2015, Neurocomputing.

[10]  Chen Qian,et al.  Realtime and Robust Hand Tracking from Depth , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Mubarak Shah,et al.  A Multiview Approach to Tracking People in Crowded Scenes Using a Planar Homography Constraint , 2006, ECCV.

[12]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[13]  Zhenmin Tang,et al.  Modified particle filter-based infrared pedestrian tracking , 2010 .

[14]  Ehud Rivlin,et al.  Mean Shift tracking with multiple reference color histograms , 2010, Comput. Vis. Image Underst..

[15]  GuoJing-Ming,et al.  Fast Background Subtraction Based on a Multilayer Codebook Model for Moving Object Detection , 2013 .

[16]  Jake K. Aggarwal,et al.  Temporal spatio-velocity transform and its application to tracking and interaction , 2004, Comput. Vis. Image Underst..

[17]  Yihao Zhang,et al.  A new approach for extracting and summarizing abnormal activities in surveillance videos , 2014, 2014 IEEE International Conference on Multimedia and Expo Workshops (ICMEW).

[18]  Mohsen A. Hassan,et al.  Decoupled Third-order Fuzzy Sliding Model Control For Cart-Inverted Pendulum System , 2013 .

[19]  Chong-Wah Ngo,et al.  Motion characterization by temporal slices analysis , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[20]  Larry S. Davis,et al.  Probabilistic template based pedestrian detection in infrared videos , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[21]  David Zhang,et al.  Robust Object Tracking Using Joint Color-Texture Histogram , 2009, Int. J. Pattern Recognit. Artif. Intell..

[22]  Juhng-Perng Su,et al.  Moving Target Tracking Based on CamShift Approach and Kalman Filter , 2015 .

[23]  Xia Liu,et al.  Pedestrian detection and tracking with night vision , 2005, IEEE Transactions on Intelligent Transportation Systems.

[24]  Chong-Wah Ngo,et al.  Motion analysis and segmentation through spatio-temporal slices processing , 2003, IEEE Trans. Image Process..