A robust object tracking synthetic structure using regional mutual information and edge correlation-based tracking algorithm in aerial surveillance application

This paper issues the problem of moving object tracking in aerial video sequences for surveillance application. The proposed object tracking synthetic structure integrates edge correlation-based (EC) tracking algorithm and a novel regional mutual information-based (RMI) tracking algorithm. In this structure, using a novel defined crowded criterion, we are able to recognize a crowded background and vast difference of illumination. The proposed crowded criterion determines the crowded and non-crowded backgrounds based on two defined intensity variation and relative power measures that are calculated from four rectangular areas around the object. Due to inability of the EC tracking algorithm in tracking the object in the crowded frames, the RMI tracking algorithm is applied to track an object in the crowded frames of video sequences. Against, due to sensitivity of the RMI tracking algorithm to scale variations of the object and less computational complexity of the EC tracking algorithm, the EC tracking algorithm is selected for the object tracking in the non-crowded frames of the video sequences. However, the RMI tracking algorithm is suitable for the frames with the crowded backgrounds, high-intensity variations, noisy conditions, and existence of clutter, but it is sensitive to scale variations of the object. Moreover, it is normally slower than the EC tracking algorithm, but we apply Powell–Golden optimization method to optimize the RMI tracking algorithm, until we can use it as an online algorithm on each frame. The obtained results show the superiority of the proposed tracking structure in comparison with other conventional algorithms. Our proposed structure covers the most challenges of the tracking in the aerial surveillance application.

[1]  Xin Li,et al.  Contour-based object tracking with occlusion handling in video acquired using mobile cameras , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[3]  Tobias Bjerregaard,et al.  A survey of research and practices of Network-on-chip , 2006, CSUR.

[4]  F. Fleuret.  Fast Binary Feature Selection with Conditional Mutual Information , 2004, J. Mach. Learn. Res..

[5]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[6]  Ghazanfar Shahgholian,et al.  Robust and Real Time Object Tracking Using Regional Mutual Information in Surveillance and Reconnaissance Systems , 2011, 2011 7th Iranian Conference on Machine Vision and Image Processing.

[7]  Dong-Jo Park,et al.  Robust centroid target tracker based on novel distance features in cluttered image sequences , 2000, Visual Communications and Image Processing.

[8]  H. Soleimani,et al.  Submitted: 2011-08-08 Accepted: 2011-11-24 Reducing Interpolation Artifacts for Mutual Information Based Image Registration , 2022 .

[9]  Cedric Nishan Canagarajah,et al.  Structural similarity-based object tracking in multimodality surveillance videos , 2009, Machine Vision and Applications.

[10]  Arivazhagan Selvaraj,et al.  Automatic Target Detection Using Wavelet Transform , 2004, EURASIP J. Adv. Signal Process..

[11]  Zdenek Kalal,et al.  Tracking-Learning-Detection , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Carlo Tomasi,et al.  Image Similarity Using Mutual Information of Regions , 2004, ECCV.

[13]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Rafael C. González,et al.  Local Determination of a Moving Contrast Edge , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[16]  C. D. Kuglin,et al.  The phase correlation image alignment method , 1975 .

[17]  C. Tomasi,et al.  Factoring image sequences into shape and motion , 1991, Proceedings of the IEEE Workshop on Visual Motion.

[18]  Mubarak Shah,et al.  Real-time edge-enhanced dynamic correlation and predictive open-loop car-following control for robust tracking , 2008, Machine Vision and Applications.

[19]  Yuntao Cui,et al.  Indoor monitoring via the collaboration between a peripheral sensor and a foveal sensor , 1998, Proceedings 1998 IEEE Workshop on Visual Surveillance.

[20]  J. P. Lewis.  Fast Normalized Cross-Correlation , 2010 .

[21]  Andrew Hunter,et al.  Measurement of retinal vessel widths from fundus images based on 2-D modeling , 2004, IEEE Transactions on Medical Imaging.

[22]  Sung-Il Chien,et al.  Adaptive window method with sizing vectors for reliable correlation-based target tracking , 2000, Pattern Recognit..

[23]  David J. Heeger,et al.  Optical flow using spatiotemporal filters , 2004, International Journal of Computer Vision.

[24]  G. Shahgholian,et al.  Robust Object Tracking Using Regional Mutual Information and Normalized Cross Correlation , 2012, 2012 Fourth International Conference on Computational Intelligence and Communication Networks.

[25]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Andrew Hunter,et al.  A Fast Model-Free Morphology-Based Object Tracking Algorithm , 2002, BMVC.

[27]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.