Target tracking in nonuniform illumination conditions using locally adaptive correlation filters

Abstract An accurate method for tracking the position and orientation of a moving target in nonuniformly illuminated and noisy scenes is proposed. The approach employs a filter bank of space-variant correlation filters which adapt their parameters accordingly with local statistics of the observed scene in each frame. When a scene frame is captured, a fragment of interest is extracted from the frame around predicted coordinates of the target location. The fragment is firstly preprocessed to correct the illumination. Afterwards, the location and orientation of the target are estimated from the corrected fragment with the help of the filter bank. The performance of the proposed system in terms of tracking accuracy is tested in nonuniformly illuminated and noisy scene sequences. The obtained results are discussed and compared with those of similar state-of-the-art techniques for target tracking in terms of objective metrics.

[1]  Vitaly Kober,et al.  Design of correlation filters for pattern recognition using a noisy reference , 2012 .

[2]  Jason Sanders,et al.  CUDA by example: an introduction to general purpose GPU programming , 2010 .

[3]  David G. Stork,et al.  Pattern Classification , 1973 .

[4]  Dorin Comaniciu,et al.  Kernel-Based Object Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Tobias Bjerregaard,et al.  A survey of research and practices of Network-on-chip , 2006, CSUR.

[6]  Simon J. Godsill,et al.  On sequential Monte Carlo sampling methods for Bayesian filtering , 2000, Stat. Comput..

[7]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Ehud Rivlin,et al.  Mean Shift tracking with multiple reference color histograms , 2010, Comput. Vis. Image Underst..

[9]  Vitaly Kober,et al.  Real-time tracking of multiple objects using adaptive correlation filters with complex constraints , 2013 .

[10]  Bahram Javidi,et al.  Design of filters to detect a noisy target in nonoverlapping background noise , 1994 .

[11]  Henri H. Arsenault,et al.  Modified LACIF filtering in background disjoint noise , 2011 .

[12]  B. Kumar,et al.  Performance measures for correlation filters. , 1990, Applied optics.

[13]  Mohammad S. Alam,et al.  New two-stage correlation-based approach for target detection and tracking in forward-looking infrared imagery using filters based on extended maximum average correlation height and polynomial distance classifier correlation , 2007 .

[14]  Yulei Wang,et al.  Visual tracking and learning using speeded up robust features , 2012, Pattern Recognit. Lett..

[15]  Vitaly Kober,et al.  Adaptive phase-input joint transform correlator. , 2007, Applied optics.

[16]  Steve Serati,et al.  Optical correlator based target detection, recognition, classification, and tracking. , 2012, Applied optics.

[17]  B Javidi,et al.  Minimum-mean-square-error filters for detecting a noisy target in background noise. , 1996, Applied optics.

[18]  Zdenek Kalal,et al.  Tracking-Learning-Detection , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  X. R. Li,et al.  Survey of maneuvering target tracking. Part I. Dynamic models , 2003 .

[20]  Anil K. Jain.  Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[21]  Vitaly Kober,et al.  Accuracy of location measurement of a noisy target in a nonoverlapping background , 1996 .

[22]  J W Goodman,et al.  Optimal binary phase-only matched filters. , 1988, Applied optics.

[23]  Ting Rui,et al.  Object tracking using particle filter in the wavelet subspace , 2013, Neurocomputing.

[24]  Tieniu Tan,et al.  A survey on visual surveillance of object motion and behaviors , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[25]  Bahram Javidi,et al.  Optimum filter for detecting a target in multiplicative noise and additive noise , 1997 .

[26]  S. Y. Chen,et al.  Kalman Filter for Robot Vision: A Survey , 2012, IEEE Transactions on Industrial Electronics.

[27]  A. Alfalou,et al.  Optimized pre-processing input plane GPU implementation of an optical face recognition technique using a segmented phase only composite filter , 2013 .

[28]  Rama Chellappa,et al.  Visual tracking and recognition using appearance-adaptive models in particle filters , 2004, IEEE Transactions on Image Processing.

[29]  Carlos Ferreira,et al.  Optical implementation of the weighted sliced orthogonal nonlinear generalized correlation for nonuniform illumination conditions. , 2002, Applied optics.

[30]  Vitaly Kober,et al.  Nonlinear synthetic discriminant function filters for illumination-invariant pattern recognition , 2008 .

[31]  M. Carter.  Computer graphics: Principles and practice , 1997 .

[32]  Huiyu Zhou,et al.  Object tracking using SIFT features and mean shift , 2009, Comput. Vis. Image Underst..

[33]  M S Alam,et al.  Decision optimization for face recognition based on an alternate correlation plane quantification metric. , 2012, Optics letters.

[34]  Henri H Arsenault,et al.  Intensity invariant nonlinear correlation filtering in spatially disjoint noise. , 2010, Applied optics.

[35]  H H Arsenault,et al.  Homomorphic cameo filter for pattern recognition that is invariant with changes in illumination. , 2000, Optics letters.

[36]  Mohammad S. Alam,et al.  Smart pattern recognition , 2013, Defense, Security, and Sensing.

[37]  I. A. Ovseevich,et al.  Adaptive correlation filters for pattern recognition , 2006, Pattern Recognition and Image Analysis.

[38]  Vitaly Kober,et al.  Target recognition under nonuniform illumination conditions. , 2009, Applied optics.

[39]  Vitaly Kober,et al.  Adaptive synthetic discriminant function filters for pattern recognition , 2006 .

[40]  Vitaly Kober,et al.  Multiclass pattern recognition using adaptive correlation filters with complex constraints , 2012 .

[41]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.