An efficient hybrid framework for visual tracking using Exponential Quantum Particle Filter and Mean Shift optimization

Visual object tracking is a key component in many computer vision applications. In real time visual tracking, abrupt changes in speed and direction of the object are demanding challenges. In this paper, we present an efficient visual tracking framework which can efficiently handle the above challenge, i.e., abrupt motion of the object. The framework is formulated by hybridizing the proposed Exponential Quantum Particle Filter (EQPF) with the traditional Mean-Shift (MS) optimization for efficient computation in object tracking task. The efficacy of EQPF in estimating the abrupt changes in functions, is tested on the standard Quail function, and then it has been successfully applied in object tracking algorithm. The effective multi-modal propagation strategies of Quantum Particle Filter (QPF) enables the tracker to handle the abrupt changes in speed and direction, whereas, the hybridization with MS enhances the computational efficiency by reducing the number of particles. Performance of the proposed method is assessed by experimenting on different publicly available challenging sequences. Both the subjective and objective evaluations are carried out to validate the superiority of the proposed tracking method over other state-of-the-art methods.

[1]  Matthew R. James,et al.  An Introduction to Quantum Filtering , 2006, SIAM Journal of Control and Optimization.

[2]  Bo Ma,et al.  Unscented Kalman filter for visual curve tracking , 2004, Image Vis. Comput..

[3]  Cor J. Veenman,et al.  Resolving Motion Correspondence for Densely Moving Points , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  G. Minty Monotone (nonlinear) operators in Hilbert space , 1962 .

[5]  Jing Li,et al.  Real-time visual tracking based on improved perceptual hashing , 2016, Multimedia Tools and Applications.

[6]  Francisco Madrigal,et al.  Evaluation of multiple motion models for multiple pedestrian visual tracking , 2013, 2013 10th IEEE International Conference on Advanced Video and Signal Based Surveillance.

[7]  Y. Chan,et al.  A Kalman Filter Based Tracking Scheme with Input Estimation , 1979, IEEE Transactions on Aerospace and Electronic Systems.

[8]  Bugao Xu,et al.  Fast compressive tracking combined with Kalman filter , 2019, Multimedia Tools and Applications.

[9]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[10]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[11]  Rama Chellappa,et al.  Dynamic feature point tracking in an image sequence , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[12]  Rolf Baxter,et al.  An Adaptive Motion Model for Person Tracking with Instantaneous Head-Pose Features , 2015, IEEE Signal Processing Letters.

[13]  A. M. Khalili,et al.  Quantum particle filter: a multiple mode method for low delay abrupt pedestrian motion tracking , 2015 .

[14]  Qi Wang,et al.  Multi-cue based tracking , 2014, Neurocomputing.

[15]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[16]  Bradley A. Chase,et al.  Single-shot parameter estimation via continuous quantum measurement , 2008, 0811.0601.

[17]  Juan José Pantrigo,et al.  Performance evaluation of a 3D multi-view-based particle filter for visual object tracking using GPUs and multicore CPUs , 2014, Journal of Real-Time Image Processing.

[18]  Ales Leonardis,et al.  A Two-Stage Dynamic Model for Visual Tracking , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[19]  John K. Stockton,et al.  REVIEW ARTICLE: Modelling and feedback control design for quantum state preparation , 2005 .

[20]  James M. Rehg,et al.  A multiple hypothesis approach to figure tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[21]  Dorin Comaniciu,et al.  Kernel-Based Object Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Rama Chellappa,et al.  Estimation of Object Motion Parameters from Noisy Images , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Qi Wang,et al.  Robust Superpixel Tracking via Depth Fusion , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[24]  Tieniu Tan,et al.  Real-time hand tracking using a mean shift embedded particle filter , 2007, Pattern Recognit..

[25]  Junseok Kwon,et al.  Visual tracking decomposition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[26]  Manoochehr Nahvi,et al.  Multispectral particle filter tracking using adaptive decision-based fusion of visible and thermal sequences , 2020, Multimedia Tools and Applications.

[27]  Rajiv Kapoor,et al.  Spider monkey optimisation assisted particle filter for robust object tracking , 2017, IET Comput. Vis..

[28]  C. Gouriéroux,et al.  Non-Gaussian State-Space Modeling of Nonstationary Time Series , 2008 .

[29]  A. C. Doherty,et al.  Sensitivity optimization in quantum parameter estimation , 2001 .

[30]  Younes Dhassi,et al.  Robust visual tracking based on adaptive gradient descent optimization of a cost function with parametric models of appearance and geometry , 2019, Multimedia Tools and Applications.

[31]  Honghai Liu,et al.  Jointly network: a network based on CNN and RBM for gesture recognition , 2018, Neural Computing and Applications.

[32]  BlakeAndrew,et al.  C ONDENSATION Conditional Density Propagation forVisual Tracking , 1998 .

[33]  Xuelong Li,et al.  Multi-spectral saliency detection , 2013, Pattern Recognit. Lett..

[34]  Chunhua Shen,et al.  Enhanced Kernel-Based Tracking for Monochromatic and Thermographic Video , 2006, 2006 IEEE International Conference on Video and Signal Based Surveillance.

[35]  Michael A. West,et al.  Combined Parameter and State Estimation in Simulation-Based Filtering , 2001, Sequential Monte Carlo Methods in Practice.

[36]  Zhang Xin-yan,et al.  Object tracking method based on particle filter of adaptive patches combined with multi-features fusion , 2018, Multimedia Tools and Applications.

[37]  Junyu Dong,et al.  Dense 3D facial reconstruction from a single depth image in unconstrained environment , 2017, Virtual Reality.

[38]  J. T Lewis,et al.  Quantum stochastic processes I , 1981 .

[39]  Tony P. Pridmore,et al.  Managing Particle Spread via Hybrid Particle Filter/Kernel Mean Shift Tracking , 2007, BMVC.

[40]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[41]  G. Kitagawa Non-Gaussian State—Space Modeling of Nonstationary Time Series , 1987 .