Integrating Occlusion and Illumination Modeling for Object Tracking Using Image Annotation

Tracking occluded objects at different depths has become as extremely important component of study for any video sequence having wide applications in object tracking, scene recognition, coding, editing the videos and mosaicking. This paper experiments with the capabilities of image annotation contour based tracking for occluded object. Image annotation is applied on 3 similar normal video sequences varying in depth. In the experiment, one bike occludes the other at a depth of 60 cm, 80 cm and 100 cm respectively. The effect on tracking is also analyzed with illumination variations using 3 different light sources in video sequences having objects occluding one another at same depth. The paper finally studies the ability of annotation to track the occluded object based on pyramids with variation in depth further establishing a threshold at which the ability of the system to track the occluded object fails. The contour of both the individual objects can"t be tracked due to the distortion caused by overlapping of the object pyramids. The thresholds established can be used as a bench mark to estimate the capability of different softwares. The paper further computes the frame by frame error incurred by the system, supported by detailed simulations. This system can be effectively used to achieve flawless tracking as the error in motion tracking can be corrected. This can be of great interest to computer scientists while designing surveillance systems etc.

[1]  Hisashi Miyamori,et al.  A visual tracking system for sports video annotation in unconstrained environments , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[2]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[3]  Xiaoxu Wang,et al.  Automated 3D Motion Tracking Using Gabor Filter Bank, Robust Point Matching, and Deformable Models , 2010, IEEE Transactions on Medical Imaging.

[4]  S. Bakker,et al.  Biomechanics of cranial dynamics during daily living activities , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[5]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[6]  Thomas Brox,et al.  High Accuracy Optical Flow Estimation Based on a Theory for Warping , 2004, ECCV.

[7]  Rachid Deriche,et al.  Symmetrical Dense Optical Flow Estimation with Occlusions Detection , 2002, ECCV.

[8]  Michael J. Black,et al.  The Robust Estimation of Multiple Motions: Parametric and Piecewise-Smooth Flow Fields , 1996, Comput. Vis. Image Underst..

[9]  W. Marsden.  I and J , 2012 .

[10]  J. Weickert,et al.  Lucas/Kanade meets Horn/Schunck: combining local and global optic flow methods , 2005 .

[11]  G.M. Siouris,et al.  Tracking an incoming ballistic missile using an extended interval Kalman filter , 1997, IEEE Transactions on Aerospace and Electronic Systems.