Silhouette labeling and tracking in calibrated omnidirectional video sequences

In this paper, we present a methodology for labeling and tracking human silhouettes in indoor videos acquired by omnidirectional (fish-eye) cameras. The proposed methodology is based on a fisheye camera model that employs a spherical optical element and central projection, which has been calibrated to allow extraction of 3D geometry clues as described in [11]. The proposed algorithm requires input from a video segmentation algorithm, generating segmented human silhouettes. The history of a person's real position, as well as his appearance in the form of R, G, B color values are utilized in the described methodology. According to initial experimentation, the proposed algorithm is able to track efficiently multiple silhouettes with prolonged partial or full occlusions and it can calculate the trajectory of each silhouette. The algorithm can operate in the presence of imperfect segmentation, with the persons moving in any direction with respect to the camera, thus producing radically different shapes and color appearances.

[1]  Vassilis P. Plagianakos,et al.  Fisheye camera modeling for human segmentation refinement in indoor videos , 2013, PETRA '13.

[2]  Dorin Comaniciu,et al.  Kernel-Based Object Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Rongrong Ji,et al.  3D silhouette tracking with occlusion inference , 2010, Visual Communications and Image Processing.

[4]  Vassilis P. Plagianakos,et al.  Refinement of human silhouette segmentation in omni-directional indoor videos , 2014, Comput. Vis. Image Underst..

[5]  F. Porikli,et al.  Recurrent Tracking using Multifold Consistency , 2009 .

[6]  Larry L. Peterson,et al.  Reasoning about naming systems , 1993, TOPL.

[7]  Luc Van Gool,et al.  An adaptive color-based particle filter , 2003, Image Vis. Comput..

[8]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[9]  S. Shankar Sastry,et al.  Markov Chain Monte Carlo Data Association for Multi-Target Tracking , 2009, IEEE Transactions on Automatic Control.

[10]  Afshin Dehghan,et al.  Part-based multiple-person tracking with partial occlusion handling , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Jitendra Malik,et al.  Fast vehicle detection with probabilistic feature grouping and its application to vehicle tracking , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[12]  James J. Little,et al.  A Boosted Particle Filter: Multitarget Detection and Tracking , 2004, ECCV.

[13]  Robert T. Collins,et al.  Mean-shift blob tracking through scale space , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[14]  Simon Baker,et al.  Lucas-Kanade 20 Years On: A Unifying Framework , 2004, International Journal of Computer Vision.

[15]  Ehud Rivlin,et al.  Mean Shift tracking with multiple reference color histograms , 2010, Comput. Vis. Image Underst..

[16]  Ian D. Reid,et al.  Stable multi-target tracking in real-time surveillance video , 2011, CVPR 2011.

[17]  Jiri Matas,et al.  Face-TLD: Tracking-Learning-Detection applied to faces , 2010, 2010 IEEE International Conference on Image Processing.

[18]  Henry Medeiros,et al.  Distributed Object Tracking Using a Cluster-Based Kalman Filter in Wireless Camera Networks , 2008, IEEE Journal of Selected Topics in Signal Processing.

[19]  Vladimir Pavlovic,et al.  Face tracking and recognition with visual constraints in real-world videos , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Dorin Comaniciu,et al.  Real-time tracking of non-rigid objects using mean shift , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).