On-line Object Tracking for Colour Video Analysis

Real-time object tracking is recently becoming more and more important in the field of video analysis and processing. Applications like traffic control, user?computer interaction, on-line video processing and production and video surveillance need reliable and economically affordable video tracking tools. It seems, however, that most of the available solutions are computationally intensive and sometimes require expensive video hardware, quite often without guaranteeing a suitable level of reliability. In this paper, we present a new approach to real-time object tracking from colour video sequences. It relies on contours in order to track the shape, position and orientation of objects, without exploiting snakes or “traditional” active contours. A closed-loop control approach is adopted to enforce motion tracking stability, while a separate shape model is maintained, featuring a two-stage model and a median filtering technique to cope with temporary occlusions and noise. The system was tested in several different environments with different constraints, and gave very encouraging performance. Experimental results are reported and commented on.

[1]  Dimitris N. Metaxas,et al.  Shape and Nonrigid Motion Estimation Through Physics-Based Synthesis , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  C Tomasi,et al.  Shape and motion from image streams: a factorization method. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[3]  Rangachar Kasturi,et al.  Machine vision , 1995 .

[4]  Demetri Terzopoulos,et al.  Real-time computer vision , 1995 .

[5]  H. S. Sawhney,et al.  Intelligent interactive image outlining using spline snakes , 1994, Proceedings of 1994 28th Asilomar Conference on Signals, Systems and Computers.

[6]  Yves Jean,et al.  Real time tracking for enhanced tennis broadcasts , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[7]  Richard Szeliski,et al.  Physically based and probabilistic models for computer vision , 1991, Optics & Photonics.

[8]  Yi Li,et al.  Human posture recognition using multi-scale morphological method and Kalman motion estimation , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[9]  Brian Scassellati,et al.  Retrieving images by 2D shape: a comparison of computation methods with human perceptual judgments , 1994, Electronic Imaging.

[10]  E. R. Davies.  Machine vision , 1990 .

[11]  Hironobu Fujiyoshi,et al.  Real-time human motion analysis by image skeletonization , 1998, Proceedings Fourth IEEE Workshop on Applications of Computer Vision. WACV'98 (Cat. No.98EX201).

[12]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[13]  Stephen M. Smith,et al.  ASSET-2: Real-Time Motion Segmentation and Shape Tracking , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Alex Pentland,et al.  Recursive Estimation of Motion, Structure, and Focal Length , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Rita Cucchiara,et al.  Real-time detection of moving vehicles , 1999, Proceedings 10th International Conference on Image Analysis and Processing.

[16]  Suya You,et al.  Natural Feature Tracking for Augmented Reality , 1999, IEEE Trans. Multim..

[17]  Laurent D. Cohen,et al.  Finite-Element Methods for Active Contour Models and Balloons for 2-D and 3-D Images , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Shaogang Gong,et al.  Tracking colour objects using adaptive mixture models , 1999, Image Vis. Comput..

[19]  Emanuele Trucco,et al.  Making good features track better , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[20]  Ramesh C. Jain,et al.  Dynamic vision , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[21]  Gregory D. Hager,et al.  Real-time tracking of image regions with changes in geometry and illumination , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[22]  Georgios Tziritas,et al.  Adaptive detection and localization of moving objects in image sequences , 1999, Signal Process. Image Commun..

[23]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Shaogang Gong,et al.  Tracking and segmenting people in varying lighting conditions using colour , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[25]  Michael Isard,et al.  Active Contours , 2000, Springer London.

[26]  Giancarlo Iannizzotto,et al.  Fast and accurate edge-based segmentation with no contour smoothing in 2-D real images , 2000, IEEE Trans. Image Process..

[27]  Milan Sonka,et al.  Image Processing, Analysis and Machine Vision , 1993, Springer US.

[28]  Alok Gupta,et al.  Dynamic Programming for Detecting, Tracking, and Matching Deformable Contours , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Saburo Tsuji,et al.  Determining motion of nonrigid objects by active tubes , 1992, [1992] Proceedings. 11th IAPR International Conference on Pattern Recognition.

[30]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[31]  James M. Rehg,et al.  Statistical Color Models with Application to Skin Detection , 2004, International Journal of Computer Vision.

[32]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[33]  Shaogang Gong,et al.  Dynamic vision , 2000 .

[34]  Roland T. Chin,et al.  Deformable contours: modeling and extraction , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[35]  Andrew Blake,et al.  Separability of pose and expression in facial tracking and animation , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[36]  Alex Pentland,et al.  Pfinder: Real-Time Tracking of the Human Body , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  Mubarak Shah,et al.  A fast algorithm for active contours , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[38]  Giancarlo Iannizzotto,et al.  Real-time object tracking with movels and affine transformations , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[39]  Larry S. Davis,et al.  Towards 3-D model-based tracking and recognition of human movement: a multi-view approach , 1995 .