Multi-Modal Tracking of Interacting Targets Using Gaussian Approximations

We introduce a modular tracker architecture that combines the advantages of several simple and rapidly performing tracking algorithms. Robust tracking is facilitated by fra merate or near-frame-rate processing. A Kalman filter is used to integrate tracking results across detection modules and over time. Processing regions are smoothly localized by weighting with a Gaussian that is dimensioned according to the target sizes and uncertainties estimated by the Kalman filter. From this Gaussian mask, Gaussian approximations of known nearby targets are subtracted to allow individual tracking of interacting targets, that can be merged and spli t based on Mahalanobis distances and a robust version of connected components. The result is an adaptive tracker that can robustly track at video frame rates several targets , each of which corresponds to one or more individual objects. Its performance degrades gracefully with increased system load.

[1]  Karl Brammer,et al.  Kalman-Bucy filters , 1989 .

[2]  James W. Davis,et al.  The Representation and Recognition of Action Using Temporal Templates , 1997, CVPR 1997.

[3]  Alex Pentland,et al.  Pfinder: Real-Time Tracking of the Human Body , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Larry S. Davis,et al.  W4S : A real-time system for detecting and tracking people in 2 D , 1998, eccv 1998.

[5]  W. Eric L. Grimson,et al.  Using adaptive tracking to classify and monitor activities in a site , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[6]  L. Davis,et al.  W 4 S: a Real-time System for Detecting and Tracking People in 2 1 2 D , 1998 .

[7]  Gregory D. Hager,et al.  X Vision: A Portable Substrate for Real-Time Vision Applications , 1998, Comput. Vis. Image Underst..

[8]  Larry S. Davis,et al.  W4S: A real-time system detecting and tracking people in 2 1/2D , 1998, ECCV.

[9]  James L. Crowley,et al.  Face-Tracking and Coding for Video Compression , 1999, ICVS.

[10]  James L. Crowley,et al.  Robust face tracking using color , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[11]  Stephen J. McKenna,et al.  Tracking interacting people , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[12]  James L. Crowley,et al.  Object Recognition Using Coloured Receptive Fields , 2000, ECCV.