Interacting multiple model (IMM) Kalman filters for robust high speed human motion tracking

Accurate and robust tracking of humans is of growing interest in the image processing and computer vision communities. The ability of a vision system to track the subjects and accurately, predict their future locations is critical to many surveillance and camera control applications. Further, an inference of the type of motion as well as to rapidly detect and switch between motion models is critical since in some applications the switching time between motion models can be extremely small. The interacting multiple model (IMM) Kalman filter provides a powerful framework for performing the tracking of both the motion as well as the shape of these subjects. The tracking system utilizes a simple geometric shape primitive such as an ellipse to define a bounding extent of the subject. The utility of the IMM paradigm for rapid model switching and behaviour detection is shown for a passenger airbag suppression system in an automobile. The simplicity, of the methods and the robustness of the underlying IMM filtering make the framework well suited for low-cost embedded real-time motion sequence analysis systems.

[1]  Christoph Bregler,et al.  Learning and recognizing human dynamics in video sequences , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[2]  Ludwig Listl,et al.  Fast range imaging by CMOS sensor array through multiple double short time integration (MDSI) , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[3]  H. Nagel,et al.  Tracking of persons in monocular image sequences , 1997, Proceedings IEEE Nonrigid and Articulated Motion Workshop.

[4]  (54) AUTOMOTIVE OCCUPANT SENSOR SYSTEM AND METHOD OF OPERATION BY SENSOR FUSION SENSORSYSTEM ZUR ERFASSUNG VON FAHRZEUGINSASSEN UND BETRIEBSVERFAHREN UNTER VERWENDUNG VON FUSIONIERTEN SENSORINFORMATIONEN SYSTEME DE DETECTION D’OCCUPATION D’UNE AUTOMOBILE ET PROCEDE PERMETTANT SON FONCTIONNEMENT FAIS , 2022 .

[5]  Mikko Pekkarinen,et al.  Multiple model approaches to multisensor tracking , 2000 .

[6]  Brian K Blackburn,et al.  Apparatus and method for controlling occupant restraint system , 1994 .

[7]  Andrew Blake,et al.  Tracking through singularities and discontinuities by random sampling , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[8]  Michael Isard,et al.  A mixed-state condensation tracker with automatic model-switching , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[9]  Arthur Gelb,et al.  Applied Optimal Estimation , 1974 .

[10]  John Krumm,et al.  Video occupant detection for airbag deployment , 1998, Proceedings Fourth IEEE Workshop on Applications of Computer Vision. WACV'98 (Cat. No.98EX201).

[11]  Y. Bar-Shalom,et al.  The interacting multiple model algorithm for systems with Markovian switching coefficients , 1988 .