Multi sensor fusion for object detection using generalized feature models

This paper presents a multi sensor tmck- ing system and introduces the use of new generalized feature models. To detect and recognize objects as self- contained parts of the real world with two or more sen- sors of the same or of several types requires on the one hand fusion methods suitable for combining the data coming from the set of sensors in an optimal man- ner. This is realized by a sensor fusion principle on the basis of a Kalman filter. On the other hand it is necessary to model objects under the assumption that seveml sensors observe them. Therefore, we propose a new generalized 3D model which is suitable for this case. The paper presents a system for the detection and tracking of cars in road environments as an example. This system works with two sensors: a laser scanner and an infrared camera.

[1]  Pramod K. Varshney,et al.  Temporal fusion in multi-sensor target tracking systems , 2002, Proceedings of the Fifth International Conference on Information Fusion. FUSION 2002. (IEEE Cat.No.02EX5997).

[2]  Yaakov Bar-Shalom,et al.  Estimation and Tracking: Principles, Techniques, and Software , 1993 .

[3]  Y. Bar-Shalom Tracking and data association , 1988 .

[4]  Ed Waltz,et al.  The Principles and Practice of Image and Spatial Data Fusion , 2001 .

[5]  Volker Graefe,et al.  Applications of dynamic monocular machine vision , 1988, Machine Vision and Applications.

[6]  A. Polychronopoulos,et al.  Multiple sensor collision avoidance system for automotive applications using an IMM approach for obstacle tracking , 2002, Proceedings of the Fifth International Conference on Information Fusion. FUSION 2002. (IEEE Cat.No.02EX5997).

[7]  Otmar Loffeld,et al.  Estimationstheorie II: Anwendungen - Kalman-Filter , 1990 .

[8]  Dirk Wetzel Wissensbasierte Verkehrsszenenanalyse zur Fahrerunterstützung , 1996, DISKI.

[9]  Karl Brammer,et al.  Kalman-Bucy-Filter: Deterministische Beobachtung und stochastische Filterung , 1993 .

[10]  Ernst D. Dickmanns 4D-Szenenanalyse mit integralen raum-/zeitlichen Modellen , 1987, DAGM-Symposium.

[11]  Karl Rohr,et al.  Modellgestützte Bestimmung des Bewegungszustandes von Fußgängern in Realweltbildfolgen , 1990, DAGM-Symposium.

[12]  Yakov Bar-Shalom,et al.  Multitarget-Multisensor Tracking: Principles and Techniques , 1995 .

[13]  Henner Kollnig Ermittlung von Verkehrsgeschehen durch Bildfolgenauswertung , 1995, DISKI.