Shape and motion-based pedestrian detection in infrared images: a multi sensor approach

This work deals with the detection and tracking of pedestrians. The focus of the investigations was on methods, which allow a precise and detailed description of both significant features of pedestrians: shape and motion. Since the practical employment of such methods requires a good initialization and tracking, a multi sensor system was developed consisting of a far infrared camera, a laser scanning device and ego motion sensors. To handle the combination of the information of the different sensors a Kalman filter based data fusion is used. Arranging a set of Kalman filters in parallel, a multi sensor/multi target tracking system was created. The system structure combines a straightforward with a backward loop methodology to combine fast initiation functions with more affordable verification functions. Therefore formerly known semiautomatic image processing methods work fully automatically in the system. The analysis of the estimated optical flow regarding the typical human motion as well as the analysis of shape parameters using active contour models is performed. The multi sensor/multi target tracking system is installed on a test vehicle to obtain practical results, which are also discussed in this article.

[1]  Junaed Sattar.  Snakes , Shapes and Gradient Vector Flow , 2022 .

[2]  Taein Lee,et al.  Active contour models , 2005 .

[3]  Keiichi Yamada,et al.  Comparison between infrared-image-based and visible-image-based approaches for pedestrian detection , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[4]  Sridhar Lakshmanan,et al.  A motion and shape-based pedestrian detection algorithm , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[5]  Alberto Broggi,et al.  Pedestrian detection in infrared images , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[6]  Xia Liu,et al.  Pedestrian detection and tracking with night vision , 2005, IEEE Transactions on Intelligent Transportation Systems.

[7]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[8]  Anil K. Jain.  Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[9]  G. Wanielik,et al.  Multi sensor based tracking of pedestrians: a survey of suitable movement models , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[10]  J. Little,et al.  Recognizing People by Their Gait: The Shape of Motion , 1998 .

[11]  Xia Liu,et al.  Pedestrian detection using stereo night vision , 2004, IEEE Transactions on Vehicular Technology.

[12]  Kikuo Fujimura,et al.  Pedestrian detection and tracking with night vision , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[13]  Jan Giebel,et al.  Shape-based pedestrian detection and tracking , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[14]  W. von Seelen,et al.  Walking pedestrian recognition , 1999, Proceedings 199 IEEE/IEEJ/JSAI International Conference on Intelligent Transportation Systems (Cat. No.99TH8383).

[15]  Hans-Hellmut Nagel,et al.  On the Estimation of Optical Flow: Relations between Different Approaches and Some New Results , 1987, Artif. Intell..