Detecting moving humans using color and infrared video

We approach the task of human silhouette extraction from color and infrared video using automatic image registration. Image registration between color and thermal images is a challenging problem due to the difficulties associated with finding correspondence. However, the moving people in a static scene provide cues to address this problem. In this paper, we propose a hierarchical scheme to automatically find the correspondence between the preliminary human silhouettes extracted from color and infrared video for image registration. Next, we discuss some strategies for probabilistically combining cues from registered color and thermal images. It is shown that the proposed approach achieves good results for image registration and human silhouette extraction. Experimental results also show a comparison of sensor fusion strategies and demonstrate the improvement in performance for human silhouette extraction.

[1]  Joseph Wilder,et al.  Comparison of visible and infra-red imagery for face recognition , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[2]  Edward H. Adelson,et al.  Analyzing and recognizing walking figures in XYT , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Bir Bhanu,et al.  Kinematic-based human motion analysis in infrared sequences , 2002, Sixth IEEE Workshop on Applications of Computer Vision, 2002. (WACV 2002). Proceedings..

[4]  Yao Jianchao.  Image registration based on both feature and intensity matching , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[5]  Luís A. Alexandre,et al.  On combining classifiers using sum and product rules , 2001, Pattern Recognit. Lett..

[6]  J. Little,et al.  Recognizing People by Their Gait: The Shape of Motion , 1998 .

[7]  Yasunari Yoshitomi,et al.  Effect of sensor fusion for recognition of emotional states using voice, face image and thermal image of face , 2000, Proceedings 9th IEEE International Workshop on Robot and Human Interactive Communication. IEEE RO-MAN 2000 (Cat. No.00TH8499).

[8]  Hiroshi Murase,et al.  Moving object recognition in eigenspace representation: gait analysis and lip reading , 1996, Pattern Recognit. Lett..

[9]  Bir Bhanu,et al.  Multistrategy fusion using mixture model for moving object detection , 2001, Conference Documentation International Conference on Multisensor Fusion and Integration for Intelligent Systems. MFI 2001 (Cat. No.01TH8590).

[10]  H. D. Arlowe.  Thermal detection contrast of human targets , 1992, Proceedings 1992 International Carnahan Conference on Security Technology: Crime Countermeasures.

[11]  M. Viergever,et al.  Medical image matching-a review with classification , 1993, IEEE Engineering in Medicine and Biology Magazine.

[12]  Mark S. Nixon,et al.  Recognising humans by gait via parametric canonical space , 1999, Artif. Intell. Eng..

[13]  J. Fitzpatrick,et al.  Adaptive search space scaling in digital image registration. , 1989, IEEE transactions on medical imaging.