Multiperspective Thermal IR and Video Arrays for 3D Body Tracking and Driver Activity Analysis

This paper presents a multi-perspective (i.e., four camera views) multi-modal (i.e., thermal infrared and color) video based system for robust and real-time 3D tracking of important body parts.The multi-perspective characteristics of the system provides 3Dtrajectory of the body parts, while the multi-modal characteristics of the system provides robustness and reliability of feature detection and tracking. The application context for this research is that of intelligent vehicles and driver assistance systems. Experimental results demonstrate effectiveness of the proposed system.

[1]  Larry S. Davis,et al.  Background modeling and subtraction by codebook construction , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[2]  Sangho Park,et al.  Segmentation and tracking of interacting human body parts under occlusion and shadowing , 2002, Workshop on Motion and Video Computing, 2002. Proceedings..

[3]  Jake K. Aggarwal,et al.  A hierarchical Bayesian network for event recognition of human actions and interactions , 2004, Multimedia Systems.

[4]  Tarak Gandhi,et al.  Driver's view and vehicle surround estimation using omnidirectional video stream , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[5]  Mohan M. Trivedi,et al.  Occupant posture analysis with stereo and thermal infrared video: algorithms and experimental evaluation , 2004, IEEE Transactions on Vehicular Technology.

[6]  Mohan Trivedi,et al.  Vehicle Occupant Posture Analysis Using Voxel Data , 2002 .

[7]  Larry S. Davis,et al.  3-D model-based tracking of humans in action: a multi-view approach , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[8]  Anoop Sarkar,et al.  Learning Verb Argument Structure from Minimally Annotated Corpora , 2002, COLING.

[9]  Mohan M. Trivedi,et al.  Video arrays for real-time tracking of person, head, and face in an intelligent room , 2003, Machine Vision and Applications.

[10]  Thomas B. Moeslund,et al.  A Survey of Computer Vision-Based Human Motion Capture , 2001, Comput. Vis. Image Underst..

[11]  S.Y. Cheng,et al.  Human posture estimation using voxel data for "smart" airbag systems: issues and framework , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[12]  M.M. Trivedi,et al.  Design of an instrumented vehicle test bed for developing a human centered driver support system , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[13]  Emanuele Trucco,et al.  Introductory techniques for 3-D computer vision , 1998 .