Recognizing human behaviors with vision sensors in a network robot system

A network robot system integrated with various types of robots via ubiquitous networks is a new concept which introduces an interactive robot living together with people. In this paper, we present a tangible network robot system composed of a mobile robot and vision sensors embedded in an environment, and show human behavior recognition methods necessary for providing diverse services desired by the people in good time. Typical human behaviors are described with logical sensors which are defined through data fusion processes spatially and temporally with the physical sensors of the mobile robot and those in the environment. Our system can be utilized to make human-robot communication and interaction friendlier and smarter

[1]  Junji Yamato,et al.  Recognizing human action in time-sequential images using hidden Markov model , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[2]  Mohan M. Trivedi,et al.  Real-time target localization and tracking by N-ocular stereo , 2000, Proceedings IEEE Workshop on Omnidirectional Vision (Cat. No.PR00704).

[3]  J. E. Handschin.  Monte Carlo techniques for prediction and filtering of non-linear stochastic processes , 1970 .

[4]  Tom Henderson,et al.  Logical sensor systems , 1984, J. Field Robotics.

[5]  Moshe Kam,et al.  Sensor Fusion for Mobile Robot Navigation , 1997, Proc. IEEE.

[6]  Robert T. Collins,et al.  Mean-shift blob tracking through scale space , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[7]  Dorin Comaniciu,et al.  Real-time tracking of non-rigid objects using mean shift , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[8]  L. Davis,et al.  Background and foreground modeling using nonparametric kernel density estimation for visual surveillance , 2002, Proc. IEEE.

[9]  Wolfram Burgard,et al.  Monte Carlo localization for mobile robots , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[10]  Mongi A. Abidi,et al.  Data fusion in robotics and machine intelligence , 1992 .

[11]  Masamichi Shimosaka,et al.  Human-like action recognition system using features extracted by human , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.