Multisensor-based human tracking behaviors with Markov chain Monte Carlo methods

For communication robots, it is important to find a communication partner and attract his or her attention in daily environments. In this paper, we propose a method for communication robots to detect and track a human actively in order to communicate with him or her. We apply Markov chain Monte Carlo methods (MCMC) to human detection and tracking behaviors with a humanoid robot that has four types of sensors. Thus, by utilizing our method, the robot can detect and track humans with irregdar motion in complicated daily environments. While tracking a human, it tries to attract attention by verbal and nonverbal communication. We verify the validity of our method by performing experiments with a humanoid-type communication robot named Robovie.

[1]  Horst-Michael Gross,et al.  Sensor Fusion for Vision and Sonar Based People Tracking on a Mobile Service Robot , 2002 .

[2]  David J. Fleet,et al.  People tracking using hybrid Monte Carlo filtering , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[3]  Brian Scassellati,et al.  How to build robots that make friends and influence people , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).

[4]  Tetsuo Ono,et al.  Robovie: an interactive humanoid robot , 2001 .

[5]  Tetsuo Ono,et al.  A constructive approach for developing interactive humanoid robots , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Michael Isard,et al.  A Smoothing Filter for CONDENSATION , 1998, ECCV.

[7]  Tetsunori Kobayashi,et al.  Modeling of conversational strategy for the robot participating in the group conversation , 2001, INTERSPEECH.

[8]  Nando de Freitas,et al.  Sequential Monte Carlo Methods in Practice , 2001, Statistics for Engineering and Information Science.

[9]  Timothy J. Robinson,et al.  Sequential Monte Carlo Methods in Practice , 2003 .

[10]  Marian Stewart Bartlett,et al.  A comparison of Gabor filter methods for automatic detection of facial landmarks , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[11]  Sergey Ioffe,et al.  Human tracking with mixtures of trees , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[12]  Tetsunori Kobayashi,et al.  A conversational robot utilizing facial and body expressions , 2000, Smc 2000 conference proceedings. 2000 ieee international conference on systems, man and cybernetics. 'cybernetics evolving to systems, humans, organizations, and their complex interactions' (cat. no.0.