A multimodal person-following system for telepresence applications

This paper presents the design and implementation of a multimodal person-following system for a mobile telepresence robot. A color histogram matching and position matching algorithm was developed for a person-recognition function using Kinect sensors. Robot motion was controlled by adjusting its velocity according to the humans position in relation to the robot. The robot was able to follow the targeted person in various person-following modes, such as the back-following mode, the side-by-side accompaniment mode as well as the front-guiding mode. An obstacle avoidance function was also implemented using the virtual potential field algorithm.

[1]  Henrik I. Christensen,et al.  Tracking for following and passing persons , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Hiroshi Mizoguchi,et al.  Development of a Person Following Robot with Vision Based Target Detection , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Avinash C. Kak,et al.  Person Tracking with a Mobile Robot using Two Uncalibrated Independently Moving Cameras , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[4]  Yoram Koren,et al.  Potential field methods and their inherent limitations for mobile robot navigation , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[5]  Akihisa Ohya,et al.  Intelligent Escort Robot Moving together with Human -Interaction in Accompanying Behavior- , 2002 .

[6]  Maja J. Mataric,et al.  A laser-based people tracker , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[7]  Sonia Chernova,et al.  Mobile human-robot teaming with environmental tolerance , 2009, 2009 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[8]  Zhichao Chen,et al.  Person following with a mobile robot using binocular feature-based tracking , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Gerald Seet,et al.  A design for a mobile robotic avatar - Modular framework , 2012, 2012 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON).

[10]  脇元 修一,et al.  IEEE International Conference on Robotics and Automation (ICRA) におけるフルードパワー技術の研究動向 , 2011 .

[11]  Joelle Pineau,et al.  Experiences with a mobile robotic guide for the elderly , 2002, AAAI/IAAI.

[12]  Jian Cheng,et al.  Human tracking in the complicated background by Particle Filter using color-histogram and HOG , 2010, 2010 International Symposium on Intelligent Signal Processing and Communication Systems.

[13]  R. Simmons,et al.  COMPANION: A Constraint-Optimizing Method for Person-Acceptable Navigation , 2009, RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication.

[14]  Greg Welch,et al.  Animatronic Shader Lamps Avatars , 2009, ISMAR.

[15]  Gerald Seet,et al.  Design Considerations of a Robotic Head for Telepresence Applications , 2012, ICIRA.

[16]  Erwin Prassler,et al.  Motion coordination between a human and a mobile robot , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  Henrik I. Christensen,et al.  Design of an Office-Guide Robot for Social Interaction Studies , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Wolfram Burgard,et al.  The Interactive Museum Tour-Guide Robot , 1998, AAAI/IAAI.

[19]  Kai Oliver Arras,et al.  People tracking in RGB-D data with on-line boosted target models , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  E. Hall,et al.  The Hidden Dimension , 1970 .

[21]  Wolfram Burgard,et al.  Using Boosted Features for the Detection of People in 2D Range Data , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[22]  John C. Tang,et al.  Embodied social proxy: mediating interpersonal connection in hub-and-satellite teams , 2010, CHI.

[23]  Reid G. Simmons,et al.  Natural person-following behavior for social robots , 2007, 2007 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[24]  Gary R. Bradski,et al.  Learning OpenCV - computer vision with the OpenCV library: software that sees , 2008 .

[25]  Henrik I. Christensen,et al.  Autonomous person following for telepresence robots , 2013, 2013 IEEE International Conference on Robotics and Automation.