Person-following for Telepresence Robots Using Web Cameras

Many existing mobile robotic telepresence systems have equipped with two web cameras, one is a forward-facing camera (FF camera) for video communication, and the other is a downward-facing camera (DF camera) for robot navigation. In this paper, we present a new framework of autonomous person-following for telepresence robots using the two web cameras. Based on correlation filters tracking methods, we use the FF camera to track the upper body of a person and the DF camera to localize and track the person’s feet. We improve the robustness of feet trackers, consisting of a left foot tracker and a right foot tracker, by making full use of the spatial constraints of the human body parts. We conducted experiments on tracking in different environmental situations and real person-following scenario to evaluate the effectiveness of our method.

[1]  Henrik I. Christensen,et al.  Autonomous person following for telepresence robots , 2013, 2013 IEEE International Conference on Robotics and Automation.

[2]  Takashi Tsubouchi,et al.  People Tracking Using a Robot in Motion with Laser Range Finder , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Michael Felsberg,et al.  Discriminative Scale Space Tracking , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Youngwoo Yoon,et al.  Depth assisted person following robots , 2013, 2013 IEEE RO-MAN.

[5]  Sonia Chernova,et al.  Mobile human-robot teaming with environmental tolerance , 2009, 2009 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[6]  Jiaxu Leng,et al.  Real-Time RGB-D Visual Tracking With Scale Estimation and Occlusion Handling , 2018, IEEE Access.

[7]  Jun Miura,et al.  Identification of a specific person using color, height, and gait features for a person following robot , 2016, Robotics Auton. Syst..

[8]  John K. Tsotsos,et al.  Person Following Robot Using Selected Online Ada-Boosting with Stereo Camera , 2017, 2017 14th Conference on Computer and Robot Vision (CRV).

[9]  Michael Felsberg,et al.  Adaptive Color Attributes for Real-Time Visual Tracking , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Yasushi Yagi,et al.  Development of a human-tracking robot using QR code recognition , 2011, 2011 17th Korea-Japan Joint Workshop on Frontiers of Computer Vision (FCV).

[11]  Xianzhong Dai,et al.  A Robust Person Tracking and Following Approach for Mobile Robot , 2007, 2007 International Conference on Mechatronics and Automation.

[12]  John Canny,et al.  PRoP : Personal Roving Presence , 2007 .

[13]  Joelle Pineau,et al.  Person tracking and following with 2D laser scanners , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[14]  Ahmad Zaki Shukor,et al.  Object Tracking and Following Robot Using Color-Based Vision Recognition for Library Environment , 2018 .

[15]  Ying Li,et al.  Human feet tracking guided by locomotion model , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[16]  Qinyuan Ren,et al.  People Following System Based on LRF , 2018, 2018 11th International Workshop on Human Friendly Robotics (HFR).

[17]  Reid G. Simmons,et al.  Natural person-following behavior for social robots , 2007, 2007 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[18]  Stasinos Konstantopoulos,et al.  Detecting and Measuring Human Walking in Laser Scans , 2018, SETN.

[19]  Makoto Mizukawa,et al.  Research on person following system based on RGB-D features by autonomous robot with multi-Kinect sensor , 2014, 2014 IEEE/SICE International Symposium on System Integration.

[20]  Rui Caseiro,et al.  High-Speed Tracking with Kernelized Correlation Filters , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Bin Xu,et al.  Telepresence Interaction by Touching Live Video Images , 2015, ArXiv.

[22]  Wolfram Burgard,et al.  Using Boosted Features for the Detection of People in 2D Range Data , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[23]  Mahmoud Tarokh,et al.  Vision-based robotic person following in fast walking , 2014, 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[24]  Junzhi Yu,et al.  A human-following approach using binocular camera , 2017, 2017 IEEE International Conference on Mechatronics and Automation (ICMA).