Performance Assessment of a People Tracker for Social Robots

Service robots are becoming more and more pervasive in natural environments where human beings actually carry out daily duties. One of the main enabler in these scenario is the capability of such a system to understand the positions and the motions of people moving in its surroundings. In this paper, we will investigate the effectiveness of a people tracking system that uses a stereo camera as the sensor and then use the gathered data in an estimation algorithm to continuously track their position in the environment. Experiments in a laboratory are carried out to characterise and evaluate the performance of such a system and establish its suitability for an application on an actual service robot.

[1]  Luigi Palopoli,et al.  Indoor Localization of Mobile Robots Through QR Code Detection and Dead Reckoning Data Fusion , 2017, IEEE/ASME Transactions on Mechatronics.

[2]  Nassir Navab,et al.  Human skeleton tracking from depth data using geodesic distances and optical flow , 2012, Image Vis. Comput..

[3]  Luigi Palopoli,et al.  Simulating Passivity for Robotic Walkers via Authority-Sharing , 2018, IEEE Robotics and Automation Letters.

[4]  D. Macii,et al.  Optimal landmark placement for indoor positioning using context information and multi-sensor data , 2018, 2018 IEEE International Instrumentation and Measurement Technology Conference (I2MTC).

[5]  Axel Legay,et al.  Efficient customisable dynamic motion planning for assistive robots in complex human environments , 2015, J. Ambient Intell. Smart Environ..

[6]  Hee-Jun Kang,et al.  Golf Swing Motion Tracking Using Inertial Sensors and a Stereo Camera , 2014, IEEE Transactions on Instrumentation and Measurement.

[7]  Daniele Fontanelli,et al.  Towards a Predictive Behavioural Model for Service Robots in Shared Environments , 2018, 2018 IEEE Workshop on Advanced Robotics and its Social Impacts (ARSO).

[8]  Yaser Sheikh,et al.  OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  José Luis Lázaro,et al.  Embedded Vision Modules for Tracking and Counting People , 2009, IEEE Transactions on Instrumentation and Measurement.

[10]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[11]  Alessandro Ferrero,et al.  Camera as the instrument: the rising trend of vision based measurement , 2014, IEEE Instrumentation & Measurement Magazine.

[12]  Alan L. Jennings,et al.  Optical flow background subtraction for real-time PTZ camera object tracking , 2013, 2013 IEEE International Instrumentation and Measurement Technology Conference (I2MTC).

[13]  Tatsuo Arai,et al.  Human-Robot Collision Avoidance using a modified Social force Model with Body Pose and Face Orientation , 2013, Int. J. Humanoid Robotics.

[14]  Jean-Paul Laumond,et al.  On the nonholonomic nature of human locomotion , 2008, Auton. Robots.

[15]  Daniele Fontanelli,et al.  Walking Ahead: The Headed Social Force Model , 2017, PloS one.

[16]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Luigi Palopoli,et al.  Path Following With Authority Sharing Between Humans and Passive Robotic Walkers Equipped With Low-Cost Actuators , 2017, IEEE Robotics and Automation Letters.

[18]  Luigi Palopoli,et al.  Flexible Indoor Localization and Tracking Based on a Wearable Platform and Sensor Data Fusion , 2014, IEEE Transactions on Instrumentation and Measurement.

[19]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[20]  Helbing,et al.  Social force model for pedestrian dynamics. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[21]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Luca De Vito,et al.  Measurements and sensors for motion tracking in motor rehabilitation , 2014, IEEE Instrumentation & Measurement Magazine.

[23]  Valerio Magnago,et al.  Ruling the Control Authority of a Service Robot Based on Information Precision , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[24]  Yaser Sheikh,et al.  Hand Keypoint Detection in Single Images Using Multiview Bootstrapping , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Luigi Palopoli,et al.  Reactive Planning for Assistive Robots , 2018, IEEE Robotics and Automation Letters.

[26]  Yan Liu,et al.  Accurate indoor tracking using a mobile phone and non-overlapping camera sensor networks , 2012, 2012 IEEE International Instrumentation and Measurement Technology Conference Proceedings.

[27]  Varun Ramakrishna,et al.  Convolutional Pose Machines , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).