Calibrating Depth Sensors for Pedestrian Tracking Using a Robot as a Movable and Localized Landmark

Using multiple depth sensors enables us to accurately track pedestrians in real environments. Accurate pedestrian positions are essential for building an effective human-centered cyber world provided by location-based services. In particular, ceiling-mounted depth sensors can robustly track people in such environments. However, one important problem for this approach is the accurate calibration of the absolute sensor positions. This problem remains unsolved due to limited range and sensor distortions from a distance. Manual calibration is complicated and time-consuming, and the existing calibration method still has several limitations since it used a pedestrian as a movable landmark. Instead of a human landmark, we propose a method that uses a mobile robot as a movable and localized landmark to calibrate each sensor. We compared the calibration performance of the proposed and existing methods and showed that the former achieved more accurate calibration for both the absolute sensor and tracked pedestrian positions. Our proposed method with a mobile robot not only increased the accuracy of the calibration processes but also decreased human efforts.

[1]  Shahram Payandeh,et al.  Localization and identification of body extremities based on data from multiple depth sensors , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[2]  Takayuki Kanda,et al.  A Model of Distributional Handing Interaction for a Mobile Robot , 2013, Robotics: Science and Systems.

[3]  Takayuki Kanda,et al.  Abstracting People's Trajectories for Social Robots to Proactively Approach Customers , 2009, IEEE Transactions on Robotics.

[4]  Sander Oude Elberink,et al.  Accuracy and Resolution of Kinect Depth Data for Indoor Mapping Applications , 2012, Sensors.

[5]  Norihiro Hagita,et al.  SNAPCAT-3D: Calibrating networks of 3D range sensors for pedestrian tracking , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[6]  Takayuki Kanda,et al.  How would store managers employ social robots? , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[7]  Takayuki Kanda,et al.  Person Tracking in Large Public Spaces Using 3-D Range Sensors , 2013, IEEE Transactions on Human-Machine Systems.

[8]  Wolfram Burgard,et al.  Monte Carlo localization for mobile robots , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[9]  Alcherio Martinoli,et al.  Automatic calibration of ultra wide band tracking systems using a mobile robot: A person localization case-study , 2017, 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[10]  Nico Blodow,et al.  Towards 3D Point cloud based object maps for household environments , 2008, Robotics Auton. Syst..

[11]  Gaetano Borriello,et al.  Location Systems for Ubiquitous Computing , 2001, Computer.

[12]  Takayuki Kanda,et al.  Simulation-Based Behavior Planning to Prevent Congestion of Pedestrians Around a Robot , 2015, IEEE Transactions on Robotics.

[13]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using unit quaternions , 1987 .

[14]  Norihiro Hagita,et al.  Finding a person with a wearable acceleration sensor using a 3D position tracking system in daily environments , 2015, Adv. Robotics.

[15]  Max Lu,et al.  Acquiring Multi-Scale Images by Pan-Tilt-Zoom Control and Automatic Multi-Camera Calibration , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[16]  Takayuki Kanda,et al.  A Robot that Approaches Pedestrians , 2013, IEEE Transactions on Robotics.

[17]  Mohan S. Kankanhalli,et al.  Multi-Camera Coordination and Control in Surveillance Systems , 2015, ACM Trans. Multim. Comput. Commun. Appl..