Using a Deep Learning Model on Images to Obtain a 2D Laser People Detector for a Mobile Robot

Recent improvements in deep learning techniques applied to images allow the detection of people with a high success rate. However, other types of sensors, such as laser rangefinders, are still useful due to their wide field of vision and their ability to operate in different environments and lighting conditions. In this work we use an interesting computational intelligence technique such as the deep learning method to detect people in images taken by a mobile robot. The masks of the people in the images are used to automatically label a set of samples formed by 2D laser range data that will allow us to detect the legs of people present in the scene. The samples are geometric characteristics of the clusters built from the laser data. The machine learning algorithms are used to learn a classifier that is capable of detecting people from only 2D laser range data. Our people detector is compared to a state-of-the-art classifier. Our proposal achieves a higher value of F1 in the test set using an unbalanced dataset. To improve accuracy, the final classifier has been generated from a balanced training set. This final classifier has also been evaluated using a test set in which we have obtained very high accuracy values in each class. The contribution of this work is 2-fold. On the one hand, our proposal performs an automatic labeling of the samples so that the dataset can be collected under real operating conditions. On the other hand, the robot can detect people in a wider field of view than if we only used a camera, and in this way can help build more robust behaviors. © 2019 The Authors. Published by Atlantis Press SARL. This is an open access article distributed under the CC BY-NC 4.0 license (http://creativecommons.org/licenses/by-nc/4.0/).

[1]  Yi Li,et al.  R-FCN: Object Detection via Region-based Fully Convolutional Networks , 2016, NIPS.

[2]  Joelle Pineau,et al.  Person tracking and following with 2D laser scanners , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[3]  Satish Prabhu,et al.  Real Time Skeleton Tracking based Human Recognition System using Kinect and Arduino , 2015 .

[4]  Roland Siegwart,et al.  Human detection using multimodal and multidimensional features , 2008, 2008 IEEE International Conference on Robotics and Automation.

[5]  Wolfram Burgard,et al.  Using Boosted Features for the Detection of People in 2D Range Data , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[6]  Basilio Sierra,et al.  RGB-D, Laser and Thermal Sensor Fusion for People following in a Mobile Robot , 2013 .

[7]  Petros Daras,et al.  Real-Time Skeleton-Tracking-Based Human Action Recognition Using Kinect Data , 2014, MMM.

[8]  Wolfram Burgard,et al.  People Tracking with Mobile Robots Using Sample-Based Joint Probabilistic Data Association Filters , 2003, Int. J. Robotics Res..

[9]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[10]  Takafumi Matsumaru,et al.  Human Detecting and Following Mobile Robot Using a Laser Range Sensor , 2014, J. Robotics Mechatronics.

[11]  Woojin Chung,et al.  The Detection and Following of Human Legs Through Inductive Approaches for a Mobile Robot With a Single Laser Range Finder , 2012, IEEE Transactions on Industrial Electronics.

[12]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[13]  María Malfaz,et al.  Vision-based people detection using depth information for social robots , 2017 .

[14]  Rafael Muñoz-Salinas,et al.  A new fuzzy based algorithm for solving stereo vagueness in detecting and tracking people , 2012, Int. J. Approx. Reason..