I see you lying on the ground — Can I help you? Fast fallen person detection in 3D with a mobile robot

One important function in assistive robotics for home applications is the detection of emergency cases, like falls. In this paper, we present a new detection system which can run on a mobile robot to detect persons after a fall event robustly. The system is based on 3D Normal Distributions Transform (NDT) maps on which a powerful segmentation is applied. Segments most likely belonging to a person lying on the ground are grouped into clusters. After extracting features with a soft encoding approach, each cluster is classified separately. Our experiments show that the system is able to reliably detect fallen persons in real-time. It clearly outperforms other 3D state-of-the-art approaches. We can show that our system is able to handle even very challenging situations, where fallen persons are very close to other objects in the apartment. Such complex fall events often occur in real-world applications.

[1]  Andrew Y. Ng,et al.  The Importance of Encoding Versus Training with Sparse Coding and Vector Quantization , 2011, ICML.

[2]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[3]  Yihong Gong,et al.  Linear spatial pyramid matching using sparse coding for image classification , 2009, CVPR.

[4]  Ling Shao,et al.  A survey on fall detection: Principles and approaches , 2013, Neurocomputing.

[5]  Nicholas Roy,et al.  Lying Pose Recognition for Elderly Fall Detection , 2012 .

[6]  Inmaculada Plaza,et al.  Challenges, issues and trends in fall detection systems , 2013, Biomedical engineering online.

[7]  G. ÓLaighin,et al.  A proposal for the classification and evaluation of fall detectors Une proposition pour la classification et l'évaluation des détecteurs de chutes , 2008 .

[8]  Annupan Rodtook,et al.  Fall detection using directional bounding box , 2015, 2015 12th International Joint Conference on Computer Science and Software Engineering (JCSSE).

[9]  David A. McAllester,et al.  A discriminatively trained, multiscale, deformable part model , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Horst-Michael Groß,et al.  Generic NDT mapping in dynamic environments and its application for lifelong SLAM , 2015, Robotics Auton. Syst..

[11]  Pierre-Marc Jodoin,et al.  Lying-pose detection with training dataset expansion , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[12]  Horst-Michael Groß,et al.  IRON: A fast interest point descriptor for robust NDT-map matching and its application to robot localization , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[13]  Stefan Wermter,et al.  A Neurocognitive Robot Assistant for Robust Event Detection , 2016 .

[14]  Jean-Philippe Tarel,et al.  Real time obstacle detection in stereovision on non flat road geometry through "v-disparity" representation , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[15]  Horst-Michael Groß,et al.  Fallen Person Detection for Mobile Robots Using 3D Depth Data , 2013, 2013 IEEE International Conference on Systems, Man, and Cybernetics.

[16]  Tom Duckett,et al.  Scan registration for autonomous mining vehicles using 3D‐NDT , 2007, J. Field Robotics.

[17]  Alexandros Nanopoulos,et al.  Hubs in Space: Popular Nearest Neighbors in High-Dimensional Data , 2010, J. Mach. Learn. Res..

[18]  Horst-Michael Groß,et al.  Evaluation of multi feature fusion at score-level for appearance-based person re-identification , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[19]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[20]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[21]  Bernd Fritzke,et al.  A Growing Neural Gas Network Learns Topologies , 1994, NIPS.

[22]  Horst-Michael Groß,et al.  Robot companion for domestic health assistance: Implementation, test and case study under everyday conditions in private apartments , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[23]  Xinguo Yu.  Approaches and principles of fall detection for elderly and patient , 2008, HealthCom 2008 - 10th International Conference on e-health Networking, Applications and Services.

[24]  Thomas Martinetz,et al.  Learning Data Representations with Sparse Coding Neural Gas , 2008, ESANN.

[25]  Isabel N. Figueiredo,et al.  Exploring smartphone sensors for fall detection , 2016, mUX: The Journal of Mobile User Experience.

[26]  Vassilis P. Plagianakos,et al.  On-Line Fall Detection via Mobile Accelerometer Data , 2015, AIAI.

[27]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.