Layered Path Planning with Human Motion Detection for Autonomous Robots

Reactively planning a path in a dynamic and unstructured environment is a key challenge for mobile robots and autonomous systems. Planning should consider factors including the long-term and short-term prediction, current environmental situation, and human context. In this chapter, we present a novel robotic path-planning method with human activity information in a large-scale three-dimensional (3D) environment. In the learning stage, this method uses human motion detection results and preliminary environmental information to build a long-term context model with a hidden Markov model (HMM) to describe and predict human activities in the environment. In the application stage, when a robot detects humans in the environment, it first uses the long-term context model to generate impedance areas in the environment. Then, the robot searches each area of the environment to find paths between key locations, such as escalators, to generate a Reactive Key Cost Map (RKCM), whose vertexes are those key locations and edges are generated paths. The graphs of all areas are connected using the key nodes in the subgraphs to build a global graph of the whole environment. Finally, the robot can reactively plan a path based on the current environmental situation and predicted human activities. This method enables robots to navigate robustly in a large-scale 3D environment with regular human activities, and it significantly reduces computing workload with proposed RKCM.

[1]  J.K. Aggarwal,et al.  Human activity analysis , 2011, ACM Comput. Surv..

[2]  Zoran Zivkovic,et al.  Improved adaptive Gaussian mixture model for background subtraction , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[3]  Prabal Dutta,et al.  PolyPoint: Guiding Indoor Quadrotors with Ultra-Wideband Localization , 2015, HotWireless@MobiCom.

[4]  Yi Xu,et al.  An integrated robotic system for transporting surgical tools in hospitals , 2016, 2016 Annual IEEE Systems Conference (SysCon).

[5]  Neal Patwari,et al.  See-Through Walls: Motion Tracking Using Variance-Based Radio Tomography Networks , 2011, IEEE Transactions on Mobile Computing.

[6]  Yang Zhao,et al.  Directed by Directionality: Benefiting from the Gain Pattern of Active RFID Badges , 2012, IEEE Transactions on Mobile Computing.

[7]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[8]  Changzhi Li,et al.  Portable coherent frequency-modulated continuous-wave radar for indoor human tracking , 2016, 2016 IEEE Topical Conference on Biomedical Wireless Technologies, Networks, and Sensing Systems (BioWireleSS).

[9]  Dariu Gavrila,et al.  The Visual Analysis of Human Movement: A Survey , 1999, Comput. Vis. Image Underst..

[10]  Hobart R. Everett,et al.  Mobile robot positioning: Sensors and techniques , 1997, J. Field Robotics.

[11]  Suresh Venkatasubramanian,et al.  Radio tomographic imaging and tracking of stationary and moving people via kernel distance , 2013, IPSN.

[12]  Bruno Sinopoli,et al.  ALPS: A Bluetooth and Ultrasound Platform for Mapping and Localization , 2015, SenSys.

[13]  Huan Tan,et al.  Human-Supervisory Distributed Robotic System Architecture for Healthcare Operation Automation , 2015, 2015 IEEE International Conference on Systems, Man, and Cybernetics.

[14]  Qian Du,et al.  A potential field method-based extension of the dynamic movement primitive algorithm for imitation learning with obstacle avoidance , 2011, 2011 IEEE International Conference on Mechatronics and Automation.

[15]  Aude Billard,et al.  On Learning, Representing, and Generalizing a Task in a Humanoid Robot , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[16]  Yoshihiko Nakamura,et al.  Keyframe compression and decompression for time series data based on the continuous hidden Markov model , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[17]  Kyuchang Kang,et al.  Hierarchically linked infinite hidden Markov model based trajectory analysis and semantic region retrieval in a trajectory dataset , 2017, Expert Syst. Appl..

[18]  Sean T Doherty,et al.  Tracking human activity and well-being in natural environments using wearable sensors and experience sampling. , 2014, Social science & medicine.

[19]  Qingmin Liao,et al.  An improved algorithm of multiple robots cooperation in obstacle existing environment , 2007, 2007 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[20]  Florent Lamiraux,et al.  Motion Planning and Obstacle Avoidance , 2016, Springer Handbook of Robotics, 2nd Ed..

[21]  Yang Zhao,et al.  Robust Estimators for Variance-Based Device-Free Localization and Tracking , 2011, IEEE Transactions on Mobile Computing.

[22]  Huan Tan,et al.  Towards safe robot-human collaboration systems using human pose detection , 2015, 2015 IEEE International Conference on Technologies for Practical Robot Applications (TePRA).

[23]  Fernando Seco Granja,et al.  Joint estimation of indoor position and orientation from RF signal strength measurements , 2013, International Conference on Indoor Positioning and Indoor Navigation.

[24]  Hobart R. Everett,et al.  Mobile Robot Positioning - Sensors and Techniques , 1997 .

[25]  Gaurav S. Sukhatme,et al.  An Experimental Study of Localization Using Wireless Ethernet , 2003, FSR.

[26]  Lydia E. Kavraki,et al.  Motion Planning , 2011, IEEE Robotics & Automation Magazine.

[27]  Huan Tan Imitation Learning and Behavior Generation in a Robot Team , 2012, DARS.

[28]  A. Ijspeert,et al.  Environmental monitoring using autonomous vehicles: a survey of recent searching techniques. , 2017, Current Opinion in Biotechnology.

[29]  Neal Patwari,et al.  Radio Tomographic Imaging with Wireless Networks , 2010, IEEE Transactions on Mobile Computing.

[30]  Maurizio Bocca,et al.  Enhancing the accuracy of radio tomographic imaging using channel diversity , 2012, 2012 IEEE 9th International Conference on Mobile Ad-Hoc and Sensor Systems (MASS 2012).

[31]  David González,et al.  A Review of Motion Planning Techniques for Automated Vehicles , 2016, IEEE Transactions on Intelligent Transportation Systems.

[32]  Huan Tan,et al.  Applying an Extension of Estimation of Distribution Algorithm (EDA) for Mobile Robots to Learn Motion Patterns from Demonstration , 2015, 2015 IEEE International Conference on Systems, Man, and Cybernetics.

[33]  Michael Bosse,et al.  Driving on Point Clouds: Motion Planning, Trajectory Optimization, and Terrain Assessment in Generic Nonplanar Environments , 2017, J. Field Robotics.

[34]  Yunhao Liu,et al.  Locating in fingerprint space: wireless indoor localization with little human intervention , 2012, Mobicom '12.