Human-guided robot 3D mapping using virtual reality technology

Map building is a fundamental task in many robotic applications. In this paper, we propose a novel approach for 3D mapping of indoor environments which allows a robot avatar to collaborate with a human seamlessly through a virtual reality (VR) device. The 3D map is created using the 3D data from an RGB-D camera mounted on the robot and simultaneously transmitted to a remote server, and then rendered to the VR device. On the other hand, the intentions of the user are inferred using the motion of the head movement based on hidden Markov models (HMMs), and then interpreted into commands to control the robot. We implement the proposed approach based on a modified Pioneer robot platform. The experimental results show the feasibility of the proposed system.

[1]  Hugh F. Durrant-Whyte,et al.  Simultaneous localization and mapping: part I , 2006, IEEE Robotics & Automation Magazine.

[2]  Cyrill Stachniss,et al.  Robotic Mapping and Exploration , 2009, Springer Tracts in Advanced Robotics.

[3]  G. Swaminathan.  Robot Motion Planning , 2006 .

[4]  Lindsay Kleeman,et al.  Interactive SLAM using Laser and Advanced Sonar , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[5]  Kun Zhou,et al.  An interactive approach to semantic modeling of indoor scenes with an RGBD camera , 2012, ACM Trans. Graph..

[6]  Jizhong Xiao,et al.  Fast visual odometry and mapping from RGB-D data , 2013, 2013 IEEE International Conference on Robotics and Automation.

[7]  Gerhard Lakemeyer,et al.  Exploring artificial intelligence in the new millennium , 2003 .

[8]  Gerhard Rigoll,et al.  Hidden Markov model based continuous online gesture recognition , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[9]  Michael Milford.  Robotic Mapping Methods , 2008 .

[10]  Sebastian Thrun,et al.  Robotic mapping: a survey , 2003 .

[11]  Rodrigo Ventura,et al.  Interactive 3D scan-matching using RGB-D data , 2012, Proceedings of 2012 IEEE 17th International Conference on Emerging Technologies & Factory Automation (ETFA 2012).

[12]  Yoram Singer,et al.  The Hierarchical Hidden Markov Model: Analysis and Applications , 1998, Machine Learning.

[13]  Andrew W. Fitzgibbon,et al.  KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera , 2011, UIST.

[14]  Dieter Fox,et al.  RGB-D mapping: Using Kinect-style depth cameras for dense 3D modeling of indoor environments , 2012, Int. J. Robotics Res..

[15]  Sung-Kee Park,et al.  Human augmented mapping for indoor environments using a stereo camera , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.