A Single Frame Depth Visual Gyroscope and its Integration for Robot Navigation and Mapping in Structured Indoor Environments

An accurate navigation system is an essential and important part for the mobile robot. The recent appearance of low cost RGBD cameras has made 3D point clouds together with RGB information easy accessible, and they have been widely applied in many applications. Relative poses of a mobile robot can be estimated from consecutive visual information. However, such incremental registration methods still suffer from accumulated errors which makes the estimated trajectory as weird as by only using wheel mounted encoders. In contrast, we introduce a novel and inexpensive sensor fusion based approach to solve the robot localization problem. The key idea is to use visual gyroscope as a complementary source for robot heading estimation. Aided with constraints, the unscented Kalman filter is used for robot pose estimation. A field experiment has been carried out in order to verify the introduced method. Accordingly, the 3D map of the environment is also presented based on the estimated robot trajectory.

[1]  Tom Drummond,et al.  A Single-frame Visual Gyroscope , 2005, BMVC.

[2]  Kotaro Hirasawa,et al.  A comparison of SLAM implementations for indoor mobile robots , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Andrew W. Fitzgibbon,et al.  KinectFusion: Real-time dense surface mapping and tracking , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[4]  C. Chandrasekar,et al.  A Comparison of various Edge Detection Techniques used in Image Processing , 2012 .

[5]  Milan Sonka,et al.  Image Processing, Analysis and Machine Vision , 1993, Springer US.

[6]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[7]  Ruizhi Chen,et al.  Effect of camera characteristics on the accuracy of a visual gyroscope for indoor pedestrian navigation , 2012, 2012 Ubiquitous Positioning, Indoor Navigation, and Location Based Service (UPINLBS).

[8]  Liqiang Feng,et al.  Gyrodometry: a new method for combining data from gyros and odometry in mobile robots , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[9]  Hubert Roth,et al.  Plane Extraction and Map Building Using a Kinect Equipped Mobile Robot , 2012 .

[10]  D. Simon Kalman filtering with state constraints: a survey of linear and nonlinear algorithms , 2010 .

[11]  G. T. Shrivakshan,et al.  A Comparison of various Edge Detection Techniques used in Image Processing , 2012 .

[12]  Alan L. Yuille,et al.  Manhattan World: compass direction from a single image by Bayesian inference , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[13]  Daniel Cremers,et al.  Robust odometry estimation for RGB-D cameras , 2013, 2013 IEEE International Conference on Robotics and Automation.

[14]  Ruizhi Chen,et al.  Visual-aided Two-dimensional Pedestrian Indoor Navigation with a Smartphone , 2011 .

[15]  Sebastian Thrun,et al.  6D SLAM with an application in autonomous mine mapping , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[16]  Johann Borenstein,et al.  Accurate mobile robot dead-reckoning with a precision-calibrated fiber-optic gyroscope , 2001, IEEE Trans. Robotics Autom..

[17]  Chen Feng,et al.  SLAM using both points and planes for hand-held 3D sensors , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[18]  Reinhard Koch,et al.  Time-of-Flight sensor calibration for accurate range sensing , 2010, Comput. Vis. Image Underst..

[19]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Hyungsuck Cho,et al.  Visual gyroscope: Integration of visual information with gyroscope for attitude measurement of mobile platform , 2008, 2008 International Conference on Control, Automation and Systems.

[21]  Chen Feng,et al.  Point-plane SLAM for hand-held 3D sensors , 2013, 2013 IEEE International Conference on Robotics and Automation.

[22]  Andrew Zisserman,et al.  MLESAC: A New Robust Estimator with Application to Estimating Image Geometry , 2000, Comput. Vis. Image Underst..

[23]  B. Caprile,et al.  Using vanishing points for camera calibration , 1990, International Journal of Computer Vision.