Robust stairway-detection and localization method for mobile robots using a graph-based model and competing initializations

One of the major challenges for mobile robots in human-shaped environments is navigating stairways. This study presents a method for accurately detecting, localizing, and estimating the characteristics of stairways using point cloud data. The main challenge is the wide variety of different structures and shapes of stairways. This challenge is often aggravated by an unfavorable position of the sensor, which leaves large parts of the stairway occluded. This can be further aggravated by sparse point data. We overcome these difficulties by introducing a three-dimensional graph-based stairway-detection method combined with competing initializations. The stairway graph characterizes the general structural design of stairways in a generic way that can be used to describe a large variety of different stairways. By using multiple ways to initialize the graph, we can robustly detect stairways even if parts of the stairway are occluded. Furthermore, by letting the initializations compete against each other, we find the best initialization that accurately describes the measured stairway. The detection algorithm utilizes a plane-based approach. We also investigate different planar segmentation algorithms and experimentally compare them in an application-orientated manner. Our system accurately detects and estimates the stairway parameters with an average error of only 2 . 5 mm for a variety of stairways including ascending, descending, and spiral stairways. Our method works robustly with different depth sensors for either small- or large-scale environments and for dense and sparse point cloud data. Despite this generality, our system’s accuracy is higher than most state-of-the-art stairway-detection methods.

[1]  Steffen Fuchs,et al.  Efficient segmentation and surface classification of range images , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[2]  Kris K. Hauser,et al.  Identifying support surfaces of climbable structures from 3D point clouds , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[3]  Sven Behnke,et al.  Learning depth-sensitive conditional random fields for semantic segmentation of RGB-D images , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[4]  Roberto Manduchi,et al.  CC-RANSAC: Fitting planes in the presence of multiple surfaces in range data , 2011, Pattern Recognit. Lett..

[5]  刘霁,et al.  A stairway detection algorithm based on vision for UGV stair climbing , 2008 .

[6]  Rajesh Elara Mohan,et al.  A staircase detection method for 3D point clouds , 2014, 2014 13th International Conference on Control Automation Robotics & Vision (ICARCV).

[7]  Markus Vincze,et al.  Fast semantic segmentation of 3D point clouds using a dense CRF with learned parameters , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[8]  Kazunori Ohno,et al.  Fog removal using laser beam penetration, laser intensity, and geometrical features for 3D measurements in fog-filled room , 2016, Adv. Robotics.

[9]  Martin Lauer,et al.  Detection of ascending stairs using stereo vision , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[10]  Wai Ho Li,et al.  Plane-based detection of staircases using inverse depth , 2012, ICRA 2012.

[11]  Takashi Kato,et al.  Study on stairs detection using RGB-depth images , 2014, 2014 Joint 7th International Conference on Soft Computing and Intelligent Systems (SCIS) and 15th International Symposium on Advanced Intelligent Systems (ISIS).

[12]  Helge J. Ritter,et al.  Realtime 3D segmentation for human-robot interaction , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Markus Vincze,et al.  Learning of perceptual grouping for object segmentation on RGB-D data , 2014, J. Vis. Commun. Image Represent..

[14]  Reinhard Klein,et al.  Efficient RANSAC for Point‐Cloud Shape Detection , 2007, Comput. Graph. Forum.

[15]  Josechu J. Guerrero,et al.  Detection and Modelling of Staircases Using a Wearable Depth Sensor , 2014, ECCV Workshops.

[16]  Kazunori Ohno,et al.  Development of 3D laser scanner for measuring uniform and dense 3D shapes of static objects in dynamic environment. , 2009, 2008 IEEE International Conference on Robotics and Biomimetics.

[17]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[18]  Vineet R. Kamat,et al.  Fast plane extraction in organized point clouds using agglomerative hierarchical clustering , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[19]  Maren Bennewitz,et al.  From 3D point clouds to climbing stairs: A comparison of plane segmentation approaches for humanoids , 2011, 2011 11th IEEE-RAS International Conference on Humanoid Robots.

[20]  Sven Behnke,et al.  Real-Time Plane Segmentation Using RGB-D Cameras , 2012, RoboCup.

[21]  Wei Wang,et al.  Stairway detection using Gabor Filter and FFPG , 2011, 2011 International Conference of Soft Computing and Pattern Recognition (SoCPaR).

[22]  Ren C. Luo,et al.  Multisensor integrated stair recognition and parameters measurement system for dynamic stair climbing robots , 2013, 2013 IEEE International Conference on Automation Science and Engineering (CASE).

[23]  Philip David,et al.  Ascending stairway modeling from dense depth imagery for traversability analysis , 2013, 2013 IEEE International Conference on Robotics and Automation.

[24]  Cang Ye,et al.  3D object recognition by geometric context and Gaussian-Mixture-Model-based plane classification , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[25]  Markus Vincze,et al.  Enhancing Semantic Segmentation for Robotics: The Power of 3-D Entangled Forests , 2016, IEEE Robotics and Automation Letters.

[26]  Bärbel Mertsching,et al.  3D graph based stairway detection and localization for mobile robots , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[27]  J. Srinonchat,et al.  Development Image Processing Technique for Climbing Stair of Small Humaniod Robot , 2008, 2008 International Conference on Computer Science and Information Technology.

[28]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Keiji Nagatani,et al.  Trials of 3-D map construction using the tele-operated tracked vehicle kenaf at disaster city , 2010, 2010 IEEE International Conference on Robotics and Automation.

[30]  Y. Tseng,et al.  LIDAR DATA SEGMENTATION AND CLASSIFICATION BASED ON OCTREE STRUCTURE , 2004 .

[31]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[32]  Aleksandra Pizurica,et al.  Obstacle detection for pedestrians with a visual impairment based on 3D imaging , 2013, 2013 International Conference on 3D Imaging.

[33]  Nico Blodow,et al.  Learning informative point classes for the acquisition of object model maps , 2008, 2008 10th International Conference on Control, Automation, Robotics and Vision.

[34]  Zoltan-Csaba Marton,et al.  Hierarchical object geometric categorization and appearance classification for mobile manipulation , 2010, 2010 10th IEEE-RAS International Conference on Humanoid Robots.

[35]  C. Ye,et al.  NCC-RANSAC: A fast plane extraction method for navigating a smart cane for the visually impaired , 2013, 2013 IEEE International Conference on Automation Science and Engineering (CASE).

[36]  Bastian Leibe,et al.  Dense 3D semantic mapping of indoor scenes from RGB-D images , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).