Ascending stairway modeling from dense depth imagery for traversability analysis

Localization and modeling of stairways by mobile robots can enable multi-floor exploration for those platforms capable of stair traversal. Existing approaches focus on either stairway detection or traversal, but do not address these problems in the context of path planning for the autonomous exploration of multi-floor buildings. We propose a system for detecting and modeling ascending stairways while performing simultaneous localization and mapping, such that the traversability of each stairway can be assessed by estimating its physical properties. The long-term objective of our approach is to enable exploration of multiple floors of a building by allowing stairways to be considered during path planning as traversable portals to new frontiers. We design a generative model of a stairway as a single object. We localize these models with respect to the map, and estimate the dimensions of the stairway as a whole, as well as its steps. With these estimates, a robot can determine if the stairway is traversable based on its climbing capabilities. Our system consists of two parts: a computationally efficient detector that leverages geometric cues from dense depth imagery to detect sets of ascending stairs, and a stairway modeler that uses multiple detections to infer the location and parameters of a stairway that is discovered during exploration. We demonstrate the performance of this system when deployed on several mobile platforms using a Microsoft Kinect sensor.

[1]  Roberto Manduchi,et al.  Detection and Localization of Curbs and Stairways Using Stereo Vision , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[2]  Philip David,et al.  Toward Autonomous Multi-floor Exploration: Ascending Stairway Localization and Modeling , 2013 .

[3]  Joel A. Hesch,et al.  Descending-stair detection, approach, and traversal with an autonomous tracked vehicle , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Yandong Tang,et al.  A Stairway Detection Algorithm based on Vision for UGV Stair Climbing , 2008, 2008 IEEE International Conference on Networking, Sensing and Control.

[5]  Han Wang,et al.  2D staircase detection using real AdaBoost , 2009, 2009 7th International Conference on Information, Communications and Signal Processing (ICICS).

[6]  Hamid D. Taghirad,et al.  Autonomous staircase detection and stair climbing for a tracked mobile robot using fuzzy controller , 2009, 2008 IEEE International Conference on Robotics and Biomimetics.

[7]  M. Brunner,et al.  Towards autonomously traversing complex obstacles with mobile robots with adjustable chassis , 2012, Proceedings of the 13th International Carpathian Control Conference (ICCC).

[8]  Stergios I. Roumeliotis,et al.  Autonomous Stair Climbing for Tracked Vehicles , 2007, Int. J. Robotics Res..

[9]  Nico Blodow,et al.  Towards 3D Point cloud based object maps for household environments , 2008, Robotics Auton. Syst..

[10]  Jizhong Xiao,et al.  Mapping of multi-floor buildings: A barometric approach , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Kang-Hyun Jo,et al.  Outdoor stairway segmentation using vertical vanishing point and directional filter , 2010, International Forum on Strategic Technology 2010.

[12]  Aaron M. Johnson,et al.  Autonomous legged hill and stairwell ascent , 2011, 2011 IEEE International Symposium on Safety, Security, and Rescue Robotics.

[13]  Subhasis Bhaumik,et al.  On Design and Development of an Intelligent Mobile Robotic Vehicle for Stair-Case Navigation , 2010, Intelligent Autonomous Systems.

[14]  G. Medioni,et al.  Piecewise Planar Modeling for Step Detection using Stereo Vision , 2008 .

[15]  Kang-Hyun Jo,et al.  Stairway detection based on single camera by motion stereo , 2011, IEA/AIE'11.

[16]  Maren Bennewitz,et al.  From 3D point clouds to climbing stairs: A comparison of plane segmentation approaches for humanoids , 2011, 2011 11th IEEE-RAS International Conference on Humanoid Robots.

[17]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[18]  Yoon Keun Kwak,et al.  Obstacle negotiation for the rescue robot with variable single-tracked mechanism , 2007, 2007 IEEE/ASME international conference on advanced intelligent mechatronics.

[19]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[20]  Vijay Kumar,et al.  Autonomous multi-floor indoor navigation with a computationally constrained MAV , 2011, 2011 IEEE International Conference on Robotics and Automation.

[21]  Maren Bennewitz,et al.  Autonomous climbing of spiral staircases with humanoids , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.