Stair detection and tracking from egocentric stereo vision

In this work we present a real-time approach to capture the properties of staircases from a free moving, head mounted stereo-camera. A variety of systems can profit from such ability, examples range from robots in multi-floor exploration scenarios to wearable assistance systems for the visually impaired. We introduce a light-weight method to measure the individual steps and use this information to update a minimal stair model while approaching and traversing the stair. Results are evaluated on an in- and outdoor scenario and show competitive accuracy to state of the art approaches working on precise lidar-sensors.

[1]  Roberto Manduchi,et al.  Detection and Localization of Curbs and Stairways Using Stereo Vision , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[2]  Penny Probert Smith,et al.  Robotic sensing for the partially sighted , 1999, Robotics Auton. Syst..

[3]  Jean-Philippe Tardif,et al.  Non-iterative approach for fast and accurate vanishing point detection , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[4]  Maren Bennewitz,et al.  From 3D point clouds to climbing stairs: A comparison of plane segmentation approaches for humanoids , 2011, 2011 11th IEEE-RAS International Conference on Humanoid Robots.

[5]  Han Wang,et al.  2D staircase detection using real AdaBoost , 2009, 2009 7th International Conference on Information, Communications and Signal Processing (ICICS).

[6]  Julius Ziegler,et al.  StereoScan: Dense 3d reconstruction in real-time , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[7]  Harold W. Kuhn,et al.  The Hungarian method for the assignment problem , 1955, 50 Years of Integer Programming.

[8]  Friedrich Fraundorfer,et al.  Visual Odometry Part I: The First 30 Years and Fundamentals , 2022 .

[9]  Josechu J. Guerrero,et al.  Detection and Modelling of Staircases Using a Wearable Depth Sensor , 2014, ECCV Workshops.

[10]  Michael Brady,et al.  Vision-based Detection of Kerbs and Steps , 1997, BMVC.

[11]  James R. Bergen,et al.  Visual odometry , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[12]  Wai Ho Li,et al.  Plane-based detection of staircases using inverse depth , 2012, ICRA 2012.

[13]  Martin Lauer,et al.  Robust ground plane tracking in cluttered environments from egocentric stereo vision , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[14]  Kang-Hyun Jo,et al.  Stairway segmentation using Gabor Filter and vanishing point , 2011, 2011 IEEE International Conference on Mechatronics and Automation.

[15]  Masahiro Fujita,et al.  Stair climbing for humanoid robots using stereo vision , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[16]  Joel A. Hesch,et al.  Descending-stair detection, approach, and traversal with an autonomous tracked vehicle , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  Gérard G. Medioni,et al.  Real-time staircase detection from a wearable stereo system , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[18]  G. Medioni,et al.  Piecewise Planar Modeling for Step Detection using Stereo Vision , 2008 .

[19]  Philip David,et al.  Ascending stairway modeling from dense depth imagery for traversability analysis , 2013, 2013 IEEE International Conference on Robotics and Automation.