Classification of ascending steps and stairs using Time-of-Flight sensor data

This paper proposes a method to analyse human-made environments in order to verify the presence of ascending steps or stairs. Our system is intended to assist visually impaired people by providing acoustic information about the scene in front of a low-resolution Time-of-Flight (ToF) camera that is fixed to a mobile vehicle (rollator). Detailed instructions to the user about potentially hazardous situations are provided. This paper in particular deals with a fast approach on classification of ascending steps in 3D point clouds. This method is part of a system that aims on enhancing visually impaired persons understand the environment and help prevent collisions.

[1]  Aleksandra Pizurica,et al.  Obstacle detection for pedestrians with a visual impairment based on 3D imaging , 2013, 2013 International Conference on 3D Imaging.

[2]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[3]  João Barroso,et al.  Blind Navigation Support System based on Microsoft Kinect , 2012, DSAI.

[4]  Josechu J. Guerrero,et al.  Detection and Modelling of Staircases Using a Wearable Depth Sensor , 2014, ECCV Workshops.

[5]  Luis Miguel Bergasa,et al.  Assisting the Visually Impaired: Obstacle Detection and Warning System by Acoustic Feedback , 2012, Sensors.

[6]  Gerd Hirzinger,et al.  Extrinsic and depth calibration of ToF-cameras , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Wai Ho Li,et al.  Plane-based detection of staircases using inverse depth , 2012, ICRA 2012.

[8]  Shuihua Wang,et al.  Detecting stairs and pedestrian crosswalks for the blind by RGBD camera , 2012, 2012 IEEE International Conference on Bioinformatics and Biomedicine Workshops.

[9]  Anton Kummert,et al.  Descending step classification using time-of-flight sensor data , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[10]  João Barroso,et al.  Obstacle Detection using Stereo Imaging to Assist the Navigation of Visually Impaired People , 2012, DSAI.

[11]  S. Foix,et al.  Lock-in Time-of-Flight (ToF) Cameras: A Survey , 2011, IEEE Sensors Journal.

[12]  Joel A. Hesch,et al.  Descending-stair detection, approach, and traversal with an autonomous tracked vehicle , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Yandong Tang,et al.  A Stairway Detection Algorithm based on Vision for UGV Stair Climbing , 2008, 2008 IEEE International Conference on Networking, Sensing and Control.

[14]  Michael Brady,et al.  Vision-based Detection of Stair-cases , 2003 .

[15]  Radu Bogdan Rusu,et al.  Semantic 3D Object Maps for Everyday Manipulation in Human Living Environments , 2010, KI - Künstliche Intelligenz.