Door detection in images of 3D scenes in an electronic travel aid for the blind

In this paper we propose a fast method for detecting doors in images of 3D scenes. First, the equation estimating the orientation and location of the ground surface is computed. This information is used in further processing steps of the algorithm. Then, the edge image is calculated (using the Canny edge detector) and line segments justifying predefined conditions are searched for by applying the Probabilistic Hough Transform method. Pairs of parallel line segments perpendicular to the ground surface located at a distance range 80–110 cm are identified. The detection performance has been also enhanced by detecting door handles. The proposed method was successfully verified on the recorded indoor RGB-D video sequences acquired by a vision based Electronic Travel Aid (ETA) for the blind. The achieved door detection performance for the tested sequences is at a level of 63% for sensitivity and 84% for positive predictivity values.

[1]  Erkki Oja,et al.  Probabilistic and non-probabilistic Hough transforms: overview and comparisons , 1995, Image Vis. Comput..

[2]  Pawel Strumillo,et al.  Verification of visual odometry algorithms with an OpenGL-based software tool , 2015, J. Electronic Imaging.

[3]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[4]  Nikolaos G. Bourbakis,et al.  Wearable Obstacle Avoidance Electronic Travel Aids for Blind: A Survey , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[5]  Helin Dutagaci,et al.  Rule-Based Door Detection Using Laser Range Data in Indoor Environments , 2015, 2015 IEEE 27th International Conference on Tools with Artificial Intelligence (ICTAI).

[6]  Yimin Zhou,et al.  Kinect depth image based door detection for autonomous indoor navigation , 2014, The 23rd IEEE International Symposium on Robot and Human Interactive Communication.

[7]  Fazida Hanim Hashim,et al.  An automated 3D scanning algorithm using depth cameras for door detection , 2015, 2015 International Electronics Symposium (IES).

[8]  Runar Unnthorsson,et al.  Different Approaches to Aiding Blind Persons in Mobility and Navigation in the “Naviton” and “Sound of Vision” Projects , 2018 .

[9]  Sven Wachsmuth,et al.  Automated Door Detection with a 3D-Sensor , 2014, 2014 Canadian Conference on Computer and Robot Vision.

[10]  M. Balakrishnan,et al.  'Smart' Cane for the Visually Impaired: Design and Controlled Field Testing of an Affordable Obstacle Detection System , 2010 .

[11]  Pawel Strumillo,et al.  Enhancing Positioning Accuracy in Urban Terrain by Fusing Data from a GPS Receiver, Inertial Sensors, Stereo-Camera and Digital Maps for Pedestrian Navigation , 2012, Sensors.

[12]  Baranski Przemyslaw,et al.  Enhancing Positioning Accuracy in Urban Terrain by Fusing Data from a GPS Receiver, Inertial Sensors, Stereo-Camera and Digital Maps for Pedestrian Navigation , 2012, Sensors.

[13]  Farid Melgani,et al.  Geometric model for vision-based door detection , 2014, 2014 9th International Conference on Computer Engineering & Systems (ICCES).

[14]  Simone Spagnol,et al.  MODEL-BASED OBSTACLE SONIFICATION FOR THE NAVIGATION OF VISUALLY IMPAIRED PERSONS , 2016 .

[15]  João M. F. Rodrigues,et al.  Realtime Local Navigation for the Blind: Detection of Lateral Doors and Sound Interface , 2012, DSAI.

[16]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[17]  Zhichao Chen,et al.  Visual detection of lintel-occluded doors from a single image , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[18]  Richard S. Stephens,et al.  Probabilistic approach to the Hough transform , 1991, Image Vis. Comput..

[19]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  J.-Y. Bouguet,et al.  Pyramidal implementation of the lucas kanade feature tracker , 1999 .

[21]  Piotr Korbel,et al.  Wireless indoor positioning system for the visually impaired , 2013, 2013 Federated Conference on Computer Science and Information Systems.

[22]  N. A. Bradley,et al.  Assistive Technology For Visually Impaired And Blind People , 2008 .

[23]  François Pasteau,et al.  Simple monocular door detection and tracking , 2013, 2013 IEEE International Conference on Image Processing.

[24]  Yunhao Liu,et al.  LMDD: Light-Weight Magnetic-Based Door Detection with Your Smartphone , 2015, 2015 44th International Conference on Parallel Processing.