Computer vision guidance system for indoor navigation of visually impaired people

Visually Impaired (VI) and blind people suffer from reduced mobility, as they cannot detect the terrain and their environment. They always need assistance and walking support systems in their daily life. Solutions have been proposed many decades ago and are rapidly improving nowadays due to the technology evolution and integration. A large number of assistance aids have been deployed in real life situations whereas other concepts remained as research ideas. This paper describes a new approach of an ambient navigation system that would help the visually impaired or blind person to move freely indoor (house, office, etc.) without the assistance of anyone. The system is composed of IP cameras attached to the ceiling of each room and the smart phone of the subject is used as human machine interface (HMI). Frames are sent to a computer that analyzes the environment, detects and recognizes objects. A computer vision guidance algorithm is designed to help the user reach his destination (or his personal item) with obstacle detection. The system is commanded by voice messages via a simple mobile application. Feedbacks (alerts, route) are voice messages returns by the application to the user. This system provides a reliable solution to assist those users in their indoor navigation providing them a correct route with obstacle avoidance.

[1]  Charles M. Higgins,et al.  A Navigation Aid for the Blind Using Tactile-Visual Sensory Substitution , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[2]  R. Golledge.  Geography and the disabled: a survey with special reference to vision impaired and blind populations , 1993 .

[3]  Constantinos Mavroidis,et al.  Tactile Feedback Navigation Handle for the Visually Impaired , 2004 .

[4]  Peter B. L. Meijer,et al.  An experimental system for auditory image representations , 1992, IEEE Transactions on Biomedical Engineering.

[5]  Iwan Ulrich,et al.  The GuideCane-applying mobile robot technologies to assist the visually impaired , 2001, IEEE Trans. Syst. Man Cybern. Part A.

[6]  Shraga Shoval,et al.  Mobile robot obstacle avoidance in a computerized travel aid for the blind , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[7]  Thomas Ertl,et al.  Design and development of an indoor navigation and object identification system for the blind , 2004, ACM SIGACCESS Access. Comput..

[8]  Tetsuo Ono,et al.  CyARM: an alternative aid device for blind persons , 2005, CHI Extended Abstracts.

[9]  J. M. Hans du Buf,et al.  The SmartVision local navigation aid for blind and visually impaired persons , 2011 .

[10]  Ling Li,et al.  A Smartphone-Based Obstacle Sensor for the Visually Impaired , 2010, UIC.

[11]  Roberto Manduchi,et al.  A Tool for Range Sensing and Environment Discovery for the Blind , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[12]  Sazali Yaacob,et al.  Fuzzy image processing scheme for autonomous navigation of human blind , 2007, Appl. Soft Comput..

[13]  T. Ifukube,et al.  A blind mobility aid modeled after echolocation of bats , 1991, IEEE Transactions on Biomedical Engineering.

[14]  Nikolaos G. Bourbakis,et al.  A 2D Vibration Array as an Assistive Device for Visually Impaired , 2007, 2007 IEEE 7th International Symposium on BioInformatics and BioEngineering.

[15]  Penny Probert Smith,et al.  A stereo vision-based aid for the visually impaired , 1998, Image Vis. Comput..

[16]  Nikolaos G. Bourbakis,et al.  Wearable Obstacle Avoidance Electronic Travel Aids for Blind: A Survey , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).