Indoor navigation assistance system for visually impaired people using multimodal technologies

In this paper, a complete indoor navigation assistance system for visually impaired people is introduced. Different multimedia technologies are integrated in a single system in order to provide a precise, safe and friendly navigation service. First, the environment is modeled and represented. After that, the user location is determined by combining Wi-Fi and vision information. This combination offers some benefits in comparison with single technology systems such as setup cost, computational time and accuracy. Finally, the interaction between users and the system is performed through natural Vietnamese language with the support of Vietnamese voice synthesis and recognition. The proposed the system has been successfully deployed in a school for visually impaired pupils. Evaluation with various criteria on visually impaired pupils reveals the feasibility of the solution.

[1]  Eric Castelli,et al.  Multimodal Combination of GPS, WiFi, RFID and Step Count for User Localization , 2014 .

[2]  Pieter Hintjens,et al.  ZeroMQ: Messaging for Many Applications , 2013 .

[3]  R. Mautz.  Indoor Positioning Technologies , 2012 .

[4]  Do Dat Tran,et al.  Non-uniform unit selection in Vietnamese speech synthesis , 2011, SoICT '11.

[5]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[6]  Richard E. Korf,et al.  Depth-First Iterative-Deepening: An Optimal Admissible Tree Search , 1985, Artif. Intell..

[7]  Nils J. Nilsson,et al.  A Formal Basis for the Heuristic Determination of Minimum Cost Paths , 1968, IEEE Trans. Syst. Sci. Cybern..

[8]  Hossam S. Hassanein,et al.  3D Passive Tag Localization Schemes for Indoor RFID Applications , 2010, 2010 IEEE International Conference on Communications.

[9]  Xiaodong Yang,et al.  Toward a computer vision-based wayfinding aid for blind persons to access unfamiliar indoor environments , 2012, Machine Vision and Applications.

[10]  Luis A. Guerrero,et al.  An Indoor Navigation System for the Visually Impaired , 2012, Sensors.

[11]  N. A. Bradley,et al.  Assistive Technology For Visually Impaired And Blind People , 2008 .

[12]  Hai Vu,et al.  A Robust Shadow Removal Technique Applying For Person Localization in a Surveillance Environment , 2015, SoICT.

[13]  Joëlle Coutaz.  PAC: AN OBJECT ORIENTED MODEL FOR IMPLEMENTING USER INTERFACES , 1987 .

[14]  Zoran Zivkovic,et al.  Improved adaptive Gaussian mixture model for background subtraction , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[15]  Arne Jönsson,et al.  Wizard of Oz studies: why and how , 1993, IUI '93.