Pedestrian Navigation System for Visually Impaired People Using HoloLens and RFID

This research proposes a wearable system to help visually impaired people navigate while avoiding obstructions. Visually impaired people require a highly accurate navigation system to obtain reliable positioning. Thus, we offer a positioning method using radio frequency identification (RFID) and the quasi-zenith satellite system (QZSS) to improve positioning accuracy. Our navigation system needs to also recognize the surrounding environment and the direction users are facing, and it must carefully help navigate around obstacles. We use Microsoft HoloLens to detect the direction the user is facing and to locate a walkable path that avoids obstruction. HoloLens has multiple cameras and a depth sensor for positioning and mapping. The system navigates by combining the global area path (via RFID and QZSS) and the local area path (via HoloLens). In this paper, we describe system construction and approach, and we present results of demonstrations.

[1]  Akihiro Yamashita,et al.  Development of a Pedestrian Navigation System for the Visually Impaired with QZSS and RFID , 2016, 2016 Joint 8th International Conference on Soft Computing and Intelligent Systems (SCIS) and 17th International Symposium on Advanced Intelligent Systems (ISIS).

[2]  Laura Giarré,et al.  Enabling independent navigation for visually impaired people through a wearable vision-based feedback system , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[3]  Andrew W. Fitzgibbon,et al.  KinectFusion: Real-time dense surface mapping and tracking , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[4]  Hugh F. Durrant-Whyte,et al.  A solution to the simultaneous localization and map building (SLAM) problem , 2001, IEEE Trans. Robotics Autom..