Research advances of indoor navigation for blind people: A brief review of technological instrumentation

Blind persons need electronic traveling aid (ETA) solutions for better orientation and navigation in unfamiliar indoor environments, with embedded features for detection and recognition of both obstacles and desired destinations such as rooms, staircases, and elevators. Because the use of GPS for locational references is impractical indoors, the development of such navigation systems is challenging and requires a systematic review and evaluation of different technological approaches. Using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) method, we evaluated and compared current research papers that deal with the prototyping of assistive devices (visual sensory perception substitution with audio and haptic signals) for blind and visually impaired persons. We conducted an instructional assessment of selected indoor navigation prototypes using three main criteria: navigation technologies, sensors, and computer vision approaches. For the latter category, we conducted a separate systematic review, as papers in this research area primarily specialize in software computer vision solutions rather than hardware. The paper provides useful insights for researchers regarding technological instrumentation for the development of ETA solutions for blind and visually impaired (VI) persons in the field of indoor orientation and navigation.

[1]  Md. Iftekhar Islam,et al.  An Indoor Navigation System for Visually Impaired People Using a Path Finding Algorithm and a Wearable Cap , 2018, 2018 3rd International Conference for Convergence in Technology (I2CT).

[2]  CO Manlises,et al.  Indoor navigation system based on computer vision using CAMShift and D* algorithm for visually impaired , 2016, 2016 6th IEEE International Conference on Control System, Computing and Engineering (ICCSCE).

[3]  Ibrahim Khalil,et al.  Accurate positioning using long range active RFID technology to assist visually impaired people , 2014, J. Netw. Comput. Appl..

[4]  Titus Zaharia,et al.  Wearable assistive devices for visually impaired: A state of the art survey , 2020, Pattern Recognit. Lett..

[5]  Juyang Weng,et al.  Mobile Device Based Outdoor Navigation with On-Line Learning Neural Network: A Comparison with Convolutional Neural Network , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[6]  Shueng-Han Gary Chan,et al.  Wi-Fi Fingerprint-Based Indoor Positioning: Recent Advances and Comparisons , 2016, IEEE Communications Surveys & Tutorials.

[7]  Marcantonio Catelani,et al.  Metrological characterization of infrared sensor and application on drone anti-collision system , 2016, 2016 IEEE Metrology for Aerospace (MetroAeroSpace).

[8]  B. V. Uma,et al.  An Electronic Smart Jacket for the Navigation of Visually Impaired Society , 2018 .

[9]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[10]  Daniela Rus,et al.  Safe Local Navigation for Visually Impaired Users With a Time-of-Flight and Haptic Feedback Device , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[11]  Muhammad Tahir,et al.  Improving the Accuracy of Human Body Orientation Estimation With Wearable IMU Sensors , 2017, IEEE Transactions on Instrumentation and Measurement.

[12]  Devender R. Banda,et al.  A Survey on the Use of Mobile Applications for People who Are Visually Impaired , 2017 .

[13]  Shiguo Lian,et al.  Smart guiding glasses for visually impaired people in indoor environment , 2017, IEEE Transactions on Consumer Electronics.

[14]  Josechu J. Guerrero,et al.  Stairs detection with odometry-aided traversal from a wearable RGB-D camera , 2017, Comput. Vis. Image Underst..

[15]  Eiman Kanjo,et al.  NFC based applications for visually impaired people - A review , 2014, 2014 IEEE International Conference on Multimedia and Expo Workshops (ICMEW).

[16]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[17]  Manuela Chessa,et al.  An integrated artificial vision framework for assisting visually impaired users , 2016, Comput. Vis. Image Underst..

[18]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[19]  Xiukui Li,et al.  A GPS-Based Indoor Positioning System With Delayed Repeaters , 2019, IEEE Transactions on Vehicular Technology.

[20]  Jinqiang Bai,et al.  A Cloud and Vision-based Navigation System Used for Blind People , 2017, AIACT '17.

[21]  Jessica Velasco,et al.  Voice Controlled Navigational Aid With RFID-based Indoor Positioning System for the Visually Impaired , 2018, 2018 IEEE 10th International Conference on Humanoid, Nanotechnology, Information Technology,Communication and Control, Environment and Management (HNICEM).

[22]  Kailun Yang,et al.  Long-Range Traversability Awareness and Low-Lying Obstacle Negotiation with RealSense for the Visually Impaired , 2018 .

[23]  Wilson E. Sakpere,et al.  A State-of-the-Art Survey of Indoor Positioning and Navigation Systems and Technologies , 2017, South Afr. Comput. J..

[24]  Khaled M. Elleithy,et al.  Sensor-Based Assistive Devices for Visually-Impaired People: Current Status, Challenges, and Future Directions , 2017, Sensors.

[25]  Joan García-Haro,et al.  Design, Implementation and Evaluation of an Indoor Navigation System for Visually Impaired People , 2015, Sensors.

[26]  João Barroso,et al.  Blind Guide: An Ultrasound Sensor-based Body Area Network for Guiding Blind People , 2015, DSAI.

[27]  R. Mautz Indoor Positioning Technologies , 2012 .

[28]  Yi Liu,et al.  Indoor Fingerprint Positioning Based on Wi-Fi: An Overview , 2017, ISPRS Int. J. Geo Inf..

[29]  Bruno Emile,et al.  Indoor navigation assistance with a Smartphone camera based on vanishing points , 2013, International Conference on Indoor Positioning and Indoor Navigation.

[30]  Eunjeong Ko Blind guidance system using situation information and activity-based instruction , 2013, ASSETS.

[31]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[32]  Tom Drummond,et al.  Faster and Better: A Machine Learning Approach to Corner Detection , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  José López Vicario,et al.  A Review of Pedestrian Indoor Positioning Systems for Mass Market Applications , 2017, Sensors.

[34]  Mani Shankar Prasad,et al.  Three dimensional D* algorithm for incremental path planning in uncooperative environment , 2016, 2016 3rd International Conference on Signal Processing and Integrated Networks (SPIN).

[35]  M Mahalakshmi,et al.  Real time vision based object tracking using CAMSHIFT algorithm with enhanced color image segmentation , 2010, 2010 Second International conference on Computing, Communication and Networking Technologies.

[36]  Ani Nahapetian,et al.  Wearable computing for image-based indoor navigation of the visually impaired , 2015, Wireless Health.

[37]  Ruxandra Tapu,et al.  DEEP-SEE: Joint Object Detection, Tracking and Recognition with Application to Visually Impaired Navigational Assistance , 2017, Sensors.

[38]  Saffet Vatansever,et al.  A broad overview of GPS fundamentals: Now and future , 2017, 2017 IEEE 7th Annual Computing and Communication Workshop and Conference (CCWC).

[39]  He Zhang,et al.  An indoor navigation aid for the visually impaired , 2016, 2016 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[40]  Ruxandra Tapu,et al.  A computer vision system that ensure the autonomous navigation of blind people , 2013, 2013 E-Health and Bioengineering Conference (EHB).

[41]  Gretchen A. Stevens,et al.  Magnitude, temporal trends, and projections of the global prevalence of blindness and distance and near vision impairment: a systematic review and meta-analysis. , 2017, The Lancet. Global health.

[42]  Bing Li,et al.  An Assistive Navigation Framework for the Visually Impaired , 2015, IEEE Transactions on Human-Machine Systems.

[43]  Nikolaos Doulamis,et al.  Deep Learning for Computer Vision: A Brief Review , 2018, Comput. Intell. Neurosci..

[44]  Ruxandra Tapu,et al.  When Ultrasonic Sensors and Computer Vision Join Forces for Efficient Obstacle Detection and Recognition , 2016, Sensors.

[45]  Zahid Iqbal,et al.  An efficient indoor navigation technique to find optimal route for blinds using QR codes , 2015, 2015 IEEE 10th Conference on Industrial Electronics and Applications (ICIEA).

[46]  Eun Yi Kim,et al.  A Vision-Based Wayfinding System for Visually Impaired People Using Situation Awareness and Activity-Based Instructions , 2017, Sensors.

[47]  Mohamed Lamine Mekhalfi,et al.  Recovering the Sight to blind People in indoor Environments with smart Technologies , 2016, Expert Syst. Appl..

[48]  Wilhelm Burger,et al.  Digital Image Processing - An Algorithmic Introduction using Java , 2008, Texts in Computer Science.

[49]  Georges Badr,et al.  Computer vision guidance system for indoor navigation of visually impaired people , 2016, 2016 IEEE 8th International Conference on Intelligent Systems (IS).

[50]  Andrzej Glowacz,et al.  Vision-based navigation assistance for visually impaired individuals using general purpose mobile devices , 2016, 2016 International Conference on Signals and Electronic Systems (ICSES).

[51]  Jong-Hwan Kim,et al.  Fuzzy gaze control-based navigational assistance system for visually impaired people in a dynamic indoor environment , 2015, 2015 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[52]  Ray Fontaine Recent innovations in CMOS image sensors , 2011, 2011 IEEE/SEMI Advanced Semiconductor Manufacturing Conference.

[53]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[54]  Vinod Namboodiri,et al.  GuideBeacon: Beacon-based indoor wayfinding for the blind, visually impaired, and disoriented , 2017, 2017 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[55]  Nathan Ickes,et al.  A 0.6V, 8mW 3D Vision Processor for a Navigation Device for the Visually Impaired , 2016 .

[56]  Tony Stockman,et al.  A survey of assistive technologies and applications for blind users on mobile platforms: a review and foundation for research , 2015, Journal on Multimodal User Interfaces.

[57]  M. Senthil,et al.  Real time environment perception for visually impaired , 2017, 2017 IEEE Technological Innovations in ICT for Agriculture and Rural Development (TIAR).

[58]  Rezaul K. Begg,et al.  Ultrasonic and Infrared Sensors Performance in a Wireless Obstacle Detection System , 2013, 2013 1st International Conference on Artificial Intelligence, Modelling and Simulation.

[59]  Cang Ye,et al.  Co-Robotic Cane: A New Robotic Navigation Aid for the Visually Impaired , 2016, IEEE Systems, Man, and Cybernetics Magazine.

[60]  Vicente Ferreira de Lucena,et al.  Blind user wearable audio assistance for indoor navigation based on visual markers and ultrasonic obstacle detection , 2016, 2016 IEEE International Conference on Consumer Electronics (ICCE).

[61]  Gérard G. Medioni,et al.  RGB-D camera based wearable navigation system for the visually impaired , 2016, Comput. Vis. Image Underst..

[62]  Giovanni Fusco,et al.  Towards a Sign-Based Indoor Navigation System for People with Visual Impairments , 2016, ASSETS.

[63]  Bing Li,et al.  CCNY Smart Cane , 2017, 2017 IEEE 7th Annual International Conference on CYBER Technology in Automation, Control, and Intelligent Systems (CYBER).

[64]  Hon Cheung,et al.  Localization techniques in indoor navigation system for visually impaired people , 2017, 2017 17th International Symposium on Communications and Information Technologies (ISCIT).

[65]  Yi Sun,et al.  A SLAM Based Semantic Indoor Navigation System for Visually Impaired Users , 2015, 2015 IEEE International Conference on Systems, Man, and Cybernetics.

[66]  Kristian Thorlund,et al.  The PRISMA Extension Statement for Reporting of Systematic Reviews Incorporating Network Meta-analyses of Health Care Interventions: Checklist and Explanations , 2015, Annals of Internal Medicine.

[67]  Tarun Sharma,et al.  NAVI: Navigation aid for the visually impaired , 2016, 2016 International Conference on Computing, Communication and Automation (ICCCA).