Simple Smartphone-Based Guiding System for Visually Impaired People

Visually impaired people are often unaware of dangers in front of them, even in familiar environments. Furthermore, in unfamiliar environments, such people require guidance to reduce the risk of colliding with obstacles. This study proposes a simple smartphone-based guiding system for solving the navigation problems for visually impaired people and achieving obstacle avoidance to enable visually impaired people to travel smoothly from a beginning point to a destination with greater awareness of their surroundings. In this study, a computer image recognition system and smartphone application were integrated to form a simple assisted guiding system. Two operating modes, online mode and offline mode, can be chosen depending on network availability. When the system begins to operate, the smartphone captures the scene in front of the user and sends the captured images to the backend server to be processed. The backend server uses the faster region convolutional neural network algorithm or the you only look once algorithm to recognize multiple obstacles in every image, and it subsequently sends the results back to the smartphone. The results of obstacle recognition in this study reached 60%, which is sufficient for assisting visually impaired people in realizing the types and locations of obstacles around them.

[1]  RUN,et al.  Naveye A Guiding System for Blinds , 2015 .

[2]  Ahmed F. Seddik,et al.  Assistive infrared sensor based smart stick for blind people , 2015, 2015 Science and Information Conference (SAI).

[3]  Luis Nieto,et al.  Design and implementation of elctronic aid to blind's cane , 2014, 2014 III International Congress of Engineering Mechatronics and Automation (CIIMA).

[4]  Ching-Tang Hsieh,et al.  An Indoor Obstacle Detection System Using Depth Information and Region Growth , 2015, Sensors.

[5]  Steve Mann,et al.  Blind navigation with a wearable range camera and vibrotactile helmet , 2011, ACM Multimedia.

[6]  Jian Sun,et al.  Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Manjunatha Mahadevappa,et al.  Design, Development, and Clinical Evaluation of the Electronic Mobility Cane for Vision Rehabilitation , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[8]  Shraddha Bunnan,et al.  ULTRSONIC BLIND WALKING STICK FOR THE VISUALLY IMPAIRED , 2016 .

[9]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Han Wang,et al.  2D staircase detection using real AdaBoost , 2009, 2009 7th International Conference on Information, Communications and Signal Processing (ICICS).

[11]  Koen E. A. van de Sande,et al.  Segmentation as selective search for object recognition , 2011, 2011 International Conference on Computer Vision.

[12]  Jianguo Zhang,et al.  The PASCAL Visual Object Classes Challenge , 2006 .

[13]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[14]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[15]  Zaw Min Naing,et al.  RFID-based Audio Guidance Cane for Blind and Visually Impaired Person , 2014 .

[16]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[17]  N. Tripathi,et al.  Design of Smart Voice Guiding and Location Indicator System for Visually Impaired and Disabled Person : The Artificial Vision System , GSM , GPRS , GPS , Cloud Computing , 2016 .

[18]  Nicolas Vuillerme,et al.  Obstacle detection and warning system for visually impaired people based on electrode matrix and mobile Kinect , 2015, Vietnam Journal of Computer Science.

[19]  Li Jiang,et al.  The Research on Blind Navigation System Based on RFID , 2007, 2007 International Conference on Wireless Communications, Networking and Mobile Computing.

[20]  João Barroso,et al.  Blind Guide: An Ultrasound Sensor-based Body Area Network for Guiding Blind People , 2015, DSAI.

[21]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  A. S. Al-Fahoum,et al.  A Smart Infrared Microcontroller-Based Blind Guidance System , 2013 .

[23]  Anushree Harsur Voice Based Navigation System for Blind People Using Ultrasonic Sensor , 2015 .

[24]  João Barroso,et al.  Blind Navigation Support System based on Microsoft Kinect , 2012, DSAI.

[25]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Olivier Stasse,et al.  MonoSLAM: Real-Time Single Camera SLAM , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Yiting Yi,et al.  A design of blind-guide crutch based on multi-sensors , 2015, 2015 12th International Conference on Fuzzy Systems and Knowledge Discovery (FSKD).

[28]  Jizhong Xiao,et al.  Being Aware of the World: Toward Using Social Media to Support the Blind With Navigation , 2015, IEEE Transactions on Human-Machine Systems.

[29]  Mohamed Manoufali,et al.  Smart guide for blind people , 2011, The 2011 International Conference and Workshop on Current Trends in Information Technology (CTIT 11).